Duckietown Challenges Home Challenges Submissions

Evaluator 114

ID114
evaluatordavinci-stage-01-6.2.50
owneruser1000001
machinedavinci-stage
processdavinci-stage-01-6.2.50
version6.2.50
first heard
last heard
statusinactive
# evaluating
# success277 12041
# timeout1 13999
# failed76 12209
# error183 12666
# aborted3 12901
# host-error22 12268
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)2.8 GHz
Free % of processors98%
RAM total (MB)251.6 GB
RAM free (MB)243.4 GB
Disk (MB)491.1 GB
Disk available (MB)202.3 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, ETH_small_intersect
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
150351301Andrea Censicollision-check-exerciselx22-collision-check-valistep1failedyesdavinci-stage-01-6.2.500:02:15
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
150301297Andrea Censicollision-check-exerciselx22-collision-check-valistep1host-erroryesdavinci-stage-01-6.2.500:00:42
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.41/images/create?tag=2022_11_24_17_26_06&fromImage=registry-stage2.duckietown.org%2Fandreacensi%2Faido-submissions

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 93, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 429, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.ImageNotFound: 404 Client Error for http+docker://localhost/v1.41/images/create?tag=2022_11_24_17_26_06&fromImage=registry-stage2.duckietown.org%2Fandreacensi%2Faido-submissions: Not Found ("pull access denied for registry-stage2.duckietown.org/andreacensi/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 112, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  registry-stage2.duckietown.org/andreacensi/aido-submissions@sha256:840e7105f36db90b5d37324bdcab451125a96c2e8b8f5c02658293c659de9b5d  tag  2022_11_24_17_26_06

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 51, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull registry-stage2.duckietown.org/andreacensi/aido-submissions:2022_11_24_17_26_06@sha256:840e7105f36db90b5d37324bdcab451125a96c2e8b8f5c02658293c659de9b5d
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15028309Andrea Censiminimal-agentaido-LFV-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:02:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.099999999999983
in-drivable-lane_median5.649999999999983
driven_lanedir_consec_median0.1397956002040246
deviation-center-line_median0.09390664341773942


other stats
deviation-center-line_max0.09390664341773942
deviation-center-line_mean0.09390664341773942
deviation-center-line_min0.09390664341773942
deviation-heading_max0.9654183287874442
deviation-heading_mean0.9654183287874442
deviation-heading_median0.9654183287874442
deviation-heading_min0.9654183287874442
distance-from-start_max1.0016247187181055
distance-from-start_mean1.0016247187181055
distance-from-start_median1.0016247187181055
distance-from-start_min1.0016247187181055
driven_any_max1.0016732136326914
driven_any_mean1.0016732136326914
driven_any_median1.0016732136326914
driven_any_min1.0016732136326914
driven_lanedir_consec_max0.1397956002040246
driven_lanedir_consec_mean0.1397956002040246
driven_lanedir_consec_min0.1397956002040246
driven_lanedir_max0.1397956002040246
driven_lanedir_mean0.1397956002040246
driven_lanedir_median0.1397956002040246
driven_lanedir_min0.1397956002040246
in-drivable-lane_max5.649999999999983
in-drivable-lane_mean5.649999999999983
in-drivable-lane_min5.649999999999983
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.0016732136326914, "survival_time": 7.099999999999983, "driven_lanedir": 0.1397956002040246, "in-drivable-lane": 5.649999999999983, "deviation-heading": 0.9654183287874442, "distance-from-start": 1.0016247187181055, "deviation-center-line": 0.09390664341773942, "driven_lanedir_consec": 0.1397956002040246}}
simulation-passed1
survival_time_max7.099999999999983
survival_time_mean7.099999999999983
survival_time_min7.099999999999983
No reset possible
15023310Andrea Censiminimal-agentaido-LFV-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:03:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.099999999999983
in-drivable-lane_median5.649999999999983
driven_lanedir_consec_median0.1397956002040246
deviation-center-line_median0.09390664341773942


other stats
deviation-center-line_max0.09390664341773942
deviation-center-line_mean0.09390664341773942
deviation-center-line_min0.09390664341773942
deviation-heading_max0.9654183287874442
deviation-heading_mean0.9654183287874442
deviation-heading_median0.9654183287874442
deviation-heading_min0.9654183287874442
distance-from-start_max1.0016247187181055
distance-from-start_mean1.0016247187181055
distance-from-start_median1.0016247187181055
distance-from-start_min1.0016247187181055
driven_any_max1.0016732136326914
driven_any_mean1.0016732136326914
driven_any_median1.0016732136326914
driven_any_min1.0016732136326914
driven_lanedir_consec_max0.1397956002040246
driven_lanedir_consec_mean0.1397956002040246
driven_lanedir_consec_min0.1397956002040246
driven_lanedir_max0.1397956002040246
driven_lanedir_mean0.1397956002040246
driven_lanedir_median0.1397956002040246
driven_lanedir_min0.1397956002040246
in-drivable-lane_max5.649999999999983
in-drivable-lane_mean5.649999999999983
in-drivable-lane_min5.649999999999983
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.0016732136326914, "survival_time": 7.099999999999983, "driven_lanedir": 0.1397956002040246, "in-drivable-lane": 5.649999999999983, "deviation-heading": 0.9654183287874442, "distance-from-start": 1.0016247187181055, "deviation-center-line": 0.09390664341773942, "driven_lanedir_consec": 0.1397956002040246}}
simulation-passed1
survival_time_max7.099999999999983
survival_time_mean7.099999999999983
survival_time_min7.099999999999983
No reset possible
15021310Andrea Censiminimal-agentaido-LFV-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:02:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.2
in-drivable-lane_median0.0
driven_lanedir_consec_median0.16440570511787245
deviation-center-line_median0.19162140900760455


other stats
deviation-center-line_max0.19162140900760455
deviation-center-line_mean0.19162140900760455
deviation-center-line_min0.19162140900760455
deviation-heading_max1.1939422489088862
deviation-heading_mean1.1939422489088862
deviation-heading_median1.1939422489088862
deviation-heading_min1.1939422489088862
distance-from-start_max0.19201183050647508
distance-from-start_mean0.19201183050647508
distance-from-start_median0.19201183050647508
distance-from-start_min0.19201183050647508
driven_any_max0.19201481064322065
driven_any_mean0.19201481064322065
driven_any_median0.19201481064322065
driven_any_min0.19201481064322065
driven_lanedir_consec_max0.16440570511787245
driven_lanedir_consec_mean0.16440570511787245
driven_lanedir_consec_min0.16440570511787245
driven_lanedir_max0.16440570511787245
driven_lanedir_mean0.16440570511787245
driven_lanedir_median0.16440570511787245
driven_lanedir_min0.16440570511787245
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.19201481064322065, "survival_time": 2.2, "driven_lanedir": 0.16440570511787245, "in-drivable-lane": 0.0, "deviation-heading": 1.1939422489088862, "distance-from-start": 0.19201183050647508, "deviation-center-line": 0.19162140900760455, "driven_lanedir_consec": 0.16440570511787245}}
simulation-passed1
survival_time_max2.2
survival_time_mean2.2
survival_time_min2.2
No reset possible
15019311Andrea Censiminimal-agentaido-LFV-sim-validationsim-1of4successnodavinci-stage-01-6.2.500:03:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.700000000000044
in-drivable-lane_median10.950000000000044
driven_lanedir_consec_median0.19955171937759708
deviation-center-line_median0.12567511082985278


other stats
deviation-center-line_max0.12567511082985278
deviation-center-line_mean0.12567511082985278
deviation-center-line_min0.12567511082985278
deviation-heading_max0.9488219555580464
deviation-heading_mean0.9488219555580464
deviation-heading_median0.9488219555580464
deviation-heading_min0.9488219555580464
distance-from-start_max1.924049384083022
distance-from-start_mean1.924049384083022
distance-from-start_median1.924049384083022
distance-from-start_min1.924049384083022
driven_any_max1.924195440713655
driven_any_mean1.924195440713655
driven_any_median1.924195440713655
driven_any_min1.924195440713655
driven_lanedir_consec_max0.19955171937759708
driven_lanedir_consec_mean0.19955171937759708
driven_lanedir_consec_min0.19955171937759708
driven_lanedir_max0.19955171937759708
driven_lanedir_mean0.19955171937759708
driven_lanedir_median0.19955171937759708
driven_lanedir_min0.19955171937759708
in-drivable-lane_max10.950000000000044
in-drivable-lane_mean10.950000000000044
in-drivable-lane_min10.950000000000044
per-episodes
details{"loop-000-ego0": {"driven_any": 1.924195440713655, "survival_time": 12.700000000000044, "driven_lanedir": 0.19955171937759708, "in-drivable-lane": 10.950000000000044, "deviation-heading": 0.9488219555580464, "distance-from-start": 1.924049384083022, "deviation-center-line": 0.12567511082985278, "driven_lanedir_consec": 0.19955171937759708}}
simulation-passed1
survival_time_max12.700000000000044
survival_time_mean12.700000000000044
survival_time_min12.700000000000044
No reset possible
15016311Andrea Censiminimal-agentaido-LFV-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:02:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.2
in-drivable-lane_median0.0
driven_lanedir_consec_median0.16440570511787245
deviation-center-line_median0.19162140900760455


other stats
deviation-center-line_max0.19162140900760455
deviation-center-line_mean0.19162140900760455
deviation-center-line_min0.19162140900760455
deviation-heading_max1.1939422489088862
deviation-heading_mean1.1939422489088862
deviation-heading_median1.1939422489088862
deviation-heading_min1.1939422489088862
distance-from-start_max0.19201183050647508
distance-from-start_mean0.19201183050647508
distance-from-start_median0.19201183050647508
distance-from-start_min0.19201183050647508
driven_any_max0.19201481064322065
driven_any_mean0.19201481064322065
driven_any_median0.19201481064322065
driven_any_min0.19201481064322065
driven_lanedir_consec_max0.16440570511787245
driven_lanedir_consec_mean0.16440570511787245
driven_lanedir_consec_min0.16440570511787245
driven_lanedir_max0.16440570511787245
driven_lanedir_mean0.16440570511787245
driven_lanedir_median0.16440570511787245
driven_lanedir_min0.16440570511787245
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.19201481064322065, "survival_time": 2.2, "driven_lanedir": 0.16440570511787245, "in-drivable-lane": 0.0, "deviation-heading": 1.1939422489088862, "distance-from-start": 0.19201183050647508, "deviation-center-line": 0.19162140900760455, "driven_lanedir_consec": 0.16440570511787245}}
simulation-passed1
survival_time_max2.2
survival_time_mean2.2
survival_time_min2.2
No reset possible
15014312Liam Paulltemplate-rosaido-LF-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.11991986546127742
survival_time_median2.000000000000001
deviation-center-line_median0.04479259626557715
in-drivable-lane_median1.1500000000000008


other stats
deviation-center-line_max0.04479259626557715
deviation-center-line_mean0.04479259626557715
deviation-center-line_min0.04479259626557715
deviation-heading_max0.5962036139333092
deviation-heading_mean0.5962036139333092
deviation-heading_median0.5962036139333092
deviation-heading_min0.5962036139333092
distance-from-start_max0.3099063366084988
distance-from-start_mean0.3099063366084988
distance-from-start_median0.3099063366084988
distance-from-start_min0.3099063366084988
driven_any_max0.31344765591704704
driven_any_mean0.31344765591704704
driven_any_median0.31344765591704704
driven_any_min0.31344765591704704
driven_lanedir_consec_max0.11991986546127742
driven_lanedir_consec_mean0.11991986546127742
driven_lanedir_consec_min0.11991986546127742
driven_lanedir_max0.11991986546127742
driven_lanedir_mean0.11991986546127742
driven_lanedir_median0.11991986546127742
driven_lanedir_min0.11991986546127742
in-drivable-lane_max1.1500000000000008
in-drivable-lane_mean1.1500000000000008
in-drivable-lane_min1.1500000000000008
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.31344765591704704, "survival_time": 2.000000000000001, "driven_lanedir": 0.11991986546127742, "in-drivable-lane": 1.1500000000000008, "deviation-heading": 0.5962036139333092, "distance-from-start": 0.3099063366084988, "deviation-center-line": 0.04479259626557715, "driven_lanedir_consec": 0.11991986546127742}}
simulation-passed1
survival_time_max2.000000000000001
survival_time_mean2.000000000000001
survival_time_min2.000000000000001
No reset possible
15013312Liam Paulltemplate-rosaido-LF-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:01:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4102251105968768
survival_time_median11.300000000000026
deviation-center-line_median0.21095175552837028
in-drivable-lane_median8.55000000000002


other stats
deviation-center-line_max0.21095175552837028
deviation-center-line_mean0.21095175552837028
deviation-center-line_min0.21095175552837028
deviation-heading_max2.394213234261176
deviation-heading_mean2.394213234261176
deviation-heading_median2.394213234261176
deviation-heading_min2.394213234261176
distance-from-start_max2.7561865363412013
distance-from-start_mean2.7561865363412013
distance-from-start_median2.7561865363412013
distance-from-start_min2.7561865363412013
driven_any_max2.996411076993902
driven_any_mean2.996411076993902
driven_any_median2.996411076993902
driven_any_min2.996411076993902
driven_lanedir_consec_max0.4102251105968768
driven_lanedir_consec_mean0.4102251105968768
driven_lanedir_consec_min0.4102251105968768
driven_lanedir_max0.4102251105968768
driven_lanedir_mean0.4102251105968768
driven_lanedir_median0.4102251105968768
driven_lanedir_min0.4102251105968768
in-drivable-lane_max8.55000000000002
in-drivable-lane_mean8.55000000000002
in-drivable-lane_min8.55000000000002
per-episodes
details{"zigzag-000-ego0": {"driven_any": 2.996411076993902, "survival_time": 11.300000000000026, "driven_lanedir": 0.4102251105968768, "in-drivable-lane": 8.55000000000002, "deviation-heading": 2.394213234261176, "distance-from-start": 2.7561865363412013, "deviation-center-line": 0.21095175552837028, "driven_lanedir_consec": 0.4102251105968768}}
simulation-passed1
survival_time_max11.300000000000026
survival_time_mean11.300000000000026
survival_time_min11.300000000000026
No reset possible
15010341Liam Paulltemplate-rosaido-LF-sim-validationsim-3of4failednodavinci-stage-01-6.2.500:03:02
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 243, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15009341Liam Paulltemplate-rosaido-LF-sim-validationsim-2of4failednodavinci-stage-01-6.2.500:02:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 243, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15008356Liam Paulltemplate-rosaido-LF-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:02:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6525751003042335
survival_time_median6.8999999999999835
deviation-center-line_median0.23671393686256573
in-drivable-lane_median4.299999999999985


other stats
deviation-center-line_max0.23671393686256573
deviation-center-line_mean0.23671393686256573
deviation-center-line_min0.23671393686256573
deviation-heading_max0.6293793188754973
deviation-heading_mean0.6293793188754973
deviation-heading_median0.6293793188754973
deviation-heading_min0.6293793188754973
distance-from-start_max1.6502642141054713
distance-from-start_mean1.6502642141054713
distance-from-start_median1.6502642141054713
distance-from-start_min1.6502642141054713
driven_any_max1.66857085864973
driven_any_mean1.66857085864973
driven_any_median1.66857085864973
driven_any_min1.66857085864973
driven_lanedir_consec_max0.6525751003042335
driven_lanedir_consec_mean0.6525751003042335
driven_lanedir_consec_min0.6525751003042335
driven_lanedir_max0.6525751003042335
driven_lanedir_mean0.6525751003042335
driven_lanedir_median0.6525751003042335
driven_lanedir_min0.6525751003042335
in-drivable-lane_max4.299999999999985
in-drivable-lane_mean4.299999999999985
in-drivable-lane_min4.299999999999985
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.66857085864973, "survival_time": 6.8999999999999835, "driven_lanedir": 0.6525751003042335, "in-drivable-lane": 4.299999999999985, "deviation-heading": 0.6293793188754973, "distance-from-start": 1.6502642141054713, "deviation-center-line": 0.23671393686256573, "driven_lanedir_consec": 0.6525751003042335}}
simulation-passed1
survival_time_max6.8999999999999835
survival_time_mean6.8999999999999835
survival_time_min6.8999999999999835
No reset possible
15007356Liam Paulltemplate-rosaido-LF-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:02:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.17418012288196216
survival_time_median15.250000000000082
deviation-center-line_median0.055055239509883336
in-drivable-lane_median14.20000000000008


other stats
deviation-center-line_max0.055055239509883336
deviation-center-line_mean0.055055239509883336
deviation-center-line_min0.055055239509883336
deviation-heading_max0.604789626300289
deviation-heading_mean0.604789626300289
deviation-heading_median0.604789626300289
deviation-heading_min0.604789626300289
distance-from-start_max3.574319264151423
distance-from-start_mean3.574319264151423
distance-from-start_median3.574319264151423
distance-from-start_min3.574319264151423
driven_any_max4.3029389638658575
driven_any_mean4.3029389638658575
driven_any_median4.3029389638658575
driven_any_min4.3029389638658575
driven_lanedir_consec_max0.17418012288196216
driven_lanedir_consec_mean0.17418012288196216
driven_lanedir_consec_min0.17418012288196216
driven_lanedir_max0.17418012288196216
driven_lanedir_mean0.17418012288196216
driven_lanedir_median0.17418012288196216
driven_lanedir_min0.17418012288196216
in-drivable-lane_max14.20000000000008
in-drivable-lane_mean14.20000000000008
in-drivable-lane_min14.20000000000008
per-episodes
details{"autolab-000-ego0": {"driven_any": 4.3029389638658575, "survival_time": 15.250000000000082, "driven_lanedir": 0.17418012288196216, "in-drivable-lane": 14.20000000000008, "deviation-heading": 0.604789626300289, "distance-from-start": 3.574319264151423, "deviation-center-line": 0.055055239509883336, "driven_lanedir_consec": 0.17418012288196216}}
simulation-passed1
survival_time_max15.250000000000082
survival_time_mean15.250000000000082
survival_time_min15.250000000000082
No reset possible
15006356Liam Paulltemplate-rosaido-LF-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:01:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8341700055862735
survival_time_median6.649999999999984
deviation-center-line_median0.3311604309458622
in-drivable-lane_median3.0499999999999896


other stats
deviation-center-line_max0.3311604309458622
deviation-center-line_mean0.3311604309458622
deviation-center-line_min0.3311604309458622
deviation-heading_max1.4489993184848182
deviation-heading_mean1.4489993184848182
deviation-heading_median1.4489993184848182
deviation-heading_min1.4489993184848182
distance-from-start_max1.502287848282847
distance-from-start_mean1.502287848282847
distance-from-start_median1.502287848282847
distance-from-start_min1.502287848282847
driven_any_max1.597681077091479
driven_any_mean1.597681077091479
driven_any_median1.597681077091479
driven_any_min1.597681077091479
driven_lanedir_consec_max0.8341700055862735
driven_lanedir_consec_mean0.8341700055862735
driven_lanedir_consec_min0.8341700055862735
driven_lanedir_max0.8341700055862735
driven_lanedir_mean0.8341700055862735
driven_lanedir_median0.8341700055862735
driven_lanedir_min0.8341700055862735
in-drivable-lane_max3.0499999999999896
in-drivable-lane_mean3.0499999999999896
in-drivable-lane_min3.0499999999999896
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.597681077091479, "survival_time": 6.649999999999984, "driven_lanedir": 0.8341700055862735, "in-drivable-lane": 3.0499999999999896, "deviation-heading": 1.4489993184848182, "distance-from-start": 1.502287848282847, "deviation-center-line": 0.3311604309458622, "driven_lanedir_consec": 0.8341700055862735}}
simulation-passed1
survival_time_max6.649999999999984
survival_time_mean6.649999999999984
survival_time_min6.649999999999984
No reset possible
15005356Liam Paulltemplate-rosaido-LF-sim-validationsim-1of4successnodavinci-stage-01-6.2.500:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.633890199914475
survival_time_median5.799999999999987
deviation-center-line_median0.16445708737875364
in-drivable-lane_median3.2999999999999883


other stats
deviation-center-line_max0.16445708737875364
deviation-center-line_mean0.16445708737875364
deviation-center-line_min0.16445708737875364
deviation-heading_max0.6559984994996813
deviation-heading_mean0.6559984994996813
deviation-heading_median0.6559984994996813
deviation-heading_min0.6559984994996813
distance-from-start_max1.3095721958170938
distance-from-start_mean1.3095721958170938
distance-from-start_median1.3095721958170938
distance-from-start_min1.3095721958170938
driven_any_max1.3287842287503877
driven_any_mean1.3287842287503877
driven_any_median1.3287842287503877
driven_any_min1.3287842287503877
driven_lanedir_consec_max0.633890199914475
driven_lanedir_consec_mean0.633890199914475
driven_lanedir_consec_min0.633890199914475
driven_lanedir_max0.633890199914475
driven_lanedir_mean0.633890199914475
driven_lanedir_median0.633890199914475
driven_lanedir_min0.633890199914475
in-drivable-lane_max3.2999999999999883
in-drivable-lane_mean3.2999999999999883
in-drivable-lane_min3.2999999999999883
per-episodes
details{"loop-000-ego0": {"driven_any": 1.3287842287503877, "survival_time": 5.799999999999987, "driven_lanedir": 0.633890199914475, "in-drivable-lane": 3.2999999999999883, "deviation-heading": 0.6559984994996813, "distance-from-start": 1.3095721958170938, "deviation-center-line": 0.16445708737875364, "driven_lanedir_consec": 0.633890199914475}}
simulation-passed1
survival_time_max5.799999999999987
survival_time_mean5.799999999999987
survival_time_min5.799999999999987
No reset possible
14999386Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:10:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median9.149999999999778
driven_lanedir_consec_median-5.474767891791627
deviation-center-line_median5.646838140390525


other stats
deviation-center-line_max5.646838140390525
deviation-center-line_mean5.646838140390525
deviation-center-line_min5.646838140390525
deviation-heading_max34.2194240164273
deviation-heading_mean34.2194240164273
deviation-heading_median34.2194240164273
deviation-heading_min34.2194240164273
distance-from-start_max0.24572859161974425
distance-from-start_mean0.24572859161974425
distance-from-start_median0.24572859161974425
distance-from-start_min0.24572859161974425
driven_any_max15.345004420949932
driven_any_mean15.345004420949932
driven_any_median15.345004420949932
driven_any_min15.345004420949932
driven_lanedir_consec_max-5.474767891791627
driven_lanedir_consec_mean-5.474767891791627
driven_lanedir_consec_min-5.474767891791627
driven_lanedir_max-9.175578658081363
driven_lanedir_mean-9.175578658081363
driven_lanedir_median-9.175578658081363
driven_lanedir_min-9.175578658081363
in-drivable-lane_max9.149999999999778
in-drivable-lane_mean9.149999999999778
in-drivable-lane_min9.149999999999778
per-episodes
details{"zigzag-000-ego0": {"driven_any": 15.345004420949932, "survival_time": 59.99999999999873, "driven_lanedir": -9.175578658081363, "in-drivable-lane": 9.149999999999778, "deviation-heading": 34.2194240164273, "distance-from-start": 0.24572859161974425, "deviation-center-line": 5.646838140390525, "driven_lanedir_consec": -5.474767891791627}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14982391Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:32:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median24.09999999999933
driven_lanedir_consec_median-1.8439052942483725
deviation-center-line_median3.346562977678423


other stats
deviation-center-line_max5.180936121444073
deviation-center-line_mean3.3757560082264533
deviation-center-line_min1.6289619561048934
deviation-heading_max32.35729728642251
deviation-heading_mean22.920551825759716
deviation-heading_median21.8611674479343
deviation-heading_min15.602575120747757
distance-from-start_max0.29146279230173994
distance-from-start_mean0.18809422791050803
distance-from-start_median0.16254374383862258
distance-from-start_min0.13582663166304695
driven_any_max12.344958468578165
driven_any_mean8.834458261955374
driven_any_median9.641326495954864
driven_any_min3.7102215873336055
driven_lanedir_consec_max-0.9496310225543318
driven_lanedir_consec_mean-1.913162633735166
driven_lanedir_consec_min-3.0152089238895874
driven_lanedir_max-1.1240567079161323
driven_lanedir_mean-2.869230202482609
driven_lanedir_median-2.2373143044604147
driven_lanedir_min-5.878235493093474
in-drivable-lane_max42.54999999999875
in-drivable-lane_mean24.26249999999936
in-drivable-lane_min6.300000000000026
per-episodes
details{"udem-000-ego0": {"driven_any": 11.751132981938078, "survival_time": 59.99999999999873, "driven_lanedir": -3.170573550123332, "in-drivable-lane": 33.749999999999176, "deviation-heading": 23.7087240418468, "distance-from-start": 0.1617638446351687, "deviation-center-line": 2.4243366502643235, "driven_lanedir_consec": -3.0152089238895874}, "udem-000-ego1": {"driven_any": 7.53152000997165, "survival_time": 59.99999999999873, "driven_lanedir": -1.304055058797498, "in-drivable-lane": 42.54999999999875, "deviation-heading": 15.602575120747757, "distance-from-start": 0.13582663166304695, "deviation-center-line": 1.6289619561048934, "driven_lanedir_consec": -1.304055058797498}, "udem-000-ego2": {"driven_any": 12.344958468578165, "survival_time": 59.99999999999873, "driven_lanedir": -5.878235493093474, "in-drivable-lane": 14.449999999999484, "deviation-heading": 32.35729728642251, "distance-from-start": 0.29146279230173994, "deviation-center-line": 4.268789305092523, "driven_lanedir_consec": -2.383755529699247}, "udem-000-ego3": {"driven_any": 3.7102215873336055, "survival_time": 59.99999999999873, "driven_lanedir": -1.1240567079161323, "in-drivable-lane": 6.300000000000026, "deviation-heading": 20.013610854021803, "distance-from-start": 0.16332364304207647, "deviation-center-line": 5.180936121444073, "driven_lanedir_consec": -0.9496310225543318}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14981391Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14977391Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-validationsim-1of4successnodavinci-stage-01-6.2.500:24:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.450000000000031
driven_lanedir_consec_median-1.1097898320863422
deviation-center-line_median4.586008567135565


other stats
deviation-center-line_max6.275859617093115
deviation-center-line_mean4.467579238527552
deviation-center-line_min2.4224402027459657
deviation-heading_max41.897797976960646
deviation-heading_mean28.81425906798893
deviation-heading_median26.01964724774098
deviation-heading_min21.31994379951312
distance-from-start_max0.21445007864157645
distance-from-start_mean0.15846596782835662
distance-from-start_median0.15783114794689934
distance-from-start_min0.10375149677805123
driven_any_max14.033906279316795
driven_any_mean5.902203246956661
driven_any_median4.234459643073686
driven_any_min1.1059874223624786
driven_lanedir_consec_max-0.105851646342366
driven_lanedir_consec_mean-1.6638876188678375
driven_lanedir_consec_min-4.3301191649563
driven_lanedir_max-0.105851646342366
driven_lanedir_mean-2.2062906625343497
driven_lanedir_median-1.8989675935456527
driven_lanedir_min-4.921375816703727
in-drivable-lane_max27.19999999999939
in-drivable-lane_mean9.312499999999863
in-drivable-lane_min1.149999999999996
per-episodes
details{"4way-000-ego0": {"driven_any": 14.033906279316795, "survival_time": 59.99999999999873, "driven_lanedir": -4.921375816703727, "in-drivable-lane": 27.19999999999939, "deviation-heading": 26.626850992655203, "distance-from-start": 0.21445007864157645, "deviation-center-line": 2.4224402027459657, "driven_lanedir_consec": -4.3301191649563}, "4way-000-ego1": {"driven_any": 1.1059874223624786, "survival_time": 59.99999999999873, "driven_lanedir": -0.23936516538035144, "in-drivable-lane": 2.499999999999994, "deviation-heading": 21.31994379951312, "distance-from-start": 0.14675277341459525, "deviation-center-line": 6.275859617093115, "driven_lanedir_consec": -0.23936516538035144}, "4way-000-ego2": {"driven_any": 7.262084351816282, "survival_time": 59.99999999999873, "driven_lanedir": -3.558570021710954, "in-drivable-lane": 6.40000000000007, "deviation-heading": 25.41244350282676, "distance-from-start": 0.16890952247920346, "deviation-center-line": 5.199672799651434, "driven_lanedir_consec": -1.9802144987923327}, "4way-000-ego3": {"driven_any": 1.2068349343310905, "survival_time": 59.99999999999873, "driven_lanedir": -0.105851646342366, "in-drivable-lane": 1.149999999999996, "deviation-heading": 41.897797976960646, "distance-from-start": 0.10375149677805123, "deviation-center-line": 3.972344334619696, "driven_lanedir_consec": -0.105851646342366}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14971393Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-testingsim-0of4successnodavinci-stage-01-6.2.500:09:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median35.399999999999096
driven_lanedir_consec_median-2.414899024822126
deviation-center-line_median2.288537590157524


other stats
deviation-center-line_max2.288537590157524
deviation-center-line_mean2.288537590157524
deviation-center-line_min2.288537590157524
deviation-heading_max22.31276189006342
deviation-heading_mean22.31276189006342
deviation-heading_median22.31276189006342
deviation-heading_min22.31276189006342
distance-from-start_max0.1686893905750609
distance-from-start_mean0.1686893905750609
distance-from-start_median0.1686893905750609
distance-from-start_min0.1686893905750609
driven_any_max11.342084112206887
driven_any_mean11.342084112206887
driven_any_median11.342084112206887
driven_any_min11.342084112206887
driven_lanedir_consec_max-2.414899024822126
driven_lanedir_consec_mean-2.414899024822126
driven_lanedir_consec_min-2.414899024822126
driven_lanedir_max-2.414899024822126
driven_lanedir_mean-2.414899024822126
driven_lanedir_median-2.414899024822126
driven_lanedir_min-2.414899024822126
in-drivable-lane_max35.399999999999096
in-drivable-lane_mean35.399999999999096
in-drivable-lane_min35.399999999999096
per-episodes
details{"autolab-000-ego0": {"driven_any": 11.342084112206887, "survival_time": 59.99999999999873, "driven_lanedir": -2.414899024822126, "in-drivable-lane": 35.399999999999096, "deviation-heading": 22.31276189006342, "distance-from-start": 0.1686893905750609, "deviation-center-line": 2.288537590157524, "driven_lanedir_consec": -2.414899024822126}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14953398Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-testingsim-0of4successnodavinci-stage-01-6.2.500:28:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median15.97499999999973
driven_lanedir_consec_median-2.1445130970576067
deviation-center-line_median4.670755299047441


other stats
deviation-center-line_max6.763870629643994
deviation-center-line_mean4.582013322603388
deviation-center-line_min2.2226720626746785
deviation-heading_max28.390312024938225
deviation-heading_mean19.924575320904196
deviation-heading_median20.6433272429903
deviation-heading_min10.021334772697958
distance-from-start_max0.21614425635355836
distance-from-start_mean0.17116074973410436
distance-from-start_median0.16037902454151676
distance-from-start_min0.14774069349982558
driven_any_max12.21004457846955
driven_any_mean7.727380390017374
driven_any_median7.960380738572091
driven_any_min2.7787155044557643
driven_lanedir_consec_max-0.774556240674239
driven_lanedir_consec_mean-2.1668456423372433
driven_lanedir_consec_min-3.603800134559521
driven_lanedir_max-0.774556240674239
driven_lanedir_mean-2.2102038970460836
driven_lanedir_median-2.2312296064752872
driven_lanedir_min-3.603800134559521
in-drivable-lane_max27.549999999999436
in-drivable-lane_mean16.31249999999973
in-drivable-lane_min5.75000000000002
per-episodes
details{"udem-000-ego0": {"driven_any": 11.419253999457306, "survival_time": 59.99999999999873, "driven_lanedir": -3.187045434448271, "in-drivable-lane": 25.249999999999417, "deviation-heading": 28.390312024938225, "distance-from-start": 0.15596113751352897, "deviation-center-line": 2.718574578352583, "driven_lanedir_consec": -3.187045434448271}, "udem-000-ego1": {"driven_any": 2.7787155044557643, "survival_time": 59.99999999999873, "driven_lanedir": -0.774556240674239, "in-drivable-lane": 5.75000000000002, "deviation-heading": 10.021334772697958, "distance-from-start": 0.14774069349982558, "deviation-center-line": 6.622936019742299, "driven_lanedir_consec": -0.774556240674239}, "udem-000-ego2": {"driven_any": 4.501507477686878, "survival_time": 59.99999999999873, "driven_lanedir": -1.2754137785023034, "in-drivable-lane": 6.700000000000042, "deviation-heading": 14.997357260834162, "distance-from-start": 0.16479691156950457, "deviation-center-line": 6.763870629643994, "driven_lanedir_consec": -1.1019807596669424}, "udem-000-ego3": {"driven_any": 12.21004457846955, "survival_time": 59.99999999999873, "driven_lanedir": -3.603800134559521, "in-drivable-lane": 27.549999999999436, "deviation-heading": 26.28929722514644, "distance-from-start": 0.21614425635355836, "deviation-center-line": 2.2226720626746785, "driven_lanedir_consec": -3.603800134559521}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14949514Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-validationsim-0of4failednodavinci-stage-01-6.2.500:01:15
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14945515Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-validationsim-0of4failednodavinci-stage-01-6.2.500:00:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14942516Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-validationsim-1of4failednodavinci-stage-01-6.2.500:01:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14936518Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14932519Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-validationsim-2of4failednodavinci-stage-01-6.2.500:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14927520Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14922521Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-testingsim-0of4failednodavinci-stage-01-6.2.500:01:23
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14897528Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-validationsim-1of4successnodavinci-stage-01-6.2.500:21:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.9749999999999197
driven_lanedir_consec_median8.961040834822473
deviation-center-line_median3.372676445667081


other stats
deviation-center-line_max4.3391803848463235
deviation-center-line_mean3.28485979415408
deviation-center-line_min2.0549059004358337
deviation-heading_max20.764641830603573
deviation-heading_mean17.585893005757168
deviation-heading_median18.979554298184965
deviation-heading_min11.61982159605516
distance-from-start_max2.8197324443410814
distance-from-start_mean2.5479907677801843
distance-from-start_median2.704888464321487
distance-from-start_min1.9624536981366811
driven_any_max10.921714280966809
driven_any_mean10.188038598248612
driven_any_median10.191204509966136
driven_any_min9.448031092095368
driven_lanedir_consec_max9.40327046753666
driven_lanedir_consec_mean8.970055149484228
driven_lanedir_consec_min8.554868460755305
driven_lanedir_max9.40327046753666
driven_lanedir_mean8.970055149484228
driven_lanedir_median8.961040834822473
driven_lanedir_min8.554868460755305
in-drivable-lane_max6.099999999999757
in-drivable-lane_mean2.6249999999999005
in-drivable-lane_min0.4500000000000064
per-episodes
details{"loop-000-ego0": {"driven_any": 10.921714280966809, "survival_time": 59.99999999999873, "driven_lanedir": 9.40327046753666, "in-drivable-lane": 3.049999999999826, "deviation-heading": 19.090400573408928, "distance-from-start": 2.78272920220292, "deviation-center-line": 3.426520907894287, "driven_lanedir_consec": 9.40327046753666}, "loop-000-ego1": {"driven_any": 9.448031092095368, "survival_time": 59.99999999999873, "driven_lanedir": 8.554868460755305, "in-drivable-lane": 0.9000000000000128, "deviation-heading": 20.764641830603573, "distance-from-start": 2.8197324443410814, "deviation-center-line": 4.3391803848463235, "driven_lanedir_consec": 8.554868460755305}, "loop-000-ego2": {"driven_any": 10.67115409231077, "survival_time": 59.99999999999873, "driven_lanedir": 8.591554362581444, "in-drivable-lane": 6.099999999999757, "deviation-heading": 18.868708022961005, "distance-from-start": 2.627047726440055, "deviation-center-line": 3.3188319834398747, "driven_lanedir_consec": 8.591554362581444}, "loop-000-ego3": {"driven_any": 9.711254927621502, "survival_time": 59.99999999999873, "driven_lanedir": 9.3305273070635, "in-drivable-lane": 0.4500000000000064, "deviation-heading": 11.61982159605516, "distance-from-start": 1.9624536981366811, "deviation-center-line": 2.0549059004358337, "driven_lanedir_consec": 9.3305273070635}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14893529Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:03:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median30.450000000000298
in-drivable-lane_median9.80000000000014
driven_lanedir_consec_median3.366728791394606
deviation-center-line_median1.439991256261997


other stats
deviation-center-line_max1.439991256261997
deviation-center-line_mean1.439991256261997
deviation-center-line_min1.439991256261997
deviation-heading_max8.288660745288958
deviation-heading_mean8.288660745288958
deviation-heading_median8.288660745288958
deviation-heading_min8.288660745288958
distance-from-start_max1.6081762017471009
distance-from-start_mean1.6081762017471009
distance-from-start_median1.6081762017471009
distance-from-start_min1.6081762017471009
driven_any_max5.609739438249546
driven_any_mean5.609739438249546
driven_any_median5.609739438249546
driven_any_min5.609739438249546
driven_lanedir_consec_max3.366728791394606
driven_lanedir_consec_mean3.366728791394606
driven_lanedir_consec_min3.366728791394606
driven_lanedir_max3.366728791394606
driven_lanedir_mean3.366728791394606
driven_lanedir_median3.366728791394606
driven_lanedir_min3.366728791394606
in-drivable-lane_max9.80000000000014
in-drivable-lane_mean9.80000000000014
in-drivable-lane_min9.80000000000014
per-episodes
details{"loop2-000-ego0": {"driven_any": 5.609739438249546, "survival_time": 30.450000000000298, "driven_lanedir": 3.366728791394606, "in-drivable-lane": 9.80000000000014, "deviation-heading": 8.288660745288958, "distance-from-start": 1.6081762017471009, "deviation-center-line": 1.439991256261997, "driven_lanedir_consec": 3.366728791394606}}
simulation-passed1
survival_time_max30.450000000000298
survival_time_mean30.450000000000298
survival_time_min30.450000000000298
No reset possible
14888530Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:07:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median9.491997570139503
deviation-center-line_median2.660879859611622


other stats
deviation-center-line_max2.660879859611622
deviation-center-line_mean2.660879859611622
deviation-center-line_min2.660879859611622
deviation-heading_max12.80316736907411
deviation-heading_mean12.80316736907411
deviation-heading_median12.80316736907411
deviation-heading_min12.80316736907411
distance-from-start_max1.0954035026364637
distance-from-start_mean1.0954035026364637
distance-from-start_median1.0954035026364637
distance-from-start_min1.0954035026364637
driven_any_max9.78971033196798
driven_any_mean9.78971033196798
driven_any_median9.78971033196798
driven_any_min9.78971033196798
driven_lanedir_consec_max9.491997570139503
driven_lanedir_consec_mean9.491997570139503
driven_lanedir_consec_min9.491997570139503
driven_lanedir_max9.491997570139503
driven_lanedir_mean9.491997570139503
driven_lanedir_median9.491997570139503
driven_lanedir_min9.491997570139503
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 9.78971033196798, "survival_time": 59.99999999999873, "driven_lanedir": 9.491997570139503, "in-drivable-lane": 0.0, "deviation-heading": 12.80316736907411, "distance-from-start": 1.0954035026364637, "deviation-center-line": 2.660879859611622, "driven_lanedir_consec": 9.491997570139503}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14887531Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14884531Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14883532Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14881532Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14870535Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-testingsim-1of4successnodavinci-stage-01-6.2.500:14:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median45.49999999999955
in-drivable-lane_median0.6000000000000054
driven_lanedir_consec_median3.22370109120282
deviation-center-line_median2.258484999682417


other stats
deviation-center-line_max5.397113846837058
deviation-center-line_mean2.967333723069459
deviation-center-line_min1.9552510460759436
deviation-heading_max15.621176661554228
deviation-heading_mean13.339388012880114
deviation-heading_median13.15297723191706
deviation-heading_min11.430420926132104
distance-from-start_max2.479979978197411
distance-from-start_mean1.9896282632558695
distance-from-start_median1.8885741147942383
distance-from-start_min1.7013848452375908
driven_any_max7.71940980017833
driven_any_mean4.362988365656663
driven_any_median3.7442669794488577
driven_any_min2.2440097035506055
driven_lanedir_consec_max7.320743275359519
driven_lanedir_consec_mean3.9529942559544864
driven_lanedir_consec_min2.0438315660527864
driven_lanedir_max7.320743275359519
driven_lanedir_mean3.9529942559544864
driven_lanedir_median3.22370109120282
driven_lanedir_min2.0438315660527864
in-drivable-lane_max2.299999999999992
in-drivable-lane_mean0.8750000000000007
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 2.3986144984896245, "survival_time": 45.49999999999955, "driven_lanedir": 2.0438315660527864, "in-drivable-lane": 0.8500000000000121, "deviation-heading": 14.420600062865365, "distance-from-start": 1.7013848452375908, "deviation-center-line": 1.9552510460759436, "driven_lanedir_consec": 2.0438315660527864}, "loop-000-ego1": {"driven_any": 7.71940980017833, "survival_time": 45.49999999999955, "driven_lanedir": 7.320743275359519, "in-drivable-lane": 0.34999999999999876, "deviation-heading": 11.430420926132104, "distance-from-start": 2.479979978197411, "deviation-center-line": 2.4502778379096317, "driven_lanedir_consec": 7.320743275359519}, "loop-000-ego2": {"driven_any": 2.2440097035506055, "survival_time": 45.49999999999955, "driven_lanedir": 2.1107349422224058, "in-drivable-lane": 0.0, "deviation-heading": 15.621176661554228, "distance-from-start": 1.8803972567254408, "deviation-center-line": 5.397113846837058, "driven_lanedir_consec": 2.1107349422224058}, "loop-000-ego3": {"driven_any": 5.08991946040809, "survival_time": 45.49999999999955, "driven_lanedir": 4.3366672401832345, "in-drivable-lane": 2.299999999999992, "deviation-heading": 11.885354400968756, "distance-from-start": 1.896750972863036, "deviation-center-line": 2.0666921614552027, "driven_lanedir_consec": 4.3366672401832345}}
simulation-passed1
survival_time_max45.49999999999955
survival_time_mean45.49999999999955
survival_time_min45.49999999999955
No reset possible
14861537Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-testingsim-0of4successnodavinci-stage-01-6.2.500:14:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.0499999999999543
driven_lanedir_consec_median8.392615438899535
deviation-center-line_median3.42203475343397


other stats
deviation-center-line_max3.42203475343397
deviation-center-line_mean3.42203475343397
deviation-center-line_min3.42203475343397
deviation-heading_max16.731836310455126
deviation-heading_mean16.731836310455126
deviation-heading_median16.731836310455126
deviation-heading_min16.731836310455126
distance-from-start_max3.258292623282794
distance-from-start_mean3.258292623282794
distance-from-start_median3.258292623282794
distance-from-start_min3.258292623282794
driven_any_max9.220639336580524
driven_any_mean9.220639336580524
driven_any_median9.220639336580524
driven_any_min9.220639336580524
driven_lanedir_consec_max8.392615438899535
driven_lanedir_consec_mean8.392615438899535
driven_lanedir_consec_min8.392615438899535
driven_lanedir_max8.392615438899535
driven_lanedir_mean8.392615438899535
driven_lanedir_median8.392615438899535
driven_lanedir_min8.392615438899535
in-drivable-lane_max1.0499999999999543
in-drivable-lane_mean1.0499999999999543
in-drivable-lane_min1.0499999999999543
per-episodes
details{"autolab-000-ego0": {"driven_any": 9.220639336580524, "survival_time": 59.99999999999873, "driven_lanedir": 8.392615438899535, "in-drivable-lane": 1.0499999999999543, "deviation-heading": 16.731836310455126, "distance-from-start": 3.258292623282794, "deviation-center-line": 3.42203475343397, "driven_lanedir_consec": 8.392615438899535}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14860538Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14852539Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-testingsim-0of4successnodavinci-stage-01-6.2.500:06:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median9.175894742518684
deviation-center-line_median3.725126098014147


other stats
deviation-center-line_max3.725126098014147
deviation-center-line_mean3.725126098014147
deviation-center-line_min3.725126098014147
deviation-heading_max18.406092376148777
deviation-heading_mean18.406092376148777
deviation-heading_median18.406092376148777
deviation-heading_min18.406092376148777
distance-from-start_max1.0126919334380111
distance-from-start_mean1.0126919334380111
distance-from-start_median1.0126919334380111
distance-from-start_min1.0126919334380111
driven_any_max9.728727027356951
driven_any_mean9.728727027356951
driven_any_median9.728727027356951
driven_any_min9.728727027356951
driven_lanedir_consec_max9.175894742518684
driven_lanedir_consec_mean9.175894742518684
driven_lanedir_consec_min9.175894742518684
driven_lanedir_max9.177797185643026
driven_lanedir_mean9.177797185643026
driven_lanedir_median9.177797185643026
driven_lanedir_min9.177797185643026
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 9.728727027356951, "survival_time": 59.99999999999873, "driven_lanedir": 9.177797185643026, "in-drivable-lane": 0.0, "deviation-heading": 18.406092376148777, "distance-from-start": 1.0126919334380111, "deviation-center-line": 3.725126098014147, "driven_lanedir_consec": 9.175894742518684}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14846541Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:06:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.301911363852366
survival_time_median59.99999999999873
deviation-center-line_median3.6954963662573914
in-drivable-lane_median1.549999999999912


other stats
deviation-center-line_max3.6954963662573914
deviation-center-line_mean3.6954963662573914
deviation-center-line_min3.6954963662573914
deviation-heading_max13.024347579703416
deviation-heading_mean13.024347579703416
deviation-heading_median13.024347579703416
deviation-heading_min13.024347579703416
distance-from-start_max2.8561310240916913
distance-from-start_mean2.8561310240916913
distance-from-start_median2.8561310240916913
distance-from-start_min2.8561310240916913
driven_any_max8.961488143307946
driven_any_mean8.961488143307946
driven_any_median8.961488143307946
driven_any_min8.961488143307946
driven_lanedir_consec_max8.301911363852366
driven_lanedir_consec_mean8.301911363852366
driven_lanedir_consec_min8.301911363852366
driven_lanedir_max8.301911363852366
driven_lanedir_mean8.301911363852366
driven_lanedir_median8.301911363852366
driven_lanedir_min8.301911363852366
in-drivable-lane_max1.549999999999912
in-drivable-lane_mean1.549999999999912
in-drivable-lane_min1.549999999999912
per-episodes
details{"zigzag-000-ego0": {"driven_any": 8.961488143307946, "survival_time": 59.99999999999873, "driven_lanedir": 8.301911363852366, "in-drivable-lane": 1.549999999999912, "deviation-heading": 13.024347579703416, "distance-from-start": 2.8561310240916913, "deviation-center-line": 3.6954963662573914, "driven_lanedir_consec": 8.301911363852366}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14844544Bea Baselines 🐤baseline-dagger-pytorchaido-hello-sim-validationsanity-checksuccessnodavinci-stage-01-6.2.500:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.03650776552862656
deviation-center-line_median0.005211963820770945


other stats
deviation-center-line_max0.005211963820770945
deviation-center-line_mean0.005211963820770945
deviation-center-line_min0.005211963820770945
deviation-heading_max0.24614658622116428
deviation-heading_mean0.24614658622116428
deviation-heading_median0.24614658622116428
deviation-heading_min0.24614658622116428
distance-from-start_max0.040240410823725786
distance-from-start_mean0.040240410823725786
distance-from-start_median0.040240410823725786
distance-from-start_min0.040240410823725786
driven_any_max0.04031457575144988
driven_any_mean0.04031457575144988
driven_any_median0.04031457575144988
driven_any_min0.04031457575144988
driven_lanedir_consec_max0.03650776552862656
driven_lanedir_consec_mean0.03650776552862656
driven_lanedir_consec_min0.03650776552862656
driven_lanedir_max0.03650776552862656
driven_lanedir_mean0.03650776552862656
driven_lanedir_median0.03650776552862656
driven_lanedir_min0.03650776552862656
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.04031457575144988, "survival_time": 0.49999999999999994, "driven_lanedir": 0.03650776552862656, "in-drivable-lane": 0.0, "deviation-heading": 0.24614658622116428, "distance-from-start": 0.040240410823725786, "deviation-center-line": 0.005211963820770945, "driven_lanedir_consec": 0.03650776552862656}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
14837600Liam Paulltemplate-tensorflowaido-LF-sim-validationsim-1of4failednodavinci-stage-01-6.2.500:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14832763Bea Baselines 🐤challenge-aido_LF-template-ros:daffy:e107400fd98b91bb7c02b7b24d7be5f5d7623035aido-hello-sim-validationsanity-checksuccessnodavinci-stage-01-6.2.500:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.04735438700764805
deviation-center-line_median0.00663633288151513


other stats
deviation-center-line_max0.00663633288151513
deviation-center-line_mean0.00663633288151513
deviation-center-line_min0.00663633288151513
deviation-heading_max0.2706662680549352
deviation-heading_mean0.2706662680549352
deviation-heading_median0.2706662680549352
deviation-heading_min0.2706662680549352
distance-from-start_max0.05548631883908786
distance-from-start_mean0.05548631883908786
distance-from-start_median0.05548631883908786
distance-from-start_min0.05548631883908786
driven_any_max0.055495718127740665
driven_any_mean0.055495718127740665
driven_any_median0.055495718127740665
driven_any_min0.055495718127740665
driven_lanedir_consec_max0.04735438700764805
driven_lanedir_consec_mean0.04735438700764805
driven_lanedir_consec_min0.04735438700764805
driven_lanedir_max0.04735438700764805
driven_lanedir_mean0.04735438700764805
driven_lanedir_median0.04735438700764805
driven_lanedir_min0.04735438700764805
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.055495718127740665, "survival_time": 0.49999999999999994, "driven_lanedir": 0.04735438700764805, "in-drivable-lane": 0.0, "deviation-heading": 0.2706662680549352, "distance-from-start": 0.05548631883908786, "deviation-center-line": 0.00663633288151513, "driven_lanedir_consec": 0.04735438700764805}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
14830791Bea Baselines 🐤challenge-aido_LF-baseline-RPL-ros:daffy-staging:61ce4781fdb88fb08748da51bde492a74499e71daido-hello-sim-validationsanity-checksuccessnodavinci-stage-01-6.2.500:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.008964228491396442
deviation-center-line_median0.006978175833823155


other stats
deviation-center-line_max0.006978175833823155
deviation-center-line_mean0.006978175833823155
deviation-center-line_min0.006978175833823155
deviation-heading_max0.27034279806000455
deviation-heading_mean0.27034279806000455
deviation-heading_median0.27034279806000455
deviation-heading_min0.27034279806000455
distance-from-start_max0.010496991881877605
distance-from-start_mean0.010496991881877605
distance-from-start_median0.010496991881877605
distance-from-start_min0.010496991881877605
driven_any_max0.01049705081507342
driven_any_mean0.01049705081507342
driven_any_median0.01049705081507342
driven_any_min0.01049705081507342
driven_lanedir_consec_max0.008964228491396442
driven_lanedir_consec_mean0.008964228491396442
driven_lanedir_consec_min0.008964228491396442
driven_lanedir_max0.008964228491396442
driven_lanedir_mean0.008964228491396442
driven_lanedir_median0.008964228491396442
driven_lanedir_min0.008964228491396442
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.01049705081507342, "survival_time": 0.49999999999999994, "driven_lanedir": 0.008964228491396442, "in-drivable-lane": 0.0, "deviation-heading": 0.27034279806000455, "distance-from-start": 0.010496991881877605, "deviation-center-line": 0.006978175833823155, "driven_lanedir_consec": 0.008964228491396442}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
14823796Bea Baselines 🐤challenge-aido_LF-template-tensorflow:daffy-staging:4f78c63aa6d3b56db61748d0875daf8a08ba14a1aido-hello-sim-validationsanity-checkfailednodavinci-stage-01-6.2.500:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14820800Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-1of4failednodavinci-stage-01-6.2.500:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14803809Andrea Censitemplate-randomaido-LFV-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:14:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median48.69999999999937
in-drivable-lane_median36.64999999999927
driven_lanedir_consec_median0.27329071924012593
deviation-center-line_median0.8940598330260409


other stats
deviation-center-line_max0.8940598330260409
deviation-center-line_mean0.8940598330260409
deviation-center-line_min0.8940598330260409
deviation-heading_max9.653852545002117
deviation-heading_mean9.653852545002117
deviation-heading_median9.653852545002117
deviation-heading_min9.653852545002117
distance-from-start_max1.1351054760255814
distance-from-start_mean1.1351054760255814
distance-from-start_median1.1351054760255814
distance-from-start_min1.1351054760255814
driven_any_max12.221812291295889
driven_any_mean12.221812291295889
driven_any_median12.221812291295889
driven_any_min12.221812291295889
driven_lanedir_consec_max0.27329071924012593
driven_lanedir_consec_mean0.27329071924012593
driven_lanedir_consec_min0.27329071924012593
driven_lanedir_max0.26112935377464863
driven_lanedir_mean0.26112935377464863
driven_lanedir_median0.26112935377464863
driven_lanedir_min0.26112935377464863
in-drivable-lane_max36.64999999999927
in-drivable-lane_mean36.64999999999927
in-drivable-lane_min36.64999999999927
per-episodes
details{"zigzag-000-ego0": {"driven_any": 12.221812291295889, "survival_time": 48.69999999999937, "driven_lanedir": 0.26112935377464863, "in-drivable-lane": 36.64999999999927, "deviation-heading": 9.653852545002117, "distance-from-start": 1.1351054760255814, "deviation-center-line": 0.8940598330260409, "driven_lanedir_consec": 0.27329071924012593}}
simulation-passed1
survival_time_max48.69999999999937
survival_time_mean48.69999999999937
survival_time_min48.69999999999937
No reset possible
14798815Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:04:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median9.938760268113356e-05
deviation-center-line_median0.8948971250979786


other stats
deviation-center-line_max0.8948971250979786
deviation-center-line_mean0.8948971250979786
deviation-center-line_min0.8948971250979786
deviation-heading_max32.2491476465892
deviation-heading_mean32.2491476465892
deviation-heading_median32.2491476465892
deviation-heading_min32.2491476465892
distance-from-start_max4.440892098500626e-16
distance-from-start_mean4.440892098500626e-16
distance-from-start_median4.440892098500626e-16
distance-from-start_min4.440892098500626e-16
driven_any_max5.329070518200751e-13
driven_any_mean5.329070518200751e-13
driven_any_median5.329070518200751e-13
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max9.938760268113356e-05
driven_lanedir_consec_mean9.938760268113356e-05
driven_lanedir_consec_min9.938760268113356e-05
driven_lanedir_max9.938760268113356e-05
driven_lanedir_mean9.938760268113356e-05
driven_lanedir_median9.938760268113356e-05
driven_lanedir_min9.938760268113356e-05
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 9.938760268113356e-05, "in-drivable-lane": 0.0, "deviation-heading": 32.2491476465892, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.8948971250979786, "driven_lanedir_consec": 9.938760268113356e-05}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14790817Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:11:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median4.304249926437537
deviation-center-line_median0.1825026183725989


other stats
deviation-center-line_max0.34104251013325637
deviation-center-line_mean0.20912268674780385
deviation-center-line_min0.13044300011276103
deviation-heading_max2.994295582077131
deviation-heading_mean2.5147400523068573
deviation-heading_median2.5090088664494945
deviation-heading_min2.0466468942513076
distance-from-start_max3.0928237060834363
distance-from-start_mean2.645965341319192
distance-from-start_median2.580815039187992
distance-from-start_min2.329407580817348
driven_any_max5.8241864351349815
driven_any_mean4.627603360938423
driven_any_median4.714304114852396
driven_any_min3.25761877891392
driven_lanedir_consec_max5.808142217564284
driven_lanedir_consec_mean4.417823696659784
driven_lanedir_consec_min3.254652716199778
driven_lanedir_max5.808142217564284
driven_lanedir_mean4.6194454357816355
driven_lanedir_median4.70749340468124
driven_lanedir_min3.254652716199778
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-001-ego0": {"driven_any": 3.25761877891392, "survival_time": 59.99999999999873, "driven_lanedir": 3.254652716199778, "in-drivable-lane": 0.0, "deviation-heading": 2.4432266696129785, "distance-from-start": 2.7016200695021144, "deviation-center-line": 0.1633304587519851, "driven_lanedir_consec": 3.254652716199778}, "udem-001-ego1": {"driven_any": 4.275772003750879, "survival_time": 59.99999999999873, "driven_lanedir": 4.270214821719897, "in-drivable-lane": 0.0, "deviation-heading": 2.994295582077131, "distance-from-start": 3.0928237060834363, "deviation-center-line": 0.13044300011276103, "driven_lanedir_consec": 3.867286559394435}, "udem-001-ego2": {"driven_any": 5.152836225953913, "survival_time": 59.99999999999873, "driven_lanedir": 5.144771987642583, "in-drivable-lane": 0.0, "deviation-heading": 2.0466468942513076, "distance-from-start": 2.329407580817348, "deviation-center-line": 0.20167477799321273, "driven_lanedir_consec": 4.741213293480639}, "udem-001-ego3": {"driven_any": 5.8241864351349815, "survival_time": 59.99999999999873, "driven_lanedir": 5.808142217564284, "in-drivable-lane": 0.0, "deviation-heading": 2.5747910632860105, "distance-from-start": 2.460010008873869, "deviation-center-line": 0.34104251013325637, "driven_lanedir_consec": 5.808142217564284}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14785818Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:09:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median57.84999999999885
in-drivable-lane_median0.0
driven_lanedir_consec_median4.884807237005287
deviation-center-line_median0.15072920516156368


other stats
deviation-center-line_max0.15072920516156368
deviation-center-line_mean0.15072920516156368
deviation-center-line_min0.15072920516156368
deviation-heading_max1.1475940808640654
deviation-heading_mean1.1475940808640654
deviation-heading_median1.1475940808640654
deviation-heading_min1.1475940808640654
distance-from-start_max2.6948612403356473
distance-from-start_mean2.6948612403356473
distance-from-start_median2.6948612403356473
distance-from-start_min2.6948612403356473
driven_any_max5.697171922964183
driven_any_mean5.697171922964183
driven_any_median5.697171922964183
driven_any_min5.697171922964183
driven_lanedir_consec_max4.884807237005287
driven_lanedir_consec_mean4.884807237005287
driven_lanedir_consec_min4.884807237005287
driven_lanedir_max5.693381869716076
driven_lanedir_mean5.693381869716076
driven_lanedir_median5.693381869716076
driven_lanedir_min5.693381869716076
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-001-ego0": {"driven_any": 5.697171922964183, "survival_time": 57.84999999999885, "driven_lanedir": 5.693381869716076, "in-drivable-lane": 0.0, "deviation-heading": 1.1475940808640654, "distance-from-start": 2.6948612403356473, "deviation-center-line": 0.15072920516156368, "driven_lanedir_consec": 4.884807237005287}}
simulation-passed1
survival_time_max57.84999999999885
survival_time_mean57.84999999999885
survival_time_min57.84999999999885
No reset possible
14781819Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-validation455successnodavinci-stage-01-6.2.500:04:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.656919495074917
deviation-center-line_median0.2661881658162768


other stats
deviation-center-line_max0.3039938965173563
deviation-center-line_mean0.2661881658162768
deviation-center-line_min0.22838243511519724
deviation-heading_max2.327018578184933
deviation-heading_mean2.308429504381555
deviation-heading_median2.308429504381555
deviation-heading_min2.289840430578177
distance-from-start_max1.5439885956730326
distance-from-start_mean1.530636320399127
distance-from-start_median1.530636320399127
distance-from-start_min1.517284045125221
driven_any_max5.702917901484924
driven_any_mean5.667599931124791
driven_any_median5.667599931124791
driven_any_min5.632281960764657
driven_lanedir_consec_max5.692768953399423
driven_lanedir_consec_mean5.656919495074917
driven_lanedir_consec_min5.621070036750412
driven_lanedir_max5.692768953399423
driven_lanedir_mean5.656919495074917
driven_lanedir_median5.656919495074917
driven_lanedir_min5.621070036750412
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 5.702917901484924, "survival_time": 59.99999999999873, "driven_lanedir": 5.692768953399423, "in-drivable-lane": 0.0, "deviation-heading": 2.327018578184933, "distance-from-start": 1.517284045125221, "deviation-center-line": 0.22838243511519724, "driven_lanedir_consec": 5.692768953399423}, "loop2-000-ego1": {"driven_any": 5.632281960764657, "survival_time": 59.99999999999873, "driven_lanedir": 5.621070036750412, "in-drivable-lane": 0.0, "deviation-heading": 2.289840430578177, "distance-from-start": 1.5439885956730326, "deviation-center-line": 0.3039938965173563, "driven_lanedir_consec": 5.621070036750412}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14777820Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:02:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median28.050000000000264
in-drivable-lane_median0.0
driven_lanedir_consec_median2.292618548158817
deviation-center-line_median0.19323515838271432


other stats
deviation-center-line_max0.19323515838271432
deviation-center-line_mean0.19323515838271432
deviation-center-line_min0.19323515838271432
deviation-heading_max1.8288145404727405
deviation-heading_mean1.8288145404727405
deviation-heading_median1.8288145404727405
deviation-heading_min1.8288145404727405
distance-from-start_max1.9904020045641833
distance-from-start_mean1.9904020045641833
distance-from-start_median1.9904020045641833
distance-from-start_min1.9904020045641833
driven_any_max2.3014771077635525
driven_any_mean2.3014771077635525
driven_any_median2.3014771077635525
driven_any_min2.3014771077635525
driven_lanedir_consec_max2.292618548158817
driven_lanedir_consec_mean2.292618548158817
driven_lanedir_consec_min2.292618548158817
driven_lanedir_max2.292618548158817
driven_lanedir_mean2.292618548158817
driven_lanedir_median2.292618548158817
driven_lanedir_min2.292618548158817
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.3014771077635525, "survival_time": 28.050000000000264, "driven_lanedir": 2.292618548158817, "in-drivable-lane": 0.0, "deviation-heading": 1.8288145404727405, "distance-from-start": 1.9904020045641833, "deviation-center-line": 0.19323515838271432, "driven_lanedir_consec": 2.292618548158817}}
simulation-passed1
survival_time_max28.050000000000264
survival_time_mean28.050000000000264
survival_time_min28.050000000000264
No reset possible
14772821Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-testingsim-1of4successnodavinci-stage-01-6.2.500:03:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.762199167368613
deviation-center-line_median0.2695568246827997


other stats
deviation-center-line_max0.2695568246827997
deviation-center-line_mean0.2695568246827997
deviation-center-line_min0.2695568246827997
deviation-heading_max2.286728929136476
deviation-heading_mean2.286728929136476
deviation-heading_median2.286728929136476
deviation-heading_min2.286728929136476
distance-from-start_max2.8947685325489236
distance-from-start_mean2.8947685325489236
distance-from-start_median2.8947685325489236
distance-from-start_min2.8947685325489236
driven_any_max5.7779481252581375
driven_any_mean5.7779481252581375
driven_any_median5.7779481252581375
driven_any_min5.7779481252581375
driven_lanedir_consec_max5.762199167368613
driven_lanedir_consec_mean5.762199167368613
driven_lanedir_consec_min5.762199167368613
driven_lanedir_max5.762199167368613
driven_lanedir_mean5.762199167368613
driven_lanedir_median5.762199167368613
driven_lanedir_min5.762199167368613
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 5.7779481252581375, "survival_time": 59.99999999999873, "driven_lanedir": 5.762199167368613, "in-drivable-lane": 0.0, "deviation-heading": 2.286728929136476, "distance-from-start": 2.8947685325489236, "deviation-center-line": 0.2695568246827997, "driven_lanedir_consec": 5.762199167368613}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14766823Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:11:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median2.2917560752452353
deviation-center-line_median0.27463897897422074


other stats
deviation-center-line_max0.8490104989255264
deviation-center-line_mean0.4053497700508593
deviation-center-line_min0.2231106233294694
deviation-heading_max4.652112626803104
deviation-heading_mean3.392972578929611
deviation-heading_median3.4870395918569868
deviation-heading_min1.9456985052013656
distance-from-start_max2.3851954040258585
distance-from-start_mean1.4217930471518925
distance-from-start_median1.6509883922908557
distance-from-start_min2.220446049250313e-16
driven_any_max5.630152749474803
driven_any_mean2.559119045837817
driven_any_median2.3031617169380976
driven_any_min2.6645352591003757e-13
driven_lanedir_consec_max5.099440922602875
driven_lanedir_consec_mean2.4207382682733365
driven_lanedir_consec_min0.0
driven_lanedir_max5.620526100398644
driven_lanedir_mean2.5510097184456804
driven_lanedir_median2.291756386692038
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 2.930809165198691, "survival_time": 59.99999999999873, "driven_lanedir": 2.9200356041068973, "in-drivable-lane": 0.0, "deviation-heading": 3.5129636830313307, "distance-from-start": 2.3851954040258585, "deviation-center-line": 0.2707652624623321, "driven_lanedir_consec": 2.9200349812132913}, "4way-000-ego1": {"driven_any": 5.630152749474803, "survival_time": 59.99999999999873, "driven_lanedir": 5.620526100398644, "in-drivable-lane": 0.0, "deviation-heading": 1.9456985052013656, "distance-from-start": 2.067364738250145, "deviation-center-line": 0.2785126954861093, "driven_lanedir_consec": 5.099440922602875}, "4way-000-ego2": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 4.652112626803104, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 0.2231106233294694, "driven_lanedir_consec": 0.0}, "4way-000-ego3": {"driven_any": 1.6755142686775044, "survival_time": 59.99999999999873, "driven_lanedir": 1.6634771692771788, "in-drivable-lane": 0.0, "deviation-heading": 3.461115500682643, "distance-from-start": 1.2346120463315662, "deviation-center-line": 0.8490104989255264, "driven_lanedir_consec": 1.6634771692771788}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14760824Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:10:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.40652749865251103


other stats
deviation-center-line_max0.40652749865251103
deviation-center-line_mean0.40652749865251103
deviation-center-line_min0.40652749865251103
deviation-heading_max40.967332753486254
deviation-heading_mean40.967332753486254
deviation-heading_median40.967332753486254
deviation-heading_min40.967332753486254
distance-from-start_max5.551115123125783e-17
distance-from-start_mean5.551115123125783e-17
distance-from-start_median5.551115123125783e-17
distance-from-start_min5.551115123125783e-17
driven_any_max6.661338147750939e-14
driven_any_mean6.661338147750939e-14
driven_any_median6.661338147750939e-14
driven_any_min6.661338147750939e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 6.661338147750939e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.40652749865251103, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14752826Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:11:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median1.829863345092516
deviation-center-line_median0.7452453730558963


other stats
deviation-center-line_max0.7452453730558963
deviation-center-line_mean0.7452453730558963
deviation-center-line_min0.7452453730558963
deviation-heading_max2.253920939651482
deviation-heading_mean2.253920939651482
deviation-heading_median2.253920939651482
deviation-heading_min2.253920939651482
distance-from-start_max1.4208404655961004
distance-from-start_mean1.4208404655961004
distance-from-start_median1.4208404655961004
distance-from-start_min1.4208404655961004
driven_any_max1.8373653561570753
driven_any_mean1.8373653561570753
driven_any_median1.8373653561570753
driven_any_min1.8373653561570753
driven_lanedir_consec_max1.829863345092516
driven_lanedir_consec_mean1.829863345092516
driven_lanedir_consec_min1.829863345092516
driven_lanedir_max1.829863345092516
driven_lanedir_mean1.829863345092516
driven_lanedir_median1.829863345092516
driven_lanedir_min1.829863345092516
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.8373653561570753, "survival_time": 59.99999999999873, "driven_lanedir": 1.829863345092516, "in-drivable-lane": 0.0, "deviation-heading": 2.253920939651482, "distance-from-start": 1.4208404655961004, "deviation-center-line": 0.7452453730558963, "driven_lanedir_consec": 1.829863345092516}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14750827Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:02:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median15.650000000000087
in-drivable-lane_median0.0
driven_lanedir_consec_median1.3397922837799834
deviation-center-line_median0.17577830426095897


other stats
deviation-center-line_max0.17577830426095897
deviation-center-line_mean0.17577830426095897
deviation-center-line_min0.17577830426095897
deviation-heading_max1.414000512850352
deviation-heading_mean1.414000512850352
deviation-heading_median1.414000512850352
deviation-heading_min1.414000512850352
distance-from-start_max0.9953946201002636
distance-from-start_mean0.9953946201002636
distance-from-start_median0.9953946201002636
distance-from-start_min0.9953946201002636
driven_any_max1.3507304582476738
driven_any_mean1.3507304582476738
driven_any_median1.3507304582476738
driven_any_min1.3507304582476738
driven_lanedir_consec_max1.3397922837799834
driven_lanedir_consec_mean1.3397922837799834
driven_lanedir_consec_min1.3397922837799834
driven_lanedir_max1.3397922837799834
driven_lanedir_mean1.3397922837799834
driven_lanedir_median1.3397922837799834
driven_lanedir_min1.3397922837799834
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.3507304582476738, "survival_time": 15.650000000000087, "driven_lanedir": 1.3397922837799834, "in-drivable-lane": 0.0, "deviation-heading": 1.414000512850352, "distance-from-start": 0.9953946201002636, "deviation-center-line": 0.17577830426095897, "driven_lanedir_consec": 1.3397922837799834}}
simulation-passed1
survival_time_max15.650000000000087
survival_time_mean15.650000000000087
survival_time_min15.650000000000087
No reset possible
14746828Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:05:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median1.8922261091347536e-06
deviation-center-line_median0.4065255308886839


other stats
deviation-center-line_max0.4065255308886839
deviation-center-line_mean0.4065255308886839
deviation-center-line_min0.4065255308886839
deviation-heading_max40.96731053008268
deviation-heading_mean40.96731053008268
deviation-heading_median40.96731053008268
deviation-heading_min40.96731053008268
distance-from-start_max9.930136612989092e-16
distance-from-start_mean9.930136612989092e-16
distance-from-start_median9.930136612989092e-16
distance-from-start_min9.930136612989092e-16
driven_any_max1.19161639355867e-12
driven_any_mean1.19161639355867e-12
driven_any_median1.19161639355867e-12
driven_any_min1.19161639355867e-12
driven_lanedir_consec_max1.8922261091347536e-06
driven_lanedir_consec_mean1.8922261091347536e-06
driven_lanedir_consec_min1.8922261091347536e-06
driven_lanedir_max1.8922261091347536e-06
driven_lanedir_mean1.8922261091347536e-06
driven_lanedir_median1.8922261091347536e-06
driven_lanedir_min1.8922261091347536e-06
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.19161639355867e-12, "survival_time": 59.99999999999873, "driven_lanedir": 1.8922261091347536e-06, "in-drivable-lane": 0.0, "deviation-heading": 40.96731053008268, "distance-from-start": 9.930136612989092e-16, "deviation-center-line": 0.4065255308886839, "driven_lanedir_consec": 1.8922261091347536e-06}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14737911Bea Baselines 🐤baseline-solutionlx22-planning-dd-static-valistep1-2of4erroryesdavinci-stage-01-6.2.500:17:05
Waited 1004 seconds [...]
Waited 1004 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14724916Bea Baselines 🐤baseline-solutionlx22-planning-dd-dynamic-teststep1-1of4erroryesdavinci-stage-01-6.2.500:17:08
Waited 1008 seconds [...]
Waited 1008 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14723916Bea Baselines 🐤baseline-solutionlx22-planning-dd-dynamic-teststep1-3of4successyesdavinci-stage-01-6.2.500:00:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
14718917Bea Baselines 🐤baseline-solutionlx22-planning-dd-static-teststep1-3of4erroryesdavinci-stage-01-6.2.500:17:05
Waited 1001 seconds [...]
Waited 1001 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14709921Bea Baselines 🐤baseline-solutionlx22-planning-cc-empty-teststep1successyesdavinci-stage-01-6.2.500:10:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.925925925925926
success_ratio1.0
duration8.696897525204346
complexity16.48148148148148
avg_min_distance0.8613658087096333


other stats
nfeasible27
nsamples27
No reset possible
14706923Bea Baselines 🐤baseline-solutionlx22-collision-check-teststep1successyesdavinci-stage-01-6.2.500:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.0


other stats
nsamples200
No reset possible
14701930Bea Baselines 🐤baseline-duckietownaido-LF-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:05:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median0.8949084199908675
in-drivable-lane_median0.0


other stats
deviation-center-line_max0.8949084199908675
deviation-center-line_mean0.8949084199908675
deviation-center-line_min0.8949084199908675
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max4.002966042486721e-16
distance-from-start_mean4.002966042486721e-16
distance-from-start_median4.002966042486721e-16
distance-from-start_min4.002966042486721e-16
driven_any_max4.803559250983913e-13
driven_any_mean4.803559250983913e-13
driven_any_median4.803559250983913e-13
driven_any_min4.803559250983913e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 4.803559250983913e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.002966042486721e-16, "deviation-center-line": 0.8949084199908675, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14696960Bea Baselines 🐤template-pytorchaido-LFV-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:05:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median15.500000000000083
in-drivable-lane_median11.000000000000073
driven_lanedir_consec_median0.27883373094308617
deviation-center-line_median0.4827443299936602


other stats
deviation-center-line_max0.4827443299936602
deviation-center-line_mean0.4827443299936602
deviation-center-line_min0.4827443299936602
deviation-heading_max4.7983365919253975
deviation-heading_mean4.7983365919253975
deviation-heading_median4.7983365919253975
deviation-heading_min4.7983365919253975
distance-from-start_max0.30707529752706986
distance-from-start_mean0.30707529752706986
distance-from-start_median0.30707529752706986
distance-from-start_min0.30707529752706986
driven_any_max1.7600287903319018
driven_any_mean1.7600287903319018
driven_any_median1.7600287903319018
driven_any_min1.7600287903319018
driven_lanedir_consec_max0.27883373094308617
driven_lanedir_consec_mean0.27883373094308617
driven_lanedir_consec_min0.27883373094308617
driven_lanedir_max0.27883373094308617
driven_lanedir_mean0.27883373094308617
driven_lanedir_median0.27883373094308617
driven_lanedir_min0.27883373094308617
in-drivable-lane_max11.000000000000073
in-drivable-lane_mean11.000000000000073
in-drivable-lane_min11.000000000000073
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.7600287903319018, "survival_time": 15.500000000000083, "driven_lanedir": 0.27883373094308617, "in-drivable-lane": 11.000000000000073, "deviation-heading": 4.7983365919253975, "distance-from-start": 0.30707529752706986, "deviation-center-line": 0.4827443299936602, "driven_lanedir_consec": 0.27883373094308617}}
simulation-passed1
survival_time_max15.500000000000083
survival_time_mean15.500000000000083
survival_time_min15.500000000000083
No reset possible
14692961Bea Baselines 🐤template-pytorchaido-LFVI-sim-validationsim-1of4successnodavinci-stage-01-6.2.500:04:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.999999999999993
in-drivable-lane_median5.100000000000004
driven_lanedir_consec_median0.1423722726883363
deviation-center-line_median0.13463727031552505


other stats
deviation-center-line_max0.13463727031552505
deviation-center-line_mean0.13463727031552505
deviation-center-line_min0.13463727031552505
deviation-heading_max3.0960069314331835
deviation-heading_mean3.0960069314331835
deviation-heading_median3.0960069314331835
deviation-heading_min3.0960069314331835
distance-from-start_max0.06731717414017709
distance-from-start_mean0.06731717414017709
distance-from-start_median0.06731717414017709
distance-from-start_min0.06731717414017709
driven_any_max0.5120611588254235
driven_any_mean0.5120611588254235
driven_any_median0.5120611588254235
driven_any_min0.5120611588254235
driven_lanedir_consec_max0.1423722726883363
driven_lanedir_consec_mean0.1423722726883363
driven_lanedir_consec_min0.1423722726883363
driven_lanedir_max0.1423722726883363
driven_lanedir_mean0.1423722726883363
driven_lanedir_median0.1423722726883363
driven_lanedir_min0.1423722726883363
in-drivable-lane_max5.100000000000004
in-drivable-lane_mean5.100000000000004
in-drivable-lane_min5.100000000000004
per-episodes
details{"4way-000-ego0": {"driven_any": 0.5120611588254235, "survival_time": 8.999999999999993, "driven_lanedir": 0.1423722726883363, "in-drivable-lane": 5.100000000000004, "deviation-heading": 3.0960069314331835, "distance-from-start": 0.06731717414017709, "deviation-center-line": 0.13463727031552505, "driven_lanedir_consec": 0.1423722726883363}}
simulation-passed1
survival_time_max8.999999999999993
survival_time_mean8.999999999999993
survival_time_min8.999999999999993
No reset possible
14691961Bea Baselines 🐤template-pytorchaido-LFVI-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14690961Bea Baselines 🐤template-pytorchaido-LFVI-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14687962Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:02:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.4
in-drivable-lane_median6.000000000000006
driven_lanedir_consec_median0.6555779785196358
deviation-center-line_median0.2792528643701144


other stats
deviation-center-line_max0.2792528643701144
deviation-center-line_mean0.2792528643701144
deviation-center-line_min0.2792528643701144
deviation-heading_max1.4557099349980311
deviation-heading_mean1.4557099349980311
deviation-heading_median1.4557099349980311
deviation-heading_min1.4557099349980311
distance-from-start_max0.9109883165248291
distance-from-start_mean0.9109883165248291
distance-from-start_median0.9109883165248291
distance-from-start_min0.9109883165248291
driven_any_max2.087397642506476
driven_any_mean2.087397642506476
driven_any_median2.087397642506476
driven_any_min2.087397642506476
driven_lanedir_consec_max0.6555779785196358
driven_lanedir_consec_mean0.6555779785196358
driven_lanedir_consec_min0.6555779785196358
driven_lanedir_max0.6555779785196358
driven_lanedir_mean0.6555779785196358
driven_lanedir_median0.6555779785196358
driven_lanedir_min0.6555779785196358
in-drivable-lane_max6.000000000000006
in-drivable-lane_mean6.000000000000006
in-drivable-lane_min6.000000000000006
per-episodes
details{"4way-000-ego0": {"driven_any": 2.087397642506476, "survival_time": 9.4, "driven_lanedir": 0.6555779785196358, "in-drivable-lane": 6.000000000000006, "deviation-heading": 1.4557099349980311, "distance-from-start": 0.9109883165248291, "deviation-center-line": 0.2792528643701144, "driven_lanedir_consec": 0.6555779785196358}}
simulation-passed1
survival_time_max9.4
survival_time_mean9.4
survival_time_min9.4
No reset possible
14686962Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14684963Bea Baselines 🐤template-pytorchaido-LF-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:07:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1766391620347214
survival_time_median59.99999999999873
deviation-center-line_median0.3072734443468621
in-drivable-lane_median57.399999999998734


other stats
deviation-center-line_max0.3072734443468621
deviation-center-line_mean0.3072734443468621
deviation-center-line_min0.3072734443468621
deviation-heading_max1.6975107887408651
deviation-heading_mean1.6975107887408651
deviation-heading_median1.6975107887408651
deviation-heading_min1.6975107887408651
distance-from-start_max0.5893709936586936
distance-from-start_mean0.5893709936586936
distance-from-start_median0.5893709936586936
distance-from-start_min0.5893709936586936
driven_any_max5.186441222604035
driven_any_mean5.186441222604035
driven_any_median5.186441222604035
driven_any_min5.186441222604035
driven_lanedir_consec_max0.1766391620347214
driven_lanedir_consec_mean0.1766391620347214
driven_lanedir_consec_min0.1766391620347214
driven_lanedir_max0.1766391620347214
driven_lanedir_mean0.1766391620347214
driven_lanedir_median0.1766391620347214
driven_lanedir_min0.1766391620347214
in-drivable-lane_max57.399999999998734
in-drivable-lane_mean57.399999999998734
in-drivable-lane_min57.399999999998734
per-episodes
details{"loop2-000-ego0": {"driven_any": 5.186441222604035, "survival_time": 59.99999999999873, "driven_lanedir": 0.1766391620347214, "in-drivable-lane": 57.399999999998734, "deviation-heading": 1.6975107887408651, "distance-from-start": 0.5893709936586936, "deviation-center-line": 0.3072734443468621, "driven_lanedir_consec": 0.1766391620347214}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14682963Bea Baselines 🐤template-pytorchaido-LF-sim-validationsim-1of4successnodavinci-stage-01-6.2.500:07:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.3950175173888302
survival_time_median59.99999999999873
deviation-center-line_median1.0657797886202278
in-drivable-lane_median42.099999999998985


other stats
deviation-center-line_max1.0657797886202278
deviation-center-line_mean1.0657797886202278
deviation-center-line_min1.0657797886202278
deviation-heading_max13.996975745202988
deviation-heading_mean13.996975745202988
deviation-heading_median13.996975745202988
deviation-heading_min13.996975745202988
distance-from-start_max0.8085215499006221
distance-from-start_mean0.8085215499006221
distance-from-start_median0.8085215499006221
distance-from-start_min0.8085215499006221
driven_any_max10.886519255855044
driven_any_mean10.886519255855044
driven_any_median10.886519255855044
driven_any_min10.886519255855044
driven_lanedir_consec_max1.3950175173888302
driven_lanedir_consec_mean1.3950175173888302
driven_lanedir_consec_min1.3950175173888302
driven_lanedir_max2.1368582443118247
driven_lanedir_mean2.1368582443118247
driven_lanedir_median2.1368582443118247
driven_lanedir_min2.1368582443118247
in-drivable-lane_max42.099999999998985
in-drivable-lane_mean42.099999999998985
in-drivable-lane_min42.099999999998985
per-episodes
details{"loop-000-ego0": {"driven_any": 10.886519255855044, "survival_time": 59.99999999999873, "driven_lanedir": 2.1368582443118247, "in-drivable-lane": 42.099999999998985, "deviation-heading": 13.996975745202988, "distance-from-start": 0.8085215499006221, "deviation-center-line": 1.0657797886202278, "driven_lanedir_consec": 1.3950175173888302}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14681963Bea Baselines 🐤template-pytorchaido-LF-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:02:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.10263940584835618
survival_time_median12.000000000000036
deviation-center-line_median0.15928294392088138
in-drivable-lane_median9.800000000000027


other stats
deviation-center-line_max0.15928294392088138
deviation-center-line_mean0.15928294392088138
deviation-center-line_min0.15928294392088138
deviation-heading_max2.493203091466092
deviation-heading_mean2.493203091466092
deviation-heading_median2.493203091466092
deviation-heading_min2.493203091466092
distance-from-start_max0.7148825856502831
distance-from-start_mean0.7148825856502831
distance-from-start_median0.7148825856502831
distance-from-start_min0.7148825856502831
driven_any_max2.650138445863142
driven_any_mean2.650138445863142
driven_any_median2.650138445863142
driven_any_min2.650138445863142
driven_lanedir_consec_max0.10263940584835618
driven_lanedir_consec_mean0.10263940584835618
driven_lanedir_consec_min0.10263940584835618
driven_lanedir_max0.1377179478402586
driven_lanedir_mean0.1377179478402586
driven_lanedir_median0.1377179478402586
driven_lanedir_min0.1377179478402586
in-drivable-lane_max9.800000000000027
in-drivable-lane_mean9.800000000000027
in-drivable-lane_min9.800000000000027
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.650138445863142, "survival_time": 12.000000000000036, "driven_lanedir": 0.1377179478402586, "in-drivable-lane": 9.800000000000027, "deviation-heading": 2.493203091466092, "distance-from-start": 0.7148825856502831, "deviation-center-line": 0.15928294392088138, "driven_lanedir_consec": 0.10263940584835618}}
simulation-passed1
survival_time_max12.000000000000036
survival_time_mean12.000000000000036
survival_time_min12.000000000000036
No reset possible
14680964Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-0of4host-errornodavinci-stage-01-6.2.500:01:51
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 388, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.model = DDPG(state_dim=self.preprocessor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/submission/model.py", line 153, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 388, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.model = DDPG(state_dim=self.preprocessor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/submission/model.py", line 153, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14678964Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14674965Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:06:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median36.10000000000009
in-drivable-lane_median32.175000000000054
driven_lanedir_consec_median0.14896119574481914
deviation-center-line_median0.32155739137031863


other stats
deviation-center-line_max0.5557717547346468
deviation-center-line_mean0.32155739137031863
deviation-center-line_min0.0873430280059905
deviation-heading_max6.615234318043676
deviation-heading_mean3.7119455407071458
deviation-heading_median3.7119455407071458
deviation-heading_min0.8086567633706153
distance-from-start_max1.00475258167126
distance-from-start_mean0.6558846035430742
distance-from-start_median0.6558846035430742
distance-from-start_min0.3070166254148883
driven_any_max7.998759461748224
driven_any_mean4.415828658175556
driven_any_median4.415828658175556
driven_any_min0.8328978546028878
driven_lanedir_consec_max0.2215970321288561
driven_lanedir_consec_mean0.14896119574481914
driven_lanedir_consec_min0.07632535936078222
driven_lanedir_max0.7829976932442684
driven_lanedir_mean0.4296615263025253
driven_lanedir_median0.4296615263025253
driven_lanedir_min0.07632535936078222
in-drivable-lane_max35.05000000000008
in-drivable-lane_mean32.175000000000054
in-drivable-lane_min29.300000000000026
per-episodes
details{"loop2-000-ego0": {"driven_any": 7.998759461748224, "survival_time": 36.10000000000009, "driven_lanedir": 0.7829976932442684, "in-drivable-lane": 29.300000000000026, "deviation-heading": 6.615234318043676, "distance-from-start": 1.00475258167126, "deviation-center-line": 0.5557717547346468, "driven_lanedir_consec": 0.2215970321288561}, "loop2-000-ego1": {"driven_any": 0.8328978546028878, "survival_time": 36.10000000000009, "driven_lanedir": 0.07632535936078222, "in-drivable-lane": 35.05000000000008, "deviation-heading": 0.8086567633706153, "distance-from-start": 0.3070166254148883, "deviation-center-line": 0.0873430280059905, "driven_lanedir_consec": 0.07632535936078222}}
simulation-passed1
survival_time_max36.10000000000009
survival_time_mean36.10000000000009
survival_time_min36.10000000000009
No reset possible
14670966Bea Baselines 🐤template-pytorchaido-LFP-sim-validationsim-1of4successnodavinci-stage-01-6.2.500:08:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median41.54999999999886
driven_lanedir_consec_median1.4080190989990096
deviation-center-line_median2.1481824672906753


other stats
deviation-center-line_max2.1481824672906753
deviation-center-line_mean2.1481824672906753
deviation-center-line_min2.1481824672906753
deviation-heading_max16.824094693758582
deviation-heading_mean16.824094693758582
deviation-heading_median16.824094693758582
deviation-heading_min16.824094693758582
distance-from-start_max0.9708461423922458
distance-from-start_mean0.9708461423922458
distance-from-start_median0.9708461423922458
distance-from-start_min0.9708461423922458
driven_any_max6.969300157953495
driven_any_mean6.969300157953495
driven_any_median6.969300157953495
driven_any_min6.969300157953495
driven_lanedir_consec_max1.4080190989990096
driven_lanedir_consec_mean1.4080190989990096
driven_lanedir_consec_min1.4080190989990096
driven_lanedir_max1.4151779872144945
driven_lanedir_mean1.4151779872144945
driven_lanedir_median1.4151779872144945
driven_lanedir_min1.4151779872144945
in-drivable-lane_max41.54999999999886
in-drivable-lane_mean41.54999999999886
in-drivable-lane_min41.54999999999886
per-episodes
details{"loop-000-ego0": {"driven_any": 6.969300157953495, "survival_time": 59.99999999999873, "driven_lanedir": 1.4151779872144945, "in-drivable-lane": 41.54999999999886, "deviation-heading": 16.824094693758582, "distance-from-start": 0.9708461423922458, "deviation-center-line": 2.1481824672906753, "driven_lanedir_consec": 1.4080190989990096}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14666972Bea Baselines 🐤template-pytorchaido-LFV-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:03:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.55
in-drivable-lane_median6.100000000000007
driven_lanedir_consec_median0.7769016128178257
deviation-center-line_median0.3297041934533869


other stats
deviation-center-line_max0.3297041934533869
deviation-center-line_mean0.3297041934533869
deviation-center-line_min0.3297041934533869
deviation-heading_max2.169752495413339
deviation-heading_mean2.169752495413339
deviation-heading_median2.169752495413339
deviation-heading_min2.169752495413339
distance-from-start_max2.687555196511618
distance-from-start_mean2.687555196511618
distance-from-start_median2.687555196511618
distance-from-start_min2.687555196511618
driven_any_max2.7039789631750213
driven_any_mean2.7039789631750213
driven_any_median2.7039789631750213
driven_any_min2.7039789631750213
driven_lanedir_consec_max0.7769016128178257
driven_lanedir_consec_mean0.7769016128178257
driven_lanedir_consec_min0.7769016128178257
driven_lanedir_max0.7769016128178257
driven_lanedir_mean0.7769016128178257
driven_lanedir_median0.7769016128178257
driven_lanedir_min0.7769016128178257
in-drivable-lane_max6.100000000000007
in-drivable-lane_mean6.100000000000007
in-drivable-lane_min6.100000000000007
per-episodes
details{"zigzag-000-ego0": {"driven_any": 2.7039789631750213, "survival_time": 9.55, "driven_lanedir": 0.7769016128178257, "in-drivable-lane": 6.100000000000007, "deviation-heading": 2.169752495413339, "distance-from-start": 2.687555196511618, "deviation-center-line": 0.3297041934533869, "driven_lanedir_consec": 0.7769016128178257}}
simulation-passed1
survival_time_max9.55
survival_time_mean9.55
survival_time_min9.55
No reset possible
14655975Bea Baselines 🐤template-pytorchaido-LF-sim-testingsim-0of4successnodavinci-stage-01-6.2.500:08:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9824276802575016
survival_time_median59.99999999999873
deviation-center-line_median1.5570385231861052
in-drivable-lane_median41.14999999999915


other stats
deviation-center-line_max1.5570385231861052
deviation-center-line_mean1.5570385231861052
deviation-center-line_min1.5570385231861052
deviation-heading_max16.717775058582177
deviation-heading_mean16.717775058582177
deviation-heading_median16.717775058582177
deviation-heading_min16.717775058582177
distance-from-start_max0.3349908460091386
distance-from-start_mean0.3349908460091386
distance-from-start_median0.3349908460091386
distance-from-start_min0.3349908460091386
driven_any_max11.122481036454907
driven_any_mean11.122481036454907
driven_any_median11.122481036454907
driven_any_min11.122481036454907
driven_lanedir_consec_max1.9824276802575016
driven_lanedir_consec_mean1.9824276802575016
driven_lanedir_consec_min1.9824276802575016
driven_lanedir_max1.9824276802575016
driven_lanedir_mean1.9824276802575016
driven_lanedir_median1.9824276802575016
driven_lanedir_min1.9824276802575016
in-drivable-lane_max41.14999999999915
in-drivable-lane_mean41.14999999999915
in-drivable-lane_min41.14999999999915
per-episodes
details{"autolab-000-ego0": {"driven_any": 11.122481036454907, "survival_time": 59.99999999999873, "driven_lanedir": 1.9824276802575016, "in-drivable-lane": 41.14999999999915, "deviation-heading": 16.717775058582177, "distance-from-start": 0.3349908460091386, "deviation-center-line": 1.5570385231861052, "driven_lanedir_consec": 1.9824276802575016}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14647977Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-testingsim-0of4successnodavinci-stage-01-6.2.500:25:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median49.09999999999877
driven_lanedir_consec_median0.9735371136029332
deviation-center-line_median1.0260968130750516


other stats
deviation-center-line_max2.432385310357314
deviation-center-line_mean1.1456265619899282
deviation-center-line_min0.0979273114522956
deviation-heading_max19.664754859426942
deviation-heading_mean9.051228133128172
deviation-heading_median8.045901894691982
deviation-heading_min0.448353883701789
distance-from-start_max0.92616722690262
distance-from-start_mean0.6482217632692135
distance-from-start_median0.6790376606067473
distance-from-start_min0.30864450496073975
driven_any_max8.7395994187767
driven_any_mean5.003311354672157
driven_any_median4.781378105529232
driven_any_min1.7108897888534629
driven_lanedir_consec_max2.133045349871831
driven_lanedir_consec_mean1.1060091185788632
driven_lanedir_consec_min0.3439168972377553
driven_lanedir_max2.2745864050117497
driven_lanedir_mean1.1413943823638428
driven_lanedir_median0.9735371136029332
driven_lanedir_min0.3439168972377553
in-drivable-lane_max57.94999999999872
in-drivable-lane_mean47.73749999999882
in-drivable-lane_min34.799999999999
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.809862798376326, "survival_time": 59.99999999999873, "driven_lanedir": 0.3439168972377553, "in-drivable-lane": 55.54999999999873, "deviation-heading": 2.84930638154657, "distance-from-start": 0.30864450496073975, "deviation-center-line": 0.45418127342407033, "driven_lanedir_consec": 0.3439168972377553}, "autolab-000-ego1": {"driven_any": 6.7528934126821385, "survival_time": 59.99999999999873, "driven_lanedir": 1.5111839997248355, "in-drivable-lane": 42.64999999999881, "deviation-heading": 13.242497407837394, "distance-from-start": 0.92616722690262, "deviation-center-line": 1.5980123527260328, "driven_lanedir_consec": 1.5111839997248355}, "autolab-000-ego2": {"driven_any": 1.7108897888534629, "survival_time": 59.99999999999873, "driven_lanedir": 0.435890227481031, "in-drivable-lane": 57.94999999999872, "deviation-heading": 0.448353883701789, "distance-from-start": 0.8183336677579761, "deviation-center-line": 0.0979273114522956, "driven_lanedir_consec": 0.435890227481031}, "autolab-000-ego3": {"driven_any": 8.7395994187767, "survival_time": 59.99999999999873, "driven_lanedir": 2.2745864050117497, "in-drivable-lane": 34.799999999999, "deviation-heading": 19.664754859426942, "distance-from-start": 0.5397416534555185, "deviation-center-line": 2.432385310357314, "driven_lanedir_consec": 2.133045349871831}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14642978Bea Baselines 🐤template-pytorchaido-LFP-sim-testingsim-1of4successnodavinci-stage-01-6.2.500:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.5499999999999954
in-drivable-lane_median1.499999999999995
driven_lanedir_consec_median0.3337570313239768
deviation-center-line_median0.09738714221829972


other stats
deviation-center-line_max0.09738714221829972
deviation-center-line_mean0.09738714221829972
deviation-center-line_min0.09738714221829972
deviation-heading_max1.0559475956785718
deviation-heading_mean1.0559475956785718
deviation-heading_median1.0559475956785718
deviation-heading_min1.0559475956785718
distance-from-start_max0.4175995954727744
distance-from-start_mean0.4175995954727744
distance-from-start_median0.4175995954727744
distance-from-start_min0.4175995954727744
driven_any_max0.5847537646685028
driven_any_mean0.5847537646685028
driven_any_median0.5847537646685028
driven_any_min0.5847537646685028
driven_lanedir_consec_max0.3337570313239768
driven_lanedir_consec_mean0.3337570313239768
driven_lanedir_consec_min0.3337570313239768
driven_lanedir_max0.3337570313239768
driven_lanedir_mean0.3337570313239768
driven_lanedir_median0.3337570313239768
driven_lanedir_min0.3337570313239768
in-drivable-lane_max1.499999999999995
in-drivable-lane_mean1.499999999999995
in-drivable-lane_min1.499999999999995
per-episodes
details{"loop-000-ego0": {"driven_any": 0.5847537646685028, "survival_time": 3.5499999999999954, "driven_lanedir": 0.3337570313239768, "in-drivable-lane": 1.499999999999995, "deviation-heading": 1.0559475956785718, "distance-from-start": 0.4175995954727744, "deviation-center-line": 0.09738714221829972, "driven_lanedir_consec": 0.3337570313239768}}
simulation-passed1
survival_time_max3.5499999999999954
survival_time_mean3.5499999999999954
survival_time_min3.5499999999999954
No reset possible
14629982Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:11:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.000286102294921875
deviation-center-line_median0.8949084199909635


other stats
deviation-center-line_max0.8949084199909635
deviation-center-line_mean0.8949084199909635
deviation-center-line_min0.8949084199909635
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max4.965068306494546e-16
distance-from-start_mean4.965068306494546e-16
distance-from-start_median4.965068306494546e-16
distance-from-start_min4.965068306494546e-16
driven_any_max5.95808196779335e-13
driven_any_mean5.95808196779335e-13
driven_any_median5.95808196779335e-13
driven_any_min5.95808196779335e-13
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean0.000286102294921875
driven_lanedir_consec_min0.000286102294921875
driven_lanedir_max0.000286102294921875
driven_lanedir_mean0.000286102294921875
driven_lanedir_median0.000286102294921875
driven_lanedir_min0.000286102294921875
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.8949084199909635, "driven_lanedir_consec": 0.000286102294921875}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14621986Bea Baselines 🐤baseline-duckietownaido-LF-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:05:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.567919480047702
survival_time_median59.99999999999873
deviation-center-line_median4.9080084920624625
in-drivable-lane_median8.049999999999686


other stats
deviation-center-line_max4.9080084920624625
deviation-center-line_mean4.9080084920624625
deviation-center-line_min4.9080084920624625
deviation-heading_max12.79133683587168
deviation-heading_mean12.79133683587168
deviation-heading_median12.79133683587168
deviation-heading_min12.79133683587168
distance-from-start_max2.1659139827834544
distance-from-start_mean2.1659139827834544
distance-from-start_median2.1659139827834544
distance-from-start_min2.1659139827834544
driven_any_max7.9076714033165265
driven_any_mean7.9076714033165265
driven_any_median7.9076714033165265
driven_any_min7.9076714033165265
driven_lanedir_consec_max3.567919480047702
driven_lanedir_consec_mean3.567919480047702
driven_lanedir_consec_min3.567919480047702
driven_lanedir_max6.395861137926634
driven_lanedir_mean6.395861137926634
driven_lanedir_median6.395861137926634
driven_lanedir_min6.395861137926634
in-drivable-lane_max8.049999999999686
in-drivable-lane_mean8.049999999999686
in-drivable-lane_min8.049999999999686
per-episodes
details{"zigzag-000-ego0": {"driven_any": 7.9076714033165265, "survival_time": 59.99999999999873, "driven_lanedir": 6.395861137926634, "in-drivable-lane": 8.049999999999686, "deviation-heading": 12.79133683587168, "distance-from-start": 2.1659139827834544, "deviation-center-line": 4.9080084920624625, "driven_lanedir_consec": 3.567919480047702}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14617987Bea Baselines 🐤template-rosaido-LF-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1858527999289057
survival_time_median4.899999999999991
deviation-center-line_median0.07054397106424753
in-drivable-lane_median3.8499999999999903


other stats
deviation-center-line_max0.07054397106424753
deviation-center-line_mean0.07054397106424753
deviation-center-line_min0.07054397106424753
deviation-heading_max0.6069177729998052
deviation-heading_mean0.6069177729998052
deviation-heading_median0.6069177729998052
deviation-heading_min0.6069177729998052
distance-from-start_max1.1160926070526571
distance-from-start_mean1.1160926070526571
distance-from-start_median1.1160926070526571
distance-from-start_min1.1160926070526571
driven_any_max1.1292687576287694
driven_any_mean1.1292687576287694
driven_any_median1.1292687576287694
driven_any_min1.1292687576287694
driven_lanedir_consec_max0.1858527999289057
driven_lanedir_consec_mean0.1858527999289057
driven_lanedir_consec_min0.1858527999289057
driven_lanedir_max0.1858527999289057
driven_lanedir_mean0.1858527999289057
driven_lanedir_median0.1858527999289057
driven_lanedir_min0.1858527999289057
in-drivable-lane_max3.8499999999999903
in-drivable-lane_mean3.8499999999999903
in-drivable-lane_min3.8499999999999903
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.1292687576287694, "survival_time": 4.899999999999991, "driven_lanedir": 0.1858527999289057, "in-drivable-lane": 3.8499999999999903, "deviation-heading": 0.6069177729998052, "distance-from-start": 1.1160926070526571, "deviation-center-line": 0.07054397106424753, "driven_lanedir_consec": 0.1858527999289057}}
simulation-passed1
survival_time_max4.899999999999991
survival_time_mean4.899999999999991
survival_time_min4.899999999999991
No reset possible
14612989Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-validationsim-0of4failednodavinci-stage-01-6.2.500:01:13
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14607991Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-validationsim-1of4failednodavinci-stage-01-6.2.500:01:13
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14602992Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-validationsim-2of4failednodavinci-stage-01-6.2.500:00:56
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14597993Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-validationsim-2of4failednodavinci-stage-01-6.2.500:01:12
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14591994Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-validationsim-2of4failednodavinci-stage-01-6.2.500:01:13
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145861007Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-testingsim-2of4failednodavinci-stage-01-6.2.500:01:25
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145831007Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-testingsim-3of4failednodavinci-stage-01-6.2.500:01:15
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145771008Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-testingsim-1of4failednodavinci-stage-01-6.2.500:01:14
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145731010Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-testingsim-1of4failednodavinci-stage-01-6.2.500:00:58
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145691010Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-testingsim-0of4failednodavinci-stage-01-6.2.500:00:58
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145651011Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-testingsim-0of4failednodavinci-stage-01-6.2.500:01:14
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145611012Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-testingsim-1of4failednodavinci-stage-01-6.2.500:01:14
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145591013Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-testingsim-2of4failednodavinci-stage-01-6.2.500:00:59
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145521015Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
145501015Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
145481016Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:01:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
145361019Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-validationsim-1of4successnodavinci-stage-01-6.2.500:23:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median11.875000000000064
driven_lanedir_consec_median2.035852478328693
deviation-center-line_median2.4415476899172055


other stats
deviation-center-line_max3.8588512440814857
deviation-center-line_mean2.389412372663692
deviation-center-line_min0.8157028667388714
deviation-heading_max45.12366173763501
deviation-heading_mean25.331504293095975
deviation-heading_median26.27710152123557
deviation-heading_min3.648152392277753
distance-from-start_max1.9133774653533615
distance-from-start_mean1.3037635173638016
distance-from-start_median1.2864389344872886
distance-from-start_min0.7287987351272676
driven_any_max7.9135584549575455
driven_any_mean5.830428251192869
driven_any_median5.284350175450056
driven_any_min4.839454198913819
driven_lanedir_consec_max4.4251445593851475
driven_lanedir_consec_mean2.6003566054199485
driven_lanedir_consec_min1.90457690563726
driven_lanedir_max6.101838430798107
driven_lanedir_mean3.3663623620554812
driven_lanedir_median2.602041371358612
driven_lanedir_min2.1595282747065916
in-drivable-lane_max42.499999999998614
in-drivable-lane_mean18.812499999999645
in-drivable-lane_min8.999999999999826
per-episodes
details{"loop-000-ego0": {"driven_any": 4.839454198913819, "survival_time": 59.99999999999873, "driven_lanedir": 2.321008648570092, "in-drivable-lane": 13.400000000000002, "deviation-heading": 45.12366173763501, "distance-from-start": 0.7504943535932896, "deviation-center-line": 2.7760820870095233, "driven_lanedir_consec": 1.90457690563726}, "loop-000-ego1": {"driven_any": 7.9135584549575455, "survival_time": 59.99999999999873, "driven_lanedir": 6.101838430798107, "in-drivable-lane": 8.999999999999826, "deviation-heading": 15.937995632164569, "distance-from-start": 1.8223835153812875, "deviation-center-line": 3.8588512440814857, "driven_lanedir_consec": 4.4251445593851475}, "loop-000-ego2": {"driven_any": 4.840011207603829, "survival_time": 59.99999999999873, "driven_lanedir": 2.8830740941471324, "in-drivable-lane": 10.350000000000126, "deviation-heading": 36.61620741030657, "distance-from-start": 0.7287987351272676, "deviation-center-line": 2.1070132928248877, "driven_lanedir_consec": 1.9121766819507944}, "loop-000-ego3": {"driven_any": 5.7286891432962825, "survival_time": 59.99999999999873, "driven_lanedir": 2.1595282747065916, "in-drivable-lane": 42.499999999998614, "deviation-heading": 3.648152392277753, "distance-from-start": 1.9133774653533615, "deviation-center-line": 0.8157028667388714, "driven_lanedir_consec": 2.1595282747065916}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
145311020Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:04:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median27.90000000000026
in-drivable-lane_median2.0000000000000178
driven_lanedir_consec_median3.1396605023114317
deviation-center-line_median2.1876656130936065


other stats
deviation-center-line_max2.1876656130936065
deviation-center-line_mean2.1876656130936065
deviation-center-line_min2.1876656130936065
deviation-heading_max6.053685479628427
deviation-heading_mean6.053685479628427
deviation-heading_median6.053685479628427
deviation-heading_min6.053685479628427
distance-from-start_max2.578704024953579
distance-from-start_mean2.578704024953579
distance-from-start_median2.578704024953579
distance-from-start_min2.578704024953579
driven_any_max3.552905379172514
driven_any_mean3.552905379172514
driven_any_median3.552905379172514
driven_any_min3.552905379172514
driven_lanedir_consec_max3.1396605023114317
driven_lanedir_consec_mean3.1396605023114317
driven_lanedir_consec_min3.1396605023114317
driven_lanedir_max3.1396605023114317
driven_lanedir_mean3.1396605023114317
driven_lanedir_median3.1396605023114317
driven_lanedir_min3.1396605023114317
in-drivable-lane_max2.0000000000000178
in-drivable-lane_mean2.0000000000000178
in-drivable-lane_min2.0000000000000178
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.552905379172514, "survival_time": 27.90000000000026, "driven_lanedir": 3.1396605023114317, "in-drivable-lane": 2.0000000000000178, "deviation-heading": 6.053685479628427, "distance-from-start": 2.578704024953579, "deviation-center-line": 2.1876656130936065, "driven_lanedir_consec": 3.1396605023114317}}
simulation-passed1
survival_time_max27.90000000000026
survival_time_mean27.90000000000026
survival_time_min27.90000000000026
No reset possible
145241032Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-testingsim-0of4successnodavinci-stage-01-6.2.500:14:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median6.84999999999992
driven_lanedir_consec_median4.157319552197759
deviation-center-line_median3.876430313234652


other stats
deviation-center-line_max3.876430313234652
deviation-center-line_mean3.876430313234652
deviation-center-line_min3.876430313234652
deviation-heading_max13.727861059214536
deviation-heading_mean13.727861059214536
deviation-heading_median13.727861059214536
deviation-heading_min13.727861059214536
distance-from-start_max2.5507337987388565
distance-from-start_mean2.5507337987388565
distance-from-start_median2.5507337987388565
distance-from-start_min2.5507337987388565
driven_any_max7.914191593284278
driven_any_mean7.914191593284278
driven_any_median7.914191593284278
driven_any_min7.914191593284278
driven_lanedir_consec_max4.157319552197759
driven_lanedir_consec_mean4.157319552197759
driven_lanedir_consec_min4.157319552197759
driven_lanedir_max6.508336825620436
driven_lanedir_mean6.508336825620436
driven_lanedir_median6.508336825620436
driven_lanedir_min6.508336825620436
in-drivable-lane_max6.84999999999992
in-drivable-lane_mean6.84999999999992
in-drivable-lane_min6.84999999999992
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.914191593284278, "survival_time": 59.99999999999873, "driven_lanedir": 6.508336825620436, "in-drivable-lane": 6.84999999999992, "deviation-heading": 13.727861059214536, "distance-from-start": 2.5507337987388565, "deviation-center-line": 3.876430313234652, "driven_lanedir_consec": 4.157319552197759}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
145031037Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:28:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median14.324999999999546
driven_lanedir_consec_median3.867893790061285
deviation-center-line_median3.39046575640147


other stats
deviation-center-line_max4.629367177399155
deviation-center-line_mean2.9593753741144244
deviation-center-line_min0.4272028062556031
deviation-heading_max24.028458625897304
deviation-heading_mean17.57769287021062
deviation-heading_median21.888478622591737
deviation-heading_min2.505355609761705
distance-from-start_max4.37431405808424
distance-from-start_mean2.656752935359598
distance-from-start_median2.7843533781106773
distance-from-start_min0.6839909271327972
driven_any_max7.913281720465459
driven_any_mean6.121110957882715
driven_any_median7.677593561116336
driven_any_min1.2159749888327285
driven_lanedir_consec_max4.375226753313482
driven_lanedir_consec_mean3.1992172470159144
driven_lanedir_consec_min0.6858546546276048
driven_lanedir_max5.8502066133315465
driven_lanedir_mean4.11356005732722
driven_lanedir_median4.959089480674864
driven_lanedir_min0.6858546546276048
in-drivable-lane_max53.69999999999874
in-drivable-lane_mean22.66249999999941
in-drivable-lane_min8.29999999999982
per-episodes
details{"zigzag-000-ego0": {"driven_any": 7.913281720465459, "survival_time": 59.99999999999873, "driven_lanedir": 5.8502066133315465, "in-drivable-lane": 8.29999999999982, "deviation-heading": 22.687439760030824, "distance-from-start": 2.273299677329404, "deviation-center-line": 3.564780111402713, "driven_lanedir_consec": 4.131813306628415}, "zigzag-000-ego1": {"driven_any": 7.441977360189309, "survival_time": 59.99999999999873, "driven_lanedir": 4.4854711046890055, "in-drivable-lane": 18.299999999999297, "deviation-heading": 21.089517485152648, "distance-from-start": 4.37431405808424, "deviation-center-line": 3.2161514014002273, "driven_lanedir_consec": 3.6039742734941544}, "zigzag-000-ego2": {"driven_any": 1.2159749888327285, "survival_time": 59.99999999999873, "driven_lanedir": 0.6858546546276048, "in-drivable-lane": 53.69999999999874, "deviation-heading": 2.505355609761705, "distance-from-start": 0.6839909271327972, "deviation-center-line": 0.4272028062556031, "driven_lanedir_consec": 0.6858546546276048}, "zigzag-000-ego3": {"driven_any": 7.913209762043364, "survival_time": 59.99999999999873, "driven_lanedir": 5.432707856660723, "in-drivable-lane": 10.3499999999998, "deviation-heading": 24.028458625897304, "distance-from-start": 3.2954070788919503, "deviation-center-line": 4.629367177399155, "driven_lanedir_consec": 4.375226753313482}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144991038Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:03:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median25.250000000000224
in-drivable-lane_median1.1500000000000146
driven_lanedir_consec_median2.9765829131060673
deviation-center-line_median1.568521481037982


other stats
deviation-center-line_max1.568521481037982
deviation-center-line_mean1.568521481037982
deviation-center-line_min1.568521481037982
deviation-heading_max4.341636456481769
deviation-heading_mean4.341636456481769
deviation-heading_median4.341636456481769
deviation-heading_min4.341636456481769
distance-from-start_max2.269533143596769
distance-from-start_mean2.269533143596769
distance-from-start_median2.269533143596769
distance-from-start_min2.269533143596769
driven_any_max3.2011099711669875
driven_any_mean3.2011099711669875
driven_any_median3.2011099711669875
driven_any_min3.2011099711669875
driven_lanedir_consec_max2.9765829131060673
driven_lanedir_consec_mean2.9765829131060673
driven_lanedir_consec_min2.9765829131060673
driven_lanedir_max2.9765829131060673
driven_lanedir_mean2.9765829131060673
driven_lanedir_median2.9765829131060673
driven_lanedir_min2.9765829131060673
in-drivable-lane_max1.1500000000000146
in-drivable-lane_mean1.1500000000000146
in-drivable-lane_min1.1500000000000146
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.2011099711669875, "survival_time": 25.250000000000224, "driven_lanedir": 2.9765829131060673, "in-drivable-lane": 1.1500000000000146, "deviation-heading": 4.341636456481769, "distance-from-start": 2.269533143596769, "deviation-center-line": 1.568521481037982, "driven_lanedir_consec": 2.9765829131060673}}
simulation-passed1
survival_time_max25.250000000000224
survival_time_mean25.250000000000224
survival_time_min25.250000000000224
No reset possible
144921040Bea Baselines 🐤baseline-duckietownaido-LFV-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:12:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.000286102294921875
deviation-center-line_median0.8949084199909635


other stats
deviation-center-line_max0.8949084199909635
deviation-center-line_mean0.8949084199909635
deviation-center-line_min0.8949084199909635
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max4.965068306494546e-16
distance-from-start_mean4.965068306494546e-16
distance-from-start_median4.965068306494546e-16
distance-from-start_min4.965068306494546e-16
driven_any_max5.95808196779335e-13
driven_any_mean5.95808196779335e-13
driven_any_median5.95808196779335e-13
driven_any_min5.95808196779335e-13
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean0.000286102294921875
driven_lanedir_consec_min0.000286102294921875
driven_lanedir_max0.000286102294921875
driven_lanedir_mean0.000286102294921875
driven_lanedir_median0.000286102294921875
driven_lanedir_min0.000286102294921875
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.8949084199909635, "driven_lanedir_consec": 0.000286102294921875}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144801043Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-validationsim-1of4successnodavinci-stage-01-6.2.500:12:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median1.511698604299755


other stats
deviation-center-line_max2.946761767849851
deviation-center-line_mean1.5769744566982602
deviation-center-line_min0.3377388503436793
deviation-heading_max32.249113233675025
deviation-heading_mean22.83949643715976
deviation-heading_median22.597265680122995
deviation-heading_min13.914341154718024
distance-from-start_max2.220446049250313e-16
distance-from-start_mean1.1796119636642288e-16
distance-from-start_median1.249000902703301e-16
distance-from-start_min0.0
driven_any_max2.6645352591003757e-13
driven_any_mean1.4155343563970748e-13
driven_any_median1.4988010832439613e-13
driven_any_min0.0
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 1.665334536937735e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 1.3877787807814454e-16, "deviation-center-line": 0.8948943425963037, "driven_lanedir_consec": 0.0}, "4way-000-ego1": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 2.1285028660032066, "driven_lanedir_consec": 0.0}, "4way-000-ego2": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 14.481564596168331, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 2.946761767849851, "driven_lanedir_consec": 0.0}, "4way-000-ego3": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 13.914341154718024, "distance-from-start": 0.0, "deviation-center-line": 0.3377388503436793, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144751044Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:12:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median1.5117001971192878


other stats
deviation-center-line_max2.946786737000149
deviation-center-line_mean1.5769829592245754
deviation-center-line_min0.3377447056595774
deviation-heading_max32.249113233675025
deviation-heading_mean22.83949643715976
deviation-heading_median22.597265680122995
deviation-heading_min13.914341154718024
distance-from-start_max6.280369834735102e-16
distance-from-start_mean3.5129827517777994e-16
distance-from-start_median3.3306690738754696e-16
distance-from-start_min1.1102230246251563e-16
driven_any_max7.536443801682175e-13
driven_any_mean4.215579302133373e-13
driven_any_median3.9968028886505635e-13
driven_any_min1.3322676295501878e-13
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.536443801682175e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 6.280369834735102e-16, "deviation-center-line": 0.8948975282353634, "driven_lanedir_consec": 0.0}, "autolab-000-ego1": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 2.1285028660032124, "driven_lanedir_consec": 0.0}, "autolab-000-ego2": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 14.481564596168331, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 2.946786737000149, "driven_lanedir_consec": 0.0}, "autolab-000-ego3": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 13.914341154718024, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 0.3377447056595774, "driven_lanedir_consec": 0.000286102294921875}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144711045Bea Baselines 🐤baseline-duckietownaido-LFP-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:04:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8949116056299162


other stats
deviation-center-line_max0.8949116056299162
deviation-center-line_mean0.8949116056299162
deviation-center-line_min0.8949116056299162
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max4.965068306494546e-16
distance-from-start_mean4.965068306494546e-16
distance-from-start_median4.965068306494546e-16
distance-from-start_min4.965068306494546e-16
driven_any_max5.95808196779335e-13
driven_any_mean5.95808196779335e-13
driven_any_median5.95808196779335e-13
driven_any_min5.95808196779335e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.8949116056299162, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144641057Bea Baselines 🐤baseline-duckietownaido-LFV-sim-testingsim-0of4successnodavinci-stage-01-6.2.500:11:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.406517941735332


other stats
deviation-center-line_max0.406517941735332
deviation-center-line_mean0.406517941735332
deviation-center-line_min0.406517941735332
deviation-heading_max40.967332753486225
deviation-heading_mean40.967332753486225
deviation-heading_median40.967332753486225
deviation-heading_min40.967332753486225
distance-from-start_max1.6653345369377348e-16
distance-from-start_mean1.6653345369377348e-16
distance-from-start_median1.6653345369377348e-16
distance-from-start_min1.6653345369377348e-16
driven_any_max1.9984014443252818e-13
driven_any_mean1.9984014443252818e-13
driven_any_median1.9984014443252818e-13
driven_any_min1.9984014443252818e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.9984014443252818e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 1.6653345369377348e-16, "deviation-center-line": 0.406517941735332, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144611058Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
144501061Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-testingsim-0of4successnodavinci-stage-01-6.2.500:13:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median1.5844889463941298


other stats
deviation-center-line_max3.468403943259572
deviation-center-line_mean1.715123114844324
deviation-center-line_min0.22311062332946505
deviation-heading_max40.967332753486254
deviation-heading_mean25.437951450471505
deviation-heading_median28.066180210798333
deviation-heading_min4.652112626803104
distance-from-start_max8.95090418262362e-16
distance-from-start_mean2.515281801812194e-16
distance-from-start_median5.551115123125783e-17
distance-from-start_min0.0
driven_any_max1.0741085019148277e-12
driven_any_mean3.018338162174616e-13
driven_any_median6.661338147750939e-14
driven_any_min0.0
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 1.0741085019148277e-12, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 8.95090418262362e-16, "deviation-center-line": 0.40651845769758127, "driven_lanedir_consec": 0.0}, "udem-000-ego1": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005143, "distance-from-start": 0.0, "deviation-center-line": 3.468403943259572, "driven_lanedir_consec": 0.0}, "udem-000-ego2": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 4.652112626803104, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 0.22311062332946505, "driven_lanedir_consec": 0.0}, "udem-000-ego3": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 0.0, "deviation-center-line": 2.7624594350906784, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144471062Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:06:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median1.9374500507418704


other stats
deviation-center-line_max3.4683898658648995
deviation-center-line_mean1.9374500507418704
deviation-center-line_min0.4065102356188418
deviation-heading_max40.967332753486225
deviation-heading_mean29.638380384745684
deviation-heading_median29.638380384745684
deviation-heading_min18.309428016005143
distance-from-start_max1.1102230246251563e-16
distance-from-start_mean5.551115123125783e-17
distance-from-start_median5.551115123125783e-17
distance-from-start_min0.0
driven_any_max1.3322676295501878e-13
driven_any_mean6.661338147750939e-14
driven_any_median6.661338147750939e-14
driven_any_min0.0
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 0.4065102356188418, "driven_lanedir_consec": 0.0}, "loop2-000-ego1": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005143, "distance-from-start": 0.0, "deviation-center-line": 3.4683898658648995, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144421063Bea Baselines 🐤baseline-duckietownaido-LFP-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:05:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.000286102294921875
deviation-center-line_median0.4065583231185028


other stats
deviation-center-line_max0.4065583231185028
deviation-center-line_mean0.4065583231185028
deviation-center-line_min0.4065583231185028
deviation-heading_max40.967332753486254
deviation-heading_mean40.967332753486254
deviation-heading_median40.967332753486254
deviation-heading_min40.967332753486254
distance-from-start_max1.3877787807814457e-17
distance-from-start_mean1.3877787807814457e-17
distance-from-start_median1.3877787807814457e-17
distance-from-start_min1.3877787807814457e-17
driven_any_max1.6653345369377348e-14
driven_any_mean1.6653345369377348e-14
driven_any_median1.6653345369377348e-14
driven_any_min1.6653345369377348e-14
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean0.000286102294921875
driven_lanedir_consec_min0.000286102294921875
driven_lanedir_max0.000286102294921875
driven_lanedir_mean0.000286102294921875
driven_lanedir_median0.000286102294921875
driven_lanedir_min0.000286102294921875
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.6653345369377348e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 1.3877787807814457e-17, "deviation-center-line": 0.4065583231185028, "driven_lanedir_consec": 0.000286102294921875}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144391063Bea Baselines 🐤baseline-duckietownaido-LFP-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:04:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.4065274986524565


other stats
deviation-center-line_max0.4065274986524565
deviation-center-line_mean0.4065274986524565
deviation-center-line_min0.4065274986524565
deviation-heading_max40.967332753486254
deviation-heading_mean40.967332753486254
deviation-heading_median40.967332753486254
deviation-heading_min40.967332753486254
distance-from-start_max0.0
distance-from-start_mean0.0
distance-from-start_median0.0
distance-from-start_min0.0
driven_any_max0.0
driven_any_mean0.0
driven_any_median0.0
driven_any_min0.0
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 0.0, "deviation-center-line": 0.4065274986524565, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144261207Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-validationsim-1of4successnodavinci-stage-01-6.2.500:10:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.4352426430008087
deviation-center-line_median3.497394545816877


other stats
deviation-center-line_max3.497394545816877
deviation-center-line_mean3.497394545816877
deviation-center-line_min3.497394545816877
deviation-heading_max4.5431846817285875
deviation-heading_mean4.5431846817285875
deviation-heading_median4.5431846817285875
deviation-heading_min4.5431846817285875
distance-from-start_max2.2779004007617862
distance-from-start_mean2.2779004007617862
distance-from-start_median2.2779004007617862
distance-from-start_min2.2779004007617862
driven_any_max3.579588780115603
driven_any_mean3.579588780115603
driven_any_median3.579588780115603
driven_any_min3.579588780115603
driven_lanedir_consec_max3.4352426430008087
driven_lanedir_consec_mean3.4352426430008087
driven_lanedir_consec_min3.4352426430008087
driven_lanedir_max3.556065828743906
driven_lanedir_mean3.556065828743906
driven_lanedir_median3.556065828743906
driven_lanedir_min3.556065828743906
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 3.579588780115603, "survival_time": 59.99999999999873, "driven_lanedir": 3.556065828743906, "in-drivable-lane": 0.0, "deviation-heading": 4.5431846817285875, "distance-from-start": 2.2779004007617862, "deviation-center-line": 3.497394545816877, "driven_lanedir_consec": 3.4352426430008087}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144171209Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-validationsim-1of4successnodavinci-stage-01-6.2.500:09:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.449999999999882
driven_lanedir_consec_median3.305858702972225
deviation-center-line_median7.198939676780748


other stats
deviation-center-line_max7.198939676780748
deviation-center-line_mean7.198939676780748
deviation-center-line_min7.198939676780748
deviation-heading_max5.347648671657762
deviation-heading_mean5.347648671657762
deviation-heading_median5.347648671657762
deviation-heading_min5.347648671657762
distance-from-start_max2.180674072281247
distance-from-start_mean2.180674072281247
distance-from-start_median2.180674072281247
distance-from-start_min2.180674072281247
driven_any_max3.476091095751902
driven_any_mean3.476091095751902
driven_any_median3.476091095751902
driven_any_min3.476091095751902
driven_lanedir_consec_max3.305858702972225
driven_lanedir_consec_mean3.305858702972225
driven_lanedir_consec_min3.305858702972225
driven_lanedir_max3.305858702972225
driven_lanedir_mean3.305858702972225
driven_lanedir_median3.305858702972225
driven_lanedir_min3.305858702972225
in-drivable-lane_max3.449999999999882
in-drivable-lane_mean3.449999999999882
in-drivable-lane_min3.449999999999882
per-episodes
details{"loop-000-ego0": {"driven_any": 3.476091095751902, "survival_time": 59.99999999999873, "driven_lanedir": 3.305858702972225, "in-drivable-lane": 3.449999999999882, "deviation-heading": 5.347648671657762, "distance-from-start": 2.180674072281247, "deviation-center-line": 7.198939676780748, "driven_lanedir_consec": 3.305858702972225}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144121210Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:06:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.499999999999858
driven_lanedir_consec_median2.0645358809359813
deviation-center-line_median5.566213132905718


other stats
deviation-center-line_max5.566213132905718
deviation-center-line_mean5.566213132905718
deviation-center-line_min5.566213132905718
deviation-heading_max4.9431426026826735
deviation-heading_mean4.9431426026826735
deviation-heading_median4.9431426026826735
deviation-heading_min4.9431426026826735
distance-from-start_max1.7331587954302872
distance-from-start_mean1.7331587954302872
distance-from-start_median1.7331587954302872
distance-from-start_min1.7331587954302872
driven_any_max3.504736975249796
driven_any_mean3.504736975249796
driven_any_median3.504736975249796
driven_any_min3.504736975249796
driven_lanedir_consec_max2.0645358809359813
driven_lanedir_consec_mean2.0645358809359813
driven_lanedir_consec_min2.0645358809359813
driven_lanedir_max3.3607755978458167
driven_lanedir_mean3.3607755978458167
driven_lanedir_median3.3607755978458167
driven_lanedir_min3.3607755978458167
in-drivable-lane_max2.499999999999858
in-drivable-lane_mean2.499999999999858
in-drivable-lane_min2.499999999999858
per-episodes
details{"4way-000-ego0": {"driven_any": 3.504736975249796, "survival_time": 59.99999999999873, "driven_lanedir": 3.3607755978458167, "in-drivable-lane": 2.499999999999858, "deviation-heading": 4.9431426026826735, "distance-from-start": 1.7331587954302872, "deviation-center-line": 5.566213132905718, "driven_lanedir_consec": 2.0645358809359813}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144111210Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:01:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
144031212Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-validationsim-1of4successnodavinci-stage-01-6.2.500:15:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.20000000000000284
driven_lanedir_consec_median2.1565184275403313
deviation-center-line_median6.8847539526335915


other stats
deviation-center-line_max8.505262062597504
deviation-center-line_mean6.394382047888438
deviation-center-line_min3.302758223689067
deviation-heading_max3.5798145230604925
deviation-heading_mean3.012446130364057
deviation-heading_median3.033769498208445
deviation-heading_min2.402431001978846
distance-from-start_max2.264476618156332
distance-from-start_mean1.734085808306428
distance-from-start_median1.6868768650116457
distance-from-start_min1.29811288504609
driven_any_max3.579581555069671
driven_any_mean2.4167183064098396
driven_any_median2.2138464935031155
driven_any_min1.6595986835634573
driven_lanedir_consec_max3.3044744777527537
driven_lanedir_consec_mean2.3124661245028157
driven_lanedir_consec_min1.6323531651778471
driven_lanedir_max3.561566929531012
driven_lanedir_mean2.376739286489579
driven_lanedir_median2.156518525624728
driven_lanedir_min1.6323531651778471
in-drivable-lane_max1.8499999999998948
in-drivable-lane_mean0.5624999999999751
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 3.579581555069671, "survival_time": 59.99999999999873, "driven_lanedir": 3.561566929531012, "in-drivable-lane": 0.0, "deviation-heading": 3.2546450343389006, "distance-from-start": 2.0440638678450447, "deviation-center-line": 3.302758223689067, "driven_lanedir_consec": 3.3044744777527537}, "4way-000-ego1": {"driven_any": 2.762094908064345, "survival_time": 59.99999999999873, "driven_lanedir": 2.6640283319084603, "in-drivable-lane": 1.8499999999998948, "deviation-heading": 3.5798145230604925, "distance-from-start": 2.264476618156332, "deviation-center-line": 6.515047986085757, "driven_lanedir_consec": 2.664028135739667}, "4way-000-ego2": {"driven_any": 1.665598078941886, "survival_time": 59.99999999999873, "driven_lanedir": 1.6323531651778471, "in-drivable-lane": 0.4000000000000057, "deviation-heading": 2.8128939620779896, "distance-from-start": 1.29811288504609, "deviation-center-line": 7.254459919181427, "driven_lanedir_consec": 1.6323531651778471}, "4way-000-ego3": {"driven_any": 1.6595986835634573, "survival_time": 59.99999999999873, "driven_lanedir": 1.6490087193409952, "in-drivable-lane": 0.0, "deviation-heading": 2.402431001978846, "distance-from-start": 1.3296898621782465, "deviation-center-line": 8.505262062597504, "driven_lanedir_consec": 1.6490087193409952}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144001213Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-validationsim-1of4successnodavinci-stage-01-6.2.500:04:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.0999999999999377
driven_lanedir_consec_median3.4859795177769355
deviation-center-line_median5.328952992335323


other stats
deviation-center-line_max5.328952992335323
deviation-center-line_mean5.328952992335323
deviation-center-line_min5.328952992335323
deviation-heading_max2.913818063831324
deviation-heading_mean2.913818063831324
deviation-heading_median2.913818063831324
deviation-heading_min2.913818063831324
distance-from-start_max2.6400931371900738
distance-from-start_mean2.6400931371900738
distance-from-start_median2.6400931371900738
distance-from-start_min2.6400931371900738
driven_any_max3.5467463468284044
driven_any_mean3.5467463468284044
driven_any_median3.5467463468284044
driven_any_min3.5467463468284044
driven_lanedir_consec_max3.4859795177769355
driven_lanedir_consec_mean3.4859795177769355
driven_lanedir_consec_min3.4859795177769355
driven_lanedir_max3.4859795177769355
driven_lanedir_mean3.4859795177769355
driven_lanedir_median3.4859795177769355
driven_lanedir_min3.4859795177769355
in-drivable-lane_max1.0999999999999377
in-drivable-lane_mean1.0999999999999377
in-drivable-lane_min1.0999999999999377
per-episodes
details{"loop-000-ego0": {"driven_any": 3.5467463468284044, "survival_time": 59.99999999999873, "driven_lanedir": 3.4859795177769355, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.913818063831324, "distance-from-start": 2.6400931371900738, "deviation-center-line": 5.328952992335323, "driven_lanedir_consec": 3.4859795177769355}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143941215Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:04:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.1499999999999666
driven_lanedir_consec_median1.4203998040440715
deviation-center-line_median4.904463356399461


other stats
deviation-center-line_max4.904463356399461
deviation-center-line_mean4.904463356399461
deviation-center-line_min4.904463356399461
deviation-heading_max7.745124858723169
deviation-heading_mean7.745124858723169
deviation-heading_median7.745124858723169
deviation-heading_min7.745124858723169
distance-from-start_max1.2059816832534165
distance-from-start_mean1.2059816832534165
distance-from-start_median1.2059816832534165
distance-from-start_min1.2059816832534165
driven_any_max3.485084016236962
driven_any_mean3.485084016236962
driven_any_median3.485084016236962
driven_any_min3.485084016236962
driven_lanedir_consec_max1.4203998040440715
driven_lanedir_consec_mean1.4203998040440715
driven_lanedir_consec_min1.4203998040440715
driven_lanedir_max3.2905050472289954
driven_lanedir_mean3.2905050472289954
driven_lanedir_median3.2905050472289954
driven_lanedir_min3.2905050472289954
in-drivable-lane_max3.1499999999999666
in-drivable-lane_mean3.1499999999999666
in-drivable-lane_min3.1499999999999666
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.485084016236962, "survival_time": 59.99999999999873, "driven_lanedir": 3.2905050472289954, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.745124858723169, "distance-from-start": 1.2059816832534165, "deviation-center-line": 4.904463356399461, "driven_lanedir_consec": 1.4203998040440715}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143911215Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-testingsim-0of4successnodavinci-stage-01-6.2.500:03:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median25.200000000000223
in-drivable-lane_median1.1000000000000156
driven_lanedir_consec_median1.3557424143249113
deviation-center-line_median2.2764052687353016


other stats
deviation-center-line_max2.2764052687353016
deviation-center-line_mean2.2764052687353016
deviation-center-line_min2.2764052687353016
deviation-heading_max2.9201829757406066
deviation-heading_mean2.9201829757406066
deviation-heading_median2.9201829757406066
deviation-heading_min2.9201829757406066
distance-from-start_max1.1340032910142968
distance-from-start_mean1.1340032910142968
distance-from-start_median1.1340032910142968
distance-from-start_min1.1340032910142968
driven_any_max1.4165963270662665
driven_any_mean1.4165963270662665
driven_any_median1.4165963270662665
driven_any_min1.4165963270662665
driven_lanedir_consec_max1.3557424143249113
driven_lanedir_consec_mean1.3557424143249113
driven_lanedir_consec_min1.3557424143249113
driven_lanedir_max1.3557424143249113
driven_lanedir_mean1.3557424143249113
driven_lanedir_median1.3557424143249113
driven_lanedir_min1.3557424143249113
in-drivable-lane_max1.1000000000000156
in-drivable-lane_mean1.1000000000000156
in-drivable-lane_min1.1000000000000156
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.4165963270662665, "survival_time": 25.200000000000223, "driven_lanedir": 1.3557424143249113, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.9201829757406066, "distance-from-start": 1.1340032910142968, "deviation-center-line": 2.2764052687353016, "driven_lanedir_consec": 1.3557424143249113}}
simulation-passed1
survival_time_max25.200000000000223
survival_time_mean25.200000000000223
survival_time_min25.200000000000223
No reset possible
143821218Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-testingsim-0of4successnodavinci-stage-01-6.2.500:16:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.1749999999998764
driven_lanedir_consec_median3.3248172596190684
deviation-center-line_median5.75716887821971


other stats
deviation-center-line_max6.627907079134618
deviation-center-line_mean5.497801828136498
deviation-center-line_min3.848962476971951
deviation-heading_max11.413636489405157
deviation-heading_mean7.6893062297262045
deviation-heading_median7.06163724081356
deviation-heading_min5.220313947872544
distance-from-start_max3.071318609975737
distance-from-start_mean2.3992593598839593
distance-from-start_median2.4470384918328207
distance-from-start_min1.6316418458944593
driven_any_max3.579587562679039
driven_any_mean3.521088411159384
driven_any_median3.51433972593214
driven_any_min3.476086630094217
driven_lanedir_consec_max3.4776012543896866
driven_lanedir_consec_mean3.338894985703014
driven_lanedir_consec_min3.2283441691842336
driven_lanedir_max3.4776012543896866
driven_lanedir_mean3.377098944667144
driven_lanedir_median3.3812666483317493
driven_lanedir_min3.2682612276153913
in-drivable-lane_max3.449999999999882
in-drivable-lane_mean1.9499999999999087
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.509092316575898, "survival_time": 59.99999999999873, "driven_lanedir": 3.3813732916227455, "in-drivable-lane": 2.3499999999998664, "deviation-heading": 5.432222638225493, "distance-from-start": 1.6316418458944593, "deviation-center-line": 6.627907079134618, "driven_lanedir_consec": 3.3813732916227455}, "autolab-000-ego1": {"driven_any": 3.5195871352883814, "survival_time": 59.99999999999873, "driven_lanedir": 3.381160005040753, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 5.220313947872544, "distance-from-start": 2.830245940398582, "deviation-center-line": 6.258804535671791, "driven_lanedir_consec": 3.2283441691842336}, "autolab-000-ego2": {"driven_any": 3.476086630094217, "survival_time": 59.99999999999873, "driven_lanedir": 3.2682612276153913, "in-drivable-lane": 3.449999999999882, "deviation-heading": 8.691051843401628, "distance-from-start": 2.063831043267061, "deviation-center-line": 5.25553322076763, "driven_lanedir_consec": 3.2682612276153913}, "autolab-000-ego3": {"driven_any": 3.579587562679039, "survival_time": 59.99999999999873, "driven_lanedir": 3.4776012543896866, "in-drivable-lane": 0.0, "deviation-heading": 11.413636489405157, "distance-from-start": 3.071318609975737, "deviation-center-line": 3.848962476971951, "driven_lanedir_consec": 3.4776012543896866}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143791218Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:07:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.3499999999998806
driven_lanedir_consec_median2.380620752906845
deviation-center-line_median6.078324583568444


other stats
deviation-center-line_max6.569878400409913
deviation-center-line_mean6.078324583568444
deviation-center-line_min5.586770766726975
deviation-heading_max8.265181027759835
deviation-heading_mean7.317539588112885
deviation-heading_median7.317539588112885
deviation-heading_min6.369898148465933
distance-from-start_max1.63164181697012
distance-from-start_mean1.433389926870248
distance-from-start_median1.433389926870248
distance-from-start_min1.235138036770376
driven_any_max3.486583615924898
driven_any_mean3.479150650070676
driven_any_median3.479150650070676
driven_any_min3.471717684216453
driven_lanedir_consec_max3.28796749924175
driven_lanedir_consec_mean2.380620752906845
driven_lanedir_consec_min1.4732740065719407
driven_lanedir_max3.288000588512179
driven_lanedir_mean3.287984043876964
driven_lanedir_median3.287984043876964
driven_lanedir_min3.28796749924175
in-drivable-lane_max3.5999999999997954
in-drivable-lane_mean3.3499999999998806
in-drivable-lane_min3.099999999999966
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.471717684216453, "survival_time": 59.99999999999873, "driven_lanedir": 3.28796749924175, "in-drivable-lane": 3.5999999999997954, "deviation-heading": 6.369898148465933, "distance-from-start": 1.63164181697012, "deviation-center-line": 6.569878400409913, "driven_lanedir_consec": 3.28796749924175}, "loop2-000-ego1": {"driven_any": 3.486583615924898, "survival_time": 59.99999999999873, "driven_lanedir": 3.288000588512179, "in-drivable-lane": 3.099999999999966, "deviation-heading": 8.265181027759835, "distance-from-start": 1.235138036770376, "deviation-center-line": 5.586770766726975, "driven_lanedir_consec": 1.4732740065719407}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143751220Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:04:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.349999999999895
driven_lanedir_consec_median2.0916627772105003
deviation-center-line_median5.917247390668543


other stats
deviation-center-line_max5.917247390668543
deviation-center-line_mean5.917247390668543
deviation-center-line_min5.917247390668543
deviation-heading_max8.389432170044804
deviation-heading_mean8.389432170044804
deviation-heading_median8.389432170044804
deviation-heading_min8.389432170044804
distance-from-start_max1.030783297990397
distance-from-start_mean1.030783297990397
distance-from-start_median1.030783297990397
distance-from-start_min1.030783297990397
driven_any_max3.4490819837251045
driven_any_mean3.4490819837251045
driven_any_median3.4490819837251045
driven_any_min3.4490819837251045
driven_lanedir_consec_max2.0916627772105003
driven_lanedir_consec_mean2.0916627772105003
driven_lanedir_consec_min2.0916627772105003
driven_lanedir_max3.204014087213283
driven_lanedir_mean3.204014087213283
driven_lanedir_median3.204014087213283
driven_lanedir_min3.204014087213283
in-drivable-lane_max4.349999999999895
in-drivable-lane_mean4.349999999999895
in-drivable-lane_min4.349999999999895
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.4490819837251045, "survival_time": 59.99999999999873, "driven_lanedir": 3.204014087213283, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.389432170044804, "distance-from-start": 1.030783297990397, "deviation-center-line": 5.917247390668543, "driven_lanedir_consec": 2.0916627772105003}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143691222Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:04:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.1000000000000156
driven_lanedir_consec_median3.4856553091076994
deviation-center-line_median7.514935466498128


other stats
deviation-center-line_max7.514935466498128
deviation-center-line_mean7.514935466498128
deviation-center-line_min7.514935466498128
deviation-heading_max2.919831926025915
deviation-heading_mean2.919831926025915
deviation-heading_median2.919831926025915
deviation-heading_min2.919831926025915
distance-from-start_max2.8766441843618256
distance-from-start_mean2.8766441843618256
distance-from-start_median2.8766441843618256
distance-from-start_min2.8766441843618256
driven_any_max3.5465963271067142
driven_any_mean3.5465963271067142
driven_any_median3.5465963271067142
driven_any_min3.5465963271067142
driven_lanedir_consec_max3.4856553091076994
driven_lanedir_consec_mean3.4856553091076994
driven_lanedir_consec_min3.4856553091076994
driven_lanedir_max3.4856553091076994
driven_lanedir_mean3.4856553091076994
driven_lanedir_median3.4856553091076994
driven_lanedir_min3.4856553091076994
in-drivable-lane_max1.1000000000000156
in-drivable-lane_mean1.1000000000000156
in-drivable-lane_min1.1000000000000156
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.5465963271067142, "survival_time": 59.99999999999873, "driven_lanedir": 3.4856553091076994, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.919831926025915, "distance-from-start": 2.8766441843618256, "deviation-center-line": 7.514935466498128, "driven_lanedir_consec": 3.4856553091076994}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143641223Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:04:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.4226928398281333
deviation-center-line_median4.174748477462163


other stats
deviation-center-line_max4.174748477462163
deviation-center-line_mean4.174748477462163
deviation-center-line_min4.174748477462163
deviation-heading_max4.533756317111154
deviation-heading_mean4.533756317111154
deviation-heading_median4.533756317111154
deviation-heading_min4.533756317111154
distance-from-start_max2.2784552815665835
distance-from-start_mean2.2784552815665835
distance-from-start_median2.2784552815665835
distance-from-start_min2.2784552815665835
driven_any_max3.579587154113982
driven_any_mean3.579587154113982
driven_any_median3.579587154113982
driven_any_min3.579587154113982
driven_lanedir_consec_max3.4226928398281333
driven_lanedir_consec_mean3.4226928398281333
driven_lanedir_consec_min3.4226928398281333
driven_lanedir_max3.55610753301965
driven_lanedir_mean3.55610753301965
driven_lanedir_median3.55610753301965
driven_lanedir_min3.55610753301965
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 3.579587154113982, "survival_time": 59.99999999999873, "driven_lanedir": 3.55610753301965, "in-drivable-lane": 0.0, "deviation-heading": 4.533756317111154, "distance-from-start": 2.2784552815665835, "deviation-center-line": 4.174748477462163, "driven_lanedir_consec": 3.4226928398281333}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143591224Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:09:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.200000000000017
driven_lanedir_consec_median2.4146675176310586
deviation-center-line_median3.947705796799454


other stats
deviation-center-line_max6.091229568413222
deviation-center-line_mean4.214852861011506
deviation-center-line_min2.872770282033897
deviation-heading_max6.386481527905395
deviation-heading_mean5.35354556440471
deviation-heading_median5.451360814369008
deviation-heading_min4.1249791009754295
distance-from-start_max2.281674511474288
distance-from-start_mean1.714053337572477
distance-from-start_median1.836882099225881
distance-from-start_min0.900774640363858
driven_any_max3.579588827869872
driven_any_mean3.2555873758340863
driven_any_median3.5015869259609413
driven_any_min2.4395868235445906
driven_lanedir_consec_max3.4224970151785294
driven_lanedir_consec_mean2.2942753407245777
driven_lanedir_consec_min0.9252693124576647
driven_lanedir_max3.5575561401701146
driven_lanedir_mean3.1699347353913017
driven_lanedir_median3.415152633778211
driven_lanedir_min2.2918775338386688
in-drivable-lane_max2.5000000000000355
in-drivable-lane_mean1.2250000000000174
in-drivable-lane_min0.0
per-episodes
details{"udem-001-ego0": {"driven_any": 2.4395868235445906, "survival_time": 59.99999999999873, "driven_lanedir": 2.2918775338386688, "in-drivable-lane": 2.5000000000000355, "deviation-heading": 6.080254254951424, "distance-from-start": 0.900774640363858, "deviation-center-line": 6.091229568413222, "driven_lanedir_consec": 0.9252693124576647}, "udem-001-ego1": {"driven_any": 3.5795872366067147, "survival_time": 59.99999999999873, "driven_lanedir": 3.5575561401701146, "in-drivable-lane": 0.0, "deviation-heading": 4.1249791009754295, "distance-from-start": 2.227888326915521, "deviation-center-line": 2.872770282033897, "driven_lanedir_consec": 3.4083694793883828}, "udem-001-ego2": {"driven_any": 3.579588827869872, "survival_time": 59.99999999999873, "driven_lanedir": 3.554406946632496, "in-drivable-lane": 0.0, "deviation-heading": 4.822467373786592, "distance-from-start": 2.281674511474288, "deviation-center-line": 2.9756165082921022, "driven_lanedir_consec": 3.4224970151785294}, "udem-001-ego3": {"driven_any": 3.4235866153151684, "survival_time": 59.99999999999873, "driven_lanedir": 3.2758983209239267, "in-drivable-lane": 2.400000000000034, "deviation-heading": 6.386481527905395, "distance-from-start": 1.4458758715362408, "deviation-center-line": 4.919795085306806, "driven_lanedir_consec": 1.420965555873734}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143531226Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-validation453successnodavinci-stage-01-6.2.500:08:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.024999999999885
driven_lanedir_consec_median2.8836464071754424
deviation-center-line_median4.931508707760766


other stats
deviation-center-line_max6.3036870378980545
deviation-center-line_mean4.754059809018029
deviation-center-line_min2.849534782652531
deviation-heading_max10.21512648000997
deviation-heading_mean7.012504143780273
deviation-heading_median6.183746783871795
deviation-heading_min5.467396527367534
distance-from-start_max2.8921559661543035
distance-from-start_mean2.3425297784489167
distance-from-start_median2.7244627341849204
distance-from-start_min1.029037679271524
driven_any_max3.5795930523955186
driven_any_mean3.51658678882585
driven_any_median3.518837348781513
driven_any_min3.449079405344856
driven_lanedir_consec_max3.523403879531396
driven_lanedir_consec_mean2.80039428476615
driven_lanedir_consec_min1.9108804451823185
driven_lanedir_max3.523403879531396
driven_lanedir_mean3.367002207018827
driven_lanedir_median3.3821242286277675
driven_lanedir_min3.180356491288375
in-drivable-lane_max4.349999999999895
in-drivable-lane_mean2.099999999999916
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.5795930523955186, "survival_time": 59.99999999999873, "driven_lanedir": 3.523403879531396, "in-drivable-lane": 0.0, "deviation-heading": 6.6639509470713305, "distance-from-start": 2.8921559661543035, "deviation-center-line": 4.385751447715679, "driven_lanedir_consec": 3.523403879531396}, "autolab-000-ego1": {"driven_any": 3.5195867625452832, "survival_time": 59.99999999999873, "driven_lanedir": 3.3788154695170194, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 5.467396527367534, "distance-from-start": 2.8387069111327494, "deviation-center-line": 6.3036870378980545, "driven_lanedir_consec": 3.2259975588274012}, "autolab-000-ego2": {"driven_any": 3.5180879350177428, "survival_time": 59.99999999999873, "driven_lanedir": 3.385432987738516, "in-drivable-lane": 2.0499999999998835, "deviation-heading": 5.70354262067226, "distance-from-start": 2.6102185572370913, "deviation-center-line": 2.849534782652531, "driven_lanedir_consec": 2.541295255523484}, "autolab-000-ego3": {"driven_any": 3.449079405344856, "survival_time": 59.99999999999873, "driven_lanedir": 3.180356491288375, "in-drivable-lane": 4.349999999999895, "deviation-heading": 10.21512648000997, "distance-from-start": 1.029037679271524, "deviation-center-line": 5.477265967805854, "driven_lanedir_consec": 1.9108804451823185}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143481227Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:03:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median38.69999999999994
in-drivable-lane_median1.1000000000000156
driven_lanedir_consec_median2.128702834048944
deviation-center-line_median2.983588623443892


other stats
deviation-center-line_max2.983588623443892
deviation-center-line_mean2.983588623443892
deviation-center-line_min2.983588623443892
deviation-heading_max7.04246757923185
deviation-heading_mean7.04246757923185
deviation-heading_median7.04246757923185
deviation-heading_min7.04246757923185
distance-from-start_max1.8921505020832197
distance-from-start_mean1.8921505020832197
distance-from-start_median1.8921505020832197
distance-from-start_min1.8921505020832197
driven_any_max2.2265921855085775
driven_any_mean2.2265921855085775
driven_any_median2.2265921855085775
driven_any_min2.2265921855085775
driven_lanedir_consec_max2.128702834048944
driven_lanedir_consec_mean2.128702834048944
driven_lanedir_consec_min2.128702834048944
driven_lanedir_max2.128702834048944
driven_lanedir_mean2.128702834048944
driven_lanedir_median2.128702834048944
driven_lanedir_min2.128702834048944
in-drivable-lane_max1.1000000000000156
in-drivable-lane_mean1.1000000000000156
in-drivable-lane_min1.1000000000000156
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.2265921855085775, "survival_time": 38.69999999999994, "driven_lanedir": 2.128702834048944, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 7.04246757923185, "distance-from-start": 1.8921505020832197, "deviation-center-line": 2.983588623443892, "driven_lanedir_consec": 2.128702834048944}}
simulation-passed1
survival_time_max38.69999999999994
survival_time_mean38.69999999999994
survival_time_min38.69999999999994
No reset possible
143421229Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-testingsim-1of4successnodavinci-stage-01-6.2.500:04:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.548280526093551
deviation-center-line_median3.9116147681867446


other stats
deviation-center-line_max3.9116147681867446
deviation-center-line_mean3.9116147681867446
deviation-center-line_min3.9116147681867446
deviation-heading_max4.21820918012117
deviation-heading_mean4.21820918012117
deviation-heading_median4.21820918012117
deviation-heading_min4.21820918012117
distance-from-start_max2.3398538209611455
distance-from-start_mean2.3398538209611455
distance-from-start_median2.3398538209611455
distance-from-start_min2.3398538209611455
driven_any_max3.579594786375953
driven_any_mean3.579594786375953
driven_any_median3.579594786375953
driven_any_min3.579594786375953
driven_lanedir_consec_max3.548280526093551
driven_lanedir_consec_mean3.548280526093551
driven_lanedir_consec_min3.548280526093551
driven_lanedir_max3.5551990211644577
driven_lanedir_mean3.5551990211644577
driven_lanedir_median3.5551990211644577
driven_lanedir_min3.5551990211644577
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-000-ego0": {"driven_any": 3.579594786375953, "survival_time": 59.99999999999873, "driven_lanedir": 3.5551990211644577, "in-drivable-lane": 0.0, "deviation-heading": 4.21820918012117, "distance-from-start": 2.3398538209611455, "deviation-center-line": 3.9116147681867446, "driven_lanedir_consec": 3.548280526093551}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143391229Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
143341230Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-testingsim-0of4successnodavinci-stage-01-6.2.500:09:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.5500000000000078
driven_lanedir_consec_median2.825841304293628
deviation-center-line_median6.148412844000683


other stats
deviation-center-line_max7.459308588139718
deviation-center-line_mean5.79704956898892
deviation-center-line_min3.4320639998145963
deviation-heading_max5.71924387882506
deviation-heading_mean3.762143800377421
deviation-heading_median3.459178970777112
deviation-heading_min2.410973381130398
distance-from-start_max2.3395282410041216
distance-from-start_mean1.7201588165346102
distance-from-start_median1.841509860392298
distance-from-start_min0.8580873043497238
driven_any_max3.579593143168887
driven_any_mean2.845719156432434
driven_any_median2.859597815206898
driven_any_min2.0840878521470536
driven_lanedir_consec_max3.541021205942728
driven_lanedir_consec_mean2.496966407955825
driven_lanedir_consec_min0.795161817293316
driven_lanedir_max3.5571658869822893
driven_lanedir_mean2.7899921003455295
driven_lanedir_median2.8258414934613327
driven_lanedir_min1.9511195274771624
in-drivable-lane_max2.050000000000029
in-drivable-lane_mean0.7875000000000112
in-drivable-lane_min0.0
per-episodes
details{"udem-001-ego0": {"driven_any": 2.889596951730418, "survival_time": 59.99999999999873, "driven_lanedir": 2.8328219934740586, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.497059451447388, "distance-from-start": 2.1662522780274744, "deviation-center-line": 7.459308588139718, "driven_lanedir_consec": 2.8328219934740586}, "udem-001-ego1": {"driven_any": 2.0840878521470536, "survival_time": 59.99999999999873, "driven_lanedir": 1.9511195274771624, "in-drivable-lane": 2.050000000000029, "deviation-heading": 5.71924387882506, "distance-from-start": 0.8580873043497238, "deviation-center-line": 6.835139580883994, "driven_lanedir_consec": 0.795161817293316}, "udem-001-ego2": {"driven_any": 2.8295986786833778, "survival_time": 59.99999999999873, "driven_lanedir": 2.8188609934486073, "in-drivable-lane": 0.0, "deviation-heading": 2.410973381130398, "distance-from-start": 2.3395282410041216, "deviation-center-line": 5.461686107117372, "driven_lanedir_consec": 2.818860615113197}, "udem-001-ego3": {"driven_any": 3.579593143168887, "survival_time": 59.99999999999873, "driven_lanedir": 3.5571658869822893, "in-drivable-lane": 0.0, "deviation-heading": 4.421298490106836, "distance-from-start": 1.5167674427571216, "deviation-center-line": 3.4320639998145963, "driven_lanedir_consec": 3.541021205942728}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143291232Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:08:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.174999999999917
driven_lanedir_consec_median2.6226225453427174
deviation-center-line_median5.3031846613240265


other stats
deviation-center-line_max5.816265976116539
deviation-center-line_mean5.196634927837193
deviation-center-line_min4.363904412584181
deviation-heading_max13.510507170954757
deviation-heading_mean10.821915690706016
deviation-heading_median10.428621244524829
deviation-heading_min8.919913102819658
distance-from-start_max2.9580871089811698
distance-from-start_mean2.332849013698153
distance-from-start_median2.410604919303986
distance-from-start_min1.55209910720347
driven_any_max3.579590098610528
driven_any_mean3.3933509000885236
driven_any_median3.464904539716091
driven_any_min3.064004422311384
driven_lanedir_consec_max3.4992371353936753
driven_lanedir_consec_mean2.597829668578795
driven_lanedir_consec_min1.64683644823607
driven_lanedir_max3.4992371353936753
driven_lanedir_mean3.216224003341642
driven_lanedir_median3.212923209015736
driven_lanedir_min2.939812459941421
in-drivable-lane_max4.299999999999949
in-drivable-lane_mean2.162499999999946
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.579590098610528, "survival_time": 59.99999999999873, "driven_lanedir": 3.4992371353936753, "in-drivable-lane": 0.0, "deviation-heading": 8.919913102819658, "distance-from-start": 2.9580871089811698, "deviation-center-line": 4.363904412584181, "driven_lanedir_consec": 3.4992371353936753}, "zigzag-000-ego1": {"driven_any": 3.4790808241674496, "survival_time": 59.99999999999873, "driven_lanedir": 3.252574528929212, "in-drivable-lane": 3.3499999999998913, "deviation-heading": 10.055957232850009, "distance-from-start": 2.114012987076784, "deviation-center-line": 5.136572055912668, "driven_lanedir_consec": 2.305432630744014}, "zigzag-000-ego2": {"driven_any": 3.064004422311384, "survival_time": 59.99999999999873, "driven_lanedir": 2.939812459941421, "in-drivable-lane": 0.9999999999999432, "deviation-heading": 13.510507170954757, "distance-from-start": 2.707196851531188, "deviation-center-line": 5.469797266735385, "driven_lanedir_consec": 2.939812459941421}, "zigzag-000-ego3": {"driven_any": 3.4507282552647327, "survival_time": 59.99999999999873, "driven_lanedir": 3.17327188910226, "in-drivable-lane": 4.299999999999949, "deviation-heading": 10.80128525619965, "distance-from-start": 1.55209910720347, "deviation-center-line": 5.816265976116539, "driven_lanedir_consec": 1.64683644823607}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143201234Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-testingsim-0of4successnodavinci-stage-01-6.2.500:11:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.4692997359006403
deviation-center-line_median3.623644320092078


other stats
deviation-center-line_max3.623644320092078
deviation-center-line_mean3.623644320092078
deviation-center-line_min3.623644320092078
deviation-heading_max11.947232259174388
deviation-heading_mean11.947232259174388
deviation-heading_median11.947232259174388
deviation-heading_min11.947232259174388
distance-from-start_max3.168925231786075
distance-from-start_mean3.168925231786075
distance-from-start_median3.168925231786075
distance-from-start_min3.168925231786075
driven_any_max3.5795865108076983
driven_any_mean3.5795865108076983
driven_any_median3.5795865108076983
driven_any_min3.5795865108076983
driven_lanedir_consec_max3.4692997359006403
driven_lanedir_consec_mean3.4692997359006403
driven_lanedir_consec_min3.4692997359006403
driven_lanedir_max3.4692997359006403
driven_lanedir_mean3.4692997359006403
driven_lanedir_median3.4692997359006403
driven_lanedir_min3.4692997359006403
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.5795865108076983, "survival_time": 59.99999999999873, "driven_lanedir": 3.4692997359006403, "in-drivable-lane": 0.0, "deviation-heading": 11.947232259174388, "distance-from-start": 3.168925231786075, "deviation-center-line": 3.623644320092078, "driven_lanedir_consec": 3.4692997359006403}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143171235Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-testingsim-1of4successnodavinci-stage-01-6.2.500:03:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median39.19999999999991
in-drivable-lane_median2.0000000000000284
driven_lanedir_consec_median1.303336274368214
deviation-center-line_median2.900740783049649


other stats
deviation-center-line_max2.900740783049649
deviation-center-line_mean2.900740783049649
deviation-center-line_min2.900740783049649
deviation-heading_max5.3959193297072545
deviation-heading_mean5.3959193297072545
deviation-heading_median5.3959193297072545
deviation-heading_min5.3959193297072545
distance-from-start_max1.390965508634873
distance-from-start_mean1.390965508634873
distance-from-start_median1.390965508634873
distance-from-start_min1.390965508634873
driven_any_max2.2295876463781625
driven_any_mean2.2295876463781625
driven_any_median2.2295876463781625
driven_any_min2.2295876463781625
driven_lanedir_consec_max1.303336274368214
driven_lanedir_consec_mean1.303336274368214
driven_lanedir_consec_min1.303336274368214
driven_lanedir_max2.097514770609055
driven_lanedir_mean2.097514770609055
driven_lanedir_median2.097514770609055
driven_lanedir_min2.097514770609055
in-drivable-lane_max2.0000000000000284
in-drivable-lane_mean2.0000000000000284
in-drivable-lane_min2.0000000000000284
per-episodes
details{"loop-000-ego0": {"driven_any": 2.2295876463781625, "survival_time": 39.19999999999991, "driven_lanedir": 2.097514770609055, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.3959193297072545, "distance-from-start": 1.390965508634873, "deviation-center-line": 2.900740783049649, "driven_lanedir_consec": 1.303336274368214}}
simulation-passed1
survival_time_max39.19999999999991
survival_time_mean39.19999999999991
survival_time_min39.19999999999991
No reset possible
143121236Bea Baselines 🐤minimal-agent-stateaido-hello-sim-state-validationsanity-checksuccessnodavinci-stage-01-6.2.500:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.010100888678529872
deviation-center-line_median0.00637454737911999


other stats
deviation-center-line_max0.00637454737911999
deviation-center-line_mean0.00637454737911999
deviation-center-line_min0.00637454737911999
deviation-heading_max0.2614212407761817
deviation-heading_mean0.2614212407761817
deviation-heading_median0.2614212407761817
deviation-heading_min0.2614212407761817
distance-from-start_max0.011536496219628309
distance-from-start_mean0.011536496219628309
distance-from-start_median0.011536496219628309
distance-from-start_min0.011536496219628309
driven_any_max0.011538646402324344
driven_any_mean0.011538646402324344
driven_any_median0.011538646402324344
driven_any_min0.011538646402324344
driven_lanedir_consec_max0.010100888678529872
driven_lanedir_consec_mean0.010100888678529872
driven_lanedir_consec_min0.010100888678529872
driven_lanedir_max0.010100888678529872
driven_lanedir_mean0.010100888678529872
driven_lanedir_median0.010100888678529872
driven_lanedir_min0.010100888678529872
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.011538646402324344, "survival_time": 0.49999999999999994, "driven_lanedir": 0.010100888678529872, "in-drivable-lane": 0.0, "deviation-heading": 0.2614212407761817, "distance-from-start": 0.011536496219628309, "deviation-center-line": 0.00637454737911999, "driven_lanedir_consec": 0.010100888678529872}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
143091238Bea Baselines 🐤minimal-agentaido-LFVI-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
143031239Bea Baselines 🐤minimal-agentaido-LFI-sim-validationsim-1of4successnodavinci-stage-01-6.2.500:02:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.699999999999984
in-drivable-lane_median4.949999999999983
driven_lanedir_consec_median0.19955565328420843
deviation-center-line_median0.12567493837705537


other stats
deviation-center-line_max0.12567493837705537
deviation-center-line_mean0.12567493837705537
deviation-center-line_min0.12567493837705537
deviation-heading_max0.9488219555580464
deviation-heading_mean0.9488219555580464
deviation-heading_median0.9488219555580464
deviation-heading_min0.9488219555580464
distance-from-start_max0.9347143740566054
distance-from-start_mean0.9347143740566054
distance-from-start_median0.9347143740566054
distance-from-start_min0.9347143740566054
driven_any_max0.9347451682894398
driven_any_mean0.9347451682894398
driven_any_median0.9347451682894398
driven_any_min0.9347451682894398
driven_lanedir_consec_max0.19955565328420843
driven_lanedir_consec_mean0.19955565328420843
driven_lanedir_consec_min0.19955565328420843
driven_lanedir_max0.19955565328420843
driven_lanedir_mean0.19955565328420843
driven_lanedir_median0.19955565328420843
driven_lanedir_min0.19955565328420843
in-drivable-lane_max4.949999999999983
in-drivable-lane_mean4.949999999999983
in-drivable-lane_min4.949999999999983
per-episodes
details{"udem1-000-ego0": {"driven_any": 0.9347451682894398, "survival_time": 6.699999999999984, "driven_lanedir": 0.19955565328420843, "in-drivable-lane": 4.949999999999983, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.9347143740566054, "deviation-center-line": 0.12567493837705537, "driven_lanedir_consec": 0.19955565328420843}}
simulation-passed1
survival_time_max6.699999999999984
survival_time_mean6.699999999999984
survival_time_min6.699999999999984
No reset possible
143001240Bea Baselines 🐤minimal-agentaido-LF-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1969462908187456
survival_time_median10.450000000000014
deviation-center-line_median0.12539072943048185
in-drivable-lane_median8.700000000000014


other stats
deviation-center-line_max0.12539072943048185
deviation-center-line_mean0.12539072943048185
deviation-center-line_min0.12539072943048185
deviation-heading_max0.9520924629376072
deviation-heading_mean0.9520924629376072
deviation-heading_median0.9520924629376072
deviation-heading_min0.9520924629376072
distance-from-start_max1.550823637656203
distance-from-start_mean1.550823637656203
distance-from-start_median1.550823637656203
distance-from-start_min1.550823637656203
driven_any_max1.5511368313112863
driven_any_mean1.5511368313112863
driven_any_median1.5511368313112863
driven_any_min1.5511368313112863
driven_lanedir_consec_max0.1969462908187456
driven_lanedir_consec_mean0.1969462908187456
driven_lanedir_consec_min0.1969462908187456
driven_lanedir_max0.1969462908187456
driven_lanedir_mean0.1969462908187456
driven_lanedir_median0.1969462908187456
driven_lanedir_min0.1969462908187456
in-drivable-lane_max8.700000000000014
in-drivable-lane_mean8.700000000000014
in-drivable-lane_min8.700000000000014
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.5511368313112863, "survival_time": 10.450000000000014, "driven_lanedir": 0.1969462908187456, "in-drivable-lane": 8.700000000000014, "deviation-heading": 0.9520924629376072, "distance-from-start": 1.550823637656203, "deviation-center-line": 0.12539072943048185, "driven_lanedir_consec": 0.1969462908187456}}
simulation-passed1
survival_time_max10.450000000000014
survival_time_mean10.450000000000014
survival_time_min10.450000000000014
No reset possible
142981240Bea Baselines 🐤minimal-agentaido-LF-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:01:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.31872576909325967
survival_time_median12.40000000000004
deviation-center-line_median0.2634611971893196
in-drivable-lane_median9.150000000000045


other stats
deviation-center-line_max0.2634611971893196
deviation-center-line_mean0.2634611971893196
deviation-center-line_min0.2634611971893196
deviation-heading_max2.539741615834614
deviation-heading_mean2.539741615834614
deviation-heading_median2.539741615834614
deviation-heading_min2.539741615834614
distance-from-start_max1.8751243016635968
distance-from-start_mean1.8751243016635968
distance-from-start_median1.8751243016635968
distance-from-start_min1.8751243016635968
driven_any_max1.875978020012028
driven_any_mean1.875978020012028
driven_any_median1.875978020012028
driven_any_min1.875978020012028
driven_lanedir_consec_max0.31872576909325967
driven_lanedir_consec_mean0.31872576909325967
driven_lanedir_consec_min0.31872576909325967
driven_lanedir_max0.31872576909325967
driven_lanedir_mean0.31872576909325967
driven_lanedir_median0.31872576909325967
driven_lanedir_min0.31872576909325967
in-drivable-lane_max9.150000000000045
in-drivable-lane_mean9.150000000000045
in-drivable-lane_min9.150000000000045
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.875978020012028, "survival_time": 12.40000000000004, "driven_lanedir": 0.31872576909325967, "in-drivable-lane": 9.150000000000045, "deviation-heading": 2.539741615834614, "distance-from-start": 1.8751243016635968, "deviation-center-line": 0.2634611971893196, "driven_lanedir_consec": 0.31872576909325967}}
simulation-passed1
survival_time_max12.40000000000004
survival_time_mean12.40000000000004
survival_time_min12.40000000000004
No reset possible
142941241Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
142901242Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:03:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.299999999999983
in-drivable-lane_median6.624999999999982
driven_lanedir_consec_median0.19060094269967293
deviation-center-line_median0.1216458457586781


other stats
deviation-center-line_max0.21751801628337733
deviation-center-line_mean0.13818990472822829
deviation-center-line_min0.0919499111121796
deviation-heading_max1.097213756170657
deviation-heading_mean0.8726834400339218
deviation-heading_median0.8752529260804078
deviation-heading_min0.6430141518042152
distance-from-start_max1.1999739970209826
distance-from-start_mean0.960682482291036
distance-from-start_median0.9932177858395684
distance-from-start_min0.6563203604640253
driven_any_max1.2000364664329273
driven_any_mean0.960724520660087
driven_any_median0.9932647664055376
driven_any_min0.6563320833963454
driven_lanedir_consec_max0.5527361332180669
driven_lanedir_consec_mean0.26843501239744166
driven_lanedir_consec_min0.139802030972354
driven_lanedir_max0.5527361332180669
driven_lanedir_mean0.26843501239744166
driven_lanedir_median0.19060094269967293
driven_lanedir_min0.139802030972354
in-drivable-lane_max6.849999999999983
in-drivable-lane_mean6.137499999999984
in-drivable-lane_min4.449999999999989
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.6563320833963454, "survival_time": 8.299999999999983, "driven_lanedir": 0.139802030972354, "in-drivable-lane": 6.849999999999983, "deviation-heading": 0.9654177247981324, "distance-from-start": 0.6563203604640253, "deviation-center-line": 0.09390669229815438, "driven_lanedir_consec": 0.139802030972354}, "zigzag-000-ego1": {"driven_any": 0.9932647664055404, "survival_time": 8.299999999999983, "driven_lanedir": 0.5527361332180669, "in-drivable-lane": 4.449999999999989, "deviation-heading": 1.097213756170657, "distance-from-start": 0.9932177858395674, "deviation-center-line": 0.21751801628337733, "driven_lanedir_consec": 0.5527361332180669}, "zigzag-000-ego2": {"driven_any": 0.9932647664055346, "survival_time": 8.299999999999983, "driven_lanedir": 0.2351170339597527, "in-drivable-lane": 6.399999999999982, "deviation-heading": 0.6430141518042152, "distance-from-start": 0.9932177858395694, "deviation-center-line": 0.1493849992192018, "driven_lanedir_consec": 0.2351170339597527}, "zigzag-000-ego3": {"driven_any": 1.2000364664329273, "survival_time": 8.299999999999983, "driven_lanedir": 0.14608485143959313, "in-drivable-lane": 6.849999999999983, "deviation-heading": 0.7850881273626832, "distance-from-start": 1.1999739970209826, "deviation-center-line": 0.0919499111121796, "driven_lanedir_consec": 0.14608485143959313}}
simulation-passed1
survival_time_max8.299999999999983
survival_time_mean8.299999999999983
survival_time_min8.299999999999983
No reset possible
142881243Bea Baselines 🐤minimal-agentaido-LFP-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.299999999999989
in-drivable-lane_median3.5499999999999883
driven_lanedir_consec_median0.1995526730519679
deviation-center-line_median0.12567493837705493


other stats
deviation-center-line_max0.12567493837705493
deviation-center-line_mean0.12567493837705493
deviation-center-line_min0.12567493837705493
deviation-heading_max0.9488219555580464
deviation-heading_mean0.9488219555580464
deviation-heading_median0.9488219555580464
deviation-heading_min0.9488219555580464
distance-from-start_max0.7065171257852313
distance-from-start_mean0.7065171257852313
distance-from-start_median0.7065171257852313
distance-from-start_min0.7065171257852313
driven_any_max0.7065288976667109
driven_any_mean0.7065288976667109
driven_any_median0.7065288976667109
driven_any_min0.7065288976667109
driven_lanedir_consec_max0.1995526730519679
driven_lanedir_consec_mean0.1995526730519679
driven_lanedir_consec_min0.1995526730519679
driven_lanedir_max0.1995526730519679
driven_lanedir_mean0.1995526730519679
driven_lanedir_median0.1995526730519679
driven_lanedir_min0.1995526730519679
in-drivable-lane_max3.5499999999999883
in-drivable-lane_mean3.5499999999999883
in-drivable-lane_min3.5499999999999883
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.7065288976667109, "survival_time": 5.299999999999989, "driven_lanedir": 0.1995526730519679, "in-drivable-lane": 3.5499999999999883, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.7065171257852313, "deviation-center-line": 0.12567493837705493, "driven_lanedir_consec": 0.1995526730519679}}
simulation-passed1
survival_time_max5.299999999999989
survival_time_mean5.299999999999989
survival_time_min5.299999999999989
No reset possible
142811247Bea Baselines 🐤minimal-agentlx22-state-estimationsimsuccessyesdavinci-stage-01-6.2.500:04:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.602316779928666
survival_time_median11.250000000000025
deviation-center-line_median0.25844063605243855
in-drivable-lane_median6.600000000000033


other stats
deviation-center-line_max0.46940419435631386
deviation-center-line_mean0.31601951040293014
deviation-center-line_min0.220213700800038
deviation-heading_max2.138198727189773
deviation-heading_mean1.3887557886235824
deviation-heading_median1.3576715425669252
deviation-heading_min0.6703970961140492
distance-from-start_max2.9006007855190927
distance-from-start_mean2.0801990954134797
distance-from-start_median1.6889817408539205
distance-from-start_min1.651014759867426
driven_any_max2.9015373770561546
driven_any_mean2.0805808076947017
driven_any_median1.68908053965813
driven_any_min1.65112450636982
driven_lanedir_consec_max0.6591118533086625
driven_lanedir_consec_mean0.5555566616524058
driven_lanedir_consec_min0.40524135171988895
driven_lanedir_max0.6591118533086625
driven_lanedir_mean0.5555566616524058
driven_lanedir_median0.602316779928666
driven_lanedir_min0.40524135171988895
in-drivable-lane_max15.750000000000131
in-drivable-lane_mean9.550000000000065
in-drivable-lane_min6.300000000000031
per-episodes
details{"LF-zig-zag-000-ego0": {"driven_any": 1.65112450636982, "survival_time": 11.050000000000022, "driven_lanedir": 0.6591118533086625, "in-drivable-lane": 6.300000000000031, "deviation-heading": 1.3576715425669252, "distance-from-start": 1.651014759867426, "deviation-center-line": 0.220213700800038, "driven_lanedir_consec": 0.6591118533086625}, "LF-zig-zag-001-ego0": {"driven_any": 2.9015373770561546, "survival_time": 18.60000000000013, "driven_lanedir": 0.40524135171988895, "in-drivable-lane": 15.750000000000131, "deviation-heading": 0.6703970961140492, "distance-from-start": 2.9006007855190927, "deviation-center-line": 0.25844063605243855, "driven_lanedir_consec": 0.40524135171988895}, "LF-zig-zag-002-ego0": {"driven_any": 1.68908053965813, "survival_time": 11.250000000000025, "driven_lanedir": 0.602316779928666, "in-drivable-lane": 6.600000000000033, "deviation-heading": 2.138198727189773, "distance-from-start": 1.6889817408539205, "deviation-center-line": 0.46940419435631386, "driven_lanedir_consec": 0.602316779928666}}
simulation-passed1
survival_time_max18.60000000000013
survival_time_mean13.633333333333391
survival_time_min11.050000000000022
No reset possible
142771259Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:02:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median13.80000000000006
in-drivable-lane_median10.700000000000069
driven_lanedir_consec_median0.3090253186660683
deviation-center-line_median0.26861536036719097


other stats
deviation-center-line_max0.26861536036719097
deviation-center-line_mean0.26861536036719097
deviation-center-line_min0.26861536036719097
deviation-heading_max2.499533756017491
deviation-heading_mean2.499533756017491
deviation-heading_median2.499533756017491
deviation-heading_min2.499533756017491
distance-from-start_max2.1070810871296555
distance-from-start_mean2.1070810871296555
distance-from-start_median2.1070810871296555
distance-from-start_min2.1070810871296555
driven_any_max2.1073264492289447
driven_any_mean2.1073264492289447
driven_any_median2.1073264492289447
driven_any_min2.1073264492289447
driven_lanedir_consec_max0.3090253186660683
driven_lanedir_consec_mean0.3090253186660683
driven_lanedir_consec_min0.3090253186660683
driven_lanedir_max0.3090253186660683
driven_lanedir_mean0.3090253186660683
driven_lanedir_median0.3090253186660683
driven_lanedir_min0.3090253186660683
in-drivable-lane_max10.700000000000069
in-drivable-lane_mean10.700000000000069
in-drivable-lane_min10.700000000000069
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.1073264492289447, "survival_time": 13.80000000000006, "driven_lanedir": 0.3090253186660683, "in-drivable-lane": 10.700000000000069, "deviation-heading": 2.499533756017491, "distance-from-start": 2.1070810871296555, "deviation-center-line": 0.26861536036719097, "driven_lanedir_consec": 0.3090253186660683}}
simulation-passed1
survival_time_max13.80000000000006
survival_time_mean13.80000000000006
survival_time_min13.80000000000006
No reset possible
142721260Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
142671262Bea Baselines 🐤minimal-agentaido-LF-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:01:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3224736988087771
survival_time_median15.250000000000082
deviation-center-line_median0.2741150615740815
in-drivable-lane_median12.100000000000056


other stats
deviation-center-line_max0.2741150615740815
deviation-center-line_mean0.2741150615740815
deviation-center-line_min0.2741150615740815
deviation-heading_max2.486301423131022
deviation-heading_mean2.486301423131022
deviation-heading_median2.486301423131022
deviation-heading_min2.486301423131022
distance-from-start_max2.346684322024178
distance-from-start_mean2.346684322024178
distance-from-start_median2.346684322024178
distance-from-start_min2.346684322024178
driven_any_max2.3472858269950745
driven_any_mean2.3472858269950745
driven_any_median2.3472858269950745
driven_any_min2.3472858269950745
driven_lanedir_consec_max0.3224736988087771
driven_lanedir_consec_mean0.3224736988087771
driven_lanedir_consec_min0.3224736988087771
driven_lanedir_max0.3224736988087771
driven_lanedir_mean0.3224736988087771
driven_lanedir_median0.3224736988087771
driven_lanedir_min0.3224736988087771
in-drivable-lane_max12.100000000000056
in-drivable-lane_mean12.100000000000056
in-drivable-lane_min12.100000000000056
per-episodes
details{"zigzag-000-ego0": {"driven_any": 2.3472858269950745, "survival_time": 15.250000000000082, "driven_lanedir": 0.3224736988087771, "in-drivable-lane": 12.100000000000056, "deviation-heading": 2.486301423131022, "distance-from-start": 2.346684322024178, "deviation-center-line": 0.2741150615740815, "driven_lanedir_consec": 0.3224736988087771}}
simulation-passed1
survival_time_max15.250000000000082
survival_time_mean15.250000000000082
survival_time_min15.250000000000082
No reset possible
142631263Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
142581264Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-testingsim-1of4successnodavinci-stage-01-6.2.500:04:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median14.200000000000069
in-drivable-lane_median11.000000000000057
driven_lanedir_consec_median0.3152938274760638
deviation-center-line_median0.26684016190284265


other stats
deviation-center-line_max0.3356902421161755
deviation-center-line_mean0.24640550413561532
deviation-center-line_min0.11625145062060036
deviation-heading_max2.486301423131022
deviation-heading_mean1.563252755154394
deviation-heading_median1.5495075837941936
deviation-heading_min0.6676944298981667
distance-from-start_max2.173942193160628
distance-from-start_mean1.5951256386014727
distance-from-start_median1.745851963918557
distance-from-start_min0.7148564334081484
driven_any_max2.174275713561512
driven_any_mean1.595266942374297
driven_any_median1.7459619017485188
driven_any_min0.7148682524386378
driven_lanedir_consec_max0.6842972359477595
driven_lanedir_consec_mean0.3573150593764172
driven_lanedir_consec_min0.11437534660578176
driven_lanedir_max0.6842972359477595
driven_lanedir_mean0.3573150593764172
driven_lanedir_median0.3152938274760638
driven_lanedir_min0.11437534660578176
in-drivable-lane_max13.000000000000068
in-drivable-lane_mean11.162500000000064
in-drivable-lane_min9.650000000000077
per-episodes
details{"loop-000-ego0": {"driven_any": 2.174275713561512, "survival_time": 14.200000000000069, "driven_lanedir": 0.3224767982503016, "in-drivable-lane": 11.050000000000042, "deviation-heading": 2.486301423131022, "distance-from-start": 2.173942193160628, "deviation-center-line": 0.27411484919814116, "driven_lanedir_consec": 0.3224767982503016}, "loop-000-ego1": {"driven_any": 1.7252690192462308, "survival_time": 14.200000000000069, "driven_lanedir": 0.30811085670182603, "in-drivable-lane": 10.95000000000007, "deviation-heading": 2.339830246753357, "distance-from-start": 1.7251591376367597, "deviation-center-line": 0.3356902421161755, "driven_lanedir_consec": 0.30811085670182603}, "loop-000-ego2": {"driven_any": 1.766654784250807, "survival_time": 14.200000000000069, "driven_lanedir": 0.6842972359477595, "in-drivable-lane": 9.650000000000077, "deviation-heading": 0.6676944298981667, "distance-from-start": 1.7665447902003542, "deviation-center-line": 0.2595654746075442, "driven_lanedir_consec": 0.6842972359477595}, "loop-000-ego3": {"driven_any": 0.7148682524386378, "survival_time": 14.200000000000069, "driven_lanedir": 0.11437534660578176, "in-drivable-lane": 13.000000000000068, "deviation-heading": 0.7591849208350301, "distance-from-start": 0.7148564334081484, "deviation-center-line": 0.11625145062060036, "driven_lanedir_consec": 0.11437534660578176}}
simulation-passed1
survival_time_max14.200000000000069
survival_time_mean14.200000000000069
survival_time_min14.200000000000069
No reset possible
142551265Bea Baselines 🐤minimal-agentaido-LFP-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:02:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.15000000000001
in-drivable-lane_median7.050000000000014
driven_lanedir_consec_median0.3090241265730129
deviation-center-line_median0.2686164080772624


other stats
deviation-center-line_max0.2686164080772624
deviation-center-line_mean0.2686164080772624
deviation-center-line_min0.2686164080772624
deviation-heading_max2.49953375601749
deviation-heading_mean2.49953375601749
deviation-heading_median2.49953375601749
deviation-heading_min2.49953375601749
distance-from-start_max1.5040665006803369
distance-from-start_mean1.5040665006803369
distance-from-start_median1.5040665006803369
distance-from-start_min1.5040665006803369
driven_any_max1.5041747780934245
driven_any_mean1.5041747780934245
driven_any_median1.5041747780934245
driven_any_min1.5041747780934245
driven_lanedir_consec_max0.3090241265730129
driven_lanedir_consec_mean0.3090241265730129
driven_lanedir_consec_min0.3090241265730129
driven_lanedir_max0.3090241265730129
driven_lanedir_mean0.3090241265730129
driven_lanedir_median0.3090241265730129
driven_lanedir_min0.3090241265730129
in-drivable-lane_max7.050000000000014
in-drivable-lane_mean7.050000000000014
in-drivable-lane_min7.050000000000014
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.5041747780934245, "survival_time": 10.15000000000001, "driven_lanedir": 0.3090241265730129, "in-drivable-lane": 7.050000000000014, "deviation-heading": 2.49953375601749, "distance-from-start": 1.5040665006803369, "deviation-center-line": 0.2686164080772624, "driven_lanedir_consec": 0.3090241265730129}}
simulation-passed1
survival_time_max10.15000000000001
survival_time_mean10.15000000000001
survival_time_min10.15000000000001
No reset possible
142531265Bea Baselines 🐤minimal-agentaido-LFP-sim-testingsim-0of4successnodavinci-stage-01-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.14999999999999
in-drivable-lane_median3.74999999999999
driven_lanedir_consec_median0.13665955970746824
deviation-center-line_median0.10783802485851962


other stats
deviation-center-line_max0.10783802485851962
deviation-center-line_mean0.10783802485851962
deviation-center-line_min0.10783802485851962
deviation-heading_max0.9508048428349386
deviation-heading_mean0.9508048428349386
deviation-heading_median0.9508048428349386
deviation-heading_min0.9508048428349386
distance-from-start_max0.6813626821293306
distance-from-start_mean0.6813626821293306
distance-from-start_median0.6813626821293306
distance-from-start_min0.6813626821293306
driven_any_max0.6813744088473564
driven_any_mean0.6813744088473564
driven_any_median0.6813744088473564
driven_any_min0.6813744088473564
driven_lanedir_consec_max0.13665955970746824
driven_lanedir_consec_mean0.13665955970746824
driven_lanedir_consec_min0.13665955970746824
driven_lanedir_max0.13665955970746824
driven_lanedir_mean0.13665955970746824
driven_lanedir_median0.13665955970746824
driven_lanedir_min0.13665955970746824
in-drivable-lane_max3.74999999999999
in-drivable-lane_mean3.74999999999999
in-drivable-lane_min3.74999999999999
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.6813744088473564, "survival_time": 5.14999999999999, "driven_lanedir": 0.13665955970746824, "in-drivable-lane": 3.74999999999999, "deviation-heading": 0.9508048428349386, "distance-from-start": 0.6813626821293306, "deviation-center-line": 0.10783802485851962, "driven_lanedir_consec": 0.13665955970746824}}
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean5.14999999999999
survival_time_min5.14999999999999
No reset possible
142521265Bea Baselines 🐤minimal-agentaido-LFP-sim-testingsim-1of4successnodavinci-stage-01-6.2.500:02:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.85000000000002
in-drivable-lane_median9.45000000000002
driven_lanedir_consec_median0.13666480491623578
deviation-center-line_median0.10783813033632964


other stats
deviation-center-line_max0.10783813033632964
deviation-center-line_mean0.10783813033632964
deviation-center-line_min0.10783813033632964
deviation-heading_max0.9508048428349386
deviation-heading_mean0.9508048428349386
deviation-heading_median0.9508048428349386
deviation-heading_min0.9508048428349386
distance-from-start_max1.6182798682575148
distance-from-start_mean1.6182798682575148
distance-from-start_median1.6182798682575148
distance-from-start_min1.6182798682575148
driven_any_max1.618389277101394
driven_any_mean1.618389277101394
driven_any_median1.618389277101394
driven_any_min1.618389277101394
driven_lanedir_consec_max0.13666480491623578
driven_lanedir_consec_mean0.13666480491623578
driven_lanedir_consec_min0.13666480491623578
driven_lanedir_max0.13666480491623578
driven_lanedir_mean0.13666480491623578
driven_lanedir_median0.13666480491623578
driven_lanedir_min0.13666480491623578
in-drivable-lane_max9.45000000000002
in-drivable-lane_mean9.45000000000002
in-drivable-lane_min9.45000000000002
per-episodes
details{"loop-000-ego0": {"driven_any": 1.618389277101394, "survival_time": 10.85000000000002, "driven_lanedir": 0.13666480491623578, "in-drivable-lane": 9.45000000000002, "deviation-heading": 0.9508048428349386, "distance-from-start": 1.6182798682575148, "deviation-center-line": 0.10783813033632964, "driven_lanedir_consec": 0.13666480491623578}}
simulation-passed1
survival_time_max10.85000000000002
survival_time_mean10.85000000000002
survival_time_min10.85000000000002
No reset possible
142401290Bea Baselines 🐤template-randomaido-LFVI-sim-testingsim-0of4successnodavinci-stage-01-6.2.500:14:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median55.54999999999898
in-drivable-lane_median33.999999999999304
driven_lanedir_consec_median0.23486935510848683
deviation-center-line_median1.9152361710618249


other stats
deviation-center-line_max1.9152361710618249
deviation-center-line_mean1.9152361710618249
deviation-center-line_min1.9152361710618249
deviation-heading_max18.76264857218657
deviation-heading_mean18.76264857218657
deviation-heading_median18.76264857218657
deviation-heading_min18.76264857218657
distance-from-start_max1.290574960120657
distance-from-start_mean1.290574960120657
distance-from-start_median1.290574960120657
distance-from-start_min1.290574960120657
driven_any_max13.766585811745278
driven_any_mean13.766585811745278
driven_any_median13.766585811745278
driven_any_min13.766585811745278
driven_lanedir_consec_max0.23486935510848683
driven_lanedir_consec_mean0.23486935510848683
driven_lanedir_consec_min0.23486935510848683
driven_lanedir_max0.22765090740773952
driven_lanedir_mean0.22765090740773952
driven_lanedir_median0.22765090740773952
driven_lanedir_min0.22765090740773952
in-drivable-lane_max33.999999999999304
in-drivable-lane_mean33.999999999999304
in-drivable-lane_min33.999999999999304
per-episodes
details{"udem-000-ego0": {"driven_any": 13.766585811745278, "survival_time": 55.54999999999898, "driven_lanedir": 0.22765090740773952, "in-drivable-lane": 33.999999999999304, "deviation-heading": 18.76264857218657, "distance-from-start": 1.290574960120657, "deviation-center-line": 1.9152361710618249, "driven_lanedir_consec": 0.23486935510848683}}
simulation-passed1
survival_time_max55.54999999999898
survival_time_mean55.54999999999898
survival_time_min55.54999999999898
No reset possible
142331292Bea Baselines 🐤template-randomaido-LF-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:07:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.012435476414101476
survival_time_median59.99999999999873
deviation-center-line_median0.5849703750508038
in-drivable-lane_median53.74999999999868


other stats
deviation-center-line_max0.5849703750508038
deviation-center-line_mean0.5849703750508038
deviation-center-line_min0.5849703750508038
deviation-heading_max4.775258785640045
deviation-heading_mean4.775258785640045
deviation-heading_median4.775258785640045
deviation-heading_min4.775258785640045
distance-from-start_max1.4108418329398955
distance-from-start_mean1.4108418329398955
distance-from-start_median1.4108418329398955
distance-from-start_min1.4108418329398955
driven_any_max15.326310847370571
driven_any_mean15.326310847370571
driven_any_median15.326310847370571
driven_any_min15.326310847370571
driven_lanedir_consec_max0.012435476414101476
driven_lanedir_consec_mean0.012435476414101476
driven_lanedir_consec_min0.012435476414101476
driven_lanedir_max0.01578217614057431
driven_lanedir_mean0.01578217614057431
driven_lanedir_median0.01578217614057431
driven_lanedir_min0.01578217614057431
in-drivable-lane_max53.74999999999868
in-drivable-lane_mean53.74999999999868
in-drivable-lane_min53.74999999999868
per-episodes
details{"zigzag-000-ego0": {"driven_any": 15.326310847370571, "survival_time": 59.99999999999873, "driven_lanedir": 0.01578217614057431, "in-drivable-lane": 53.74999999999868, "deviation-heading": 4.775258785640045, "distance-from-start": 1.4108418329398955, "deviation-center-line": 0.5849703750508038, "driven_lanedir_consec": 0.012435476414101476}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
142321292Bea Baselines 🐤template-randomaido-LF-sim-testingsim-0of4successnodavinci-stage-01-6.2.500:02:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.029483020207996535
survival_time_median11.450000000000028
deviation-center-line_median0.32684152243677644
in-drivable-lane_median8.000000000000016


other stats
deviation-center-line_max0.32684152243677644
deviation-center-line_mean0.32684152243677644
deviation-center-line_min0.32684152243677644
deviation-heading_max2.5488727326530465
deviation-heading_mean2.5488727326530465
deviation-heading_median2.5488727326530465
deviation-heading_min2.5488727326530465
distance-from-start_max0.5461575079396548
distance-from-start_mean0.5461575079396548
distance-from-start_median0.5461575079396548
distance-from-start_min0.5461575079396548
driven_any_max2.3519174817467863
driven_any_mean2.3519174817467863
driven_any_median2.3519174817467863
driven_any_min2.3519174817467863
driven_lanedir_consec_max0.029483020207996535
driven_lanedir_consec_mean0.029483020207996535
driven_lanedir_consec_min0.029483020207996535
driven_lanedir_max0.03283067360874581
driven_lanedir_mean0.03283067360874581
driven_lanedir_median0.03283067360874581
driven_lanedir_min0.03283067360874581
in-drivable-lane_max8.000000000000016
in-drivable-lane_mean8.000000000000016
in-drivable-lane_min8.000000000000016
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.3519174817467863, "survival_time": 11.450000000000028, "driven_lanedir": 0.03283067360874581, "in-drivable-lane": 8.000000000000016, "deviation-heading": 2.5488727326530465, "distance-from-start": 0.5461575079396548, "deviation-center-line": 0.32684152243677644, "driven_lanedir_consec": 0.029483020207996535}}
simulation-passed1
survival_time_max11.450000000000028
survival_time_mean11.450000000000028
survival_time_min11.450000000000028
No reset possible
142301293Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
142281293Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-1of4successnodavinci-stage-01-6.2.500:07:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.850000000000104
in-drivable-lane_median12.125000000000089
driven_lanedir_consec_median0.0914085509908058
deviation-center-line_median0.43295730670036126


other stats
deviation-center-line_max0.9740434407320936
deviation-center-line_mean0.4859958968604682
deviation-center-line_min0.10402553330905678
deviation-heading_max11.275693531416076
deviation-heading_mean4.654809102682379
deviation-heading_median2.965682219224468
deviation-heading_min1.412178440864505
distance-from-start_max0.6736010379604943
distance-from-start_mean0.3985347917343786
distance-from-start_median0.4602690644885098
distance-from-start_min6.280369834735102e-16
driven_any_max4.057822758459427
driven_any_mean1.6869445200555797
driven_any_median1.3449776608814374
driven_any_min1.6723002649096045e-14
driven_lanedir_consec_max0.3062479141509611
driven_lanedir_consec_mean0.12226625403314316
driven_lanedir_consec_min0.0
driven_lanedir_max0.3062479141509611
driven_lanedir_mean0.11925650183156368
driven_lanedir_median0.08538904658764679
driven_lanedir_min0.0
in-drivable-lane_max14.800000000000107
in-drivable-lane_mean9.76250000000007
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 2.295525081876566, "survival_time": 16.850000000000104, "driven_lanedir": 0.03283062049203522, "in-drivable-lane": 13.400000000000093, "deviation-heading": 2.548872644626666, "distance-from-start": 0.5461575079396546, "deviation-center-line": 0.3268416966298657, "driven_lanedir_consec": 0.029485112858473883}, "4way-000-ego1": {"driven_any": 1.6723002649096045e-14, "survival_time": 16.850000000000104, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 11.275693531416076, "distance-from-start": 6.280369834735102e-16, "deviation-center-line": 0.9740434407320936, "driven_lanedir_consec": 0.0}, "4way-000-ego2": {"driven_any": 4.057822758459427, "survival_time": 16.850000000000104, "driven_lanedir": 0.13794747268325835, "in-drivable-lane": 10.850000000000088, "deviation-heading": 3.3824917938222696, "distance-from-start": 0.6736010379604943, "deviation-center-line": 0.5390729167708568, "driven_lanedir_consec": 0.15333198912313772}, "4way-000-ego3": {"driven_any": 0.3944302398863089, "survival_time": 16.850000000000104, "driven_lanedir": 0.3062479141509611, "in-drivable-lane": 14.800000000000107, "deviation-heading": 1.412178440864505, "distance-from-start": 0.37438062103736497, "deviation-center-line": 0.10402553330905678, "driven_lanedir_consec": 0.3062479141509611}}
simulation-passed1
survival_time_max16.850000000000104
survival_time_mean16.850000000000104
survival_time_min16.850000000000104
No reset possible
142231295Bea Baselines 🐤template-randomaido-LFP-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:08:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median36.34999999999917
driven_lanedir_consec_median0.23799216289173675
deviation-center-line_median2.122382603135255


other stats
deviation-center-line_max2.122382603135255
deviation-center-line_mean2.122382603135255
deviation-center-line_min2.122382603135255
deviation-heading_max20.52214487263099
deviation-heading_mean20.52214487263099
deviation-heading_median20.52214487263099
deviation-heading_min20.52214487263099
distance-from-start_max1.4108418329398902
distance-from-start_mean1.4108418329398902
distance-from-start_median1.4108418329398902
distance-from-start_min1.4108418329398902
driven_any_max15.326310847370609
driven_any_mean15.326310847370609
driven_any_median15.326310847370609
driven_any_min15.326310847370609
driven_lanedir_consec_max0.23799216289173675
driven_lanedir_consec_mean0.23799216289173675
driven_lanedir_consec_min0.23799216289173675
driven_lanedir_max0.2454177542370326
driven_lanedir_mean0.2454177542370326
driven_lanedir_median0.2454177542370326
driven_lanedir_min0.2454177542370326
in-drivable-lane_max36.34999999999917
in-drivable-lane_mean36.34999999999917
in-drivable-lane_min36.34999999999917
per-episodes
details{"zigzag-000-ego0": {"driven_any": 15.326310847370609, "survival_time": 59.99999999999873, "driven_lanedir": 0.2454177542370326, "in-drivable-lane": 36.34999999999917, "deviation-heading": 20.52214487263099, "distance-from-start": 1.4108418329398902, "deviation-center-line": 2.122382603135255, "driven_lanedir_consec": 0.23799216289173675}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
142201295Bea Baselines 🐤template-randomaido-LFP-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:02:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.300000000000026
in-drivable-lane_median7.850000000000014
driven_lanedir_consec_median0.02948472541340319
deviation-center-line_median0.3268416970813497


other stats
deviation-center-line_max0.3268416970813497
deviation-center-line_mean0.3268416970813497
deviation-center-line_min0.3268416970813497
deviation-heading_max2.548872596322993
deviation-heading_mean2.548872596322993
deviation-heading_median2.548872596322993
deviation-heading_min2.548872596322993
distance-from-start_max0.5461575079396523
distance-from-start_mean0.5461575079396523
distance-from-start_median0.5461575079396523
distance-from-start_min0.5461575079396523
driven_any_max2.2681416551684617
driven_any_mean2.2681416551684617
driven_any_median2.2681416551684617
driven_any_min2.2681416551684617
driven_lanedir_consec_max0.02948472541340319
driven_lanedir_consec_mean0.02948472541340319
driven_lanedir_consec_min0.02948472541340319
driven_lanedir_max0.032831067512037126
driven_lanedir_mean0.032831067512037126
driven_lanedir_median0.032831067512037126
driven_lanedir_min0.032831067512037126
in-drivable-lane_max7.850000000000014
in-drivable-lane_mean7.850000000000014
in-drivable-lane_min7.850000000000014
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.2681416551684617, "survival_time": 11.300000000000026, "driven_lanedir": 0.032831067512037126, "in-drivable-lane": 7.850000000000014, "deviation-heading": 2.548872596322993, "distance-from-start": 0.5461575079396523, "deviation-center-line": 0.3268416970813497, "driven_lanedir_consec": 0.02948472541340319}}
simulation-passed1
survival_time_max11.300000000000026
survival_time_mean11.300000000000026
survival_time_min11.300000000000026
No reset possible
142121268Bea Baselines 🐤template-randomaido-LFVI-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:07:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median28.850000000000275
in-drivable-lane_median18.900000000000233
driven_lanedir_consec_median0.25774306587044116
deviation-center-line_median0.8659891122281899


other stats
deviation-center-line_max0.8659891122281899
deviation-center-line_mean0.8659891122281899
deviation-center-line_min0.8659891122281899
deviation-heading_max7.706889663126838
deviation-heading_mean7.706889663126838
deviation-heading_median7.706889663126838
deviation-heading_min7.706889663126838
distance-from-start_max0.8626308120701125
distance-from-start_mean0.8626308120701125
distance-from-start_median0.8626308120701125
distance-from-start_min0.8626308120701125
driven_any_max7.161071358405415
driven_any_mean7.161071358405415
driven_any_median7.161071358405415
driven_any_min7.161071358405415
driven_lanedir_consec_max0.25774306587044116
driven_lanedir_consec_mean0.25774306587044116
driven_lanedir_consec_min0.25774306587044116
driven_lanedir_max0.2397300056472842
driven_lanedir_mean0.2397300056472842
driven_lanedir_median0.2397300056472842
driven_lanedir_min0.2397300056472842
in-drivable-lane_max18.900000000000233
in-drivable-lane_mean18.900000000000233
in-drivable-lane_min18.900000000000233
per-episodes
details{"udem-000-ego0": {"driven_any": 7.161071358405415, "survival_time": 28.850000000000275, "driven_lanedir": 0.2397300056472842, "in-drivable-lane": 18.900000000000233, "deviation-heading": 7.706889663126838, "distance-from-start": 0.8626308120701125, "deviation-center-line": 0.8659891122281899, "driven_lanedir_consec": 0.25774306587044116}}
simulation-passed1
survival_time_max28.850000000000275
survival_time_mean28.850000000000275
survival_time_min28.850000000000275
No reset possible
142081270Bea Baselines 🐤template-randomaido-LF-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:04:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2718401947993705
survival_time_median27.70000000000026
deviation-center-line_median0.7655517188189105
in-drivable-lane_median19.150000000000237


other stats
deviation-center-line_max0.7655517188189105
deviation-center-line_mean0.7655517188189105
deviation-center-line_min0.7655517188189105
deviation-heading_max5.708723015945327
deviation-heading_mean5.708723015945327
deviation-heading_median5.708723015945327
deviation-heading_min5.708723015945327
distance-from-start_max0.7960980578537302
distance-from-start_mean0.7960980578537302
distance-from-start_median0.7960980578537302
distance-from-start_min0.7960980578537302
driven_any_max6.635455547557208
driven_any_mean6.635455547557208
driven_any_median6.635455547557208
driven_any_min6.635455547557208
driven_lanedir_consec_max0.2718401947993705
driven_lanedir_consec_mean0.2718401947993705
driven_lanedir_consec_min0.2718401947993705
driven_lanedir_max0.25382904192484634
driven_lanedir_mean0.25382904192484634
driven_lanedir_median0.25382904192484634
driven_lanedir_min0.25382904192484634
in-drivable-lane_max19.150000000000237
in-drivable-lane_mean19.150000000000237
in-drivable-lane_min19.150000000000237
per-episodes
details{"autolab-000-ego0": {"driven_any": 6.635455547557208, "survival_time": 27.70000000000026, "driven_lanedir": 0.25382904192484634, "in-drivable-lane": 19.150000000000237, "deviation-heading": 5.708723015945327, "distance-from-start": 0.7960980578537302, "deviation-center-line": 0.7655517188189105, "driven_lanedir_consec": 0.2718401947993705}}
simulation-passed1
survival_time_max27.70000000000026
survival_time_mean27.70000000000026
survival_time_min27.70000000000026
No reset possible
142021271Bea Baselines 🐤template-randomaido-LFVI_multi-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:12:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median28.850000000000275
in-drivable-lane_median22.925000000000257
driven_lanedir_consec_median0.1842700338005553
deviation-center-line_median0.4627381849764669


other stats
deviation-center-line_max4.099655310425073
deviation-center-line_mean1.3331675709092048
deviation-center-line_min0.3075386032588124
deviation-heading_max14.96173668874226
deviation-heading_mean6.250128407006366
deviation-heading_median3.9170785755528663
deviation-heading_min2.204619788177472
distance-from-start_max0.8626308120701165
distance-from-start_mean0.6103488428669119
distance-from-start_median0.5879544645467749
distance-from-start_min0.4028556303039817
driven_any_max7.1610713584054295
driven_any_mean3.3142682447917635
driven_any_median2.835962585238713
driven_any_min0.4240764502841981
driven_lanedir_consec_max0.3901369682576328
driven_lanedir_consec_mean0.21562824323701707
driven_lanedir_consec_min0.10383593708932493
driven_lanedir_max0.3901369682576328
driven_lanedir_mean0.2054725659587014
driven_lanedir_median0.16943030307989526
driven_lanedir_min0.09289268941738228
in-drivable-lane_max24.45000000000027
in-drivable-lane_mean17.800000000000196
in-drivable-lane_min0.9
per-episodes
details{"udem-000-ego0": {"driven_any": 0.4240764502841981, "survival_time": 28.850000000000275, "driven_lanedir": 0.3901369682576328, "in-drivable-lane": 0.9, "deviation-heading": 14.96173668874226, "distance-from-start": 0.4028556303039817, "deviation-center-line": 4.099655310425073, "driven_lanedir_consec": 0.3901369682576328}, "udem-000-ego1": {"driven_any": 7.1610713584054295, "survival_time": 28.850000000000275, "driven_lanedir": 0.1969626852808437, "in-drivable-lane": 21.40000000000026, "deviation-heading": 4.716518246290203, "distance-from-start": 0.8626308120701165, "deviation-center-line": 0.5494202956548411, "driven_lanedir_consec": 0.21028967498696935}, "udem-000-ego2": {"driven_any": 2.4684338587868724, "survival_time": 28.850000000000275, "driven_lanedir": 0.1418979208789468, "in-drivable-lane": 24.45000000000027, "deviation-heading": 2.204619788177472, "distance-from-start": 0.5461575079396516, "deviation-center-line": 0.37605607429809274, "driven_lanedir_consec": 0.1582503926141412}, "udem-000-ego3": {"driven_any": 3.2034913116905535, "survival_time": 28.850000000000275, "driven_lanedir": 0.09289268941738228, "in-drivable-lane": 24.45000000000025, "deviation-heading": 3.1176389048155295, "distance-from-start": 0.6297514211538984, "deviation-center-line": 0.3075386032588124, "driven_lanedir_consec": 0.10383593708932493}}
simulation-passed1
survival_time_max28.850000000000275
survival_time_mean28.850000000000275
survival_time_min28.850000000000275
No reset possible
142001271Bea Baselines 🐤template-randomaido-LFVI_multi-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:01:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
141911275Bea Baselines 🐤template-randomlx22-objdetsimsuccessyesdavinci-stage-01-6.2.500:11:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median54.49999999999904
driven_lanedir_consec_median0.26709798212212443


other stats
deviation-center-line_max1.037569790997506
deviation-center-line_mean0.8435604085256779
deviation-center-line_median0.8435604085256779
deviation-center-line_min0.64955102605385
deviation-heading_max4.206744090268851
deviation-heading_mean4.053028283662815
deviation-heading_median4.053028283662815
deviation-heading_min3.899312477056781
distance-from-start_max1.4108418329398793
distance-from-start_mean1.2742348024332677
distance-from-start_median1.2742348024332677
distance-from-start_min1.1376277719266563
driven_any_max15.326310847370594
driven_any_mean13.855133975004188
driven_any_median13.855133975004188
driven_any_min12.38395710263778
driven_lanedir_consec_max0.46522399883077714
driven_lanedir_consec_mean0.26709798212212443
driven_lanedir_consec_min0.06897196541347173
driven_lanedir_max0.4443159195617077
driven_lanedir_mean0.24618990285305495
driven_lanedir_median0.24618990285305495
driven_lanedir_min0.04806388614440227
in-drivable-lane_max53.699999999998695
in-drivable-lane_mean46.67499999999907
in-drivable-lane_median46.67499999999907
in-drivable-lane_min39.64999999999946
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 15.326310847370594, "survival_time": 59.99999999999873, "driven_lanedir": 0.4443159195617077, "in-drivable-lane": 53.699999999998695, "deviation-heading": 3.899312477056781, "distance-from-start": 1.4108418329398793, "deviation-center-line": 0.64955102605385, "driven_lanedir_consec": 0.46522399883077714}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 12.38395710263778, "survival_time": 48.99999999999935, "driven_lanedir": 0.04806388614440227, "in-drivable-lane": 39.64999999999946, "deviation-heading": 4.206744090268851, "distance-from-start": 1.1376277719266563, "deviation-center-line": 1.037569790997506, "driven_lanedir_consec": 0.06897196541347173}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean54.49999999999904
survival_time_min48.99999999999935
No reset possible
141761122Bea Baselines 🐤template-randomaido-LFV_multi-sim-testingsim-0of4abortednodavinci-stage-01-6.2.500:16:18
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1302, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 749, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
141721123Bea Baselines 🐤template-randomaido-LFP-sim-testingsim-0of4successnodavinci-stage-01-6.2.500:02:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.94999999999998
in-drivable-lane_median5.549999999999983
driven_lanedir_consec_median0.020891462039611675
deviation-center-line_median0.16974575483481455


other stats
deviation-center-line_max0.16974575483481455
deviation-center-line_mean0.16974575483481455
deviation-center-line_min0.16974575483481455
deviation-heading_max1.6654350665682798
deviation-heading_mean1.6654350665682798
deviation-heading_median1.6654350665682798
deviation-heading_min1.6654350665682798
distance-from-start_max0.5351951936475464
distance-from-start_mean0.5351951936475464
distance-from-start_median0.5351951936475464
distance-from-start_min0.5351951936475464
driven_any_max1.5709859611218706
driven_any_mean1.5709859611218706
driven_any_median1.5709859611218706
driven_any_min1.5709859611218706
driven_lanedir_consec_max0.020891462039611675
driven_lanedir_consec_mean0.020891462039611675
driven_lanedir_consec_min0.020891462039611675
driven_lanedir_max0.020891462039611675
driven_lanedir_mean0.020891462039611675
driven_lanedir_median0.020891462039611675
driven_lanedir_min0.020891462039611675
in-drivable-lane_max5.549999999999983
in-drivable-lane_mean5.549999999999983
in-drivable-lane_min5.549999999999983
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.5709859611218706, "survival_time": 7.94999999999998, "driven_lanedir": 0.020891462039611675, "in-drivable-lane": 5.549999999999983, "deviation-heading": 1.6654350665682798, "distance-from-start": 0.5351951936475464, "deviation-center-line": 0.16974575483481455, "driven_lanedir_consec": 0.020891462039611675}}
simulation-passed1
survival_time_max7.94999999999998
survival_time_mean7.94999999999998
survival_time_min7.94999999999998
No reset possible
141621125Bea Baselines 🐤template-rosaido-LFV-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.9499999999999975
in-drivable-lane_median1.8999999999999972
driven_lanedir_consec_median0.13484936694016603
deviation-center-line_median0.060126561564959616


other stats
deviation-center-line_max0.060126561564959616
deviation-center-line_mean0.060126561564959616
deviation-center-line_min0.060126561564959616
deviation-heading_max0.7021852057989807
deviation-heading_mean0.7021852057989807
deviation-heading_median0.7021852057989807
deviation-heading_min0.7021852057989807
distance-from-start_max0.575265779392977
distance-from-start_mean0.575265779392977
distance-from-start_median0.575265779392977
distance-from-start_min0.575265779392977
driven_any_max0.5772691458609409
driven_any_mean0.5772691458609409
driven_any_median0.5772691458609409
driven_any_min0.5772691458609409
driven_lanedir_consec_max0.13484936694016603
driven_lanedir_consec_mean0.13484936694016603
driven_lanedir_consec_min0.13484936694016603
driven_lanedir_max0.13484936694016603
driven_lanedir_mean0.13484936694016603
driven_lanedir_median0.13484936694016603
driven_lanedir_min0.13484936694016603
in-drivable-lane_max1.8999999999999972
in-drivable-lane_mean1.8999999999999972
in-drivable-lane_min1.8999999999999972
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.5772691458609409, "survival_time": 2.9499999999999975, "driven_lanedir": 0.13484936694016603, "in-drivable-lane": 1.8999999999999972, "deviation-heading": 0.7021852057989807, "distance-from-start": 0.575265779392977, "deviation-center-line": 0.060126561564959616, "driven_lanedir_consec": 0.13484936694016603}}
simulation-passed1
survival_time_max2.9499999999999975
survival_time_mean2.9499999999999975
survival_time_min2.9499999999999975
No reset possible
141571127Bea Baselines 🐤template-rosaido-LFI-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:01:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.3
in-drivable-lane_median0.8999999999999992
driven_lanedir_consec_median0.2947272661967042
deviation-center-line_median0.10211059119339748


other stats
deviation-center-line_max0.10211059119339748
deviation-center-line_mean0.10211059119339748
deviation-center-line_min0.10211059119339748
deviation-heading_max0.6042194022421988
deviation-heading_mean0.6042194022421988
deviation-heading_median0.6042194022421988
deviation-heading_min0.6042194022421988
distance-from-start_max0.3897382728332853
distance-from-start_mean0.3897382728332853
distance-from-start_median0.3897382728332853
distance-from-start_min0.3897382728332853
driven_any_max0.3906498277751073
driven_any_mean0.3906498277751073
driven_any_median0.3906498277751073
driven_any_min0.3906498277751073
driven_lanedir_consec_max0.2947272661967042
driven_lanedir_consec_mean0.2947272661967042
driven_lanedir_consec_min0.2947272661967042
driven_lanedir_max0.2947272661967042
driven_lanedir_mean0.2947272661967042
driven_lanedir_median0.2947272661967042
driven_lanedir_min0.2947272661967042
in-drivable-lane_max0.8999999999999992
in-drivable-lane_mean0.8999999999999992
in-drivable-lane_min0.8999999999999992
per-episodes
details{"4way-000-ego0": {"driven_any": 0.3906498277751073, "survival_time": 2.3, "driven_lanedir": 0.2947272661967042, "in-drivable-lane": 0.8999999999999992, "deviation-heading": 0.6042194022421988, "distance-from-start": 0.3897382728332853, "deviation-center-line": 0.10211059119339748, "driven_lanedir_consec": 0.2947272661967042}}
simulation-passed1
survival_time_max2.3
survival_time_mean2.3
survival_time_min2.3
No reset possible
141541127Bea Baselines 🐤template-rosaido-LFI-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
141501128Bea Baselines 🐤template-rosaido-LFVI_multi-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
141461129Bea Baselines 🐤template-rosaido-LFV_multi-sim-validationsim-1of4successnodavinci-stage-01-6.2.500:03:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.149999999999983
in-drivable-lane_median5.599999999999982
driven_lanedir_consec_median0.3171829334661116
deviation-center-line_median0.1075481725310149


other stats
deviation-center-line_max0.13970617256688517
deviation-center-line_mean0.10969709766978296
deviation-center-line_min0.08398587305021685
deviation-heading_max0.623638950542771
deviation-heading_mean0.540010884244966
deviation-heading_median0.5495321067209555
deviation-heading_min0.437340372995182
distance-from-start_max1.640028940056469
distance-from-start_mean0.8510967257391827
distance-from-start_median0.7738673500406669
distance-from-start_min0.2166232628189281
driven_any_max1.783352124204132
driven_any_mean0.89339753152812
driven_any_median0.7863112600667455
driven_any_min0.21761548177485648
driven_lanedir_consec_max0.43605870438450345
driven_lanedir_consec_mean0.30864185730664356
driven_lanedir_consec_min0.16414285790984762
driven_lanedir_max0.43605870438450345
driven_lanedir_mean0.30864185730664356
driven_lanedir_median0.3171829334661116
driven_lanedir_min0.16414285790984762
in-drivable-lane_max6.149999999999983
in-drivable-lane_mean5.674999999999981
in-drivable-lane_min5.349999999999982
per-episodes
details{"loop-000-ego0": {"driven_any": 0.8355214643619843, "survival_time": 7.149999999999983, "driven_lanedir": 0.2530152663855385, "in-drivable-lane": 5.799999999999982, "deviation-heading": 0.623638950542771, "distance-from-start": 0.8180033244320561, "deviation-center-line": 0.08512809215758546, "driven_lanedir_consec": 0.2530152663855385}, "loop-000-ego1": {"driven_any": 0.21761548177485648, "survival_time": 7.149999999999983, "driven_lanedir": 0.16414285790984762, "in-drivable-lane": 6.149999999999983, "deviation-heading": 0.5078084918489658, "distance-from-start": 0.2166232628189281, "deviation-center-line": 0.08398587305021685, "driven_lanedir_consec": 0.16414285790984762}, "loop-000-ego2": {"driven_any": 1.783352124204132, "survival_time": 7.149999999999983, "driven_lanedir": 0.3813506005466847, "in-drivable-lane": 5.399999999999982, "deviation-heading": 0.5912557215929453, "distance-from-start": 1.640028940056469, "deviation-center-line": 0.12996825290444433, "driven_lanedir_consec": 0.3813506005466847}, "loop-000-ego3": {"driven_any": 0.7371010557715068, "survival_time": 7.149999999999983, "driven_lanedir": 0.43605870438450345, "in-drivable-lane": 5.349999999999982, "deviation-heading": 0.437340372995182, "distance-from-start": 0.7297313756492776, "deviation-center-line": 0.13970617256688517, "driven_lanedir_consec": 0.43605870438450345}}
simulation-passed1
survival_time_max7.149999999999983
survival_time_mean7.149999999999983
survival_time_min7.149999999999983
No reset possible
141331142Bea Baselines 🐤template-rosaido-LFV-sim-testingsim-1of4successnodavinci-stage-01-6.2.500:02:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.849999999999991
in-drivable-lane_median4.049999999999991
driven_lanedir_consec_median0.11890818808584223
deviation-center-line_median0.05120915196473799


other stats
deviation-center-line_max0.05120915196473799
deviation-center-line_mean0.05120915196473799
deviation-center-line_min0.05120915196473799
deviation-heading_max0.5861679395412895
deviation-heading_mean0.5861679395412895
deviation-heading_median0.5861679395412895
deviation-heading_min0.5861679395412895
distance-from-start_max1.1022312583819605
distance-from-start_mean1.1022312583819605
distance-from-start_median1.1022312583819605
distance-from-start_min1.1022312583819605
driven_any_max1.2063202009991223
driven_any_mean1.2063202009991223
driven_any_median1.2063202009991223
driven_any_min1.2063202009991223
driven_lanedir_consec_max0.11890818808584223
driven_lanedir_consec_mean0.11890818808584223
driven_lanedir_consec_min0.11890818808584223
driven_lanedir_max0.11890818808584223
driven_lanedir_mean0.11890818808584223
driven_lanedir_median0.11890818808584223
driven_lanedir_min0.11890818808584223
in-drivable-lane_max4.049999999999991
in-drivable-lane_mean4.049999999999991
in-drivable-lane_min4.049999999999991
per-episodes
details{"loop-000-ego0": {"driven_any": 1.2063202009991223, "survival_time": 4.849999999999991, "driven_lanedir": 0.11890818808584223, "in-drivable-lane": 4.049999999999991, "deviation-heading": 0.5861679395412895, "distance-from-start": 1.1022312583819605, "deviation-center-line": 0.05120915196473799, "driven_lanedir_consec": 0.11890818808584223}}
simulation-passed1
survival_time_max4.849999999999991
survival_time_mean4.849999999999991
survival_time_min4.849999999999991
No reset possible
141291143Bea Baselines 🐤template-rosaido-LFVI-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
141261145Bea Baselines 🐤template-rosaido-LF-sim-testingsim-1of4successnodavinci-stage-01-6.2.500:01:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.19997332661671183
survival_time_median10.700000000000015
deviation-center-line_median0.12164050440902172
in-drivable-lane_median9.10000000000002


other stats
deviation-center-line_max0.12164050440902172
deviation-center-line_mean0.12164050440902172
deviation-center-line_min0.12164050440902172
deviation-heading_max1.5501085146744502
deviation-heading_mean1.5501085146744502
deviation-heading_median1.5501085146744502
deviation-heading_min1.5501085146744502
distance-from-start_max2.71021611054515
distance-from-start_mean2.71021611054515
distance-from-start_median2.71021611054515
distance-from-start_min2.71021611054515
driven_any_max2.7483728613325225
driven_any_mean2.7483728613325225
driven_any_median2.7483728613325225
driven_any_min2.7483728613325225
driven_lanedir_consec_max0.19997332661671183
driven_lanedir_consec_mean0.19997332661671183
driven_lanedir_consec_min0.19997332661671183
driven_lanedir_max0.19997332661671183
driven_lanedir_mean0.19997332661671183
driven_lanedir_median0.19997332661671183
driven_lanedir_min0.19997332661671183
in-drivable-lane_max9.10000000000002
in-drivable-lane_mean9.10000000000002
in-drivable-lane_min9.10000000000002
per-episodes
details{"loop-000-ego0": {"driven_any": 2.7483728613325225, "survival_time": 10.700000000000015, "driven_lanedir": 0.19997332661671183, "in-drivable-lane": 9.10000000000002, "deviation-heading": 1.5501085146744502, "distance-from-start": 2.71021611054515, "deviation-center-line": 0.12164050440902172, "driven_lanedir_consec": 0.19997332661671183}}
simulation-passed1
survival_time_max10.700000000000015
survival_time_mean10.700000000000015
survival_time_min10.700000000000015
No reset possible
141171146Bea Baselines 🐤template-rosaido-LFVI_multi-sim-testingsim-0of4successnodavinci-stage-01-6.2.500:02:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.6499999999999915
in-drivable-lane_median2.849999999999992
driven_lanedir_consec_median0.3956146220957095
deviation-center-line_median0.13249550612826053


other stats
deviation-center-line_max0.2660017369182625
deviation-center-line_mean0.15053769557684152
deviation-center-line_min0.07115803313258254
deviation-heading_max1.3090270242773252
deviation-heading_mean0.8634773320984637
deviation-heading_median0.90844116594482
deviation-heading_min0.32799997222688965
distance-from-start_max1.0690032483357703
distance-from-start_mean0.5926387553460274
distance-from-start_median0.5380803569984943
distance-from-start_min0.22539105905135057
driven_any_max1.0955379842500357
driven_any_mean0.6275873074353256
driven_any_median0.5944611687139992
driven_any_min0.2258889080632683
driven_lanedir_consec_max0.6346194821887337
driven_lanedir_consec_mean0.3840178427591166
driven_lanedir_consec_min0.1102226446563137
driven_lanedir_max0.6346194821887337
driven_lanedir_mean0.3840178427591166
driven_lanedir_median0.3956146220957095
driven_lanedir_min0.1102226446563137
in-drivable-lane_max3.849999999999992
in-drivable-lane_mean2.8499999999999925
in-drivable-lane_min1.849999999999994
per-episodes
details{"udem-000-ego0": {"driven_any": 0.8177477904617765, "survival_time": 4.6499999999999915, "driven_lanedir": 0.6346194821887337, "in-drivable-lane": 1.949999999999993, "deviation-heading": 1.3090270242773252, "distance-from-start": 0.7062620768494794, "deviation-center-line": 0.2660017369182625, "driven_lanedir_consec": 0.6346194821887337}, "udem-000-ego1": {"driven_any": 0.3711745469662221, "survival_time": 4.6499999999999915, "driven_lanedir": 0.1948451906560136, "in-drivable-lane": 3.749999999999991, "deviation-heading": 0.32799997222688965, "distance-from-start": 0.3698986371475093, "deviation-center-line": 0.08935318752555747, "driven_lanedir_consec": 0.1948451906560136}, "udem-000-ego2": {"driven_any": 1.0955379842500357, "survival_time": 4.6499999999999915, "driven_lanedir": 0.5963840535354055, "in-drivable-lane": 1.849999999999994, "deviation-heading": 1.285116539682713, "distance-from-start": 1.0690032483357703, "deviation-center-line": 0.17563782473096357, "driven_lanedir_consec": 0.5963840535354055}, "udem-000-ego3": {"driven_any": 0.2258889080632683, "survival_time": 4.6499999999999915, "driven_lanedir": 0.1102226446563137, "in-drivable-lane": 3.849999999999992, "deviation-heading": 0.5317657922069269, "distance-from-start": 0.22539105905135057, "deviation-center-line": 0.07115803313258254, "driven_lanedir_consec": 0.1102226446563137}}
simulation-passed1
survival_time_max4.6499999999999915
survival_time_mean4.6499999999999915
survival_time_min4.6499999999999915
No reset possible
141121147Bea Baselines 🐤template-rosaido-LFV_multi-sim-testingsim-0of4successnodavinci-stage-01-6.2.500:02:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.7999999999999945
in-drivable-lane_median2.7999999999999945
driven_lanedir_consec_median0.15877826339452872
deviation-center-line_median0.09161725141278192


other stats
deviation-center-line_max0.11811133298568131
deviation-center-line_mean0.08742467212634827
deviation-center-line_min0.04835285269414791
deviation-heading_max0.6387680430057958
deviation-heading_mean0.4928774717182732
deviation-heading_median0.4708180339892936
deviation-heading_min0.3911057758887098
distance-from-start_max0.7182926242613349
distance-from-start_mean0.5876273760728167
distance-from-start_median0.5679237995007114
distance-from-start_min0.496369281028509
driven_any_max0.7380004758307639
driven_any_mean0.5938141772414013
driven_any_median0.5694591380978674
driven_any_min0.49833795693910665
driven_lanedir_consec_max0.40495315977465385
driven_lanedir_consec_mean0.20758007755019617
driven_lanedir_consec_min0.10781062363707328
driven_lanedir_max0.40495315977465385
driven_lanedir_mean0.20758007755019617
driven_lanedir_median0.15877826339452872
driven_lanedir_min0.10781062363707328
in-drivable-lane_max2.9499999999999944
in-drivable-lane_mean2.649999999999994
in-drivable-lane_min2.0499999999999936
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.5195122003628624, "survival_time": 3.7999999999999945, "driven_lanedir": 0.10781062363707328, "in-drivable-lane": 2.9499999999999944, "deviation-heading": 0.6387680430057958, "distance-from-start": 0.5181299559694641, "deviation-center-line": 0.04835285269414791, "driven_lanedir_consec": 0.10781062363707328}, "autolab-000-ego1": {"driven_any": 0.7380004758307639, "survival_time": 3.7999999999999945, "driven_lanedir": 0.17701630157960802, "in-drivable-lane": 2.649999999999994, "deviation-heading": 0.4532782384905209, "distance-from-start": 0.7182926242613349, "deviation-center-line": 0.11811133298568131, "driven_lanedir_consec": 0.17701630157960802}, "autolab-000-ego2": {"driven_any": 0.49833795693910665, "survival_time": 3.7999999999999945, "driven_lanedir": 0.40495315977465385, "in-drivable-lane": 2.0499999999999936, "deviation-heading": 0.3911057758887098, "distance-from-start": 0.496369281028509, "deviation-center-line": 0.10601590933218465, "driven_lanedir_consec": 0.40495315977465385}, "autolab-000-ego3": {"driven_any": 0.6194060758328724, "survival_time": 3.7999999999999945, "driven_lanedir": 0.14054022520944942, "in-drivable-lane": 2.9499999999999944, "deviation-heading": 0.4883578294880662, "distance-from-start": 0.6177176430319588, "deviation-center-line": 0.07721859349337921, "driven_lanedir_consec": 0.14054022520944942}}
simulation-passed1
survival_time_max3.7999999999999945
survival_time_mean3.7999999999999945
survival_time_min3.7999999999999945
No reset possible
141031150Bea Baselines 🐤template-tensorflowaido-LFVI-sim-validationsim-0of4failednodavinci-stage-01-6.2.500:01:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140961150Bea Baselines 🐤template-tensorflowaido-LFVI-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
140911153Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
140861153Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
140821155Bea Baselines 🐤template-tensorflowaido-LFP-sim-validationsim-2of4failednodavinci-stage-01-6.2.500:00:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140731163Bea Baselines 🐤template-tensorflowaido-hello-sim-validationsanity-checkfailednodavinci-stage-01-6.2.500:00:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140671167Bea Baselines 🐤template-tensorflowaido-LFV-sim-testingsim-3of4failednodavinci-stage-01-6.2.500:01:32
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140631169Bea Baselines 🐤template-tensorflowaido-LFI-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
140581170Bea Baselines 🐤template-tensorflowaido-LF-sim-testingsim-3of4failednodavinci-stage-01-6.2.500:01:00
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140531171Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-testingsim-0of4failednodavinci-stage-01-6.2.500:01:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140481172Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-testingsim-3of4failednodavinci-stage-01-6.2.500:01:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140441173Bea Baselines 🐤template-tensorflowaido-LFP-sim-testingsim-3of4failednodavinci-stage-01-6.2.500:00:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140311182Bea Baselines 🐤baseline-duckietown-mllx22-state-estimationsimsuccessyesdavinci-stage-01-6.2.500:16:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.928727284828145
survival_time_median59.99999999999873
deviation-center-line_median4.2702308709377075
in-drivable-lane_median6.499999999999906


other stats
deviation-center-line_max4.630398201077483
deviation-center-line_mean3.501452624987642
deviation-center-line_min1.6037288029477348
deviation-heading_max11.057112379321852
deviation-heading_mean7.935392041695846
deviation-heading_median6.5985757564564205
deviation-heading_min6.150487989309267
distance-from-start_max3.1902594983324555
distance-from-start_mean2.8290803370244184
distance-from-start_median2.968767351624464
distance-from-start_min2.328214161116335
driven_any_max7.921224592738967
driven_any_mean7.916679660868543
driven_any_median7.921129962231004
driven_any_min7.90768442763566
driven_lanedir_consec_max7.270565595430461
driven_lanedir_consec_mean5.54872184429608
driven_lanedir_consec_min2.446872652629633
driven_lanedir_max7.270565595430461
driven_lanedir_mean5.679060659117483
driven_lanedir_median6.928727284828145
driven_lanedir_min2.837889097093843
in-drivable-lane_max36.599999999999696
in-drivable-lane_mean15.266666666666548
in-drivable-lane_min2.7000000000000384
per-episodes
details{"LF-zig-zag-000-ego0": {"driven_any": 7.90768442763566, "survival_time": 59.99999999999873, "driven_lanedir": 2.837889097093843, "in-drivable-lane": 36.599999999999696, "deviation-heading": 6.150487989309267, "distance-from-start": 2.328214161116335, "deviation-center-line": 1.6037288029477348, "driven_lanedir_consec": 2.446872652629633}, "LF-zig-zag-001-ego0": {"driven_any": 7.921129962231004, "survival_time": 59.99999999999873, "driven_lanedir": 7.270565595430461, "in-drivable-lane": 2.7000000000000384, "deviation-heading": 11.057112379321852, "distance-from-start": 2.968767351624464, "deviation-center-line": 4.630398201077483, "driven_lanedir_consec": 7.270565595430461}, "LF-zig-zag-002-ego0": {"driven_any": 7.921224592738967, "survival_time": 59.99999999999873, "driven_lanedir": 6.928727284828145, "in-drivable-lane": 6.499999999999906, "deviation-heading": 6.5985757564564205, "distance-from-start": 3.1902594983324555, "deviation-center-line": 4.2702308709377075, "driven_lanedir_consec": 6.928727284828145}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
140281185Bea Baselines 🐤baseline-duckietownlx22-visservoingsimsuccessyesdavinci-stage-01-6.2.500:07:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median0.0
deviation-center-line_median0.8923084795475021
driven_lanedir_consec_median2.5749206500336182e-05
survival_time_median59.99999999999873


other stats
deviation-center-line_max0.8923090875148936
deviation-center-line_mean0.8923084795475021
deviation-center-line_min0.8923078715801107
deviation-heading_max1.4695762799782753e-14
deviation-heading_mean7.347881399891377e-15
deviation-heading_median7.347881399891377e-15
deviation-heading_min0.0
distance-from-start_max0.0
distance-from-start_mean0.0
distance-from-start_median0.0
distance-from-start_min0.0
driven_any_max0.0
driven_any_mean0.0
driven_any_median0.0
driven_any_min0.0
driven_lanedir_consec_max2.5749206500336182e-05
driven_lanedir_consec_mean2.5749206500336182e-05
driven_lanedir_consec_min2.5749206500336182e-05
driven_lanedir_max2.5749206500336182e-05
driven_lanedir_mean2.5749206500336182e-05
driven_lanedir_median2.5749206500336182e-05
driven_lanedir_min2.5749206500336182e-05
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 2.5749206500336182e-05, "in-drivable-lane": 0.0, "deviation-heading": 1.4695762799782753e-14, "distance-from-start": 0.0, "deviation-center-line": 0.8923090875148936, "driven_lanedir_consec": 2.5749206500336182e-05}, "LF-small-loop-001-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 2.5749206500336182e-05, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "distance-from-start": 0.0, "deviation-center-line": 0.8923078715801107, "driven_lanedir_consec": 2.5749206500336182e-05}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
140211192Bea Baselines 🐤template-pytorchlx22-objdetsimsuccessyesdavinci-stage-01-6.2.500:12:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
driven_lanedir_consec_median1.2918256014635685


other stats
deviation-center-line_max1.728292803409909
deviation-center-line_mean1.3348209387740728
deviation-center-line_median1.3348209387740728
deviation-center-line_min0.9413490741382368
deviation-heading_max18.443721517134716
deviation-heading_mean11.869656240548425
deviation-heading_median11.869656240548425
deviation-heading_min5.295590963962135
distance-from-start_max0.3964306238031792
distance-from-start_mean0.3716325239194435
distance-from-start_median0.3716325239194435
distance-from-start_min0.34683442403570786
driven_any_max7.392132138936747
driven_any_mean6.996052076169697
driven_any_median6.996052076169697
driven_any_min6.599972013402648
driven_lanedir_consec_max1.975784094923452
driven_lanedir_consec_mean1.2918256014635685
driven_lanedir_consec_min0.607867108003685
driven_lanedir_max1.975784094923452
driven_lanedir_mean1.2918256014635685
driven_lanedir_median1.2918256014635685
driven_lanedir_min0.607867108003685
in-drivable-lane_max51.99999999999868
in-drivable-lane_mean43.19999999999903
in-drivable-lane_median43.19999999999903
in-drivable-lane_min34.39999999999938
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 6.599972013402648, "survival_time": 59.99999999999873, "driven_lanedir": 0.607867108003685, "in-drivable-lane": 51.99999999999868, "deviation-heading": 5.295590963962135, "distance-from-start": 0.3964306238031792, "deviation-center-line": 0.9413490741382368, "driven_lanedir_consec": 0.607867108003685}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 7.392132138936747, "survival_time": 59.99999999999873, "driven_lanedir": 1.975784094923452, "in-drivable-lane": 34.39999999999938, "deviation-heading": 18.443721517134716, "distance-from-start": 0.34683442403570786, "deviation-center-line": 1.728292803409909, "driven_lanedir_consec": 1.975784094923452}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
140161200Bea Baselines 🐤template-roslx22-objdetsimsuccessyesdavinci-stage-01-6.2.500:05:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median20.57500000000016
driven_lanedir_consec_median1.0794023109392037


other stats
deviation-center-line_max0.36364432589699175
deviation-center-line_mean0.28025615514100044
deviation-center-line_median0.28025615514100044
deviation-center-line_min0.1968679843850091
deviation-heading_max1.2080651379308225
deviation-heading_mean1.1749087648555638
deviation-heading_median1.1749087648555638
deviation-heading_min1.1417523917803052
distance-from-start_max7.272165624941885
distance-from-start_mean5.531395391851578
distance-from-start_median5.531395391851578
distance-from-start_min3.7906251587612703
driven_any_max7.738421196161134
driven_any_mean5.8520988438692445
driven_any_median5.8520988438692445
driven_any_min3.9657764915773552
driven_lanedir_consec_max1.400269672930457
driven_lanedir_consec_mean1.0794023109392037
driven_lanedir_consec_min0.7585349489479505
driven_lanedir_max1.400269672930457
driven_lanedir_mean1.0794023109392037
driven_lanedir_median1.0794023109392037
driven_lanedir_min0.7585349489479505
in-drivable-lane_max21.7000000000002
in-drivable-lane_mean16.42500000000014
in-drivable-lane_median16.42500000000014
in-drivable-lane_min11.150000000000071
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 3.9657764915773552, "survival_time": 14.45000000000007, "driven_lanedir": 0.7585349489479505, "in-drivable-lane": 11.150000000000071, "deviation-heading": 1.2080651379308225, "distance-from-start": 3.7906251587612703, "deviation-center-line": 0.1968679843850091, "driven_lanedir_consec": 0.7585349489479505}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 7.738421196161134, "survival_time": 26.700000000000244, "driven_lanedir": 1.400269672930457, "in-drivable-lane": 21.7000000000002, "deviation-heading": 1.1417523917803052, "distance-from-start": 7.272165624941885, "deviation-center-line": 0.36364432589699175, "driven_lanedir_consec": 1.400269672930457}}
simulation-passed1
survival_time_max26.700000000000244
survival_time_mean20.57500000000016
survival_time_min14.45000000000007
No reset possible
139991200Bea Baselines 🐤template-roslx22-objdetsimtimeoutyesdavinci-stage-01-6.2.50----No reset possible
13977785Andrea Danieletemplate-rosaido-LF-sim-validationsim-2of4host-errornodavinci-stage-01-6.2.501:06:12
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 60, in check_docker_environment
    client = docker.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1107, in run_single
    cr = run_one(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1197, in run_one
    client = check_docker_environment()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 69, in check_docker_environment
    raise InvalidEnvironment(msg)
duckietown_challenges.exceptions.InvalidEnvironment: I cannot communicate with Docker:
Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Make sure the docker service is running.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13966715Bea Baselines 🐤template-randomaido-LF-sim-testingsim-3of4host-errornodavinci-stage-01-6.2.501:10:28
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 60, in check_docker_environment
    client = docker.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1107, in run_single
    cr = run_one(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1197, in run_one
    client = check_docker_environment()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 69, in check_docker_environment
    raise InvalidEnvironment(msg)
duckietown_challenges.exceptions.InvalidEnvironment: I cannot communicate with Docker:
Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Make sure the docker service is running.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13965785Andrea Danieletemplate-rosaido-LF-sim-validationsim-0of4host-errornodavinci-stage-01-6.2.500:01:21
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1097, in run_single
    client = DockerClient.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13964789Andrea Danieletemplate-pytorchaido-LF-sim-validationsim-2of4host-errornodavinci-stage-01-6.2.500:01:05
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1097, in run_single
    client = DockerClient.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13956789Andrea Danieletemplate-pytorchaido-LF-sim-validationsim-0of4host-errornodavinci-stage-01-6.2.501:08:43
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 60, in check_docker_environment
    client = docker.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1107, in run_single
    cr = run_one(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1197, in run_one
    client = check_docker_environment()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 69, in check_docker_environment
    raise InvalidEnvironment(msg)
duckietown_challenges.exceptions.InvalidEnvironment: I cannot communicate with Docker:
Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Make sure the docker service is running.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13952698Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-2of4host-errornodavinci-stage-01-6.2.502:26:44
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 60, in check_docker_environment
    client = docker.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1118, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 125, in write_logs
    client = check_docker_environment()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 69, in check_docker_environment
    raise InvalidEnvironment(msg)
duckietown_challenges.exceptions.InvalidEnvironment: I cannot communicate with Docker:
Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Make sure the docker service is running.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13948699Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-3of4host-errornodavinci-stage-01-6.2.500:01:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1097, in run_single
    client = DockerClient.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13943698Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-3of4host-errornodavinci-stage-01-6.2.500:01:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1097, in run_single
    client = DockerClient.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13940699Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-1of4host-errornodavinci-stage-01-6.2.500:01:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1097, in run_single
    client = DockerClient.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13936700Bea Baselines 🐤minimal-agentaido-LFI-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13931701Bea Baselines 🐤minimal-agentaido-LF-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:02:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.30902388815479953
survival_time_median13.80000000000006
deviation-center-line_median0.26861568883973136
in-drivable-lane_median10.700000000000069


other stats
deviation-center-line_max0.26861568883973136
deviation-center-line_mean0.26861568883973136
deviation-center-line_min0.26861568883973136
deviation-heading_max2.499533756017491
deviation-heading_mean2.499533756017491
deviation-heading_median2.499533756017491
deviation-heading_min2.499533756017491
distance-from-start_max2.107081087129661
distance-from-start_mean2.107081087129661
distance-from-start_median2.107081087129661
distance-from-start_min2.107081087129661
driven_any_max2.107326449228953
driven_any_mean2.107326449228953
driven_any_median2.107326449228953
driven_any_min2.107326449228953
driven_lanedir_consec_max0.30902388815479953
driven_lanedir_consec_mean0.30902388815479953
driven_lanedir_consec_min0.30902388815479953
driven_lanedir_max0.30902388815479953
driven_lanedir_mean0.30902388815479953
driven_lanedir_median0.30902388815479953
driven_lanedir_min0.30902388815479953
in-drivable-lane_max10.700000000000069
in-drivable-lane_mean10.700000000000069
in-drivable-lane_min10.700000000000069
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.107326449228953, "survival_time": 13.80000000000006, "driven_lanedir": 0.30902388815479953, "in-drivable-lane": 10.700000000000069, "deviation-heading": 2.499533756017491, "distance-from-start": 2.107081087129661, "deviation-center-line": 0.26861568883973136, "driven_lanedir_consec": 0.30902388815479953}}
simulation-passed1
survival_time_max13.80000000000006
survival_time_mean13.80000000000006
survival_time_min13.80000000000006
No reset possible
13924397Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-testingsim-0of4successnodavinci-stage-01-6.2.500:07:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-2.75579969228059
survival_time_median59.99999999999873
deviation-center-line_median2.7288147290244114
in-drivable-lane_median21.249999999999417


other stats
deviation-center-line_max2.7288147290244114
deviation-center-line_mean2.7288147290244114
deviation-center-line_min2.7288147290244114
deviation-heading_max30.0763337008297
deviation-heading_mean30.0763337008297
deviation-heading_median30.0763337008297
deviation-heading_min30.0763337008297
distance-from-start_max0.15379164804261278
distance-from-start_mean0.15379164804261278
distance-from-start_median0.15379164804261278
distance-from-start_min0.15379164804261278
driven_any_max10.522347071491764
driven_any_mean10.522347071491764
driven_any_median10.522347071491764
driven_any_min10.522347071491764
driven_lanedir_consec_max-2.75579969228059
driven_lanedir_consec_mean-2.75579969228059
driven_lanedir_consec_min-2.75579969228059
driven_lanedir_max-2.75579969228059
driven_lanedir_mean-2.75579969228059
driven_lanedir_median-2.75579969228059
driven_lanedir_min-2.75579969228059
in-drivable-lane_max21.249999999999417
in-drivable-lane_mean21.249999999999417
in-drivable-lane_min21.249999999999417
per-episodes
details{"autolab-000-ego0": {"driven_any": 10.522347071491764, "survival_time": 59.99999999999873, "driven_lanedir": -2.75579969228059, "in-drivable-lane": 21.249999999999417, "deviation-heading": 30.0763337008297, "distance-from-start": 0.15379164804261278, "deviation-center-line": 2.7288147290244114, "driven_lanedir_consec": -2.75579969228059}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
13920526Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-testingsim-1of4failednodavinci-stage-01-6.2.500:00:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13916672Bea Baselines 🐤template-tensorflowaido-LF-sim-testingsim-2of4failednodavinci-stage-01-6.2.500:00:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13913672Bea Baselines 🐤template-tensorflowaido-LF-sim-testingsim-1of4failednodavinci-stage-01-6.2.500:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13911715Bea Baselines 🐤template-randomaido-LF-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:02:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.15869649764514326
survival_time_median15.900000000000093
deviation-center-line_median0.4544941711289141
in-drivable-lane_median11.05000000000006


other stats
deviation-center-line_max0.4544941711289141
deviation-center-line_mean0.4544941711289141
deviation-center-line_min0.4544941711289141
deviation-heading_max3.664036561158003
deviation-heading_mean3.664036561158003
deviation-heading_median3.664036561158003
deviation-heading_min3.664036561158003
distance-from-start_max0.6653201232297334
distance-from-start_mean0.6653201232297334
distance-from-start_median0.6653201232297334
distance-from-start_min0.6653201232297334
driven_any_max3.642720741594881
driven_any_mean3.642720741594881
driven_any_median3.642720741594881
driven_any_min3.642720741594881
driven_lanedir_consec_max0.15869649764514326
driven_lanedir_consec_mean0.15869649764514326
driven_lanedir_consec_min0.15869649764514326
driven_lanedir_max0.1620428397437772
driven_lanedir_mean0.1620428397437772
driven_lanedir_median0.1620428397437772
driven_lanedir_min0.1620428397437772
in-drivable-lane_max11.05000000000006
in-drivable-lane_mean11.05000000000006
in-drivable-lane_min11.05000000000006
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.642720741594881, "survival_time": 15.900000000000093, "driven_lanedir": 0.1620428397437772, "in-drivable-lane": 11.05000000000006, "deviation-heading": 3.664036561158003, "distance-from-start": 0.6653201232297334, "deviation-center-line": 0.4544941711289141, "driven_lanedir_consec": 0.15869649764514326}}
simulation-passed1
survival_time_max15.900000000000093
survival_time_mean15.900000000000093
survival_time_min15.900000000000093
No reset possible
13897789Andrea Danieletemplate-pytorchaido-LF-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:09:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4703087023978962
survival_time_median59.99999999999873
deviation-center-line_median2.2504869216100096
in-drivable-lane_median37.34999999999904


other stats
deviation-center-line_max2.2504869216100096
deviation-center-line_mean2.2504869216100096
deviation-center-line_min2.2504869216100096
deviation-heading_max15.747097951460148
deviation-heading_mean15.747097951460148
deviation-heading_median15.747097951460148
deviation-heading_min15.747097951460148
distance-from-start_max0.6545638223701382
distance-from-start_mean0.6545638223701382
distance-from-start_median0.6545638223701382
distance-from-start_min0.6545638223701382
driven_any_max6.2696149465331645
driven_any_mean6.2696149465331645
driven_any_median6.2696149465331645
driven_any_min6.2696149465331645
driven_lanedir_consec_max1.4703087023978962
driven_lanedir_consec_mean1.4703087023978962
driven_lanedir_consec_min1.4703087023978962
driven_lanedir_max1.4703087023978962
driven_lanedir_mean1.4703087023978962
driven_lanedir_median1.4703087023978962
driven_lanedir_min1.4703087023978962
in-drivable-lane_max37.34999999999904
in-drivable-lane_mean37.34999999999904
in-drivable-lane_min37.34999999999904
per-episodes
details{"zigzag-000-ego0": {"driven_any": 6.2696149465331645, "survival_time": 59.99999999999873, "driven_lanedir": 1.4703087023978962, "in-drivable-lane": 37.34999999999904, "deviation-heading": 15.747097951460148, "distance-from-start": 0.6545638223701382, "deviation-center-line": 2.2504869216100096, "driven_lanedir_consec": 1.4703087023978962}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
13894309Andrea Censiminimal-agentaido-LFV-sim-validationsim-3of4errornodavinci-stage-01-6.2.500:01:53
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13889310Andrea Censiminimal-agentaido-LFV-sim-validationsim-3of4errornodavinci-stage-01-6.2.500:01:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13885312Liam Paulltemplate-rosaido-LF-sim-validationsim-3of4errornodavinci-stage-01-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13878341Liam Paulltemplate-rosaido-LF-sim-validationsim-1of4failednodavinci-stage-01-6.2.500:02:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 243, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13873356Liam Paulltemplate-rosaido-LF-sim-validationsim-2of4errornodavinci-stage-01-6.2.500:01:07
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13867385Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-validationsim-3of4errornodavinci-stage-01-6.2.500:01:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13861387Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-validationsim-2of4errornodavinci-stage-01-6.2.500:01:44
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13856389Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-validationsim-1of4host-errornodavinci-stage-01-6.2.500:01:56
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13852389Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-validationsim-0of4host-errornodavinci-stage-01-6.2.500:01:33
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13846391Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13841392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-1of4errornodavinci-stage-01-6.2.500:01:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13834393Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-testingsim-0of4errornodavinci-stage-01-6.2.500:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13831394Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-testingsim-0of4errornodavinci-stage-01-6.2.500:01:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13826395Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-testingsim-1of4errornodavinci-stage-01-6.2.500:01:40
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13820396Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13815514Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-validationsim-2of4failednodavinci-stage-01-6.2.500:01:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13810515Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-validationsim-3of4failednodavinci-stage-01-6.2.500:00:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13805516Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-validationsim-3of4failednodavinci-stage-01-6.2.500:01:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13800517Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13797519Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-validationsim-2of4failednodavinci-stage-01-6.2.500:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13789520Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13784521Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-testingsim-2of4failednodavinci-stage-01-6.2.500:01:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13782522Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-testingsim-1of4failednodavinci-stage-01-6.2.500:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13776523Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-testingsim-0of4failednodavinci-stage-01-6.2.500:01:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13771525Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-testingsim-0of4failednodavinci-stage-01-6.2.500:01:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13767527Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-testingsim-0of4failednodavinci-stage-01-6.2.500:01:16
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13759528Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-validationsim-0of4errornodavinci-stage-01-6.2.500:01:17
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13754530Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-validationsim-1of4errornodavinci-stage-01-6.2.500:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13749531Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-validationsim-0of4errornodavinci-stage-01-6.2.500:01:35
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13744532Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-validationsim-1of4errornodavinci-stage-01-6.2.500:01:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13739533Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-validationsim-1of4errornodavinci-stage-01-6.2.500:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13735535Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-testingsim-0of4errornodavinci-stage-01-6.2.500:01:17
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13731536Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-testingsim-2of4errornodavinci-stage-01-6.2.500:00:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13724537Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-testingsim-2of4errornodavinci-stage-01-6.2.500:01:36
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13720539Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-testingsim-1of4errornodavinci-stage-01-6.2.500:01:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13714541Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-testingsim-0of4errornodavinci-stage-01-6.2.500:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13709542Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-testingsim-0of4errornodavinci-stage-01-6.2.500:01:13
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13704595Liam Paullbaseline-duckietownaido-LF-sim-validationsim-3of4failednodavinci-stage-01-6.2.500:00:54
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13699600Liam Paulltemplate-tensorflowaido-LF-sim-validationsim-0of4failednodavinci-stage-01-6.2.500:00:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13694603Bea Baselines 🐤template-rosaido-LFV_multi-sim-validationsim-0of4errornodavinci-stage-01-6.2.500:01:18
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13692604Bea Baselines 🐤template-rosaido-LFP-sim-validationsim-1of4errornodavinci-stage-01-6.2.500:01:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13687605Bea Baselines 🐤template-rosaido-LFV-sim-validationsim-3of4errornodavinci-stage-01-6.2.500:01:31
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13682607Bea Baselines 🐤template-rosaido-LFI-sim-validationsim-1of4errornodavinci-stage-01-6.2.500:01:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13677609Bea Baselines 🐤template-rosaido-LFVI_multi-sim-validationsim-0of4errornodavinci-stage-01-6.2.500:01:19
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13672610Bea Baselines 🐤template-rosaido-LFV_multi-sim-testingsim-0of4errornodavinci-stage-01-6.2.500:01:20
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13667611Bea Baselines 🐤template-rosaido-LFP-sim-testingsim-0of4errornodavinci-stage-01-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13663612Bea Baselines 🐤template-rosaido-LFV-sim-testingsim-3of4errornodavinci-stage-01-6.2.500:01:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13657613Bea Baselines 🐤template-rosaido-LFVI-sim-testingsim-0of4errornodavinci-stage-01-6.2.500:01:38
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13654615Bea Baselines 🐤template-rosaido-LF-sim-testingsim-1of4errornodavinci-stage-01-6.2.500:00:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13648616Bea Baselines 🐤template-rosaido-LFVI_multi-sim-testingsim-0of4errornodavinci-stage-01-6.2.500:01:15
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13643618Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-validationsim-2of4errornodavinci-stage-01-6.2.500:01:32
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13638619Bea Baselines 🐤baseline-duckietownaido-LFP-sim-validationsim-0of4errornodavinci-stage-01-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13633620Bea Baselines 🐤baseline-duckietownaido-LFV-sim-validationsim-1of4errornodavinci-stage-01-6.2.500:01:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13628622Bea Baselines 🐤baseline-duckietownaido-LFI-sim-validationsim-1of4errornodavinci-stage-01-6.2.500:01:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13623624Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13618625Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-testingsim-2of4errornodavinci-stage-01-6.2.500:01:30
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13612627Bea Baselines 🐤baseline-duckietownaido-LFV-sim-testingsim-2of4errornodavinci-stage-01-6.2.500:01:40
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13608628Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13601629Bea Baselines 🐤baseline-duckietownaido-LFI-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13595631Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-testingsim-0of4errornodavinci-stage-01-6.2.500:01:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13591660Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-validationsim-1of4failednodavinci-stage-01-6.2.500:01:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13587661Bea Baselines 🐤template-tensorflowaido-LFP-sim-validationsim-1of4failednodavinci-stage-01-6.2.500:00:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13581663Bea Baselines 🐤template-tensorflowaido-LFVI-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13577664Bea Baselines 🐤template-tensorflowaido-LFI-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13571666Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13566667Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-testingsim-3of4failednodavinci-stage-01-6.2.500:01:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13561668Bea Baselines 🐤template-tensorflowaido-LFP-sim-testingsim-2of4failednodavinci-stage-01-6.2.500:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13556671Bea Baselines 🐤template-tensorflowaido-LFI-sim-testingsim-1of4failednodavinci-stage-01-6.2.500:02:00
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13549671Bea Baselines 🐤template-tensorflowaido-LFI-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13543673Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13539703Bea Baselines 🐤template-randomaido-LFV_multi-sim-validationsim-0of4errornodavinci-stage-01-6.2.500:01:13
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13535704Bea Baselines 🐤template-randomaido-LFP-sim-validationsim-2of4errornodavinci-stage-01-6.2.500:00:54
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13530707Bea Baselines 🐤template-randomaido-LFI-sim-validationsim-0of4errornodavinci-stage-01-6.2.500:01:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13525708Bea Baselines 🐤template-randomaido-LF-sim-validationsim-0of4errornodavinci-stage-01-6.2.500:00:54
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13522708Bea Baselines 🐤template-randomaido-LF-sim-validationsim-2of4errornodavinci-stage-01-6.2.500:00:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13518710Bea Baselines 🐤template-randomaido-LFV_multi-sim-testingsim-0of4errornodavinci-stage-01-6.2.500:01:13
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13513711Bea Baselines 🐤template-randomaido-LFP-sim-testingsim-0of4errornodavinci-stage-01-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13508711Bea Baselines 🐤template-randomaido-LFP-sim-testingsim-2of4errornodavinci-stage-01-6.2.500:00:54
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13504713Bea Baselines 🐤template-randomaido-LFVI-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13499714Bea Baselines 🐤template-randomaido-LFI-sim-testingsim-0of4errornodavinci-stage-01-6.2.500:01:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13496732Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-validationsim-3of4errornodavinci-stage-01-6.2.500:01:23
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13487736Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-validationsim-1of4errornodavinci-stage-01-6.2.500:02:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13481735Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13477737Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-validationsim-0of4errornodavinci-stage-01-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13474737Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-validationsim-3of4errornodavinci-stage-01-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13467739Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-testingsim-1of4errornodavinci-stage-01-6.2.500:01:17
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13462740Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-testingsim-1of4errornodavinci-stage-01-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13459742Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-testingsim-0of4errornodavinci-stage-01-6.2.500:01:38
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13452742Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-testingsim-1of4errornodavinci-stage-01-6.2.500:01:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13450745Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-testingsim-0of4errornodavinci-stage-01-6.2.500:01:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13446745Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-testingsim-2of4errornodavinci-stage-01-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13441748Bea Baselines 🐤baseline-duckietown-mlaido-hello-sim-validationsanity-checkerrornodavinci-stage-01-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13436768Bea Baselines 🐤challenge-aido_LF-baseline-RPL-ros:daffy-staging:e625ad6e3d7dcafd3e31a42aa57e3ac0e2ccc484aido-hello-sim-validationsanity-checkerrornodavinci-stage-01-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13431770Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-validationsim-2of4errornodavinci-stage-01-6.2.500:01:06
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13426771Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-validationsim-0of4errornodavinci-stage-01-6.2.500:01:31
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13421772Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13416773Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-validationsim-1of4errornodavinci-stage-01-6.2.500:01:43
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13411776Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-testingsim-2of4errornodavinci-stage-01-6.2.500:01:34
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13405778Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-testingsim-3of4errornodavinci-stage-01-6.2.500:01:34
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13399778Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-testingsim-2of4errornodavinci-stage-01-6.2.500:01:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13394779Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13390781Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-testingsim-1of4errornodavinci-stage-01-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13385782Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-testingsim-0of4errornodavinci-stage-01-6.2.500:01:22
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13378800Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-1of4failednodavinci-stage-01-6.2.500:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13373801Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-1of4failednodavinci-stage-01-6.2.500:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13370803Bea Baselines 🐤challenge-aido_LF-template-ros:daffy-staging:3b1546b6959e8affea32711104eb83074ec984eaaido-hello-sim-validationsanity-checkerrornodavinci-stage-01-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13363806user1000001minimal-agentaido-LFV-sim-validationsim-1of4errornodavinci-stage-01-6.2.500:01:38
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13360809Andrea Censitemplate-randomaido-LFV-sim-validationsim-3of4errornodavinci-stage-01-6.2.500:01:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13354810Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-validationsim-0of4failednodavinci-stage-01-6.2.500:00:56
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13350811Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-1of4errornodavinci-stage-01-6.2.500:01:45
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13343812Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-1of4errornodavinci-stage-01-6.2.500:01:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13339814Bea Baselines 🐤baseline-duckietownaido-LF-sim-validationsim-3of4errornodavinci-stage-01-6.2.500:01:02
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13334815Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-validationsim-3of4errornodavinci-stage-01-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13329816Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13324817Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-validationsim-0of4errornodavinci-stage-01-6.2.500:01:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13320819Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-validation447errornodavinci-stage-01-6.2.500:01:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13315820Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-validationsim-1of4errornodavinci-stage-01-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13309821Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-testingsim-2of4errornodavinci-stage-01-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13304822Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-testingsim-0of4errornodavinci-stage-01-6.2.500:01:33
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13300823Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-testingsim-2of4errornodavinci-stage-01-6.2.500:01:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13295824Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-testingsim-3of4errornodavinci-stage-01-6.2.500:01:46
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13292826Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-validationsim-3of4errornodavinci-stage-01-6.2.500:01:33
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13286827Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-testingsim-2of4errornodavinci-stage-01-6.2.500:01:45
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13282828Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-testingsim-0of4errornodavinci-stage-01-6.2.500:01:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13277829Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13272831Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-validationsim-0of4errornodavinci-stage-01-6.2.500:01:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13267832Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-validationsim-1of4errornodavinci-stage-01-6.2.500:01:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13262833Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-validationsim-2of4errornodavinci-stage-01-6.2.500:01:35
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13256834Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13251836Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13243838Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-testingsim-1of4errornodavinci-stage-01-6.2.500:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13239839Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-testingsim-0of4errornodavinci-stage-01-6.2.500:01:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13230839Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13225841Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13221842Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-testingsim-0of4errornodavinci-stage-01-6.2.500:01:12
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13216843Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-validationsim-0of4errornodavinci-stage-01-6.2.500:01:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13212846Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-validationsim-3of4errornodavinci-stage-01-6.2.500:01:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13208847Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-validation447errornodavinci-stage-01-6.2.500:01:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13202848Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-validationsim-3of4errornodavinci-stage-01-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13198849Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-testingsim-2of4errornodavinci-stage-01-6.2.500:01:02
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13194852Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-testingsim-2of4errornodavinci-stage-01-6.2.500:01:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13189853Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-testingsim-1of4errornodavinci-stage-01-6.2.500:01:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13182854Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-3of4host-errornodavinci-stage-01-6.2.500:01:39
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13179856Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-testingsim-1of4errornodavinci-stage-01-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13176856Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-testingsim-2of4errornodavinci-stage-01-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13171858Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-0of4errornodavinci-stage-01-6.2.500:01:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13166859Bea Baselines 🐤baseline-duckietownaido-LF-sim-validationsim-0of4errornodavinci-stage-01-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13161860Bea Baselines 🐤template-pytorchaido-LFV-sim-validationsim-2of4errornodavinci-stage-01-6.2.500:01:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13156861Bea Baselines 🐤template-pytorchaido-LFVI-sim-validationsim-1of4errornodavinci-stage-01-6.2.500:01:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13152863Bea Baselines 🐤template-pytorchaido-LF-sim-validationsim-1of4errornodavinci-stage-01-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13147863Bea Baselines 🐤template-pytorchaido-LF-sim-validationsim-2of4errornodavinci-stage-01-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13142865Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-validationsim-2of4errornodavinci-stage-01-6.2.500:01:38
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13135874Bea Baselines 🐤template-pytorchaido-LFI-sim-testingsim-0of4errornodavinci-stage-01-6.2.500:02:46
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13130873Bea Baselines 🐤template-pytorchaido-LFVI-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13124874Bea Baselines 🐤template-pytorchaido-LFI-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:01:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13121875Bea Baselines 🐤template-pytorchaido-LF-sim-testingsim-2of4errornodavinci-stage-01-6.2.500:01:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13114877Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-testingsim-2of4errornodavinci-stage-01-6.2.500:01:38
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13110879Bea Baselines 🐤template-randomaido-LFV-sim-validationsim-2of4errornodavinci-stage-01-6.2.500:01:43
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13104880Bea Baselines 🐤template-rosaido-LF-sim-validationsim-0of4errornodavinci-stage-01-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13099882Bea Baselines 🐤template-randomaido-LFV-sim-validationsim-1of4errornodavinci-stage-01-6.2.500:01:35
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13093883Bea Baselines 🐤template-tensorflowaido-LFV-sim-validationsim-1of4failednodavinci-stage-01-6.2.500:01:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13089884Bea Baselines 🐤template-rosaido-LF-sim-validationsim-0of4errornodavinci-stage-01-6.2.500:01:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13083689Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-validationsim-3of4errornodavinci-stage-01-6.2.500:01:16
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13078692Bea Baselines 🐤minimal-agentaido-LFVI-sim-validationsim-1of4errornodavinci-stage-01-6.2.500:01:35
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13073693Bea Baselines 🐤minimal-agentaido-LFI-sim-validationsim-0of4errornodavinci-stage-01-6.2.500:01:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13067695Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13061696Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-testingsim-3of4errornodavinci-stage-01-6.2.500:01:18
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13056698Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-1of4errornodavinci-stage-01-6.2.500:01:38
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13051699Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-0of4errornodavinci-stage-01-6.2.500:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13045700Bea Baselines 🐤minimal-agentaido-LFI-sim-testingsim-0of4errornodavinci-stage-01-6.2.500:01:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13042397Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-testingsim-1of4errornodavinci-stage-01-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13035397Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-testingsim-0of4errornodavinci-stage-01-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13030672Bea Baselines 🐤template-tensorflowaido-LF-sim-testingsim-3of4failednodavinci-stage-01-6.2.500:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13026715Bea Baselines 🐤template-randomaido-LF-sim-testingsim-1of4errornodavinci-stage-01-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13021783Andrea Danieletemplate-randomaido-LF-sim-validationsim-1of4errornodavinci-stage-01-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13017785Andrea Danieletemplate-rosaido-LF-sim-validationsim-2of4errornodavinci-stage-01-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13012843Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-validationsim-3of4abortednodavinci-stage-01-6.2.500:00:48
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1302, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 749, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13007845Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-validationsim-3of4errornodavinci-stage-01-6.2.500:01:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13002845Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-validationsim-1of4errornodavinci-stage-01-6.2.500:01:30
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12996847Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-validation444erroryesdavinci-stage-01-6.2.500:01:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12990849Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-testingsim-3of4errornodavinci-stage-01-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12985850Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-testingsim-0of4errornodavinci-stage-01-6.2.500:01:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12981851Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-testingsim-0of4errornodavinci-stage-01-6.2.500:01:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12976852Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-testingsim-2of4errornodavinci-stage-01-6.2.500:01:40
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12972854Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-3of4errornodavinci-stage-01-6.2.500:01:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12967855Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-testingsim-0of4errornodavinci-stage-01-6.2.500:01:31
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12962856Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-testingsim-2of4errornodavinci-stage-01-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12957857Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-1of4errornodavinci-stage-01-6.2.500:01:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12952858Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-0of4errornodavinci-stage-01-6.2.500:01:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12946860Bea Baselines 🐤template-pytorchaido-LFV-sim-validationsim-2of4errornodavinci-stage-01-6.2.500:01:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12941861Bea Baselines 🐤template-pytorchaido-LFVI-sim-validationsim-0of4errornodavinci-stage-01-6.2.500:01:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12936862Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-0of4host-errornodavinci-stage-01-6.2.500:01:36
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12931688Bea Baselines 🐤baseline-simple-yieldaido-hello-sim-state-validationsanity-checkerrornodavinci-stage-01-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12926876Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-testingsim-0of4errornodavinci-stage-01-6.2.500:01:36
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12920702Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12917874Bea Baselines 🐤template-pytorchaido-LFI-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12911700Bea Baselines 🐤minimal-agentaido-LFI-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12907693Bea Baselines 🐤minimal-agentaido-LFI-sim-validationsim-1of4errornodavinci-stage-01-6.2.500:01:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12901862Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-3of4abortednodavinci-stage-01-6.2.500:01:03
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1302, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 749, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12898863Bea Baselines 🐤template-pytorchaido-LF-sim-validationsim-2of4errornodavinci-stage-01-6.2.500:01:03
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12893865Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-validationsim-0of4errornodavinci-stage-01-6.2.500:01:38
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12887877Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-testingsim-2of4errornodavinci-stage-01-6.2.500:01:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12880698Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-1of4errornodavinci-stage-01-6.2.500:01:36
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12875880Bea Baselines 🐤template-rosaido-LF-sim-validationsim-2of4errornodavinci-stage-01-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12870694Bea Baselines 🐤minimal-agentaido-LF-sim-validationsim-3of4errornodavinci-stage-01-6.2.500:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12865701Bea Baselines 🐤minimal-agentaido-LF-sim-testingsim-0of4errornodavinci-stage-01-6.2.500:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12860672Bea Baselines 🐤template-tensorflowaido-LF-sim-testingsim-3of4failednodavinci-stage-01-6.2.500:00:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12855785Andrea Danieletemplate-rosaido-LF-sim-validationsim-3of4errornodavinci-stage-01-6.2.500:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12850872Bea Baselines 🐤template-pytorchaido-LFV-sim-testingsim-2of4errornodavinci-stage-01-6.2.500:01:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12845873Bea Baselines 🐤template-pytorchaido-LFVI-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12838874Bea Baselines 🐤template-pytorchaido-LFI-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12835876Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12830877Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-testingsim-1of4errornodavinci-stage-01-6.2.500:01:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12825878Bea Baselines 🐤template-pytorchaido-LFP-sim-testingsim-1of4errornodavinci-stage-01-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12820879Bea Baselines 🐤template-randomaido-LFV-sim-validationsim-0of4errornodavinci-stage-01-6.2.500:01:33
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12816880Bea Baselines 🐤template-rosaido-LF-sim-validationsim-1of4errornodavinci-stage-01-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12815880Bea Baselines 🐤template-rosaido-LF-sim-validationsim-3of4errornodavinci-stage-01-6.2.500:01:06
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12810882Bea Baselines 🐤template-randomaido-LFV-sim-validationsim-3of4errornodavinci-stage-01-6.2.500:01:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12805883Bea Baselines 🐤template-tensorflowaido-LFV-sim-validationsim-3of4failednodavinci-stage-01-6.2.500:01:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12801884Bea Baselines 🐤template-rosaido-LF-sim-validationsim-0of4errornodavinci-stage-01-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12792689Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-validationsim-3of4errornodavinci-stage-01-6.2.500:01:14
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12785690Bea Baselines 🐤minimal-agentaido-LFP-sim-validationsim-3of4errornodavinci-stage-01-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12780692Bea Baselines 🐤minimal-agentaido-LFVI-sim-validationsim-0of4errornodavinci-stage-01-6.2.500:01:36
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12778693Bea Baselines 🐤minimal-agentaido-LFI-sim-validationsim-1of4errornodavinci-stage-01-6.2.500:01:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12772694Bea Baselines 🐤minimal-agentaido-LF-sim-validationsim-3of4errornodavinci-stage-01-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12768696Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-testingsim-3of4errornodavinci-stage-01-6.2.500:01:17
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12763696Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-testingsim-1of4errornodavinci-stage-01-6.2.500:01:15
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12759697Bea Baselines 🐤minimal-agentaido-LFP-sim-testingsim-3of4errornodavinci-stage-01-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12753699Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-1of4errornodavinci-stage-01-6.2.500:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12749701Bea Baselines 🐤minimal-agentaido-LF-sim-testingsim-1of4errornodavinci-stage-01-6.2.500:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12743397Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-testingsim-2of4errornodavinci-stage-01-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12738526Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-testingsim-1of4failednodavinci-stage-01-6.2.500:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12733715Bea Baselines 🐤template-randomaido-LF-sim-testingsim-2of4errornodavinci-stage-01-6.2.500:00:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12729783Andrea Danieletemplate-randomaido-LF-sim-validationsim-3of4errornodavinci-stage-01-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12724789Andrea Danieletemplate-pytorchaido-LF-sim-validationsim-1of4errornodavinci-stage-01-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12716698Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-2of4errornodavinci-stage-01-6.2.500:01:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12711699Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12706700Bea Baselines 🐤minimal-agentaido-LFI-sim-testingsim-1of4errornodavinci-stage-01-6.2.500:01:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12702702Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:01:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12698397Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-testingsim-2of4errornodavinci-stage-01-6.2.500:00:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12690526Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-testingsim-1of4failednodavinci-stage-01-6.2.500:00:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12688785Andrea Danieletemplate-rosaido-LF-sim-validationsim-0of4errornodavinci-stage-01-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12681789Andrea Danieletemplate-pytorchaido-LF-sim-validationsim-3of4errornodavinci-stage-01-6.2.500:01:20
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12675672Bea Baselines 🐤template-tensorflowaido-LF-sim-testingsim-1of4failednodavinci-stage-01-6.2.500:00:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12670715Bea Baselines 🐤template-randomaido-LF-sim-testingsim-0of4errornodavinci-stage-01-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12666803Bea Baselines 🐤challenge-aido_LF-template-ros:daffy-staging:3b1546b6959e8affea32711104eb83074ec984eaaido-hello-sim-validationsanity-checkerrornodavinci-stage-01-6.2.500:01:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12604912Bea Baselines 🐤baseline-solutionlx22-planning-dd-empty-valistep1successnodavinci-stage-01-6.2.500:11:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio1.0
duration11.16818724870393
complexity15.925925925925926
avg_min_distance0.8746658000716122


other stats
nfeasible27
nsamples27
No reset possible
12602913Bea Baselines 🐤baseline-solutionlx22-planning-cc-dynamic-valistep1-3of4successnodavinci-stage-01-6.2.500:00:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
12600913Bea Baselines 🐤baseline-solutionlx22-planning-cc-dynamic-valistep1-1of4successnodavinci-stage-01-6.2.500:00:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
12599914Bea Baselines 🐤baseline-solutionlx22-planning-cc-static-valistep1-1of4successnodavinci-stage-01-6.2.500:00:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
12598914Bea Baselines 🐤baseline-solutionlx22-planning-cc-static-valistep1-2of4successnodavinci-stage-01-6.2.500:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
12597914Bea Baselines 🐤baseline-solutionlx22-planning-cc-static-valistep1-3of4successnodavinci-stage-01-6.2.500:00:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
12588917Bea Baselines 🐤baseline-solutionlx22-planning-dd-static-teststep1-0of4successnodavinci-stage-01-6.2.500:12:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio1.0
duration45.314332041815014
complexity95.66666666666669
avg_min_distance0.20535868938035437


other stats
nfeasible3
nsamples3
No reset possible
12587917Bea Baselines 🐤baseline-solutionlx22-planning-dd-static-teststep1-1of4successnodavinci-stage-01-6.2.500:00:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
12584919Bea Baselines 🐤baseline-solutionlx22-planning-cc-dynamic-teststep1-3of4successnodavinci-stage-01-6.2.500:00:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
12580920Bea Baselines 🐤baseline-solutionlx22-planning-cc-static-teststep1-3of4successnodavinci-stage-01-6.2.500:00:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
12577920Bea Baselines 🐤baseline-solutionlx22-planning-cc-static-teststep1-2of4successnodavinci-stage-01-6.2.500:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
12556309Andrea Censiminimal-agentaido-LFV-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:03:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.499999999999986
in-drivable-lane_median6.749999999999985
driven_lanedir_consec_median0.19955231542410212
deviation-center-line_median0.1256753337219296


other stats
deviation-center-line_max0.1256753337219296
deviation-center-line_mean0.1256753337219296
deviation-center-line_min0.1256753337219296
deviation-heading_max0.9488219555580464
deviation-heading_mean0.9488219555580464
deviation-heading_median0.9488219555580464
deviation-heading_min0.9488219555580464
distance-from-start_max1.233057068821899
distance-from-start_mean1.233057068821899
distance-from-start_median1.233057068821899
distance-from-start_min1.233057068821899
driven_any_max1.2331286149593297
driven_any_mean1.2331286149593297
driven_any_median1.2331286149593297
driven_any_min1.2331286149593297
driven_lanedir_consec_max0.19955231542410212
driven_lanedir_consec_mean0.19955231542410212
driven_lanedir_consec_min0.19955231542410212
driven_lanedir_max0.19955231542410212
driven_lanedir_mean0.19955231542410212
driven_lanedir_median0.19955231542410212
driven_lanedir_min0.19955231542410212
in-drivable-lane_max6.749999999999985
in-drivable-lane_mean6.749999999999985
in-drivable-lane_min6.749999999999985
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.2331286149593297, "survival_time": 8.499999999999986, "driven_lanedir": 0.19955231542410212, "in-drivable-lane": 6.749999999999985, "deviation-heading": 0.9488219555580464, "distance-from-start": 1.233057068821899, "deviation-center-line": 0.1256753337219296, "driven_lanedir_consec": 0.19955231542410212}}
simulation-passed1
survival_time_max8.499999999999986
survival_time_mean8.499999999999986
survival_time_min8.499999999999986
No reset possible
12552310Andrea Censiminimal-agentaido-LFV-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:02:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.8499999999999943
in-drivable-lane_median2.0999999999999934
driven_lanedir_consec_median0.19955565328420843
deviation-center-line_median0.12567516126913225


other stats
deviation-center-line_max0.12567516126913225
deviation-center-line_mean0.12567516126913225
deviation-center-line_min0.12567516126913225
deviation-heading_max0.9488219555580464
deviation-heading_mean0.9488219555580464
deviation-heading_median0.9488219555580464
deviation-heading_min0.9488219555580464
distance-from-start_max0.46487640009490927
distance-from-start_mean0.46487640009490927
distance-from-start_median0.46487640009490927
distance-from-start_min0.46487640009490927
driven_any_max0.46488519376666826
driven_any_mean0.46488519376666826
driven_any_median0.46488519376666826
driven_any_min0.46488519376666826
driven_lanedir_consec_max0.19955565328420843
driven_lanedir_consec_mean0.19955565328420843
driven_lanedir_consec_min0.19955565328420843
driven_lanedir_max0.19955565328420843
driven_lanedir_mean0.19955565328420843
driven_lanedir_median0.19955565328420843
driven_lanedir_min0.19955565328420843
in-drivable-lane_max2.0999999999999934
in-drivable-lane_mean2.0999999999999934
in-drivable-lane_min2.0999999999999934
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.46488519376666826, "survival_time": 3.8499999999999943, "driven_lanedir": 0.19955565328420843, "in-drivable-lane": 2.0999999999999934, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.46487640009490927, "deviation-center-line": 0.12567516126913225, "driven_lanedir_consec": 0.19955565328420843}}
simulation-passed1
survival_time_max3.8499999999999943
survival_time_mean3.8499999999999943
survival_time_min3.8499999999999943
No reset possible
12547311Andrea Censiminimal-agentaido-LFV-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:04:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.900000000000006
in-drivable-lane_median6.60000000000001
driven_lanedir_consec_median0.33122941999330235
deviation-center-line_median0.2697354465605155


other stats
deviation-center-line_max0.2697354465605155
deviation-center-line_mean0.2697354465605155
deviation-center-line_min0.2697354465605155
deviation-heading_max2.53835057480462
deviation-heading_mean2.53835057480462
deviation-heading_median2.53835057480462
deviation-heading_min2.53835057480462
distance-from-start_max1.4631057991302543
distance-from-start_mean1.4631057991302543
distance-from-start_median1.4631057991302543
distance-from-start_min1.4631057991302543
driven_any_max1.4632129547419284
driven_any_mean1.4632129547419284
driven_any_median1.4632129547419284
driven_any_min1.4632129547419284
driven_lanedir_consec_max0.33122941999330235
driven_lanedir_consec_mean0.33122941999330235
driven_lanedir_consec_min0.33122941999330235
driven_lanedir_max0.33122941999330235
driven_lanedir_mean0.33122941999330235
driven_lanedir_median0.33122941999330235
driven_lanedir_min0.33122941999330235
in-drivable-lane_max6.60000000000001
in-drivable-lane_mean6.60000000000001
in-drivable-lane_min6.60000000000001
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.4632129547419284, "survival_time": 9.900000000000006, "driven_lanedir": 0.33122941999330235, "in-drivable-lane": 6.60000000000001, "deviation-heading": 2.53835057480462, "distance-from-start": 1.4631057991302543, "deviation-center-line": 0.2697354465605155, "driven_lanedir_consec": 0.33122941999330235}}
simulation-passed1
survival_time_max9.900000000000006
survival_time_mean9.900000000000006
survival_time_min9.900000000000006
No reset possible
12543312Liam Paulltemplate-rosaido-LF-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:01:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.31175730512436184
survival_time_median7.349999999999982
deviation-center-line_median0.14399311239876822
in-drivable-lane_median5.3499999999999845


other stats
deviation-center-line_max0.14399311239876822
deviation-center-line_mean0.14399311239876822
deviation-center-line_min0.14399311239876822
deviation-heading_max1.5609075234861365
deviation-heading_mean1.5609075234861365
deviation-heading_median1.5609075234861365
deviation-heading_min1.5609075234861365
distance-from-start_max1.8346285229072263
distance-from-start_mean1.8346285229072263
distance-from-start_median1.8346285229072263
distance-from-start_min1.8346285229072263
driven_any_max1.8972994455879413
driven_any_mean1.8972994455879413
driven_any_median1.8972994455879413
driven_any_min1.8972994455879413
driven_lanedir_consec_max0.31175730512436184
driven_lanedir_consec_mean0.31175730512436184
driven_lanedir_consec_min0.31175730512436184
driven_lanedir_max0.31175730512436184
driven_lanedir_mean0.31175730512436184
driven_lanedir_median0.31175730512436184
driven_lanedir_min0.31175730512436184
in-drivable-lane_max5.3499999999999845
in-drivable-lane_mean5.3499999999999845
in-drivable-lane_min5.3499999999999845
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.8972994455879413, "survival_time": 7.349999999999982, "driven_lanedir": 0.31175730512436184, "in-drivable-lane": 5.3499999999999845, "deviation-heading": 1.5609075234861365, "distance-from-start": 1.8346285229072263, "deviation-center-line": 0.14399311239876822, "driven_lanedir_consec": 0.31175730512436184}}
simulation-passed1
survival_time_max7.349999999999982
survival_time_mean7.349999999999982
survival_time_min7.349999999999982
No reset possible
12541341Liam Paulltemplate-rosaido-LF-sim-validationsim-3of4failednodavinci-stage-01-6.2.500:03:18
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 243, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12539341Liam Paulltemplate-rosaido-LF-sim-validationsim-1of4failednodavinci-stage-01-6.2.500:03:02
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 243, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12537356Liam Paulltemplate-rosaido-LF-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:02:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1963743496786647
survival_time_median5.549999999999988
deviation-center-line_median0.06466834814020654
in-drivable-lane_median4.449999999999988


other stats
deviation-center-line_max0.06466834814020654
deviation-center-line_mean0.06466834814020654
deviation-center-line_min0.06466834814020654
deviation-heading_max0.5965294985191033
deviation-heading_mean0.5965294985191033
deviation-heading_median0.5965294985191033
deviation-heading_min0.5965294985191033
distance-from-start_max1.3437764950185644
distance-from-start_mean1.3437764950185644
distance-from-start_median1.3437764950185644
distance-from-start_min1.3437764950185644
driven_any_max1.4293397883458483
driven_any_mean1.4293397883458483
driven_any_median1.4293397883458483
driven_any_min1.4293397883458483
driven_lanedir_consec_max0.1963743496786647
driven_lanedir_consec_mean0.1963743496786647
driven_lanedir_consec_min0.1963743496786647
driven_lanedir_max0.1963743496786647
driven_lanedir_mean0.1963743496786647
driven_lanedir_median0.1963743496786647
driven_lanedir_min0.1963743496786647
in-drivable-lane_max4.449999999999988
in-drivable-lane_mean4.449999999999988
in-drivable-lane_min4.449999999999988
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.4293397883458483, "survival_time": 5.549999999999988, "driven_lanedir": 0.1963743496786647, "in-drivable-lane": 4.449999999999988, "deviation-heading": 0.5965294985191033, "distance-from-start": 1.3437764950185644, "deviation-center-line": 0.06466834814020654, "driven_lanedir_consec": 0.1963743496786647}}
simulation-passed1
survival_time_max5.549999999999988
survival_time_mean5.549999999999988
survival_time_min5.549999999999988
No reset possible
12531356Liam Paulltemplate-rosaido-LF-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:02:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1400036731926848
survival_time_median2.9499999999999975
deviation-center-line_median0.05051615373046504
in-drivable-lane_median2.049999999999997


other stats
deviation-center-line_max0.05051615373046504
deviation-center-line_mean0.05051615373046504
deviation-center-line_min0.05051615373046504
deviation-heading_max0.593008550541477
deviation-heading_mean0.593008550541477
deviation-heading_median0.593008550541477
deviation-heading_min0.593008550541477
distance-from-start_max0.5431519453782556
distance-from-start_mean0.5431519453782556
distance-from-start_median0.5431519453782556
distance-from-start_min0.5431519453782556
driven_any_max0.5699386803569293
driven_any_mean0.5699386803569293
driven_any_median0.5699386803569293
driven_any_min0.5699386803569293
driven_lanedir_consec_max0.1400036731926848
driven_lanedir_consec_mean0.1400036731926848
driven_lanedir_consec_min0.1400036731926848
driven_lanedir_max0.1400036731926848
driven_lanedir_mean0.1400036731926848
driven_lanedir_median0.1400036731926848
driven_lanedir_min0.1400036731926848
in-drivable-lane_max2.049999999999997
in-drivable-lane_mean2.049999999999997
in-drivable-lane_min2.049999999999997
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.5699386803569293, "survival_time": 2.9499999999999975, "driven_lanedir": 0.1400036731926848, "in-drivable-lane": 2.049999999999997, "deviation-heading": 0.593008550541477, "distance-from-start": 0.5431519453782556, "deviation-center-line": 0.05051615373046504, "driven_lanedir_consec": 0.1400036731926848}}
simulation-passed1
survival_time_max2.9499999999999975
survival_time_mean2.9499999999999975
survival_time_min2.9499999999999975
No reset possible
12530356Liam Paulltemplate-rosaido-LF-sim-validationsim-1of4successnodavinci-stage-01-6.2.500:02:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7033947470951211
survival_time_median11.60000000000003
deviation-center-line_median0.17015566547819724
in-drivable-lane_median8.550000000000036


other stats
deviation-center-line_max0.17015566547819724
deviation-center-line_mean0.17015566547819724
deviation-center-line_min0.17015566547819724
deviation-heading_max1.4758177244968111
deviation-heading_mean1.4758177244968111
deviation-heading_median1.4758177244968111
deviation-heading_min1.4758177244968111
distance-from-start_max2.8275657896864685
distance-from-start_mean2.8275657896864685
distance-from-start_median2.8275657896864685
distance-from-start_min2.8275657896864685
driven_any_max3.263626931364328
driven_any_mean3.263626931364328
driven_any_median3.263626931364328
driven_any_min3.263626931364328
driven_lanedir_consec_max0.7033947470951211
driven_lanedir_consec_mean0.7033947470951211
driven_lanedir_consec_min0.7033947470951211
driven_lanedir_max0.7033947470951211
driven_lanedir_mean0.7033947470951211
driven_lanedir_median0.7033947470951211
driven_lanedir_min0.7033947470951211
in-drivable-lane_max8.550000000000036
in-drivable-lane_mean8.550000000000036
in-drivable-lane_min8.550000000000036
per-episodes
details{"loop-000-ego0": {"driven_any": 3.263626931364328, "survival_time": 11.60000000000003, "driven_lanedir": 0.7033947470951211, "in-drivable-lane": 8.550000000000036, "deviation-heading": 1.4758177244968111, "distance-from-start": 2.8275657896864685, "deviation-center-line": 0.17015566547819724, "driven_lanedir_consec": 0.7033947470951211}}
simulation-passed1
survival_time_max11.60000000000003
survival_time_mean11.60000000000003
survival_time_min11.60000000000003
No reset possible
12529356Liam Paulltemplate-rosaido-LF-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:01:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.42130283292732584
survival_time_median7.099999999999983
deviation-center-line_median0.1979674046511709
in-drivable-lane_median4.749999999999985


other stats
deviation-center-line_max0.1979674046511709
deviation-center-line_mean0.1979674046511709
deviation-center-line_min0.1979674046511709
deviation-heading_max1.5419318948077585
deviation-heading_mean1.5419318948077585
deviation-heading_median1.5419318948077585
deviation-heading_min1.5419318948077585
distance-from-start_max1.6907587028355764
distance-from-start_mean1.6907587028355764
distance-from-start_median1.6907587028355764
distance-from-start_min1.6907587028355764
driven_any_max1.7542162085054918
driven_any_mean1.7542162085054918
driven_any_median1.7542162085054918
driven_any_min1.7542162085054918
driven_lanedir_consec_max0.42130283292732584
driven_lanedir_consec_mean0.42130283292732584
driven_lanedir_consec_min0.42130283292732584
driven_lanedir_max0.42130283292732584
driven_lanedir_mean0.42130283292732584
driven_lanedir_median0.42130283292732584
driven_lanedir_min0.42130283292732584
in-drivable-lane_max4.749999999999985
in-drivable-lane_mean4.749999999999985
in-drivable-lane_min4.749999999999985
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.7542162085054918, "survival_time": 7.099999999999983, "driven_lanedir": 0.42130283292732584, "in-drivable-lane": 4.749999999999985, "deviation-heading": 1.5419318948077585, "distance-from-start": 1.6907587028355764, "deviation-center-line": 0.1979674046511709, "driven_lanedir_consec": 0.42130283292732584}}
simulation-passed1
survival_time_max7.099999999999983
survival_time_mean7.099999999999983
survival_time_min7.099999999999983
No reset possible
12524386Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:10:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median31.94999999999914
driven_lanedir_consec_median-3.421760415292741
deviation-center-line_median1.962151814562556


other stats
deviation-center-line_max1.962151814562556
deviation-center-line_mean1.962151814562556
deviation-center-line_min1.962151814562556
deviation-heading_max23.913703600582505
deviation-heading_mean23.913703600582505
deviation-heading_median23.913703600582505
deviation-heading_min23.913703600582505
distance-from-start_max0.16539067108007266
distance-from-start_mean0.16539067108007266
distance-from-start_median0.16539067108007266
distance-from-start_min0.16539067108007266
driven_any_max12.139984289635205
driven_any_mean12.139984289635205
driven_any_median12.139984289635205
driven_any_min12.139984289635205
driven_lanedir_consec_max-3.421760415292741
driven_lanedir_consec_mean-3.421760415292741
driven_lanedir_consec_min-3.421760415292741
driven_lanedir_max-3.683233935411457
driven_lanedir_mean-3.683233935411457
driven_lanedir_median-3.683233935411457
driven_lanedir_min-3.683233935411457
in-drivable-lane_max31.94999999999914
in-drivable-lane_mean31.94999999999914
in-drivable-lane_min31.94999999999914
per-episodes
details{"autolab-000-ego0": {"driven_any": 12.139984289635205, "survival_time": 59.99999999999873, "driven_lanedir": -3.683233935411457, "in-drivable-lane": 31.94999999999914, "deviation-heading": 23.913703600582505, "distance-from-start": 0.16539067108007266, "deviation-center-line": 1.962151814562556, "driven_lanedir_consec": -3.421760415292741}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12522386Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:07:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median31.19999999999928
driven_lanedir_consec_median-3.801138406224003
deviation-center-line_median2.040337869436015


other stats
deviation-center-line_max2.040337869436015
deviation-center-line_mean2.040337869436015
deviation-center-line_min2.040337869436015
deviation-heading_max25.49961927450449
deviation-heading_mean25.49961927450449
deviation-heading_median25.49961927450449
deviation-heading_min25.49961927450449
distance-from-start_max0.16802097701961405
distance-from-start_mean0.16802097701961405
distance-from-start_median0.16802097701961405
distance-from-start_min0.16802097701961405
driven_any_max12.667246217506165
driven_any_mean12.667246217506165
driven_any_median12.667246217506165
driven_any_min12.667246217506165
driven_lanedir_consec_max-3.801138406224003
driven_lanedir_consec_mean-3.801138406224003
driven_lanedir_consec_min-3.801138406224003
driven_lanedir_max-4.0759945777409925
driven_lanedir_mean-4.0759945777409925
driven_lanedir_median-4.0759945777409925
driven_lanedir_min-4.0759945777409925
in-drivable-lane_max31.19999999999928
in-drivable-lane_mean31.19999999999928
in-drivable-lane_min31.19999999999928
per-episodes
details{"loop2-000-ego0": {"driven_any": 12.667246217506165, "survival_time": 59.99999999999873, "driven_lanedir": -4.0759945777409925, "in-drivable-lane": 31.19999999999928, "deviation-heading": 25.49961927450449, "distance-from-start": 0.16802097701961405, "deviation-center-line": 2.040337869436015, "driven_lanedir_consec": -3.801138406224003}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12517387Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-validationsim-1of4successnodavinci-stage-01-6.2.500:14:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median36.59999999999893
driven_lanedir_consec_median-2.1683893159488927
deviation-center-line_median2.291608246258233


other stats
deviation-center-line_max2.291608246258233
deviation-center-line_mean2.291608246258233
deviation-center-line_min2.291608246258233
deviation-heading_max19.55838705452319
deviation-heading_mean19.55838705452319
deviation-heading_median19.55838705452319
deviation-heading_min19.55838705452319
distance-from-start_max0.16389202081277737
distance-from-start_mean0.16389202081277737
distance-from-start_median0.16389202081277737
distance-from-start_min0.16389202081277737
driven_any_max11.00548359088279
driven_any_mean11.00548359088279
driven_any_median11.00548359088279
driven_any_min11.00548359088279
driven_lanedir_consec_max-2.1683893159488927
driven_lanedir_consec_mean-2.1683893159488927
driven_lanedir_consec_min-2.1683893159488927
driven_lanedir_max-2.4005849790524896
driven_lanedir_mean-2.4005849790524896
driven_lanedir_median-2.4005849790524896
driven_lanedir_min-2.4005849790524896
in-drivable-lane_max36.59999999999893
in-drivable-lane_mean36.59999999999893
in-drivable-lane_min36.59999999999893
per-episodes
details{"loop-000-ego0": {"driven_any": 11.00548359088279, "survival_time": 59.99999999999873, "driven_lanedir": -2.4005849790524896, "in-drivable-lane": 36.59999999999893, "deviation-heading": 19.55838705452319, "distance-from-start": 0.16389202081277737, "deviation-center-line": 2.291608246258233, "driven_lanedir_consec": -2.1683893159488927}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12515388Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12504392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-1of4successnodavinci-stage-01-6.2.500:27:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median27.549999999999343
driven_lanedir_consec_median-2.952388036461128
deviation-center-line_median2.6591203276789717


other stats
deviation-center-line_max3.411260379326251
deviation-center-line_mean2.560755367941862
deviation-center-line_min1.5135204370832562
deviation-heading_max37.82293240559152
deviation-heading_mean27.461389722178673
deviation-heading_median27.18543023893306
deviation-heading_min17.651766005257038
distance-from-start_max0.20567278232911332
distance-from-start_mean0.13666208070034486
distance-from-start_median0.17048777023613293
distance-from-start_min2.482534153247273e-16
driven_any_max12.794300656563582
driven_any_mean9.269486349093668
driven_any_median12.141822369905398
driven_any_min2.9790409838966753e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean-2.383202078612419
driven_lanedir_consec_min-3.628032241527421
driven_lanedir_max0.0
driven_lanedir_mean-2.4261210758414835
driven_lanedir_median-3.038226030919257
driven_lanedir_min-3.628032241527421
in-drivable-lane_max40.649999999998826
in-drivable-lane_mean23.93749999999938
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 12.550596672050906, "survival_time": 59.99999999999873, "driven_lanedir": -3.628032241527421, "in-drivable-lane": 30.499999999999275, "deviation-heading": 26.14246462371696, "distance-from-start": 0.16134661137470413, "deviation-center-line": 2.555778034628291, "driven_lanedir_consec": -3.628032241527421}, "loop-000-ego1": {"driven_any": 12.794300656563582, "survival_time": 59.99999999999873, "driven_lanedir": -3.5841099942431316, "in-drivable-lane": 24.59999999999941, "deviation-heading": 28.22839585414916, "distance-from-start": 0.17962892909756173, "deviation-center-line": 3.411260379326251, "driven_lanedir_consec": -3.5841099942431316}, "loop-000-ego2": {"driven_any": 11.733048067759889, "survival_time": 59.99999999999873, "driven_lanedir": -2.492342067595382, "in-drivable-lane": 40.649999999998826, "deviation-heading": 17.651766005257038, "distance-from-start": 0.20567278232911332, "deviation-center-line": 1.5135204370832562, "driven_lanedir_consec": -2.320666078679124}, "loop-000-ego3": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 2.7624626207296523, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12491392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:32:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median30.94999999999917
driven_lanedir_consec_median-2.241098903362043
deviation-center-line_median2.380347320299924


other stats
deviation-center-line_max4.487069802055514
deviation-center-line_mean2.6302026035566675
deviation-center-line_min1.2730459715713065
deviation-heading_max22.249151252164424
deviation-heading_mean16.56452866758167
deviation-heading_median17.467476122616702
deviation-heading_min9.07401117292885
distance-from-start_max0.16796232451580118
distance-from-start_mean0.14031899383285684
distance-from-start_median0.16228414501189842
distance-from-start_min0.06874536079182941
driven_any_max15.437770446044734
driven_any_mean9.762865071294074
driven_any_median11.771602612424124
driven_any_min0.07048461428331204
driven_lanedir_consec_max0.06632886269851967
driven_lanedir_consec_mean-1.968257266277401
driven_lanedir_consec_min-3.457160121084037
driven_lanedir_max0.06632886269851967
driven_lanedir_mean-2.5617480711929312
driven_lanedir_median-2.241098903362043
driven_lanedir_min-5.831123340746159
in-drivable-lane_max47.2499999999989
in-drivable-lane_mean27.28749999999931
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 11.230788571634928, "survival_time": 59.99999999999873, "driven_lanedir": -2.885349138192572, "in-drivable-lane": 33.89999999999918, "deviation-heading": 22.249151252164424, "distance-from-start": 0.16012749435440324, "deviation-center-line": 2.3346845790500064, "driven_lanedir_consec": -2.885349138192572}, "zigzag-000-ego1": {"driven_any": 12.312416653213324, "survival_time": 59.99999999999873, "driven_lanedir": -1.5968486685315146, "in-drivable-lane": 47.2499999999989, "deviation-heading": 12.77494256439268, "distance-from-start": 0.16444079566939357, "deviation-center-line": 1.2730459715713065, "driven_lanedir_consec": -1.5968486685315146}, "zigzag-000-ego2": {"driven_any": 15.437770446044734, "survival_time": 59.99999999999873, "driven_lanedir": -5.831123340746159, "in-drivable-lane": 27.99999999999916, "deviation-heading": 22.160009680840727, "distance-from-start": 0.16796232451580118, "deviation-center-line": 2.4260100615498414, "driven_lanedir_consec": -3.457160121084037}, "zigzag-000-ego3": {"driven_any": 0.07048461428331204, "survival_time": 59.99999999999873, "driven_lanedir": 0.06632886269851967, "in-drivable-lane": 0.0, "deviation-heading": 9.07401117292885, "distance-from-start": 0.06874536079182941, "deviation-center-line": 4.487069802055514, "driven_lanedir_consec": 0.06632886269851967}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12489393Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:10:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median41.89999999999898
driven_lanedir_consec_median-2.074203312000338
deviation-center-line_median1.5666797598758089


other stats
deviation-center-line_max1.5666797598758089
deviation-center-line_mean1.5666797598758089
deviation-center-line_min1.5666797598758089
deviation-heading_max16.52479763975907
deviation-heading_mean16.52479763975907
deviation-heading_median16.52479763975907
deviation-heading_min16.52479763975907
distance-from-start_max0.16830579319217703
distance-from-start_mean0.16830579319217703
distance-from-start_median0.16830579319217703
distance-from-start_min0.16830579319217703
driven_any_max12.55631829735102
driven_any_mean12.55631829735102
driven_any_median12.55631829735102
driven_any_min12.55631829735102
driven_lanedir_consec_max-2.074203312000338
driven_lanedir_consec_mean-2.074203312000338
driven_lanedir_consec_min-2.074203312000338
driven_lanedir_max-2.400979598764138
driven_lanedir_mean-2.400979598764138
driven_lanedir_median-2.400979598764138
driven_lanedir_min-2.400979598764138
in-drivable-lane_max41.89999999999898
in-drivable-lane_mean41.89999999999898
in-drivable-lane_min41.89999999999898
per-episodes
details{"zigzag-000-ego0": {"driven_any": 12.55631829735102, "survival_time": 59.99999999999873, "driven_lanedir": -2.400979598764138, "in-drivable-lane": 41.89999999999898, "deviation-heading": 16.52479763975907, "distance-from-start": 0.16830579319217703, "deviation-center-line": 1.5666797598758089, "driven_lanedir_consec": -2.074203312000338}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12469398Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-testingsim-1of4successnodavinci-stage-01-6.2.500:33:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median26.0999999999994
driven_lanedir_consec_median-3.447390171428352
deviation-center-line_median2.907294411513669


other stats
deviation-center-line_max5.482870762494935
deviation-center-line_mean3.475989493785371
deviation-center-line_min2.6064983896192127
deviation-heading_max29.499798157663715
deviation-heading_mean26.459007646358085
deviation-heading_median26.167022141013113
deviation-heading_min24.0021881457424
distance-from-start_max0.2975168760662697
distance-from-start_mean0.193446078816376
distance-from-start_median0.16281371507504538
distance-from-start_min0.1506400090491435
driven_any_max12.965973865595313
driven_any_mean9.6054436440259
driven_any_median12.369576208924371
driven_any_min0.7166482926595499
driven_lanedir_consec_max-0.08515599549204622
driven_lanedir_consec_mean-2.693708699892234
driven_lanedir_consec_min-3.7948984612201855
driven_lanedir_max-0.08515599549204622
driven_lanedir_mean-2.82181604044678
driven_lanedir_median-3.557520947463922
driven_lanedir_min-4.087066271367232
in-drivable-lane_max30.84999999999919
in-drivable-lane_mean21.049999999999496
in-drivable-lane_min1.149999999999996
per-episodes
details{"4way-000-ego0": {"driven_any": 12.373328680349855, "survival_time": 59.99999999999873, "driven_lanedir": -3.320143433707658, "in-drivable-lane": 27.049999999999297, "deviation-heading": 27.20366714442528, "distance-from-start": 0.1576653722570175, "deviation-center-line": 3.208082673183731, "driven_lanedir_consec": -3.320143433707658}, "4way-000-ego1": {"driven_any": 0.7166482926595499, "survival_time": 59.99999999999873, "driven_lanedir": -0.08515599549204622, "in-drivable-lane": 1.149999999999996, "deviation-heading": 25.13037713760095, "distance-from-start": 0.1506400090491435, "deviation-center-line": 5.482870762494935, "driven_lanedir_consec": -0.08515599549204622}, "4way-000-ego2": {"driven_any": 12.365823737498886, "survival_time": 59.99999999999873, "driven_lanedir": -4.087066271367232, "in-drivable-lane": 30.84999999999919, "deviation-heading": 24.0021881457424, "distance-from-start": 0.16796205789307325, "deviation-center-line": 2.6064983896192127, "driven_lanedir_consec": -3.574636909149046}, "4way-000-ego3": {"driven_any": 12.965973865595313, "survival_time": 59.99999999999873, "driven_lanedir": -3.7948984612201855, "in-drivable-lane": 25.149999999999505, "deviation-heading": 29.499798157663715, "distance-from-start": 0.2975168760662697, "deviation-center-line": 2.6065061498436073, "driven_lanedir_consec": -3.7948984612201855}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12464514Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-validationsim-0of4failednodavinci-stage-01-6.2.500:01:09
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12460516Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-validationsim-2of4failednodavinci-stage-01-6.2.500:01:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12453517Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12449518Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-validationsim-0of4failednodavinci-stage-01-6.2.500:01:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12442519Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-validationsim-2of4failednodavinci-stage-01-6.2.500:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12436521Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-testingsim-3of4failednodavinci-stage-01-6.2.500:01:16
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12434522Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-testingsim-3of4failednodavinci-stage-01-6.2.500:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12428523Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-testingsim-3of4failednodavinci-stage-01-6.2.500:02:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12425524Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-testingsim-0of4failednodavinci-stage-01-6.2.500:02:20
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12424524Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:01:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12422525Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-testingsim-0of4failednodavinci-stage-01-6.2.500:01:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12415528Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:09:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median25.42499999999924
driven_lanedir_consec_median5.775611772253251
deviation-center-line_median2.4368969029593206


other stats
deviation-center-line_max3.813517873092033
deviation-center-line_mean2.4368969029593206
deviation-center-line_min1.0602759328266085
deviation-heading_max19.724833120292317
deviation-heading_mean12.884422857490256
deviation-heading_median12.884422857490256
deviation-heading_min6.044012594688198
distance-from-start_max2.1721163975446953
distance-from-start_mean1.8975071089702689
distance-from-start_median1.8975071089702689
distance-from-start_min1.6228978203958422
driven_any_max11.549465065218318
driven_any_mean7.889941030470343
driven_any_median7.889941030470343
driven_any_min4.230416995722369
driven_lanedir_consec_max9.036570542930152
driven_lanedir_consec_mean5.775611772253251
driven_lanedir_consec_min2.514653001576349
driven_lanedir_max9.036570542930152
driven_lanedir_mean5.775611772253251
driven_lanedir_median5.775611772253251
driven_lanedir_min2.514653001576349
in-drivable-lane_max43.899999999998634
in-drivable-lane_mean25.42499999999924
in-drivable-lane_min6.949999999999844
per-episodes
details{"loop2-000-ego0": {"driven_any": 4.230416995722369, "survival_time": 59.99999999999873, "driven_lanedir": 2.514653001576349, "in-drivable-lane": 43.899999999998634, "deviation-heading": 6.044012594688198, "distance-from-start": 2.1721163975446953, "deviation-center-line": 1.0602759328266085, "driven_lanedir_consec": 2.514653001576349}, "loop2-000-ego1": {"driven_any": 11.549465065218318, "survival_time": 59.99999999999873, "driven_lanedir": 9.036570542930152, "in-drivable-lane": 6.949999999999844, "deviation-heading": 19.724833120292317, "distance-from-start": 1.6228978203958422, "deviation-center-line": 3.813517873092033, "driven_lanedir_consec": 9.036570542930152}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12404530Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:16:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.199999999999953
driven_lanedir_consec_median8.320274088521748
deviation-center-line_median2.549950497061826


other stats
deviation-center-line_max2.549950497061826
deviation-center-line_mean2.549950497061826
deviation-center-line_min2.549950497061826
deviation-heading_max13.126852586359613
deviation-heading_mean13.126852586359613
deviation-heading_median13.126852586359613
deviation-heading_min13.126852586359613
distance-from-start_max4.556305853230429
distance-from-start_mean4.556305853230429
distance-from-start_median4.556305853230429
distance-from-start_min4.556305853230429
driven_any_max8.977334305914763
driven_any_mean8.977334305914763
driven_any_median8.977334305914763
driven_any_min8.977334305914763
driven_lanedir_consec_max8.320274088521748
driven_lanedir_consec_mean8.320274088521748
driven_lanedir_consec_min8.320274088521748
driven_lanedir_max8.320274088521748
driven_lanedir_mean8.320274088521748
driven_lanedir_median8.320274088521748
driven_lanedir_min8.320274088521748
in-drivable-lane_max1.199999999999953
in-drivable-lane_mean1.199999999999953
in-drivable-lane_min1.199999999999953
per-episodes
details{"zigzag-000-ego0": {"driven_any": 8.977334305914763, "survival_time": 59.99999999999873, "driven_lanedir": 8.320274088521748, "in-drivable-lane": 1.199999999999953, "deviation-heading": 13.126852586359613, "distance-from-start": 4.556305853230429, "deviation-center-line": 2.549950497061826, "driven_lanedir_consec": 8.320274088521748}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12402531Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:01:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12398531Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12383535Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-testingsim-1of4successnodavinci-stage-01-6.2.500:19:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.5999999999999979
driven_lanedir_consec_median5.359945129625874
deviation-center-line_median2.797074554207498


other stats
deviation-center-line_max3.215355482924686
deviation-center-line_mean2.5989475182580497
deviation-center-line_min1.5862854816925165
deviation-heading_max37.82293240559152
deviation-heading_mean18.747757819417345
deviation-heading_median16.781748774486328
deviation-heading_min3.604601323105195
distance-from-start_max2.7916309189063746
distance-from-start_mean1.7082084038604508
distance-from-start_median2.0206013482677143
distance-from-start_min2.482534153247273e-16
driven_any_max10.749590711673504
driven_any_mean5.831708211311879
driven_any_median6.288621066786858
driven_any_min2.9790409838966753e-13
driven_lanedir_consec_max9.847292262319336
driven_lanedir_consec_mean5.141795630392772
driven_lanedir_consec_min0.0
driven_lanedir_max9.847292262319336
driven_lanedir_mean5.141795630392772
driven_lanedir_median5.359945129625874
driven_lanedir_min0.0
in-drivable-lane_max4.999999999999908
in-drivable-lane_mean1.5499999999999758
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 10.749473072019082, "survival_time": 59.99999999999873, "driven_lanedir": 8.937712730938049, "in-drivable-lane": 4.999999999999908, "deviation-heading": 17.301188530645998, "distance-from-start": 2.7916309189063746, "deviation-center-line": 2.831686487685343, "driven_lanedir_consec": 8.937712730938049}, "loop-000-ego1": {"driven_any": 10.749590711673504, "survival_time": 59.99999999999873, "driven_lanedir": 9.847292262319336, "in-drivable-lane": 1.1999999999999955, "deviation-heading": 16.262309018326658, "distance-from-start": 2.6407043806177697, "deviation-center-line": 3.215355482924686, "driven_lanedir_consec": 9.847292262319336}, "loop-000-ego2": {"driven_any": 1.8277690615546336, "survival_time": 59.99999999999873, "driven_lanedir": 1.782177528313699, "in-drivable-lane": 0.0, "deviation-heading": 3.604601323105195, "distance-from-start": 1.4004983159176585, "deviation-center-line": 1.5862854816925165, "driven_lanedir_consec": 1.782177528313699}, "loop-000-ego3": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 2.7624626207296523, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12379536Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-testingsim-1of4successnodavinci-stage-01-6.2.500:04:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median15.900000000000093
in-drivable-lane_median1.900000000000012
driven_lanedir_consec_median2.175604489772919
deviation-center-line_median0.8238065222487974


other stats
deviation-center-line_max0.8238065222487974
deviation-center-line_mean0.8238065222487974
deviation-center-line_min0.8238065222487974
deviation-heading_max5.232081473002006
deviation-heading_mean5.232081473002006
deviation-heading_median5.232081473002006
deviation-heading_min5.232081473002006
distance-from-start_max1.9983403439574363
distance-from-start_mean1.9983403439574363
distance-from-start_median1.9983403439574363
distance-from-start_min1.9983403439574363
driven_any_max2.7816327932339937
driven_any_mean2.7816327932339937
driven_any_median2.7816327932339937
driven_any_min2.7816327932339937
driven_lanedir_consec_max2.175604489772919
driven_lanedir_consec_mean2.175604489772919
driven_lanedir_consec_min2.175604489772919
driven_lanedir_max2.175604489772919
driven_lanedir_mean2.175604489772919
driven_lanedir_median2.175604489772919
driven_lanedir_min2.175604489772919
in-drivable-lane_max1.900000000000012
in-drivable-lane_mean1.900000000000012
in-drivable-lane_min1.900000000000012
per-episodes
details{"loop-000-ego0": {"driven_any": 2.7816327932339937, "survival_time": 15.900000000000093, "driven_lanedir": 2.175604489772919, "in-drivable-lane": 1.900000000000012, "deviation-heading": 5.232081473002006, "distance-from-start": 1.9983403439574363, "deviation-center-line": 0.8238065222487974, "driven_lanedir_consec": 2.175604489772919}}
simulation-passed1
survival_time_max15.900000000000093
survival_time_mean15.900000000000093
survival_time_min15.900000000000093
No reset possible
12375536Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:05:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median12.799999999999669
driven_lanedir_consec_median7.178798222047785
deviation-center-line_median3.903204792746733


other stats
deviation-center-line_max3.903204792746733
deviation-center-line_mean3.903204792746733
deviation-center-line_min3.903204792746733
deviation-heading_max20.145891521154457
deviation-heading_mean20.145891521154457
deviation-heading_median20.145891521154457
deviation-heading_min20.145891521154457
distance-from-start_max1.6126320924227435
distance-from-start_mean1.6126320924227435
distance-from-start_median1.6126320924227435
distance-from-start_min1.6126320924227435
driven_any_max10.960808918689256
driven_any_mean10.960808918689256
driven_any_median10.960808918689256
driven_any_min10.960808918689256
driven_lanedir_consec_max7.178798222047785
driven_lanedir_consec_mean7.178798222047785
driven_lanedir_consec_min7.178798222047785
driven_lanedir_max7.178798222047785
driven_lanedir_mean7.178798222047785
driven_lanedir_median7.178798222047785
driven_lanedir_min7.178798222047785
in-drivable-lane_max12.799999999999669
in-drivable-lane_mean12.799999999999669
in-drivable-lane_min12.799999999999669
per-episodes
details{"loop2-000-ego0": {"driven_any": 10.960808918689256, "survival_time": 59.99999999999873, "driven_lanedir": 7.178798222047785, "in-drivable-lane": 12.799999999999669, "deviation-heading": 20.145891521154457, "distance-from-start": 1.6126320924227435, "deviation-center-line": 3.903204792746733, "driven_lanedir_consec": 7.178798222047785}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12372536Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-testingsim-0of4host-errornodavinci-stage-01-6.2.500:00:30
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon' 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12370537Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-testingsim-1of4host-errornodavinci-stage-01-6.2.500:00:31
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: Get https://registry-stage2.duckietown.org/v2/token?account=duckietowndaemon&client_id=docker&offline_token=true&service=registry-stage2.duckietown.org: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon' 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12369537Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-testingsim-3of4host-errornodavinci-stage-01-6.2.500:00:37
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: Get https://registry-stage2.duckietown.org/v2/token?account=duckietowndaemon&client_id=docker&offline_token=true&service=registry-stage2.duckietown.org: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon' 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12361539Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-testingsim-1of4successnodavinci-stage-01-6.2.500:03:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median18.70000000000013
in-drivable-lane_median0.0
driven_lanedir_consec_median3.18898913896116
deviation-center-line_median1.2467392937615498


other stats
deviation-center-line_max1.2467392937615498
deviation-center-line_mean1.2467392937615498
deviation-center-line_min1.2467392937615498
deviation-heading_max5.209216545276964
deviation-heading_mean5.209216545276964
deviation-heading_median5.209216545276964
deviation-heading_min5.209216545276964
distance-from-start_max1.9166367940476343
distance-from-start_mean1.9166367940476343
distance-from-start_median1.9166367940476343
distance-from-start_min1.9166367940476343
driven_any_max3.3666118426924916
driven_any_mean3.3666118426924916
driven_any_median3.3666118426924916
driven_any_min3.3666118426924916
driven_lanedir_consec_max3.18898913896116
driven_lanedir_consec_mean3.18898913896116
driven_lanedir_consec_min3.18898913896116
driven_lanedir_max3.203595637386103
driven_lanedir_mean3.203595637386103
driven_lanedir_median3.203595637386103
driven_lanedir_min3.203595637386103
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-000-ego0": {"driven_any": 3.3666118426924916, "survival_time": 18.70000000000013, "driven_lanedir": 3.203595637386103, "in-drivable-lane": 0.0, "deviation-heading": 5.209216545276964, "distance-from-start": 1.9166367940476343, "deviation-center-line": 1.2467392937615498, "driven_lanedir_consec": 3.18898913896116}}
simulation-passed1
survival_time_max18.70000000000013
survival_time_mean18.70000000000013
survival_time_min18.70000000000013
No reset possible
12358539Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:02:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12350541Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-testingsim-0of4successnodavinci-stage-01-6.2.500:06:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.460478967330891
survival_time_median59.99999999999873
deviation-center-line_median2.4127056348699227
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.4127056348699227
deviation-center-line_mean2.4127056348699227
deviation-center-line_min2.4127056348699227
deviation-heading_max12.073446987984315
deviation-heading_mean12.073446987984315
deviation-heading_median12.073446987984315
deviation-heading_min12.073446987984315
distance-from-start_max4.0529703260672045
distance-from-start_mean4.0529703260672045
distance-from-start_median4.0529703260672045
distance-from-start_min4.0529703260672045
driven_any_max8.819940156165249
driven_any_mean8.819940156165249
driven_any_median8.819940156165249
driven_any_min8.819940156165249
driven_lanedir_consec_max8.460478967330891
driven_lanedir_consec_mean8.460478967330891
driven_lanedir_consec_min8.460478967330891
driven_lanedir_max8.460478967330891
driven_lanedir_mean8.460478967330891
driven_lanedir_median8.460478967330891
driven_lanedir_min8.460478967330891
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 8.819940156165249, "survival_time": 59.99999999999873, "driven_lanedir": 8.460478967330891, "in-drivable-lane": 0.0, "deviation-heading": 12.073446987984315, "distance-from-start": 4.0529703260672045, "deviation-center-line": 2.4127056348699227, "driven_lanedir_consec": 8.460478967330891}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12345542Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:01:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12342595Liam Paullbaseline-duckietownaido-LF-sim-validationsim-0of4failednodavinci-stage-01-6.2.500:01:00
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12338599Liam Paulltemplate-randomaido-hello-sim-validationsanity-checksuccessnodavinci-stage-01-6.2.500:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.007457570166591001


other stats
deviation-center-line_max0.007457570166591001
deviation-center-line_mean0.007457570166591001
deviation-center-line_min0.007457570166591001
deviation-heading_max0.1966171946901932
deviation-heading_mean0.1966171946901932
deviation-heading_median0.1966171946901932
deviation-heading_min0.1966171946901932
distance-from-start_max5.551115123125783e-17
distance-from-start_mean5.551115123125783e-17
distance-from-start_median5.551115123125783e-17
distance-from-start_min5.551115123125783e-17
driven_any_max8.413744284337043e-16
driven_any_mean8.413744284337043e-16
driven_any_median8.413744284337043e-16
driven_any_min8.413744284337043e-16
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 8.413744284337043e-16, "survival_time": 0.49999999999999994, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 0.1966171946901932, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.007457570166591001, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
12334600Liam Paulltemplate-tensorflowaido-LF-sim-validationsim-2of4host-errornodavinci-stage-01-6.2.500:01:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: Get https://registry-stage2.duckietown.org/v2/token?account=duckietowndaemon&client_id=docker&offline_token=true&service=registry-stage2.duckietown.org: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) (Client.Timeout exceeded while awaiting headers)")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon' 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12331600Liam Paulltemplate-tensorflowaido-LF-sim-validationsim-1of4failednodavinci-stage-01-6.2.500:02:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12325606Bea Baselines 🐤template-rosaido-LFVI-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:02:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.3499999999999996
in-drivable-lane_median0.899999999999999
driven_lanedir_consec_median0.29209897366604887
deviation-center-line_median0.11968971845759342


other stats
deviation-center-line_max0.11968971845759342
deviation-center-line_mean0.11968971845759342
deviation-center-line_min0.11968971845759342
deviation-heading_max0.6060773140665514
deviation-heading_mean0.6060773140665514
deviation-heading_median0.6060773140665514
deviation-heading_min0.6060773140665514
distance-from-start_max0.3828615371240688
distance-from-start_mean0.3828615371240688
distance-from-start_median0.3828615371240688
distance-from-start_min0.3828615371240688
driven_any_max0.38413627812344464
driven_any_mean0.38413627812344464
driven_any_median0.38413627812344464
driven_any_min0.38413627812344464
driven_lanedir_consec_max0.29209897366604887
driven_lanedir_consec_mean0.29209897366604887
driven_lanedir_consec_min0.29209897366604887
driven_lanedir_max0.29209897366604887
driven_lanedir_mean0.29209897366604887
driven_lanedir_median0.29209897366604887
driven_lanedir_min0.29209897366604887
in-drivable-lane_max0.899999999999999
in-drivable-lane_mean0.899999999999999
in-drivable-lane_min0.899999999999999
per-episodes
details{"udem-000-ego0": {"driven_any": 0.38413627812344464, "survival_time": 2.3499999999999996, "driven_lanedir": 0.29209897366604887, "in-drivable-lane": 0.899999999999999, "deviation-heading": 0.6060773140665514, "distance-from-start": 0.3828615371240688, "deviation-center-line": 0.11968971845759342, "driven_lanedir_consec": 0.29209897366604887}}
simulation-passed1
survival_time_max2.3499999999999996
survival_time_mean2.3499999999999996
survival_time_min2.3499999999999996
No reset possible
12320604Bea Baselines 🐤template-rosaido-LFP-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:02:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.099999999999986
in-drivable-lane_median5.149999999999986
driven_lanedir_consec_median0.11840186037067556
deviation-center-line_median0.05283014619837831


other stats
deviation-center-line_max0.05283014619837831
deviation-center-line_mean0.05283014619837831
deviation-center-line_min0.05283014619837831
deviation-heading_max0.6707715756231242
deviation-heading_mean0.6707715756231242
deviation-heading_median0.6707715756231242
deviation-heading_min0.6707715756231242
distance-from-start_max1.4186406886261014
distance-from-start_mean1.4186406886261014
distance-from-start_median1.4186406886261014
distance-from-start_min1.4186406886261014
driven_any_max1.5287011836332942
driven_any_mean1.5287011836332942
driven_any_median1.5287011836332942
driven_any_min1.5287011836332942
driven_lanedir_consec_max0.11840186037067556
driven_lanedir_consec_mean0.11840186037067556
driven_lanedir_consec_min0.11840186037067556
driven_lanedir_max0.11840186037067556
driven_lanedir_mean0.11840186037067556
driven_lanedir_median0.11840186037067556
driven_lanedir_min0.11840186037067556
in-drivable-lane_max5.149999999999986
in-drivable-lane_mean5.149999999999986
in-drivable-lane_min5.149999999999986
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.5287011836332942, "survival_time": 6.099999999999986, "driven_lanedir": 0.11840186037067556, "in-drivable-lane": 5.149999999999986, "deviation-heading": 0.6707715756231242, "distance-from-start": 1.4186406886261014, "deviation-center-line": 0.05283014619837831, "driven_lanedir_consec": 0.11840186037067556}}
simulation-passed1
survival_time_max6.099999999999986
survival_time_mean6.099999999999986
survival_time_min6.099999999999986
No reset possible
12316604Bea Baselines 🐤template-rosaido-LFP-sim-validationsim-2of4host-errornodavinci-stage-01-6.2.500:00:40
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon' 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12311607Bea Baselines 🐤template-rosaido-LFI-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:02:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12307606Bea Baselines 🐤template-rosaido-LFVI-sim-validationsim-3of4host-errornodavinci-stage-01-6.2.500:01:36
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon' 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12299609Bea Baselines 🐤template-rosaido-LFVI_multi-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:04:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.94999999999998
in-drivable-lane_median6.124999999999981
driven_lanedir_consec_median0.2997694313848607
deviation-center-line_median0.15166987767366802


other stats
deviation-center-line_max1.023965618633002
deviation-center-line_mean0.353151395879437
deviation-center-line_min0.08530020953740998
deviation-heading_max2.0857174766586306
deviation-heading_mean1.152345857192849
deviation-heading_median0.9728692949794552
deviation-heading_min0.5779273621538558
distance-from-start_max1.8435331593008104
distance-from-start_mean0.9242391872983032
distance-from-start_median0.7358334699603968
distance-from-start_min0.381756649971608
driven_any_max1.997353719329123
driven_any_mean0.969090895728088
driven_any_median0.7484778112695731
driven_any_min0.3820542410440824
driven_lanedir_consec_max0.4776125229742836
driven_lanedir_consec_mean0.3130314215818218
driven_lanedir_consec_min0.17497430058328223
driven_lanedir_max0.4776125229742836
driven_lanedir_mean0.3130314215818218
driven_lanedir_median0.2997694313848607
driven_lanedir_min0.17497430058328223
in-drivable-lane_max6.799999999999979
in-drivable-lane_mean4.762499999999985
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 0.6982195113107578, "survival_time": 7.94999999999998, "driven_lanedir": 0.2356944300367676, "in-drivable-lane": 6.74999999999998, "deviation-heading": 0.5894823001641477, "distance-from-start": 0.6924272788351895, "deviation-center-line": 0.08530020953740998, "driven_lanedir_consec": 0.2356944300367676}, "udem-000-ego1": {"driven_any": 0.7987361112283885, "survival_time": 7.94999999999998, "driven_lanedir": 0.17497430058328223, "in-drivable-lane": 6.799999999999979, "deviation-heading": 0.5779273621538558, "distance-from-start": 0.7792396610856039, "deviation-center-line": 0.10409188683076752, "driven_lanedir_consec": 0.17497430058328223}, "udem-000-ego2": {"driven_any": 0.3820542410440824, "survival_time": 7.94999999999998, "driven_lanedir": 0.36384443273295375, "in-drivable-lane": 0.0, "deviation-heading": 2.0857174766586306, "distance-from-start": 0.381756649971608, "deviation-center-line": 1.023965618633002, "driven_lanedir_consec": 0.36384443273295375}, "udem-000-ego3": {"driven_any": 1.997353719329123, "survival_time": 7.94999999999998, "driven_lanedir": 0.4776125229742836, "in-drivable-lane": 5.499999999999983, "deviation-heading": 1.3562562897947628, "distance-from-start": 1.8435331593008104, "deviation-center-line": 0.19924786851656853, "driven_lanedir_consec": 0.4776125229742836}}
simulation-passed1
survival_time_max7.94999999999998
survival_time_mean7.94999999999998
survival_time_min7.94999999999998
No reset possible
12297609Bea Baselines 🐤template-rosaido-LFVI_multi-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12292611Bea Baselines 🐤template-rosaido-LFP-sim-testingsim-1of4successnodavinci-stage-01-6.2.500:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.399999999999984
in-drivable-lane_median6.449999999999988
driven_lanedir_consec_median0.20559332221029103
deviation-center-line_median0.15802124436296783


other stats
deviation-center-line_max0.15802124436296783
deviation-center-line_mean0.15802124436296783
deviation-center-line_min0.15802124436296783
deviation-heading_max1.8852716066048203
deviation-heading_mean1.8852716066048203
deviation-heading_median1.8852716066048203
deviation-heading_min1.8852716066048203
distance-from-start_max1.855259289632322
distance-from-start_mean1.855259289632322
distance-from-start_median1.855259289632322
distance-from-start_min1.855259289632322
driven_any_max2.046792482001477
driven_any_mean2.046792482001477
driven_any_median2.046792482001477
driven_any_min2.046792482001477
driven_lanedir_consec_max0.20559332221029103
driven_lanedir_consec_mean0.20559332221029103
driven_lanedir_consec_min0.20559332221029103
driven_lanedir_max0.20559332221029103
driven_lanedir_mean0.20559332221029103
driven_lanedir_median0.20559332221029103
driven_lanedir_min0.20559332221029103
in-drivable-lane_max6.449999999999988
in-drivable-lane_mean6.449999999999988
in-drivable-lane_min6.449999999999988
per-episodes
details{"loop-000-ego0": {"driven_any": 2.046792482001477, "survival_time": 8.399999999999984, "driven_lanedir": 0.20559332221029103, "in-drivable-lane": 6.449999999999988, "deviation-heading": 1.8852716066048203, "distance-from-start": 1.855259289632322, "deviation-center-line": 0.15802124436296783, "driven_lanedir_consec": 0.20559332221029103}}
simulation-passed1
survival_time_max8.399999999999984
survival_time_mean8.399999999999984
survival_time_min8.399999999999984
No reset possible
12287612Bea Baselines 🐤template-rosaido-LFV-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:02:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.449999999999989
in-drivable-lane_median4.649999999999989
driven_lanedir_consec_median0.09301898993202144
deviation-center-line_median0.052619990338786296


other stats
deviation-center-line_max0.052619990338786296
deviation-center-line_mean0.052619990338786296
deviation-center-line_min0.052619990338786296
deviation-heading_max0.6529913530949109
deviation-heading_mean0.6529913530949109
deviation-heading_median0.6529913530949109
deviation-heading_min0.6529913530949109
distance-from-start_max1.3117237103247696
distance-from-start_mean1.3117237103247696
distance-from-start_median1.3117237103247696
distance-from-start_min1.3117237103247696
driven_any_max1.3652946759239208
driven_any_mean1.3652946759239208
driven_any_median1.3652946759239208
driven_any_min1.3652946759239208
driven_lanedir_consec_max0.09301898993202144
driven_lanedir_consec_mean0.09301898993202144
driven_lanedir_consec_min0.09301898993202144
driven_lanedir_max0.09301898993202144
driven_lanedir_mean0.09301898993202144
driven_lanedir_median0.09301898993202144
driven_lanedir_min0.09301898993202144
in-drivable-lane_max4.649999999999989
in-drivable-lane_mean4.649999999999989
in-drivable-lane_min4.649999999999989
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.3652946759239208, "survival_time": 5.449999999999989, "driven_lanedir": 0.09301898993202144, "in-drivable-lane": 4.649999999999989, "deviation-heading": 0.6529913530949109, "distance-from-start": 1.3117237103247696, "deviation-center-line": 0.052619990338786296, "driven_lanedir_consec": 0.09301898993202144}}
simulation-passed1
survival_time_max5.449999999999989
survival_time_mean5.449999999999989
survival_time_min5.449999999999989
No reset possible
12279613Bea Baselines 🐤template-rosaido-LFVI-sim-testingsim-1of4successnodavinci-stage-01-6.2.500:02:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.649999999999984
in-drivable-lane_median5.5999999999999845
driven_lanedir_consec_median0.16184244330135122
deviation-center-line_median0.07397809771289268


other stats
deviation-center-line_max0.07397809771289268
deviation-center-line_mean0.07397809771289268
deviation-center-line_min0.07397809771289268
deviation-heading_max0.6551662415570124
deviation-heading_mean0.6551662415570124
deviation-heading_median0.6551662415570124
deviation-heading_min0.6551662415570124
distance-from-start_max1.4347403131063814
distance-from-start_mean1.4347403131063814
distance-from-start_median1.4347403131063814
distance-from-start_min1.4347403131063814
driven_any_max1.71590800760084
driven_any_mean1.71590800760084
driven_any_median1.71590800760084
driven_any_min1.71590800760084
driven_lanedir_consec_max0.16184244330135122
driven_lanedir_consec_mean0.16184244330135122
driven_lanedir_consec_min0.16184244330135122
driven_lanedir_max0.16184244330135122
driven_lanedir_mean0.16184244330135122
driven_lanedir_median0.16184244330135122
driven_lanedir_min0.16184244330135122
in-drivable-lane_max5.5999999999999845
in-drivable-lane_mean5.5999999999999845
in-drivable-lane_min5.5999999999999845
per-episodes
details{"4way-000-ego0": {"driven_any": 1.71590800760084, "survival_time": 6.649999999999984, "driven_lanedir": 0.16184244330135122, "in-drivable-lane": 5.5999999999999845, "deviation-heading": 0.6551662415570124, "distance-from-start": 1.4347403131063814, "deviation-center-line": 0.07397809771289268, "driven_lanedir_consec": 0.16184244330135122}}
simulation-passed1
survival_time_max6.649999999999984
survival_time_mean6.649999999999984
survival_time_min6.649999999999984
No reset possible
12277614Bea Baselines 🐤template-rosaido-LFI-sim-testingsim-1of4successnodavinci-stage-01-6.2.500:02:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.6499999999999915
in-drivable-lane_median3.749999999999991
driven_lanedir_consec_median0.11182432775986496
deviation-center-line_median0.0611834096180453


other stats
deviation-center-line_max0.0611834096180453
deviation-center-line_mean0.0611834096180453
deviation-center-line_min0.0611834096180453
deviation-heading_max0.6897892177062237
deviation-heading_mean0.6897892177062237
deviation-heading_median0.6897892177062237
deviation-heading_min0.6897892177062237
distance-from-start_max1.037862501189461
distance-from-start_mean1.037862501189461
distance-from-start_median1.037862501189461
distance-from-start_min1.037862501189461
driven_any_max1.0475492200869834
driven_any_mean1.0475492200869834
driven_any_median1.0475492200869834
driven_any_min1.0475492200869834
driven_lanedir_consec_max0.11182432775986496
driven_lanedir_consec_mean0.11182432775986496
driven_lanedir_consec_min0.11182432775986496
driven_lanedir_max0.11182432775986496
driven_lanedir_mean0.11182432775986496
driven_lanedir_median0.11182432775986496
driven_lanedir_min0.11182432775986496
in-drivable-lane_max3.749999999999991
in-drivable-lane_mean3.749999999999991
in-drivable-lane_min3.749999999999991
per-episodes
details{"udem1-000-ego0": {"driven_any": 1.0475492200869834, "survival_time": 4.6499999999999915, "driven_lanedir": 0.11182432775986496, "in-drivable-lane": 3.749999999999991, "deviation-heading": 0.6897892177062237, "distance-from-start": 1.037862501189461, "deviation-center-line": 0.0611834096180453, "driven_lanedir_consec": 0.11182432775986496}}
simulation-passed1
survival_time_max4.6499999999999915
survival_time_mean4.6499999999999915
survival_time_min4.6499999999999915
No reset possible
12270618Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:08:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median35.449999999999214
driven_lanedir_consec_median1.9688303395588675
deviation-center-line_median1.4972480829484551


other stats
deviation-center-line_max2.087000974196729
deviation-center-line_mean1.4972480829484551
deviation-center-line_min0.9074951917001812
deviation-heading_max13.290016116794272
deviation-heading_mean8.19820926527002
deviation-heading_median8.19820926527002
deviation-heading_min3.1064024137457693
distance-from-start_max1.5227025621674375
distance-from-start_mean1.4755138627787676
distance-from-start_median1.4755138627787676
distance-from-start_min1.4283251633900975
driven_any_max7.907334159087509
driven_any_mean5.859590509740617
driven_any_median5.859590509740617
driven_any_min3.811846860393725
driven_lanedir_consec_max3.081963651669268
driven_lanedir_consec_mean1.9688303395588675
driven_lanedir_consec_min0.8556970274484672
driven_lanedir_max4.6334656999825174
driven_lanedir_mean2.8338862425713423
driven_lanedir_median2.8338862425713423
driven_lanedir_min1.0343067851601673
in-drivable-lane_max50.94999999999872
in-drivable-lane_mean35.449999999999214
in-drivable-lane_min19.949999999999704
per-episodes
details{"loop2-000-ego0": {"driven_any": 7.907334159087509, "survival_time": 59.99999999999873, "driven_lanedir": 4.6334656999825174, "in-drivable-lane": 19.949999999999704, "deviation-heading": 13.290016116794272, "distance-from-start": 1.4283251633900975, "deviation-center-line": 2.087000974196729, "driven_lanedir_consec": 3.081963651669268}, "loop2-000-ego1": {"driven_any": 3.811846860393725, "survival_time": 59.99999999999873, "driven_lanedir": 1.0343067851601673, "in-drivable-lane": 50.94999999999872, "deviation-heading": 3.1064024137457693, "distance-from-start": 1.5227025621674375, "deviation-center-line": 0.9074951917001812, "driven_lanedir_consec": 0.8556970274484672}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12268616Bea Baselines 🐤template-rosaido-LFVI_multi-sim-testingsim-3of4host-errornodavinci-stage-01-6.2.500:02:55
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon' 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12263618Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:09:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median55.54999999999898
in-drivable-lane_median16.524999999999523
driven_lanedir_consec_median2.97907700469581
deviation-center-line_median2.801198930021873


other stats
deviation-center-line_max3.67294062394079
deviation-center-line_mean2.801198930021873
deviation-center-line_min1.9294572361029567
deviation-heading_max10.650271021555657
deviation-heading_mean10.608801765820646
deviation-heading_median10.608801765820646
deviation-heading_min10.567332510085636
distance-from-start_max1.506615861973983
distance-from-start_mean1.4505273302912172
distance-from-start_median1.4505273302912172
distance-from-start_min1.3944387986084514
driven_any_max7.2303858742636224
driven_any_mean7.230327472449357
driven_any_median7.230327472449357
driven_any_min7.230269070635091
driven_lanedir_consec_max3.204559096873821
driven_lanedir_consec_mean2.97907700469581
driven_lanedir_consec_min2.7535949125177988
driven_lanedir_max5.011970127403921
driven_lanedir_mean4.656537818430289
driven_lanedir_median4.656537818430289
driven_lanedir_min4.301105509456658
in-drivable-lane_max19.549999999999542
in-drivable-lane_mean16.524999999999523
in-drivable-lane_min13.4999999999995
per-episodes
details{"loop2-000-ego0": {"driven_any": 7.230269070635091, "survival_time": 55.54999999999898, "driven_lanedir": 4.301105509456658, "in-drivable-lane": 19.549999999999542, "deviation-heading": 10.650271021555657, "distance-from-start": 1.3944387986084514, "deviation-center-line": 1.9294572361029567, "driven_lanedir_consec": 2.7535949125177988}, "loop2-000-ego1": {"driven_any": 7.2303858742636224, "survival_time": 55.54999999999898, "driven_lanedir": 5.011970127403921, "in-drivable-lane": 13.4999999999995, "deviation-heading": 10.567332510085636, "distance-from-start": 1.506615861973983, "deviation-center-line": 3.67294062394079, "driven_lanedir_consec": 3.204559096873821}}
simulation-passed1
survival_time_max55.54999999999898
survival_time_mean55.54999999999898
survival_time_min55.54999999999898
No reset possible
12259619Bea Baselines 🐤baseline-duckietownaido-LFP-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:05:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median50.69999999999926
in-drivable-lane_median1.249999999999929
driven_lanedir_consec_median6.221519581278283
deviation-center-line_median3.241871153356938


other stats
deviation-center-line_max3.241871153356938
deviation-center-line_mean3.241871153356938
deviation-center-line_min3.241871153356938
deviation-heading_max9.30450277429399
deviation-heading_mean9.30450277429399
deviation-heading_median9.30450277429399
deviation-heading_min9.30450277429399
distance-from-start_max3.0924930156044472
distance-from-start_mean3.0924930156044472
distance-from-start_median3.0924930156044472
distance-from-start_min3.0924930156044472
driven_any_max6.586759765649965
driven_any_mean6.586759765649965
driven_any_median6.586759765649965
driven_any_min6.586759765649965
driven_lanedir_consec_max6.221519581278283
driven_lanedir_consec_mean6.221519581278283
driven_lanedir_consec_min6.221519581278283
driven_lanedir_max6.221519581278283
driven_lanedir_mean6.221519581278283
driven_lanedir_median6.221519581278283
driven_lanedir_min6.221519581278283
in-drivable-lane_max1.249999999999929
in-drivable-lane_mean1.249999999999929
in-drivable-lane_min1.249999999999929
per-episodes
details{"zigzag-000-ego0": {"driven_any": 6.586759765649965, "survival_time": 50.69999999999926, "driven_lanedir": 6.221519581278283, "in-drivable-lane": 1.249999999999929, "deviation-heading": 9.30450277429399, "distance-from-start": 3.0924930156044472, "deviation-center-line": 3.241871153356938, "driven_lanedir_consec": 6.221519581278283}}
simulation-passed1
survival_time_max50.69999999999926
survival_time_mean50.69999999999926
survival_time_min50.69999999999926
No reset possible
12249621Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-validationsim-1of4successnodavinci-stage-01-6.2.500:07:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median27.450000000000255
in-drivable-lane_median7.400000000000089
driven_lanedir_consec_median1.1183390563648243
deviation-center-line_median1.596899480123442


other stats
deviation-center-line_max1.596899480123442
deviation-center-line_mean1.596899480123442
deviation-center-line_min1.596899480123442
deviation-heading_max9.8956799404345
deviation-heading_mean9.8956799404345
deviation-heading_median9.8956799404345
deviation-heading_min9.8956799404345
distance-from-start_max0.7327259608678879
distance-from-start_mean0.7327259608678879
distance-from-start_median0.7327259608678879
distance-from-start_min0.7327259608678879
driven_any_max3.4990096243659954
driven_any_mean3.4990096243659954
driven_any_median3.4990096243659954
driven_any_min3.4990096243659954
driven_lanedir_consec_max1.1183390563648243
driven_lanedir_consec_mean1.1183390563648243
driven_lanedir_consec_min1.1183390563648243
driven_lanedir_max2.095266715498483
driven_lanedir_mean2.095266715498483
driven_lanedir_median2.095266715498483
driven_lanedir_min2.095266715498483
in-drivable-lane_max7.400000000000089
in-drivable-lane_mean7.400000000000089
in-drivable-lane_min7.400000000000089
per-episodes
details{"4way-000-ego0": {"driven_any": 3.4990096243659954, "survival_time": 27.450000000000255, "driven_lanedir": 2.095266715498483, "in-drivable-lane": 7.400000000000089, "deviation-heading": 9.8956799404345, "distance-from-start": 0.7327259608678879, "deviation-center-line": 1.596899480123442, "driven_lanedir_consec": 1.1183390563648243}}
simulation-passed1
survival_time_max27.450000000000255
survival_time_mean27.450000000000255
survival_time_min27.450000000000255
No reset possible
12238625Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-testingsim-1of4successnodavinci-stage-01-6.2.500:20:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median6.749999999999737
driven_lanedir_consec_median2.7103209740014127
deviation-center-line_median4.072418184619559


other stats
deviation-center-line_max5.3473582100869965
deviation-center-line_mean4.063664300013942
deviation-center-line_min2.7624626207296523
deviation-heading_max37.82293240559152
deviation-heading_mean22.303353966529563
deviation-heading_median18.6847856380791
deviation-heading_min14.020912184368544
distance-from-start_max2.2241084463503396
distance-from-start_mean1.399777069986493
distance-from-start_median1.6874999167978169
distance-from-start_min2.482534153247273e-16
driven_any_max7.914014565586578
driven_any_mean4.436881526628344
driven_any_median4.91675577046325
driven_any_min2.9790409838966753e-13
driven_lanedir_consec_max4.678244947047636
driven_lanedir_consec_mean2.5247217237626156
driven_lanedir_consec_min0.0
driven_lanedir_max5.943924857839957
driven_lanedir_mean3.2104519756145056
driven_lanedir_median3.4489415223090325
driven_lanedir_min0.0
in-drivable-lane_max14.64999999999958
in-drivable-lane_mean7.037499999999763
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 7.914014565586578, "survival_time": 59.99999999999873, "driven_lanedir": 5.943924857839957, "in-drivable-lane": 10.99999999999944, "deviation-heading": 14.020912184368544, "distance-from-start": 2.013015343242682, "deviation-center-line": 3.045299193925892, "driven_lanedir_consec": 3.992408213544538}, "loop-000-ego1": {"driven_any": 7.913847076655591, "survival_time": 59.99999999999873, "driven_lanedir": 5.469649310159777, "in-drivable-lane": 14.64999999999958, "deviation-heading": 14.829745804406686, "distance-from-start": 2.2241084463503396, "deviation-center-line": 5.099537175313225, "driven_lanedir_consec": 4.678244947047636}, "loop-000-ego2": {"driven_any": 1.919664464270908, "survival_time": 59.99999999999873, "driven_lanedir": 1.4282337344582876, "in-drivable-lane": 2.5000000000000355, "deviation-heading": 22.53982547175151, "distance-from-start": 1.3619844903529517, "deviation-center-line": 5.3473582100869965, "driven_lanedir_consec": 1.4282337344582876}, "loop-000-ego3": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 2.7624626207296523, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12234626Bea Baselines 🐤baseline-duckietownaido-LFP-sim-testingsim-1of4successnodavinci-stage-01-6.2.500:03:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median27.300000000000253
in-drivable-lane_median5.600000000000042
driven_lanedir_consec_median2.678203105308887
deviation-center-line_median1.9955420474294776


other stats
deviation-center-line_max1.9955420474294776
deviation-center-line_mean1.9955420474294776
deviation-center-line_min1.9955420474294776
deviation-heading_max3.3734856550212453
deviation-heading_mean3.3734856550212453
deviation-heading_median3.3734856550212453
deviation-heading_min3.3734856550212453
distance-from-start_max2.0019591441340587
distance-from-start_mean2.0019591441340587
distance-from-start_median2.0019591441340587
distance-from-start_min2.0019591441340587
driven_any_max3.479968362633859
driven_any_mean3.479968362633859
driven_any_median3.479968362633859
driven_any_min3.479968362633859
driven_lanedir_consec_max2.678203105308887
driven_lanedir_consec_mean2.678203105308887
driven_lanedir_consec_min2.678203105308887
driven_lanedir_max2.678203105308887
driven_lanedir_mean2.678203105308887
driven_lanedir_median2.678203105308887
driven_lanedir_min2.678203105308887
in-drivable-lane_max5.600000000000042
in-drivable-lane_mean5.600000000000042
in-drivable-lane_min5.600000000000042
per-episodes
details{"loop-000-ego0": {"driven_any": 3.479968362633859, "survival_time": 27.300000000000253, "driven_lanedir": 2.678203105308887, "in-drivable-lane": 5.600000000000042, "deviation-heading": 3.3734856550212453, "distance-from-start": 2.0019591441340587, "deviation-center-line": 1.9955420474294776, "driven_lanedir_consec": 2.678203105308887}}
simulation-passed1
survival_time_max27.300000000000253
survival_time_mean27.300000000000253
survival_time_min27.300000000000253
No reset possible
12229627Bea Baselines 🐤baseline-duckietownaido-LFV-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:05:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median51.099999999999234
in-drivable-lane_median1.599999999999998
driven_lanedir_consec_median6.212126012967792
deviation-center-line_median3.790689527444141


other stats
deviation-center-line_max3.790689527444141
deviation-center-line_mean3.790689527444141
deviation-center-line_min3.790689527444141
deviation-heading_max8.52506988404326
deviation-heading_mean8.52506988404326
deviation-heading_median8.52506988404326
deviation-heading_min8.52506988404326
distance-from-start_max1.0157467714214152
distance-from-start_mean1.0157467714214152
distance-from-start_median1.0157467714214152
distance-from-start_min1.0157467714214152
driven_any_max6.639703258578546
driven_any_mean6.639703258578546
driven_any_median6.639703258578546
driven_any_min6.639703258578546
driven_lanedir_consec_max6.212126012967792
driven_lanedir_consec_mean6.212126012967792
driven_lanedir_consec_min6.212126012967792
driven_lanedir_max6.212126012967792
driven_lanedir_mean6.212126012967792
driven_lanedir_median6.212126012967792
driven_lanedir_min6.212126012967792
in-drivable-lane_max1.599999999999998
in-drivable-lane_mean1.599999999999998
in-drivable-lane_min1.599999999999998
per-episodes
details{"loop2-000-ego0": {"driven_any": 6.639703258578546, "survival_time": 51.099999999999234, "driven_lanedir": 6.212126012967792, "in-drivable-lane": 1.599999999999998, "deviation-heading": 8.52506988404326, "distance-from-start": 1.0157467714214152, "deviation-center-line": 3.790689527444141, "driven_lanedir_consec": 6.212126012967792}}
simulation-passed1
survival_time_max51.099999999999234
survival_time_mean51.099999999999234
survival_time_min51.099999999999234
No reset possible
12225628Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12220630Bea Baselines 🐤baseline-duckietownaido-LF-sim-testingsim-1of4successnodavinci-stage-01-6.2.500:06:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.339735965190632
survival_time_median59.99999999999873
deviation-center-line_median3.926748957741339
in-drivable-lane_median10.89999999999977


other stats
deviation-center-line_max3.926748957741339
deviation-center-line_mean3.926748957741339
deviation-center-line_min3.926748957741339
deviation-heading_max6.119299803625427
deviation-heading_mean6.119299803625427
deviation-heading_median6.119299803625427
deviation-heading_min6.119299803625427
distance-from-start_max2.488869201271096
distance-from-start_mean2.488869201271096
distance-from-start_median2.488869201271096
distance-from-start_min2.488869201271096
driven_any_max7.907908973833881
driven_any_mean7.907908973833881
driven_any_median7.907908973833881
driven_any_min7.907908973833881
driven_lanedir_consec_max6.339735965190632
driven_lanedir_consec_mean6.339735965190632
driven_lanedir_consec_min6.339735965190632
driven_lanedir_max6.339735965190632
driven_lanedir_mean6.339735965190632
driven_lanedir_median6.339735965190632
driven_lanedir_min6.339735965190632
in-drivable-lane_max10.89999999999977
in-drivable-lane_mean10.89999999999977
in-drivable-lane_min10.89999999999977
per-episodes
details{"loop-000-ego0": {"driven_any": 7.907908973833881, "survival_time": 59.99999999999873, "driven_lanedir": 6.339735965190632, "in-drivable-lane": 10.89999999999977, "deviation-heading": 6.119299803625427, "distance-from-start": 2.488869201271096, "deviation-center-line": 3.926748957741339, "driven_lanedir_consec": 6.339735965190632}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12213631Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-testingsim-0of4successnodavinci-stage-01-6.2.500:04:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.949999999999992
in-drivable-lane_median2.574999999999999
driven_lanedir_consec_median0.4103209454490069
deviation-center-line_median0.4450667228841798


other stats
deviation-center-line_max0.9003650564338647
deviation-center-line_mean0.4809998532889378
deviation-center-line_min0.1335009109535268
deviation-heading_max4.338684852850408
deviation-heading_mean2.5753639777226716
deviation-heading_median2.2096132703295863
deviation-heading_min1.5435445173811055
distance-from-start_max1.0094665054589416
distance-from-start_mean0.549874672367663
distance-from-start_median0.423156277975559
distance-from-start_min0.3437196280605923
driven_any_max1.043573045205194
driven_any_mean0.7132434522260762
driven_any_median0.6717327099491572
driven_any_min0.465935343800797
driven_lanedir_consec_max1.0085164096313155
driven_lanedir_consec_mean0.5415856834790703
driven_lanedir_consec_min0.3371844333869518
driven_lanedir_max1.0085164096313155
driven_lanedir_mean0.5415866145654681
driven_lanedir_median0.4103228076218024
driven_lanedir_min0.3371844333869518
in-drivable-lane_max5.599999999999996
in-drivable-lane_mean2.6874999999999982
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 0.850887350076483, "survival_time": 8.949999999999992, "driven_lanedir": 0.3371844333869518, "in-drivable-lane": 5.599999999999996, "deviation-heading": 1.5435445173811055, "distance-from-start": 0.3437196280605923, "deviation-center-line": 0.1335009109535268, "driven_lanedir_consec": 0.3371844333869518}, "udem-000-ego1": {"driven_any": 1.043573045205194, "survival_time": 8.949999999999992, "driven_lanedir": 1.0085164096313155, "in-drivable-lane": 0.0, "deviation-heading": 1.9614587675389543, "distance-from-start": 1.0094665054589416, "deviation-center-line": 0.9003650564338647, "driven_lanedir_consec": 1.0085164096313155}, "udem-000-ego2": {"driven_any": 0.4925780698218314, "survival_time": 8.949999999999992, "driven_lanedir": 0.473753994378928, "in-drivable-lane": 0.0, "deviation-heading": 4.338684852850408, "distance-from-start": 0.4768939894267785, "deviation-center-line": 0.5151431390426636, "driven_lanedir_consec": 0.4737502700333369}, "udem-000-ego3": {"driven_any": 0.465935343800797, "survival_time": 8.949999999999992, "driven_lanedir": 0.34689162086467684, "in-drivable-lane": 5.149999999999998, "deviation-heading": 2.457767773120218, "distance-from-start": 0.36941856652433946, "deviation-center-line": 0.374990306725696, "driven_lanedir_consec": 0.34689162086467684}}
simulation-passed1
survival_time_max8.949999999999992
survival_time_mean8.949999999999992
survival_time_min8.949999999999992
No reset possible
12209661Bea Baselines 🐤template-tensorflowaido-LFP-sim-validationsim-0of4failednodavinci-stage-01-6.2.500:00:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12163703Bea Baselines 🐤template-randomaido-LFV_multi-sim-validationsim-1of4successnodavinci-stage-01-6.2.500:23:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median53.599999999998715
driven_lanedir_consec_median0.17850006289932396
deviation-center-line_median0.49660205595737594


other stats
deviation-center-line_max0.7655517644258731
deviation-center-line_mean0.550438887644005
deviation-center-line_min0.4429996742353948
deviation-heading_max5.708723015945328
deviation-heading_mean4.314762107049478
deviation-heading_median4.260413639699664
deviation-heading_min3.029498132853256
distance-from-start_max1.4108418329398826
distance-from-start_mean1.1194358824993853
distance-from-start_median1.1354018196019648
distance-from-start_min0.7960980578537286
driven_any_max15.326310847370626
driven_any_mean11.633879106528216
driven_any_median12.316353572892982
driven_any_min6.576498432956271
driven_lanedir_consec_max0.271834711171973
driven_lanedir_consec_mean0.18178573943420095
driven_lanedir_consec_min0.0983081207661829
driven_lanedir_max0.25382999559920805
driven_lanedir_mean0.16790489531803093
driven_lanedir_median0.1652120582661244
driven_lanedir_min0.0873654691406669
in-drivable-lane_max54.699999999998695
in-drivable-lane_mean53.33749999999871
in-drivable-lane_min51.44999999999871
per-episodes
details{"loop-000-ego0": {"driven_any": 11.376062002465089, "survival_time": 59.99999999999873, "driven_lanedir": 0.25382999559920805, "in-drivable-lane": 51.44999999999871, "deviation-heading": 5.708723015945328, "distance-from-start": 1.0442247976691956, "deviation-center-line": 0.7655517644258731, "driven_lanedir_consec": 0.271834711171973}, "loop-000-ego1": {"driven_any": 6.576498432956271, "survival_time": 59.99999999999873, "driven_lanedir": 0.1969664999784144, "in-drivable-lane": 52.54999999999872, "deviation-heading": 4.716518246290203, "distance-from-start": 0.7960980578537286, "deviation-center-line": 0.5494202135367019, "driven_lanedir_consec": 0.2102948009868546}, "loop-000-ego2": {"driven_any": 13.256645143320878, "survival_time": 59.99999999999873, "driven_lanedir": 0.13345761655383437, "in-drivable-lane": 54.64999999999871, "deviation-heading": 3.029498132853256, "distance-from-start": 1.226578841534734, "deviation-center-line": 0.4429996742353948, "driven_lanedir_consec": 0.14670532481179333}, "loop-000-ego3": {"driven_any": 15.326310847370626, "survival_time": 59.99999999999873, "driven_lanedir": 0.0873654691406669, "in-drivable-lane": 54.699999999998695, "deviation-heading": 3.804309033109124, "distance-from-start": 1.4108418329398826, "deviation-center-line": 0.4437838983780501, "driven_lanedir_consec": 0.0983081207661829}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12152706Bea Baselines 🐤template-randomaido-LFVI-sim-validationsim-1of4successnodavinci-stage-01-6.2.500:11:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median43.24999999999968
in-drivable-lane_median30.94999999999972
driven_lanedir_consec_median0.21786067233483597
deviation-center-line_median1.03377506159595


other stats
deviation-center-line_max1.03377506159595
deviation-center-line_mean1.03377506159595
deviation-center-line_min1.03377506159595
deviation-heading_max10.709657934936162
deviation-heading_mean10.709657934936162
deviation-heading_median10.709657934936162
deviation-heading_min10.709657934936162
distance-from-start_max1.009340436005919
distance-from-start_mean1.009340436005919
distance-from-start_median1.009340436005919
distance-from-start_min1.009340436005919
driven_any_max10.497249092993233
driven_any_mean10.497249092993233
driven_any_median10.497249092993233
driven_any_min10.497249092993233
driven_lanedir_consec_max0.21786067233483597
driven_lanedir_consec_mean0.21786067233483597
driven_lanedir_consec_min0.21786067233483597
driven_lanedir_max0.19985118839069793
driven_lanedir_mean0.19985118839069793
driven_lanedir_median0.19985118839069793
driven_lanedir_min0.19985118839069793
in-drivable-lane_max30.94999999999972
in-drivable-lane_mean30.94999999999972
in-drivable-lane_min30.94999999999972
per-episodes
details{"4way-000-ego0": {"driven_any": 10.497249092993233, "survival_time": 43.24999999999968, "driven_lanedir": 0.19985118839069793, "in-drivable-lane": 30.94999999999972, "deviation-heading": 10.709657934936162, "distance-from-start": 1.009340436005919, "deviation-center-line": 1.03377506159595, "driven_lanedir_consec": 0.21786067233483597}}
simulation-passed1
survival_time_max43.24999999999968
survival_time_mean43.24999999999968
survival_time_min43.24999999999968
No reset possible
12149707Bea Baselines 🐤template-randomaido-LFI-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:02:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.7499999999999942
in-drivable-lane_median0.9
driven_lanedir_consec_median0.39017518658850303
deviation-center-line_median0.17124897035562547


other stats
deviation-center-line_max0.17124897035562547
deviation-center-line_mean0.17124897035562547
deviation-center-line_min0.17124897035562547
deviation-heading_max1.7031418047241604
deviation-heading_mean1.7031418047241604
deviation-heading_median1.7031418047241604
deviation-heading_min1.7031418047241604
distance-from-start_max0.40285563030398
distance-from-start_mean0.40285563030398
distance-from-start_median0.40285563030398
distance-from-start_min0.40285563030398
driven_any_max0.4240764502839632
driven_any_mean0.4240764502839632
driven_any_median0.4240764502839632
driven_any_min0.4240764502839632
driven_lanedir_consec_max0.39017518658850303
driven_lanedir_consec_mean0.39017518658850303
driven_lanedir_consec_min0.39017518658850303
driven_lanedir_max0.39017518658850303
driven_lanedir_mean0.39017518658850303
driven_lanedir_median0.39017518658850303
driven_lanedir_min0.39017518658850303
in-drivable-lane_max0.9
in-drivable-lane_mean0.9
in-drivable-lane_min0.9
per-episodes
details{"4way-000-ego0": {"driven_any": 0.4240764502839632, "survival_time": 3.7499999999999942, "driven_lanedir": 0.39017518658850303, "in-drivable-lane": 0.9, "deviation-heading": 1.7031418047241604, "distance-from-start": 0.40285563030398, "deviation-center-line": 0.17124897035562547, "driven_lanedir_consec": 0.39017518658850303}}
simulation-passed1
survival_time_max3.7499999999999942
survival_time_mean3.7499999999999942
survival_time_min3.7499999999999942
No reset possible
12146708Bea Baselines 🐤template-randomaido-LF-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:05:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.26764947507969805
survival_time_median25.75000000000023
deviation-center-line_median0.7555292890833561
in-drivable-lane_median17.20000000000021


other stats
deviation-center-line_max0.7555292890833561
deviation-center-line_mean0.7555292890833561
deviation-center-line_min0.7555292890833561
deviation-heading_max5.523299123594233
deviation-heading_mean5.523299123594233
deviation-heading_median5.523299123594233
deviation-heading_min5.523299123594233
distance-from-start_max0.7960980578537241
distance-from-start_mean0.7960980578537241
distance-from-start_median0.7960980578537241
distance-from-start_min0.7960980578537241
driven_any_max6.239826156091173
driven_any_mean6.239826156091173
driven_any_median6.239826156091173
driven_any_min6.239826156091173
driven_lanedir_consec_max0.26764947507969805
driven_lanedir_consec_mean0.26764947507969805
driven_lanedir_consec_min0.26764947507969805
driven_lanedir_max0.2496387990426845
driven_lanedir_mean0.2496387990426845
driven_lanedir_median0.2496387990426845
driven_lanedir_min0.2496387990426845
in-drivable-lane_max17.20000000000021
in-drivable-lane_mean17.20000000000021
in-drivable-lane_min17.20000000000021
per-episodes
details{"loop2-000-ego0": {"driven_any": 6.239826156091173, "survival_time": 25.75000000000023, "driven_lanedir": 0.2496387990426845, "in-drivable-lane": 17.20000000000021, "deviation-heading": 5.523299123594233, "distance-from-start": 0.7960980578537241, "deviation-center-line": 0.7555292890833561, "driven_lanedir_consec": 0.26764947507969805}}
simulation-passed1
survival_time_max25.75000000000023
survival_time_mean25.75000000000023
survival_time_min25.75000000000023
No reset possible
12144708Bea Baselines 🐤template-randomaido-LF-sim-validationsim-0of4successnodavinci-stage-01-6.2.500:04:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2577651966235015
survival_time_median31.100000000000307
deviation-center-line_median0.8659888526711657
in-drivable-lane_median21.150000000000265


other stats
deviation-center-line_max0.8659888526711657
deviation-center-line_mean0.8659888526711657
deviation-center-line_min0.8659888526711657
deviation-heading_max7.706889494947773
deviation-heading_mean7.706889494947773
deviation-heading_median7.706889494947773
deviation-heading_min7.706889494947773
distance-from-start_max0.862630812070106
distance-from-start_mean0.862630812070106
distance-from-start_median0.862630812070106
distance-from-start_min0.862630812070106
driven_any_max7.342290201920578
driven_any_mean7.342290201920578
driven_any_median7.342290201920578
driven_any_min7.342290201920578
driven_lanedir_consec_max0.2577651966235015
driven_lanedir_consec_mean0.2577651966235015
driven_lanedir_consec_min0.2577651966235015
driven_lanedir_max0.2397442685877289
driven_lanedir_mean0.2397442685877289
driven_lanedir_median0.2397442685877289
driven_lanedir_min0.2397442685877289
in-drivable-lane_max21.150000000000265
in-drivable-lane_mean21.150000000000265
in-drivable-lane_min21.150000000000265
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.342290201920578, "survival_time": 31.100000000000307, "driven_lanedir": 0.2397442685877289, "in-drivable-lane": 21.150000000000265, "deviation-heading": 7.706889494947773, "distance-from-start": 0.862630812070106, "deviation-center-line": 0.8659888526711657, "driven_lanedir_consec": 0.2577651966235015}}
simulation-passed1
survival_time_max31.100000000000307
survival_time_mean31.100000000000307
survival_time_min31.100000000000307
No reset possible
12142709Bea Baselines 🐤template-randomaido-LFVI_multi-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:03:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12136709Bea Baselines 🐤template-randomaido-LFVI_multi-sim-validationsim-1of4successnodavinci-stage-01-6.2.500:12:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median27.85000000000026
in-drivable-lane_median23.575000000000244
driven_lanedir_consec_median0.2152178291743677
deviation-center-line_median0.34607680035313926


other stats
deviation-center-line_max0.7555295762526522
deviation-center-line_mean0.3831880038858158
deviation-center-line_min0.0850688385843324
deviation-heading_max5.523299013646982
deviation-heading_mean2.976848653346106
deviation-heading_median2.577175729127456
deviation-heading_min1.229744141482529
distance-from-start_max0.8413577961802242
distance-from-start_mean0.6171534020652945
distance-from-start_median0.6122000908884857
distance-from-start_min0.4028556303039823
driven_any_max6.724613878580574
driven_any_mean3.448516774187835
driven_any_median3.322688383943399
driven_any_min0.4240764502839678
driven_lanedir_consec_max0.3926134494082678
driven_lanedir_consec_mean0.23172102279300744
driven_lanedir_consec_min0.10383498341502671
driven_lanedir_max0.3926134494082678
driven_lanedir_mean0.22283655208020933
driven_lanedir_median0.1995874449338097
driven_lanedir_min0.09955786904495012
in-drivable-lane_max25.750000000000263
in-drivable-lane_mean23.05000000000025
in-drivable-lane_min19.30000000000024
per-episodes
details{"4way-000-ego0": {"driven_any": 6.724613878580574, "survival_time": 27.85000000000026, "driven_lanedir": 0.24963678127672728, "in-drivable-lane": 19.30000000000024, "deviation-heading": 5.523299013646982, "distance-from-start": 0.8413577961802242, "deviation-center-line": 0.7555295762526522, "driven_lanedir_consec": 0.26764984149988424}, "4way-000-ego1": {"driven_any": 0.4240764502839678, "survival_time": 27.85000000000026, "driven_lanedir": 0.3926134494082678, "in-drivable-lane": 25.750000000000263, "deviation-heading": 1.229744141482529, "distance-from-start": 0.4028556303039823, "deviation-center-line": 0.0850688385843324, "driven_lanedir_consec": 0.3926134494082678}, "4way-000-ego2": {"driven_any": 4.117732239446978, "survival_time": 27.85000000000026, "driven_lanedir": 0.14953810859089212, "in-drivable-lane": 22.75000000000024, "deviation-heading": 2.8042483888415783, "distance-from-start": 0.6736010379604935, "deviation-center-line": 0.4035531580478341, "driven_lanedir_consec": 0.16278581684885107}, "4way-000-ego3": {"driven_any": 2.527644528439821, "survival_time": 27.85000000000026, "driven_lanedir": 0.09955786904495012, "in-drivable-lane": 24.40000000000025, "deviation-heading": 2.350103069413334, "distance-from-start": 0.5507991438164779, "deviation-center-line": 0.2886004426584445, "driven_lanedir_consec": 0.10383498341502671}}
simulation-passed1
survival_time_max27.85000000000026
survival_time_mean27.85000000000026
survival_time_min27.85000000000026
No reset possible
12125712Bea Baselines 🐤template-randomaido-LFV-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:13:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median47.14999999999946
in-drivable-lane_median41.84999999999942
driven_lanedir_consec_median0.02132071110144948
deviation-center-line_median0.43050874852338417


other stats
deviation-center-line_max0.43050874852338417
deviation-center-line_mean0.43050874852338417
deviation-center-line_min0.43050874852338417
deviation-heading_max4.072118820377199
deviation-heading_mean4.072118820377199
deviation-heading_median4.072118820377199
deviation-heading_min4.072118820377199
distance-from-start_max1.0630774515460415
distance-from-start_mean1.0630774515460415
distance-from-start_median1.0630774515460415
distance-from-start_min1.0630774515460415
driven_any_max11.484884891685338
driven_any_mean11.484884891685338
driven_any_median11.484884891685338
driven_any_min11.484884891685338
driven_lanedir_consec_max0.02132071110144948
driven_lanedir_consec_mean0.02132071110144948
driven_lanedir_consec_min0.02132071110144948
driven_lanedir_max0.004356572616899007
driven_lanedir_mean0.004356572616899007
driven_lanedir_median0.004356572616899007
driven_lanedir_min0.004356572616899007
in-drivable-lane_max41.84999999999942
in-drivable-lane_mean41.84999999999942
in-drivable-lane_min41.84999999999942
per-episodes
details{"zigzag-000-ego0": {"driven_any": 11.484884891685338, "survival_time": 47.14999999999946, "driven_lanedir": 0.004356572616899007, "in-drivable-lane": 41.84999999999942, "deviation-heading": 4.072118820377199, "distance-from-start": 1.0630774515460415, "deviation-center-line": 0.43050874852338417, "driven_lanedir_consec": 0.02132071110144948}}
simulation-passed1
survival_time_max47.14999999999946
survival_time_mean47.14999999999946
survival_time_min47.14999999999946
No reset possible
12122713Bea Baselines 🐤template-randomaido-LFVI-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12118714Bea Baselines 🐤template-randomaido-LFI-sim-testingsim-1of4successnodavinci-stage-01-6.2.500:02:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.899999999999994
in-drivable-lane_median2.399999999999994
driven_lanedir_consec_median0.022350163233605613
deviation-center-line_median0.026643428344150132


other stats
deviation-center-line_max0.026643428344150132
deviation-center-line_mean0.026643428344150132
deviation-center-line_min0.026643428344150132
deviation-heading_max1.126574172093021
deviation-heading_mean1.126574172093021
deviation-heading_median1.126574172093021
deviation-heading_min1.126574172093021
distance-from-start_max0.48917230594954225
distance-from-start_mean0.48917230594954225
distance-from-start_median0.48917230594954225
distance-from-start_min0.48917230594954225
driven_any_max0.5134230938905342
driven_any_mean0.5134230938905342
driven_any_median0.5134230938905342
driven_any_min0.5134230938905342
driven_lanedir_consec_max0.022350163233605613
driven_lanedir_consec_mean0.022350163233605613
driven_lanedir_consec_min0.022350163233605613
driven_lanedir_max0.022350163233605613
driven_lanedir_mean0.022350163233605613
driven_lanedir_median0.022350163233605613
driven_lanedir_min0.022350163233605613
in-drivable-lane_max2.399999999999994
in-drivable-lane_mean2.399999999999994
in-drivable-lane_min2.399999999999994
per-episodes
details{"udem1-000-ego0": {"driven_any": 0.5134230938905342, "survival_time": 3.899999999999994, "driven_lanedir": 0.022350163233605613, "in-drivable-lane": 2.399999999999994, "deviation-heading": 1.126574172093021, "distance-from-start": 0.48917230594954225, "deviation-center-line": 0.026643428344150132, "driven_lanedir_consec": 0.022350163233605613}}
simulation-passed1
survival_time_max3.899999999999994
survival_time_mean3.899999999999994
survival_time_min3.899999999999994
No reset possible
12112716Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-0of4successnodavinci-stage-01-6.2.500:07:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median15.80000000000009
in-drivable-lane_median12.250000000000089
driven_lanedir_consec_median0.1976657309045995
deviation-center-line_median0.30916297118874164


other stats
deviation-center-line_max0.5167734001966479
deviation-center-line_mean0.2904356927295703
deviation-center-line_min0.026643428344150132
deviation-heading_max3.648554139524216
deviation-heading_mean2.1866076734990423
deviation-heading_median1.9856511911894663
deviation-heading_min1.126574172093021
distance-from-start_max0.6297514211539125
distance-from-start_mean0.5152552969251188
distance-from-start_median0.5284445727545999
distance-from-start_min0.3743806210373633
driven_any_max3.5922095903913815
driven_any_mean1.7403199031741243
driven_any_median1.4873198912093584
driven_any_min0.3944302398863988
driven_lanedir_consec_max0.30624803336021755
driven_lanedir_consec_mean0.18098238479843215
driven_lanedir_consec_min0.022350044024312066
driven_lanedir_max0.30624803336021755
driven_lanedir_mean0.17754217371916875
driven_lanedir_median0.1907853087460727
driven_lanedir_min0.022350044024312066
in-drivable-lane_max14.30000000000009
in-drivable-lane_mean11.862500000000091
in-drivable-lane_min8.650000000000095
per-episodes
details{"udem-000-ego0": {"driven_any": 0.5356334840761573, "survival_time": 15.80000000000009, "driven_lanedir": 0.022350044024312066, "in-drivable-lane": 14.30000000000009, "deviation-heading": 1.126574172093021, "distance-from-start": 0.5107316375695493, "deviation-center-line": 0.026643428344150132, "driven_lanedir_consec": 0.022350044024312066}, "udem-000-ego1": {"driven_any": 3.5922095903913815, "survival_time": 15.80000000000009, "driven_lanedir": 0.23530327637400592, "in-drivable-lane": 8.650000000000095, "deviation-heading": 3.648554139524216, "distance-from-start": 0.6297514211539125, "deviation-center-line": 0.5167734001966479, "driven_lanedir_consec": 0.24249463032549556}, "udem-000-ego2": {"driven_any": 2.4390062983425596, "survival_time": 15.80000000000009, "driven_lanedir": 0.14626734111813944, "in-drivable-lane": 10.750000000000083, "deviation-heading": 2.5591239415144273, "distance-from-start": 0.5461575079396503, "deviation-center-line": 0.5143008900460763, "driven_lanedir_consec": 0.15283683148370342}, "udem-000-ego3": {"driven_any": 0.3944302398863988, "survival_time": 15.80000000000009, "driven_lanedir": 0.30624803336021755, "in-drivable-lane": 13.750000000000092, "deviation-heading": 1.4121784408645055, "distance-from-start": 0.3743806210373633, "deviation-center-line": 0.10402505233140706, "driven_lanedir_consec": 0.30624803336021755}}
simulation-passed1
survival_time_max15.80000000000009
survival_time_mean15.80000000000009
survival_time_min15.80000000000009
No reset possible
12107732Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-validationsim-2of4successnodavinci-stage-01-6.2.500:07:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median1.5116931584219897


other stats
deviation-center-line_max2.128488788608653
deviation-center-line_mean1.5116931584219897
deviation-center-line_min0.8948975282353262
deviation-heading_max32.249113233675025
deviation-heading_mean31.48103999887634
deviation-heading_median31.48103999887634
deviation-heading_min30.712966764077652
distance-from-start_max4.440892098500626e-16
distance-from-start_mean2.3592239273284576e-16
distance-from-start_median2.3592239273284576e-16
distance-from-start_min2.7755575615628914e-17
driven_any_max5.329070518200751e-13
driven_any_mean2.831068712794149e-13
driven_any_median2.831068712794149e-13
driven_any_min3.3306690738754696e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.3306690738754696e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.7755575615628914e-17, "deviation-center-line": 0.8948975282353262, "driven_lanedir_consec": 0.0}, "loop2-000-ego1": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 2.128488788608653, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12103733Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-validationsim-1of4successnodavinci-stage-01-6.2.500:06:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8948988630736971


other stats
deviation-center-line_max0.8948988630736971
deviation-center-line_mean0.8948988630736971
deviation-center-line_min0.8948988630736971
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max4.965068306494546e-16
distance-from-start_mean4.965068306494546e-16
distance-from-start_median4.965068306494546e-16
distance-from-start_min4.965068306494546e-16
driven_any_max5.95808196779335e-13
driven_any_mean5.95808196779335e-13
driven_any_median5.95808196779335e-13
driven_any_min5.95808196779335e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.8948988630736971, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12097736Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-validationsim-1of4successnodavinci-stage-01-6.2.500:05:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8949033835511649


other stats
deviation-center-line_max0.8949033835511649
deviation-center-line_mean0.8949033835511649
deviation-center-line_min0.8949033835511649
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max2.220446049250313e-16
distance-from-start_mean2.220446049250313e-16
distance-from-start_median2.220446049250313e-16
distance-from-start_min2.220446049250313e-16
driven_any_max2.6645352591003757e-13
driven_any_mean2.6645352591003757e-13
driven_any_median2.6645352591003757e-13
driven_any_min2.6645352591003757e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-000-ego0": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 0.8949033835511649, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12096736Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-validationsim-3of4successnodavinci-stage-01-6.2.500:01:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12087738Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-validationsim-1of4successnodavinci-stage-01-6.2.500:14:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median1.511704717596742


other stats
deviation-center-line_max2.946772659605511
deviation-center-line_mean1.5769817001146265
deviation-center-line_min0.3377447056595108
deviation-heading_max32.249113233675025
deviation-heading_mean22.83949643715976
deviation-heading_median22.59726568012299
deviation-heading_min13.914341154718024
distance-from-start_max4.965068306494546e-16
distance-from-start_mean2.2127122231706483e-16
distance-from-start_median1.6653345369377348e-16
distance-from-start_min5.551115123125783e-17
driven_any_max5.95808196779335e-13
driven_any_mean2.6552546678047523e-13
driven_any_median1.9984014443252818e-13
driven_any_min6.661338147750939e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.8949033835511649, "driven_lanedir_consec": 0.0}, "4way-000-ego1": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 2.128506051642319, "driven_lanedir_consec": 0.0}, "4way-000-ego2": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 14.481564596168328, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 2.946772659605511, "driven_lanedir_consec": 0.0}, "4way-000-ego3": {"driven_any": 6.661338147750939e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 13.914341154718024, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.3377447056595108, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12078741Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-testingsim-0of4successnodavinci-stage-01-6.2.500:13:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.4065243130134844


other stats
deviation-center-line_max0.4065243130134844
deviation-center-line_mean0.4065243130134844
deviation-center-line_min0.4065243130134844
deviation-heading_max40.967332753486254
deviation-heading_mean40.967332753486254
deviation-heading_median40.967332753486254
deviation-heading_min40.967332753486254
distance-from-start_max0.0
distance-from-start_mean0.0
distance-from-start_median0.0
distance-from-start_min0.0
driven_any_max0.0
driven_any_mean0.0
driven_any_median0.0
driven_any_min0.0
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 0.0, "deviation-center-line": 0.4065243130134844, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12076741Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-testingsim-2of4successnodavinci-stage-01-6.2.500:06:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.40652431301346514


other stats
deviation-center-line_max0.40652431301346514
deviation-center-line_mean0.40652431301346514
deviation-center-line_min0.40652431301346514
deviation-heading_max40.967332753486254
deviation-heading_mean40.967332753486254
deviation-heading_median40.967332753486254
deviation-heading_min40.967332753486254
distance-from-start_max1.1102230246251563e-16
distance-from-start_mean1.1102230246251563e-16
distance-from-start_median1.1102230246251563e-16
distance-from-start_min1.1102230246251563e-16
driven_any_max1.3322676295501878e-13
driven_any_mean1.3322676295501878e-13
driven_any_median1.3322676295501878e-13
driven_any_min1.3322676295501878e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 0.40652431301346514, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12073742Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12070743Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-testingsim-3of4successnodavinci-stage-01-6.2.500:01:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12067743Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-testingsim-1of4successnodavinci-stage-01-6.2.500:04:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.4065243130134252


other stats
deviation-center-line_max0.4065243130134252
deviation-center-line_mean0.4065243130134252
deviation-center-line_min0.4065243130134252
deviation-heading_max40.967332753486254
deviation-heading_mean40.967332753486254
deviation-heading_median40.967332753486254
deviation-heading_min40.967332753486254
distance-from-start_max4.440892098500626e-16
distance-from-start_mean4.440892098500626e-16
distance-from-start_median4.440892098500626e-16
distance-from-start_min4.440892098500626e-16
driven_any_max5.329070518200751e-13
driven_any_mean5.329070518200751e-13
driven_any_median5.329070518200751e-13
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-000-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.4065243130134252, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12041746Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-testingsim-0of4successnodavinci-stage-01-6.2.500:14:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median1.5844918740520562


other stats
deviation-center-line_max3.468395721180941
deviation-center-line_mean1.7151225231536382
deviation-center-line_min0.22311062332950052
deviation-heading_max40.967332753486254
deviation-heading_mean25.437951450471505
deviation-heading_median28.066180210798333
deviation-heading_min4.652112626803104
distance-from-start_max4.965068306494546e-16
distance-from-start_mean3.1321156654383563e-16
distance-from-start_median3.5041414214731503e-16
distance-from-start_min5.551115123125783e-17
driven_any_max5.95808196779335e-13
driven_any_mean3.758538798526001e-13
driven_any_median4.2049697057677814e-13
driven_any_min6.661338147750939e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 6.661338147750939e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.4065243130134252, "driven_lanedir_consec": 0.0}, "udem-000-ego1": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005143, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 3.468395721180941, "driven_lanedir_consec": 0.0}, "udem-000-ego2": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 4.652112626803104, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.22311062332950052, "driven_lanedir_consec": 0.0}, "udem-000-ego3": {"driven_any": 3.08086889333481e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 2.5673907444456745e-16, "deviation-center-line": 2.7624594350906873, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible