Duckietown Challenges Home Challenges Submissions

Evaluator 113

ID113
evaluatordavinci-stage-03-6.2.50
owneruser1000001
machinedavinci-stage
processdavinci-stage-03-6.2.50
version6.2.50
first heard
last heard
statusinactive
# evaluating
# success277 12053
# timeout2 12310
# failed93 12178
# error178 12668
# aborted3 12720
# host-error24 12134
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)2.8 GHz
Free % of processors97%
RAM total (MB)251.6 GB
RAM free (MB)243.3 GB
Disk (MB)491.1 GB
Disk available (MB)201.7 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, ETH_small_intersect
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
150321297Andrea Censicollision-check-exerciselx22-collision-check-valistep1host-erroryesdavinci-stage-03-6.2.500:00:43
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.41/images/create?tag=2022_11_24_17_26_06&fromImage=registry-stage2.duckietown.org%2Fandreacensi%2Faido-submissions

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 93, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 429, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.ImageNotFound: 404 Client Error for http+docker://localhost/v1.41/images/create?tag=2022_11_24_17_26_06&fromImage=registry-stage2.duckietown.org%2Fandreacensi%2Faido-submissions: Not Found ("pull access denied for registry-stage2.duckietown.org/andreacensi/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 112, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  registry-stage2.duckietown.org/andreacensi/aido-submissions@sha256:840e7105f36db90b5d37324bdcab451125a96c2e8b8f5c02658293c659de9b5d  tag  2022_11_24_17_26_06

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 51, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull registry-stage2.duckietown.org/andreacensi/aido-submissions:2022_11_24_17_26_06@sha256:840e7105f36db90b5d37324bdcab451125a96c2e8b8f5c02658293c659de9b5d
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15025309Andrea Censiminimal-agentaido-LFV-sim-validationsim-0of4successnodavinci-stage-03-6.2.500:02:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.2
in-drivable-lane_median0.0
driven_lanedir_consec_median0.16440570511787245
deviation-center-line_median0.19162140900760455


other stats
deviation-center-line_max0.19162140900760455
deviation-center-line_mean0.19162140900760455
deviation-center-line_min0.19162140900760455
deviation-heading_max1.1939422489088862
deviation-heading_mean1.1939422489088862
deviation-heading_median1.1939422489088862
deviation-heading_min1.1939422489088862
distance-from-start_max0.19201183050647508
distance-from-start_mean0.19201183050647508
distance-from-start_median0.19201183050647508
distance-from-start_min0.19201183050647508
driven_any_max0.19201481064322065
driven_any_mean0.19201481064322065
driven_any_median0.19201481064322065
driven_any_min0.19201481064322065
driven_lanedir_consec_max0.16440570511787245
driven_lanedir_consec_mean0.16440570511787245
driven_lanedir_consec_min0.16440570511787245
driven_lanedir_max0.16440570511787245
driven_lanedir_mean0.16440570511787245
driven_lanedir_median0.16440570511787245
driven_lanedir_min0.16440570511787245
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.19201481064322065, "survival_time": 2.2, "driven_lanedir": 0.16440570511787245, "in-drivable-lane": 0.0, "deviation-heading": 1.1939422489088862, "distance-from-start": 0.19201183050647508, "deviation-center-line": 0.19162140900760455, "driven_lanedir_consec": 0.16440570511787245}}
simulation-passed1
survival_time_max2.2
survival_time_mean2.2
survival_time_min2.2
No reset possible
15022310Andrea Censiminimal-agentaido-LFV-sim-validationsim-1of4successnodavinci-stage-03-6.2.500:03:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.700000000000044
in-drivable-lane_median10.950000000000044
driven_lanedir_consec_median0.19955171937759708
deviation-center-line_median0.12567511082985278


other stats
deviation-center-line_max0.12567511082985278
deviation-center-line_mean0.12567511082985278
deviation-center-line_min0.12567511082985278
deviation-heading_max0.9488219555580464
deviation-heading_mean0.9488219555580464
deviation-heading_median0.9488219555580464
deviation-heading_min0.9488219555580464
distance-from-start_max1.924049384083022
distance-from-start_mean1.924049384083022
distance-from-start_median1.924049384083022
distance-from-start_min1.924049384083022
driven_any_max1.924195440713655
driven_any_mean1.924195440713655
driven_any_median1.924195440713655
driven_any_min1.924195440713655
driven_lanedir_consec_max0.19955171937759708
driven_lanedir_consec_mean0.19955171937759708
driven_lanedir_consec_min0.19955171937759708
driven_lanedir_max0.19955171937759708
driven_lanedir_mean0.19955171937759708
driven_lanedir_median0.19955171937759708
driven_lanedir_min0.19955171937759708
in-drivable-lane_max10.950000000000044
in-drivable-lane_mean10.950000000000044
in-drivable-lane_min10.950000000000044
per-episodes
details{"loop-000-ego0": {"driven_any": 1.924195440713655, "survival_time": 12.700000000000044, "driven_lanedir": 0.19955171937759708, "in-drivable-lane": 10.950000000000044, "deviation-heading": 0.9488219555580464, "distance-from-start": 1.924049384083022, "deviation-center-line": 0.12567511082985278, "driven_lanedir_consec": 0.19955171937759708}}
simulation-passed1
survival_time_max12.700000000000044
survival_time_mean12.700000000000044
survival_time_min12.700000000000044
No reset possible
15020311Andrea Censiminimal-agentaido-LFV-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:02:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.400000000000013
in-drivable-lane_median7.100000000000017
driven_lanedir_consec_median0.33123013524902545
deviation-center-line_median0.26973522366843383


other stats
deviation-center-line_max0.26973522366843383
deviation-center-line_mean0.26973522366843383
deviation-center-line_min0.26973522366843383
deviation-heading_max2.53835057480462
deviation-heading_mean2.53835057480462
deviation-heading_median2.53835057480462
deviation-heading_min2.53835057480462
distance-from-start_max1.5453191784191067
distance-from-start_mean1.5453191784191067
distance-from-start_median1.5453191784191067
distance-from-start_min1.5453191784191067
driven_any_max1.545427894810905
driven_any_mean1.545427894810905
driven_any_median1.545427894810905
driven_any_min1.545427894810905
driven_lanedir_consec_max0.33123013524902545
driven_lanedir_consec_mean0.33123013524902545
driven_lanedir_consec_min0.33123013524902545
driven_lanedir_max0.33123013524902545
driven_lanedir_mean0.33123013524902545
driven_lanedir_median0.33123013524902545
driven_lanedir_min0.33123013524902545
in-drivable-lane_max7.100000000000017
in-drivable-lane_mean7.100000000000017
in-drivable-lane_min7.100000000000017
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.545427894810905, "survival_time": 10.400000000000013, "driven_lanedir": 0.33123013524902545, "in-drivable-lane": 7.100000000000017, "deviation-heading": 2.53835057480462, "distance-from-start": 1.5453191784191067, "deviation-center-line": 0.26973522366843383, "driven_lanedir_consec": 0.33123013524902545}}
simulation-passed1
survival_time_max10.400000000000013
survival_time_mean10.400000000000013
survival_time_min10.400000000000013
No reset possible
15018311Andrea Censiminimal-agentaido-LFV-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:02:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.099999999999983
in-drivable-lane_median5.649999999999983
driven_lanedir_consec_median0.1397956002040246
deviation-center-line_median0.09390664341773942


other stats
deviation-center-line_max0.09390664341773942
deviation-center-line_mean0.09390664341773942
deviation-center-line_min0.09390664341773942
deviation-heading_max0.9654183287874442
deviation-heading_mean0.9654183287874442
deviation-heading_median0.9654183287874442
deviation-heading_min0.9654183287874442
distance-from-start_max1.0016247187181055
distance-from-start_mean1.0016247187181055
distance-from-start_median1.0016247187181055
distance-from-start_min1.0016247187181055
driven_any_max1.0016732136326914
driven_any_mean1.0016732136326914
driven_any_median1.0016732136326914
driven_any_min1.0016732136326914
driven_lanedir_consec_max0.1397956002040246
driven_lanedir_consec_mean0.1397956002040246
driven_lanedir_consec_min0.1397956002040246
driven_lanedir_max0.1397956002040246
driven_lanedir_mean0.1397956002040246
driven_lanedir_median0.1397956002040246
driven_lanedir_min0.1397956002040246
in-drivable-lane_max5.649999999999983
in-drivable-lane_mean5.649999999999983
in-drivable-lane_min5.649999999999983
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.0016732136326914, "survival_time": 7.099999999999983, "driven_lanedir": 0.1397956002040246, "in-drivable-lane": 5.649999999999983, "deviation-heading": 0.9654183287874442, "distance-from-start": 1.0016247187181055, "deviation-center-line": 0.09390664341773942, "driven_lanedir_consec": 0.1397956002040246}}
simulation-passed1
survival_time_max7.099999999999983
survival_time_mean7.099999999999983
survival_time_min7.099999999999983
No reset possible
15017312Liam Paulltemplate-rosaido-LF-sim-validationsim-1of4successnodavinci-stage-03-6.2.500:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.16302146580657828
survival_time_median4.099999999999993
deviation-center-line_median0.06232197509312462
in-drivable-lane_median3.049999999999993


other stats
deviation-center-line_max0.06232197509312462
deviation-center-line_mean0.06232197509312462
deviation-center-line_min0.06232197509312462
deviation-heading_max0.6382399614100658
deviation-heading_mean0.6382399614100658
deviation-heading_median0.6382399614100658
deviation-heading_min0.6382399614100658
distance-from-start_max0.8601254569118647
distance-from-start_mean0.8601254569118647
distance-from-start_median0.8601254569118647
distance-from-start_min0.8601254569118647
driven_any_max0.9171947644659368
driven_any_mean0.9171947644659368
driven_any_median0.9171947644659368
driven_any_min0.9171947644659368
driven_lanedir_consec_max0.16302146580657828
driven_lanedir_consec_mean0.16302146580657828
driven_lanedir_consec_min0.16302146580657828
driven_lanedir_max0.16302146580657828
driven_lanedir_mean0.16302146580657828
driven_lanedir_median0.16302146580657828
driven_lanedir_min0.16302146580657828
in-drivable-lane_max3.049999999999993
in-drivable-lane_mean3.049999999999993
in-drivable-lane_min3.049999999999993
per-episodes
details{"loop-000-ego0": {"driven_any": 0.9171947644659368, "survival_time": 4.099999999999993, "driven_lanedir": 0.16302146580657828, "in-drivable-lane": 3.049999999999993, "deviation-heading": 0.6382399614100658, "distance-from-start": 0.8601254569118647, "deviation-center-line": 0.06232197509312462, "driven_lanedir_consec": 0.16302146580657828}}
simulation-passed1
survival_time_max4.099999999999993
survival_time_mean4.099999999999993
survival_time_min4.099999999999993
No reset possible
15015312Liam Paulltemplate-rosaido-LF-sim-validationsim-0of4successnodavinci-stage-03-6.2.500:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2079763968029953
survival_time_median5.09999999999999
deviation-center-line_median0.06596024132476608
in-drivable-lane_median3.9499999999999895


other stats
deviation-center-line_max0.06596024132476608
deviation-center-line_mean0.06596024132476608
deviation-center-line_min0.06596024132476608
deviation-heading_max0.6077645415264644
deviation-heading_mean0.6077645415264644
deviation-heading_median0.6077645415264644
deviation-heading_min0.6077645415264644
distance-from-start_max1.0713705718756092
distance-from-start_mean1.0713705718756092
distance-from-start_median1.0713705718756092
distance-from-start_min1.0713705718756092
driven_any_max1.0946574267738334
driven_any_mean1.0946574267738334
driven_any_median1.0946574267738334
driven_any_min1.0946574267738334
driven_lanedir_consec_max0.2079763968029953
driven_lanedir_consec_mean0.2079763968029953
driven_lanedir_consec_min0.2079763968029953
driven_lanedir_max0.2079763968029953
driven_lanedir_mean0.2079763968029953
driven_lanedir_median0.2079763968029953
driven_lanedir_min0.2079763968029953
in-drivable-lane_max3.9499999999999895
in-drivable-lane_mean3.9499999999999895
in-drivable-lane_min3.9499999999999895
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.0946574267738334, "survival_time": 5.09999999999999, "driven_lanedir": 0.2079763968029953, "in-drivable-lane": 3.9499999999999895, "deviation-heading": 0.6077645415264644, "distance-from-start": 1.0713705718756092, "deviation-center-line": 0.06596024132476608, "driven_lanedir_consec": 0.2079763968029953}}
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean5.09999999999999
survival_time_min5.09999999999999
No reset possible
15012341Liam Paulltemplate-rosaido-LF-sim-validationsim-0of4failednodavinci-stage-03-6.2.500:02:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 243, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15011341Liam Paulltemplate-rosaido-LF-sim-validationsim-1of4failednodavinci-stage-03-6.2.500:02:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 243, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15004385Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:12:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median31.22499999999915
driven_lanedir_consec_median-2.768562967492729
deviation-center-line_median2.434098360877102


other stats
deviation-center-line_max2.619067608956514
deviation-center-line_mean2.434098360877102
deviation-center-line_min2.24912911279769
deviation-heading_max26.60394846268584
deviation-heading_mean25.366484477874813
deviation-heading_median25.366484477874813
deviation-heading_min24.12902049306379
distance-from-start_max0.1728152012320356
distance-from-start_mean0.16740981663278576
distance-from-start_median0.16740981663278576
distance-from-start_min0.16200443203353593
driven_any_max11.693416046915765
driven_any_mean11.3014534564613
driven_any_median11.3014534564613
driven_any_min10.909490866006838
driven_lanedir_consec_max-1.9957236997944148
driven_lanedir_consec_mean-2.768562967492729
driven_lanedir_consec_min-3.5414022351910432
driven_lanedir_max-1.9957236997944148
driven_lanedir_mean-2.848338467121253
driven_lanedir_median-2.848338467121253
driven_lanedir_min-3.7009532344480913
in-drivable-lane_max32.699999999998994
in-drivable-lane_mean31.22499999999915
in-drivable-lane_min29.749999999999304
per-episodes
details{"loop2-000-ego0": {"driven_any": 11.693416046915765, "survival_time": 59.99999999999873, "driven_lanedir": -3.7009532344480913, "in-drivable-lane": 29.749999999999304, "deviation-heading": 26.60394846268584, "distance-from-start": 0.1728152012320356, "deviation-center-line": 2.24912911279769, "driven_lanedir_consec": -3.5414022351910432}, "loop2-000-ego1": {"driven_any": 10.909490866006838, "survival_time": 59.99999999999873, "driven_lanedir": -1.9957236997944148, "in-drivable-lane": 32.699999999998994, "deviation-heading": 24.12902049306379, "distance-from-start": 0.16200443203353593, "deviation-center-line": 2.619067608956514, "driven_lanedir_consec": -1.9957236997944148}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
15000386Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:07:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median23.09999999999939
driven_lanedir_consec_median-2.977348903591193
deviation-center-line_median2.789157488888693


other stats
deviation-center-line_max2.789157488888693
deviation-center-line_mean2.789157488888693
deviation-center-line_min2.789157488888693
deviation-heading_max27.204305451707594
deviation-heading_mean27.204305451707594
deviation-heading_median27.204305451707594
deviation-heading_min27.204305451707594
distance-from-start_max0.207165753854416
distance-from-start_mean0.207165753854416
distance-from-start_median0.207165753854416
distance-from-start_min0.207165753854416
driven_any_max10.710415417732426
driven_any_mean10.710415417732426
driven_any_median10.710415417732426
driven_any_min10.710415417732426
driven_lanedir_consec_max-2.977348903591193
driven_lanedir_consec_mean-2.977348903591193
driven_lanedir_consec_min-2.977348903591193
driven_lanedir_max-3.4612688667638833
driven_lanedir_mean-3.4612688667638833
driven_lanedir_median-3.4612688667638833
driven_lanedir_min-3.4612688667638833
in-drivable-lane_max23.09999999999939
in-drivable-lane_mean23.09999999999939
in-drivable-lane_min23.09999999999939
per-episodes
details{"loop2-000-ego0": {"driven_any": 10.710415417732426, "survival_time": 59.99999999999873, "driven_lanedir": -3.4612688667638833, "in-drivable-lane": 23.09999999999939, "deviation-heading": 27.204305451707594, "distance-from-start": 0.207165753854416, "deviation-center-line": 2.789157488888693, "driven_lanedir_consec": -2.977348903591193}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14996386Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-validationsim-1of4successnodavinci-stage-03-6.2.500:08:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median23.549999999999383
driven_lanedir_consec_median-3.010280327397548
deviation-center-line_median3.785897189515984


other stats
deviation-center-line_max3.785897189515984
deviation-center-line_mean3.785897189515984
deviation-center-line_min3.785897189515984
deviation-heading_max29.02248037288647
deviation-heading_mean29.02248037288647
deviation-heading_median29.02248037288647
deviation-heading_min29.02248037288647
distance-from-start_max0.24499891272137164
distance-from-start_mean0.24499891272137164
distance-from-start_median0.24499891272137164
distance-from-start_min0.24499891272137164
driven_any_max12.363933705909632
driven_any_mean12.363933705909632
driven_any_median12.363933705909632
driven_any_min12.363933705909632
driven_lanedir_consec_max-3.010280327397548
driven_lanedir_consec_mean-3.010280327397548
driven_lanedir_consec_min-3.010280327397548
driven_lanedir_max-3.010280327397548
driven_lanedir_mean-3.010280327397548
driven_lanedir_median-3.010280327397548
driven_lanedir_min-3.010280327397548
in-drivable-lane_max23.549999999999383
in-drivable-lane_mean23.549999999999383
in-drivable-lane_min23.549999999999383
per-episodes
details{"loop-000-ego0": {"driven_any": 12.363933705909632, "survival_time": 59.99999999999873, "driven_lanedir": -3.010280327397548, "in-drivable-lane": 23.549999999999383, "deviation-heading": 29.02248037288647, "distance-from-start": 0.24499891272137164, "deviation-center-line": 3.785897189515984, "driven_lanedir_consec": -3.010280327397548}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14990388Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-validationsim-0of4successnodavinci-stage-03-6.2.500:16:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median25.799999999999315
driven_lanedir_consec_median-2.6256705283450965
deviation-center-line_median3.133776111701194


other stats
deviation-center-line_max3.133776111701194
deviation-center-line_mean3.133776111701194
deviation-center-line_min3.133776111701194
deviation-heading_max25.727158624826
deviation-heading_mean25.727158624826
deviation-heading_median25.727158624826
deviation-heading_min25.727158624826
distance-from-start_max0.20611872638644085
distance-from-start_mean0.20611872638644085
distance-from-start_median0.20611872638644085
distance-from-start_min0.20611872638644085
driven_any_max11.081370320672356
driven_any_mean11.081370320672356
driven_any_median11.081370320672356
driven_any_min11.081370320672356
driven_lanedir_consec_max-2.6256705283450965
driven_lanedir_consec_mean-2.6256705283450965
driven_lanedir_consec_min-2.6256705283450965
driven_lanedir_max-2.7516509113993775
driven_lanedir_mean-2.7516509113993775
driven_lanedir_median-2.7516509113993775
driven_lanedir_min-2.7516509113993775
in-drivable-lane_max25.799999999999315
in-drivable-lane_mean25.799999999999315
in-drivable-lane_min25.799999999999315
per-episodes
details{"udem-000-ego0": {"driven_any": 11.081370320672356, "survival_time": 59.99999999999873, "driven_lanedir": -2.7516509113993775, "in-drivable-lane": 25.799999999999315, "deviation-heading": 25.727158624826, "distance-from-start": 0.20611872638644085, "deviation-center-line": 3.133776111701194, "driven_lanedir_consec": -2.6256705283450965}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14983390Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:07:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-3.342186444474904
survival_time_median59.99999999999873
deviation-center-line_median4.266195284924609
in-drivable-lane_median13.949999999999608


other stats
deviation-center-line_max4.266195284924609
deviation-center-line_mean4.266195284924609
deviation-center-line_min4.266195284924609
deviation-heading_max29.59028579898309
deviation-heading_mean29.59028579898309
deviation-heading_median29.59028579898309
deviation-heading_min29.59028579898309
distance-from-start_max0.18438999340340745
distance-from-start_mean0.18438999340340745
distance-from-start_median0.18438999340340745
distance-from-start_min0.18438999340340745
driven_any_max11.817258546165498
driven_any_mean11.817258546165498
driven_any_median11.817258546165498
driven_any_min11.817258546165498
driven_lanedir_consec_max-3.342186444474904
driven_lanedir_consec_mean-3.342186444474904
driven_lanedir_consec_min-3.342186444474904
driven_lanedir_max-5.514490858547109
driven_lanedir_mean-5.514490858547109
driven_lanedir_median-5.514490858547109
driven_lanedir_min-5.514490858547109
in-drivable-lane_max13.949999999999608
in-drivable-lane_mean13.949999999999608
in-drivable-lane_min13.949999999999608
per-episodes
details{"loop2-000-ego0": {"driven_any": 11.817258546165498, "survival_time": 59.99999999999873, "driven_lanedir": -5.514490858547109, "in-drivable-lane": 13.949999999999608, "deviation-heading": 29.59028579898309, "distance-from-start": 0.18438999340340745, "deviation-center-line": 4.266195284924609, "driven_lanedir_consec": -3.342186444474904}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14973392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:34:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median29.99999999999929
driven_lanedir_consec_median-3.0576273279853923
deviation-center-line_median2.2449495692909824


other stats
deviation-center-line_max2.8672716726551895
deviation-center-line_mean2.2852900336427697
deviation-center-line_min1.783989323333925
deviation-heading_max33.847965306963346
deviation-heading_mean24.45936116834886
deviation-heading_median24.774713436194947
deviation-heading_min14.440052494042195
distance-from-start_max0.16606227998682907
distance-from-start_mean0.1594275212027207
distance-from-start_median0.16267443403825604
distance-from-start_min0.14629893674754163
driven_any_max12.411939615166784
driven_any_mean10.177297954978854
driven_any_median11.562929713356452
driven_any_min5.171392778035727
driven_lanedir_consec_max-0.4172079666896622
driven_lanedir_consec_mean-2.6203533333253484
driven_lanedir_consec_min-3.948950710640946
driven_lanedir_max-0.4172079666896622
driven_lanedir_mean-2.756275483714901
driven_lanedir_median-3.3294716287644976
driven_lanedir_min-3.948950710640946
in-drivable-lane_max43.549999999998626
in-drivable-lane_mean30.374999999999197
in-drivable-lane_min17.949999999999584
per-episodes
details{"zigzag-000-ego0": {"driven_any": 11.457632273593012, "survival_time": 59.99999999999873, "driven_lanedir": -3.5890236376011937, "in-drivable-lane": 17.949999999999584, "deviation-heading": 33.847965306963346, "distance-from-start": 0.16059544995616565, "deviation-center-line": 2.463182715692119, "driven_lanedir_consec": -3.5890236376011937}, "zigzag-000-ego1": {"driven_any": 11.668227153119892, "survival_time": 59.99999999999873, "driven_lanedir": -3.948950710640946, "in-drivable-lane": 21.299999999999493, "deviation-heading": 32.94702214909827, "distance-from-start": 0.14629893674754163, "deviation-center-line": 2.8672716726551895, "driven_lanedir_consec": -3.948950710640946}, "zigzag-000-ego2": {"driven_any": 12.411939615166784, "survival_time": 59.99999999999873, "driven_lanedir": -3.0699196199278016, "in-drivable-lane": 38.69999999999908, "deviation-heading": 16.602404723291627, "distance-from-start": 0.16606227998682907, "deviation-center-line": 2.0267164228898453, "driven_lanedir_consec": -2.526231018369591}, "zigzag-000-ego3": {"driven_any": 5.171392778035727, "survival_time": 59.99999999999873, "driven_lanedir": -0.4172079666896622, "in-drivable-lane": 43.549999999998626, "deviation-heading": 14.440052494042195, "distance-from-start": 0.16475341812034644, "deviation-center-line": 1.783989323333925, "driven_lanedir_consec": -0.4172079666896622}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14968394Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:10:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median22.349999999999365
driven_lanedir_consec_median-2.2571493733823167
deviation-center-line_median4.159181579152947


other stats
deviation-center-line_max4.159181579152947
deviation-center-line_mean4.159181579152947
deviation-center-line_min4.159181579152947
deviation-heading_max27.13152564075344
deviation-heading_mean27.13152564075344
deviation-heading_median27.13152564075344
deviation-heading_min27.13152564075344
distance-from-start_max0.13251719729843456
distance-from-start_mean0.13251719729843456
distance-from-start_median0.13251719729843456
distance-from-start_min0.13251719729843456
driven_any_max10.45075346624932
driven_any_mean10.45075346624932
driven_any_median10.45075346624932
driven_any_min10.45075346624932
driven_lanedir_consec_max-2.2571493733823167
driven_lanedir_consec_mean-2.2571493733823167
driven_lanedir_consec_min-2.2571493733823167
driven_lanedir_max-2.2571493733823167
driven_lanedir_mean-2.2571493733823167
driven_lanedir_median-2.2571493733823167
driven_lanedir_min-2.2571493733823167
in-drivable-lane_max22.349999999999365
in-drivable-lane_mean22.349999999999365
in-drivable-lane_min22.349999999999365
per-episodes
details{"loop2-000-ego0": {"driven_any": 10.45075346624932, "survival_time": 59.99999999999873, "driven_lanedir": -2.2571493733823167, "in-drivable-lane": 22.349999999999365, "deviation-heading": 27.13152564075344, "distance-from-start": 0.13251719729843456, "deviation-center-line": 4.159181579152947, "driven_lanedir_consec": -2.2571493733823167}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14967394Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-testingsim-0of4successnodavinci-stage-03-6.2.500:05:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median13.550000000000058
in-drivable-lane_median6.750000000000029
driven_lanedir_consec_median-0.7931637738044943
deviation-center-line_median0.265520800776268


other stats
deviation-center-line_max0.265520800776268
deviation-center-line_mean0.265520800776268
deviation-center-line_min0.265520800776268
deviation-heading_max6.0608766669388
deviation-heading_mean6.0608766669388
deviation-heading_median6.0608766669388
deviation-heading_min6.0608766669388
distance-from-start_max0.16066113901798962
distance-from-start_mean0.16066113901798962
distance-from-start_median0.16066113901798962
distance-from-start_min0.16066113901798962
driven_any_max2.477994186915919
driven_any_mean2.477994186915919
driven_any_median2.477994186915919
driven_any_min2.477994186915919
driven_lanedir_consec_max-0.7931637738044943
driven_lanedir_consec_mean-0.7931637738044943
driven_lanedir_consec_min-0.7931637738044943
driven_lanedir_max-0.7931637738044943
driven_lanedir_mean-0.7931637738044943
driven_lanedir_median-0.7931637738044943
driven_lanedir_min-0.7931637738044943
in-drivable-lane_max6.750000000000029
in-drivable-lane_mean6.750000000000029
in-drivable-lane_min6.750000000000029
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.477994186915919, "survival_time": 13.550000000000058, "driven_lanedir": -0.7931637738044943, "in-drivable-lane": 6.750000000000029, "deviation-heading": 6.0608766669388, "distance-from-start": 0.16066113901798962, "deviation-center-line": 0.265520800776268, "driven_lanedir_consec": -0.7931637738044943}}
simulation-passed1
survival_time_max13.550000000000058
survival_time_mean13.550000000000058
survival_time_min13.550000000000058
No reset possible
14964394Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-testingsim-1of4successnodavinci-stage-03-6.2.500:04:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.100000000000025
in-drivable-lane_median6.10000000000001
driven_lanedir_consec_median-0.6621452117318065
deviation-center-line_median0.2127191629116179


other stats
deviation-center-line_max0.2127191629116179
deviation-center-line_mean0.2127191629116179
deviation-center-line_min0.2127191629116179
deviation-heading_max3.750276198266524
deviation-heading_mean3.750276198266524
deviation-heading_median3.750276198266524
deviation-heading_min3.750276198266524
distance-from-start_max0.1631747392663352
distance-from-start_mean0.1631747392663352
distance-from-start_median0.1631747392663352
distance-from-start_min0.1631747392663352
driven_any_max2.0872849840662617
driven_any_mean2.0872849840662617
driven_any_median2.0872849840662617
driven_any_min2.0872849840662617
driven_lanedir_consec_max-0.6621452117318065
driven_lanedir_consec_mean-0.6621452117318065
driven_lanedir_consec_min-0.6621452117318065
driven_lanedir_max-0.6621452117318065
driven_lanedir_mean-0.6621452117318065
driven_lanedir_median-0.6621452117318065
driven_lanedir_min-0.6621452117318065
in-drivable-lane_max6.10000000000001
in-drivable-lane_mean6.10000000000001
in-drivable-lane_min6.10000000000001
per-episodes
details{"loop-000-ego0": {"driven_any": 2.0872849840662617, "survival_time": 11.100000000000025, "driven_lanedir": -0.6621452117318065, "in-drivable-lane": 6.10000000000001, "deviation-heading": 3.750276198266524, "distance-from-start": 0.1631747392663352, "deviation-center-line": 0.2127191629116179, "driven_lanedir_consec": -0.6621452117318065}}
simulation-passed1
survival_time_max11.100000000000025
survival_time_mean11.100000000000025
survival_time_min11.100000000000025
No reset possible
14963395Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-testingsim-1of4successnodavinci-stage-03-6.2.500:05:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median13.950000000000063
in-drivable-lane_median6.800000000000029
driven_lanedir_consec_median-0.9803913459522292
deviation-center-line_median0.29465057664847183


other stats
deviation-center-line_max0.29465057664847183
deviation-center-line_mean0.29465057664847183
deviation-center-line_min0.29465057664847183
deviation-heading_max5.6398905572363915
deviation-heading_mean5.6398905572363915
deviation-heading_median5.6398905572363915
deviation-heading_min5.6398905572363915
distance-from-start_max0.1639730317737584
distance-from-start_mean0.1639730317737584
distance-from-start_median0.1639730317737584
distance-from-start_min0.1639730317737584
driven_any_max3.0462903469261025
driven_any_mean3.0462903469261025
driven_any_median3.0462903469261025
driven_any_min3.0462903469261025
driven_lanedir_consec_max-0.9803913459522292
driven_lanedir_consec_mean-0.9803913459522292
driven_lanedir_consec_min-0.9803913459522292
driven_lanedir_max-0.9688816545308868
driven_lanedir_mean-0.9688816545308868
driven_lanedir_median-0.9688816545308868
driven_lanedir_min-0.9688816545308868
in-drivable-lane_max6.800000000000029
in-drivable-lane_mean6.800000000000029
in-drivable-lane_min6.800000000000029
per-episodes
details{"4way-000-ego0": {"driven_any": 3.0462903469261025, "survival_time": 13.950000000000063, "driven_lanedir": -0.9688816545308868, "in-drivable-lane": 6.800000000000029, "deviation-heading": 5.6398905572363915, "distance-from-start": 0.1639730317737584, "deviation-center-line": 0.29465057664847183, "driven_lanedir_consec": -0.9803913459522292}}
simulation-passed1
survival_time_max13.950000000000063
survival_time_mean13.950000000000063
survival_time_min13.950000000000063
No reset possible
14961395Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14959396Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14955398Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14950514Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-validationsim-3of4failednodavinci-stage-03-6.2.500:01:13
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14947515Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-validationsim-3of4failednodavinci-stage-03-6.2.500:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14941516Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-validationsim-2of4failednodavinci-stage-03-6.2.500:01:36
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14935517Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-validationsim-1of4failednodavinci-stage-03-6.2.500:01:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14931519Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-validationsim-0of4failednodavinci-stage-03-6.2.500:00:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14926520Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-validationsim-1of4failednodavinci-stage-03-6.2.500:01:16
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14921521Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-testingsim-3of4failednodavinci-stage-03-6.2.500:01:19
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14917522Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-testingsim-1of4failednodavinci-stage-03-6.2.500:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14915523Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-testingsim-0of4failednodavinci-stage-03-6.2.500:01:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14914523Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-testingsim-1of4failednodavinci-stage-03-6.2.500:01:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14912523Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-testingsim-3of4failednodavinci-stage-03-6.2.500:01:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14910524Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-testingsim-0of4host-errornodavinci-stage-03-6.2.500:01:38
The container "npc0" [...]
The container "npc0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14908524Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-testingsim-1of4failednodavinci-stage-03-6.2.500:01:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14906525Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14904525Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14891530Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:16:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.9999999999999752
driven_lanedir_consec_median8.505408989634473
deviation-center-line_median3.415676678287276


other stats
deviation-center-line_max3.415676678287276
deviation-center-line_mean3.415676678287276
deviation-center-line_min3.415676678287276
deviation-heading_max15.677167498461452
deviation-heading_mean15.677167498461452
deviation-heading_median15.677167498461452
deviation-heading_min15.677167498461452
distance-from-start_max4.530664498326325
distance-from-start_mean4.530664498326325
distance-from-start_median4.530664498326325
distance-from-start_min4.530664498326325
driven_any_max9.275026162291438
driven_any_mean9.275026162291438
driven_any_median9.275026162291438
driven_any_min9.275026162291438
driven_lanedir_consec_max8.505408989634473
driven_lanedir_consec_mean8.505408989634473
driven_lanedir_consec_min8.505408989634473
driven_lanedir_max8.505408989634473
driven_lanedir_mean8.505408989634473
driven_lanedir_median8.505408989634473
driven_lanedir_min8.505408989634473
in-drivable-lane_max0.9999999999999752
in-drivable-lane_mean0.9999999999999752
in-drivable-lane_min0.9999999999999752
per-episodes
details{"zigzag-000-ego0": {"driven_any": 9.275026162291438, "survival_time": 59.99999999999873, "driven_lanedir": 8.505408989634473, "in-drivable-lane": 0.9999999999999752, "deviation-heading": 15.677167498461452, "distance-from-start": 4.530664498326325, "deviation-center-line": 3.415676678287276, "driven_lanedir_consec": 8.505408989634473}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14885531Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-validationsim-1of4successnodavinci-stage-03-6.2.500:05:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.5000000000001
in-drivable-lane_median0.0
driven_lanedir_consec_median2.071413008230462
deviation-center-line_median0.9155829338598144


other stats
deviation-center-line_max0.9155829338598144
deviation-center-line_mean0.9155829338598144
deviation-center-line_min0.9155829338598144
deviation-heading_max5.178358169683556
deviation-heading_mean5.178358169683556
deviation-heading_median5.178358169683556
deviation-heading_min5.178358169683556
distance-from-start_max1.105256704581045
distance-from-start_mean1.105256704581045
distance-from-start_median1.105256704581045
distance-from-start_min1.105256704581045
driven_any_max2.1959447493852777
driven_any_mean2.1959447493852777
driven_any_median2.1959447493852777
driven_any_min2.1959447493852777
driven_lanedir_consec_max2.071413008230462
driven_lanedir_consec_mean2.071413008230462
driven_lanedir_consec_min2.071413008230462
driven_lanedir_max2.0719513779470353
driven_lanedir_mean2.0719513779470353
driven_lanedir_median2.0719513779470353
driven_lanedir_min2.0719513779470353
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 2.1959447493852777, "survival_time": 16.5000000000001, "driven_lanedir": 2.0719513779470353, "in-drivable-lane": 0.0, "deviation-heading": 5.178358169683556, "distance-from-start": 1.105256704581045, "deviation-center-line": 0.9155829338598144, "driven_lanedir_consec": 2.071413008230462}}
simulation-passed1
survival_time_max16.5000000000001
survival_time_mean16.5000000000001
survival_time_min16.5000000000001
No reset possible
14880532Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-validationsim-0of4successnodavinci-stage-03-6.2.500:03:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median23.900000000000205
in-drivable-lane_median0.0
driven_lanedir_consec_median3.5363828262901373
deviation-center-line_median1.2397507406902135


other stats
deviation-center-line_max1.2397507406902135
deviation-center-line_mean1.2397507406902135
deviation-center-line_min1.2397507406902135
deviation-heading_max6.510278715391559
deviation-heading_mean6.510278715391559
deviation-heading_median6.510278715391559
deviation-heading_min6.510278715391559
distance-from-start_max1.0131390019939708
distance-from-start_mean1.0131390019939708
distance-from-start_median1.0131390019939708
distance-from-start_min1.0131390019939708
driven_any_max3.682258286880969
driven_any_mean3.682258286880969
driven_any_median3.682258286880969
driven_any_min3.682258286880969
driven_lanedir_consec_max3.5363828262901373
driven_lanedir_consec_mean3.5363828262901373
driven_lanedir_consec_min3.5363828262901373
driven_lanedir_max3.5363833209189695
driven_lanedir_mean3.5363833209189695
driven_lanedir_median3.5363833209189695
driven_lanedir_min3.5363833209189695
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 3.682258286880969, "survival_time": 23.900000000000205, "driven_lanedir": 3.5363833209189695, "in-drivable-lane": 0.0, "deviation-heading": 6.510278715391559, "distance-from-start": 1.0131390019939708, "deviation-center-line": 1.2397507406902135, "driven_lanedir_consec": 3.5363828262901373}}
simulation-passed1
survival_time_max23.900000000000205
survival_time_mean23.900000000000205
survival_time_min23.900000000000205
No reset possible
14871535Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-testingsim-0of4successnodavinci-stage-03-6.2.500:14:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median40.24999999999985
in-drivable-lane_median0.4750000000000067
driven_lanedir_consec_median4.4187527138631335
deviation-center-line_median1.925457849064667


other stats
deviation-center-line_max4.516228377675819
deviation-center-line_mean2.46144330838555
deviation-center-line_min1.4786291577370467
deviation-heading_max15.443294376978931
deviation-heading_mean10.527405191367183
deviation-heading_median9.18536228579613
deviation-heading_min8.295601816897546
distance-from-start_max4.44623383929986
distance-from-start_mean3.2546974094725485
distance-from-start_median2.947389875445426
distance-from-start_min2.67777604769948
driven_any_max6.9276576416463165
driven_any_mean5.057198522845318
driven_any_median4.849582887113804
driven_any_min3.601970675507349
driven_lanedir_consec_max6.649720920744032
driven_lanedir_consec_mean4.667263300159762
driven_lanedir_consec_min3.181826852168749
driven_lanedir_max6.649720920744032
driven_lanedir_mean4.667263300159762
driven_lanedir_median4.4187527138631335
driven_lanedir_min3.181826852168749
in-drivable-lane_max1.9499999999999176
in-drivable-lane_mean0.7249999999999828
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 6.9276576416463165, "survival_time": 40.24999999999985, "driven_lanedir": 6.649720920744032, "in-drivable-lane": 0.0, "deviation-heading": 8.295601816897546, "distance-from-start": 4.44623383929986, "deviation-center-line": 1.5710558331735385, "driven_lanedir_consec": 6.649720920744032}, "autolab-000-ego1": {"driven_any": 4.058662761406357, "survival_time": 40.24999999999985, "driven_lanedir": 3.790079729044014, "in-drivable-lane": 0.0, "deviation-heading": 8.588083578611005, "distance-from-start": 2.67777604769948, "deviation-center-line": 1.4786291577370467, "driven_lanedir_consec": 3.790079729044014}, "autolab-000-ego2": {"driven_any": 5.6405030128212506, "survival_time": 40.24999999999985, "driven_lanedir": 5.047425698682254, "in-drivable-lane": 1.9499999999999176, "deviation-heading": 9.782640992981252, "distance-from-start": 2.959798355687644, "deviation-center-line": 2.2798598649557955, "driven_lanedir_consec": 5.047425698682254}, "autolab-000-ego3": {"driven_any": 3.601970675507349, "survival_time": 40.24999999999985, "driven_lanedir": 3.181826852168749, "in-drivable-lane": 0.9500000000000136, "deviation-heading": 15.443294376978931, "distance-from-start": 2.9349813952032098, "deviation-center-line": 4.516228377675819, "driven_lanedir_consec": 3.181826852168749}}
simulation-passed1
survival_time_max40.24999999999985
survival_time_mean40.24999999999985
survival_time_min40.24999999999985
No reset possible
14859537Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:16:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median17.550000000000175
driven_lanedir_consec_median3.9264344172728056
deviation-center-line_median2.154021884887452


other stats
deviation-center-line_max2.154021884887452
deviation-center-line_mean2.154021884887452
deviation-center-line_min2.154021884887452
deviation-heading_max12.84158736559225
deviation-heading_mean12.84158736559225
deviation-heading_median12.84158736559225
deviation-heading_min12.84158736559225
distance-from-start_max1.9508168450179355
distance-from-start_mean1.9508168450179355
distance-from-start_median1.9508168450179355
distance-from-start_min1.9508168450179355
driven_any_max10.557186291399631
driven_any_mean10.557186291399631
driven_any_median10.557186291399631
driven_any_min10.557186291399631
driven_lanedir_consec_max3.9264344172728056
driven_lanedir_consec_mean3.9264344172728056
driven_lanedir_consec_min3.9264344172728056
driven_lanedir_max6.641925927960137
driven_lanedir_mean6.641925927960137
driven_lanedir_median6.641925927960137
driven_lanedir_min6.641925927960137
in-drivable-lane_max17.550000000000175
in-drivable-lane_mean17.550000000000175
in-drivable-lane_min17.550000000000175
per-episodes
details{"zigzag-000-ego0": {"driven_any": 10.557186291399631, "survival_time": 59.99999999999873, "driven_lanedir": 6.641925927960137, "in-drivable-lane": 17.550000000000175, "deviation-heading": 12.84158736559225, "distance-from-start": 1.9508168450179355, "deviation-center-line": 2.154021884887452, "driven_lanedir_consec": 3.9264344172728056}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14858538Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14853539Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-testingsim-1of4successnodavinci-stage-03-6.2.500:03:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median18.35000000000013
in-drivable-lane_median1.8500000000000263
driven_lanedir_consec_median2.429731276860595
deviation-center-line_median0.9334770559979112


other stats
deviation-center-line_max0.9334770559979112
deviation-center-line_mean0.9334770559979112
deviation-center-line_min0.9334770559979112
deviation-heading_max4.83520390457243
deviation-heading_mean4.83520390457243
deviation-heading_median4.83520390457243
deviation-heading_min4.83520390457243
distance-from-start_max2.087712660250505
distance-from-start_mean2.087712660250505
distance-from-start_median2.087712660250505
distance-from-start_min2.087712660250505
driven_any_max2.804158174766413
driven_any_mean2.804158174766413
driven_any_median2.804158174766413
driven_any_min2.804158174766413
driven_lanedir_consec_max2.429731276860595
driven_lanedir_consec_mean2.429731276860595
driven_lanedir_consec_min2.429731276860595
driven_lanedir_max2.429731276860595
driven_lanedir_mean2.429731276860595
driven_lanedir_median2.429731276860595
driven_lanedir_min2.429731276860595
in-drivable-lane_max1.8500000000000263
in-drivable-lane_mean1.8500000000000263
in-drivable-lane_min1.8500000000000263
per-episodes
details{"udem1-000-ego0": {"driven_any": 2.804158174766413, "survival_time": 18.35000000000013, "driven_lanedir": 2.429731276860595, "in-drivable-lane": 1.8500000000000263, "deviation-heading": 4.83520390457243, "distance-from-start": 2.087712660250505, "deviation-center-line": 0.9334770559979112, "driven_lanedir_consec": 2.429731276860595}}
simulation-passed1
survival_time_max18.35000000000013
survival_time_mean18.35000000000013
survival_time_min18.35000000000013
No reset possible
14849541Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:05:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.148872970268547
survival_time_median59.99999999999873
deviation-center-line_median3.782361551682099
in-drivable-lane_median3.4499999999999913


other stats
deviation-center-line_max3.782361551682099
deviation-center-line_mean3.782361551682099
deviation-center-line_min3.782361551682099
deviation-heading_max18.597924416871596
deviation-heading_mean18.597924416871596
deviation-heading_median18.597924416871596
deviation-heading_min18.597924416871596
distance-from-start_max1.6164994402487924
distance-from-start_mean1.6164994402487924
distance-from-start_median1.6164994402487924
distance-from-start_min1.6164994402487924
driven_any_max10.80490027242701
driven_any_mean10.80490027242701
driven_any_median10.80490027242701
driven_any_min10.80490027242701
driven_lanedir_consec_max9.148872970268547
driven_lanedir_consec_mean9.148872970268547
driven_lanedir_consec_min9.148872970268547
driven_lanedir_max9.148872970268547
driven_lanedir_mean9.148872970268547
driven_lanedir_median9.148872970268547
driven_lanedir_min9.148872970268547
in-drivable-lane_max3.4499999999999913
in-drivable-lane_mean3.4499999999999913
in-drivable-lane_min3.4499999999999913
per-episodes
details{"loop2-000-ego0": {"driven_any": 10.80490027242701, "survival_time": 59.99999999999873, "driven_lanedir": 9.148872970268547, "in-drivable-lane": 3.4499999999999913, "deviation-heading": 18.597924416871596, "distance-from-start": 1.6164994402487924, "deviation-center-line": 3.782361551682099, "driven_lanedir_consec": 9.148872970268547}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14848542Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-testingsim-0of4failednodavinci-stage-03-6.2.500:01:03
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14841595Liam Paullbaseline-duckietownaido-LF-sim-validationsim-0of4failednodavinci-stage-03-6.2.500:00:55
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14835595Liam Paullbaseline-duckietownaido-LF-sim-validationsim-3of4failednodavinci-stage-03-6.2.500:00:56
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14831764Bea Baselines 🐤challenge-aido_LF-baseline-duckietown:daffy:d0c3b9f200e160334a96bdb0f91745327be57194aido-hello-sim-validationsanity-checksuccessnodavinci-stage-03-6.2.500:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.013461524275151904
deviation-center-line_median0.006583941198228151


other stats
deviation-center-line_max0.006583941198228151
deviation-center-line_mean0.006583941198228151
deviation-center-line_min0.006583941198228151
deviation-heading_max0.25871769826801777
deviation-heading_mean0.25871769826801777
deviation-heading_median0.25871769826801777
deviation-heading_min0.25871769826801777
distance-from-start_max0.015072515347372905
distance-from-start_mean0.015072515347372905
distance-from-start_median0.015072515347372905
distance-from-start_min0.015072515347372905
driven_any_max0.0150841388039882
driven_any_mean0.0150841388039882
driven_any_median0.0150841388039882
driven_any_min0.0150841388039882
driven_lanedir_consec_max0.013461524275151904
driven_lanedir_consec_mean0.013461524275151904
driven_lanedir_consec_min0.013461524275151904
driven_lanedir_max0.013461524275151904
driven_lanedir_mean0.013461524275151904
driven_lanedir_median0.013461524275151904
driven_lanedir_min0.013461524275151904
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.0150841388039882, "survival_time": 0.49999999999999994, "driven_lanedir": 0.013461524275151904, "in-drivable-lane": 0.0, "deviation-heading": 0.25871769826801777, "distance-from-start": 0.015072515347372905, "deviation-center-line": 0.006583941198228151, "driven_lanedir_consec": 0.013461524275151904}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
14829766Bea Baselines 🐤challenge-aido_LF-template-tensorflow:daffy-staging:38486fc8c2bf41d1f9b206035ae484c5873c8a4baido-hello-sim-validationsanity-checkfailednodavinci-stage-03-6.2.500:01:19
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14825795Bea Baselines 🐤challenge-aido_LF-template-pytorch:daffy-staging:c5eb3df1f1017464ea091cbc60ac41b043b03a95aido-hello-sim-validationsanity-checksuccessnodavinci-stage-03-6.2.500:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.017683939985298602
deviation-center-line_median0.005438815807733007


other stats
deviation-center-line_max0.005438815807733007
deviation-center-line_mean0.005438815807733007
deviation-center-line_min0.005438815807733007
deviation-heading_max0.3154064173254528
deviation-heading_mean0.3154064173254528
deviation-heading_median0.3154064173254528
deviation-heading_min0.3154064173254528
distance-from-start_max0.024363319738286888
distance-from-start_mean0.024363319738286888
distance-from-start_median0.024363319738286888
distance-from-start_min0.024363319738286888
driven_any_max0.024538034935385287
driven_any_mean0.024538034935385287
driven_any_median0.024538034935385287
driven_any_min0.024538034935385287
driven_lanedir_consec_max0.017683939985298602
driven_lanedir_consec_mean0.017683939985298602
driven_lanedir_consec_min0.017683939985298602
driven_lanedir_max0.017683939985298602
driven_lanedir_mean0.017683939985298602
driven_lanedir_median0.017683939985298602
driven_lanedir_min0.017683939985298602
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.024538034935385287, "survival_time": 0.49999999999999994, "driven_lanedir": 0.017683939985298602, "in-drivable-lane": 0.0, "deviation-heading": 0.3154064173254528, "distance-from-start": 0.024363319738286888, "deviation-center-line": 0.005438815807733007, "driven_lanedir_consec": 0.017683939985298602}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
14821800Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-0of4failednodavinci-stage-03-6.2.500:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14817801Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-0of4failednodavinci-stage-03-6.2.500:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14815803Bea Baselines 🐤challenge-aido_LF-template-ros:daffy-staging:3b1546b6959e8affea32711104eb83074ec984eaaido-hello-sim-validationsanity-checksuccessnodavinci-stage-03-6.2.500:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.056259816797334494
deviation-center-line_median0.007589238509820164


other stats
deviation-center-line_max0.007589238509820164
deviation-center-line_mean0.007589238509820164
deviation-center-line_min0.007589238509820164
deviation-heading_max0.2742294179269786
deviation-heading_mean0.2742294179269786
deviation-heading_median0.2742294179269786
deviation-heading_min0.2742294179269786
distance-from-start_max0.06630187128701073
distance-from-start_mean0.06630187128701073
distance-from-start_median0.06630187128701073
distance-from-start_min0.06630187128701073
driven_any_max0.06630606948583491
driven_any_mean0.06630606948583491
driven_any_median0.06630606948583491
driven_any_min0.06630606948583491
driven_lanedir_consec_max0.056259816797334494
driven_lanedir_consec_mean0.056259816797334494
driven_lanedir_consec_min0.056259816797334494
driven_lanedir_max0.056259816797334494
driven_lanedir_mean0.056259816797334494
driven_lanedir_median0.056259816797334494
driven_lanedir_min0.056259816797334494
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.06630606948583491, "survival_time": 0.49999999999999994, "driven_lanedir": 0.056259816797334494, "in-drivable-lane": 0.0, "deviation-heading": 0.2742294179269786, "distance-from-start": 0.06630187128701073, "deviation-center-line": 0.007589238509820164, "driven_lanedir_consec": 0.056259816797334494}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
14812805Bea Baselines 🐤challenge-aido_LF-baseline-duckietown:daffy-staging:06423b9f834b346c04889a28f919db3673a8d2c1aido-hello-sim-validationsanity-checksuccessnodavinci-stage-03-6.2.500:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.013001974930733295
deviation-center-line_median0.006518526408135585


other stats
deviation-center-line_max0.006518526408135585
deviation-center-line_mean0.006518526408135585
deviation-center-line_min0.006518526408135585
deviation-heading_max0.26904523012973774
deviation-heading_mean0.26904523012973774
deviation-heading_median0.26904523012973774
deviation-heading_min0.26904523012973774
distance-from-start_max0.015083298117845685
distance-from-start_mean0.015083298117845685
distance-from-start_median0.015083298117845685
distance-from-start_min0.015083298117845685
driven_any_max0.015084719639026665
driven_any_mean0.015084719639026665
driven_any_median0.015084719639026665
driven_any_min0.015084719639026665
driven_lanedir_consec_max0.013001974930733295
driven_lanedir_consec_mean0.013001974930733295
driven_lanedir_consec_min0.013001974930733295
driven_lanedir_max0.013001974930733295
driven_lanedir_mean0.013001974930733295
driven_lanedir_median0.013001974930733295
driven_lanedir_min0.013001974930733295
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.015084719639026665, "survival_time": 0.49999999999999994, "driven_lanedir": 0.013001974930733295, "in-drivable-lane": 0.0, "deviation-heading": 0.26904523012973774, "distance-from-start": 0.015083298117845685, "deviation-center-line": 0.006518526408135585, "driven_lanedir_consec": 0.013001974930733295}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
14809806user1000001minimal-agentaido-LFV-sim-validationsim-1of4successnodavinci-stage-03-6.2.500:03:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.700000000000044
in-drivable-lane_median10.950000000000044
driven_lanedir_consec_median0.19955171937759708
deviation-center-line_median0.12567511082985278


other stats
deviation-center-line_max0.12567511082985278
deviation-center-line_mean0.12567511082985278
deviation-center-line_min0.12567511082985278
deviation-heading_max0.9488219555580464
deviation-heading_mean0.9488219555580464
deviation-heading_median0.9488219555580464
deviation-heading_min0.9488219555580464
distance-from-start_max1.924049384083022
distance-from-start_mean1.924049384083022
distance-from-start_median1.924049384083022
distance-from-start_min1.924049384083022
driven_any_max1.924195440713655
driven_any_mean1.924195440713655
driven_any_median1.924195440713655
driven_any_min1.924195440713655
driven_lanedir_consec_max0.19955171937759708
driven_lanedir_consec_mean0.19955171937759708
driven_lanedir_consec_min0.19955171937759708
driven_lanedir_max0.19955171937759708
driven_lanedir_mean0.19955171937759708
driven_lanedir_median0.19955171937759708
driven_lanedir_min0.19955171937759708
in-drivable-lane_max10.950000000000044
in-drivable-lane_mean10.950000000000044
in-drivable-lane_min10.950000000000044
per-episodes
details{"loop-000-ego0": {"driven_any": 1.924195440713655, "survival_time": 12.700000000000044, "driven_lanedir": 0.19955171937759708, "in-drivable-lane": 10.950000000000044, "deviation-heading": 0.9488219555580464, "distance-from-start": 1.924049384083022, "deviation-center-line": 0.12567511082985278, "driven_lanedir_consec": 0.19955171937759708}}
simulation-passed1
survival_time_max12.700000000000044
survival_time_mean12.700000000000044
survival_time_min12.700000000000044
No reset possible
14805808Andrea Censitemplate-randomaido-LFV-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:04:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median24.750000000000217
in-drivable-lane_median16.200000000000195
driven_lanedir_consec_median0.2676465159268615
deviation-center-line_median0.7555297758130887


other stats
deviation-center-line_max0.7555297758130887
deviation-center-line_mean0.7555297758130887
deviation-center-line_min0.7555297758130887
deviation-heading_max5.523299068383883
deviation-heading_mean5.523299068383883
deviation-heading_median5.523299068383883
deviation-heading_min5.523299068383883
distance-from-start_max0.796098057853727
distance-from-start_mean0.796098057853727
distance-from-start_median0.796098057853727
distance-from-start_min0.796098057853727
driven_any_max6.0666647982270385
driven_any_mean6.0666647982270385
driven_any_median6.0666647982270385
driven_any_min6.0666647982270385
driven_lanedir_consec_max0.2676465159268615
driven_lanedir_consec_mean0.2676465159268615
driven_lanedir_consec_min0.2676465159268615
driven_lanedir_max0.24963703198272744
driven_lanedir_mean0.24963703198272744
driven_lanedir_median0.24963703198272744
driven_lanedir_min0.24963703198272744
in-drivable-lane_max16.200000000000195
in-drivable-lane_mean16.200000000000195
in-drivable-lane_min16.200000000000195
per-episodes
details{"loop2-000-ego0": {"driven_any": 6.0666647982270385, "survival_time": 24.750000000000217, "driven_lanedir": 0.24963703198272744, "in-drivable-lane": 16.200000000000195, "deviation-heading": 5.523299068383883, "distance-from-start": 0.796098057853727, "deviation-center-line": 0.7555297758130887, "driven_lanedir_consec": 0.2676465159268615}}
simulation-passed1
survival_time_max24.750000000000217
survival_time_mean24.750000000000217
survival_time_min24.750000000000217
No reset possible
14801809Andrea Censitemplate-randomaido-LFV-sim-validationsim-0of4successnodavinci-stage-03-6.2.500:02:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.699999999999995
in-drivable-lane_median0.9
driven_lanedir_consec_median0.364506838392066
deviation-center-line_median0.14696541332404583


other stats
deviation-center-line_max0.14696541332404583
deviation-center-line_mean0.14696541332404583
deviation-center-line_min0.14696541332404583
deviation-heading_max1.6699264400950062
deviation-heading_mean1.6699264400950062
deviation-heading_median1.6699264400950062
deviation-heading_min1.6699264400950062
distance-from-start_max0.3743806210373658
distance-from-start_mean0.3743806210373658
distance-from-start_median0.3743806210373658
distance-from-start_min0.3743806210373658
driven_any_max0.3944302398862539
driven_any_mean0.3944302398862539
driven_any_median0.3944302398862539
driven_any_min0.3944302398862539
driven_lanedir_consec_max0.364506838392066
driven_lanedir_consec_mean0.364506838392066
driven_lanedir_consec_min0.364506838392066
driven_lanedir_max0.364506838392066
driven_lanedir_mean0.364506838392066
driven_lanedir_median0.364506838392066
driven_lanedir_min0.364506838392066
in-drivable-lane_max0.9
in-drivable-lane_mean0.9
in-drivable-lane_min0.9
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.3944302398862539, "survival_time": 3.699999999999995, "driven_lanedir": 0.364506838392066, "in-drivable-lane": 0.9, "deviation-heading": 1.6699264400950062, "distance-from-start": 0.3743806210373658, "deviation-center-line": 0.14696541332404583, "driven_lanedir_consec": 0.364506838392066}}
simulation-passed1
survival_time_max3.699999999999995
survival_time_mean3.699999999999995
survival_time_min3.699999999999995
No reset possible
14796815Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-validationsim-1of4successnodavinci-stage-03-6.2.500:04:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.804192854394257
deviation-center-line_median0.16028545636710145


other stats
deviation-center-line_max0.16028545636710145
deviation-center-line_mean0.16028545636710145
deviation-center-line_min0.16028545636710145
deviation-heading_max1.6564513443463602
deviation-heading_mean1.6564513443463602
deviation-heading_median1.6564513443463602
deviation-heading_min1.6564513443463602
distance-from-start_max2.5357490341649536
distance-from-start_mean2.5357490341649536
distance-from-start_median2.5357490341649536
distance-from-start_min2.5357490341649536
driven_any_max5.81208847227964
driven_any_mean5.81208847227964
driven_any_median5.81208847227964
driven_any_min5.81208847227964
driven_lanedir_consec_max5.804192854394257
driven_lanedir_consec_mean5.804192854394257
driven_lanedir_consec_min5.804192854394257
driven_lanedir_max5.804192854394257
driven_lanedir_mean5.804192854394257
driven_lanedir_median5.804192854394257
driven_lanedir_min5.804192854394257
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 5.81208847227964, "survival_time": 59.99999999999873, "driven_lanedir": 5.804192854394257, "in-drivable-lane": 0.0, "deviation-heading": 1.6564513443463602, "distance-from-start": 2.5357490341649536, "deviation-center-line": 0.16028545636710145, "driven_lanedir_consec": 5.804192854394257}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14794816Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14789817Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:11:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median4.87044918682097
deviation-center-line_median0.1629208044133267


other stats
deviation-center-line_max3.4506790593202896
deviation-center-line_mean0.975722942917009
deviation-center-line_min0.12637110352109293
deviation-heading_max26.9052448670844
deviation-heading_mean7.787954995168265
deviation-heading_median1.622296803656659
deviation-heading_min1.001981506275341
distance-from-start_max3.1388446632722284
distance-from-start_mean1.8800227125863065
distance-from-start_median2.190623093536498
distance-from-start_min4.440892098500626e-16
driven_any_max5.732211587504052
driven_any_mean3.9710285465457744
driven_any_median5.075951299339257
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max5.726105869591416
driven_lanedir_consec_mean3.866751060808339
driven_lanedir_consec_min0.0
driven_lanedir_max5.72610611271169
driven_lanedir_mean3.9673328096636857
driven_lanedir_median5.071612562971525
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-001-ego0": {"driven_any": 4.62060007041619, "survival_time": 59.99999999999873, "driven_lanedir": 4.618548386263603, "in-drivable-lane": 0.0, "deviation-heading": 1.001981506275341, "distance-from-start": 3.1388446632722284, "deviation-center-line": 0.12637110352109293, "driven_lanedir_consec": 4.61854797027584}, "4way-001-ego1": {"driven_any": 5.732211587504052, "survival_time": 59.99999999999873, "driven_lanedir": 5.72610611271169, "in-drivable-lane": 0.0, "deviation-heading": 1.7047057639689014, "distance-from-start": 2.052047610153934, "deviation-center-line": 0.17436950864269551, "driven_lanedir_consec": 5.726105869591416}, "4way-001-ego2": {"driven_any": 5.531302528262324, "survival_time": 59.99999999999873, "driven_lanedir": 5.524676739679447, "in-drivable-lane": 0.0, "deviation-heading": 1.5398878433444168, "distance-from-start": 2.329198576919062, "deviation-center-line": 0.1514721001839579, "driven_lanedir_consec": 5.122350403366101}, "4way-001-ego3": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 26.9052448670844, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 3.4506790593202896, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14783818Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-validationsim-1of4successnodavinci-stage-03-6.2.500:10:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median1.3318472576969511
deviation-center-line_median0.6648693526614008


other stats
deviation-center-line_max0.6648693526614008
deviation-center-line_mean0.6648693526614008
deviation-center-line_min0.6648693526614008
deviation-heading_max4.49371507747449
deviation-heading_mean4.49371507747449
deviation-heading_median4.49371507747449
deviation-heading_min4.49371507747449
distance-from-start_max1.4319552848600958
distance-from-start_mean1.4319552848600958
distance-from-start_median1.4319552848600958
distance-from-start_min1.4319552848600958
driven_any_max1.8616750012145875
driven_any_mean1.8616750012145875
driven_any_median1.8616750012145875
driven_any_min1.8616750012145875
driven_lanedir_consec_max1.3318472576969511
driven_lanedir_consec_mean1.3318472576969511
driven_lanedir_consec_min1.3318472576969511
driven_lanedir_max1.8544941763277367
driven_lanedir_mean1.8544941763277367
driven_lanedir_median1.8544941763277367
driven_lanedir_min1.8544941763277367
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 1.8616750012145875, "survival_time": 59.99999999999873, "driven_lanedir": 1.8544941763277367, "in-drivable-lane": 0.0, "deviation-heading": 4.49371507747449, "distance-from-start": 1.4319552848600958, "deviation-center-line": 0.6648693526614008, "driven_lanedir_consec": 1.3318472576969511}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14778820Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:03:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.678569183796779
deviation-center-line_median0.4080169826843029


other stats
deviation-center-line_max0.4080169826843029
deviation-center-line_mean0.4080169826843029
deviation-center-line_min0.4080169826843029
deviation-heading_max3.400261711047307
deviation-heading_mean3.400261711047307
deviation-heading_median3.400261711047307
deviation-heading_min3.400261711047307
distance-from-start_max1.069625617276668
distance-from-start_mean1.069625617276668
distance-from-start_median1.069625617276668
distance-from-start_min1.069625617276668
driven_any_max5.695209014172635
driven_any_mean5.695209014172635
driven_any_median5.695209014172635
driven_any_min5.695209014172635
driven_lanedir_consec_max5.678569183796779
driven_lanedir_consec_mean5.678569183796779
driven_lanedir_consec_min5.678569183796779
driven_lanedir_max5.678569183796779
driven_lanedir_mean5.678569183796779
driven_lanedir_median5.678569183796779
driven_lanedir_min5.678569183796779
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 5.695209014172635, "survival_time": 59.99999999999873, "driven_lanedir": 5.678569183796779, "in-drivable-lane": 0.0, "deviation-heading": 3.400261711047307, "distance-from-start": 1.069625617276668, "deviation-center-line": 0.4080169826843029, "driven_lanedir_consec": 5.678569183796779}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14773821Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:04:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.791208880785928
deviation-center-line_median0.422779318982871


other stats
deviation-center-line_max0.422779318982871
deviation-center-line_mean0.422779318982871
deviation-center-line_min0.422779318982871
deviation-heading_max3.5609142078788527
deviation-heading_mean3.5609142078788527
deviation-heading_median3.5609142078788527
deviation-heading_min3.5609142078788527
distance-from-start_max3.7147561232030184
distance-from-start_mean3.7147561232030184
distance-from-start_median3.7147561232030184
distance-from-start_min3.7147561232030184
driven_any_max5.812151887501377
driven_any_mean5.812151887501377
driven_any_median5.812151887501377
driven_any_min5.812151887501377
driven_lanedir_consec_max5.791208880785928
driven_lanedir_consec_mean5.791208880785928
driven_lanedir_consec_min5.791208880785928
driven_lanedir_max5.791208880785928
driven_lanedir_mean5.791208880785928
driven_lanedir_median5.791208880785928
driven_lanedir_min5.791208880785928
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.812151887501377, "survival_time": 59.99999999999873, "driven_lanedir": 5.791208880785928, "in-drivable-lane": 0.0, "deviation-heading": 3.5609142078788527, "distance-from-start": 3.7147561232030184, "deviation-center-line": 0.422779318982871, "driven_lanedir_consec": 5.791208880785928}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14769822Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-testingsim-1of4successnodavinci-stage-03-6.2.500:04:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.4065274986524993


other stats
deviation-center-line_max0.4065274986524993
deviation-center-line_mean0.4065274986524993
deviation-center-line_min0.4065274986524993
deviation-heading_max40.967332753486254
deviation-heading_mean40.967332753486254
deviation-heading_median40.967332753486254
deviation-heading_min40.967332753486254
distance-from-start_max5.551115123125783e-17
distance-from-start_mean5.551115123125783e-17
distance-from-start_median5.551115123125783e-17
distance-from-start_min5.551115123125783e-17
driven_any_max6.661338147750939e-14
driven_any_mean6.661338147750939e-14
driven_any_median6.661338147750939e-14
driven_any_min6.661338147750939e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-000-ego0": {"driven_any": 6.661338147750939e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.4065274986524993, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14764823Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-testingsim-1of4successnodavinci-stage-03-6.2.500:10:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median1.527134503811414


other stats
deviation-center-line_max3.468395721180941
deviation-center-line_mean1.6864438380333175
deviation-center-line_min0.22311062332950052
deviation-heading_max37.82293240559152
deviation-heading_mean15.742347894422767
deviation-heading_median11.480770321404124
deviation-heading_min2.184918529291301
distance-from-start_max3.177442392514494
distance-from-start_mean0.7943605981286238
distance-from-start_median7.447602459741819e-16
distance-from-start_min0.0
driven_any_max6.082579575597374
driven_any_mean1.5206448938997903
driven_any_median8.937122951690024e-13
driven_any_min0.0
driven_lanedir_consec_max6.065368636558107
driven_lanedir_consec_mean1.5163421591395267
driven_lanedir_consec_min0.0
driven_lanedir_max6.065368636558107
driven_lanedir_mean1.5163421591395267
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 6.082579575597374, "survival_time": 59.99999999999873, "driven_lanedir": 6.065368636558107, "in-drivable-lane": 0.0, "deviation-heading": 2.184918529291301, "distance-from-start": 3.177442392514494, "deviation-center-line": 0.2918095725321498, "driven_lanedir_consec": 6.065368636558107}, "udem-000-ego1": {"driven_any": 1.19161639355867e-12, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005143, "distance-from-start": 9.930136612989092e-16, "deviation-center-line": 3.468395721180941, "driven_lanedir_consec": 0.0}, "udem-000-ego2": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 4.652112626803104, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.22311062332950052, "driven_lanedir_consec": 0.0}, "udem-000-ego3": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 0.0, "deviation-center-line": 2.7624594350906784, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14759825Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-testingsim-0of4successnodavinci-stage-03-6.2.500:09:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median1.806165216596741
deviation-center-line_median0.346929751854674


other stats
deviation-center-line_max3.4683962371431485
deviation-center-line_mean1.0771419870569272
deviation-center-line_min0.14631220737521272
deviation-heading_max18.309428016005143
deviation-heading_mean6.183544615708726
deviation-heading_median2.5217690015662964
deviation-heading_min1.3812124436971696
distance-from-start_max3.2999669320195104
distance-from-start_mean1.5546858371442225
distance-from-start_median1.459388208278689
distance-from-start_min3.1401849173675503e-16
driven_any_max5.037078959860759
driven_any_mean2.168309320245248
driven_any_median1.818079160559928
driven_any_min3.7682219008410875e-13
driven_lanedir_consec_max5.026911335982149
driven_lanedir_consec_mean2.159846205080773
driven_lanedir_consec_min0.0001430511474609375
driven_lanedir_max5.026911335982149
driven_lanedir_mean2.159846205080773
driven_lanedir_median1.806165216596741
driven_lanedir_min0.0001430511474609375
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.631893286204257, "survival_time": 59.99999999999873, "driven_lanedir": 1.6201843097857167, "in-drivable-lane": 0.0, "deviation-heading": 1.3812124436971696, "distance-from-start": 1.2742263432539964, "deviation-center-line": 0.14631220737521272, "driven_lanedir_consec": 1.6201843097857167}, "autolab-000-ego1": {"driven_any": 3.7682219008410875e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005143, "distance-from-start": 3.1401849173675503e-16, "deviation-center-line": 3.4683962371431485, "driven_lanedir_consec": 0.0001430511474609375}, "autolab-000-ego2": {"driven_any": 5.037078959860759, "survival_time": 59.99999999999873, "driven_lanedir": 5.026911335982149, "in-drivable-lane": 0.0, "deviation-heading": 2.8050873323880503, "distance-from-start": 3.2999669320195104, "deviation-center-line": 0.3909808473609087, "driven_lanedir_consec": 5.026911335982149}, "autolab-000-ego3": {"driven_any": 2.0042650349155986, "survival_time": 59.99999999999873, "driven_lanedir": 1.992146123407765, "in-drivable-lane": 0.0, "deviation-heading": 2.2384506707445424, "distance-from-start": 1.644550073303382, "deviation-center-line": 0.3028786563484393, "driven_lanedir_consec": 1.992146123407765}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14756826Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:05:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8948975282353535


other stats
deviation-center-line_max0.8948975282353535
deviation-center-line_mean0.8948975282353535
deviation-center-line_min0.8948975282353535
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max2.482534153247273e-16
distance-from-start_mean2.482534153247273e-16
distance-from-start_median2.482534153247273e-16
distance-from-start_min2.482534153247273e-16
driven_any_max2.9790409838966753e-13
driven_any_mean2.9790409838966753e-13
driven_any_median2.9790409838966753e-13
driven_any_min2.9790409838966753e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 0.8948975282353535, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14753826Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:02:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.899999999999991
in-drivable-lane_median0.0
driven_lanedir_consec_median0.3608923653025524
deviation-center-line_median0.051213017209835086


other stats
deviation-center-line_max0.051213017209835086
deviation-center-line_mean0.051213017209835086
deviation-center-line_min0.051213017209835086
deviation-heading_max0.6136512740909245
deviation-heading_mean0.6136512740909245
deviation-heading_median0.6136512740909245
deviation-heading_min0.6136512740909245
distance-from-start_max0.3609304026851721
distance-from-start_mean0.3609304026851721
distance-from-start_median0.3609304026851721
distance-from-start_min0.3609304026851721
driven_any_max0.3664829367467816
driven_any_mean0.3664829367467816
driven_any_median0.3664829367467816
driven_any_min0.3664829367467816
driven_lanedir_consec_max0.3608923653025524
driven_lanedir_consec_mean0.3608923653025524
driven_lanedir_consec_min0.3608923653025524
driven_lanedir_max0.3608923653025524
driven_lanedir_mean0.3608923653025524
driven_lanedir_median0.3608923653025524
driven_lanedir_min0.3608923653025524
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.3664829367467816, "survival_time": 4.899999999999991, "driven_lanedir": 0.3608923653025524, "in-drivable-lane": 0.0, "deviation-heading": 0.6136512740909245, "distance-from-start": 0.3609304026851721, "deviation-center-line": 0.051213017209835086, "driven_lanedir_consec": 0.3608923653025524}}
simulation-passed1
survival_time_max4.899999999999991
survival_time_mean4.899999999999991
survival_time_min4.899999999999991
No reset possible
14751827Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:02:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.649999999999988
in-drivable-lane_median0.0
driven_lanedir_consec_median0.4132337880721526
deviation-center-line_median0.17972902691412632


other stats
deviation-center-line_max0.17972902691412632
deviation-center-line_mean0.17972902691412632
deviation-center-line_min0.17972902691412632
deviation-heading_max1.5025479858278594
deviation-heading_mean1.5025479858278594
deviation-heading_median1.5025479858278594
deviation-heading_min1.5025479858278594
distance-from-start_max0.37886290004634626
distance-from-start_mean0.37886290004634626
distance-from-start_median0.37886290004634626
distance-from-start_min0.37886290004634626
driven_any_max0.4316381850886603
driven_any_mean0.4316381850886603
driven_any_median0.4316381850886603
driven_any_min0.4316381850886603
driven_lanedir_consec_max0.4132337880721526
driven_lanedir_consec_mean0.4132337880721526
driven_lanedir_consec_min0.4132337880721526
driven_lanedir_max0.4132337880721526
driven_lanedir_mean0.4132337880721526
driven_lanedir_median0.4132337880721526
driven_lanedir_min0.4132337880721526
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.4316381850886603, "survival_time": 5.649999999999988, "driven_lanedir": 0.4132337880721526, "in-drivable-lane": 0.0, "deviation-heading": 1.5025479858278594, "distance-from-start": 0.37886290004634626, "deviation-center-line": 0.17972902691412632, "driven_lanedir_consec": 0.4132337880721526}}
simulation-passed1
survival_time_max5.649999999999988
survival_time_mean5.649999999999988
survival_time_min5.649999999999988
No reset possible
14739911Bea Baselines 🐤baseline-solutionlx22-planning-dd-static-valistep1-3of4erroryesdavinci-stage-03-6.2.500:17:09
Waited 1007 seconds [...]
Waited 1007 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14735912Bea Baselines 🐤baseline-solutionlx22-planning-dd-empty-valistep1successyesdavinci-stage-03-6.2.500:11:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio1.0
duration11.168187248703932
complexity15.925925925925926
avg_min_distance0.8746658000716122


other stats
nfeasible27
nsamples27
No reset possible
14734913Bea Baselines 🐤baseline-solutionlx22-planning-cc-dynamic-valistep1-3of4successyesdavinci-stage-03-6.2.500:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
14733913Bea Baselines 🐤baseline-solutionlx22-planning-cc-dynamic-valistep1-1of4successyesdavinci-stage-03-6.2.500:00:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
14731913Bea Baselines 🐤baseline-solutionlx22-planning-cc-dynamic-valistep1-2of4successyesdavinci-stage-03-6.2.500:00:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
14730914Bea Baselines 🐤baseline-solutionlx22-planning-cc-static-valistep1-1of4successyesdavinci-stage-03-6.2.500:00:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
14722916Bea Baselines 🐤baseline-solutionlx22-planning-dd-dynamic-teststep1-0of4successyesdavinci-stage-03-6.2.500:14:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.6666666666666666
success_ratio1.0
duration41.94762152671762
complexity93.33333333333331
avg_min_distance0.01236624008597755


other stats
nfeasible3
nsamples3
No reset possible
14716919Bea Baselines 🐤baseline-solutionlx22-planning-cc-dynamic-teststep1-1of4erroryesdavinci-stage-03-6.2.500:17:07
Waited 1002 seconds [...]
Waited 1002 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14715919Bea Baselines 🐤baseline-solutionlx22-planning-cc-dynamic-teststep1-3of4successyesdavinci-stage-03-6.2.500:00:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
14713919Bea Baselines 🐤baseline-solutionlx22-planning-cc-dynamic-teststep1-2of4successyesdavinci-stage-03-6.2.500:00:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
14711920Bea Baselines 🐤baseline-solutionlx22-planning-cc-static-teststep1-1of4successyesdavinci-stage-03-6.2.500:00:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
14704929Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:05:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median14.650000000000071
in-drivable-lane_median2.4500000000000135
driven_lanedir_consec_median1.380212156879176
deviation-center-line_median0.9029461024707648


other stats
deviation-center-line_max0.9029461024707648
deviation-center-line_mean0.9029461024707648
deviation-center-line_min0.9029461024707648
deviation-heading_max5.035208109485201
deviation-heading_mean5.035208109485201
deviation-heading_median5.035208109485201
deviation-heading_min5.035208109485201
distance-from-start_max1.277370219426385
distance-from-start_mean1.277370219426385
distance-from-start_median1.277370219426385
distance-from-start_min1.277370219426385
driven_any_max1.800248870773983
driven_any_mean1.800248870773983
driven_any_median1.800248870773983
driven_any_min1.800248870773983
driven_lanedir_consec_max1.380212156879176
driven_lanedir_consec_mean1.380212156879176
driven_lanedir_consec_min1.380212156879176
driven_lanedir_max1.380212156879176
driven_lanedir_mean1.380212156879176
driven_lanedir_median1.380212156879176
driven_lanedir_min1.380212156879176
in-drivable-lane_max2.4500000000000135
in-drivable-lane_mean2.4500000000000135
in-drivable-lane_min2.4500000000000135
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.800248870773983, "survival_time": 14.650000000000071, "driven_lanedir": 1.380212156879176, "in-drivable-lane": 2.4500000000000135, "deviation-heading": 5.035208109485201, "distance-from-start": 1.277370219426385, "deviation-center-line": 0.9029461024707648, "driven_lanedir_consec": 1.380212156879176}}
simulation-passed1
survival_time_max14.650000000000071
survival_time_mean14.650000000000071
survival_time_min14.650000000000071
No reset possible
14700930Bea Baselines 🐤baseline-duckietownaido-LF-sim-validationsim-1of4successnodavinci-stage-03-6.2.500:03:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0001430511474609375
survival_time_median59.99999999999873
deviation-center-line_median0.8949070851524836
in-drivable-lane_median0.0


other stats
deviation-center-line_max0.8949070851524836
deviation-center-line_mean0.8949070851524836
deviation-center-line_min0.8949070851524836
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max6.280369834735102e-16
distance-from-start_mean6.280369834735102e-16
distance-from-start_median6.280369834735102e-16
distance-from-start_min6.280369834735102e-16
driven_any_max7.536443801682175e-13
driven_any_mean7.536443801682175e-13
driven_any_median7.536443801682175e-13
driven_any_min7.536443801682175e-13
driven_lanedir_consec_max0.0001430511474609375
driven_lanedir_consec_mean0.0001430511474609375
driven_lanedir_consec_min0.0001430511474609375
driven_lanedir_max0.0001430511474609375
driven_lanedir_mean0.0001430511474609375
driven_lanedir_median0.0001430511474609375
driven_lanedir_min0.0001430511474609375
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 7.536443801682175e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 6.280369834735102e-16, "deviation-center-line": 0.8949070851524836, "driven_lanedir_consec": 0.0001430511474609375}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14698930Bea Baselines 🐤baseline-duckietownaido-LF-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:03:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median0.8948975282353535
in-drivable-lane_median0.0


other stats
deviation-center-line_max0.8948975282353535
deviation-center-line_mean0.8948975282353535
deviation-center-line_min0.8948975282353535
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max2.482534153247273e-16
distance-from-start_mean2.482534153247273e-16
distance-from-start_median2.482534153247273e-16
distance-from-start_min2.482534153247273e-16
driven_any_max2.9790409838966753e-13
driven_any_mean2.9790409838966753e-13
driven_any_median2.9790409838966753e-13
driven_any_min2.9790409838966753e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 0.8948975282353535, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14695960Bea Baselines 🐤template-pytorchaido-LFV-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:02:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.9499999999999975
in-drivable-lane_median1.8499999999999972
driven_lanedir_consec_median0.10956507931923733
deviation-center-line_median0.0670152611953823


other stats
deviation-center-line_max0.0670152611953823
deviation-center-line_mean0.0670152611953823
deviation-center-line_min0.0670152611953823
deviation-heading_max0.8308572407478595
deviation-heading_mean0.8308572407478595
deviation-heading_median0.8308572407478595
deviation-heading_min0.8308572407478595
distance-from-start_max0.3390657142733674
distance-from-start_mean0.3390657142733674
distance-from-start_median0.3390657142733674
distance-from-start_min0.3390657142733674
driven_any_max0.3842614180361137
driven_any_mean0.3842614180361137
driven_any_median0.3842614180361137
driven_any_min0.3842614180361137
driven_lanedir_consec_max0.10956507931923733
driven_lanedir_consec_mean0.10956507931923733
driven_lanedir_consec_min0.10956507931923733
driven_lanedir_max0.10956507931923733
driven_lanedir_mean0.10956507931923733
driven_lanedir_median0.10956507931923733
driven_lanedir_min0.10956507931923733
in-drivable-lane_max1.8499999999999972
in-drivable-lane_mean1.8499999999999972
in-drivable-lane_min1.8499999999999972
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.3842614180361137, "survival_time": 2.9499999999999975, "driven_lanedir": 0.10956507931923733, "in-drivable-lane": 1.8499999999999972, "deviation-heading": 0.8308572407478595, "distance-from-start": 0.3390657142733674, "deviation-center-line": 0.0670152611953823, "driven_lanedir_consec": 0.10956507931923733}}
simulation-passed1
survival_time_max2.9499999999999975
survival_time_mean2.9499999999999975
survival_time_min2.9499999999999975
No reset possible
14676965Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-validationsim-0of4successnodavinci-stage-03-6.2.500:36:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median42.12499999999887
driven_lanedir_consec_median0.8560629294457188
deviation-center-line_median1.270014853137424


other stats
deviation-center-line_max1.7770382807102474
deviation-center-line_mean1.310102898316973
deviation-center-line_min0.923343606282795
deviation-heading_max21.664772002767933
deviation-heading_mean13.76804368253414
deviation-heading_median13.669912489480335
deviation-heading_min6.067577748407954
distance-from-start_max0.8187844769060528
distance-from-start_mean0.5550705841150421
distance-from-start_median0.5642432947876401
distance-from-start_min0.2730112699788353
driven_any_max8.678448011321299
driven_any_mean5.935206745150639
driven_any_median5.792093912805981
driven_any_min3.4781911436692914
driven_lanedir_consec_max1.3465848973012835
driven_lanedir_consec_mean0.9644057561647018
driven_lanedir_consec_min0.7989122684660859
driven_lanedir_max1.3465848973012835
driven_lanedir_mean0.9998248430848484
driven_lanedir_median0.914986272014102
driven_lanedir_min0.8227419310099058
in-drivable-lane_max50.64999999999867
in-drivable-lane_mean41.6749999999989
in-drivable-lane_min31.7999999999992
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.957692761896253, "survival_time": 59.99999999999873, "driven_lanedir": 1.3465848973012835, "in-drivable-lane": 31.7999999999992, "deviation-heading": 21.664772002767933, "distance-from-start": 0.34076439123948776, "deviation-center-line": 1.318634062066887, "driven_lanedir_consec": 1.3465848973012835}, "autolab-000-ego1": {"driven_any": 8.678448011321299, "survival_time": 59.99999999999873, "driven_lanedir": 0.8227419310099058, "in-drivable-lane": 50.19999999999865, "deviation-heading": 6.743982203105445, "distance-from-start": 0.8187844769060528, "deviation-center-line": 1.221395644207961, "driven_lanedir_consec": 0.8227419310099058}, "autolab-000-ego2": {"driven_any": 7.62649506371571, "survival_time": 59.99999999999873, "driven_lanedir": 0.8893839278815319, "in-drivable-lane": 50.64999999999867, "deviation-heading": 6.067577748407954, "distance-from-start": 0.7877221983357925, "deviation-center-line": 0.923343606282795, "driven_lanedir_consec": 0.8893839278815319}, "autolab-000-ego3": {"driven_any": 3.4781911436692914, "survival_time": 59.99999999999873, "driven_lanedir": 0.9405886161466724, "in-drivable-lane": 34.04999999999909, "deviation-heading": 20.595842775855225, "distance-from-start": 0.2730112699788353, "deviation-center-line": 1.7770382807102474, "driven_lanedir_consec": 0.7989122684660859}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14672966Bea Baselines 🐤template-pytorchaido-LFP-sim-validationsim-0of4successnodavinci-stage-03-6.2.500:06:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median42.59999999999972
in-drivable-lane_median41.39999999999972
driven_lanedir_consec_median0.04178627696299397
deviation-center-line_median0.04762269525814056


other stats
deviation-center-line_max0.04762269525814056
deviation-center-line_mean0.04762269525814056
deviation-center-line_min0.04762269525814056
deviation-heading_max1.1287980584828283
deviation-heading_mean1.1287980584828283
deviation-heading_median1.1287980584828283
deviation-heading_min1.1287980584828283
distance-from-start_max1.1705591320683004
distance-from-start_mean1.1705591320683004
distance-from-start_median1.1705591320683004
distance-from-start_min1.1705591320683004
driven_any_max5.795561076935162
driven_any_mean5.795561076935162
driven_any_median5.795561076935162
driven_any_min5.795561076935162
driven_lanedir_consec_max0.04178627696299397
driven_lanedir_consec_mean0.04178627696299397
driven_lanedir_consec_min0.04178627696299397
driven_lanedir_max0.04178627696299397
driven_lanedir_mean0.04178627696299397
driven_lanedir_median0.04178627696299397
driven_lanedir_min0.04178627696299397
in-drivable-lane_max41.39999999999972
in-drivable-lane_mean41.39999999999972
in-drivable-lane_min41.39999999999972
per-episodes
details{"autolab-000-ego0": {"driven_any": 5.795561076935162, "survival_time": 42.59999999999972, "driven_lanedir": 0.04178627696299397, "in-drivable-lane": 41.39999999999972, "deviation-heading": 1.1287980584828283, "distance-from-start": 1.1705591320683004, "deviation-center-line": 0.04762269525814056, "driven_lanedir_consec": 0.04178627696299397}}
simulation-passed1
survival_time_max42.59999999999972
survival_time_mean42.59999999999972
survival_time_min42.59999999999972
No reset possible
14671966Bea Baselines 🐤template-pytorchaido-LFP-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:04:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median38.99999999999992
in-drivable-lane_median30.849999999999905
driven_lanedir_consec_median0.9896733172739194
deviation-center-line_median0.7361749784590363


other stats
deviation-center-line_max0.7361749784590363
deviation-center-line_mean0.7361749784590363
deviation-center-line_min0.7361749784590363
deviation-heading_max7.385621083386328
deviation-heading_mean7.385621083386328
deviation-heading_median7.385621083386328
deviation-heading_min7.385621083386328
distance-from-start_max0.8089788594283108
distance-from-start_mean0.8089788594283108
distance-from-start_median0.8089788594283108
distance-from-start_min0.8089788594283108
driven_any_max8.897670508234363
driven_any_mean8.897670508234363
driven_any_median8.897670508234363
driven_any_min8.897670508234363
driven_lanedir_consec_max0.9896733172739194
driven_lanedir_consec_mean0.9896733172739194
driven_lanedir_consec_min0.9896733172739194
driven_lanedir_max0.9896733172739194
driven_lanedir_mean0.9896733172739194
driven_lanedir_median0.9896733172739194
driven_lanedir_min0.9896733172739194
in-drivable-lane_max30.849999999999905
in-drivable-lane_mean30.849999999999905
in-drivable-lane_min30.849999999999905
per-episodes
details{"loop2-000-ego0": {"driven_any": 8.897670508234363, "survival_time": 38.99999999999992, "driven_lanedir": 0.9896733172739194, "in-drivable-lane": 30.849999999999905, "deviation-heading": 7.385621083386328, "distance-from-start": 0.8089788594283108, "deviation-center-line": 0.7361749784590363, "driven_lanedir_consec": 0.9896733172739194}}
simulation-passed1
survival_time_max38.99999999999992
survival_time_mean38.99999999999992
survival_time_min38.99999999999992
No reset possible
14669966Bea Baselines 🐤template-pytorchaido-LFP-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.699999999999991
in-drivable-lane_median3.649999999999991
driven_lanedir_consec_median0.08718188492897139
deviation-center-line_median0.06432325350200033


other stats
deviation-center-line_max0.06432325350200033
deviation-center-line_mean0.06432325350200033
deviation-center-line_min0.06432325350200033
deviation-heading_max0.8802964823091631
deviation-heading_mean0.8802964823091631
deviation-heading_median0.8802964823091631
deviation-heading_min0.8802964823091631
distance-from-start_max0.7795818664662538
distance-from-start_mean0.7795818664662538
distance-from-start_median0.7795818664662538
distance-from-start_min0.7795818664662538
driven_any_max0.9027544304551076
driven_any_mean0.9027544304551076
driven_any_median0.9027544304551076
driven_any_min0.9027544304551076
driven_lanedir_consec_max0.08718188492897139
driven_lanedir_consec_mean0.08718188492897139
driven_lanedir_consec_min0.08718188492897139
driven_lanedir_max0.08718188492897139
driven_lanedir_mean0.08718188492897139
driven_lanedir_median0.08718188492897139
driven_lanedir_min0.08718188492897139
in-drivable-lane_max3.649999999999991
in-drivable-lane_mean3.649999999999991
in-drivable-lane_min3.649999999999991
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.9027544304551076, "survival_time": 4.699999999999991, "driven_lanedir": 0.08718188492897139, "in-drivable-lane": 3.649999999999991, "deviation-heading": 0.8802964823091631, "distance-from-start": 0.7795818664662538, "deviation-center-line": 0.06432325350200033, "driven_lanedir_consec": 0.08718188492897139}}
simulation-passed1
survival_time_max4.699999999999991
survival_time_mean4.699999999999991
survival_time_min4.699999999999991
No reset possible
14665972Bea Baselines 🐤template-pytorchaido-LFV-sim-testingsim-1of4successnodavinci-stage-03-6.2.500:03:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.450000000000014
in-drivable-lane_median5.200000000000003
driven_lanedir_consec_median0.20764435582046437
deviation-center-line_median0.29065368116039747


other stats
deviation-center-line_max0.29065368116039747
deviation-center-line_mean0.29065368116039747
deviation-center-line_min0.29065368116039747
deviation-heading_max4.071964982556382
deviation-heading_mean4.071964982556382
deviation-heading_median4.071964982556382
deviation-heading_min4.071964982556382
distance-from-start_max0.15292076145150532
distance-from-start_mean0.15292076145150532
distance-from-start_median0.15292076145150532
distance-from-start_min0.15292076145150532
driven_any_max0.8582056805946304
driven_any_mean0.8582056805946304
driven_any_median0.8582056805946304
driven_any_min0.8582056805946304
driven_lanedir_consec_max0.20764435582046437
driven_lanedir_consec_mean0.20764435582046437
driven_lanedir_consec_min0.20764435582046437
driven_lanedir_max0.20764435582046437
driven_lanedir_mean0.20764435582046437
driven_lanedir_median0.20764435582046437
driven_lanedir_min0.20764435582046437
in-drivable-lane_max5.200000000000003
in-drivable-lane_mean5.200000000000003
in-drivable-lane_min5.200000000000003
per-episodes
details{"loop-000-ego0": {"driven_any": 0.8582056805946304, "survival_time": 10.450000000000014, "driven_lanedir": 0.20764435582046437, "in-drivable-lane": 5.200000000000003, "deviation-heading": 4.071964982556382, "distance-from-start": 0.15292076145150532, "deviation-center-line": 0.29065368116039747, "driven_lanedir_consec": 0.20764435582046437}}
simulation-passed1
survival_time_max10.450000000000014
survival_time_mean10.450000000000014
survival_time_min10.450000000000014
No reset possible
14662973Bea Baselines 🐤template-pytorchaido-LFVI-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14659974Bea Baselines 🐤template-pytorchaido-LFI-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14658974Bea Baselines 🐤template-pytorchaido-LFI-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14646977Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-testingsim-1of4successnodavinci-stage-03-6.2.500:29:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median40.67499999999888
driven_lanedir_consec_median0.6102424666966132
deviation-center-line_median1.6020537747988983


other stats
deviation-center-line_max2.2242481874125906
deviation-center-line_mean1.376676718390818
deviation-center-line_min0.07835113655288459
deviation-heading_max23.520571652190245
deviation-heading_mean13.741270725660776
deviation-heading_median15.366881262190764
deviation-heading_min0.7107487260713351
distance-from-start_max0.6122512473629121
distance-from-start_mean0.39982068108238855
distance-from-start_median0.42040269305785527
distance-from-start_min0.1462260908509316
driven_any_max6.490375713596612
driven_any_mean3.468878988165377
driven_any_median3.3337879029006015
driven_any_min0.7175644332636922
driven_lanedir_consec_max1.5757816681482668
driven_lanedir_consec_mean0.7166862546331705
driven_lanedir_consec_min0.07047841699118873
driven_lanedir_max1.5757816681482668
driven_lanedir_mean0.7166862546331705
driven_lanedir_median0.6102424666966132
driven_lanedir_min0.07047841699118873
in-drivable-lane_max59.09999999999873
in-drivable-lane_mean42.67499999999896
in-drivable-lane_min30.249999999999343
per-episodes
details{"loop-000-ego0": {"driven_any": 4.774229518460229, "survival_time": 59.99999999999873, "driven_lanedir": 0.7407105010457791, "in-drivable-lane": 47.24999999999862, "deviation-heading": 9.227158791302855, "distance-from-start": 0.4914885073950582, "deviation-center-line": 1.0975032788755166, "driven_lanedir_consec": 0.7407105010457791}, "loop-000-ego1": {"driven_any": 1.893346287340974, "survival_time": 59.99999999999873, "driven_lanedir": 0.4797744323474473, "in-drivable-lane": 30.249999999999343, "deviation-heading": 23.520571652190245, "distance-from-start": 0.1462260908509316, "deviation-center-line": 2.2242481874125906, "driven_lanedir_consec": 0.4797744323474473}, "loop-000-ego2": {"driven_any": 6.490375713596612, "survival_time": 59.99999999999873, "driven_lanedir": 1.5757816681482668, "in-drivable-lane": 34.09999999999914, "deviation-heading": 21.50660373307867, "distance-from-start": 0.34931687872065237, "deviation-center-line": 2.1066042707222805, "driven_lanedir_consec": 1.5757816681482668}, "loop-000-ego3": {"driven_any": 0.7175644332636922, "survival_time": 59.99999999999873, "driven_lanedir": 0.07047841699118873, "in-drivable-lane": 59.09999999999873, "deviation-heading": 0.7107487260713351, "distance-from-start": 0.6122512473629121, "deviation-center-line": 0.07835113655288459, "driven_lanedir_consec": 0.07047841699118873}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14643978Bea Baselines 🐤template-pytorchaido-LFP-sim-testingsim-0of4successnodavinci-stage-03-6.2.500:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.4499999999999993
in-drivable-lane_median0.9499999999999986
driven_lanedir_consec_median0.0969278598251302
deviation-center-line_median0.04647548365865626


other stats
deviation-center-line_max0.04647548365865626
deviation-center-line_mean0.04647548365865626
deviation-center-line_min0.04647548365865626
deviation-heading_max1.0147745030956985
deviation-heading_mean1.0147745030956985
deviation-heading_median1.0147745030956985
deviation-heading_min1.0147745030956985
distance-from-start_max0.157117931687909
distance-from-start_mean0.157117931687909
distance-from-start_median0.157117931687909
distance-from-start_min0.157117931687909
driven_any_max0.1977808749486088
driven_any_mean0.1977808749486088
driven_any_median0.1977808749486088
driven_any_min0.1977808749486088
driven_lanedir_consec_max0.0969278598251302
driven_lanedir_consec_mean0.0969278598251302
driven_lanedir_consec_min0.0969278598251302
driven_lanedir_max0.0969278598251302
driven_lanedir_mean0.0969278598251302
driven_lanedir_median0.0969278598251302
driven_lanedir_min0.0969278598251302
in-drivable-lane_max0.9499999999999986
in-drivable-lane_mean0.9499999999999986
in-drivable-lane_min0.9499999999999986
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.1977808749486088, "survival_time": 2.4499999999999993, "driven_lanedir": 0.0969278598251302, "in-drivable-lane": 0.9499999999999986, "deviation-heading": 1.0147745030956985, "distance-from-start": 0.157117931687909, "deviation-center-line": 0.04647548365865626, "driven_lanedir_consec": 0.0969278598251302}}
simulation-passed1
survival_time_max2.4499999999999993
survival_time_mean2.4499999999999993
survival_time_min2.4499999999999993
No reset possible
14639980Bea Baselines 🐤template-rosaido-LF-sim-validationsim-1of4successnodavinci-stage-03-6.2.500:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1840974045284285
survival_time_median4.99999999999999
deviation-center-line_median0.07077243236586893
in-drivable-lane_median3.94999999999999


other stats
deviation-center-line_max0.07077243236586893
deviation-center-line_mean0.07077243236586893
deviation-center-line_min0.07077243236586893
deviation-heading_max0.6041569800082431
deviation-heading_mean0.6041569800082431
deviation-heading_median0.6041569800082431
deviation-heading_min0.6041569800082431
distance-from-start_max1.1493742218973837
distance-from-start_mean1.1493742218973837
distance-from-start_median1.1493742218973837
distance-from-start_min1.1493742218973837
driven_any_max1.1642681463837496
driven_any_mean1.1642681463837496
driven_any_median1.1642681463837496
driven_any_min1.1642681463837496
driven_lanedir_consec_max0.1840974045284285
driven_lanedir_consec_mean0.1840974045284285
driven_lanedir_consec_min0.1840974045284285
driven_lanedir_max0.1840974045284285
driven_lanedir_mean0.1840974045284285
driven_lanedir_median0.1840974045284285
driven_lanedir_min0.1840974045284285
in-drivable-lane_max3.94999999999999
in-drivable-lane_mean3.94999999999999
in-drivable-lane_min3.94999999999999
per-episodes
details{"loop-000-ego0": {"driven_any": 1.1642681463837496, "survival_time": 4.99999999999999, "driven_lanedir": 0.1840974045284285, "in-drivable-lane": 3.94999999999999, "deviation-heading": 0.6041569800082431, "distance-from-start": 1.1493742218973837, "deviation-center-line": 0.07077243236586893, "driven_lanedir_consec": 0.1840974045284285}}
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean4.99999999999999
survival_time_min4.99999999999999
No reset possible
14637980Bea Baselines 🐤template-rosaido-LF-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:02:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7453911830846898
survival_time_median14.900000000000077
deviation-center-line_median0.3563483282863349
in-drivable-lane_median10.900000000000071


other stats
deviation-center-line_max0.3563483282863349
deviation-center-line_mean0.3563483282863349
deviation-center-line_min0.3563483282863349
deviation-heading_max3.1734865809532375
deviation-heading_mean3.1734865809532375
deviation-heading_median3.1734865809532375
deviation-heading_min3.1734865809532375
distance-from-start_max3.8109351131227305
distance-from-start_mean3.8109351131227305
distance-from-start_median3.8109351131227305
distance-from-start_min3.8109351131227305
driven_any_max4.1638385553673265
driven_any_mean4.1638385553673265
driven_any_median4.1638385553673265
driven_any_min4.1638385553673265
driven_lanedir_consec_max0.7453911830846898
driven_lanedir_consec_mean0.7453911830846898
driven_lanedir_consec_min0.7453911830846898
driven_lanedir_max0.7453911830846898
driven_lanedir_mean0.7453911830846898
driven_lanedir_median0.7453911830846898
driven_lanedir_min0.7453911830846898
in-drivable-lane_max10.900000000000071
in-drivable-lane_mean10.900000000000071
in-drivable-lane_min10.900000000000071
per-episodes
details{"zigzag-000-ego0": {"driven_any": 4.1638385553673265, "survival_time": 14.900000000000077, "driven_lanedir": 0.7453911830846898, "in-drivable-lane": 10.900000000000071, "deviation-heading": 3.1734865809532375, "distance-from-start": 3.8109351131227305, "deviation-center-line": 0.3563483282863349, "driven_lanedir_consec": 0.7453911830846898}}
simulation-passed1
survival_time_max14.900000000000077
survival_time_mean14.900000000000077
survival_time_min14.900000000000077
No reset possible
14635981Bea Baselines 🐤template-tensorflowaido-LFV-sim-validationsim-2of4failednodavinci-stage-03-6.2.500:01:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14634981Bea Baselines 🐤template-tensorflowaido-LFV-sim-validationsim-3of4failednodavinci-stage-03-6.2.500:01:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14633981Bea Baselines 🐤template-tensorflowaido-LFV-sim-validationsim-1of4failednodavinci-stage-03-6.2.500:01:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14628985Bea Baselines 🐤template-tensorflowaido-LFV-sim-validationsim-3of4failednodavinci-stage-03-6.2.500:01:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14623986Bea Baselines 🐤baseline-duckietownaido-LF-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:05:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.6287823219481545
survival_time_median59.99999999999873
deviation-center-line_median4.7345420976724
in-drivable-lane_median23.599999999999344


other stats
deviation-center-line_max4.7345420976724
deviation-center-line_mean4.7345420976724
deviation-center-line_min4.7345420976724
deviation-heading_max6.4516617024966525
deviation-heading_mean6.4516617024966525
deviation-heading_median6.4516617024966525
deviation-heading_min6.4516617024966525
distance-from-start_max1.4415494298837417
distance-from-start_mean1.4415494298837417
distance-from-start_median1.4415494298837417
distance-from-start_min1.4415494298837417
driven_any_max7.907779040144463
driven_any_mean7.907779040144463
driven_any_median7.907779040144463
driven_any_min7.907779040144463
driven_lanedir_consec_max4.6287823219481545
driven_lanedir_consec_mean4.6287823219481545
driven_lanedir_consec_min4.6287823219481545
driven_lanedir_max4.6287823219481545
driven_lanedir_mean4.6287823219481545
driven_lanedir_median4.6287823219481545
driven_lanedir_min4.6287823219481545
in-drivable-lane_max23.599999999999344
in-drivable-lane_mean23.599999999999344
in-drivable-lane_min23.599999999999344
per-episodes
details{"loop2-000-ego0": {"driven_any": 7.907779040144463, "survival_time": 59.99999999999873, "driven_lanedir": 4.6287823219481545, "in-drivable-lane": 23.599999999999344, "deviation-heading": 6.4516617024966525, "distance-from-start": 1.4415494298837417, "deviation-center-line": 4.7345420976724, "driven_lanedir_consec": 4.6287823219481545}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14611990Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-validationsim-2of4failednodavinci-stage-03-6.2.500:01:13
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14606991Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-validationsim-0of4failednodavinci-stage-03-6.2.500:01:14
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14600992Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-validationsim-0of4failednodavinci-stage-03-6.2.500:00:59
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14594994Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-validationsim-1of4failednodavinci-stage-03-6.2.500:01:13
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14588995Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-validationsim-3of4failednodavinci-stage-03-6.2.500:00:59
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145801008Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-testingsim-0of4failednodavinci-stage-03-6.2.500:01:11
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145761009Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-testingsim-1of4failednodavinci-stage-03-6.2.500:01:12
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145721010Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-testingsim-2of4failednodavinci-stage-03-6.2.500:00:59
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145681011Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-testingsim-1of4failednodavinci-stage-03-6.2.500:01:13
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145641012Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-testingsim-0of4failednodavinci-stage-03-6.2.500:01:13
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145621013Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-testingsim-0of4failednodavinci-stage-03-6.2.500:00:59
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145601013Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-testingsim-3of4failednodavinci-stage-03-6.2.500:01:00
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145391018Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-validationsim-0of4successnodavinci-stage-03-6.2.500:22:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median8.874999999999932
driven_lanedir_consec_median1.4649501795395994
deviation-center-line_median5.181971635328317


other stats
deviation-center-line_max5.581596460822838
deviation-center-line_mean4.0448238160767644
deviation-center-line_min0.23375553282758732
deviation-heading_max26.07929638297608
deviation-heading_mean17.38644492019944
deviation-heading_median20.97038546908312
deviation-heading_min1.5257123596554434
distance-from-start_max1.9384181412177512
distance-from-start_mean0.9783177065331484
distance-from-start_median0.7613596173974834
distance-from-start_min0.4521334501198752
driven_any_max7.912915137326173
driven_any_mean3.543986995845765
driven_any_median2.8918707870501934
driven_any_min0.4792912719565008
driven_lanedir_consec_max4.009734433309182
driven_lanedir_consec_mean1.846705196236027
driven_lanedir_consec_min0.4471859925557271
driven_lanedir_max5.543622552864994
driven_lanedir_mean2.5098758787632107
driven_lanedir_median2.0243474848160603
driven_lanedir_min0.4471859925557271
in-drivable-lane_max54.999999999998735
in-drivable-lane_mean18.187499999999652
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 0.4792912719565008, "survival_time": 59.99999999999873, "driven_lanedir": 0.4471859925557271, "in-drivable-lane": 0.0, "deviation-heading": 26.07929638297608, "distance-from-start": 0.4521334501198752, "deviation-center-line": 5.581596460822838, "driven_lanedir_consec": 0.4471859925557271}, "udem-000-ego1": {"driven_any": 7.912915137326173, "survival_time": 59.99999999999873, "driven_lanedir": 5.543622552864994, "in-drivable-lane": 9.749999999999808, "deviation-heading": 23.8779063910436, "distance-from-start": 1.9384181412177512, "deviation-center-line": 5.036361233089295, "driven_lanedir_consec": 4.009734433309182}, "udem-000-ego2": {"driven_any": 5.1452388841084185, "survival_time": 59.99999999999873, "driven_lanedir": 3.479302614757719, "in-drivable-lane": 8.000000000000057, "deviation-heading": 18.062864547122636, "distance-from-start": 0.9945131444781408, "deviation-center-line": 5.327582037567339, "driven_lanedir_consec": 2.4086860773500343}, "udem-000-ego3": {"driven_any": 0.6385026899919684, "survival_time": 59.99999999999873, "driven_lanedir": 0.5693923548744015, "in-drivable-lane": 54.999999999998735, "deviation-heading": 1.5257123596554434, "distance-from-start": 0.528206090316826, "deviation-center-line": 0.23375553282758732, "driven_lanedir_consec": 0.5212142817291645}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
145211033Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-testingsim-0of4successnodavinci-stage-03-6.2.500:11:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median50.49999999999927
in-drivable-lane_median17.149999999999835
driven_lanedir_consec_median3.0003758163164145
deviation-center-line_median3.2189630437079386


other stats
deviation-center-line_max3.2189630437079386
deviation-center-line_mean3.2189630437079386
deviation-center-line_min3.2189630437079386
deviation-heading_max13.652078704304582
deviation-heading_mean13.652078704304582
deviation-heading_median13.652078704304582
deviation-heading_min13.652078704304582
distance-from-start_max1.5207394218662398
distance-from-start_mean1.5207394218662398
distance-from-start_median1.5207394218662398
distance-from-start_min1.5207394218662398
driven_any_max6.5594318826424
driven_any_mean6.5594318826424
driven_any_median6.5594318826424
driven_any_min6.5594318826424
driven_lanedir_consec_max3.0003758163164145
driven_lanedir_consec_mean3.0003758163164145
driven_lanedir_consec_min3.0003758163164145
driven_lanedir_max3.731058944104984
driven_lanedir_mean3.731058944104984
driven_lanedir_median3.731058944104984
driven_lanedir_min3.731058944104984
in-drivable-lane_max17.149999999999835
in-drivable-lane_mean17.149999999999835
in-drivable-lane_min17.149999999999835
per-episodes
details{"udem-000-ego0": {"driven_any": 6.5594318826424, "survival_time": 50.49999999999927, "driven_lanedir": 3.731058944104984, "in-drivable-lane": 17.149999999999835, "deviation-heading": 13.652078704304582, "distance-from-start": 1.5207394218662398, "deviation-center-line": 3.2189630437079386, "driven_lanedir_consec": 3.0003758163164145}}
simulation-passed1
survival_time_max50.49999999999927
survival_time_mean50.49999999999927
survival_time_min50.49999999999927
No reset possible
145191033Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
145061037Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-testingsim-1of4successnodavinci-stage-03-6.2.500:23:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median15.824999999999626
driven_lanedir_consec_median4.359716052688949
deviation-center-line_median4.062175212426322


other stats
deviation-center-line_max4.348585364276031
deviation-center-line_mean4.071629380707675
deviation-center-line_min3.813581733702028
deviation-heading_max22.495452474319176
deviation-heading_mean18.518129492745647
deviation-heading_median19.33818869571951
deviation-heading_min12.900688105224388
distance-from-start_max3.107497657839288
distance-from-start_mean2.443692461281052
distance-from-start_median2.3777480698657403
distance-from-start_min1.9117760475534389
driven_any_max7.9139552721884066
driven_any_mean7.137072314635731
driven_any_median7.136949425601347
driven_any_min6.360435135151822
driven_lanedir_consec_max4.962749112937142
driven_lanedir_consec_mean4.453182168071834
driven_lanedir_consec_min4.130547453972293
driven_lanedir_max5.354176233158612
driven_lanedir_mean4.766752808565223
driven_lanedir_median4.765824618820233
driven_lanedir_min4.181185763461816
in-drivable-lane_max19.849999999999532
in-drivable-lane_mean13.287499999999676
in-drivable-lane_min1.649999999999924
per-episodes
details{"loop-000-ego0": {"driven_any": 6.360435135151822, "survival_time": 59.99999999999873, "driven_lanedir": 5.354176233158612, "in-drivable-lane": 1.649999999999924, "deviation-heading": 22.495452474319176, "distance-from-start": 3.107497657839288, "deviation-center-line": 4.348585364276031, "driven_lanedir_consec": 4.538246341916083}, "loop-000-ego1": {"driven_any": 6.3604580386499485, "survival_time": 59.99999999999873, "driven_lanedir": 4.181185763461816, "in-drivable-lane": 12.699999999999704, "deviation-heading": 21.73149668291374, "distance-from-start": 2.3308786219468756, "deviation-center-line": 4.081659724251363, "driven_lanedir_consec": 4.181185763461816}, "loop-000-ego2": {"driven_any": 7.9139552721884066, "survival_time": 59.99999999999873, "driven_lanedir": 4.962749112937142, "in-drivable-lane": 18.949999999999548, "deviation-heading": 12.900688105224388, "distance-from-start": 2.424617517784605, "deviation-center-line": 3.813581733702028, "driven_lanedir_consec": 4.962749112937142}, "loop-000-ego3": {"driven_any": 7.913440812552745, "survival_time": 59.99999999999873, "driven_lanedir": 4.5689001247033225, "in-drivable-lane": 19.849999999999532, "deviation-heading": 16.944880708525282, "distance-from-start": 1.9117760475534389, "deviation-center-line": 4.04269070060128, "driven_lanedir_consec": 4.130547453972293}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144901040Bea Baselines 🐤baseline-duckietownaido-LFV-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:13:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median2.6017417553703126e-06
deviation-center-line_median0.8949077950231444


other stats
deviation-center-line_max0.8949077950231444
deviation-center-line_mean0.8949077950231444
deviation-center-line_min0.8949077950231444
deviation-heading_max32.24912799874442
deviation-heading_mean32.24912799874442
deviation-heading_median32.24912799874442
deviation-heading_min32.24912799874442
distance-from-start_max4.440892098500626e-16
distance-from-start_mean4.440892098500626e-16
distance-from-start_median4.440892098500626e-16
distance-from-start_min4.440892098500626e-16
driven_any_max5.329070518200751e-13
driven_any_mean5.329070518200751e-13
driven_any_median5.329070518200751e-13
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max2.6017417553703126e-06
driven_lanedir_consec_mean2.6017417553703126e-06
driven_lanedir_consec_min2.6017417553703126e-06
driven_lanedir_max2.6017417553703126e-06
driven_lanedir_mean2.6017417553703126e-06
driven_lanedir_median2.6017417553703126e-06
driven_lanedir_min2.6017417553703126e-06
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 2.6017417553703126e-06, "in-drivable-lane": 0.0, "deviation-heading": 32.24912799874442, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.8949077950231444, "driven_lanedir_consec": 2.6017417553703126e-06}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144851042Bea Baselines 🐤baseline-duckietownaido-LFI-sim-validationsim-1of4successnodavinci-stage-03-6.2.500:05:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0001430511474609375
deviation-center-line_median0.8949224973854444


other stats
deviation-center-line_max0.8949224973854444
deviation-center-line_mean0.8949224973854444
deviation-center-line_min0.8949224973854444
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max4.440892098500626e-16
distance-from-start_mean4.440892098500626e-16
distance-from-start_median4.440892098500626e-16
distance-from-start_min4.440892098500626e-16
driven_any_max5.329070518200751e-13
driven_any_mean5.329070518200751e-13
driven_any_median5.329070518200751e-13
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max0.0001430511474609375
driven_lanedir_consec_mean0.0001430511474609375
driven_lanedir_consec_min0.0001430511474609375
driven_lanedir_max0.0001430511474609375
driven_lanedir_mean0.0001430511474609375
driven_lanedir_median0.0001430511474609375
driven_lanedir_min0.0001430511474609375
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-000-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.8949224973854444, "driven_lanedir_consec": 0.0001430511474609375}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144761044Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:12:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median1.939287230801057e-07
deviation-center-line_median1.5116956155527117


other stats
deviation-center-line_max2.9467746047984105
deviation-center-line_mean1.5769755996667565
deviation-center-line_min0.33773656276319197
deviation-heading_max32.24910212696788
deviation-heading_mean22.839461787379523
deviation-heading_median22.597236152907925
deviation-heading_min13.91427271673436
distance-from-start_max9.155133597044477e-16
distance-from-start_mean3.073829628603006e-16
distance-from-start_median1.5700924586837752e-16
distance-from-start_min0.0
driven_any_max1.0986160316453499e-12
driven_any_mean3.6885955543236473e-13
driven_any_median1.8841109504205443e-13
driven_any_min0.0
driven_lanedir_consec_max4.4323372971888375e-06
driven_lanedir_consec_mean-6.959346956214585e-05
driven_lanedir_consec_min-0.00028319407299193244
driven_lanedir_max4.4323372971888375e-06
driven_lanedir_mean-6.959346956214585e-05
driven_lanedir_median1.939287230801057e-07
driven_lanedir_min-0.00028319407299193244
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": -2.089142725480997e-06, "in-drivable-lane": 0.0, "deviation-heading": 32.24910212696788, "distance-from-start": 0.0, "deviation-center-line": 0.8948982095947005, "driven_lanedir_consec": -2.089142725480997e-06}, "zigzag-000-ego1": {"driven_any": 3.7682219008410875e-13, "survival_time": 59.99999999999873, "driven_lanedir": -0.00028319407299193244, "in-drivable-lane": 0.0, "deviation-heading": 30.71290207135603, "distance-from-start": 3.1401849173675503e-16, "deviation-center-line": 2.1284930215107223, "driven_lanedir_consec": -0.00028319407299193244}, "zigzag-000-ego2": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 2.477000171641208e-06, "in-drivable-lane": 0.0, "deviation-heading": 14.481570234459818, "distance-from-start": 0.0, "deviation-center-line": 2.9467746047984105, "driven_lanedir_consec": 2.477000171641208e-06}, "zigzag-000-ego3": {"driven_any": 1.0986160316453499e-12, "survival_time": 59.99999999999873, "driven_lanedir": 4.4323372971888375e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.91427271673436, "distance-from-start": 9.155133597044477e-16, "deviation-center-line": 0.33773656276319197, "driven_lanedir_consec": 4.4323372971888375e-06}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144721045Bea Baselines 🐤baseline-duckietownaido-LFP-sim-validationsim-0of4successnodavinci-stage-03-6.2.500:05:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8949224973854443


other stats
deviation-center-line_max0.8949224973854443
deviation-center-line_mean0.8949224973854443
deviation-center-line_min0.8949224973854443
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max0.0
distance-from-start_mean0.0
distance-from-start_median0.0
distance-from-start_min0.0
driven_any_max0.0
driven_any_mean0.0
driven_any_median0.0
driven_any_min0.0
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 0.0, "deviation-center-line": 0.8949224973854443, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144661057Bea Baselines 🐤baseline-duckietownaido-LFV-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:13:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median-7.759561260201053e-05
deviation-center-line_median0.40651500228682685


other stats
deviation-center-line_max0.40651500228682685
deviation-center-line_mean0.40651500228682685
deviation-center-line_min0.40651500228682685
deviation-heading_max40.96731396890531
deviation-heading_mean40.96731396890531
deviation-heading_median40.96731396890531
deviation-heading_min40.96731396890531
distance-from-start_max4.577566798522237e-16
distance-from-start_mean4.577566798522237e-16
distance-from-start_median4.577566798522237e-16
distance-from-start_min4.577566798522237e-16
driven_any_max5.49308015822675e-13
driven_any_mean5.49308015822675e-13
driven_any_median5.49308015822675e-13
driven_any_min5.49308015822675e-13
driven_lanedir_consec_max-7.759561260201053e-05
driven_lanedir_consec_mean-7.759561260201053e-05
driven_lanedir_consec_min-7.759561260201053e-05
driven_lanedir_max-7.759561260201053e-05
driven_lanedir_mean-7.759561260201053e-05
driven_lanedir_median-7.759561260201053e-05
driven_lanedir_min-7.759561260201053e-05
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.49308015822675e-13, "survival_time": 59.99999999999873, "driven_lanedir": -7.759561260201053e-05, "in-drivable-lane": 0.0, "deviation-heading": 40.96731396890531, "distance-from-start": 4.577566798522237e-16, "deviation-center-line": 0.40651500228682685, "driven_lanedir_consec": -7.759561260201053e-05}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144581059Bea Baselines 🐤baseline-duckietownaido-LFI-sim-testingsim-1of4successnodavinci-stage-03-6.2.500:05:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.4064993438632703


other stats
deviation-center-line_max0.4064993438632703
deviation-center-line_mean0.4064993438632703
deviation-center-line_min0.4064993438632703
deviation-heading_max40.967332753486225
deviation-heading_mean40.967332753486225
deviation-heading_median40.967332753486225
deviation-heading_min40.967332753486225
distance-from-start_max9.155133597044477e-16
distance-from-start_mean9.155133597044477e-16
distance-from-start_median9.155133597044477e-16
distance-from-start_min9.155133597044477e-16
driven_any_max1.0986160316453499e-12
driven_any_mean1.0986160316453499e-12
driven_any_median1.0986160316453499e-12
driven_any_min1.0986160316453499e-12
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-000-ego0": {"driven_any": 1.0986160316453499e-12, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 9.155133597044477e-16, "deviation-center-line": 0.4064993438632703, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144561059Bea Baselines 🐤baseline-duckietownaido-LFI-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
144531060Bea Baselines 🐤baseline-duckietownaido-LF-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:04:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median0.4065274986524565
in-drivable-lane_median0.0


other stats
deviation-center-line_max0.4065274986524565
deviation-center-line_mean0.4065274986524565
deviation-center-line_min0.4065274986524565
deviation-heading_max40.967332753486254
deviation-heading_mean40.967332753486254
deviation-heading_median40.967332753486254
deviation-heading_min40.967332753486254
distance-from-start_max0.0
distance-from-start_mean0.0
distance-from-start_median0.0
distance-from-start_min0.0
driven_any_max0.0
driven_any_mean0.0
driven_any_median0.0
driven_any_min0.0
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 0.0, "deviation-center-line": 0.4065274986524565, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144451062Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:13:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.7343157482938594e-06
deviation-center-line_median1.5844853993259105


other stats
deviation-center-line_max3.468395817902628
deviation-center-line_mean1.7151188170525231
deviation-center-line_min0.22310865165564356
deviation-heading_max40.96732188588877
deviation-heading_mean25.437947521585144
deviation-heading_median28.06617110903251
deviation-heading_min4.652125982386785
distance-from-start_max5.551115123125784e-16
distance-from-start_mean3.248269708766571e-16
distance-from-start_median3.165870343657673e-16
distance-from-start_min1.1102230246251563e-16
driven_any_max6.661338147750939e-13
driven_any_mean3.897923650519886e-13
driven_any_median3.7990444123892075e-13
driven_any_min1.3322676295501878e-13
driven_lanedir_consec_max0.00014045138598817175
driven_lanedir_consec_mean1.7402070830174754e-05
driven_lanedir_consec_min-7.831173416406045e-05
driven_lanedir_max0.00014045138598817175
driven_lanedir_mean1.7402070830174754e-05
driven_lanedir_median3.7343157482938594e-06
driven_lanedir_min-7.831173416406045e-05
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 6.661338147750939e-13, "survival_time": 59.99999999999873, "driven_lanedir": -7.831173416406045e-05, "in-drivable-lane": 0.0, "deviation-heading": 40.96732188588877, "distance-from-start": 5.551115123125784e-16, "deviation-center-line": 0.40651203156888976, "driven_lanedir_consec": -7.831173416406045e-05}, "zigzag-000-ego1": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.00014045138598817175, "in-drivable-lane": 0.0, "deviation-heading": 18.309423483353505, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 3.468395817902628, "driven_lanedir_consec": 0.00014045138598817175}, "zigzag-000-ego2": {"driven_any": 2.2690183065776637e-13, "survival_time": 59.99999999999873, "driven_lanedir": -5.626369536937403e-07, "in-drivable-lane": 0.0, "deviation-heading": 4.652125982386785, "distance-from-start": 1.8908485888147195e-16, "deviation-center-line": 0.22310865165564356, "driven_lanedir_consec": -5.626369536937403e-07}, "zigzag-000-ego3": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 8.031268450281459e-06, "in-drivable-lane": 0.0, "deviation-heading": 37.822918734711514, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 2.762458767082931, "driven_lanedir_consec": 8.031268450281459e-06}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144321098Bea Baselines 🐤template-pytorchaido-hello-sim-validationsanity-checksuccessnodavinci-stage-03-6.2.500:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.023630396390710295
deviation-center-line_median0.005598154430658993


other stats
deviation-center-line_max0.005598154430658993
deviation-center-line_mean0.005598154430658993
deviation-center-line_min0.005598154430658993
deviation-heading_max0.30683923937941743
deviation-heading_mean0.30683923937941743
deviation-heading_median0.30683923937941743
deviation-heading_min0.30683923937941743
distance-from-start_max0.031346839612727995
distance-from-start_mean0.031346839612727995
distance-from-start_median0.031346839612727995
distance-from-start_min0.031346839612727995
driven_any_max0.03145919298090907
driven_any_mean0.03145919298090907
driven_any_median0.03145919298090907
driven_any_min0.03145919298090907
driven_lanedir_consec_max0.023630396390710295
driven_lanedir_consec_mean0.023630396390710295
driven_lanedir_consec_min0.023630396390710295
driven_lanedir_max0.023630396390710295
driven_lanedir_mean0.023630396390710295
driven_lanedir_median0.023630396390710295
driven_lanedir_min0.023630396390710295
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.03145919298090907, "survival_time": 0.49999999999999994, "driven_lanedir": 0.023630396390710295, "in-drivable-lane": 0.0, "deviation-heading": 0.30683923937941743, "distance-from-start": 0.031346839612727995, "deviation-center-line": 0.005598154430658993, "driven_lanedir_consec": 0.023630396390710295}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
144251207Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
144221208Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-validationsim-0of4successnodavinci-stage-03-6.2.500:03:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median25.200000000000223
in-drivable-lane_median1.1000000000000156
driven_lanedir_consec_median1.3557424143249113
deviation-center-line_median2.2764052687353016


other stats
deviation-center-line_max2.2764052687353016
deviation-center-line_mean2.2764052687353016
deviation-center-line_min2.2764052687353016
deviation-heading_max2.9201829757406066
deviation-heading_mean2.9201829757406066
deviation-heading_median2.9201829757406066
deviation-heading_min2.9201829757406066
distance-from-start_max1.1340032910142968
distance-from-start_mean1.1340032910142968
distance-from-start_median1.1340032910142968
distance-from-start_min1.1340032910142968
driven_any_max1.4165963270662665
driven_any_mean1.4165963270662665
driven_any_median1.4165963270662665
driven_any_min1.4165963270662665
driven_lanedir_consec_max1.3557424143249113
driven_lanedir_consec_mean1.3557424143249113
driven_lanedir_consec_min1.3557424143249113
driven_lanedir_max1.3557424143249113
driven_lanedir_mean1.3557424143249113
driven_lanedir_median1.3557424143249113
driven_lanedir_min1.3557424143249113
in-drivable-lane_max1.1000000000000156
in-drivable-lane_mean1.1000000000000156
in-drivable-lane_min1.1000000000000156
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.4165963270662665, "survival_time": 25.200000000000223, "driven_lanedir": 1.3557424143249113, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.9201829757406066, "distance-from-start": 1.1340032910142968, "deviation-center-line": 2.2764052687353016, "driven_lanedir_consec": 1.3557424143249113}}
simulation-passed1
survival_time_max25.200000000000223
survival_time_mean25.200000000000223
survival_time_min25.200000000000223
No reset possible
144201208Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-validationsim-1of4successnodavinci-stage-03-6.2.500:02:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.09999999999998
in-drivable-lane_median0.0
driven_lanedir_consec_median0.41885674395418215
deviation-center-line_median0.2592734099538108


other stats
deviation-center-line_max0.2592734099538108
deviation-center-line_mean0.2592734099538108
deviation-center-line_min0.2592734099538108
deviation-heading_max0.7151194489559713
deviation-heading_mean0.7151194489559713
deviation-heading_median0.7151194489559713
deviation-heading_min0.7151194489559713
distance-from-start_max0.4199960454985642
distance-from-start_mean0.4199960454985642
distance-from-start_median0.4199960454985642
distance-from-start_min0.4199960454985642
driven_any_max0.42359927688869903
driven_any_mean0.42359927688869903
driven_any_median0.42359927688869903
driven_any_min0.42359927688869903
driven_lanedir_consec_max0.41885674395418215
driven_lanedir_consec_mean0.41885674395418215
driven_lanedir_consec_min0.41885674395418215
driven_lanedir_max0.41885674395418215
driven_lanedir_mean0.41885674395418215
driven_lanedir_median0.41885674395418215
driven_lanedir_min0.41885674395418215
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 0.42359927688869903, "survival_time": 8.09999999999998, "driven_lanedir": 0.41885674395418215, "in-drivable-lane": 0.0, "deviation-heading": 0.7151194489559713, "distance-from-start": 0.4199960454985642, "deviation-center-line": 0.2592734099538108, "driven_lanedir_consec": 0.41885674395418215}}
simulation-passed1
survival_time_max8.09999999999998
survival_time_mean8.09999999999998
survival_time_min8.09999999999998
No reset possible
144151209Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:06:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.099999999999845
driven_lanedir_consec_median3.2653509128575537
deviation-center-line_median7.121053917268459


other stats
deviation-center-line_max7.121053917268459
deviation-center-line_mean7.121053917268459
deviation-center-line_min7.121053917268459
deviation-heading_max5.705613996279617
deviation-heading_mean5.705613996279617
deviation-heading_median5.705613996279617
deviation-heading_min5.705613996279617
distance-from-start_max1.6305272704555316
distance-from-start_mean1.6305272704555316
distance-from-start_median1.6305272704555316
distance-from-start_min1.6305272704555316
driven_any_max3.4663369114033205
driven_any_mean3.4663369114033205
driven_any_median3.4663369114033205
driven_any_min3.4663369114033205
driven_lanedir_consec_max3.2653509128575537
driven_lanedir_consec_mean3.2653509128575537
driven_lanedir_consec_min3.2653509128575537
driven_lanedir_max3.2653509128575537
driven_lanedir_mean3.2653509128575537
driven_lanedir_median3.2653509128575537
driven_lanedir_min3.2653509128575537
in-drivable-lane_max4.099999999999845
in-drivable-lane_mean4.099999999999845
in-drivable-lane_min4.099999999999845
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.4663369114033205, "survival_time": 59.99999999999873, "driven_lanedir": 3.2653509128575537, "in-drivable-lane": 4.099999999999845, "deviation-heading": 5.705613996279617, "distance-from-start": 1.6305272704555316, "deviation-center-line": 7.121053917268459, "driven_lanedir_consec": 3.2653509128575537}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144141210Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:01:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
144081211Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-validationsim-1of4successnodavinci-stage-03-6.2.500:14:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.9999999999999822
driven_lanedir_consec_median3.396874188758651
deviation-center-line_median6.848336335212338


other stats
deviation-center-line_max7.516036575940118
deviation-center-line_mean6.209131018472381
deviation-center-line_min3.6238148275247304
deviation-heading_max7.032818929812941
deviation-heading_mean4.55196967857351
deviation-heading_median4.199788237499533
deviation-heading_min2.7754833094820346
distance-from-start_max2.9834410770695685
distance-from-start_mean2.4797248726783128
distance-from-start_median2.446473764157263
distance-from-start_min2.0425108853291554
driven_any_max3.579596486578675
driven_any_mean3.314094256325256
driven_any_median3.5210921058800326
driven_any_min2.6345963269622827
driven_lanedir_consec_max3.551753017565808
driven_lanedir_consec_mean3.229798941754201
driven_lanedir_consec_min2.573694371933692
driven_lanedir_max3.551753017565808
driven_lanedir_mean3.229798941754201
driven_lanedir_median3.396874188758651
driven_lanedir_min2.573694371933692
in-drivable-lane_max2.9999999999998295
in-drivable-lane_mean1.2499999999999485
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 2.6345963269622827, "survival_time": 59.99999999999873, "driven_lanedir": 2.573694371933692, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.920074235215898, "distance-from-start": 2.0425108853291554, "deviation-center-line": 7.516036575940118, "driven_lanedir_consec": 2.573694371933692}, "loop-000-ego1": {"driven_any": 3.579596486578675, "survival_time": 59.99999999999873, "driven_lanedir": 3.551753017565808, "in-drivable-lane": 0.0, "deviation-heading": 2.7754833094820346, "distance-from-start": 2.724162342686075, "deviation-center-line": 6.299841022357562, "driven_lanedir_consec": 3.551753017565808}, "loop-000-ego2": {"driven_any": 3.5525920285820543, "survival_time": 59.99999999999873, "driven_lanedir": 3.458623985525704, "in-drivable-lane": 0.8999999999999488, "deviation-heading": 7.032818929812941, "distance-from-start": 2.9834410770695685, "deviation-center-line": 3.6238148275247304, "driven_lanedir_consec": 3.458623985525704}, "loop-000-ego3": {"driven_any": 3.489592183178011, "survival_time": 59.99999999999873, "driven_lanedir": 3.335124391991598, "in-drivable-lane": 2.9999999999998295, "deviation-heading": 5.479502239783168, "distance-from-start": 2.168785185628451, "deviation-center-line": 7.396831648067114, "driven_lanedir_consec": 3.335124391991598}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144061212Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
144021213Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:04:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.1499999999999666
driven_lanedir_consec_median1.4203839696348646
deviation-center-line_median4.904461575108174


other stats
deviation-center-line_max4.904461575108174
deviation-center-line_mean4.904461575108174
deviation-center-line_min4.904461575108174
deviation-heading_max7.745124892472468
deviation-heading_mean7.745124892472468
deviation-heading_median7.745124892472468
deviation-heading_min7.745124892472468
distance-from-start_max1.2059816740532263
distance-from-start_mean1.2059816740532263
distance-from-start_median1.2059816740532263
distance-from-start_min1.2059816740532263
driven_any_max3.485084016237799
driven_any_mean3.485084016237799
driven_any_median3.485084016237799
driven_any_min3.485084016237799
driven_lanedir_consec_max1.4203839696348646
driven_lanedir_consec_mean1.4203839696348646
driven_lanedir_consec_min1.4203839696348646
driven_lanedir_max3.2905245152042193
driven_lanedir_mean3.2905245152042193
driven_lanedir_median3.2905245152042193
driven_lanedir_min3.2905245152042193
in-drivable-lane_max3.1499999999999666
in-drivable-lane_mean3.1499999999999666
in-drivable-lane_min3.1499999999999666
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.485084016237799, "survival_time": 59.99999999999873, "driven_lanedir": 3.2905245152042193, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.745124892472468, "distance-from-start": 1.2059816740532263, "deviation-center-line": 4.904461575108174, "driven_lanedir_consec": 1.4203839696348646}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143961214Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-testingsim-1of4successnodavinci-stage-03-6.2.500:04:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median15.05000000000008
in-drivable-lane_median0.0
driven_lanedir_consec_median0.6855434087750805
deviation-center-line_median1.12957986069885


other stats
deviation-center-line_max1.12957986069885
deviation-center-line_mean1.12957986069885
deviation-center-line_min1.12957986069885
deviation-heading_max1.951860613365137
deviation-heading_mean1.951860613365137
deviation-heading_median1.951860613365137
deviation-heading_min1.951860613365137
distance-from-start_max0.6890064762174344
distance-from-start_mean0.6890064762174344
distance-from-start_median0.6890064762174344
distance-from-start_min0.6890064762174344
driven_any_max0.8405923695951633
driven_any_mean0.8405923695951633
driven_any_median0.8405923695951633
driven_any_min0.8405923695951633
driven_lanedir_consec_max0.6855434087750805
driven_lanedir_consec_mean0.6855434087750805
driven_lanedir_consec_min0.6855434087750805
driven_lanedir_max0.8262266008885575
driven_lanedir_mean0.8262266008885575
driven_lanedir_median0.8262266008885575
driven_lanedir_min0.8262266008885575
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 0.8405923695951633, "survival_time": 15.05000000000008, "driven_lanedir": 0.8262266008885575, "in-drivable-lane": 0.0, "deviation-heading": 1.951860613365137, "distance-from-start": 0.6890064762174344, "deviation-center-line": 1.12957986069885, "driven_lanedir_consec": 0.6855434087750805}}
simulation-passed1
survival_time_max15.05000000000008
survival_time_mean15.05000000000008
survival_time_min15.05000000000008
No reset possible
143871216Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-testingsim-0of4successnodavinci-stage-03-6.2.500:12:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.349999999999895
driven_lanedir_consec_median2.0918531760676333
deviation-center-line_median5.910477685795049


other stats
deviation-center-line_max5.910477685795049
deviation-center-line_mean5.910477685795049
deviation-center-line_min5.910477685795049
deviation-heading_max8.289002671411088
deviation-heading_mean8.289002671411088
deviation-heading_median8.289002671411088
deviation-heading_min8.289002671411088
distance-from-start_max1.0313532441319608
distance-from-start_mean1.0313532441319608
distance-from-start_median1.0313532441319608
distance-from-start_min1.0313532441319608
driven_any_max3.4490819978293596
driven_any_mean3.4490819978293596
driven_any_median3.4490819978293596
driven_any_min3.4490819978293596
driven_lanedir_consec_max2.0918531760676333
driven_lanedir_consec_mean2.0918531760676333
driven_lanedir_consec_min2.0918531760676333
driven_lanedir_max3.2042238074943747
driven_lanedir_mean3.2042238074943747
driven_lanedir_median3.2042238074943747
driven_lanedir_min3.2042238074943747
in-drivable-lane_max4.349999999999895
in-drivable-lane_mean4.349999999999895
in-drivable-lane_min4.349999999999895
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.4490819978293596, "survival_time": 59.99999999999873, "driven_lanedir": 3.2042238074943747, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.289002671411088, "distance-from-start": 1.0313532441319608, "deviation-center-line": 5.910477685795049, "driven_lanedir_consec": 2.0918531760676333}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143851217Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:02:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
143831217Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
143761219Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-testingsim-1of4successnodavinci-stage-03-6.2.500:15:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.749999999999952
driven_lanedir_consec_median3.3108429130678627
deviation-center-line_median6.488612341525324


other stats
deviation-center-line_max7.194535652106716
deviation-center-line_mean6.189132437353033
deviation-center-line_min4.584769414254769
deviation-heading_max5.1659907865965735
deviation-heading_mean4.395400760189543
deviation-heading_median4.246938088221968
deviation-heading_min3.921736077717662
distance-from-start_max2.702654291483946
distance-from-start_mean2.5000234387240603
distance-from-start_median2.696936207575508
distance-from-start_min1.9035670482612792
driven_any_max3.5795805678303996
driven_any_mean3.511364143390294
driven_any_median3.497093152571938
driven_any_min3.4716897005868983
driven_lanedir_consec_max3.392650989219845
driven_lanedir_consec_mean3.3072216022018863
driven_lanedir_consec_min3.2145495934519746
driven_lanedir_max3.5546680924349143
driven_lanedir_mean3.3922512713982065
driven_lanedir_median3.361057245426797
driven_lanedir_min3.2922225023043183
in-drivable-lane_max3.5999999999999623
in-drivable-lane_mean2.2749999999999666
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 3.5795805678303996, "survival_time": 59.99999999999873, "driven_lanedir": 3.5546680924349143, "in-drivable-lane": 0.0, "deviation-heading": 3.933442455386819, "distance-from-start": 1.9035670482612792, "deviation-center-line": 4.584769414254769, "driven_lanedir_consec": 3.2145495934519746}, "4way-000-ego1": {"driven_any": 3.4850923665530997, "survival_time": 59.99999999999873, "driven_lanedir": 3.329463323831407, "in-drivable-lane": 3.1499999999999595, "deviation-heading": 4.560433721057117, "distance-from-start": 2.702654291483946, "deviation-center-line": 7.194535652106716, "driven_lanedir_consec": 3.329463323831407}, "4way-000-ego2": {"driven_any": 3.509093938590777, "survival_time": 59.99999999999873, "driven_lanedir": 3.3926511670221866, "in-drivable-lane": 2.349999999999945, "deviation-heading": 3.921736077717662, "distance-from-start": 2.698831659135408, "deviation-center-line": 6.220267984933724, "driven_lanedir_consec": 3.392650989219845}, "4way-000-ego3": {"driven_any": 3.4716897005868983, "survival_time": 59.99999999999873, "driven_lanedir": 3.2922225023043183, "in-drivable-lane": 3.5999999999999623, "deviation-heading": 5.1659907865965735, "distance-from-start": 2.695040756015608, "deviation-center-line": 6.756956698116925, "driven_lanedir_consec": 3.2922225023043183}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143731219Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
143701221Bea Baselines 🐤minimal-agent-fullaido-hello-sim-full-validationsanity-checksuccessnodavinci-stage-03-6.2.500:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.010100650259948551
deviation-center-line_median0.006374430067497517


other stats
deviation-center-line_max0.006374430067497517
deviation-center-line_mean0.006374430067497517
deviation-center-line_min0.006374430067497517
deviation-heading_max0.2614212407761817
deviation-heading_mean0.2614212407761817
deviation-heading_median0.2614212407761817
deviation-heading_min0.2614212407761817
distance-from-start_max0.011536496219628692
distance-from-start_mean0.011536496219628692
distance-from-start_median0.011536496219628692
distance-from-start_min0.011536496219628692
driven_any_max0.011538646402322758
driven_any_mean0.011538646402322758
driven_any_median0.011538646402322758
driven_any_min0.011538646402322758
driven_lanedir_consec_max0.010100650259948551
driven_lanedir_consec_mean0.010100650259948551
driven_lanedir_consec_min0.010100650259948551
driven_lanedir_max0.010100650259948551
driven_lanedir_mean0.010100650259948551
driven_lanedir_median0.010100650259948551
driven_lanedir_min0.010100650259948551
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.011538646402322758, "survival_time": 0.49999999999999994, "driven_lanedir": 0.010100650259948551, "in-drivable-lane": 0.0, "deviation-heading": 0.2614212407761817, "distance-from-start": 0.011536496219628692, "deviation-center-line": 0.006374430067497517, "driven_lanedir_consec": 0.010100650259948551}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
143661222Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:04:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.099999999999845
driven_lanedir_consec_median3.265479618005762
deviation-center-line_median7.114499866441937


other stats
deviation-center-line_max7.114499866441937
deviation-center-line_mean7.114499866441937
deviation-center-line_min7.114499866441937
deviation-heading_max5.7026362693789
deviation-heading_mean5.7026362693789
deviation-heading_median5.7026362693789
deviation-heading_min5.7026362693789
distance-from-start_max1.6303676024148757
distance-from-start_mean1.6303676024148757
distance-from-start_median1.6303676024148757
distance-from-start_min1.6303676024148757
driven_any_max3.4663369172887455
driven_any_mean3.4663369172887455
driven_any_median3.4663369172887455
driven_any_min3.4663369172887455
driven_lanedir_consec_max3.265479618005762
driven_lanedir_consec_mean3.265479618005762
driven_lanedir_consec_min3.265479618005762
driven_lanedir_max3.265479618005762
driven_lanedir_mean3.265479618005762
driven_lanedir_median3.265479618005762
driven_lanedir_min3.265479618005762
in-drivable-lane_max4.099999999999845
in-drivable-lane_mean4.099999999999845
in-drivable-lane_min4.099999999999845
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.4663369172887455, "survival_time": 59.99999999999873, "driven_lanedir": 3.265479618005762, "in-drivable-lane": 4.099999999999845, "deviation-heading": 5.7026362693789, "distance-from-start": 1.6303676024148757, "deviation-center-line": 7.114499866441937, "driven_lanedir_consec": 3.265479618005762}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143651223Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
143621223Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
143571225Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:09:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.499999999999858
driven_lanedir_consec_median2.073568167625771
deviation-center-line_median5.586339009536689


other stats
deviation-center-line_max5.586339009536689
deviation-center-line_mean5.586339009536689
deviation-center-line_min5.586339009536689
deviation-heading_max4.940364769457971
deviation-heading_mean4.940364769457971
deviation-heading_median4.940364769457971
deviation-heading_min4.940364769457971
distance-from-start_max1.7409270883034778
distance-from-start_mean1.7409270883034778
distance-from-start_median1.7409270883034778
distance-from-start_min1.7409270883034778
driven_any_max3.504586985619137
driven_any_mean3.504586985619137
driven_any_median3.504586985619137
driven_any_min3.504586985619137
driven_lanedir_consec_max2.073568167625771
driven_lanedir_consec_mean2.073568167625771
driven_lanedir_consec_min2.073568167625771
driven_lanedir_max3.360909384451456
driven_lanedir_mean3.360909384451456
driven_lanedir_median3.360909384451456
driven_lanedir_min3.360909384451456
in-drivable-lane_max2.499999999999858
in-drivable-lane_mean2.499999999999858
in-drivable-lane_min2.499999999999858
per-episodes
details{"4way-000-ego0": {"driven_any": 3.504586985619137, "survival_time": 59.99999999999873, "driven_lanedir": 3.360909384451456, "in-drivable-lane": 2.499999999999858, "deviation-heading": 4.940364769457971, "distance-from-start": 1.7409270883034778, "deviation-center-line": 5.586339009536689, "driven_lanedir_consec": 2.073568167625771}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143511226Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-validation454successnodavinci-stage-03-6.2.500:07:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.024999999999885
driven_lanedir_consec_median3.0306431432375818
deviation-center-line_median5.033330792368842


other stats
deviation-center-line_max5.884022015468802
deviation-center-line_mean4.7291156358443125
deviation-center-line_min2.965778943170763
deviation-heading_max9.018016413848066
deviation-heading_mean6.024209407625012
deviation-heading_median5.368016319010068
deviation-heading_min4.342788578631846
distance-from-start_max2.746749083783255
distance-from-start_mean2.4620132603710134
distance-from-start_median2.534242928376849
distance-from-start_min2.0328181009471
driven_any_max3.53009510877126
driven_any_mean3.5210881720251583
driven_any_median3.518836988935937
driven_any_min3.5165836014575
driven_lanedir_consec_max3.437669954668162
driven_lanedir_consec_mean3.0223252299664685
driven_lanedir_consec_min2.5903446787225497
driven_lanedir_max3.437669954668162
driven_lanedir_mean3.3861222276242007
driven_lanedir_median3.3800876466138243
driven_lanedir_min3.346643662600993
in-drivable-lane_max2.0999999999998806
in-drivable-lane_mean1.9499999999998892
in-drivable-lane_min1.6499999999999062
per-episodes
details{"loop-000-ego0": {"driven_any": 3.5180872153630816, "survival_time": 59.99999999999873, "driven_lanedir": 3.3813728794222344, "in-drivable-lane": 2.0499999999998835, "deviation-heading": 5.268596966876985, "distance-from-start": 2.0328181009471, "deviation-center-line": 4.845050204100621, "driven_lanedir_consec": 2.5903446787225497}, "loop-000-ego1": {"driven_any": 3.5195867625087924, "survival_time": 59.99999999999873, "driven_lanedir": 3.3788024138054147, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 5.467435671143151, "distance-from-start": 2.746749083783255, "deviation-center-line": 5.221611380637063, "driven_lanedir_consec": 3.2259699365624894}, "loop-000-ego2": {"driven_any": 3.53009510877126, "survival_time": 59.99999999999873, "driven_lanedir": 3.437669954668162, "in-drivable-lane": 1.6499999999999062, "deviation-heading": 4.342788578631846, "distance-from-start": 2.4007618894105165, "deviation-center-line": 5.884022015468802, "driven_lanedir_consec": 3.437669954668162}, "loop-000-ego3": {"driven_any": 3.5165836014575, "survival_time": 59.99999999999873, "driven_lanedir": 3.346643662600993, "in-drivable-lane": 2.0999999999998806, "deviation-heading": 9.018016413848066, "distance-from-start": 2.6677239673431816, "deviation-center-line": 2.965778943170763, "driven_lanedir_consec": 2.835316349912674}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143461228Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-testingsim-1of4successnodavinci-stage-03-6.2.500:03:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.249999999999958
driven_lanedir_consec_median1.601745896224546
deviation-center-line_median5.338593212765516


other stats
deviation-center-line_max5.338593212765516
deviation-center-line_mean5.338593212765516
deviation-center-line_min5.338593212765516
deviation-heading_max6.235252951727364
deviation-heading_mean6.235252951727364
deviation-heading_median6.235252951727364
deviation-heading_min6.235252951727364
distance-from-start_max1.390965508634873
distance-from-start_mean1.390965508634873
distance-from-start_median1.390965508634873
distance-from-start_min1.390965508634873
driven_any_max3.4836910006517208
driven_any_mean3.4836910006517208
driven_any_median3.4836910006517208
driven_any_min3.4836910006517208
driven_lanedir_consec_max1.601745896224546
driven_lanedir_consec_mean1.601745896224546
driven_lanedir_consec_min1.601745896224546
driven_lanedir_max3.2989420775531983
driven_lanedir_mean3.2989420775531983
driven_lanedir_median3.2989420775531983
driven_lanedir_min3.2989420775531983
in-drivable-lane_max3.249999999999958
in-drivable-lane_mean3.249999999999958
in-drivable-lane_min3.249999999999958
per-episodes
details{"loop-000-ego0": {"driven_any": 3.4836910006517208, "survival_time": 59.99999999999873, "driven_lanedir": 3.2989420775531983, "in-drivable-lane": 3.249999999999958, "deviation-heading": 6.235252951727364, "distance-from-start": 1.390965508634873, "deviation-center-line": 5.338593212765516, "driven_lanedir_consec": 1.601745896224546}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143381230Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:09:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.0000000000000142
driven_lanedir_consec_median1.857807625020336
deviation-center-line_median5.28259065053435


other stats
deviation-center-line_max6.835139014020123
deviation-center-line_mean5.43336239298157
deviation-center-line_min4.333129256837456
deviation-heading_max10.8119794492084
deviation-heading_mean6.0042732735036015
deviation-heading_median4.89679221006279
deviation-heading_min3.4115292246804296
distance-from-start_max2.2673905887925794
distance-from-start_mean1.383447713974703
distance-from-start_median1.2056823254161633
distance-from-start_min0.8550356162739062
driven_any_max3.5795879547671228
driven_any_mean2.5262149201005553
driven_any_median2.515341830463492
driven_any_min1.494588064708115
driven_lanedir_consec_max3.438860731479879
driven_lanedir_consec_mean1.982872428209739
driven_lanedir_consec_min0.7770137313184056
driven_lanedir_max3.560278357516038
driven_lanedir_mean2.4513049805698603
driven_lanedir_median2.440455044725664
driven_lanedir_min1.3640314753120752
in-drivable-lane_max2.050000000000029
in-drivable-lane_mean1.0125000000000144
in-drivable-lane_min0.0
per-episodes
details{"4way-001-ego0": {"driven_any": 3.5795879547671228, "survival_time": 59.99999999999873, "driven_lanedir": 3.560278357516038, "in-drivable-lane": 0.0, "deviation-heading": 4.074339221369879, "distance-from-start": 2.2673905887925794, "deviation-center-line": 4.333129256837456, "driven_lanedir_consec": 3.438860731479879}, "4way-001-ego1": {"driven_any": 2.0840878521440405, "survival_time": 59.99999999999873, "driven_lanedir": 1.951170455689099, "in-drivable-lane": 2.050000000000029, "deviation-heading": 5.7192451987557, "distance-from-start": 0.8580872602580342, "deviation-center-line": 6.835139014020123, "driven_lanedir_consec": 0.7951700224687287}, "4way-001-ego2": {"driven_any": 1.494588064708115, "survival_time": 59.99999999999873, "driven_lanedir": 1.3640314753120752, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 10.8119794492084, "distance-from-start": 0.8550356162739062, "deviation-center-line": 5.503515330064552, "driven_lanedir_consec": 0.7770137313184056}, "4way-001-ego3": {"driven_any": 2.946595808782943, "survival_time": 59.99999999999873, "driven_lanedir": 2.929739633762229, "in-drivable-lane": 0.0, "deviation-heading": 3.4115292246804296, "distance-from-start": 1.5532773905742925, "deviation-center-line": 5.061665971004148, "driven_lanedir_consec": 2.9204452275719435}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143321231Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:08:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median49.74999999999931
in-drivable-lane_median1.0999999999999377
driven_lanedir_consec_median2.833004579842016
deviation-center-line_median4.613202410731162


other stats
deviation-center-line_max4.613202410731162
deviation-center-line_mean4.613202410731162
deviation-center-line_min4.613202410731162
deviation-heading_max2.4939487126008157
deviation-heading_mean2.4939487126008157
deviation-heading_median2.4939487126008157
deviation-heading_min2.4939487126008157
distance-from-start_max2.3401405715621477
distance-from-start_mean2.3401405715621477
distance-from-start_median2.3401405715621477
distance-from-start_min2.3401405715621477
driven_any_max2.889596956965826
driven_any_mean2.889596956965826
driven_any_median2.889596956965826
driven_any_min2.889596956965826
driven_lanedir_consec_max2.833004579842016
driven_lanedir_consec_mean2.833004579842016
driven_lanedir_consec_min2.833004579842016
driven_lanedir_max2.833004579842016
driven_lanedir_mean2.833004579842016
driven_lanedir_median2.833004579842016
driven_lanedir_min2.833004579842016
in-drivable-lane_max1.0999999999999377
in-drivable-lane_mean1.0999999999999377
in-drivable-lane_min1.0999999999999377
per-episodes
details{"4way-001-ego0": {"driven_any": 2.889596956965826, "survival_time": 49.74999999999931, "driven_lanedir": 2.833004579842016, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.4939487126008157, "distance-from-start": 2.3401405715621477, "deviation-center-line": 4.613202410731162, "driven_lanedir_consec": 2.833004579842016}}
simulation-passed1
survival_time_max49.74999999999931
survival_time_mean49.74999999999931
survival_time_min49.74999999999931
No reset possible
143271232Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-testingsim-0of4successnodavinci-stage-03-6.2.500:08:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.1499999999999257
driven_lanedir_consec_median3.3746337017701507
deviation-center-line_median6.057454700328478


other stats
deviation-center-line_max6.384332084814334
deviation-center-line_mean6.038904654854047
deviation-center-line_min5.656377133944901
deviation-heading_max7.471247478120028
deviation-heading_mean6.581525379111778
deviation-heading_median6.501228349070126
deviation-heading_min5.8523973401868306
distance-from-start_max2.955798853097406
distance-from-start_mean2.2776980078429148
distance-from-start_median2.4208015729281067
distance-from-start_min1.313390032418041
driven_any_max3.579593246505303
driven_any_mean3.529302881163586
driven_any_median3.515090515356918
driven_any_min3.5074372474352056
driven_lanedir_consec_max3.525823359544204
driven_lanedir_consec_mean3.062863916917712
driven_lanedir_consec_min1.9763649045863416
driven_lanedir_max3.525823359544204
driven_lanedir_mean3.4097663351344685
driven_lanedir_median3.3746337017701507
driven_lanedir_min3.3639745774533676
in-drivable-lane_max2.400000000000034
in-drivable-lane_mean1.6749999999999714
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.579593246505303, "survival_time": 59.99999999999873, "driven_lanedir": 3.525823359544204, "in-drivable-lane": 0.0, "deviation-heading": 6.822136240935285, "distance-from-start": 2.955798853097406, "deviation-center-line": 5.656377133944901, "driven_lanedir_consec": 3.525823359544204}, "autolab-000-ego1": {"driven_any": 3.5195908422465023, "survival_time": 59.99999999999873, "driven_lanedir": 3.384110905730893, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 7.471247478120028, "distance-from-start": 2.2087786070849105, "deviation-center-line": 5.794137771901705, "driven_lanedir_consec": 3.384110905730893}, "autolab-000-ego2": {"driven_any": 3.5074372474352056, "survival_time": 59.99999999999873, "driven_lanedir": 3.3639745774533676, "in-drivable-lane": 2.400000000000034, "deviation-heading": 5.8523973401868306, "distance-from-start": 1.313390032418041, "deviation-center-line": 6.320771628755251, "driven_lanedir_consec": 1.9763649045863416}, "autolab-000-ego3": {"driven_any": 3.5105901884673334, "survival_time": 59.99999999999873, "driven_lanedir": 3.365156497809408, "in-drivable-lane": 2.299999999999965, "deviation-heading": 6.180320457204967, "distance-from-start": 2.6328245387713025, "deviation-center-line": 6.384332084814334, "driven_lanedir_consec": 3.365156497809408}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143251233Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:02:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.649999999999984
in-drivable-lane_median0.0
driven_lanedir_consec_median0.33188081358015475
deviation-center-line_median0.20422121163305057


other stats
deviation-center-line_max0.20422121163305057
deviation-center-line_mean0.20422121163305057
deviation-center-line_min0.20422121163305057
deviation-heading_max0.7151394802499836
deviation-heading_mean0.7151394802499836
deviation-heading_median0.7151394802499836
deviation-heading_min0.7151394802499836
distance-from-start_max0.33329338421304333
distance-from-start_mean0.33329338421304333
distance-from-start_median0.33329338421304333
distance-from-start_min0.33329338421304333
driven_any_max0.33659927688888963
driven_any_mean0.33659927688888963
driven_any_median0.33659927688888963
driven_any_min0.33659927688888963
driven_lanedir_consec_max0.33188081358015475
driven_lanedir_consec_mean0.33188081358015475
driven_lanedir_consec_min0.33188081358015475
driven_lanedir_max0.33188081358015475
driven_lanedir_mean0.33188081358015475
driven_lanedir_median0.33188081358015475
driven_lanedir_min0.33188081358015475
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.33659927688888963, "survival_time": 6.649999999999984, "driven_lanedir": 0.33188081358015475, "in-drivable-lane": 0.0, "deviation-heading": 0.7151394802499836, "distance-from-start": 0.33329338421304333, "deviation-center-line": 0.20422121163305057, "driven_lanedir_consec": 0.33188081358015475}}
simulation-passed1
survival_time_max6.649999999999984
survival_time_mean6.649999999999984
survival_time_min6.649999999999984
No reset possible
143221233Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:05:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.099999999999845
driven_lanedir_consec_median3.2655265789104
deviation-center-line_median7.114511199103643


other stats
deviation-center-line_max7.114511199103643
deviation-center-line_mean7.114511199103643
deviation-center-line_min7.114511199103643
deviation-heading_max5.702635580930089
deviation-heading_mean5.702635580930089
deviation-heading_median5.702635580930089
deviation-heading_min5.702635580930089
distance-from-start_max1.6303678440695035
distance-from-start_mean1.6303678440695035
distance-from-start_median1.6303678440695035
distance-from-start_min1.6303678440695035
driven_any_max3.466336917289666
driven_any_mean3.466336917289666
driven_any_median3.466336917289666
driven_any_min3.466336917289666
driven_lanedir_consec_max3.2655265789104
driven_lanedir_consec_mean3.2655265789104
driven_lanedir_consec_min3.2655265789104
driven_lanedir_max3.2655265789104
driven_lanedir_mean3.2655265789104
driven_lanedir_median3.2655265789104
driven_lanedir_min3.2655265789104
in-drivable-lane_max4.099999999999845
in-drivable-lane_mean4.099999999999845
in-drivable-lane_min4.099999999999845
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.466336917289666, "survival_time": 59.99999999999873, "driven_lanedir": 3.2655265789104, "in-drivable-lane": 4.099999999999845, "deviation-heading": 5.702635580930089, "distance-from-start": 1.6303678440695035, "deviation-center-line": 7.114511199103643, "driven_lanedir_consec": 3.2655265789104}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143161235Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-testingsim-0of4successnodavinci-stage-03-6.2.500:04:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.0000000000000284
driven_lanedir_consec_median2.275400628096487
deviation-center-line_median5.720691806105115


other stats
deviation-center-line_max5.720691806105115
deviation-center-line_mean5.720691806105115
deviation-center-line_min5.720691806105115
deviation-heading_max5.389911935102068
deviation-heading_mean5.389911935102068
deviation-heading_median5.389911935102068
deviation-heading_min5.389911935102068
distance-from-start_max1.706973798275489
distance-from-start_mean1.706973798275489
distance-from-start_median1.706973798275489
distance-from-start_min1.706973798275489
driven_any_max3.5195876689872945
driven_any_mean3.5195876689872945
driven_any_median3.5195876689872945
driven_any_min3.5195876689872945
driven_lanedir_consec_max2.275400628096487
driven_lanedir_consec_mean2.275400628096487
driven_lanedir_consec_min2.275400628096487
driven_lanedir_max3.387708520229716
driven_lanedir_mean3.387708520229716
driven_lanedir_median3.387708520229716
driven_lanedir_min3.387708520229716
in-drivable-lane_max2.0000000000000284
in-drivable-lane_mean2.0000000000000284
in-drivable-lane_min2.0000000000000284
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.5195876689872945, "survival_time": 59.99999999999873, "driven_lanedir": 3.387708520229716, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.389911935102068, "distance-from-start": 1.706973798275489, "deviation-center-line": 5.720691806105115, "driven_lanedir_consec": 2.275400628096487}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143111237Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-0of4successnodavinci-stage-03-6.2.500:02:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.2
in-drivable-lane_median0.0
driven_lanedir_consec_median0.16440570511787245
deviation-center-line_median0.19162140900760455


other stats
deviation-center-line_max0.19162140900760455
deviation-center-line_mean0.19162140900760455
deviation-center-line_min0.19162140900760455
deviation-heading_max1.1939422489088862
deviation-heading_mean1.1939422489088862
deviation-heading_median1.1939422489088862
deviation-heading_min1.1939422489088862
distance-from-start_max0.19201183050647508
distance-from-start_mean0.19201183050647508
distance-from-start_median0.19201183050647508
distance-from-start_min0.19201183050647508
driven_any_max0.19201481064322065
driven_any_mean0.19201481064322065
driven_any_median0.19201481064322065
driven_any_min0.19201481064322065
driven_lanedir_consec_max0.16440570511787245
driven_lanedir_consec_mean0.16440570511787245
driven_lanedir_consec_min0.16440570511787245
driven_lanedir_max0.16440570511787245
driven_lanedir_mean0.16440570511787245
driven_lanedir_median0.16440570511787245
driven_lanedir_min0.16440570511787245
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.19201481064322065, "survival_time": 2.2, "driven_lanedir": 0.16440570511787245, "in-drivable-lane": 0.0, "deviation-heading": 1.1939422489088862, "distance-from-start": 0.19201183050647508, "deviation-center-line": 0.19162140900760455, "driven_lanedir_consec": 0.16440570511787245}}
simulation-passed1
survival_time_max2.2
survival_time_mean2.2
survival_time_min2.2
No reset possible
143051238Bea Baselines 🐤minimal-agentaido-LFVI-sim-validationsim-0of4successnodavinci-stage-03-6.2.500:02:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.3499999999999925
in-drivable-lane_median2.5999999999999917
driven_lanedir_consec_median0.1995533883076508
deviation-center-line_median0.12567493837705537


other stats
deviation-center-line_max0.12567493837705537
deviation-center-line_mean0.12567493837705537
deviation-center-line_min0.12567493837705537
deviation-heading_max0.9488219555580464
deviation-heading_mean0.9488219555580464
deviation-heading_median0.9488219555580464
deviation-heading_min0.9488219555580464
distance-from-start_max0.5484102917810773
distance-from-start_mean0.5484102917810773
distance-from-start_median0.5484102917810773
distance-from-start_min0.5484102917810773
driven_any_max0.5484215635455908
driven_any_mean0.5484215635455908
driven_any_median0.5484215635455908
driven_any_min0.5484215635455908
driven_lanedir_consec_max0.1995533883076508
driven_lanedir_consec_mean0.1995533883076508
driven_lanedir_consec_min0.1995533883076508
driven_lanedir_max0.1995533883076508
driven_lanedir_mean0.1995533883076508
driven_lanedir_median0.1995533883076508
driven_lanedir_min0.1995533883076508
in-drivable-lane_max2.5999999999999917
in-drivable-lane_mean2.5999999999999917
in-drivable-lane_min2.5999999999999917
per-episodes
details{"udem-000-ego0": {"driven_any": 0.5484215635455908, "survival_time": 4.3499999999999925, "driven_lanedir": 0.1995533883076508, "in-drivable-lane": 2.5999999999999917, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.5484102917810773, "deviation-center-line": 0.12567493837705537, "driven_lanedir_consec": 0.1995533883076508}}
simulation-passed1
survival_time_max4.3499999999999925
survival_time_mean4.3499999999999925
survival_time_min4.3499999999999925
No reset possible
143011239Bea Baselines 🐤minimal-agentaido-LFI-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
142821245Bea Baselines 🐤minimal-agentlx22-objdetsimsuccessyesdavinci-stage-03-6.2.500:12:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
driven_lanedir_consec_median3.766385412387078


other stats
deviation-center-line_max1.326684653251739
deviation-center-line_mean1.1145360814864316
deviation-center-line_median1.1145360814864316
deviation-center-line_min0.9023875097211244
deviation-heading_max0.9653478875423056
deviation-heading_mean0.8614808538844678
deviation-heading_median0.8614808538844678
deviation-heading_min0.75761382022663
distance-from-start_max9.8511235402485
distance-from-start_mean9.83680867234296
distance-from-start_median9.83680867234296
distance-from-start_min9.822493804437425
driven_any_max9.857519753799252
driven_any_mean9.843192862723654
driven_any_median9.843192862723654
driven_any_min9.828865971648057
driven_lanedir_consec_max5.116504350759583
driven_lanedir_consec_mean3.766385412387078
driven_lanedir_consec_min2.416266474014573
driven_lanedir_max5.116504350759583
driven_lanedir_mean3.766385412387078
driven_lanedir_median3.766385412387078
driven_lanedir_min2.416266474014573
in-drivable-lane_max44.99999999999865
in-drivable-lane_mean36.82499999999853
in-drivable-lane_median36.82499999999853
in-drivable-lane_min28.649999999998418
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 9.857519753799252, "survival_time": 59.99999999999873, "driven_lanedir": 5.116504350759583, "in-drivable-lane": 28.649999999998418, "deviation-heading": 0.9653478875423056, "distance-from-start": 9.8511235402485, "deviation-center-line": 1.326684653251739, "driven_lanedir_consec": 5.116504350759583}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 9.828865971648057, "survival_time": 59.99999999999873, "driven_lanedir": 2.416266474014573, "in-drivable-lane": 44.99999999999865, "deviation-heading": 0.75761382022663, "distance-from-start": 9.822493804437425, "deviation-center-line": 0.9023875097211244, "driven_lanedir_consec": 2.416266474014573}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
142781259Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-1of4successnodavinci-stage-03-6.2.500:03:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.85000000000002
in-drivable-lane_median9.45000000000002
driven_lanedir_consec_median0.13666265914899656
deviation-center-line_median0.1078383533310603


other stats
deviation-center-line_max0.1078383533310603
deviation-center-line_mean0.1078383533310603
deviation-center-line_min0.1078383533310603
deviation-heading_max0.9508048428349388
deviation-heading_mean0.9508048428349388
deviation-heading_median0.9508048428349388
deviation-heading_min0.9508048428349388
distance-from-start_max1.6182798682575184
distance-from-start_mean1.6182798682575184
distance-from-start_median1.6182798682575184
distance-from-start_min1.6182798682575184
driven_any_max1.618389277101389
driven_any_mean1.618389277101389
driven_any_median1.618389277101389
driven_any_min1.618389277101389
driven_lanedir_consec_max0.13666265914899656
driven_lanedir_consec_mean0.13666265914899656
driven_lanedir_consec_min0.13666265914899656
driven_lanedir_max0.13666265914899656
driven_lanedir_mean0.13666265914899656
driven_lanedir_median0.13666265914899656
driven_lanedir_min0.13666265914899656
in-drivable-lane_max9.45000000000002
in-drivable-lane_mean9.45000000000002
in-drivable-lane_min9.45000000000002
per-episodes
details{"loop-000-ego0": {"driven_any": 1.618389277101389, "survival_time": 10.85000000000002, "driven_lanedir": 0.13666265914899656, "in-drivable-lane": 9.45000000000002, "deviation-heading": 0.9508048428349388, "distance-from-start": 1.6182798682575184, "deviation-center-line": 0.1078383533310603, "driven_lanedir_consec": 0.13666265914899656}}
simulation-passed1
survival_time_max10.85000000000002
survival_time_mean10.85000000000002
survival_time_min10.85000000000002
No reset possible
142731260Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
142691261Bea Baselines 🐤minimal-agentaido-LFI-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
142621263Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-testingsim-0of4successnodavinci-stage-03-6.2.500:04:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.050000000000022
in-drivable-lane_median9.425000000000022
driven_lanedir_consec_median0.18712269938788828
deviation-center-line_median0.15973050554702342


other stats
deviation-center-line_max0.21472209870657577
deviation-center-line_mean0.16050533162691244
deviation-center-line_min0.10783821670702712
deviation-heading_max1.3047652579244493
deviation-heading_mean0.8970980849375731
deviation-heading_median0.8549948818349844
deviation-heading_min0.5736373181558745
distance-from-start_max1.6510147598674252
distance-from-start_mean0.6888645402096076
distance-from-start_median0.439724395200456
distance-from-start_min0.2249946105700932
driven_any_max1.6511245063698194
driven_any_mean0.6888969972348484
driven_any_median0.43973285777181176
driven_any_min0.2249977670259511
driven_lanedir_consec_max0.6611934212369679
driven_lanedir_consec_mean0.2874529754105062
driven_lanedir_consec_min0.11437308162928028
driven_lanedir_max0.6611934212369679
driven_lanedir_mean0.2874529754105062
driven_lanedir_median0.18712269938788828
driven_lanedir_min0.11437308162928028
in-drivable-lane_max9.850000000000025
in-drivable-lane_mean8.750000000000025
in-drivable-lane_min6.300000000000031
per-episodes
details{"udem-000-ego0": {"driven_any": 0.5146585239873331, "survival_time": 11.050000000000022, "driven_lanedir": 0.13666480491620847, "in-drivable-lane": 9.650000000000022, "deviation-heading": 0.9508048428349388, "distance-from-start": 0.5146479428595168, "deviation-center-line": 0.10783821670702712, "driven_lanedir_consec": 0.13666480491620847}, "udem-000-ego1": {"driven_any": 0.3648071915562904, "survival_time": 11.050000000000022, "driven_lanedir": 0.2375805938595681, "in-drivable-lane": 9.20000000000002, "deviation-heading": 0.5736373181558745, "distance-from-start": 0.3648008475413953, "deviation-center-line": 0.20320962418622543, "driven_lanedir_consec": 0.2375805938595681}, "udem-000-ego2": {"driven_any": 1.6511245063698194, "survival_time": 11.050000000000022, "driven_lanedir": 0.6611934212369679, "in-drivable-lane": 6.300000000000031, "deviation-heading": 1.3047652579244493, "distance-from-start": 1.6510147598674252, "deviation-center-line": 0.21472209870657577, "driven_lanedir_consec": 0.6611934212369679}, "udem-000-ego3": {"driven_any": 0.2249977670259511, "survival_time": 11.050000000000022, "driven_lanedir": 0.11437308162928028, "in-drivable-lane": 9.850000000000025, "deviation-heading": 0.7591849208350301, "distance-from-start": 0.2249946105700932, "deviation-center-line": 0.1162513869078214, "driven_lanedir_consec": 0.11437308162928028}}
simulation-passed1
survival_time_max11.050000000000022
survival_time_mean11.050000000000022
survival_time_min11.050000000000022
No reset possible
142571264Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:02:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.650000000000002
in-drivable-lane_median7.325000000000005
driven_lanedir_consec_median0.22238961894840312
deviation-center-line_median0.2217639861515468


other stats
deviation-center-line_max0.3356899474445727
deviation-center-line_mean0.2217639861515468
deviation-center-line_min0.10783802485852088
deviation-heading_max2.3398302467533574
deviation-heading_mean1.645317544794148
deviation-heading_median1.645317544794148
deviation-heading_min0.9508048428349386
distance-from-start_max1.4215609490996366
distance-from-start_mean1.232352636856231
distance-from-start_median1.232352636856231
distance-from-start_min1.0431443246128251
driven_any_max1.421667748584305
driven_any_mean1.2324324663788455
driven_any_median1.2324324663788455
driven_any_min1.043197184173386
driven_lanedir_consec_max0.3081134793062541
driven_lanedir_consec_mean0.22238961894840312
driven_lanedir_consec_min0.1366657585905522
driven_lanedir_max0.3081134793062541
driven_lanedir_mean0.22238961894840312
driven_lanedir_median0.22238961894840312
driven_lanedir_min0.1366657585905522
in-drivable-lane_max8.250000000000002
in-drivable-lane_mean7.325000000000005
in-drivable-lane_min6.400000000000007
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.043197184173386, "survival_time": 9.650000000000002, "driven_lanedir": 0.1366657585905522, "in-drivable-lane": 8.250000000000002, "deviation-heading": 0.9508048428349386, "distance-from-start": 1.0431443246128251, "deviation-center-line": 0.10783802485852088, "driven_lanedir_consec": 0.1366657585905522}, "loop2-000-ego1": {"driven_any": 1.421667748584305, "survival_time": 9.650000000000002, "driven_lanedir": 0.3081134793062541, "in-drivable-lane": 6.400000000000007, "deviation-heading": 2.3398302467533574, "distance-from-start": 1.4215609490996366, "deviation-center-line": 0.3356899474445727, "driven_lanedir_consec": 0.3081134793062541}}
simulation-passed1
survival_time_max9.650000000000002
survival_time_mean9.650000000000002
survival_time_min9.650000000000002
No reset possible
142541265Bea Baselines 🐤minimal-agentaido-LFP-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:02:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.050000000000036
in-drivable-lane_median8.950000000000042
driven_lanedir_consec_median0.30902388815479953
deviation-center-line_median0.26861568883973136


other stats
deviation-center-line_max0.26861568883973136
deviation-center-line_mean0.26861568883973136
deviation-center-line_min0.26861568883973136
deviation-heading_max2.499533756017491
deviation-heading_mean2.499533756017491
deviation-heading_median2.499533756017491
deviation-heading_min2.499533756017491
distance-from-start_max1.816331806096384
distance-from-start_mean1.816331806096384
distance-from-start_median1.816331806096384
distance-from-start_min1.816331806096384
driven_any_max1.8164449732417056
driven_any_mean1.8164449732417056
driven_any_median1.8164449732417056
driven_any_min1.8164449732417056
driven_lanedir_consec_max0.30902388815479953
driven_lanedir_consec_mean0.30902388815479953
driven_lanedir_consec_min0.30902388815479953
driven_lanedir_max0.30902388815479953
driven_lanedir_mean0.30902388815479953
driven_lanedir_median0.30902388815479953
driven_lanedir_min0.30902388815479953
in-drivable-lane_max8.950000000000042
in-drivable-lane_mean8.950000000000042
in-drivable-lane_min8.950000000000042
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.8164449732417056, "survival_time": 12.050000000000036, "driven_lanedir": 0.30902388815479953, "in-drivable-lane": 8.950000000000042, "deviation-heading": 2.499533756017491, "distance-from-start": 1.816331806096384, "deviation-center-line": 0.26861568883973136, "driven_lanedir_consec": 0.30902388815479953}}
simulation-passed1
survival_time_max12.050000000000036
survival_time_mean12.050000000000036
survival_time_min12.050000000000036
No reset possible
142511276Bea Baselines 🐤template-randomlx22-visservoingsimsuccessyesdavinci-stage-03-6.2.500:05:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median23.174999999999663
deviation-center-line_median1.1846435027267537
driven_lanedir_consec_median0.4119359833831363
survival_time_median35.84999999999938


other stats
deviation-center-line_max2.053692550333513
deviation-center-line_mean1.1846435027267537
deviation-center-line_min0.31559445511999407
deviation-heading_max15.80459948077375
deviation-heading_mean9.065579449172477
deviation-heading_median9.065579449172477
deviation-heading_min2.326559417571199
distance-from-start_max1.4108418329398822
distance-from-start_mean0.9784996704397644
distance-from-start_median0.9784996704397644
distance-from-start_min0.5461575079396466
driven_any_max15.326310847370593
driven_any_mean8.912150167222187
driven_any_median8.912150167222187
driven_any_min2.497989487073779
driven_lanedir_consec_max0.6105561181479094
driven_lanedir_consec_mean0.4119359833831363
driven_lanedir_consec_min0.21331584861836328
driven_lanedir_max0.5974394680482642
driven_lanedir_mean0.40241777001121354
driven_lanedir_median0.40241777001121354
driven_lanedir_min0.20739607197416288
in-drivable-lane_max38.19999999999931
in-drivable-lane_mean23.174999999999663
in-drivable-lane_min8.150000000000023
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 2.497989487073779, "survival_time": 11.700000000000031, "driven_lanedir": 0.20739607197416288, "in-drivable-lane": 8.150000000000023, "deviation-heading": 2.326559417571199, "distance-from-start": 0.5461575079396466, "deviation-center-line": 0.31559445511999407, "driven_lanedir_consec": 0.21331584861836328}, "LF-small-loop-001-ego0": {"driven_any": 15.326310847370593, "survival_time": 59.99999999999873, "driven_lanedir": 0.5974394680482642, "in-drivable-lane": 38.19999999999931, "deviation-heading": 15.80459948077375, "distance-from-start": 1.4108418329398822, "deviation-center-line": 2.053692550333513, "driven_lanedir_consec": 0.6105561181479094}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean35.84999999999938
survival_time_min11.700000000000031
No reset possible
142471289Bea Baselines 🐤template-randomaido-LFV-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:07:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median48.74999999999937
in-drivable-lane_median34.749999999999275
driven_lanedir_consec_median0.24555746228952957
deviation-center-line_median1.3919847015555793


other stats
deviation-center-line_max1.3919847015555793
deviation-center-line_mean1.3919847015555793
deviation-center-line_min1.3919847015555793
deviation-heading_max9.906601177812297
deviation-heading_mean9.906601177812297
deviation-heading_median9.906601177812297
deviation-heading_min9.906601177812297
distance-from-start_max1.1351054760255683
distance-from-start_mean1.1351054760255683
distance-from-start_median1.1351054760255683
distance-from-start_min1.1351054760255683
driven_any_max12.250926783811016
driven_any_mean12.250926783811016
driven_any_median12.250926783811016
driven_any_min12.250926783811016
driven_lanedir_consec_max0.24555746228952957
driven_lanedir_consec_mean0.24555746228952957
driven_lanedir_consec_min0.24555746228952957
driven_lanedir_max0.2358197494342854
driven_lanedir_mean0.2358197494342854
driven_lanedir_median0.2358197494342854
driven_lanedir_min0.2358197494342854
in-drivable-lane_max34.749999999999275
in-drivable-lane_mean34.749999999999275
in-drivable-lane_min34.749999999999275
per-episodes
details{"loop2-000-ego0": {"driven_any": 12.250926783811016, "survival_time": 48.74999999999937, "driven_lanedir": 0.2358197494342854, "in-drivable-lane": 34.749999999999275, "deviation-heading": 9.906601177812297, "distance-from-start": 1.1351054760255683, "deviation-center-line": 1.3919847015555793, "driven_lanedir_consec": 0.24555746228952957}}
simulation-passed1
survival_time_max48.74999999999937
survival_time_mean48.74999999999937
survival_time_min48.74999999999937
No reset possible
142431290Bea Baselines 🐤template-randomaido-LFVI-sim-testingsim-1of4successnodavinci-stage-03-6.2.500:04:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.350000000000026
in-drivable-lane_median7.900000000000015
driven_lanedir_consec_median0.02729617395902917
deviation-center-line_median0.32682195168324285


other stats
deviation-center-line_max0.32682195168324285
deviation-center-line_mean0.32682195168324285
deviation-center-line_min0.32682195168324285
deviation-heading_max2.5540249040512006
deviation-heading_mean2.5540249040512006
deviation-heading_median2.5540249040512006
deviation-heading_min2.5540249040512006
distance-from-start_max0.5461575079396513
distance-from-start_mean0.5461575079396513
distance-from-start_median0.5461575079396513
distance-from-start_min0.5461575079396513
driven_any_max2.295525081876515
driven_any_mean2.295525081876515
driven_any_median2.295525081876515
driven_any_min2.295525081876515
driven_lanedir_consec_max0.02729617395902917
driven_lanedir_consec_mean0.02729617395902917
driven_lanedir_consec_min0.02729617395902917
driven_lanedir_max0.030642516057663105
driven_lanedir_mean0.030642516057663105
driven_lanedir_median0.030642516057663105
driven_lanedir_min0.030642516057663105
in-drivable-lane_max7.900000000000015
in-drivable-lane_mean7.900000000000015
in-drivable-lane_min7.900000000000015
per-episodes
details{"4way-000-ego0": {"driven_any": 2.295525081876515, "survival_time": 11.350000000000026, "driven_lanedir": 0.030642516057663105, "in-drivable-lane": 7.900000000000015, "deviation-heading": 2.5540249040512006, "distance-from-start": 0.5461575079396513, "deviation-center-line": 0.32682195168324285, "driven_lanedir_consec": 0.02729617395902917}}
simulation-passed1
survival_time_max11.350000000000026
survival_time_mean11.350000000000026
survival_time_min11.350000000000026
No reset possible
142381291Bea Baselines 🐤template-randomaido-LFI-sim-testingsim-0of4successnodavinci-stage-03-6.2.500:03:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.350000000000026
in-drivable-lane_median7.900000000000015
driven_lanedir_consec_median0.029484722837852084
deviation-center-line_median0.326841308646148


other stats
deviation-center-line_max0.326841308646148
deviation-center-line_mean0.326841308646148
deviation-center-line_min0.326841308646148
deviation-heading_max2.548872600298709
deviation-heading_mean2.548872600298709
deviation-heading_median2.548872600298709
deviation-heading_min2.548872600298709
distance-from-start_max0.5461575079396456
distance-from-start_mean0.5461575079396456
distance-from-start_median0.5461575079396456
distance-from-start_min0.5461575079396456
driven_any_max2.2955250818765065
driven_any_mean2.2955250818765065
driven_any_median2.2955250818765065
driven_any_min2.2955250818765065
driven_lanedir_consec_max0.029484722837852084
driven_lanedir_consec_mean0.029484722837852084
driven_lanedir_consec_min0.029484722837852084
driven_lanedir_max0.03283106493648602
driven_lanedir_mean0.03283106493648602
driven_lanedir_median0.03283106493648602
driven_lanedir_min0.03283106493648602
in-drivable-lane_max7.900000000000015
in-drivable-lane_mean7.900000000000015
in-drivable-lane_min7.900000000000015
per-episodes
details{"4way-000-ego0": {"driven_any": 2.2955250818765065, "survival_time": 11.350000000000026, "driven_lanedir": 0.03283106493648602, "in-drivable-lane": 7.900000000000015, "deviation-heading": 2.548872600298709, "distance-from-start": 0.5461575079396456, "deviation-center-line": 0.326841308646148, "driven_lanedir_consec": 0.029484722837852084}}
simulation-passed1
survival_time_max11.350000000000026
survival_time_mean11.350000000000026
survival_time_min11.350000000000026
No reset possible
142251294Bea Baselines 🐤template-randomaido-LFV_multi-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:24:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median50.29999999999875
driven_lanedir_consec_median0.2447360136393999
deviation-center-line_median0.8201377542768524


other stats
deviation-center-line_max1.1069457194070875
deviation-center-line_mean0.7677403353962817
deviation-center-line_min0.3237401136243348
deviation-heading_max12.93145476995294
deviation-heading_mean8.15077258988621
deviation-heading_median8.265274464791538
deviation-heading_min3.141086660008822
distance-from-start_max1.410841832939908
distance-from-start_mean1.0363313004962076
distance-from-start_median1.0345816229075964
distance-from-start_min0.6653201232297296
driven_any_max15.326310847370548
driven_any_mean9.916481674175056
driven_any_median10.348447553867391
driven_any_min3.642720741594884
driven_lanedir_consec_max0.41005402159019166
driven_lanedir_consec_mean0.2556548579850866
driven_lanedir_consec_min0.12309338307135484
driven_lanedir_max0.40636448176148865
driven_lanedir_mean0.24489136742153575
driven_lanedir_median0.23207066701918888
driven_lanedir_min0.10905965388627664
in-drivable-lane_max55.59999999999871
in-drivable-lane_mean50.837499999998734
in-drivable-lane_min47.14999999999874
per-episodes
details{"zigzag-000-ego0": {"driven_any": 12.1929529246946, "survival_time": 59.99999999999873, "driven_lanedir": 0.22628350607467773, "in-drivable-lane": 47.999999999998806, "deviation-heading": 10.0526055653766, "distance-from-start": 1.1351054760255626, "deviation-center-line": 0.970368058015948, "driven_lanedir_consec": 0.22628350607467773}, "zigzag-000-ego1": {"driven_any": 15.326310847370548, "survival_time": 59.99999999999873, "driven_lanedir": 0.23785782796370003, "in-drivable-lane": 47.14999999999874, "deviation-heading": 12.93145476995294, "distance-from-start": 1.410841832939908, "deviation-center-line": 1.1069457194070875, "driven_lanedir_consec": 0.26318852120412206}, "zigzag-000-ego2": {"driven_any": 8.503942183040182, "survival_time": 59.99999999999873, "driven_lanedir": 0.10905965388627664, "in-drivable-lane": 55.59999999999871, "deviation-heading": 3.141086660008822, "distance-from-start": 0.9340577697896302, "deviation-center-line": 0.3237401136243348, "driven_lanedir_consec": 0.12309338307135484}, "zigzag-000-ego3": {"driven_any": 3.642720741594884, "survival_time": 59.99999999999873, "driven_lanedir": 0.40636448176148865, "in-drivable-lane": 52.59999999999869, "deviation-heading": 6.477943364206477, "distance-from-start": 0.6653201232297296, "deviation-center-line": 0.6699074505377567, "driven_lanedir_consec": 0.41005402159019166}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
142151268Bea Baselines 🐤template-randomaido-LFVI-sim-validationsim-1of4successnodavinci-stage-03-6.2.500:11:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median45.099999999999575
in-drivable-lane_median36.54999999999956
driven_lanedir_consec_median0.26764984149988424
deviation-center-line_median0.7555295762526522


other stats
deviation-center-line_max0.7555295762526522
deviation-center-line_mean0.7555295762526522
deviation-center-line_min0.7555295762526522
deviation-heading_max5.523299013646982
deviation-heading_mean5.523299013646982
deviation-heading_median5.523299013646982
deviation-heading_min5.523299013646982
distance-from-start_max1.044224797669204
distance-from-start_mean1.044224797669204
distance-from-start_median1.044224797669204
distance-from-start_min1.044224797669204
driven_any_max11.376062002465122
driven_any_mean11.376062002465122
driven_any_median11.376062002465122
driven_any_min11.376062002465122
driven_lanedir_consec_max0.26764984149988424
driven_lanedir_consec_mean0.26764984149988424
driven_lanedir_consec_min0.26764984149988424
driven_lanedir_max0.24963678127672728
driven_lanedir_mean0.24963678127672728
driven_lanedir_median0.24963678127672728
driven_lanedir_min0.24963678127672728
in-drivable-lane_max36.54999999999956
in-drivable-lane_mean36.54999999999956
in-drivable-lane_min36.54999999999956
per-episodes
details{"4way-000-ego0": {"driven_any": 11.376062002465122, "survival_time": 45.099999999999575, "driven_lanedir": 0.24963678127672728, "in-drivable-lane": 36.54999999999956, "deviation-heading": 5.523299013646982, "distance-from-start": 1.044224797669204, "deviation-center-line": 0.7555295762526522, "driven_lanedir_consec": 0.26764984149988424}}
simulation-passed1
survival_time_max45.099999999999575
survival_time_mean45.099999999999575
survival_time_min45.099999999999575
No reset possible
142111269Bea Baselines 🐤template-randomaido-LFI-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
141991272Bea Baselines 🐤template-randomaido-LFV_multi-sim-validationsim-0of4successnodavinci-stage-03-6.2.500:20:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median54.674999999998704
driven_lanedir_consec_median0.12251247869641724
deviation-center-line_median0.4433920965103467


other stats
deviation-center-line_max1.2038527288241243
deviation-center-line_mean0.5423174087533363
deviation-center-line_min0.07863271316852748
deviation-heading_max14.288552729590728
deviation-heading_mean5.627247694260051
deviation-heading_median3.416903566880354
deviation-heading_min1.38663091368877
distance-from-start_max1.4108418329398955
distance-from-start_mean0.8799981600642298
distance-from-start_median0.7992095848737366
distance-from-start_min0.5107316375695505
driven_any_max15.326310847370582
driven_any_mean7.171771192512803
driven_any_median6.412570219301883
driven_any_min0.5356334840768605
driven_lanedir_consec_max0.4413235258740946
driven_lanedir_consec_mean0.1898162935783138
driven_lanedir_consec_min0.07291669104632614
driven_lanedir_max0.4413235258740946
driven_lanedir_mean0.1804353170531879
driven_lanedir_median0.1104128284063164
driven_lanedir_min0.05959208552602435
in-drivable-lane_max57.749999999998735
in-drivable-lane_mean52.93749999999879
in-drivable-lane_min44.649999999999025
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.5356334840768605, "survival_time": 59.99999999999873, "driven_lanedir": 0.4413235258740946, "in-drivable-lane": 57.749999999998735, "deviation-heading": 1.38663091368877, "distance-from-start": 0.5107316375695505, "deviation-center-line": 0.07863271316852748, "driven_lanedir_consec": 0.4413235258740946}, "autolab-000-ego1": {"driven_any": 15.326310847370582, "survival_time": 59.99999999999873, "driven_lanedir": 0.05959208552602435, "in-drivable-lane": 44.649999999999025, "deviation-heading": 14.288552729590728, "distance-from-start": 1.4108418329398955, "deviation-center-line": 1.2038527288241243, "driven_lanedir_consec": 0.07291669104632614}, "autolab-000-ego2": {"driven_any": 7.342290201921084, "survival_time": 59.99999999999873, "driven_lanedir": 0.1334588763696649, "in-drivable-lane": 54.64999999999871, "deviation-heading": 3.0294981006515846, "distance-from-start": 0.8626308120701035, "deviation-center-line": 0.4429996774431571, "driven_lanedir_consec": 0.14670729988336562}, "autolab-000-ego3": {"driven_any": 5.482850236682682, "survival_time": 59.99999999999873, "driven_lanedir": 0.08736678044296786, "in-drivable-lane": 54.699999999998695, "deviation-heading": 3.804309033109123, "distance-from-start": 0.7357883576773698, "deviation-center-line": 0.44378451557753634, "driven_lanedir_consec": 0.09831765750946886}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
141921273Bea Baselines 🐤template-randomaido-LFP-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:08:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median36.099999999999135
driven_lanedir_consec_median0.33349329950959106
deviation-center-line_median2.107688838912731


other stats
deviation-center-line_max2.107688838912731
deviation-center-line_mean2.107688838912731
deviation-center-line_min2.107688838912731
deviation-heading_max23.30238865255163
deviation-heading_mean23.30238865255163
deviation-heading_median23.30238865255163
deviation-heading_min23.30238865255163
distance-from-start_max1.4108418329398933
distance-from-start_mean1.4108418329398933
distance-from-start_median1.4108418329398933
distance-from-start_min1.4108418329398933
driven_any_max15.326310847370516
driven_any_mean15.326310847370516
driven_any_median15.326310847370516
driven_any_min15.326310847370516
driven_lanedir_consec_max0.33349329950959106
driven_lanedir_consec_mean0.33349329950959106
driven_lanedir_consec_min0.33349329950959106
driven_lanedir_max0.2728719387129268
driven_lanedir_mean0.2728719387129268
driven_lanedir_median0.2728719387129268
driven_lanedir_min0.2728719387129268
in-drivable-lane_max36.099999999999135
in-drivable-lane_mean36.099999999999135
in-drivable-lane_min36.099999999999135
per-episodes
details{"zigzag-000-ego0": {"driven_any": 15.326310847370516, "survival_time": 59.99999999999873, "driven_lanedir": 0.2728719387129268, "in-drivable-lane": 36.099999999999135, "deviation-heading": 23.30238865255163, "distance-from-start": 1.4108418329398933, "deviation-center-line": 2.107688838912731, "driven_lanedir_consec": 0.33349329950959106}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
141821120Bea Baselines 🐤template-randomaido-LF-sim-testingsim-2of4abortednodavinci-stage-03-6.2.500:00:46
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1302, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 749, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
141801121Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-0of4abortednodavinci-stage-03-6.2.500:02:53
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1302, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 749, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
141781122Bea Baselines 🐤template-randomaido-LFV_multi-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:07:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median44.99999999999958
in-drivable-lane_median39.249999999999574
driven_lanedir_consec_median0.1329316137267978
deviation-center-line_median0.4769519451920501


other stats
deviation-center-line_max0.627148077892518
deviation-center-line_mean0.4769519451920501
deviation-center-line_min0.3267558124915822
deviation-heading_max4.173256858222429
deviation-heading_mean3.3650961945019375
deviation-heading_median3.3650961945019375
deviation-heading_min2.5569355307814456
distance-from-start_max1.0442247976691823
distance-from-start_mean0.7951911528044138
distance-from-start_median0.7951911528044138
distance-from-start_min0.5461575079396452
driven_any_max11.349124250612952
driven_any_mean6.923556868843365
driven_any_median6.923556868843365
driven_any_min2.497989487073778
driven_lanedir_consec_max0.2397940766790495
driven_lanedir_consec_mean0.1329316137267978
driven_lanedir_consec_min0.02606915077454608
driven_lanedir_max0.2256600500204217
driven_lanedir_mean0.1275377118421561
driven_lanedir_median0.1275377118421561
driven_lanedir_min0.029415373663890465
in-drivable-lane_max41.54999999999957
in-drivable-lane_mean39.249999999999574
in-drivable-lane_min36.94999999999958
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.497989487073778, "survival_time": 44.99999999999958, "driven_lanedir": 0.029415373663890465, "in-drivable-lane": 41.54999999999957, "deviation-heading": 2.5569355307814456, "distance-from-start": 0.5461575079396452, "deviation-center-line": 0.3267558124915822, "driven_lanedir_consec": 0.02606915077454608}, "loop2-000-ego1": {"driven_any": 11.349124250612952, "survival_time": 44.99999999999958, "driven_lanedir": 0.2256600500204217, "in-drivable-lane": 36.94999999999958, "deviation-heading": 4.173256858222429, "distance-from-start": 1.0442247976691823, "deviation-center-line": 0.627148077892518, "driven_lanedir_consec": 0.2397940766790495}}
simulation-passed1
survival_time_max44.99999999999958
survival_time_mean44.99999999999958
survival_time_min44.99999999999958
No reset possible
141741123Bea Baselines 🐤template-randomaido-LFP-sim-testingsim-1of4successnodavinci-stage-03-6.2.500:05:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median43.29999999999968
in-drivable-lane_median35.7499999999996
driven_lanedir_consec_median0.054336775833862205
deviation-center-line_median0.6346586353316823


other stats
deviation-center-line_max0.6346586353316823
deviation-center-line_mean0.6346586353316823
deviation-center-line_min0.6346586353316823
deviation-heading_max5.904235246936354
deviation-heading_mean5.904235246936354
deviation-heading_median5.904235246936354
deviation-heading_min5.904235246936354
distance-from-start_max1.009340436005913
distance-from-start_mean1.009340436005913
distance-from-start_median1.009340436005913
distance-from-start_min1.009340436005913
driven_any_max10.522906217249686
driven_any_mean10.522906217249686
driven_any_median10.522906217249686
driven_any_min10.522906217249686
driven_lanedir_consec_max0.054336775833862205
driven_lanedir_consec_mean0.054336775833862205
driven_lanedir_consec_min0.054336775833862205
driven_lanedir_max0.05768311793249614
driven_lanedir_mean0.05768311793249614
driven_lanedir_median0.05768311793249614
driven_lanedir_min0.05768311793249614
in-drivable-lane_max35.7499999999996
in-drivable-lane_mean35.7499999999996
in-drivable-lane_min35.7499999999996
per-episodes
details{"loop-000-ego0": {"driven_any": 10.522906217249686, "survival_time": 43.29999999999968, "driven_lanedir": 0.05768311793249614, "in-drivable-lane": 35.7499999999996, "deviation-heading": 5.904235246936354, "distance-from-start": 1.009340436005913, "deviation-center-line": 0.6346586353316823, "driven_lanedir_consec": 0.054336775833862205}}
simulation-passed1
survival_time_max43.29999999999968
survival_time_mean43.29999999999968
survival_time_min43.29999999999968
No reset possible
141641125Bea Baselines 🐤template-rosaido-LFV-sim-validationsim-1of4successnodavinci-stage-03-6.2.500:02:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.049999999999983
in-drivable-lane_median5.699999999999982
driven_lanedir_consec_median0.26690835128077284
deviation-center-line_median0.09184210280953672


other stats
deviation-center-line_max0.09184210280953672
deviation-center-line_mean0.09184210280953672
deviation-center-line_min0.09184210280953672
deviation-heading_max0.5985603323274207
deviation-heading_mean0.5985603323274207
deviation-heading_median0.5985603323274207
deviation-heading_min0.5985603323274207
distance-from-start_max1.7861822941250527
distance-from-start_mean1.7861822941250527
distance-from-start_median1.7861822941250527
distance-from-start_min1.7861822941250527
driven_any_max1.8411532629731413
driven_any_mean1.8411532629731413
driven_any_median1.8411532629731413
driven_any_min1.8411532629731413
driven_lanedir_consec_max0.26690835128077284
driven_lanedir_consec_mean0.26690835128077284
driven_lanedir_consec_min0.26690835128077284
driven_lanedir_max0.26690835128077284
driven_lanedir_mean0.26690835128077284
driven_lanedir_median0.26690835128077284
driven_lanedir_min0.26690835128077284
in-drivable-lane_max5.699999999999982
in-drivable-lane_mean5.699999999999982
in-drivable-lane_min5.699999999999982
per-episodes
details{"loop-000-ego0": {"driven_any": 1.8411532629731413, "survival_time": 7.049999999999983, "driven_lanedir": 0.26690835128077284, "in-drivable-lane": 5.699999999999982, "deviation-heading": 0.5985603323274207, "distance-from-start": 1.7861822941250527, "deviation-center-line": 0.09184210280953672, "driven_lanedir_consec": 0.26690835128077284}}
simulation-passed1
survival_time_max7.049999999999983
survival_time_mean7.049999999999983
survival_time_min7.049999999999983
No reset possible
141581126Bea Baselines 🐤template-rosaido-LFVI-sim-validationsim-0of4successnodavinci-stage-03-6.2.500:02:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.449999999999992
in-drivable-lane_median3.299999999999992
driven_lanedir_consec_median0.20545449527478343
deviation-center-line_median0.07252080635465492


other stats
deviation-center-line_max0.07252080635465492
deviation-center-line_mean0.07252080635465492
deviation-center-line_min0.07252080635465492
deviation-heading_max0.6276042079186089
deviation-heading_mean0.6276042079186089
deviation-heading_median0.6276042079186089
deviation-heading_min0.6276042079186089
distance-from-start_max0.9399380142147756
distance-from-start_mean0.9399380142147756
distance-from-start_median0.9399380142147756
distance-from-start_min0.9399380142147756
driven_any_max0.9847921157636572
driven_any_mean0.9847921157636572
driven_any_median0.9847921157636572
driven_any_min0.9847921157636572
driven_lanedir_consec_max0.20545449527478343
driven_lanedir_consec_mean0.20545449527478343
driven_lanedir_consec_min0.20545449527478343
driven_lanedir_max0.20545449527478343
driven_lanedir_mean0.20545449527478343
driven_lanedir_median0.20545449527478343
driven_lanedir_min0.20545449527478343
in-drivable-lane_max3.299999999999992
in-drivable-lane_mean3.299999999999992
in-drivable-lane_min3.299999999999992
per-episodes
details{"udem-000-ego0": {"driven_any": 0.9847921157636572, "survival_time": 4.449999999999992, "driven_lanedir": 0.20545449527478343, "in-drivable-lane": 3.299999999999992, "deviation-heading": 0.6276042079186089, "distance-from-start": 0.9399380142147756, "deviation-center-line": 0.07252080635465492, "driven_lanedir_consec": 0.20545449527478343}}
simulation-passed1
survival_time_max4.449999999999992
survival_time_mean4.449999999999992
survival_time_min4.449999999999992
No reset possible
141551127Bea Baselines 🐤template-rosaido-LFI-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
141521128Bea Baselines 🐤template-rosaido-LFVI_multi-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
141361138Bea Baselines 🐤template-rosaido-hello-sim-validationsanity-checksuccessnodavinci-stage-03-6.2.500:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.05420754386700399
deviation-center-line_median0.006012606872749875


other stats
deviation-center-line_max0.006012606872749875
deviation-center-line_mean0.006012606872749875
deviation-center-line_min0.006012606872749875
deviation-heading_max0.25178942273654226
deviation-heading_mean0.25178942273654226
deviation-heading_median0.25178942273654226
deviation-heading_min0.25178942273654226
distance-from-start_max0.060142955237040815
distance-from-start_mean0.060142955237040815
distance-from-start_median0.060142955237040815
distance-from-start_min0.060142955237040815
driven_any_max0.06021433151290492
driven_any_mean0.06021433151290492
driven_any_median0.06021433151290492
driven_any_min0.06021433151290492
driven_lanedir_consec_max0.05420754386700399
driven_lanedir_consec_mean0.05420754386700399
driven_lanedir_consec_min0.05420754386700399
driven_lanedir_max0.05420754386700399
driven_lanedir_mean0.05420754386700399
driven_lanedir_median0.05420754386700399
driven_lanedir_min0.05420754386700399
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.06021433151290492, "survival_time": 0.49999999999999994, "driven_lanedir": 0.05420754386700399, "in-drivable-lane": 0.0, "deviation-heading": 0.25178942273654226, "distance-from-start": 0.060142955237040815, "deviation-center-line": 0.006012606872749875, "driven_lanedir_consec": 0.05420754386700399}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
141301143Bea Baselines 🐤template-rosaido-LFVI-sim-testingsim-0of4successnodavinci-stage-03-6.2.500:02:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.349999999999982
in-drivable-lane_median5.799999999999984
driven_lanedir_consec_median0.1691731799896976
deviation-center-line_median0.1130638388725546


other stats
deviation-center-line_max0.1130638388725546
deviation-center-line_mean0.1130638388725546
deviation-center-line_min0.1130638388725546
deviation-heading_max1.3974372883261117
deviation-heading_mean1.3974372883261117
deviation-heading_median1.3974372883261117
deviation-heading_min1.3974372883261117
distance-from-start_max1.7669634892507715
distance-from-start_mean1.7669634892507715
distance-from-start_median1.7669634892507715
distance-from-start_min1.7669634892507715
driven_any_max1.8557595398047009
driven_any_mean1.8557595398047009
driven_any_median1.8557595398047009
driven_any_min1.8557595398047009
driven_lanedir_consec_max0.1691731799896976
driven_lanedir_consec_mean0.1691731799896976
driven_lanedir_consec_min0.1691731799896976
driven_lanedir_max0.1691731799896976
driven_lanedir_mean0.1691731799896976
driven_lanedir_median0.1691731799896976
driven_lanedir_min0.1691731799896976
in-drivable-lane_max5.799999999999984
in-drivable-lane_mean5.799999999999984
in-drivable-lane_min5.799999999999984
per-episodes
details{"udem-000-ego0": {"driven_any": 1.8557595398047009, "survival_time": 7.349999999999982, "driven_lanedir": 0.1691731799896976, "in-drivable-lane": 5.799999999999984, "deviation-heading": 1.3974372883261117, "distance-from-start": 1.7669634892507715, "deviation-center-line": 0.1130638388725546, "driven_lanedir_consec": 0.1691731799896976}}
simulation-passed1
survival_time_max7.349999999999982
survival_time_mean7.349999999999982
survival_time_min7.349999999999982
No reset possible
141231144Bea Baselines 🐤template-rosaido-LFI-sim-testingsim-0of4successnodavinci-stage-03-6.2.500:02:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.449999999999981
in-drivable-lane_median5.399999999999985
driven_lanedir_consec_median0.1602668595495249
deviation-center-line_median0.16185628102469257


other stats
deviation-center-line_max0.16185628102469257
deviation-center-line_mean0.16185628102469257
deviation-center-line_min0.16185628102469257
deviation-heading_max2.082624909136271
deviation-heading_mean2.082624909136271
deviation-heading_median2.082624909136271
deviation-heading_min2.082624909136271
distance-from-start_max1.6845716322605715
distance-from-start_mean1.6845716322605715
distance-from-start_median1.6845716322605715
distance-from-start_min1.6845716322605715
driven_any_max1.8982182300120916
driven_any_mean1.8982182300120916
driven_any_median1.8982182300120916
driven_any_min1.8982182300120916
driven_lanedir_consec_max0.1602668595495249
driven_lanedir_consec_mean0.1602668595495249
driven_lanedir_consec_min0.1602668595495249
driven_lanedir_max0.22639282211698109
driven_lanedir_mean0.22639282211698109
driven_lanedir_median0.22639282211698109
driven_lanedir_min0.22639282211698109
in-drivable-lane_max5.399999999999985
in-drivable-lane_mean5.399999999999985
in-drivable-lane_min5.399999999999985
per-episodes
details{"4way-000-ego0": {"driven_any": 1.8982182300120916, "survival_time": 7.449999999999981, "driven_lanedir": 0.22639282211698109, "in-drivable-lane": 5.399999999999985, "deviation-heading": 2.082624909136271, "distance-from-start": 1.6845716322605715, "deviation-center-line": 0.16185628102469257, "driven_lanedir_consec": 0.1602668595495249}}
simulation-passed1
survival_time_max7.449999999999981
survival_time_mean7.449999999999981
survival_time_min7.449999999999981
No reset possible
141191146Bea Baselines 🐤template-rosaido-LFVI_multi-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
141161147Bea Baselines 🐤template-rosaido-LFV_multi-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:02:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.09999999999998
in-drivable-lane_median6.449999999999982
driven_lanedir_consec_median0.3883667447576484
deviation-center-line_median0.14657992604715508


other stats
deviation-center-line_max0.22540776590040917
deviation-center-line_mean0.14657992604715508
deviation-center-line_min0.067752086193901
deviation-heading_max1.0021382663503382
deviation-heading_mean0.8247363690930817
deviation-heading_median0.8247363690930817
deviation-heading_min0.6473344718358252
distance-from-start_max2.013668132685988
distance-from-start_mean1.7092530959124652
distance-from-start_median1.7092530959124652
distance-from-start_min1.4048380591389424
driven_any_max2.248663847488421
driven_any_mean1.8465438899525304
driven_any_median1.8465438899525304
driven_any_min1.4444239324166397
driven_lanedir_consec_max0.6258337370916731
driven_lanedir_consec_mean0.3883667447576484
driven_lanedir_consec_min0.15089975242362377
driven_lanedir_max0.6258337370916731
driven_lanedir_mean0.3883667447576484
driven_lanedir_median0.3883667447576484
driven_lanedir_min0.15089975242362377
in-drivable-lane_max7.09999999999998
in-drivable-lane_mean6.449999999999982
in-drivable-lane_min5.799999999999985
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.4444239324166397, "survival_time": 8.09999999999998, "driven_lanedir": 0.15089975242362377, "in-drivable-lane": 7.09999999999998, "deviation-heading": 0.6473344718358252, "distance-from-start": 1.4048380591389424, "deviation-center-line": 0.067752086193901, "driven_lanedir_consec": 0.15089975242362377}, "loop2-000-ego1": {"driven_any": 2.248663847488421, "survival_time": 8.09999999999998, "driven_lanedir": 0.6258337370916731, "in-drivable-lane": 5.799999999999985, "deviation-heading": 1.0021382663503382, "distance-from-start": 2.013668132685988, "deviation-center-line": 0.22540776590040917, "driven_lanedir_consec": 0.6258337370916731}}
simulation-passed1
survival_time_max8.09999999999998
survival_time_mean8.09999999999998
survival_time_min8.09999999999998
No reset possible
141111148Bea Baselines 🐤template-rosaido-LFP-sim-testingsim-0of4successnodavinci-stage-03-6.2.500:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.349999999999996
in-drivable-lane_median2.349999999999996
driven_lanedir_consec_median0.18255417038239008
deviation-center-line_median0.07147704699365877


other stats
deviation-center-line_max0.07147704699365877
deviation-center-line_mean0.07147704699365877
deviation-center-line_min0.07147704699365877
deviation-heading_max0.578016642023478
deviation-heading_mean0.578016642023478
deviation-heading_median0.578016642023478
deviation-heading_min0.578016642023478
distance-from-start_max0.6490786144264143
distance-from-start_mean0.6490786144264143
distance-from-start_median0.6490786144264143
distance-from-start_min0.6490786144264143
driven_any_max0.684679045122761
driven_any_mean0.684679045122761
driven_any_median0.684679045122761
driven_any_min0.684679045122761
driven_lanedir_consec_max0.18255417038239008
driven_lanedir_consec_mean0.18255417038239008
driven_lanedir_consec_min0.18255417038239008
driven_lanedir_max0.18255417038239008
driven_lanedir_mean0.18255417038239008
driven_lanedir_median0.18255417038239008
driven_lanedir_min0.18255417038239008
in-drivable-lane_max2.349999999999996
in-drivable-lane_mean2.349999999999996
in-drivable-lane_min2.349999999999996
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.684679045122761, "survival_time": 3.349999999999996, "driven_lanedir": 0.18255417038239008, "in-drivable-lane": 2.349999999999996, "deviation-heading": 0.578016642023478, "distance-from-start": 0.6490786144264143, "deviation-center-line": 0.07147704699365877, "driven_lanedir_consec": 0.18255417038239008}}
simulation-passed1
survival_time_max3.349999999999996
survival_time_mean3.349999999999996
survival_time_min3.349999999999996
No reset possible
140991151Bea Baselines 🐤template-tensorflowaido-LFI-sim-validationsim-0of4failednodavinci-stage-03-6.2.500:01:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140941151Bea Baselines 🐤template-tensorflowaido-LFI-sim-validationsim-1of4failednodavinci-stage-03-6.2.500:01:43
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140891152Bea Baselines 🐤template-tensorflowaido-LF-sim-validationsim-1of4failednodavinci-stage-03-6.2.500:01:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140851154Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-validationsim-2of4failednodavinci-stage-03-6.2.500:01:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140811155Bea Baselines 🐤template-tensorflowaido-LFP-sim-validationsim-1of4failednodavinci-stage-03-6.2.500:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140711167Bea Baselines 🐤template-tensorflowaido-LFV-sim-testingsim-1of4failednodavinci-stage-03-6.2.500:01:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140651168Bea Baselines 🐤template-tensorflowaido-LFVI-sim-testingsim-1of4failednodavinci-stage-03-6.2.500:01:42
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140611169Bea Baselines 🐤template-tensorflowaido-LFI-sim-testingsim-0of4failednodavinci-stage-03-6.2.500:01:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140561170Bea Baselines 🐤template-tensorflowaido-LF-sim-testingsim-2of4failednodavinci-stage-03-6.2.500:00:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140501172Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-testingsim-2of4failednodavinci-stage-03-6.2.500:01:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140451173Bea Baselines 🐤template-tensorflowaido-LFP-sim-testingsim-0of4failednodavinci-stage-03-6.2.500:01:29
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140381175Bea Baselines 🐤baseline-RPL-roslx22-modconsimfailedyesdavinci-stage-03-6.2.500:00:59
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140361177Bea Baselines 🐤baseline-RPL-roslx22-visservoingsimfailedyesdavinci-stage-03-6.2.500:00:57
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140321181Bea Baselines 🐤baseline-duckietown-mllx22-visservoingsimsuccessyesdavinci-stage-03-6.2.500:09:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median26.099999999999262
deviation-center-line_median4.522361146195093
driven_lanedir_consec_median4.356106602418757
survival_time_median59.99999999999873


other stats
deviation-center-line_max4.670911337065248
deviation-center-line_mean4.522361146195093
deviation-center-line_min4.373810955324938
deviation-heading_max4.856907291070999
deviation-heading_mean4.2340680557987005
deviation-heading_median4.2340680557987005
deviation-heading_min3.611228820526402
distance-from-start_max1.5002349089285698
distance-from-start_mean1.258472756243757
distance-from-start_median1.258472756243757
distance-from-start_min1.0167106035589442
driven_any_max7.920912384904493
driven_any_mean7.914398477717231
driven_any_median7.914398477717231
driven_any_min7.907884570529969
driven_lanedir_consec_max4.76472130095744
driven_lanedir_consec_mean4.356106602418757
driven_lanedir_consec_min3.947491903880075
driven_lanedir_max4.76472130095744
driven_lanedir_mean4.356106602418757
driven_lanedir_median4.356106602418757
driven_lanedir_min3.947491903880075
in-drivable-lane_max29.29999999999924
in-drivable-lane_mean26.099999999999262
in-drivable-lane_min22.89999999999929
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 7.920912384904493, "survival_time": 59.99999999999873, "driven_lanedir": 3.947491903880075, "in-drivable-lane": 29.29999999999924, "deviation-heading": 3.611228820526402, "distance-from-start": 1.0167106035589442, "deviation-center-line": 4.373810955324938, "driven_lanedir_consec": 3.947491903880075}, "LF-small-loop-001-ego0": {"driven_any": 7.907884570529969, "survival_time": 59.99999999999873, "driven_lanedir": 4.76472130095744, "in-drivable-lane": 22.89999999999929, "deviation-heading": 4.856907291070999, "distance-from-start": 1.5002349089285698, "deviation-center-line": 4.670911337065248, "driven_lanedir_consec": 4.76472130095744}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
140251188Bea Baselines 🐤minimal-agentlx22-objdetsimsuccessyesdavinci-stage-03-6.2.500:12:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
driven_lanedir_consec_median3.766385412387078


other stats
deviation-center-line_max1.326684653251739
deviation-center-line_mean1.1145360814864316
deviation-center-line_median1.1145360814864316
deviation-center-line_min0.9023875097211244
deviation-heading_max0.9653478875423056
deviation-heading_mean0.8614808538844678
deviation-heading_median0.8614808538844678
deviation-heading_min0.75761382022663
distance-from-start_max9.8511235402485
distance-from-start_mean9.83680867234296
distance-from-start_median9.83680867234296
distance-from-start_min9.822493804437425
driven_any_max9.857519753799252
driven_any_mean9.843192862723654
driven_any_median9.843192862723654
driven_any_min9.828865971648057
driven_lanedir_consec_max5.116504350759583
driven_lanedir_consec_mean3.766385412387078
driven_lanedir_consec_min2.416266474014573
driven_lanedir_max5.116504350759583
driven_lanedir_mean3.766385412387078
driven_lanedir_median3.766385412387078
driven_lanedir_min2.416266474014573
in-drivable-lane_max44.99999999999865
in-drivable-lane_mean36.82499999999853
in-drivable-lane_median36.82499999999853
in-drivable-lane_min28.649999999998418
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 9.857519753799252, "survival_time": 59.99999999999873, "driven_lanedir": 5.116504350759583, "in-drivable-lane": 28.649999999998418, "deviation-heading": 0.9653478875423056, "distance-from-start": 9.8511235402485, "deviation-center-line": 1.326684653251739, "driven_lanedir_consec": 5.116504350759583}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 9.828865971648057, "survival_time": 59.99999999999873, "driven_lanedir": 2.416266474014573, "in-drivable-lane": 44.99999999999865, "deviation-heading": 0.75761382022663, "distance-from-start": 9.822493804437425, "deviation-center-line": 0.9023875097211244, "driven_lanedir_consec": 2.416266474014573}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
140241189Bea Baselines 🐤minimal-agentlx22-visservoingsimsuccessyesdavinci-stage-03-6.2.500:02:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median2.6499999999999924
deviation-center-line_median0.17493349275674216
driven_lanedir_consec_median0.8221776345283069
survival_time_median8.14999999999998


other stats
deviation-center-line_max0.17647811751212122
deviation-center-line_mean0.17493349275674216
deviation-center-line_min0.1733888680013631
deviation-heading_max0.7383278077616701
deviation-heading_mean0.7099934263375745
deviation-heading_median0.7099934263375745
deviation-heading_min0.681659044913479
distance-from-start_max1.175276406473093
distance-from-start_mean1.175237634650054
distance-from-start_median1.175237634650054
distance-from-start_min1.1751988628270151
driven_any_max1.1755804280577309
driven_any_mean1.175457669946736
driven_any_median1.175457669946736
driven_any_min1.175334911835741
driven_lanedir_consec_max0.8828170026503562
driven_lanedir_consec_mean0.8221776345283069
driven_lanedir_consec_min0.7615382664062577
driven_lanedir_max0.8828170026503562
driven_lanedir_mean0.8221776345283069
driven_lanedir_median0.8221776345283069
driven_lanedir_min0.7615382664062577
in-drivable-lane_max2.999999999999991
in-drivable-lane_mean2.6499999999999924
in-drivable-lane_min2.2999999999999936
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 1.1755804280577309, "survival_time": 8.14999999999998, "driven_lanedir": 0.7615382664062577, "in-drivable-lane": 2.999999999999991, "deviation-heading": 0.681659044913479, "distance-from-start": 1.1751988628270151, "deviation-center-line": 0.1733888680013631, "driven_lanedir_consec": 0.7615382664062577}, "LF-small-loop-001-ego0": {"driven_any": 1.175334911835741, "survival_time": 8.14999999999998, "driven_lanedir": 0.8828170026503562, "in-drivable-lane": 2.2999999999999936, "deviation-heading": 0.7383278077616701, "distance-from-start": 1.175276406473093, "deviation-center-line": 0.17647811751212122, "driven_lanedir_consec": 0.8828170026503562}}
simulation-passed1
survival_time_max8.14999999999998
survival_time_mean8.14999999999998
survival_time_min8.14999999999998
No reset possible
140171198Bea Baselines 🐤template-randomlx22-state-estimationsimsuccessyesdavinci-stage-03-6.2.500:12:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.07536801496639489
survival_time_median59.99999999999873
deviation-center-line_median0.6735665136853142
in-drivable-lane_median49.44999999999911


other stats
deviation-center-line_max0.8579388817399466
deviation-center-line_mean0.6660984451379334
deviation-center-line_min0.4667899399885391
deviation-heading_max5.582370303572385
deviation-heading_mean4.330594699634891
deviation-heading_median3.851668979994983
deviation-heading_min3.5577448153373066
distance-from-start_max1.4108418329399044
distance-from-start_mean1.2749217352766675
distance-from-start_median1.4108418329398824
distance-from-start_min1.0030815399502164
driven_any_max15.32631084737068
driven_any_mean13.156722223767504
driven_any_median15.326310847370546
driven_any_min8.81754497656128
driven_lanedir_consec_max0.15436172858886033
driven_lanedir_consec_mean0.06086423316366729
driven_lanedir_consec_min-0.04713704406425334
driven_lanedir_max0.13361915084339548
driven_lanedir_mean0.04596436275685415
driven_lanedir_median0.06382708081740152
driven_lanedir_min-0.05955314339023454
in-drivable-lane_max53.2499999999987
in-drivable-lane_mean44.49999999999929
in-drivable-lane_min30.80000000000006
per-episodes
details{"LF-zig-zag-000-ego0": {"driven_any": 15.326310847370546, "survival_time": 59.99999999999873, "driven_lanedir": 0.13361915084339548, "in-drivable-lane": 53.2499999999987, "deviation-heading": 3.851668979994983, "distance-from-start": 1.4108418329398824, "deviation-center-line": 0.6735665136853142, "driven_lanedir_consec": 0.15436172858886033}, "LF-zig-zag-001-ego0": {"driven_any": 8.81754497656128, "survival_time": 35.9000000000001, "driven_lanedir": 0.06382708081740152, "in-drivable-lane": 30.80000000000006, "deviation-heading": 3.5577448153373066, "distance-from-start": 1.0030815399502164, "deviation-center-line": 0.4667899399885391, "driven_lanedir_consec": 0.07536801496639489}, "LF-zig-zag-002-ego0": {"driven_any": 15.32631084737068, "survival_time": 59.99999999999873, "driven_lanedir": -0.05955314339023454, "in-drivable-lane": 49.44999999999911, "deviation-heading": 5.582370303572385, "distance-from-start": 1.4108418329399044, "deviation-center-line": 0.8579388817399466, "driven_lanedir_consec": -0.04713704406425334}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean51.96666666666585
survival_time_min35.9000000000001
No reset possible
14014526Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-testingsim-3of4failednodavinci-stage-03-6.2.500:01:00
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
139951203Bea Baselines 🐤template-tensorflowlx22-modconsimtimeoutyesdavinci-stage-03-6.2.50----No reset possible
139931205Bea Baselines 🐤template-tensorflowlx22-visservoingsimhost-erroryesdavinci-stage-03-6.2.500:01:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1097, in run_single
    client = DockerClient.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13976672Bea Baselines 🐤template-tensorflowaido-LF-sim-testingsim-3of4host-errornodavinci-stage-03-6.2.501:12:05
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-stage-03-6.2.50-job13976-906025, up, --no-start,
│          --renew-anon-volumes]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-stage-03-6.2.50-job13976-906025', 'up', '--no-start', '--renew-anon-volumes']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13975783Andrea Danieletemplate-randomaido-LF-sim-validationsim-2of4host-errornodavinci-stage-03-6.2.500:01:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1097, in run_single
    client = DockerClient.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13974783Andrea Danieletemplate-randomaido-LF-sim-validationsim-0of4host-errornodavinci-stage-03-6.2.500:01:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1097, in run_single
    client = DockerClient.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13973785Andrea Danieletemplate-rosaido-LF-sim-validationsim-2of4host-errornodavinci-stage-03-6.2.500:01:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1097, in run_single
    client = DockerClient.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13963715Bea Baselines 🐤template-randomaido-LF-sim-testingsim-1of4host-errornodavinci-stage-03-6.2.501:05:34
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 60, in check_docker_environment
    client = docker.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1107, in run_single
    cr = run_one(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1197, in run_one
    client = check_docker_environment()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 69, in check_docker_environment
    raise InvalidEnvironment(msg)
duckietown_challenges.exceptions.InvalidEnvironment: I cannot communicate with Docker:
Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Make sure the docker service is running.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13962785Andrea Danieletemplate-rosaido-LF-sim-validationsim-0of4host-errornodavinci-stage-03-6.2.500:01:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1097, in run_single
    client = DockerClient.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13955789Andrea Danieletemplate-pytorchaido-LF-sim-validationsim-2of4host-errornodavinci-stage-03-6.2.501:14:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 60, in check_docker_environment
    client = docker.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1107, in run_single
    cr = run_one(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1197, in run_one
    client = check_docker_environment()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 69, in check_docker_environment
    raise InvalidEnvironment(msg)
duckietown_challenges.exceptions.InvalidEnvironment: I cannot communicate with Docker:
Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Make sure the docker service is running.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13954789Andrea Danieletemplate-pytorchaido-LF-sim-validationsim-0of4host-errornodavinci-stage-03-6.2.501:09:36
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-stage-03-6.2.50-job13954-458049, down, -v]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-stage-03-6.2.50-job13954-458049', 'down', '-v']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13950697Bea Baselines 🐤minimal-agentaido-LFP-sim-testingsim-2of4host-errornodavinci-stage-03-6.2.501:02:05
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 60, in check_docker_environment
    client = docker.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1107, in run_single
    cr = run_one(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1197, in run_one
    client = check_docker_environment()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 69, in check_docker_environment
    raise InvalidEnvironment(msg)
duckietown_challenges.exceptions.InvalidEnvironment: I cannot communicate with Docker:
Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Make sure the docker service is running.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13946697Bea Baselines 🐤minimal-agentaido-LFP-sim-testingsim-1of4host-errornodavinci-stage-03-6.2.500:01:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1097, in run_single
    client = DockerClient.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13942698Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-1of4host-errornodavinci-stage-03-6.2.500:01:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1097, in run_single
    client = DockerClient.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13938699Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:02:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13932701Bea Baselines 🐤minimal-agentaido-LF-sim-testingsim-0of4successnodavinci-stage-03-6.2.500:02:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.13666265914899656
survival_time_median16.300000000000097
deviation-center-line_median0.10783824785325348
in-drivable-lane_median14.900000000000096


other stats
deviation-center-line_max0.10783824785325348
deviation-center-line_mean0.10783824785325348
deviation-center-line_min0.10783824785325348
deviation-heading_max0.9508048428349388
deviation-heading_mean0.9508048428349388
deviation-heading_median0.9508048428349388
deviation-heading_min0.9508048428349388
distance-from-start_max2.521293261515461
distance-from-start_mean2.521293261515461
distance-from-start_median2.521293261515461
distance-from-start_min2.521293261515461
driven_any_max2.521966526425084
driven_any_mean2.521966526425084
driven_any_median2.521966526425084
driven_any_min2.521966526425084
driven_lanedir_consec_max0.13666265914899656
driven_lanedir_consec_mean0.13666265914899656
driven_lanedir_consec_min0.13666265914899656
driven_lanedir_max0.13666265914899656
driven_lanedir_mean0.13666265914899656
driven_lanedir_median0.13666265914899656
driven_lanedir_min0.13666265914899656
in-drivable-lane_max14.900000000000096
in-drivable-lane_mean14.900000000000096
in-drivable-lane_min14.900000000000096
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.521966526425084, "survival_time": 16.300000000000097, "driven_lanedir": 0.13666265914899656, "in-drivable-lane": 14.900000000000096, "deviation-heading": 0.9508048428349388, "distance-from-start": 2.521293261515461, "deviation-center-line": 0.10783824785325348, "driven_lanedir_consec": 0.13666265914899656}}
simulation-passed1
survival_time_max16.300000000000097
survival_time_mean16.300000000000097
survival_time_min16.300000000000097
No reset possible
13927702Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-testingsim-1of4successnodavinci-stage-03-6.2.500:03:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.79999999999998
in-drivable-lane_median6.174999999999979
driven_lanedir_consec_median0.18712389148079245
deviation-center-line_median0.15973064632096934


other stats
deviation-center-line_max0.25956483782942774
deviation-center-line_mean0.17171613953350223
deviation-center-line_min0.1078384276626425
deviation-heading_max0.9508048428349388
deviation-heading_mean0.7378303653221978
deviation-heading_median0.7134396501489888
deviation-heading_min0.5736373181558746
distance-from-start_max1.1174703819521252
distance-from-start_mean0.5801993351597357
distance-from-start_median0.4397243952004576
distance-from-start_min0.323878168285902
driven_any_max1.1175260347648366
driven_any_mean0.5802187299655663
driven_any_median0.4397328577718137
driven_any_min0.3238831695538013
driven_lanedir_consec_max0.6843001798814146
driven_lanedir_consec_mean0.2932298736878741
driven_lanedir_consec_min0.11437153190849704
driven_lanedir_max0.6843001798814146
driven_lanedir_mean0.2932298736878741
driven_lanedir_median0.18712389148079245
driven_lanedir_min0.11437153190849704
in-drivable-lane_max6.59999999999998
in-drivable-lane_mean5.549999999999982
in-drivable-lane_min3.2499999999999885
per-episodes
details{"4way-000-ego0": {"driven_any": 0.5146585239873271, "survival_time": 7.79999999999998, "driven_lanedir": 0.13666599700910398, "in-drivable-lane": 6.39999999999998, "deviation-heading": 0.9508048428349388, "distance-from-start": 0.5146479428595184, "deviation-center-line": 0.1078384276626425, "driven_lanedir_consec": 0.13666599700910398}, "4way-000-ego1": {"driven_any": 0.3648071915563002, "survival_time": 7.79999999999998, "driven_lanedir": 0.23758178595248092, "in-drivable-lane": 5.94999999999998, "deviation-heading": 0.5736373181558746, "distance-from-start": 0.36480084754139674, "deviation-center-line": 0.20320962418622623, "driven_lanedir_consec": 0.23758178595248092}, "4way-000-ego2": {"driven_any": 1.1175260347648366, "survival_time": 7.79999999999998, "driven_lanedir": 0.6843001798814146, "in-drivable-lane": 3.2499999999999885, "deviation-heading": 0.6676943794629474, "distance-from-start": 1.1174703819521252, "deviation-center-line": 0.25956483782942774, "driven_lanedir_consec": 0.6843001798814146}, "4way-000-ego3": {"driven_any": 0.3238831695538013, "survival_time": 7.79999999999998, "driven_lanedir": 0.11437153190849704, "in-drivable-lane": 6.59999999999998, "deviation-heading": 0.7591849208350303, "distance-from-start": 0.323878168285902, "deviation-center-line": 0.11625166845571244, "driven_lanedir_consec": 0.11437153190849704}}
simulation-passed1
survival_time_max7.79999999999998
survival_time_mean7.79999999999998
survival_time_min7.79999999999998
No reset possible
13926702Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13925701Bea Baselines 🐤minimal-agentaido-LF-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:01:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3224736988087771
survival_time_median15.250000000000082
deviation-center-line_median0.2741150615740815
in-drivable-lane_median12.100000000000056


other stats
deviation-center-line_max0.2741150615740815
deviation-center-line_mean0.2741150615740815
deviation-center-line_min0.2741150615740815
deviation-heading_max2.486301423131022
deviation-heading_mean2.486301423131022
deviation-heading_median2.486301423131022
deviation-heading_min2.486301423131022
distance-from-start_max2.346684322024178
distance-from-start_mean2.346684322024178
distance-from-start_median2.346684322024178
distance-from-start_min2.346684322024178
driven_any_max2.3472858269950745
driven_any_mean2.3472858269950745
driven_any_median2.3472858269950745
driven_any_min2.3472858269950745
driven_lanedir_consec_max0.3224736988087771
driven_lanedir_consec_mean0.3224736988087771
driven_lanedir_consec_min0.3224736988087771
driven_lanedir_max0.3224736988087771
driven_lanedir_mean0.3224736988087771
driven_lanedir_median0.3224736988087771
driven_lanedir_min0.3224736988087771
in-drivable-lane_max12.100000000000056
in-drivable-lane_mean12.100000000000056
in-drivable-lane_min12.100000000000056
per-episodes
details{"zigzag-000-ego0": {"driven_any": 2.3472858269950745, "survival_time": 15.250000000000082, "driven_lanedir": 0.3224736988087771, "in-drivable-lane": 12.100000000000056, "deviation-heading": 2.486301423131022, "distance-from-start": 2.346684322024178, "deviation-center-line": 0.2741150615740815, "driven_lanedir_consec": 0.3224736988087771}}
simulation-passed1
survival_time_max15.250000000000082
survival_time_mean15.250000000000082
survival_time_min15.250000000000082
No reset possible
13909715Bea Baselines 🐤template-randomaido-LF-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:07:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.012435476414101476
survival_time_median59.99999999999873
deviation-center-line_median0.5849703750508038
in-drivable-lane_median53.74999999999868


other stats
deviation-center-line_max0.5849703750508038
deviation-center-line_mean0.5849703750508038
deviation-center-line_min0.5849703750508038
deviation-heading_max4.775258785640045
deviation-heading_mean4.775258785640045
deviation-heading_median4.775258785640045
deviation-heading_min4.775258785640045
distance-from-start_max1.4108418329398955
distance-from-start_mean1.4108418329398955
distance-from-start_median1.4108418329398955
distance-from-start_min1.4108418329398955
driven_any_max15.326310847370571
driven_any_mean15.326310847370571
driven_any_median15.326310847370571
driven_any_min15.326310847370571
driven_lanedir_consec_max0.012435476414101476
driven_lanedir_consec_mean0.012435476414101476
driven_lanedir_consec_min0.012435476414101476
driven_lanedir_max0.01578217614057431
driven_lanedir_mean0.01578217614057431
driven_lanedir_median0.01578217614057431
driven_lanedir_min0.01578217614057431
in-drivable-lane_max53.74999999999868
in-drivable-lane_mean53.74999999999868
in-drivable-lane_min53.74999999999868
per-episodes
details{"zigzag-000-ego0": {"driven_any": 15.326310847370571, "survival_time": 59.99999999999873, "driven_lanedir": 0.01578217614057431, "in-drivable-lane": 53.74999999999868, "deviation-heading": 4.775258785640045, "distance-from-start": 1.4108418329398955, "deviation-center-line": 0.5849703750508038, "driven_lanedir_consec": 0.012435476414101476}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
13905783Andrea Danieletemplate-randomaido-LF-sim-validationsim-0of4successnodavinci-stage-03-6.2.500:03:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2718401947993705
survival_time_median27.70000000000026
deviation-center-line_median0.7655517188189105
in-drivable-lane_median19.150000000000237


other stats
deviation-center-line_max0.7655517188189105
deviation-center-line_mean0.7655517188189105
deviation-center-line_min0.7655517188189105
deviation-heading_max5.708723015945327
deviation-heading_mean5.708723015945327
deviation-heading_median5.708723015945327
deviation-heading_min5.708723015945327
distance-from-start_max0.7960980578537302
distance-from-start_mean0.7960980578537302
distance-from-start_median0.7960980578537302
distance-from-start_min0.7960980578537302
driven_any_max6.635455547557208
driven_any_mean6.635455547557208
driven_any_median6.635455547557208
driven_any_min6.635455547557208
driven_lanedir_consec_max0.2718401947993705
driven_lanedir_consec_mean0.2718401947993705
driven_lanedir_consec_min0.2718401947993705
driven_lanedir_max0.25382904192484634
driven_lanedir_mean0.25382904192484634
driven_lanedir_median0.25382904192484634
driven_lanedir_min0.25382904192484634
in-drivable-lane_max19.150000000000237
in-drivable-lane_mean19.150000000000237
in-drivable-lane_min19.150000000000237
per-episodes
details{"autolab-000-ego0": {"driven_any": 6.635455547557208, "survival_time": 27.70000000000026, "driven_lanedir": 0.25382904192484634, "in-drivable-lane": 19.150000000000237, "deviation-heading": 5.708723015945327, "distance-from-start": 0.7960980578537302, "deviation-center-line": 0.7655517188189105, "driven_lanedir_consec": 0.2718401947993705}}
simulation-passed1
survival_time_max27.70000000000026
survival_time_mean27.70000000000026
survival_time_min27.70000000000026
No reset possible
13903785Andrea Danieletemplate-rosaido-LF-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:02:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5300866138741542
survival_time_median7.89999999999998
deviation-center-line_median0.18182156716232167
in-drivable-lane_median5.649999999999984


other stats
deviation-center-line_max0.18182156716232167
deviation-center-line_mean0.18182156716232167
deviation-center-line_min0.18182156716232167
deviation-heading_max1.3116424447332415
deviation-heading_mean1.3116424447332415
deviation-heading_median1.3116424447332415
deviation-heading_min1.3116424447332415
distance-from-start_max2.0729839809974253
distance-from-start_mean2.0729839809974253
distance-from-start_median2.0729839809974253
distance-from-start_min2.0729839809974253
driven_any_max2.1749996371855387
driven_any_mean2.1749996371855387
driven_any_median2.1749996371855387
driven_any_min2.1749996371855387
driven_lanedir_consec_max0.5300866138741542
driven_lanedir_consec_mean0.5300866138741542
driven_lanedir_consec_min0.5300866138741542
driven_lanedir_max0.5300866138741542
driven_lanedir_mean0.5300866138741542
driven_lanedir_median0.5300866138741542
driven_lanedir_min0.5300866138741542
in-drivable-lane_max5.649999999999984
in-drivable-lane_mean5.649999999999984
in-drivable-lane_min5.649999999999984
per-episodes
details{"zigzag-000-ego0": {"driven_any": 2.1749996371855387, "survival_time": 7.89999999999998, "driven_lanedir": 0.5300866138741542, "in-drivable-lane": 5.649999999999984, "deviation-heading": 1.3116424447332415, "distance-from-start": 2.0729839809974253, "deviation-center-line": 0.18182156716232167, "driven_lanedir_consec": 0.5300866138741542}}
simulation-passed1
survival_time_max7.89999999999998
survival_time_mean7.89999999999998
survival_time_min7.89999999999998
No reset possible
13901789Andrea Danieletemplate-pytorchaido-LF-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:02:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.07775336726809967
survival_time_median12.800000000000049
deviation-center-line_median0.06329883653024897
in-drivable-lane_median11.750000000000046


other stats
deviation-center-line_max0.06329883653024897
deviation-center-line_mean0.06329883653024897
deviation-center-line_min0.06329883653024897
deviation-heading_max0.9133295048635888
deviation-heading_mean0.9133295048635888
deviation-heading_median0.9133295048635888
deviation-heading_min0.9133295048635888
distance-from-start_max0.6259213919387699
distance-from-start_mean0.6259213919387699
distance-from-start_median0.6259213919387699
distance-from-start_min0.6259213919387699
driven_any_max2.2298400699772225
driven_any_mean2.2298400699772225
driven_any_median2.2298400699772225
driven_any_min2.2298400699772225
driven_lanedir_consec_max0.07775336726809967
driven_lanedir_consec_mean0.07775336726809967
driven_lanedir_consec_min0.07775336726809967
driven_lanedir_max0.07775336726809967
driven_lanedir_mean0.07775336726809967
driven_lanedir_median0.07775336726809967
driven_lanedir_min0.07775336726809967
in-drivable-lane_max11.750000000000046
in-drivable-lane_mean11.750000000000046
in-drivable-lane_min11.750000000000046
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.2298400699772225, "survival_time": 12.800000000000049, "driven_lanedir": 0.07775336726809967, "in-drivable-lane": 11.750000000000046, "deviation-heading": 0.9133295048635888, "distance-from-start": 0.6259213919387699, "deviation-center-line": 0.06329883653024897, "driven_lanedir_consec": 0.07775336726809967}}
simulation-passed1
survival_time_max12.800000000000049
survival_time_mean12.800000000000049
survival_time_min12.800000000000049
No reset possible
13892310Andrea Censiminimal-agentaido-LFV-sim-validationsim-0of4errornodavinci-stage-03-6.2.500:01:46
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13888311Andrea Censiminimal-agentaido-LFV-sim-validationsim-1of4errornodavinci-stage-03-6.2.500:01:36
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13883312Liam Paulltemplate-rosaido-LF-sim-validationsim-1of4errornodavinci-stage-03-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13877341Liam Paulltemplate-rosaido-LF-sim-validationsim-3of4failednodavinci-stage-03-6.2.500:02:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 243, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13872385Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-validationsim-0of4errornodavinci-stage-03-6.2.500:01:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13868386Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-validationsim-0of4errornodavinci-stage-03-6.2.500:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13865386Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-validationsim-3of4errornodavinci-stage-03-6.2.500:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13860387Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-validationsim-3of4errornodavinci-stage-03-6.2.500:01:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13855388Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-validationsim-1of4errornodavinci-stage-03-6.2.500:01:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13849389Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-validationsim-1of4host-errornodavinci-stage-03-6.2.500:01:33
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13845390Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-validationsim-0of4errornodavinci-stage-03-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13840392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-3of4errornodavinci-stage-03-6.2.500:01:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13836393Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-testingsim-1of4errornodavinci-stage-03-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13829396Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:02:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13822396Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-testingsim-1of4errornodavinci-stage-03-6.2.500:01:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13817398Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-testingsim-1of4errornodavinci-stage-03-6.2.500:01:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13813515Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-validationsim-1of4failednodavinci-stage-03-6.2.500:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13806516Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-validationsim-1of4failednodavinci-stage-03-6.2.500:01:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13802517Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-validationsim-1of4failednodavinci-stage-03-6.2.500:01:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13796518Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-validationsim-0of4failednodavinci-stage-03-6.2.500:01:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13791520Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-validationsim-0of4failednodavinci-stage-03-6.2.500:01:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13787521Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-testingsim-1of4failednodavinci-stage-03-6.2.500:01:11
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13778523Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-testingsim-2of4failednodavinci-stage-03-6.2.500:01:40
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13773524Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-testingsim-1of4failednodavinci-stage-03-6.2.500:01:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13768525Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-testingsim-1of4failednodavinci-stage-03-6.2.500:01:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13763528Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-validationsim-2of4errornodavinci-stage-03-6.2.500:01:30
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13758530Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-validationsim-2of4errornodavinci-stage-03-6.2.500:01:36
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13752531Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13747532Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13742533Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-validationsim-3of4errornodavinci-stage-03-6.2.500:00:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13738534Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-validationsim-0of4errornodavinci-stage-03-6.2.500:01:12
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13729537Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-testingsim-1of4errornodavinci-stage-03-6.2.500:01:35
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13725537Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-testingsim-3of4errornodavinci-stage-03-6.2.500:01:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13719538Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13715541Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-testingsim-3of4errornodavinci-stage-03-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13710542Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13705595Liam Paullbaseline-duckietownaido-LF-sim-validationsim-2of4failednodavinci-stage-03-6.2.500:00:56
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13700600Liam Paulltemplate-tensorflowaido-LF-sim-validationsim-1of4failednodavinci-stage-03-6.2.500:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13695603Bea Baselines 🐤template-rosaido-LFV_multi-sim-validationsim-3of4errornodavinci-stage-03-6.2.500:01:16
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13691604Bea Baselines 🐤template-rosaido-LFP-sim-validationsim-0of4errornodavinci-stage-03-6.2.500:01:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13686605Bea Baselines 🐤template-rosaido-LFV-sim-validationsim-0of4errornodavinci-stage-03-6.2.500:01:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13681606Bea Baselines 🐤template-rosaido-LFVI-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13676609Bea Baselines 🐤template-rosaido-LFVI_multi-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13669610Bea Baselines 🐤template-rosaido-LFV_multi-sim-testingsim-2of4errornodavinci-stage-03-6.2.500:01:30
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13662612Bea Baselines 🐤template-rosaido-LFV-sim-testingsim-2of4errornodavinci-stage-03-6.2.500:01:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13658614Bea Baselines 🐤template-rosaido-LFI-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13653615Bea Baselines 🐤template-rosaido-LF-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13649616Bea Baselines 🐤template-rosaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13644617Bea Baselines 🐤challenge-aido_LF-template-ros:daffy-staging:e107400fd98b91bb7c02b7b24d7be5f5d7623035aido-hello-sim-validationsanity-checkerrornodavinci-stage-03-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13641619Bea Baselines 🐤baseline-duckietownaido-LFP-sim-validationsim-2of4errornodavinci-stage-03-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13635620Bea Baselines 🐤baseline-duckietownaido-LFV-sim-validationsim-3of4errornodavinci-stage-03-6.2.500:01:30
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13630621Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-validationsim-1of4errornodavinci-stage-03-6.2.500:01:40
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13624622Bea Baselines 🐤baseline-duckietownaido-LFI-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13619625Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:01:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13615626Bea Baselines 🐤baseline-duckietownaido-LFP-sim-testingsim-3of4errornodavinci-stage-03-6.2.500:01:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13611626Bea Baselines 🐤baseline-duckietownaido-LFP-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:01:03
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13606628Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:01:40
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13602629Bea Baselines 🐤baseline-duckietownaido-LFI-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:01:32
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13598630Bea Baselines 🐤baseline-duckietownaido-LF-sim-testingsim-3of4errornodavinci-stage-03-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13593631Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13590660Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-validationsim-0of4failednodavinci-stage-03-6.2.500:01:12
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13585661Bea Baselines 🐤template-tensorflowaido-LFP-sim-validationsim-0of4failednodavinci-stage-03-6.2.500:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13580664Bea Baselines 🐤template-tensorflowaido-LFI-sim-validationsim-1of4host-errornodavinci-stage-03-6.2.500:01:35
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13578665Bea Baselines 🐤template-tensorflowaido-LF-sim-validationsim-1of4failednodavinci-stage-03-6.2.500:00:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13569666Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13564667Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-testingsim-0of4failednodavinci-stage-03-6.2.500:01:17
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13559669Bea Baselines 🐤template-tensorflowaido-LFV-sim-testingsim-1of4failednodavinci-stage-03-6.2.500:01:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13554669Bea Baselines 🐤template-tensorflowaido-LFV-sim-testingsim-3of4failednodavinci-stage-03-6.2.500:01:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13550670Bea Baselines 🐤template-tensorflowaido-LFVI-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13546673Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13541703Bea Baselines 🐤template-randomaido-LFV_multi-sim-validationsim-1of4errornodavinci-stage-03-6.2.500:01:12
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13533706Bea Baselines 🐤template-randomaido-LFVI-sim-validationsim-0of4errornodavinci-stage-03-6.2.500:01:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13529707Bea Baselines 🐤template-randomaido-LFI-sim-validationsim-1of4errornodavinci-stage-03-6.2.500:01:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13523709Bea Baselines 🐤template-randomaido-LFVI_multi-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13517709Bea Baselines 🐤template-randomaido-LFVI_multi-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:01:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13512711Bea Baselines 🐤template-randomaido-LFP-sim-testingsim-3of4errornodavinci-stage-03-6.2.500:00:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13507712Bea Baselines 🐤template-randomaido-LFV-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:01:23
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13502714Bea Baselines 🐤template-randomaido-LFI-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13497716Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:01:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13493716Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-1of4errornodavinci-stage-03-6.2.500:01:16
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13488733Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-validationsim-1of4errornodavinci-stage-03-6.2.500:01:02
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13484735Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-validationsim-1of4errornodavinci-stage-03-6.2.500:01:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13478736Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-validationsim-1of4host-errornodavinci-stage-03-6.2.500:01:34
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13473738Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-validationsim-0of4errornodavinci-stage-03-6.2.500:01:22
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13469739Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-testingsim-3of4errornodavinci-stage-03-6.2.500:01:18
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13464740Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-testingsim-2of4errornodavinci-stage-03-6.2.500:01:03
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13457741Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-testingsim-1of4errornodavinci-stage-03-6.2.500:01:40
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13454743Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-testingsim-1of4errornodavinci-stage-03-6.2.500:01:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13451745Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-testingsim-1of4errornodavinci-stage-03-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13443746Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-testingsim-1of4errornodavinci-stage-03-6.2.500:01:23
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13439765Bea Baselines 🐤challenge-aido_LF-template-pytorch:daffy-staging:bc692490acbff19e3dcb581b0cdc6ef53963f802aido-hello-sim-validationsanity-checkerrornodavinci-stage-03-6.2.500:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13435769Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-validationsim-2of4errornodavinci-stage-03-6.2.500:01:34
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13430770Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-validationsim-0of4errornodavinci-stage-03-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13423771Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-validationsim-3of4errornodavinci-stage-03-6.2.500:01:32
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13419773Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13414775Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-validationsim-1of4errornodavinci-stage-03-6.2.500:01:19
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13409776Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:01:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13404777Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:01:02
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13401778Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:01:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13396780Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:01:30
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13389781Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-testingsim-3of4errornodavinci-stage-03-6.2.500:01:02
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13384782Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-testingsim-1of4errornodavinci-stage-03-6.2.500:01:21
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13379797Bea Baselines 🐤challenge-aido_LF-template-ros:daffy-staging:9c5ebcaaac3c2c24fe955f2dfc9f86ef7741bb3daido-hello-sim-validationsanity-checkerrornodavinci-stage-03-6.2.500:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13374801Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-3of4failednodavinci-stage-03-6.2.500:00:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13366806user1000001minimal-agentaido-LFV-sim-validationsim-0of4errornodavinci-stage-03-6.2.500:01:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13365808Andrea Censitemplate-randomaido-LFV-sim-validationsim-3of4errornodavinci-stage-03-6.2.500:01:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13356809Andrea Censitemplate-randomaido-LFV-sim-validationsim-1of4errornodavinci-stage-03-6.2.500:01:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13351810Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-validationsim-3of4failednodavinci-stage-03-6.2.500:01:44
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13347812Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-2of4errornodavinci-stage-03-6.2.500:01:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13341813Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-validationsim-0of4errornodavinci-stage-03-6.2.500:01:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13335814Bea Baselines 🐤baseline-duckietownaido-LF-sim-validationsim-2of4errornodavinci-stage-03-6.2.500:01:18
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13330816Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-validationsim-1of4errornodavinci-stage-03-6.2.500:01:35
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13325817Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-validationsim-3of4errornodavinci-stage-03-6.2.500:01:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13319818Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-validationsim-2of4errornodavinci-stage-03-6.2.500:01:45
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13316820Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-validationsim-3of4errornodavinci-stage-03-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13310821Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-testingsim-3of4errornodavinci-stage-03-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13305822Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13299824Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-testingsim-1of4errornodavinci-stage-03-6.2.500:01:45
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13294825Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-testingsim-2of4errornodavinci-stage-03-6.2.500:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13289826Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-validationsim-0of4errornodavinci-stage-03-6.2.500:01:36
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13284827Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:01:33
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13280828Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-testingsim-3of4errornodavinci-stage-03-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13274830Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-validationsim-2of4errornodavinci-stage-03-6.2.500:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13271830Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-validationsim-0of4errornodavinci-stage-03-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13266832Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13261833Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-validationsim-3of4errornodavinci-stage-03-6.2.500:01:23
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13255834Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13249836Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:01:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13245837Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:01:02
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13237838Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-testingsim-3of4errornodavinci-stage-03-6.2.500:01:34
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13231839Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-testingsim-1of4errornodavinci-stage-03-6.2.500:01:40
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13228841Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-testingsim-1of4errornodavinci-stage-03-6.2.500:01:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13222842Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-testingsim-3of4errornodavinci-stage-03-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13218843Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-validationsim-3of4errornodavinci-stage-03-6.2.500:01:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13213846Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-validationsim-1of4errornodavinci-stage-03-6.2.500:01:44
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13206847Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-validation449errornodavinci-stage-03-6.2.500:01:31
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13203849Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13196852Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:01:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13191853Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:01:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13187854Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-0of4errornodavinci-stage-03-6.2.500:01:30
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13183855Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:01:32
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13177856Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13172857Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-3of4errornodavinci-stage-03-6.2.500:01:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13167858Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-3of4errornodavinci-stage-03-6.2.500:01:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13165859Bea Baselines 🐤baseline-duckietownaido-LF-sim-validationsim-1of4errornodavinci-stage-03-6.2.500:01:02
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13160860Bea Baselines 🐤template-pytorchaido-LFV-sim-validationsim-0of4errornodavinci-stage-03-6.2.500:01:32
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13155862Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13148864Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13143865Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-validationsim-0of4errornodavinci-stage-03-6.2.500:01:38
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13138866Bea Baselines 🐤template-pytorchaido-LFP-sim-validationsim-0of4errornodavinci-stage-03-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13133872Bea Baselines 🐤template-pytorchaido-LFV-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:01:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13129874Bea Baselines 🐤template-pytorchaido-LFI-sim-testingsim-0of4host-errornodavinci-stage-03-6.2.500:01:37
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13125875Bea Baselines 🐤template-pytorchaido-LF-sim-testingsim-1of4errornodavinci-stage-03-6.2.500:01:32
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13120877Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-testingsim-1of4errornodavinci-stage-03-6.2.500:01:36
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13115878Bea Baselines 🐤template-pytorchaido-LFP-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13111879Bea Baselines 🐤template-randomaido-LFV-sim-validationsim-3of4errornodavinci-stage-03-6.2.500:01:33
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13106880Bea Baselines 🐤template-rosaido-LF-sim-validationsim-3of4errornodavinci-stage-03-6.2.500:01:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13101881Bea Baselines 🐤template-tensorflowaido-LFV-sim-validationsim-1of4failednodavinci-stage-03-6.2.500:01:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13096882Bea Baselines 🐤template-randomaido-LFV-sim-validationsim-3of4errornodavinci-stage-03-6.2.500:01:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13092884Bea Baselines 🐤template-rosaido-LF-sim-validationsim-3of4errornodavinci-stage-03-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13087884Bea Baselines 🐤template-rosaido-LF-sim-validationsim-1of4errornodavinci-stage-03-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13084690Bea Baselines 🐤minimal-agentaido-LFP-sim-validationsim-1of4errornodavinci-stage-03-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13079692Bea Baselines 🐤minimal-agentaido-LFVI-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13071693Bea Baselines 🐤minimal-agentaido-LFI-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13068694Bea Baselines 🐤minimal-agentaido-LF-sim-validationsim-0of4errornodavinci-stage-03-6.2.500:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13062696Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-testingsim-1of4errornodavinci-stage-03-6.2.500:01:17
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13057698Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-2of4errornodavinci-stage-03-6.2.500:01:38
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13052699Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13047700Bea Baselines 🐤minimal-agentaido-LFI-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13043701Bea Baselines 🐤minimal-agentaido-LF-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13038397Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-testingsim-2of4errornodavinci-stage-03-6.2.500:00:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13033526Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-testingsim-2of4failednodavinci-stage-03-6.2.500:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13028715Bea Baselines 🐤template-randomaido-LF-sim-testingsim-3of4errornodavinci-stage-03-6.2.500:00:54
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13023783Andrea Danieletemplate-randomaido-LF-sim-validationsim-3of4errornodavinci-stage-03-6.2.500:00:54
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13019785Andrea Danieletemplate-rosaido-LF-sim-validationsim-1of4errornodavinci-stage-03-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13014789Andrea Danieletemplate-pytorchaido-LF-sim-validationsim-3of4errornodavinci-stage-03-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13009844Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13004845Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-validationsim-0of4errornodavinci-stage-03-6.2.500:01:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12999846Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-validationsim-1of4errornodavinci-stage-03-6.2.500:01:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12994848Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-validationsim-3of4errornodavinci-stage-03-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12989849Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-testingsim-1of4errornodavinci-stage-03-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12984850Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12979852Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-testingsim-3of4errornodavinci-stage-03-6.2.500:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12975853Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:01:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12971854Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-2of4errornodavinci-stage-03-6.2.500:01:31
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12965855Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-testingsim-3of4errornodavinci-stage-03-6.2.500:01:32
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12961856Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-testingsim-3of4errornodavinci-stage-03-6.2.500:01:16
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12955858Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-3of4errornodavinci-stage-03-6.2.500:01:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12951859Bea Baselines 🐤baseline-duckietownaido-LF-sim-validationsim-0of4errornodavinci-stage-03-6.2.500:01:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12945860Bea Baselines 🐤template-pytorchaido-LFV-sim-validationsim-3of4errornodavinci-stage-03-6.2.500:01:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12940861Bea Baselines 🐤template-pytorchaido-LFVI-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12935864Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-1of4errornodavinci-stage-03-6.2.500:01:36
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12932731Bea Baselines 🐤minimal-agent-stateaido-hello-sim-state-validationsanity-checkerrornodavinci-stage-03-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12925876Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12921702Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12916874Bea Baselines 🐤template-pytorchaido-LFI-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:01:45
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12912700Bea Baselines 🐤minimal-agentaido-LFI-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:01:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12906693Bea Baselines 🐤minimal-agentaido-LFI-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12902863Bea Baselines 🐤template-pytorchaido-LF-sim-validationsim-0of4errornodavinci-stage-03-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12896864Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12891865Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-validationsim-3of4errornodavinci-stage-03-6.2.500:01:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12886689Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-validationsim-0of4errornodavinci-stage-03-6.2.500:01:17
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12882866Bea Baselines 🐤template-pytorchaido-LFP-sim-validationsim-0of4errornodavinci-stage-03-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12876875Bea Baselines 🐤template-pytorchaido-LF-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12873690Bea Baselines 🐤minimal-agentaido-LFP-sim-validationsim-2of4errornodavinci-stage-03-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12867697Bea Baselines 🐤minimal-agentaido-LFP-sim-testingsim-1of4errornodavinci-stage-03-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12861397Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-testingsim-3of4errornodavinci-stage-03-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12856783Andrea Danieletemplate-randomaido-LF-sim-validationsim-2of4errornodavinci-stage-03-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12849874Bea Baselines 🐤template-pytorchaido-LFI-sim-testingsim-1of4errornodavinci-stage-03-6.2.500:02:31
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12844874Bea Baselines 🐤template-pytorchaido-LFI-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12841875Bea Baselines 🐤template-pytorchaido-LF-sim-testingsim-2of4errornodavinci-stage-03-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12834876Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12827877Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-testingsim-2of4errornodavinci-stage-03-6.2.500:01:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12823879Bea Baselines 🐤template-randomaido-LFV-sim-validationsim-2of4errornodavinci-stage-03-6.2.500:01:40
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12817880Bea Baselines 🐤template-rosaido-LF-sim-validationsim-0of4errornodavinci-stage-03-6.2.500:01:02
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12811881Bea Baselines 🐤template-tensorflowaido-LFV-sim-validationsim-0of4failednodavinci-stage-03-6.2.500:03:09
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12806883Bea Baselines 🐤template-tensorflowaido-LFV-sim-validationsim-2of4failednodavinci-stage-03-6.2.500:01:38
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12803884Bea Baselines 🐤template-rosaido-LF-sim-validationsim-1of4errornodavinci-stage-03-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12799884Bea Baselines 🐤template-rosaido-LF-sim-validationsim-3of4errornodavinci-stage-03-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12791731Bea Baselines 🐤minimal-agent-stateaido-hello-sim-state-validationsanity-checkerrornodavinci-stage-03-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12786690Bea Baselines 🐤minimal-agentaido-LFP-sim-validationsim-1of4errornodavinci-stage-03-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12781693Bea Baselines 🐤minimal-agentaido-LFI-sim-validationsim-0of4errornodavinci-stage-03-6.2.500:01:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12777693Bea Baselines 🐤minimal-agentaido-LFI-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12773694Bea Baselines 🐤minimal-agentaido-LF-sim-validationsim-2of4errornodavinci-stage-03-6.2.500:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12767695Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-validationsim-1of4errornodavinci-stage-03-6.2.500:01:17
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12764697Bea Baselines 🐤minimal-agentaido-LFP-sim-testingsim-1of4errornodavinci-stage-03-6.2.500:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12758697Bea Baselines 🐤minimal-agentaido-LFP-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:01:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12755699Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12748701Bea Baselines 🐤minimal-agentaido-LF-sim-testingsim-2of4errornodavinci-stage-03-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12742397Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:01:02
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12740672Bea Baselines 🐤template-tensorflowaido-LF-sim-testingsim-3of4failednodavinci-stage-03-6.2.500:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12734783Andrea Danieletemplate-randomaido-LF-sim-validationsim-1of4errornodavinci-stage-03-6.2.500:00:53
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12730783Andrea Danieletemplate-randomaido-LF-sim-validationsim-2of4errornodavinci-stage-03-6.2.500:00:54
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12725785Andrea Danieletemplate-rosaido-LF-sim-validationsim-0of4errornodavinci-stage-03-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12720715Bea Baselines 🐤template-randomaido-LF-sim-testingsim-3of4abortednodavinci-stage-03-6.2.500:00:44
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1302, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 749, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12715698Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:01:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12710699Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-1of4errornodavinci-stage-03-6.2.500:01:36
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12705701Bea Baselines 🐤minimal-agentaido-LF-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12700701Bea Baselines 🐤minimal-agentaido-LF-sim-testingsim-2of4errornodavinci-stage-03-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12699397Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-testingsim-0of4errornodavinci-stage-03-6.2.500:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12693526Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-testingsim-2of4failednodavinci-stage-03-6.2.500:00:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12689785Andrea Danieletemplate-rosaido-LF-sim-validationsim-2of4errornodavinci-stage-03-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12682789Andrea Danieletemplate-pytorchaido-LF-sim-validationsim-0of4errornodavinci-stage-03-6.2.500:01:12
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12676672Bea Baselines 🐤template-tensorflowaido-LF-sim-testingsim-3of4failednodavinci-stage-03-6.2.500:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12671715Bea Baselines 🐤template-randomaido-LF-sim-testingsim-3of4errornodavinci-stage-03-6.2.500:01:02
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12668805Bea Baselines 🐤challenge-aido_LF-baseline-duckietown:daffy-staging:06423b9f834b346c04889a28f919db3673a8d2c1aido-hello-sim-validationsanity-checkerrornodavinci-stage-03-6.2.500:01:40
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12607911Bea Baselines 🐤baseline-solutionlx22-planning-dd-static-valistep1-0of4successnodavinci-stage-03-6.2.500:11:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio1.0
duration46.53590026256981
complexity106.33333333333331
avg_min_distance0.1938744676404338


other stats
nfeasible3
nsamples3
No reset possible
12606911Bea Baselines 🐤baseline-solutionlx22-planning-dd-static-valistep1-1of4successnodavinci-stage-03-6.2.500:00:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
12605911Bea Baselines 🐤baseline-solutionlx22-planning-dd-static-valistep1-2of4host-errornodavinci-stage-03-6.2.500:00:33
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12594915Bea Baselines 🐤baseline-solutionlx22-planning-cc-empty-valistep1successnodavinci-stage-03-6.2.500:09:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.925925925925926
success_ratio1.0
duration8.696897525204344
complexity16.48148148148148
avg_min_distance0.8613658087096335


other stats
nfeasible27
nsamples27
No reset possible
12592916Bea Baselines 🐤baseline-solutionlx22-planning-dd-dynamic-teststep1-1of4successnodavinci-stage-03-6.2.500:00:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
12591916Bea Baselines 🐤baseline-solutionlx22-planning-dd-dynamic-teststep1-2of4successnodavinci-stage-03-6.2.500:00:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
12590917Bea Baselines 🐤baseline-solutionlx22-planning-dd-static-teststep1-2of4successnodavinci-stage-03-6.2.500:00:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
12589917Bea Baselines 🐤baseline-solutionlx22-planning-dd-static-teststep1-3of4successnodavinci-stage-03-6.2.500:00:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
12579921Bea Baselines 🐤baseline-solutionlx22-planning-cc-empty-teststep1successnodavinci-stage-03-6.2.500:10:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.925925925925926
success_ratio1.0
duration8.696897525204346
complexity16.48148148148148
avg_min_distance0.8613658087096333


other stats
nfeasible27
nsamples27
No reset possible
12558309Andrea Censiminimal-agentaido-LFV-sim-validationsim-0of4successnodavinci-stage-03-6.2.500:02:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.8499999999999943
in-drivable-lane_median2.0999999999999934
driven_lanedir_consec_median0.19955565328420843
deviation-center-line_median0.12567516126913225


other stats
deviation-center-line_max0.12567516126913225
deviation-center-line_mean0.12567516126913225
deviation-center-line_min0.12567516126913225
deviation-heading_max0.9488219555580464
deviation-heading_mean0.9488219555580464
deviation-heading_median0.9488219555580464
deviation-heading_min0.9488219555580464
distance-from-start_max0.46487640009490927
distance-from-start_mean0.46487640009490927
distance-from-start_median0.46487640009490927
distance-from-start_min0.46487640009490927
driven_any_max0.46488519376666826
driven_any_mean0.46488519376666826
driven_any_median0.46488519376666826
driven_any_min0.46488519376666826
driven_lanedir_consec_max0.19955565328420843
driven_lanedir_consec_mean0.19955565328420843
driven_lanedir_consec_min0.19955565328420843
driven_lanedir_max0.19955565328420843
driven_lanedir_mean0.19955565328420843
driven_lanedir_median0.19955565328420843
driven_lanedir_min0.19955565328420843
in-drivable-lane_max2.0999999999999934
in-drivable-lane_mean2.0999999999999934
in-drivable-lane_min2.0999999999999934
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.46488519376666826, "survival_time": 3.8499999999999943, "driven_lanedir": 0.19955565328420843, "in-drivable-lane": 2.0999999999999934, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.46487640009490927, "deviation-center-line": 0.12567516126913225, "driven_lanedir_consec": 0.19955565328420843}}
simulation-passed1
survival_time_max3.8499999999999943
survival_time_mean3.8499999999999943
survival_time_min3.8499999999999943
No reset possible
12554310Andrea Censiminimal-agentaido-LFV-sim-validationsim-1of4successnodavinci-stage-03-6.2.500:02:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.1999999999999895
in-drivable-lane_median3.4499999999999886
driven_lanedir_consec_median0.19955005044754337
deviation-center-line_median0.12567516126913286


other stats
deviation-center-line_max0.12567516126913286
deviation-center-line_mean0.12567516126913286
deviation-center-line_min0.12567516126913286
deviation-heading_max0.9488219555580458
deviation-heading_mean0.9488219555580458
deviation-heading_median0.9488219555580458
deviation-heading_min0.9488219555580458
distance-from-start_max0.689742337316815
distance-from-start_mean0.689742337316815
distance-from-start_median0.689742337316815
distance-from-start_min0.689742337316815
driven_any_max0.6897540728183593
driven_any_mean0.6897540728183593
driven_any_median0.6897540728183593
driven_any_min0.6897540728183593
driven_lanedir_consec_max0.19955005044754337
driven_lanedir_consec_mean0.19955005044754337
driven_lanedir_consec_min0.19955005044754337
driven_lanedir_max0.19955005044754337
driven_lanedir_mean0.19955005044754337
driven_lanedir_median0.19955005044754337
driven_lanedir_min0.19955005044754337
in-drivable-lane_max3.4499999999999886
in-drivable-lane_mean3.4499999999999886
in-drivable-lane_min3.4499999999999886
per-episodes
details{"loop-000-ego0": {"driven_any": 0.6897540728183593, "survival_time": 5.1999999999999895, "driven_lanedir": 0.19955005044754337, "in-drivable-lane": 3.4499999999999886, "deviation-heading": 0.9488219555580458, "distance-from-start": 0.689742337316815, "deviation-center-line": 0.12567516126913286, "driven_lanedir_consec": 0.19955005044754337}}
simulation-passed1
survival_time_max5.1999999999999895
survival_time_mean5.1999999999999895
survival_time_min5.1999999999999895
No reset possible
12550311Andrea Censiminimal-agentaido-LFV-sim-validationsim-0of4successnodavinci-stage-03-6.2.500:02:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.8499999999999943
in-drivable-lane_median2.0999999999999934
driven_lanedir_consec_median0.19955565328420843
deviation-center-line_median0.12567516126913225


other stats
deviation-center-line_max0.12567516126913225
deviation-center-line_mean0.12567516126913225
deviation-center-line_min0.12567516126913225
deviation-heading_max0.9488219555580464
deviation-heading_mean0.9488219555580464
deviation-heading_median0.9488219555580464
deviation-heading_min0.9488219555580464
distance-from-start_max0.46487640009490927
distance-from-start_mean0.46487640009490927
distance-from-start_median0.46487640009490927
distance-from-start_min0.46487640009490927
driven_any_max0.46488519376666826
driven_any_mean0.46488519376666826
driven_any_median0.46488519376666826
driven_any_min0.46488519376666826
driven_lanedir_consec_max0.19955565328420843
driven_lanedir_consec_mean0.19955565328420843
driven_lanedir_consec_min0.19955565328420843
driven_lanedir_max0.19955565328420843
driven_lanedir_mean0.19955565328420843
driven_lanedir_median0.19955565328420843
driven_lanedir_min0.19955565328420843
in-drivable-lane_max2.0999999999999934
in-drivable-lane_mean2.0999999999999934
in-drivable-lane_min2.0999999999999934
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.46488519376666826, "survival_time": 3.8499999999999943, "driven_lanedir": 0.19955565328420843, "in-drivable-lane": 2.0999999999999934, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.46487640009490927, "deviation-center-line": 0.12567516126913225, "driven_lanedir_consec": 0.19955565328420843}}
simulation-passed1
survival_time_max3.8499999999999943
survival_time_mean3.8499999999999943
survival_time_min3.8499999999999943
No reset possible
12526385Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-validationsim-0of4successnodavinci-stage-03-6.2.500:37:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median27.474999999999326
driven_lanedir_consec_median-3.7596333744513473
deviation-center-line_median2.826207078934456


other stats
deviation-center-line_max5.837771540854288
deviation-center-line_mean3.4495697219248367
deviation-center-line_min2.3080931889761485
deviation-heading_max32.69128138684311
deviation-heading_mean28.000440697590285
deviation-heading_median27.32540714337015
deviation-heading_min24.65966711677774
distance-from-start_max0.24490342208234037
distance-from-start_mean0.19099812368685648
distance-from-start_median0.17646711999998588
distance-from-start_min0.16615483266511374
driven_any_max14.058604795389558
driven_any_mean13.069973137140504
driven_any_median12.855284160823707
driven_any_min12.510719431525049
driven_lanedir_consec_max-3.154843394718001
driven_lanedir_consec_mean-3.6964436895375505
driven_lanedir_consec_min-4.111664614529506
driven_lanedir_max-3.154843394718001
driven_lanedir_mean-4.925700408261102
driven_lanedir_median-4.1228287308261695
driven_lanedir_min-8.302300776674068
in-drivable-lane_max29.599999999999273
in-drivable-lane_mean23.174999999999443
in-drivable-lane_min8.149999999999844
per-episodes
details{"autolab-000-ego0": {"driven_any": 12.896419539504876, "survival_time": 59.99999999999873, "driven_lanedir": -4.072963215305138, "in-drivable-lane": 29.599999999999273, "deviation-heading": 24.65966711677774, "distance-from-start": 0.17089167856124254, "deviation-center-line": 2.460140899969981, "driven_lanedir_consec": -3.574152095657171}, "autolab-000-ego1": {"driven_any": 12.510719431525049, "survival_time": 59.99999999999873, "driven_lanedir": -3.154843394718001, "in-drivable-lane": 27.549999999999255, "deviation-heading": 26.962577155455865, "distance-from-start": 0.1820425614387292, "deviation-center-line": 3.192273257898931, "driven_lanedir_consec": -3.154843394718001}, "autolab-000-ego2": {"driven_any": 14.058604795389558, "survival_time": 59.99999999999873, "driven_lanedir": -8.302300776674068, "in-drivable-lane": 8.149999999999844, "deviation-heading": 32.69128138684311, "distance-from-start": 0.24490342208234037, "deviation-center-line": 5.837771540854288, "driven_lanedir_consec": -4.111664614529506}, "autolab-000-ego3": {"driven_any": 12.81414878214254, "survival_time": 59.99999999999873, "driven_lanedir": -4.172694246347202, "in-drivable-lane": 27.399999999999395, "deviation-heading": 27.688237131284435, "distance-from-start": 0.16615483266511374, "deviation-center-line": 2.3080931889761485, "driven_lanedir_consec": -3.945114653245524}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12509391Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-validationsim-1of4successnodavinci-stage-03-6.2.500:36:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median21.874999999999385
driven_lanedir_consec_median-4.211757020529188
deviation-center-line_median3.1463873508463234


other stats
deviation-center-line_max6.815552091704051
deviation-center-line_mean3.8069098290964782
deviation-center-line_min2.119312522989215
deviation-heading_max30.43555342726984
deviation-heading_mean25.000068465243523
deviation-heading_median25.74125030100506
deviation-heading_min18.082219831694125
distance-from-start_max0.21715901161987491
distance-from-start_mean0.18796420574674827
distance-from-start_median0.18364014583554744
distance-from-start_min0.1674175196960233
driven_any_max14.359341182682272
driven_any_mean11.947742971327608
driven_any_median13.66473086895252
driven_any_min6.1021689647231225
driven_lanedir_consec_max-1.8845364015793784
driven_lanedir_consec_mean-3.666683636625607
driven_lanedir_consec_min-4.358684103864673
driven_lanedir_max-1.8845364015793784
driven_lanedir_mean-4.595379723874755
driven_lanedir_median-5.223982154171269
driven_lanedir_min-6.049018185577106
in-drivable-lane_max27.74999999999924
in-drivable-lane_mean21.349999999999532
in-drivable-lane_min13.900000000000132
per-episodes
details{"4way-000-ego0": {"driven_any": 14.359341182682272, "survival_time": 59.99999999999873, "driven_lanedir": -5.023121990852821, "in-drivable-lane": 25.7499999999994, "deviation-heading": 27.406844325012344, "distance-from-start": 0.21715901161987491, "deviation-center-line": 2.5934900945627533, "driven_lanedir_consec": -4.358684103864673}, "4way-000-ego1": {"driven_any": 6.1021689647231225, "survival_time": 59.99999999999873, "driven_lanedir": -1.8845364015793784, "in-drivable-lane": 13.900000000000132, "deviation-heading": 18.082219831694125, "distance-from-start": 0.1674175196960233, "deviation-center-line": 6.815552091704051, "driven_lanedir_consec": -1.8845364015793784}, "4way-000-ego2": {"driven_any": 13.89751310318527, "survival_time": 59.99999999999873, "driven_lanedir": -6.049018185577106, "in-drivable-lane": 17.999999999999368, "deviation-heading": 30.43555342726984, "distance-from-start": 0.19647343797458827, "deviation-center-line": 3.699284607129894, "driven_lanedir_consec": -4.15569690611934}, "4way-000-ego3": {"driven_any": 13.431948634719769, "survival_time": 59.99999999999873, "driven_lanedir": -5.424842317489718, "in-drivable-lane": 27.74999999999924, "deviation-heading": 24.07565627699778, "distance-from-start": 0.17080685369650658, "deviation-center-line": 2.119312522989215, "driven_lanedir_consec": -4.267817134939035}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12503391Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-validationsim-0of4successnodavinci-stage-03-6.2.500:22:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median5.250000000000025
driven_lanedir_consec_median-0.7742091364089175
deviation-center-line_median4.962712306937245


other stats
deviation-center-line_max7.392925861126312
deviation-center-line_mean4.9034126102836995
deviation-center-line_min2.295299966133996
deviation-heading_max23.199675707746447
deviation-heading_mean18.705981951432804
deviation-heading_median19.92866652920145
deviation-heading_min11.76691903958188
distance-from-start_max0.16638524096161808
distance-from-start_mean0.14871012016432733
distance-from-start_median0.15112389524922104
distance-from-start_min0.1262074491972492
driven_any_max11.187632142135095
driven_any_mean4.456134758908975
driven_any_median2.700778708833587
driven_any_min1.23534947583363
driven_lanedir_consec_max-0.08976450136829062
driven_lanedir_consec_mean-1.1056014621250383
driven_lanedir_consec_min-2.7842230743140273
driven_lanedir_max-0.14337901746252513
driven_lanedir_mean-1.2011851590049256
driven_lanedir_median-0.832696066224936
driven_lanedir_min-2.995969486107305
in-drivable-lane_max33.84999999999911
in-drivable-lane_mean11.43749999999979
in-drivable-lane_min1.3999999999999986
per-episodes
details{"udem-000-ego0": {"driven_any": 11.187632142135095, "survival_time": 59.99999999999873, "driven_lanedir": -2.995969486107305, "in-drivable-lane": 33.84999999999911, "deviation-heading": 23.199675707746447, "distance-from-start": 0.16638524096161808, "deviation-center-line": 2.295299966133996, "driven_lanedir_consec": -2.7842230743140273}, "udem-000-ego1": {"driven_any": 1.8261303762681371, "survival_time": 59.99999999999873, "driven_lanedir": -0.4407915511589493, "in-drivable-lane": 3.55, "deviation-heading": 11.76691903958188, "distance-from-start": 0.1448788700377244, "deviation-center-line": 7.392925861126312, "driven_lanedir_consec": -0.4407915511589493}, "udem-000-ego2": {"driven_any": 1.23534947583363, "survival_time": 59.99999999999873, "driven_lanedir": -0.14337901746252513, "in-drivable-lane": 1.3999999999999986, "deviation-heading": 20.64938919899902, "distance-from-start": 0.1262074491972492, "deviation-center-line": 5.268140585210829, "driven_lanedir_consec": -0.08976450136829062}, "udem-000-ego3": {"driven_any": 3.575427041399037, "survival_time": 59.99999999999873, "driven_lanedir": -1.2246005812909226, "in-drivable-lane": 6.950000000000051, "deviation-heading": 19.207943859403876, "distance-from-start": 0.1573689204607177, "deviation-center-line": 4.6572840286636605, "driven_lanedir_consec": -1.1076267216588858}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12490392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-0of4successnodavinci-stage-03-6.2.500:34:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median32.74999999999909
driven_lanedir_consec_median-3.199461825468246
deviation-center-line_median2.622406975418091


other stats
deviation-center-line_max3.185780165334395
deviation-center-line_mean2.577525923552821
deviation-center-line_min1.8795095780407072
deviation-heading_max25.629546806875226
deviation-heading_mean23.505976670986183
deviation-heading_median23.32600447201314
deviation-heading_min21.742350933043237
distance-from-start_max0.19611173100874088
distance-from-start_mean0.16983897370985232
distance-from-start_median0.16410185172734645
distance-from-start_min0.15504046037597552
driven_any_max12.39942486127829
driven_any_mean11.31087097359467
driven_any_median11.72478325020823
driven_any_min9.394492532683929
driven_lanedir_consec_max-1.3377237903225625
driven_lanedir_consec_mean-2.88537011698702
driven_lanedir_consec_min-3.8048330266890265
driven_lanedir_max-1.3377237903225625
driven_lanedir_mean-2.95860064315279
driven_lanedir_median-3.325478323043151
driven_lanedir_min-3.845722136202294
in-drivable-lane_max33.899999999999096
in-drivable-lane_mean32.112499999999145
in-drivable-lane_min29.049999999999315
per-episodes
details{"autolab-000-ego0": {"driven_any": 12.211669050966334, "survival_time": 59.99999999999873, "driven_lanedir": -3.8048330266890265, "in-drivable-lane": 32.4499999999993, "deviation-heading": 24.18634105896794, "distance-from-start": 0.16200444172090925, "deviation-center-line": 1.8795095780407072, "driven_lanedir_consec": -3.8048330266890265}, "autolab-000-ego1": {"driven_any": 9.394492532683929, "survival_time": 59.99999999999873, "driven_lanedir": -1.3377237903225625, "in-drivable-lane": 33.04999999999889, "deviation-heading": 21.742350933043237, "distance-from-start": 0.19611173100874088, "deviation-center-line": 3.185780165334395, "driven_lanedir_consec": -1.3377237903225625}, "autolab-000-ego2": {"driven_any": 12.39942486127829, "survival_time": 59.99999999999873, "driven_lanedir": -3.845722136202294, "in-drivable-lane": 29.049999999999315, "deviation-heading": 25.629546806875226, "distance-from-start": 0.16619926173378366, "deviation-center-line": 2.6917691405360085, "driven_lanedir_consec": -3.5528000315392165}, "autolab-000-ego3": {"driven_any": 11.237897449450124, "survival_time": 59.99999999999873, "driven_lanedir": -2.8461236193972757, "in-drivable-lane": 33.899999999999096, "deviation-heading": 22.465667885058338, "distance-from-start": 0.15504046037597552, "deviation-center-line": 2.5530448103001735, "driven_lanedir_consec": -2.8461236193972757}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12486393Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:08:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median20.099999999999447
driven_lanedir_consec_median-2.611084584660441
deviation-center-line_median2.1837587364282505


other stats
deviation-center-line_max2.1837587364282505
deviation-center-line_mean2.1837587364282505
deviation-center-line_min2.1837587364282505
deviation-heading_max31.431414795607957
deviation-heading_mean31.431414795607957
deviation-heading_median31.431414795607957
deviation-heading_min31.431414795607957
distance-from-start_max0.14068200374801193
distance-from-start_mean0.14068200374801193
distance-from-start_median0.14068200374801193
distance-from-start_min0.14068200374801193
driven_any_max10.078211512979223
driven_any_mean10.078211512979223
driven_any_median10.078211512979223
driven_any_min10.078211512979223
driven_lanedir_consec_max-2.611084584660441
driven_lanedir_consec_mean-2.611084584660441
driven_lanedir_consec_min-2.611084584660441
driven_lanedir_max-2.611084584660441
driven_lanedir_mean-2.611084584660441
driven_lanedir_median-2.611084584660441
driven_lanedir_min-2.611084584660441
in-drivable-lane_max20.099999999999447
in-drivable-lane_mean20.099999999999447
in-drivable-lane_min20.099999999999447
per-episodes
details{"loop2-000-ego0": {"driven_any": 10.078211512979223, "survival_time": 59.99999999999873, "driven_lanedir": -2.611084584660441, "in-drivable-lane": 20.099999999999447, "deviation-heading": 31.431414795607957, "distance-from-start": 0.14068200374801193, "deviation-center-line": 2.1837587364282505, "driven_lanedir_consec": -2.611084584660441}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12479394Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:20:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median34.84999999999913
driven_lanedir_consec_median-3.4329157198822804
deviation-center-line_median1.6709554596944822


other stats
deviation-center-line_max1.6709554596944822
deviation-center-line_mean1.6709554596944822
deviation-center-line_min1.6709554596944822
deviation-heading_max18.88048177334282
deviation-heading_mean18.88048177334282
deviation-heading_median18.88048177334282
deviation-heading_min18.88048177334282
distance-from-start_max0.19486416485406577
distance-from-start_mean0.19486416485406577
distance-from-start_median0.19486416485406577
distance-from-start_min0.19486416485406577
driven_any_max14.246100139897615
driven_any_mean14.246100139897615
driven_any_median14.246100139897615
driven_any_min14.246100139897615
driven_lanedir_consec_max-3.4329157198822804
driven_lanedir_consec_mean-3.4329157198822804
driven_lanedir_consec_min-3.4329157198822804
driven_lanedir_max-4.253216848200466
driven_lanedir_mean-4.253216848200466
driven_lanedir_median-4.253216848200466
driven_lanedir_min-4.253216848200466
in-drivable-lane_max34.84999999999913
in-drivable-lane_mean34.84999999999913
in-drivable-lane_min34.84999999999913
per-episodes
details{"zigzag-000-ego0": {"driven_any": 14.246100139897615, "survival_time": 59.99999999999873, "driven_lanedir": -4.253216848200466, "in-drivable-lane": 34.84999999999913, "deviation-heading": 18.88048177334282, "distance-from-start": 0.19486416485406577, "deviation-center-line": 1.6709554596944822, "driven_lanedir_consec": -3.4329157198822804}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12478395Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12474396Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-testingsim-0of4successnodavinci-stage-03-6.2.500:03:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.400000000000029
in-drivable-lane_median4.750000000000005
driven_lanedir_consec_median-0.6286617286889524
deviation-center-line_median0.25434192215309787


other stats
deviation-center-line_max0.25434192215309787
deviation-center-line_mean0.25434192215309787
deviation-center-line_min0.25434192215309787
deviation-heading_max5.718826469443452
deviation-heading_mean5.718826469443452
deviation-heading_median5.718826469443452
deviation-heading_min5.718826469443452
distance-from-start_max0.15930824718018874
distance-from-start_mean0.15930824718018874
distance-from-start_median0.15930824718018874
distance-from-start_min0.15930824718018874
driven_any_max2.0858605810279456
driven_any_mean2.0858605810279456
driven_any_median2.0858605810279456
driven_any_min2.0858605810279456
driven_lanedir_consec_max-0.6286617286889524
driven_lanedir_consec_mean-0.6286617286889524
driven_lanedir_consec_min-0.6286617286889524
driven_lanedir_max-0.6210863044987738
driven_lanedir_mean-0.6210863044987738
driven_lanedir_median-0.6210863044987738
driven_lanedir_min-0.6210863044987738
in-drivable-lane_max4.750000000000005
in-drivable-lane_mean4.750000000000005
in-drivable-lane_min4.750000000000005
per-episodes
details{"4way-000-ego0": {"driven_any": 2.0858605810279456, "survival_time": 11.400000000000029, "driven_lanedir": -0.6210863044987738, "in-drivable-lane": 4.750000000000005, "deviation-heading": 5.718826469443452, "distance-from-start": 0.15930824718018874, "deviation-center-line": 0.25434192215309787, "driven_lanedir_consec": -0.6286617286889524}}
simulation-passed1
survival_time_max11.400000000000029
survival_time_mean11.400000000000029
survival_time_min11.400000000000029
No reset possible
12471396Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12466514Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-validationsim-1of4failednodavinci-stage-03-6.2.500:01:13
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12459516Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-validationsim-0of4failednodavinci-stage-03-6.2.500:01:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12454517Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-validationsim-1of4failednodavinci-stage-03-6.2.500:01:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12448518Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12443520Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-validationsim-0of4failednodavinci-stage-03-6.2.500:01:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12437521Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-testingsim-1of4failednodavinci-stage-03-6.2.500:01:17
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12433522Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-testingsim-2of4failednodavinci-stage-03-6.2.500:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12429523Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-testingsim-2of4failednodavinci-stage-03-6.2.500:02:16
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12427523Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-testingsim-0of4failednodavinci-stage-03-6.2.500:01:24
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12411528Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-validationsim-0of4successnodavinci-stage-03-6.2.500:19:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median4.6140601284711655
deviation-center-line_median2.1348292733798164


other stats
deviation-center-line_max4.628637351766301
deviation-center-line_mean2.5589073611071873
deviation-center-line_min1.337333545902815
deviation-heading_max40.17200735575305
deviation-heading_mean19.11851704649621
deviation-heading_median13.411146997826137
deviation-heading_min9.4797668345795
distance-from-start_max4.450312585109248
distance-from-start_mean2.909245612087179
distance-from-start_median2.569205549743059
distance-from-start_min2.0482587637533505
driven_any_max8.983475759185035
driven_any_mean5.354944968213294
driven_any_median4.778934793319333
driven_any_min2.878434527029474
driven_lanedir_consec_max8.171779866326926
driven_lanedir_consec_mean5.036572690778746
driven_lanedir_consec_min2.7463906398457265
driven_lanedir_max8.171779866326926
driven_lanedir_mean5.036572690778746
driven_lanedir_median4.6140601284711655
driven_lanedir_min2.7463906398457265
in-drivable-lane_max1.8499999999999517
in-drivable-lane_mean0.4624999999999879
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.878434527029474, "survival_time": 59.99999999999873, "driven_lanedir": 2.7463906398457265, "in-drivable-lane": 0.0, "deviation-heading": 13.842057901628587, "distance-from-start": 2.381691181114427, "deviation-center-line": 1.337333545902815, "driven_lanedir_consec": 2.7463906398457265}, "autolab-000-ego1": {"driven_any": 8.983475759185035, "survival_time": 59.99999999999873, "driven_lanedir": 8.171779866326926, "in-drivable-lane": 1.8499999999999517, "deviation-heading": 12.980236094023686, "distance-from-start": 4.450312585109248, "deviation-center-line": 2.40395018822823, "driven_lanedir_consec": 8.171779866326926}, "autolab-000-ego2": {"driven_any": 5.945164510782714, "survival_time": 59.99999999999873, "driven_lanedir": 5.789998093781497, "in-drivable-lane": 0.0, "deviation-heading": 9.4797668345795, "distance-from-start": 2.7567199183716906, "deviation-center-line": 4.628637351766301, "driven_lanedir_consec": 5.789998093781497}, "autolab-000-ego3": {"driven_any": 3.612705075855952, "survival_time": 59.99999999999873, "driven_lanedir": 3.438122163160834, "in-drivable-lane": 0.0, "deviation-heading": 40.17200735575305, "distance-from-start": 2.0482587637533505, "deviation-center-line": 1.8657083585314032, "driven_lanedir_consec": 3.438122163160834}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12409529Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-validationsim-1of4successnodavinci-stage-03-6.2.500:02:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.999999999999987
in-drivable-lane_median0.0
driven_lanedir_consec_median0.9860839370166088
deviation-center-line_median0.30618337825677316


other stats
deviation-center-line_max0.30618337825677316
deviation-center-line_mean0.30618337825677316
deviation-center-line_min0.30618337825677316
deviation-heading_max1.3239752800783415
deviation-heading_mean1.3239752800783415
deviation-heading_median1.3239752800783415
deviation-heading_min1.3239752800783415
distance-from-start_max0.7753042616869756
distance-from-start_mean0.7753042616869756
distance-from-start_median0.7753042616869756
distance-from-start_min0.7753042616869756
driven_any_max1.009641739668666
driven_any_mean1.009641739668666
driven_any_median1.009641739668666
driven_any_min1.009641739668666
driven_lanedir_consec_max0.9860839370166088
driven_lanedir_consec_mean0.9860839370166088
driven_lanedir_consec_min0.9860839370166088
driven_lanedir_max0.9860839370166088
driven_lanedir_mean0.9860839370166088
driven_lanedir_median0.9860839370166088
driven_lanedir_min0.9860839370166088
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 1.009641739668666, "survival_time": 5.999999999999987, "driven_lanedir": 0.9860839370166088, "in-drivable-lane": 0.0, "deviation-heading": 1.3239752800783415, "distance-from-start": 0.7753042616869756, "deviation-center-line": 0.30618337825677316, "driven_lanedir_consec": 0.9860839370166088}}
simulation-passed1
survival_time_max5.999999999999987
survival_time_mean5.999999999999987
survival_time_min5.999999999999987
No reset possible
12400531Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-validationsim-1of4successnodavinci-stage-03-6.2.500:12:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median54.34999999999905
in-drivable-lane_median0.4000000000000057
driven_lanedir_consec_median8.48458785272911
deviation-center-line_median2.710048179803482


other stats
deviation-center-line_max2.710048179803482
deviation-center-line_mean2.710048179803482
deviation-center-line_min2.710048179803482
deviation-heading_max11.525477950421068
deviation-heading_mean11.525477950421068
deviation-heading_median11.525477950421068
deviation-heading_min11.525477950421068
distance-from-start_max3.0164298357806545
distance-from-start_mean3.0164298357806545
distance-from-start_median3.0164298357806545
distance-from-start_min3.0164298357806545
driven_any_max9.227834475431816
driven_any_mean9.227834475431816
driven_any_median9.227834475431816
driven_any_min9.227834475431816
driven_lanedir_consec_max8.48458785272911
driven_lanedir_consec_mean8.48458785272911
driven_lanedir_consec_min8.48458785272911
driven_lanedir_max8.741140534242113
driven_lanedir_mean8.741140534242113
driven_lanedir_median8.741140534242113
driven_lanedir_min8.741140534242113
in-drivable-lane_max0.4000000000000057
in-drivable-lane_mean0.4000000000000057
in-drivable-lane_min0.4000000000000057
per-episodes
details{"4way-000-ego0": {"driven_any": 9.227834475431816, "survival_time": 54.34999999999905, "driven_lanedir": 8.741140534242113, "in-drivable-lane": 0.4000000000000057, "deviation-heading": 11.525477950421068, "distance-from-start": 3.0164298357806545, "deviation-center-line": 2.710048179803482, "driven_lanedir_consec": 8.48458785272911}}
simulation-passed1
survival_time_max54.34999999999905
survival_time_mean54.34999999999905
survival_time_min54.34999999999905
No reset possible
12394533Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-validationsim-0of4successnodavinci-stage-03-6.2.500:06:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.754499672399183
survival_time_median59.99999999999873
deviation-center-line_median3.1593211653821656
in-drivable-lane_median3.4000000000000483


other stats
deviation-center-line_max3.1593211653821656
deviation-center-line_mean3.1593211653821656
deviation-center-line_min3.1593211653821656
deviation-heading_max14.814487799578805
deviation-heading_mean14.814487799578805
deviation-heading_median14.814487799578805
deviation-heading_min14.814487799578805
distance-from-start_max3.293513341526096
distance-from-start_mean3.293513341526096
distance-from-start_median3.293513341526096
distance-from-start_min3.293513341526096
driven_any_max9.969031069651452
driven_any_mean9.969031069651452
driven_any_median9.969031069651452
driven_any_min9.969031069651452
driven_lanedir_consec_max8.754499672399183
driven_lanedir_consec_mean8.754499672399183
driven_lanedir_consec_min8.754499672399183
driven_lanedir_max8.754499672399183
driven_lanedir_mean8.754499672399183
driven_lanedir_median8.754499672399183
driven_lanedir_min8.754499672399183
in-drivable-lane_max3.4000000000000483
in-drivable-lane_mean3.4000000000000483
in-drivable-lane_min3.4000000000000483
per-episodes
details{"autolab-000-ego0": {"driven_any": 9.969031069651452, "survival_time": 59.99999999999873, "driven_lanedir": 8.754499672399183, "in-drivable-lane": 3.4000000000000483, "deviation-heading": 14.814487799578805, "distance-from-start": 3.293513341526096, "deviation-center-line": 3.1593211653821656, "driven_lanedir_consec": 8.754499672399183}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12388534Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-validationsim-0of4successnodavinci-stage-03-6.2.500:07:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median20.80000000000016
in-drivable-lane_median0.0
driven_lanedir_consec_median0.8039629846692447
deviation-center-line_median1.4550736531871753


other stats
deviation-center-line_max2.099464068174796
deviation-center-line_mean1.49134517229757
deviation-center-line_min0.9557693146411328
deviation-heading_max11.39873847947366
deviation-heading_mean7.181365632163214
deviation-heading_median7.087958731261992
deviation-heading_min3.1508065866552095
distance-from-start_max2.3707232894497565
distance-from-start_mean1.0495210369260934
distance-from-start_median0.6729590266915704
distance-from-start_min0.4814428048714763
driven_any_max3.1416983567551617
driven_any_mean1.3269991228948044
driven_any_median0.8383963401632107
driven_any_min0.4895054544976343
driven_lanedir_consec_max2.938469686845649
driven_lanedir_consec_mean1.2548501329164696
driven_lanedir_consec_min0.4730048754817404
driven_lanedir_max2.9937796297349335
driven_lanedir_mean1.2686782753600374
driven_lanedir_median0.8039629846692447
driven_lanedir_min0.4730075023667269
in-drivable-lane_max0.9500000000000136
in-drivable-lane_mean0.23750000000000335
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 3.1416983567551617, "survival_time": 20.80000000000016, "driven_lanedir": 2.9937796297349335, "in-drivable-lane": 0.9500000000000136, "deviation-heading": 4.329084154074214, "distance-from-start": 2.3707232894497565, "deviation-center-line": 0.9557693146411328, "driven_lanedir_consec": 2.938469686845649}, "udem-000-ego1": {"driven_any": 1.1772742910019651, "survival_time": 20.80000000000016, "driven_lanedir": 1.119920648368944, "in-drivable-lane": 0.0, "deviation-heading": 3.1508065866552095, "distance-from-start": 0.8538893087990495, "deviation-center-line": 0.995522871828066, "driven_lanedir_consec": 1.119920648368944}, "udem-000-ego2": {"driven_any": 0.4895054544976343, "survival_time": 20.80000000000016, "driven_lanedir": 0.4730075023667269, "in-drivable-lane": 0.0, "deviation-heading": 11.39873847947366, "distance-from-start": 0.4814428048714763, "deviation-center-line": 1.9146244345462844, "driven_lanedir_consec": 0.4730048754817404}, "udem-000-ego3": {"driven_any": 0.4995183893244563, "survival_time": 20.80000000000016, "driven_lanedir": 0.4880053209695452, "in-drivable-lane": 0.0, "deviation-heading": 9.84683330844977, "distance-from-start": 0.49202874458409135, "deviation-center-line": 2.099464068174796, "driven_lanedir_consec": 0.4880053209695452}}
simulation-passed1
survival_time_max20.80000000000016
survival_time_mean20.80000000000016
survival_time_min20.80000000000016
No reset possible
12385534Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:01:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12384535Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-testingsim-3of4host-errornodavinci-stage-03-6.2.500:00:39
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage.duckietown.org/v2/: dial tcp: lookup registry-stage.duckietown.org: Temporary failure in name resolution")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12378537Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-testingsim-1of4successnodavinci-stage-03-6.2.500:05:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median20.90000000000016
in-drivable-lane_median3.7500000000000537
driven_lanedir_consec_median3.0382021521371465
deviation-center-line_median0.9013368286008844


other stats
deviation-center-line_max0.9013368286008844
deviation-center-line_mean0.9013368286008844
deviation-center-line_min0.9013368286008844
deviation-heading_max4.452593761119633
deviation-heading_mean4.452593761119633
deviation-heading_median4.452593761119633
deviation-heading_min4.452593761119633
distance-from-start_max1.881252124734894
distance-from-start_mean1.881252124734894
distance-from-start_median1.881252124734894
distance-from-start_min1.881252124734894
driven_any_max3.6931565864927807
driven_any_mean3.6931565864927807
driven_any_median3.6931565864927807
driven_any_min3.6931565864927807
driven_lanedir_consec_max3.0382021521371465
driven_lanedir_consec_mean3.0382021521371465
driven_lanedir_consec_min3.0382021521371465
driven_lanedir_max3.0382021521371465
driven_lanedir_mean3.0382021521371465
driven_lanedir_median3.0382021521371465
driven_lanedir_min3.0382021521371465
in-drivable-lane_max3.7500000000000537
in-drivable-lane_mean3.7500000000000537
in-drivable-lane_min3.7500000000000537
per-episodes
details{"loop-000-ego0": {"driven_any": 3.6931565864927807, "survival_time": 20.90000000000016, "driven_lanedir": 3.0382021521371465, "in-drivable-lane": 3.7500000000000537, "deviation-heading": 4.452593761119633, "distance-from-start": 1.881252124734894, "deviation-center-line": 0.9013368286008844, "driven_lanedir_consec": 3.0382021521371465}}
simulation-passed1
survival_time_max20.90000000000016
survival_time_mean20.90000000000016
survival_time_min20.90000000000016
No reset possible
12366538Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-testingsim-0of4successnodavinci-stage-03-6.2.500:09:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median37.05000000000003
in-drivable-lane_median0.6500000000000092
driven_lanedir_consec_median5.28149418666708
deviation-center-line_median1.859189447897461


other stats
deviation-center-line_max1.859189447897461
deviation-center-line_mean1.859189447897461
deviation-center-line_min1.859189447897461
deviation-heading_max8.692507425048035
deviation-heading_mean8.692507425048035
deviation-heading_median8.692507425048035
deviation-heading_min8.692507425048035
distance-from-start_max2.910059927512123
distance-from-start_mean2.910059927512123
distance-from-start_median2.910059927512123
distance-from-start_min2.910059927512123
driven_any_max5.7619327960702424
driven_any_mean5.7619327960702424
driven_any_median5.7619327960702424
driven_any_min5.7619327960702424
driven_lanedir_consec_max5.28149418666708
driven_lanedir_consec_mean5.28149418666708
driven_lanedir_consec_min5.28149418666708
driven_lanedir_max5.3281212201634425
driven_lanedir_mean5.3281212201634425
driven_lanedir_median5.3281212201634425
driven_lanedir_min5.3281212201634425
in-drivable-lane_max0.6500000000000092
in-drivable-lane_mean0.6500000000000092
in-drivable-lane_min0.6500000000000092
per-episodes
details{"udem-000-ego0": {"driven_any": 5.7619327960702424, "survival_time": 37.05000000000003, "driven_lanedir": 5.3281212201634425, "in-drivable-lane": 0.6500000000000092, "deviation-heading": 8.692507425048035, "distance-from-start": 2.910059927512123, "deviation-center-line": 1.859189447897461, "driven_lanedir_consec": 5.28149418666708}}
simulation-passed1
survival_time_max37.05000000000003
survival_time_mean37.05000000000003
survival_time_min37.05000000000003
No reset possible
12360539Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:01:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12352541Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-testingsim-1of4successnodavinci-stage-03-6.2.500:07:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.07555294767996
survival_time_median59.99999999999873
deviation-center-line_median2.8445109214205684
in-drivable-lane_median5.949999999999718


other stats
deviation-center-line_max2.8445109214205684
deviation-center-line_mean2.8445109214205684
deviation-center-line_min2.8445109214205684
deviation-heading_max16.86363947422413
deviation-heading_mean16.86363947422413
deviation-heading_median16.86363947422413
deviation-heading_min16.86363947422413
distance-from-start_max2.639767136599654
distance-from-start_mean2.639767136599654
distance-from-start_median2.639767136599654
distance-from-start_min2.639767136599654
driven_any_max10.131087926610409
driven_any_mean10.131087926610409
driven_any_median10.131087926610409
driven_any_min10.131087926610409
driven_lanedir_consec_max8.07555294767996
driven_lanedir_consec_mean8.07555294767996
driven_lanedir_consec_min8.07555294767996
driven_lanedir_max8.07555294767996
driven_lanedir_mean8.07555294767996
driven_lanedir_median8.07555294767996
driven_lanedir_min8.07555294767996
in-drivable-lane_max5.949999999999718
in-drivable-lane_mean5.949999999999718
in-drivable-lane_min5.949999999999718
per-episodes
details{"loop-000-ego0": {"driven_any": 10.131087926610409, "survival_time": 59.99999999999873, "driven_lanedir": 8.07555294767996, "in-drivable-lane": 5.949999999999718, "deviation-heading": 16.86363947422413, "distance-from-start": 2.639767136599654, "deviation-center-line": 2.8445109214205684, "driven_lanedir_consec": 8.07555294767996}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12351541Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:06:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median10.348019310880066
survival_time_median59.99999999999873
deviation-center-line_median3.689707371711617
in-drivable-lane_median1.749999999999979


other stats
deviation-center-line_max3.689707371711617
deviation-center-line_mean3.689707371711617
deviation-center-line_min3.689707371711617
deviation-heading_max15.873899927143304
deviation-heading_mean15.873899927143304
deviation-heading_median15.873899927143304
deviation-heading_min15.873899927143304
distance-from-start_max1.1344876993620787
distance-from-start_mean1.1344876993620787
distance-from-start_median1.1344876993620787
distance-from-start_min1.1344876993620787
driven_any_max11.270698997623864
driven_any_mean11.270698997623864
driven_any_median11.270698997623864
driven_any_min11.270698997623864
driven_lanedir_consec_max10.348019310880066
driven_lanedir_consec_mean10.348019310880066
driven_lanedir_consec_min10.348019310880066
driven_lanedir_max10.348019310880066
driven_lanedir_mean10.348019310880066
driven_lanedir_median10.348019310880066
driven_lanedir_min10.348019310880066
in-drivable-lane_max1.749999999999979
in-drivable-lane_mean1.749999999999979
in-drivable-lane_min1.749999999999979
per-episodes
details{"loop2-000-ego0": {"driven_any": 11.270698997623864, "survival_time": 59.99999999999873, "driven_lanedir": 10.348019310880066, "in-drivable-lane": 1.749999999999979, "deviation-heading": 15.873899927143304, "distance-from-start": 1.1344876993620787, "deviation-center-line": 3.689707371711617, "driven_lanedir_consec": 10.348019310880066}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12344544Bea Baselines 🐤baseline-dagger-pytorchaido-hello-sim-validationsanity-checksuccessnodavinci-stage-03-6.2.500:02:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.01238230322898981
deviation-center-line_median0.006334025430897663


other stats
deviation-center-line_max0.006334025430897663
deviation-center-line_mean0.006334025430897663
deviation-center-line_min0.006334025430897663
deviation-heading_max0.2368079933802578
deviation-heading_mean0.2368079933802578
deviation-heading_median0.2368079933802578
deviation-heading_min0.2368079933802578
distance-from-start_max0.013396305522955142
distance-from-start_mean0.013396305522955142
distance-from-start_median0.013396305522955142
distance-from-start_min0.013396305522955142
driven_any_max0.013445379418042703
driven_any_mean0.013445379418042703
driven_any_median0.013445379418042703
driven_any_min0.013445379418042703
driven_lanedir_consec_max0.01238230322898981
driven_lanedir_consec_mean0.01238230322898981
driven_lanedir_consec_min0.01238230322898981
driven_lanedir_max0.01238230322898981
driven_lanedir_mean0.01238230322898981
driven_lanedir_median0.01238230322898981
driven_lanedir_min0.01238230322898981
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.013445379418042703, "survival_time": 0.49999999999999994, "driven_lanedir": 0.01238230322898981, "in-drivable-lane": 0.0, "deviation-heading": 0.2368079933802578, "distance-from-start": 0.013396305522955142, "deviation-center-line": 0.006334025430897663, "driven_lanedir_consec": 0.01238230322898981}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
12341595Liam Paullbaseline-duckietownaido-LF-sim-validationsim-2of4failednodavinci-stage-03-6.2.500:01:00
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12339595Liam Paullbaseline-duckietownaido-LF-sim-validationsim-3of4failednodavinci-stage-03-6.2.500:01:01
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12330603Bea Baselines 🐤template-rosaido-LFV_multi-sim-validationsim-1of4successnodavinci-stage-03-6.2.500:05:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.099999999999994
in-drivable-lane_median7.449999999999995
driven_lanedir_consec_median0.3101641289560656
deviation-center-line_median0.1228640858276967


other stats
deviation-center-line_max0.22442374040851407
deviation-center-line_mean0.13533978559270748
deviation-center-line_min0.07120723030692246
deviation-heading_max1.4222394536376657
deviation-heading_mean0.8063940521879549
deviation-heading_median0.6623922969679286
deviation-heading_min0.47855216117829713
distance-from-start_max2.2565577671280805
distance-from-start_mean1.321620123492768
distance-from-start_median1.25293247149498
distance-from-start_min0.5240577838530315
driven_any_max2.3158592450136584
driven_any_mean1.3499137431801724
driven_any_median1.277999787809245
driven_any_min0.5277961520885406
driven_lanedir_consec_max0.997932900218044
driven_lanedir_consec_mean0.4380281458946768
driven_lanedir_consec_min0.1338514254485319
driven_lanedir_max0.997932900218044
driven_lanedir_mean0.4404216195304193
driven_lanedir_median0.3149510762275506
driven_lanedir_min0.1338514254485319
in-drivable-lane_max8.249999999999993
in-drivable-lane_mean7.149999999999996
in-drivable-lane_min5.449999999999999
per-episodes
details{"loop-000-ego0": {"driven_any": 2.3158592450136584, "survival_time": 9.099999999999994, "driven_lanedir": 0.20025597004637996, "in-drivable-lane": 7.4999999999999964, "deviation-heading": 1.4222394536376657, "distance-from-start": 2.2565577671280805, "deviation-center-line": 0.13040433329236092, "driven_lanedir_consec": 0.19068207550341}, "loop-000-ego1": {"driven_any": 1.2252159353613727, "survival_time": 9.099999999999994, "driven_lanedir": 0.1338514254485319, "in-drivable-lane": 8.249999999999993, "deviation-heading": 0.47855216117829713, "distance-from-start": 1.207473740948501, "deviation-center-line": 0.07120723030692246, "driven_lanedir_consec": 0.1338514254485319}, "loop-000-ego2": {"driven_any": 0.5277961520885406, "survival_time": 9.099999999999994, "driven_lanedir": 0.4296461824087212, "in-drivable-lane": 7.399999999999993, "deviation-heading": 0.5072028288227063, "distance-from-start": 0.5240577838530315, "deviation-center-line": 0.11532383836303248, "driven_lanedir_consec": 0.4296461824087212}, "loop-000-ego3": {"driven_any": 1.3307836402571174, "survival_time": 9.099999999999994, "driven_lanedir": 0.997932900218044, "in-drivable-lane": 5.449999999999999, "deviation-heading": 0.8175817651131507, "distance-from-start": 1.298391202041459, "deviation-center-line": 0.22442374040851407, "driven_lanedir_consec": 0.997932900218044}}
simulation-passed1
survival_time_max9.099999999999994
survival_time_mean9.099999999999994
survival_time_min9.099999999999994
No reset possible
12326604Bea Baselines 🐤template-rosaido-LFP-sim-validationsim-1of4successnodavinci-stage-03-6.2.500:02:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.850000000000001
in-drivable-lane_median0.8000000000000007
driven_lanedir_consec_median0.1467345438695904
deviation-center-line_median0.0676443600461756


other stats
deviation-center-line_max0.0676443600461756
deviation-center-line_mean0.0676443600461756
deviation-center-line_min0.0676443600461756
deviation-heading_max0.6793025860420425
deviation-heading_mean0.6793025860420425
deviation-heading_median0.6793025860420425
deviation-heading_min0.6793025860420425
distance-from-start_max0.2146276356725124
distance-from-start_mean0.2146276356725124
distance-from-start_median0.2146276356725124
distance-from-start_min0.2146276356725124
driven_any_max0.2150817482660284
driven_any_mean0.2150817482660284
driven_any_median0.2150817482660284
driven_any_min0.2150817482660284
driven_lanedir_consec_max0.1467345438695904
driven_lanedir_consec_mean0.1467345438695904
driven_lanedir_consec_min0.1467345438695904
driven_lanedir_max0.1467345438695904
driven_lanedir_mean0.1467345438695904
driven_lanedir_median0.1467345438695904
driven_lanedir_min0.1467345438695904
in-drivable-lane_max0.8000000000000007
in-drivable-lane_mean0.8000000000000007
in-drivable-lane_min0.8000000000000007
per-episodes
details{"loop-000-ego0": {"driven_any": 0.2150817482660284, "survival_time": 1.850000000000001, "driven_lanedir": 0.1467345438695904, "in-drivable-lane": 0.8000000000000007, "deviation-heading": 0.6793025860420425, "distance-from-start": 0.2146276356725124, "deviation-center-line": 0.0676443600461756, "driven_lanedir_consec": 0.1467345438695904}}
simulation-passed1
survival_time_max1.850000000000001
survival_time_mean1.850000000000001
survival_time_min1.850000000000001
No reset possible
12322604Bea Baselines 🐤template-rosaido-LFP-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.699999999999981
in-drivable-lane_median5.699999999999983
driven_lanedir_consec_median0.24101229645384947
deviation-center-line_median0.15246254802393522


other stats
deviation-center-line_max0.15246254802393522
deviation-center-line_mean0.15246254802393522
deviation-center-line_min0.15246254802393522
deviation-heading_max1.8022273587437536
deviation-heading_mean1.8022273587437536
deviation-heading_median1.8022273587437536
deviation-heading_min1.8022273587437536
distance-from-start_max1.9363788105973752
distance-from-start_mean1.9363788105973752
distance-from-start_median1.9363788105973752
distance-from-start_min1.9363788105973752
driven_any_max1.972818462535905
driven_any_mean1.972818462535905
driven_any_median1.972818462535905
driven_any_min1.972818462535905
driven_lanedir_consec_max0.24101229645384947
driven_lanedir_consec_mean0.24101229645384947
driven_lanedir_consec_min0.24101229645384947
driven_lanedir_max0.24101229645384947
driven_lanedir_mean0.24101229645384947
driven_lanedir_median0.24101229645384947
driven_lanedir_min0.24101229645384947
in-drivable-lane_max5.699999999999983
in-drivable-lane_mean5.699999999999983
in-drivable-lane_min5.699999999999983
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.972818462535905, "survival_time": 7.699999999999981, "driven_lanedir": 0.24101229645384947, "in-drivable-lane": 5.699999999999983, "deviation-heading": 1.8022273587437536, "distance-from-start": 1.9363788105973752, "deviation-center-line": 0.15246254802393522, "driven_lanedir_consec": 0.24101229645384947}}
simulation-passed1
survival_time_max7.699999999999981
survival_time_mean7.699999999999981
survival_time_min7.699999999999981
No reset possible
12319606Bea Baselines 🐤template-rosaido-LFVI-sim-validationsim-0of4host-errornodavinci-stage-03-6.2.500:01:32
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12313606Bea Baselines 🐤template-rosaido-LFVI-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:02:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12310605Bea Baselines 🐤template-rosaido-LFV-sim-validationsim-1of4timeoutnodavinci-stage-03-6.2.500:00:42
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12305606Bea Baselines 🐤template-rosaido-LFVI-sim-validationsim-1of4successnodavinci-stage-03-6.2.500:02:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.7500000000000009
in-drivable-lane_median0.0
driven_lanedir_consec_median0.18821329118548036
deviation-center-line_median0.1848533044455651


other stats
deviation-center-line_max0.1848533044455651
deviation-center-line_mean0.1848533044455651
deviation-center-line_min0.1848533044455651
deviation-heading_max0.9857057932227412
deviation-heading_mean0.9857057932227412
deviation-heading_median0.9857057932227412
deviation-heading_min0.9857057932227412
distance-from-start_max0.22017577212086972
distance-from-start_mean0.22017577212086972
distance-from-start_median0.22017577212086972
distance-from-start_min0.22017577212086972
driven_any_max0.2203154019033776
driven_any_mean0.2203154019033776
driven_any_median0.2203154019033776
driven_any_min0.2203154019033776
driven_lanedir_consec_max0.18821329118548036
driven_lanedir_consec_mean0.18821329118548036
driven_lanedir_consec_min0.18821329118548036
driven_lanedir_max0.18821329118548036
driven_lanedir_mean0.18821329118548036
driven_lanedir_median0.18821329118548036
driven_lanedir_min0.18821329118548036
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 0.2203154019033776, "survival_time": 1.7500000000000009, "driven_lanedir": 0.18821329118548036, "in-drivable-lane": 0.0, "deviation-heading": 0.9857057932227412, "distance-from-start": 0.22017577212086972, "deviation-center-line": 0.1848533044455651, "driven_lanedir_consec": 0.18821329118548036}}
simulation-passed1
survival_time_max1.7500000000000009
survival_time_mean1.7500000000000009
survival_time_min1.7500000000000009
No reset possible
12304607Bea Baselines 🐤template-rosaido-LFI-sim-validationsim-2of4host-errornodavinci-stage-03-6.2.500:00:13
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12303607Bea Baselines 🐤template-rosaido-LFI-sim-validationsim-3of4host-errornodavinci-stage-03-6.2.500:00:30
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12296610Bea Baselines 🐤template-rosaido-LFV_multi-sim-testingsim-1of4successnodavinci-stage-03-6.2.500:04:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.550000000000017
in-drivable-lane_median8.100000000000017
driven_lanedir_consec_median0.28786677823545403
deviation-center-line_median0.20446047911302567


other stats
deviation-center-line_max0.48573301081164166
deviation-center-line_mean0.255277120752262
deviation-center-line_min0.126454513971355
deviation-heading_max6.650532281316726
deviation-heading_mean2.419741552149293
deviation-heading_median1.327504963510994
deviation-heading_min0.3734240002584589
distance-from-start_max2.529282105534855
distance-from-start_mean1.495176910986857
distance-from-start_median1.725712769206286
distance-from-start_min2.482534153247273e-16
driven_any_max2.9432964880018884
driven_any_mean1.664214890240389
driven_any_median1.8567815364798077
driven_any_min5.2381470633517324e-14
driven_lanedir_consec_max0.6742002410352148
driven_lanedir_consec_mean0.3124834493765307
driven_lanedir_consec_min0.0
driven_lanedir_max0.6742002410352148
driven_lanedir_mean0.3124834493765307
driven_lanedir_median0.28786677823545403
driven_lanedir_min0.0
in-drivable-lane_max9.350000000000016
in-drivable-lane_mean6.3875000000000135
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 2.463616632327879, "survival_time": 10.550000000000017, "driven_lanedir": 0.6742002410352148, "in-drivable-lane": 7.650000000000018, "deviation-heading": 1.3895324203587898, "distance-from-start": 2.2151344151726016, "deviation-center-line": 0.27496861747697876, "driven_lanedir_consec": 0.6742002410352148}, "loop-000-ego1": {"driven_any": 1.2499464406317362, "survival_time": 10.550000000000017, "driven_lanedir": 0.24086797326156884, "in-drivable-lane": 9.350000000000016, "deviation-heading": 0.3734240002584589, "distance-from-start": 1.2362911232399705, "deviation-center-line": 0.126454513971355, "driven_lanedir_consec": 0.24086797326156884}, "loop-000-ego2": {"driven_any": 2.9432964880018884, "survival_time": 10.550000000000017, "driven_lanedir": 0.33486558320933923, "in-drivable-lane": 8.550000000000017, "deviation-heading": 1.265477506663198, "distance-from-start": 2.529282105534855, "deviation-center-line": 0.13395234074907256, "driven_lanedir_consec": 0.33486558320933923}, "loop-000-ego3": {"driven_any": 5.2381470633517324e-14, "survival_time": 10.550000000000017, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 6.650532281316726, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 0.48573301081164166, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max10.550000000000017
survival_time_mean10.550000000000017
survival_time_min10.550000000000017
No reset possible
12291611Bea Baselines 🐤template-rosaido-LFP-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.6499999999999986
in-drivable-lane_median1.5999999999999983
driven_lanedir_consec_median0.14295498202947443
deviation-center-line_median0.06866006065407756


other stats
deviation-center-line_max0.06866006065407756
deviation-center-line_mean0.06866006065407756
deviation-center-line_min0.06866006065407756
deviation-heading_max0.68537615795078
deviation-heading_mean0.68537615795078
deviation-heading_median0.68537615795078
deviation-heading_min0.68537615795078
distance-from-start_max0.4333025417402071
distance-from-start_mean0.4333025417402071
distance-from-start_median0.4333025417402071
distance-from-start_min0.4333025417402071
driven_any_max0.44736631771281704
driven_any_mean0.44736631771281704
driven_any_median0.44736631771281704
driven_any_min0.44736631771281704
driven_lanedir_consec_max0.14295498202947443
driven_lanedir_consec_mean0.14295498202947443
driven_lanedir_consec_min0.14295498202947443
driven_lanedir_max0.14295498202947443
driven_lanedir_mean0.14295498202947443
driven_lanedir_median0.14295498202947443
driven_lanedir_min0.14295498202947443
in-drivable-lane_max1.5999999999999983
in-drivable-lane_mean1.5999999999999983
in-drivable-lane_min1.5999999999999983
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.44736631771281704, "survival_time": 2.6499999999999986, "driven_lanedir": 0.14295498202947443, "in-drivable-lane": 1.5999999999999983, "deviation-heading": 0.68537615795078, "distance-from-start": 0.4333025417402071, "deviation-center-line": 0.06866006065407756, "driven_lanedir_consec": 0.14295498202947443}}
simulation-passed1
survival_time_max2.6499999999999986
survival_time_mean2.6499999999999986
survival_time_min2.6499999999999986
No reset possible
12285612Bea Baselines 🐤template-rosaido-LFV-sim-testingsim-0of4successnodavinci-stage-03-6.2.500:02:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.349999999999996
in-drivable-lane_median2.399999999999996
driven_lanedir_consec_median0.160249120092955
deviation-center-line_median0.06770946010368213


other stats
deviation-center-line_max0.06770946010368213
deviation-center-line_mean0.06770946010368213
deviation-center-line_min0.06770946010368213
deviation-heading_max0.5940808960073881
deviation-heading_mean0.5940808960073881
deviation-heading_median0.5940808960073881
deviation-heading_min0.5940808960073881
distance-from-start_max0.696064257852621
distance-from-start_mean0.696064257852621
distance-from-start_median0.696064257852621
distance-from-start_min0.696064257852621
driven_any_max0.7181439628563114
driven_any_mean0.7181439628563114
driven_any_median0.7181439628563114
driven_any_min0.7181439628563114
driven_lanedir_consec_max0.160249120092955
driven_lanedir_consec_mean0.160249120092955
driven_lanedir_consec_min0.160249120092955
driven_lanedir_max0.160249120092955
driven_lanedir_mean0.160249120092955
driven_lanedir_median0.160249120092955
driven_lanedir_min0.160249120092955
in-drivable-lane_max2.399999999999996
in-drivable-lane_mean2.399999999999996
in-drivable-lane_min2.399999999999996
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.7181439628563114, "survival_time": 3.349999999999996, "driven_lanedir": 0.160249120092955, "in-drivable-lane": 2.399999999999996, "deviation-heading": 0.5940808960073881, "distance-from-start": 0.696064257852621, "deviation-center-line": 0.06770946010368213, "driven_lanedir_consec": 0.160249120092955}}
simulation-passed1
survival_time_max3.349999999999996
survival_time_mean3.349999999999996
survival_time_min3.349999999999996
No reset possible
12282613Bea Baselines 🐤template-rosaido-LFVI-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:01:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12278614Bea Baselines 🐤template-rosaido-LFI-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12274615Bea Baselines 🐤template-rosaido-LF-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.16106214669598296
survival_time_median5.249999999999989
deviation-center-line_median0.08274011326024885
in-drivable-lane_median4.099999999999989


other stats
deviation-center-line_max0.08274011326024885
deviation-center-line_mean0.08274011326024885
deviation-center-line_min0.08274011326024885
deviation-heading_max0.7208881649450762
deviation-heading_mean0.7208881649450762
deviation-heading_median0.7208881649450762
deviation-heading_min0.7208881649450762
distance-from-start_max1.0945461274209445
distance-from-start_mean1.0945461274209445
distance-from-start_median1.0945461274209445
distance-from-start_min1.0945461274209445
driven_any_max1.1985949082154297
driven_any_mean1.1985949082154297
driven_any_median1.1985949082154297
driven_any_min1.1985949082154297
driven_lanedir_consec_max0.16106214669598296
driven_lanedir_consec_mean0.16106214669598296
driven_lanedir_consec_min0.16106214669598296
driven_lanedir_max0.16106214669598296
driven_lanedir_mean0.16106214669598296
driven_lanedir_median0.16106214669598296
driven_lanedir_min0.16106214669598296
in-drivable-lane_max4.099999999999989
in-drivable-lane_mean4.099999999999989
in-drivable-lane_min4.099999999999989
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.1985949082154297, "survival_time": 5.249999999999989, "driven_lanedir": 0.16106214669598296, "in-drivable-lane": 4.099999999999989, "deviation-heading": 0.7208881649450762, "distance-from-start": 1.0945461274209445, "deviation-center-line": 0.08274011326024885, "driven_lanedir_consec": 0.16106214669598296}}
simulation-passed1
survival_time_max5.249999999999989
survival_time_mean5.249999999999989
survival_time_min5.249999999999989
No reset possible
12272616Bea Baselines 🐤template-rosaido-LFVI_multi-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:02:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12261618Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-validationsim-0of4successnodavinci-stage-03-6.2.500:18:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median35.57499999999889
driven_lanedir_consec_median1.5686314136092314
deviation-center-line_median1.8701958276914077


other stats
deviation-center-line_max3.0109101605131956
deviation-center-line_mean1.72987034724517
deviation-center-line_min0.1681795730846681
deviation-heading_max21.787049821048157
deviation-heading_mean11.781558216528074
deviation-heading_median11.59907351236297
deviation-heading_min2.141036020338203
distance-from-start_max2.484912918573514
distance-from-start_mean1.496362605544541
distance-from-start_median1.508814687129707
distance-from-start_min0.48290812934523614
driven_any_max7.913906897941906
driven_any_mean3.7201676647409254
driven_any_median2.8886536891018495
driven_any_min1.1894563828180975
driven_lanedir_consec_max3.010776339028627
driven_lanedir_consec_mean1.587466575515874
driven_lanedir_consec_min0.2018271358164072
driven_lanedir_max3.9004475661369296
driven_lanedir_mean1.9264523483669305
driven_lanedir_median1.8017673457571923
driven_lanedir_min0.2018271358164072
in-drivable-lane_max57.19999999999873
in-drivable-lane_mean32.76249999999912
in-drivable-lane_min2.6999999999999904
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.1894563828180975, "survival_time": 59.99999999999873, "driven_lanedir": 0.2018271358164072, "in-drivable-lane": 57.19999999999873, "deviation-heading": 2.141036020338203, "distance-from-start": 0.6436557867474002, "deviation-center-line": 0.1681795730846681, "driven_lanedir_consec": 0.2018271358164072}, "autolab-000-ego1": {"driven_any": 7.913906897941906, "survival_time": 59.99999999999873, "driven_lanedir": 3.9004475661369296, "in-drivable-lane": 23.699999999999147, "deviation-heading": 16.552815888634974, "distance-from-start": 2.484912918573514, "deviation-center-line": 3.0109101605131956, "driven_lanedir_consec": 3.010776339028627}, "autolab-000-ego2": {"driven_any": 2.8889847902923487, "survival_time": 59.99999999999873, "driven_lanedir": 2.302236975900124, "in-drivable-lane": 2.6999999999999904, "deviation-heading": 21.787049821048157, "distance-from-start": 2.373973587512014, "deviation-center-line": 2.372656921589496, "driven_lanedir_consec": 2.302236975900124}, "autolab-000-ego3": {"driven_any": 2.8883225879113503, "survival_time": 59.99999999999873, "driven_lanedir": 1.3012977156142609, "in-drivable-lane": 47.44999999999863, "deviation-heading": 6.645331136090965, "distance-from-start": 0.48290812934523614, "deviation-center-line": 1.3677347337933194, "driven_lanedir_consec": 0.8350258513183388}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12260619Bea Baselines 🐤baseline-duckietownaido-LFP-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:03:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.100000000000035
in-drivable-lane_median1.4500000000000206
driven_lanedir_consec_median1.3012432230071151
deviation-center-line_median0.5048288224019527


other stats
deviation-center-line_max0.5048288224019527
deviation-center-line_mean0.5048288224019527
deviation-center-line_min0.5048288224019527
deviation-heading_max2.2201205962299486
deviation-heading_mean2.2201205962299486
deviation-heading_median2.2201205962299486
deviation-heading_min2.2201205962299486
distance-from-start_max0.943342282469477
distance-from-start_mean0.943342282469477
distance-from-start_median0.943342282469477
distance-from-start_min0.943342282469477
driven_any_max1.455155374608842
driven_any_mean1.455155374608842
driven_any_median1.455155374608842
driven_any_min1.455155374608842
driven_lanedir_consec_max1.3012432230071151
driven_lanedir_consec_mean1.3012432230071151
driven_lanedir_consec_min1.3012432230071151
driven_lanedir_max1.3012432230071151
driven_lanedir_mean1.3012432230071151
driven_lanedir_median1.3012432230071151
driven_lanedir_min1.3012432230071151
in-drivable-lane_max1.4500000000000206
in-drivable-lane_mean1.4500000000000206
in-drivable-lane_min1.4500000000000206
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.455155374608842, "survival_time": 12.100000000000035, "driven_lanedir": 1.3012432230071151, "in-drivable-lane": 1.4500000000000206, "deviation-heading": 2.2201205962299486, "distance-from-start": 0.943342282469477, "deviation-center-line": 0.5048288224019527, "driven_lanedir_consec": 1.3012432230071151}}
simulation-passed1
survival_time_max12.100000000000035
survival_time_mean12.100000000000035
survival_time_min12.100000000000035
No reset possible
12258619Bea Baselines 🐤baseline-duckietownaido-LFP-sim-validationsim-1of4successnodavinci-stage-03-6.2.500:01:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.949999999999983
in-drivable-lane_median1.999999999999993
driven_lanedir_consec_median0.5570742685403363
deviation-center-line_median0.3707385968090875


other stats
deviation-center-line_max0.3707385968090875
deviation-center-line_mean0.3707385968090875
deviation-center-line_min0.3707385968090875
deviation-heading_max1.587657768321124
deviation-heading_mean1.587657768321124
deviation-heading_median1.587657768321124
deviation-heading_min1.587657768321124
distance-from-start_max0.5522446523093012
distance-from-start_mean0.5522446523093012
distance-from-start_median0.5522446523093012
distance-from-start_min0.5522446523093012
driven_any_max0.7713535235268951
driven_any_mean0.7713535235268951
driven_any_median0.7713535235268951
driven_any_min0.7713535235268951
driven_lanedir_consec_max0.5570742685403363
driven_lanedir_consec_mean0.5570742685403363
driven_lanedir_consec_min0.5570742685403363
driven_lanedir_max0.5570742685403363
driven_lanedir_mean0.5570742685403363
driven_lanedir_median0.5570742685403363
driven_lanedir_min0.5570742685403363
in-drivable-lane_max1.999999999999993
in-drivable-lane_mean1.999999999999993
in-drivable-lane_min1.999999999999993
per-episodes
details{"loop-000-ego0": {"driven_any": 0.7713535235268951, "survival_time": 6.949999999999983, "driven_lanedir": 0.5570742685403363, "in-drivable-lane": 1.999999999999993, "deviation-heading": 1.587657768321124, "distance-from-start": 0.5522446523093012, "deviation-center-line": 0.3707385968090875, "driven_lanedir_consec": 0.5570742685403363}}
simulation-passed1
survival_time_max6.949999999999983
survival_time_mean6.949999999999983
survival_time_min6.949999999999983
No reset possible
12257619Bea Baselines 🐤baseline-duckietownaido-LFP-sim-validationsim-0of4successnodavinci-stage-03-6.2.500:02:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.850000000000032
in-drivable-lane_median0.0
driven_lanedir_consec_median1.3223779525671524
deviation-center-line_median0.8190293061520778


other stats
deviation-center-line_max0.8190293061520778
deviation-center-line_mean0.8190293061520778
deviation-center-line_min0.8190293061520778
deviation-heading_max3.798654602226047
deviation-heading_mean3.798654602226047
deviation-heading_median3.798654602226047
deviation-heading_min3.798654602226047
distance-from-start_max1.1528114208076143
distance-from-start_mean1.1528114208076143
distance-from-start_median1.1528114208076143
distance-from-start_min1.1528114208076143
driven_any_max1.4219587303336996
driven_any_mean1.4219587303336996
driven_any_median1.4219587303336996
driven_any_min1.4219587303336996
driven_lanedir_consec_max1.3223779525671524
driven_lanedir_consec_mean1.3223779525671524
driven_lanedir_consec_min1.3223779525671524
driven_lanedir_max1.3223779525671524
driven_lanedir_mean1.3223779525671524
driven_lanedir_median1.3223779525671524
driven_lanedir_min1.3223779525671524
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.4219587303336996, "survival_time": 11.850000000000032, "driven_lanedir": 1.3223779525671524, "in-drivable-lane": 0.0, "deviation-heading": 3.798654602226047, "distance-from-start": 1.1528114208076143, "deviation-center-line": 0.8190293061520778, "driven_lanedir_consec": 1.3223779525671524}}
simulation-passed1
survival_time_max11.850000000000032
survival_time_mean11.850000000000032
survival_time_min11.850000000000032
No reset possible
12254620Bea Baselines 🐤baseline-duckietownaido-LFV-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:02:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.699999999999981
in-drivable-lane_median2.79999999999999
driven_lanedir_consec_median0.5376639635670735
deviation-center-line_median0.36822222552737266


other stats
deviation-center-line_max0.36822222552737266
deviation-center-line_mean0.36822222552737266
deviation-center-line_min0.36822222552737266
deviation-heading_max1.9566364034715655
deviation-heading_mean1.9566364034715655
deviation-heading_median1.9566364034715655
deviation-heading_min1.9566364034715655
distance-from-start_max0.6524382775630447
distance-from-start_mean0.6524382775630447
distance-from-start_median0.6524382775630447
distance-from-start_min0.6524382775630447
driven_any_max0.8775652264988152
driven_any_mean0.8775652264988152
driven_any_median0.8775652264988152
driven_any_min0.8775652264988152
driven_lanedir_consec_max0.5376639635670735
driven_lanedir_consec_mean0.5376639635670735
driven_lanedir_consec_min0.5376639635670735
driven_lanedir_max0.5376639635670735
driven_lanedir_mean0.5376639635670735
driven_lanedir_median0.5376639635670735
driven_lanedir_min0.5376639635670735
in-drivable-lane_max2.79999999999999
in-drivable-lane_mean2.79999999999999
in-drivable-lane_min2.79999999999999
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.8775652264988152, "survival_time": 7.699999999999981, "driven_lanedir": 0.5376639635670735, "in-drivable-lane": 2.79999999999999, "deviation-heading": 1.9566364034715655, "distance-from-start": 0.6524382775630447, "deviation-center-line": 0.36822222552737266, "driven_lanedir_consec": 0.5376639635670735}}
simulation-passed1
survival_time_max7.699999999999981
survival_time_mean7.699999999999981
survival_time_min7.699999999999981
No reset possible
12250621Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-validationsim-0of4successnodavinci-stage-03-6.2.500:02:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.799999999999991
in-drivable-lane_median0.0
driven_lanedir_consec_median0.4775155901477164
deviation-center-line_median0.3476476714162331


other stats
deviation-center-line_max0.3476476714162331
deviation-center-line_mean0.3476476714162331
deviation-center-line_min0.3476476714162331
deviation-heading_max1.2035650230865975
deviation-heading_mean1.2035650230865975
deviation-heading_median1.2035650230865975
deviation-heading_min1.2035650230865975
distance-from-start_max0.4845304754289468
distance-from-start_mean0.4845304754289468
distance-from-start_median0.4845304754289468
distance-from-start_min0.4845304754289468
driven_any_max0.4925823555463037
driven_any_mean0.4925823555463037
driven_any_median0.4925823555463037
driven_any_min0.4925823555463037
driven_lanedir_consec_max0.4775155901477164
driven_lanedir_consec_mean0.4775155901477164
driven_lanedir_consec_min0.4775155901477164
driven_lanedir_max0.4775160175836213
driven_lanedir_mean0.4775160175836213
driven_lanedir_median0.4775160175836213
driven_lanedir_min0.4775160175836213
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 0.4925823555463037, "survival_time": 4.799999999999991, "driven_lanedir": 0.4775160175836213, "in-drivable-lane": 0.0, "deviation-heading": 1.2035650230865975, "distance-from-start": 0.4845304754289468, "deviation-center-line": 0.3476476714162331, "driven_lanedir_consec": 0.4775155901477164}}
simulation-passed1
survival_time_max4.799999999999991
survival_time_mean4.799999999999991
survival_time_min4.799999999999991
No reset possible
12245622Bea Baselines 🐤baseline-duckietownaido-LFI-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:03:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12237625Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:18:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median58.34999999999882
in-drivable-lane_median6.974999999999786
driven_lanedir_consec_median1.174271538776326
deviation-center-line_median3.4061414029329624


other stats
deviation-center-line_max5.826513338519068
deviation-center-line_mean3.208835151697427
deviation-center-line_min0.19654446240471515
deviation-heading_max39.1504541083713
deviation-heading_mean23.33191849325167
deviation-heading_median25.896389272851422
deviation-heading_min2.3844413189325233
distance-from-start_max2.839456856662
distance-from-start_mean1.2453047891358089
distance-from-start_median1.0633393557730173
distance-from-start_min0.015083588335200394
driven_any_max7.601581908306041
driven_any_mean2.678171794555247
driven_any_median1.5480102248852998
driven_any_min0.015084820144347024
driven_lanedir_consec_max3.6499251922163944
driven_lanedir_consec_mean1.502540810436394
driven_lanedir_consec_min0.011694971976528912
driven_lanedir_max4.886777916829633
driven_lanedir_mean1.8117539915897032
driven_lanedir_median1.174271538776326
driven_lanedir_min0.011694971976528912
in-drivable-lane_max53.79999999999883
in-drivable-lane_mean16.937499999999602
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.9704862282670048, "survival_time": 58.34999999999882, "driven_lanedir": 0.4502135585853648, "in-drivable-lane": 53.79999999999883, "deviation-heading": 2.3844413189325233, "distance-from-start": 0.6838890816362035, "deviation-center-line": 0.19654446240471515, "driven_lanedir_consec": 0.4502135585853648}, "zigzag-000-ego1": {"driven_any": 7.601581908306041, "survival_time": 58.34999999999882, "driven_lanedir": 4.886777916829633, "in-drivable-lane": 13.399999999999563, "deviation-heading": 21.00551488738858, "distance-from-start": 2.839456856662, "deviation-center-line": 3.207911687772638, "driven_lanedir_consec": 3.6499251922163944}, "zigzag-000-ego2": {"driven_any": 2.1255342215035946, "survival_time": 58.34999999999882, "driven_lanedir": 1.8983295189672873, "in-drivable-lane": 0.5500000000000078, "deviation-heading": 30.787263658314274, "distance-from-start": 1.4427896299098308, "deviation-center-line": 5.826513338519068, "driven_lanedir_consec": 1.8983295189672873}, "zigzag-000-ego3": {"driven_any": 0.015084820144347024, "survival_time": 58.34999999999882, "driven_lanedir": 0.011694971976528912, "in-drivable-lane": 0.0, "deviation-heading": 39.1504541083713, "distance-from-start": 0.015083588335200394, "deviation-center-line": 3.604371118093287, "driven_lanedir_consec": 0.011694971976528912}}
simulation-passed1
survival_time_max58.34999999999882
survival_time_mean58.34999999999882
survival_time_min58.34999999999882
No reset possible
12233626Bea Baselines 🐤baseline-duckietownaido-LFP-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:03:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median40.64999999999983
in-drivable-lane_median7.700000000000037
driven_lanedir_consec_median3.3160654465748483
deviation-center-line_median3.096172083413612


other stats
deviation-center-line_max3.096172083413612
deviation-center-line_mean3.096172083413612
deviation-center-line_min3.096172083413612
deviation-heading_max7.361567012532922
deviation-heading_mean7.361567012532922
deviation-heading_median7.361567012532922
deviation-heading_min7.361567012532922
distance-from-start_max1.4581057072074524
distance-from-start_mean1.4581057072074524
distance-from-start_median1.4581057072074524
distance-from-start_min1.4581057072074524
driven_any_max5.245715117527565
driven_any_mean5.245715117527565
driven_any_median5.245715117527565
driven_any_min5.245715117527565
driven_lanedir_consec_max3.3160654465748483
driven_lanedir_consec_mean3.3160654465748483
driven_lanedir_consec_min3.3160654465748483
driven_lanedir_max4.047368348977071
driven_lanedir_mean4.047368348977071
driven_lanedir_median4.047368348977071
driven_lanedir_min4.047368348977071
in-drivable-lane_max7.700000000000037
in-drivable-lane_mean7.700000000000037
in-drivable-lane_min7.700000000000037
per-episodes
details{"loop2-000-ego0": {"driven_any": 5.245715117527565, "survival_time": 40.64999999999983, "driven_lanedir": 4.047368348977071, "in-drivable-lane": 7.700000000000037, "deviation-heading": 7.361567012532922, "distance-from-start": 1.4581057072074524, "deviation-center-line": 3.096172083413612, "driven_lanedir_consec": 3.3160654465748483}}
simulation-passed1
survival_time_max40.64999999999983
survival_time_mean40.64999999999983
survival_time_min40.64999999999983
No reset possible
12228628Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-testingsim-0of4successnodavinci-stage-03-6.2.500:04:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median15.950000000000092
in-drivable-lane_median1.6500000000000157
driven_lanedir_consec_median0.9914589093392572
deviation-center-line_median0.8327383340934943


other stats
deviation-center-line_max0.8327383340934943
deviation-center-line_mean0.8327383340934943
deviation-center-line_min0.8327383340934943
deviation-heading_max4.670576974992892
deviation-heading_mean4.670576974992892
deviation-heading_median4.670576974992892
deviation-heading_min4.670576974992892
distance-from-start_max0.7186760154458448
distance-from-start_mean0.7186760154458448
distance-from-start_median0.7186760154458448
distance-from-start_min0.7186760154458448
driven_any_max1.9728302382251155
driven_any_mean1.9728302382251155
driven_any_median1.9728302382251155
driven_any_min1.9728302382251155
driven_lanedir_consec_max0.9914589093392572
driven_lanedir_consec_mean0.9914589093392572
driven_lanedir_consec_min0.9914589093392572
driven_lanedir_max1.605356791400706
driven_lanedir_mean1.605356791400706
driven_lanedir_median1.605356791400706
driven_lanedir_min1.605356791400706
in-drivable-lane_max1.6500000000000157
in-drivable-lane_mean1.6500000000000157
in-drivable-lane_min1.6500000000000157
per-episodes
details{"udem-000-ego0": {"driven_any": 1.9728302382251155, "survival_time": 15.950000000000092, "driven_lanedir": 1.605356791400706, "in-drivable-lane": 1.6500000000000157, "deviation-heading": 4.670576974992892, "distance-from-start": 0.7186760154458448, "deviation-center-line": 0.8327383340934943, "driven_lanedir_consec": 0.9914589093392572}}
simulation-passed1
survival_time_max15.950000000000092
survival_time_mean15.950000000000092
survival_time_min15.950000000000092
No reset possible
12224629Bea Baselines 🐤baseline-duckietownaido-LFI-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12221629Bea Baselines 🐤baseline-duckietownaido-LFI-sim-testingsim-1of4successnodavinci-stage-03-6.2.500:02:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.799999999999987
in-drivable-lane_median1.8499999999999943
driven_lanedir_consec_median0.12513315069145392
deviation-center-line_median0.3726307704697286


other stats
deviation-center-line_max0.3726307704697286
deviation-center-line_mean0.3726307704697286
deviation-center-line_min0.3726307704697286
deviation-heading_max3.7321524404297066
deviation-heading_mean3.7321524404297066
deviation-heading_median3.7321524404297066
deviation-heading_min3.7321524404297066
distance-from-start_max0.1860380819715683
distance-from-start_mean0.1860380819715683
distance-from-start_median0.1860380819715683
distance-from-start_min0.1860380819715683
driven_any_max0.6186165246921508
driven_any_mean0.6186165246921508
driven_any_median0.6186165246921508
driven_any_min0.6186165246921508
driven_lanedir_consec_max0.12513315069145392
driven_lanedir_consec_mean0.12513315069145392
driven_lanedir_consec_min0.12513315069145392
driven_lanedir_max0.2414209363552926
driven_lanedir_mean0.2414209363552926
driven_lanedir_median0.2414209363552926
driven_lanedir_min0.2414209363552926
in-drivable-lane_max1.8499999999999943
in-drivable-lane_mean1.8499999999999943
in-drivable-lane_min1.8499999999999943
per-episodes
details{"udem1-000-ego0": {"driven_any": 0.6186165246921508, "survival_time": 5.799999999999987, "driven_lanedir": 0.2414209363552926, "in-drivable-lane": 1.8499999999999943, "deviation-heading": 3.7321524404297066, "distance-from-start": 0.1860380819715683, "deviation-center-line": 0.3726307704697286, "driven_lanedir_consec": 0.12513315069145392}}
simulation-passed1
survival_time_max5.799999999999987
survival_time_mean5.799999999999987
survival_time_min5.799999999999987
No reset possible
12218630Bea Baselines 🐤baseline-duckietownaido-LF-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:05:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.2992934026761365
survival_time_median59.99999999999873
deviation-center-line_median5.270247704220562
in-drivable-lane_median10.199999999999768


other stats
deviation-center-line_max5.270247704220562
deviation-center-line_mean5.270247704220562
deviation-center-line_min5.270247704220562
deviation-heading_max15.070297606601248
deviation-heading_mean15.070297606601248
deviation-heading_median15.070297606601248
deviation-heading_min15.070297606601248
distance-from-start_max1.0743912233495676
distance-from-start_mean1.0743912233495676
distance-from-start_median1.0743912233495676
distance-from-start_min1.0743912233495676
driven_any_max7.9074567437712915
driven_any_mean7.9074567437712915
driven_any_median7.9074567437712915
driven_any_min7.9074567437712915
driven_lanedir_consec_max5.2992934026761365
driven_lanedir_consec_mean5.2992934026761365
driven_lanedir_consec_min5.2992934026761365
driven_lanedir_max5.986803144221188
driven_lanedir_mean5.986803144221188
driven_lanedir_median5.986803144221188
driven_lanedir_min5.986803144221188
in-drivable-lane_max10.199999999999768
in-drivable-lane_mean10.199999999999768
in-drivable-lane_min10.199999999999768
per-episodes
details{"loop2-000-ego0": {"driven_any": 7.9074567437712915, "survival_time": 59.99999999999873, "driven_lanedir": 5.986803144221188, "in-drivable-lane": 10.199999999999768, "deviation-heading": 15.070297606601248, "distance-from-start": 1.0743912233495676, "deviation-center-line": 5.270247704220562, "driven_lanedir_consec": 5.2992934026761365}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12214631Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12208660Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-validationsim-3of4failednodavinci-stage-03-6.2.500:01:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12204663Bea Baselines 🐤template-tensorflowaido-LFVI-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12200664Bea Baselines 🐤template-tensorflowaido-LFI-sim-validationsim-1of4failednodavinci-stage-03-6.2.500:01:24
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12196665Bea Baselines 🐤template-tensorflowaido-LF-sim-validationsim-3of4failednodavinci-stage-03-6.2.500:00:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12191666Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12187667Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-testingsim-3of4failednodavinci-stage-03-6.2.500:01:18
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12184668Bea Baselines 🐤template-tensorflowaido-LFP-sim-testingsim-2of4failednodavinci-stage-03-6.2.500:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12178669Bea Baselines 🐤template-tensorflowaido-LFV-sim-testingsim-2of4failednodavinci-stage-03-6.2.500:02:09
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12175670Bea Baselines 🐤template-tensorflowaido-LFVI-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12172670Bea Baselines 🐤template-tensorflowaido-LFVI-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12162703Bea Baselines 🐤template-randomaido-LFV_multi-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:07:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median20.70000000000016
in-drivable-lane_median15.50000000000015
driven_lanedir_consec_median0.2523502432780965
deviation-center-line_median0.4270318356067208


other stats
deviation-center-line_max2.4472420705619533
deviation-center-line_mean0.834439744050357
deviation-center-line_min0.03645323442603294
deviation-heading_max5.758343124435709
deviation-heading_mean2.9647842264649227
deviation-heading_median2.4959523963356456
deviation-heading_min1.1088889887526905
distance-from-start_max0.735788357677379
distance-from-start_mean0.4455427430503656
distance-from-start_median0.3918367385500151
distance-from-start_min0.26270913742405294
driven_any_max5.001991003394667
driven_any_mean1.5256410869454424
driven_any_median0.4116848275607308
driven_any_min0.277203689265641
driven_lanedir_consec_max0.2737815745175769
driven_lanedir_consec_mean0.21260926710351993
driven_lanedir_consec_min0.07195500734030984
driven_lanedir_max0.25840198320624896
driven_lanedir_mean0.2081068961174864
driven_lanedir_median0.25103529696169347
driven_lanedir_min0.07195500734030984
in-drivable-lane_max19.05000000000016
in-drivable-lane_mean12.737500000000114
in-drivable-lane_min0.8999999999999998
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.001991003394667, "survival_time": 20.70000000000016, "driven_lanedir": 0.25577209057344286, "in-drivable-lane": 12.150000000000135, "deviation-heading": 5.758343124435709, "distance-from-start": 0.735788357677379, "deviation-center-line": 0.7687325001714215, "driven_lanedir_consec": 0.2737815745175769}, "zigzag-000-ego1": {"driven_any": 0.27720368926578076, "survival_time": 20.70000000000016, "driven_lanedir": 0.24629850334994408, "in-drivable-lane": 18.85000000000016, "deviation-heading": 1.2379708953066022, "distance-from-start": 0.26270913742405294, "deviation-center-line": 0.08533117104202012, "driven_lanedir_consec": 0.24629850334994408}, "zigzag-000-ego2": {"driven_any": 0.277203689265641, "survival_time": 20.70000000000016, "driven_lanedir": 0.25840198320624896, "in-drivable-lane": 0.8999999999999998, "deviation-heading": 3.7539338973646887, "distance-from-start": 0.262709137424054, "deviation-center-line": 2.4472420705619533, "driven_lanedir_consec": 0.25840198320624896}, "zigzag-000-ego3": {"driven_any": 0.5461659658556808, "survival_time": 20.70000000000016, "driven_lanedir": 0.07195500734030984, "in-drivable-lane": 19.05000000000016, "deviation-heading": 1.1088889887526905, "distance-from-start": 0.5209643396759762, "deviation-center-line": 0.03645323442603294, "driven_lanedir_consec": 0.07195500734030984}}
simulation-passed1
survival_time_max20.70000000000016
survival_time_mean20.70000000000016
survival_time_min20.70000000000016
No reset possible
12157704Bea Baselines 🐤template-randomaido-LFP-sim-validationsim-1of4successnodavinci-stage-03-6.2.500:04:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median32.600000000000286
in-drivable-lane_median24.050000000000264
driven_lanedir_consec_median0.2676461536739756
deviation-center-line_median0.7555294413118671


other stats
deviation-center-line_max0.7555294413118671
deviation-center-line_mean0.7555294413118671
deviation-center-line_min0.7555294413118671
deviation-heading_max5.523299093945129
deviation-heading_mean5.523299093945129
deviation-heading_median5.523299093945129
deviation-heading_min5.523299093945129
distance-from-start_max0.9340577697896372
distance-from-start_mean0.9340577697896372
distance-from-start_median0.9340577697896372
distance-from-start_min0.9340577697896372
driven_any_max8.050205698618822
driven_any_mean8.050205698618822
driven_any_median8.050205698618822
driven_any_min8.050205698618822
driven_lanedir_consec_max0.2676461536739756
driven_lanedir_consec_mean0.2676461536739756
driven_lanedir_consec_min0.2676461536739756
driven_lanedir_max0.2496366697298575
driven_lanedir_mean0.2496366697298575
driven_lanedir_median0.2496366697298575
driven_lanedir_min0.2496366697298575
in-drivable-lane_max24.050000000000264
in-drivable-lane_mean24.050000000000264
in-drivable-lane_min24.050000000000264
per-episodes
details{"loop-000-ego0": {"driven_any": 8.050205698618822, "survival_time": 32.600000000000286, "driven_lanedir": 0.2496366697298575, "in-drivable-lane": 24.050000000000264, "deviation-heading": 5.523299093945129, "distance-from-start": 0.9340577697896372, "deviation-center-line": 0.7555294413118671, "driven_lanedir_consec": 0.2676461536739756}}
simulation-passed1
survival_time_max32.600000000000286
survival_time_mean32.600000000000286
survival_time_min32.600000000000286
No reset possible
12154706Bea Baselines 🐤template-randomaido-LFVI-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12148708Bea Baselines 🐤template-randomaido-LF-sim-validationsim-1of4successnodavinci-stage-03-6.2.500:06:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2718431750312411
survival_time_median45.099999999999575
deviation-center-line_median0.765552090953893
in-drivable-lane_median36.54999999999956


other stats
deviation-center-line_max0.765552090953893
deviation-center-line_mean0.765552090953893
deviation-center-line_min0.765552090953893
deviation-heading_max5.708723015945327
deviation-heading_mean5.708723015945327
deviation-heading_median5.708723015945327
deviation-heading_min5.708723015945327
distance-from-start_max1.0442247976691916
distance-from-start_mean1.0442247976691916
distance-from-start_median1.0442247976691916
distance-from-start_min1.0442247976691916
driven_any_max11.376062002465076
driven_any_mean11.376062002465076
driven_any_median11.376062002465076
driven_any_min11.376062002465076
driven_lanedir_consec_max0.2718431750312411
driven_lanedir_consec_mean0.2718431750312411
driven_lanedir_consec_min0.2718431750312411
driven_lanedir_max0.25383249899423177
driven_lanedir_mean0.25383249899423177
driven_lanedir_median0.25383249899423177
driven_lanedir_min0.25383249899423177
in-drivable-lane_max36.54999999999956
in-drivable-lane_mean36.54999999999956
in-drivable-lane_min36.54999999999956
per-episodes
details{"loop-000-ego0": {"driven_any": 11.376062002465076, "survival_time": 45.099999999999575, "driven_lanedir": 0.25383249899423177, "in-drivable-lane": 36.54999999999956, "deviation-heading": 5.708723015945327, "distance-from-start": 1.0442247976691916, "deviation-center-line": 0.765552090953893, "driven_lanedir_consec": 0.2718431750312411}}
simulation-passed1
survival_time_max45.099999999999575
survival_time_mean45.099999999999575
survival_time_min45.099999999999575
No reset possible
12137710Bea Baselines 🐤template-randomaido-LFV_multi-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:23:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median50.54999999999893
driven_lanedir_consec_median0.010547930232535654
deviation-center-line_median0.8332713496515217


other stats
deviation-center-line_max2.7624735124852213
deviation-center-line_mean1.2534966840273465
deviation-center-line_min0.5849705243211205
deviation-heading_max37.85352281193537
deviation-heading_mean13.74892880994846
deviation-heading_median6.255913446760742
deviation-heading_min4.63036553433699
distance-from-start_max1.4108418329398922
distance-from-start_mean0.7664936116527056
distance-from-start_median0.8275663068354648
distance-from-start_min4.965068306494546e-16
driven_any_max15.326310847370552
driven_any_mean7.179006617535183
driven_any_median6.694857811384825
driven_any_min5.328713280502633e-13
driven_lanedir_consec_max0.1383364895771639
driven_lanedir_consec_mean0.03978656193682834
driven_lanedir_consec_min-0.000286102294921875
driven_lanedir_max0.11398132258212844
driven_lanedir_mean0.031025259247181865
driven_lanedir_median0.00774466889682357
driven_lanedir_min-0.005369623387048134
in-drivable-lane_max53.849999999998694
in-drivable-lane_mean38.73749999999914
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.689235011240985, "survival_time": 59.99999999999873, "driven_lanedir": 0.015775440088569015, "in-drivable-lane": 53.74999999999868, "deviation-heading": 4.775258835818575, "distance-from-start": 0.7727279384518404, "deviation-center-line": 0.5849705243211205, "driven_lanedir_consec": 0.012429097989935078}, "zigzag-000-ego1": {"driven_any": 7.700480611528665, "survival_time": 59.99999999999873, "driven_lanedir": 0.11398132258212844, "in-drivable-lane": 53.849999999998694, "deviation-heading": 4.63036553433699, "distance-from-start": 0.8824046752190894, "deviation-center-line": 0.597954121505881, "driven_lanedir_consec": 0.1383364895771639}, "zigzag-000-ego2": {"driven_any": 15.326310847370552, "survival_time": 59.99999999999873, "driven_lanedir": -0.005369623387048134, "in-drivable-lane": 47.34999999999918, "deviation-heading": 7.736568057702908, "distance-from-start": 1.4108418329398922, "deviation-center-line": 1.0685885777971624, "driven_lanedir_consec": 0.00866676247513623}, "zigzag-000-ego3": {"driven_any": 5.328713280502633e-13, "survival_time": 59.99999999999873, "driven_lanedir": -0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 37.85352281193537, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 2.7624735124852213, "driven_lanedir_consec": -0.000286102294921875}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12134710Bea Baselines 🐤template-randomaido-LFV_multi-sim-testingsim-2of4host-errornodavinci-stage-03-6.2.500:05:13
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1312, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 423, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1156, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12114716Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-1of4successnodavinci-stage-03-6.2.500:19:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median48.99999999999935
in-drivable-lane_median38.499999999999304
driven_lanedir_consec_median0.1764110638479598
deviation-center-line_median0.9531427784471488


other stats
deviation-center-line_max2.832529886995349
deviation-center-line_mean1.311943853353024
deviation-center-line_min0.5089599695224504
deviation-heading_max33.1589668039187
deviation-heading_mean12.62594009217387
deviation-heading_median7.392834811631175
deviation-heading_min2.5591239415144273
distance-from-start_max1.1376277719266368
distance-from-start_mean0.654460762413978
distance-from-start_median0.7401076388646376
distance-from-start_min2.220446049250313e-16
driven_any_max12.38395710263782
driven_any_mean5.860243976176914
driven_any_median5.528509401034555
driven_any_min7.240401296455718e-13
driven_lanedir_consec_max0.24555159589762132
driven_lanedir_consec_mean0.14959343089838523
driven_lanedir_consec_min0.0
driven_lanedir_max0.23581644060907703
driven_lanedir_mean0.14279539215489673
driven_lanedir_median0.16768256400525494
driven_lanedir_min0.0
in-drivable-lane_max43.94999999999935
in-drivable-lane_mean30.23749999999949
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 8.61801250372655, "survival_time": 48.99999999999935, "driven_lanedir": 0.23581644060907703, "in-drivable-lane": 34.99999999999926, "deviation-heading": 9.90660072624876, "distance-from-start": 0.9340577697896248, "deviation-center-line": 1.391984666848221, "driven_lanedir_consec": 0.24555159589762132}, "4way-000-ego1": {"driven_any": 7.240401296455718e-13, "survival_time": 48.99999999999935, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 33.1589668039187, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 2.832529886995349, "driven_lanedir_consec": 0.0}, "4way-000-ego2": {"driven_any": 2.4390062983425596, "survival_time": 48.99999999999935, "driven_lanedir": 0.14626734111813944, "in-drivable-lane": 43.94999999999935, "deviation-heading": 2.5591239415144273, "distance-from-start": 0.5461575079396503, "deviation-center-line": 0.5143008900460763, "driven_lanedir_consec": 0.15283683148370342}, "4way-000-ego3": {"driven_any": 12.38395710263782, "survival_time": 48.99999999999935, "driven_lanedir": 0.18909778689237045, "in-drivable-lane": 41.99999999999934, "deviation-heading": 4.879068897013592, "distance-from-start": 1.1376277719266368, "deviation-center-line": 0.5089599695224504, "driven_lanedir_consec": 0.19998529621221617}}
simulation-passed1
survival_time_max48.99999999999935
survival_time_mean48.99999999999935
survival_time_min48.99999999999935
No reset possible
12113716Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12111716Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-03-6.2.500:03:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12106733Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-validationsim-3of4successnodavinci-stage-03-6.2.500:07:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median7.688985448339736e-07
deviation-center-line_median0.8948980057926529


other stats
deviation-center-line_max0.8948980057926529
deviation-center-line_mean0.8948980057926529
deviation-center-line_min0.8948980057926529
deviation-heading_max32.249118375031394
deviation-heading_mean32.249118375031394
deviation-heading_median32.249118375031394
deviation-heading_min32.249118375031394
distance-from-start_max4.965068306494546e-16
distance-from-start_mean4.965068306494546e-16
distance-from-start_median4.965068306494546e-16
distance-from-start_min4.965068306494546e-16
driven_any_max5.95808196779335e-13
driven_any_mean5.95808196779335e-13
driven_any_median5.95808196779335e-13
driven_any_min5.95808196779335e-13
driven_lanedir_consec_max7.688985448339736e-07
driven_lanedir_consec_mean7.688985448339736e-07
driven_lanedir_consec_min7.688985448339736e-07
driven_lanedir_max7.688985448339736e-07
driven_lanedir_mean7.688985448339736e-07
driven_lanedir_median7.688985448339736e-07
driven_lanedir_min7.688985448339736e-07
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 7.688985448339736e-07, "in-drivable-lane": 0.0, "deviation-heading": 32.249118375031394, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.8948980057926529, "driven_lanedir_consec": 7.688985448339736e-07}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12104733Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:04:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8948943425963037


other stats
deviation-center-line_max0.8948943425963037
deviation-center-line_mean0.8948943425963037
deviation-center-line_min0.8948943425963037
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max1.3877787807814454e-16
distance-from-start_mean1.3877787807814454e-16
distance-from-start_median1.3877787807814454e-16
distance-from-start_min1.3877787807814454e-16
driven_any_max1.665334536937735e-13
driven_any_mean1.665334536937735e-13
driven_any_median1.665334536937735e-13
driven_any_min1.665334536937735e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.665334536937735e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 1.3877787807814454e-16, "deviation-center-line": 0.8948943425963037, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12101735Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-validationsim-2of4successnodavinci-stage-03-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12095736Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-validationsim-0of4successnodavinci-stage-03-6.2.500:06:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8949116056299468


other stats
deviation-center-line_max0.8949116056299468
deviation-center-line_mean0.8949116056299468
deviation-center-line_min0.8949116056299468
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max4.440892098500626e-16
distance-from-start_mean4.440892098500626e-16
distance-from-start_median4.440892098500626e-16
distance-from-start_min4.440892098500626e-16
driven_any_max5.329070518200751e-13
driven_any_mean5.329070518200751e-13
driven_any_median5.329070518200751e-13
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.8949116056299468, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12086739Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-testingsim-0of4successnodavinci-stage-03-6.2.500:15:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median1.5844914646140096


other stats
deviation-center-line_max3.46840075762051
deviation-center-line_mean1.7151235775444986
deviation-center-line_min0.22311062332946505
deviation-heading_max40.967332753486254
deviation-heading_mean25.437951450471505
deviation-heading_median28.066180210798333
deviation-heading_min4.652112626803104
distance-from-start_max2.220446049250313e-16
distance-from-start_mean8.326672684688674e-17
distance-from-start_median5.551115123125783e-17
distance-from-start_min0.0
driven_any_max2.6645352591003757e-13
driven_any_mean9.992007221626409e-14
driven_any_median6.661338147750939e-14
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 0.0, "deviation-center-line": 0.4065243130134918, "driven_lanedir_consec": 0.000286102294921875}, "autolab-000-ego1": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005143, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 3.46840075762051, "driven_lanedir_consec": 0.0}, "autolab-000-ego2": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 4.652112626803104, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 0.22311062332946505, "driven_lanedir_consec": 0.0}, "autolab-000-ego3": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 0.0, "deviation-center-line": 2.7624586162145275, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12082740Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-testingsim-3of4successnodavinci-stage-03-6.2.500:07:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median-2.5756543564625645e-06
deviation-center-line_median0.406520962699379


other stats
deviation-center-line_max0.406520962699379
deviation-center-line_mean0.406520962699379
deviation-center-line_min0.406520962699379
deviation-heading_max40.96736494841265
deviation-heading_mean40.96736494841265
deviation-heading_median40.96736494841265
deviation-heading_min40.96736494841265
distance-from-start_max4.440892098500626e-16
distance-from-start_mean4.440892098500626e-16
distance-from-start_median4.440892098500626e-16
distance-from-start_min4.440892098500626e-16
driven_any_max5.329070518200751e-13
driven_any_mean5.329070518200751e-13
driven_any_median5.329070518200751e-13
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max-2.5756543564625645e-06
driven_lanedir_consec_mean-2.5756543564625645e-06
driven_lanedir_consec_min-2.5756543564625645e-06
driven_lanedir_max-2.5756543564625645e-06
driven_lanedir_mean-2.5756543564625645e-06
driven_lanedir_median-2.5756543564625645e-06
driven_lanedir_min-2.5756543564625645e-06
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": -2.5756543564625645e-06, "in-drivable-lane": 0.0, "deviation-heading": 40.96736494841265, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.406520962699379, "driven_lanedir_consec": -2.5756543564625645e-06}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12079740Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-testingsim-1of4successnodavinci-stage-03-6.2.500:05:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.406513421257873


other stats
deviation-center-line_max0.406513421257873
deviation-center-line_mean0.406513421257873
deviation-center-line_min0.406513421257873
deviation-heading_max40.967332753486225
deviation-heading_mean40.967332753486225
deviation-heading_median40.967332753486225
deviation-heading_min40.967332753486225
distance-from-start_max1.1102230246251563e-16
distance-from-start_mean1.1102230246251563e-16
distance-from-start_median1.1102230246251563e-16
distance-from-start_min1.1102230246251563e-16
driven_any_max1.3322676295501878e-13
driven_any_mean1.3322676295501878e-13
driven_any_median1.3322676295501878e-13
driven_any_min1.3322676295501878e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 0.406513421257873, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12072742Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-testingsim-1of4successnodavinci-stage-03-6.2.500:10:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.4065192765737477


other stats
deviation-center-line_max0.4065192765737477
deviation-center-line_mean0.4065192765737477
deviation-center-line_min0.4065192765737477
deviation-heading_max40.967332753486225
deviation-heading_mean40.967332753486225
deviation-heading_median40.967332753486225
deviation-heading_min40.967332753486225
distance-from-start_max1.1102230246251563e-16
distance-from-start_mean1.1102230246251563e-16
distance-from-start_median1.1102230246251563e-16
distance-from-start_min1.1102230246251563e-16
driven_any_max1.3322676295501878e-13
driven_any_mean1.3322676295501878e-13
driven_any_median1.3322676295501878e-13
driven_any_min1.3322676295501878e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 0.4065192765737477, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12053745Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-testingsim-1of4successnodavinci-stage-03-6.2.500:05:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median0.40652749865251137
in-drivable-lane_median0.0


other stats
deviation-center-line_max0.40652749865251137
deviation-center-line_mean0.40652749865251137
deviation-center-line_min0.40652749865251137
deviation-heading_max40.967332753486254
deviation-heading_mean40.967332753486254
deviation-heading_median40.967332753486254
deviation-heading_min40.967332753486254
distance-from-start_max1.1102230246251563e-16
distance-from-start_mean1.1102230246251563e-16
distance-from-start_median1.1102230246251563e-16
distance-from-start_min1.1102230246251563e-16
driven_any_max1.3322676295501878e-13
driven_any_mean1.3322676295501878e-13
driven_any_median1.3322676295501878e-13
driven_any_min1.3322676295501878e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 0.40652749865251137, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible