Duckietown Challenges Home Challenges Submissions

Evaluator 115

ID115
evaluatordavinci-stage-02-6.2.50
owneruser1000001
machinedavinci-stage
processdavinci-stage-02-6.2.50
version6.2.50
first heard
last heard
statusinactive
# evaluating
# success272 12052
# timeout1 14010
# failed90 12167
# error181 12603
# aborted4 12586
# host-error16 12135
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)2.8 GHz
Free % of processors95%
RAM total (MB)251.6 GB
RAM free (MB)243.2 GB
Disk (MB)491.1 GB
Disk available (MB)202.9 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, ETH_small_intersect
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
150331297Andrea Censicollision-check-exerciselx22-collision-check-valistep1host-erroryesdavinci-stage-02-6.2.500:00:42
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.41/images/create?tag=2022_11_24_17_26_06&fromImage=registry-stage2.duckietown.org%2Fandreacensi%2Faido-submissions

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 93, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 429, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.ImageNotFound: 404 Client Error for http+docker://localhost/v1.41/images/create?tag=2022_11_24_17_26_06&fromImage=registry-stage2.duckietown.org%2Fandreacensi%2Faido-submissions: Not Found ("pull access denied for registry-stage2.duckietown.org/andreacensi/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 112, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  registry-stage2.duckietown.org/andreacensi/aido-submissions@sha256:840e7105f36db90b5d37324bdcab451125a96c2e8b8f5c02658293c659de9b5d  tag  2022_11_24_17_26_06

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 51, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull registry-stage2.duckietown.org/andreacensi/aido-submissions:2022_11_24_17_26_06@sha256:840e7105f36db90b5d37324bdcab451125a96c2e8b8f5c02658293c659de9b5d
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15027309Andrea Censiminimal-agentaido-LFV-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:02:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.400000000000013
in-drivable-lane_median7.100000000000017
driven_lanedir_consec_median0.33123013524902545
deviation-center-line_median0.26973522366843383


other stats
deviation-center-line_max0.26973522366843383
deviation-center-line_mean0.26973522366843383
deviation-center-line_min0.26973522366843383
deviation-heading_max2.53835057480462
deviation-heading_mean2.53835057480462
deviation-heading_median2.53835057480462
deviation-heading_min2.53835057480462
distance-from-start_max1.5453191784191067
distance-from-start_mean1.5453191784191067
distance-from-start_median1.5453191784191067
distance-from-start_min1.5453191784191067
driven_any_max1.545427894810905
driven_any_mean1.545427894810905
driven_any_median1.545427894810905
driven_any_min1.545427894810905
driven_lanedir_consec_max0.33123013524902545
driven_lanedir_consec_mean0.33123013524902545
driven_lanedir_consec_min0.33123013524902545
driven_lanedir_max0.33123013524902545
driven_lanedir_mean0.33123013524902545
driven_lanedir_median0.33123013524902545
driven_lanedir_min0.33123013524902545
in-drivable-lane_max7.100000000000017
in-drivable-lane_mean7.100000000000017
in-drivable-lane_min7.100000000000017
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.545427894810905, "survival_time": 10.400000000000013, "driven_lanedir": 0.33123013524902545, "in-drivable-lane": 7.100000000000017, "deviation-heading": 2.53835057480462, "distance-from-start": 1.5453191784191067, "deviation-center-line": 0.26973522366843383, "driven_lanedir_consec": 0.33123013524902545}}
simulation-passed1
survival_time_max10.400000000000013
survival_time_mean10.400000000000013
survival_time_min10.400000000000013
No reset possible
15024310Andrea Censiminimal-agentaido-LFV-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:02:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.400000000000013
in-drivable-lane_median7.100000000000017
driven_lanedir_consec_median0.33123013524902545
deviation-center-line_median0.26973522366843383


other stats
deviation-center-line_max0.26973522366843383
deviation-center-line_mean0.26973522366843383
deviation-center-line_min0.26973522366843383
deviation-heading_max2.53835057480462
deviation-heading_mean2.53835057480462
deviation-heading_median2.53835057480462
deviation-heading_min2.53835057480462
distance-from-start_max1.5453191784191067
distance-from-start_mean1.5453191784191067
distance-from-start_median1.5453191784191067
distance-from-start_min1.5453191784191067
driven_any_max1.545427894810905
driven_any_mean1.545427894810905
driven_any_median1.545427894810905
driven_any_min1.545427894810905
driven_lanedir_consec_max0.33123013524902545
driven_lanedir_consec_mean0.33123013524902545
driven_lanedir_consec_min0.33123013524902545
driven_lanedir_max0.33123013524902545
driven_lanedir_mean0.33123013524902545
driven_lanedir_median0.33123013524902545
driven_lanedir_min0.33123013524902545
in-drivable-lane_max7.100000000000017
in-drivable-lane_mean7.100000000000017
in-drivable-lane_min7.100000000000017
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.545427894810905, "survival_time": 10.400000000000013, "driven_lanedir": 0.33123013524902545, "in-drivable-lane": 7.100000000000017, "deviation-heading": 2.53835057480462, "distance-from-start": 1.5453191784191067, "deviation-center-line": 0.26973522366843383, "driven_lanedir_consec": 0.33123013524902545}}
simulation-passed1
survival_time_max10.400000000000013
survival_time_mean10.400000000000013
survival_time_min10.400000000000013
No reset possible
15003385Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-validationsim-1of4successnodavinci-stage-02-6.2.500:31:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median26.42499999999941
driven_lanedir_consec_median-3.2703267592042615
deviation-center-line_median2.703680721861694


other stats
deviation-center-line_max3.2723496952513296
deviation-center-line_mean2.6687967678329607
deviation-center-line_min1.9954759323571265
deviation-heading_max28.522973685198952
deviation-heading_mean26.620701038478632
deviation-heading_median27.977473822154415
deviation-heading_min22.004882824406742
distance-from-start_max0.20807793810514677
distance-from-start_mean0.18253819339081356
distance-from-start_median0.17870486050730028
distance-from-start_min0.16466511444350698
driven_any_max12.47424879164805
driven_any_mean11.40823229039528
driven_any_median11.430826014591444
driven_any_min10.297028340750186
driven_lanedir_consec_max-1.2900574539251308
driven_lanedir_consec_mean-2.877313598752232
driven_lanedir_consec_min-3.678543422675273
driven_lanedir_max-1.2900574539251308
driven_lanedir_mean-3.0854622902330298
driven_lanedir_median-3.678243732656416
driven_lanedir_min-3.695304241694157
in-drivable-lane_max33.299999999998875
in-drivable-lane_mean26.96249999999928
in-drivable-lane_min21.69999999999942
per-episodes
details{"loop-000-ego0": {"driven_any": 10.297028340750186, "survival_time": 59.99999999999873, "driven_lanedir": -1.2900574539251308, "in-drivable-lane": 33.299999999998875, "deviation-heading": 22.004882824406742, "distance-from-start": 0.18296870775482055, "deviation-center-line": 2.671280282728969, "driven_lanedir_consec": -1.2900574539251308}, "loop-000-ego1": {"driven_any": 12.47424879164805, "survival_time": 59.99999999999873, "driven_lanedir": -3.678543422675273, "in-drivable-lane": 26.999999999999403, "deviation-heading": 27.884758626612683, "distance-from-start": 0.17444101325977998, "deviation-center-line": 2.736081160994419, "driven_lanedir_consec": -3.678543422675273}, "loop-000-ego2": {"driven_any": 11.286476207858607, "survival_time": 59.99999999999873, "driven_lanedir": -3.6779440426375594, "in-drivable-lane": 21.69999999999942, "deviation-heading": 28.070189017696144, "distance-from-start": 0.20807793810514677, "deviation-center-line": 3.2723496952513296, "driven_lanedir_consec": -3.1149660240957715}, "loop-000-ego3": {"driven_any": 11.57517582132428, "survival_time": 59.99999999999873, "driven_lanedir": -3.695304241694157, "in-drivable-lane": 25.84999999999942, "deviation-heading": 28.522973685198952, "distance-from-start": 0.16466511444350698, "deviation-center-line": 1.9954759323571265, "driven_lanedir_consec": -3.4256874943127515}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14998386Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-validationsim-0of4successnodavinci-stage-02-6.2.500:09:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median27.79999999999935
driven_lanedir_consec_median-3.5077154749623163
deviation-center-line_median2.6153419355920184


other stats
deviation-center-line_max2.6153419355920184
deviation-center-line_mean2.6153419355920184
deviation-center-line_min2.6153419355920184
deviation-heading_max26.99981130160173
deviation-heading_mean26.99981130160173
deviation-heading_median26.99981130160173
deviation-heading_min26.99981130160173
distance-from-start_max0.1666268599487052
distance-from-start_mean0.1666268599487052
distance-from-start_median0.1666268599487052
distance-from-start_min0.1666268599487052
driven_any_max12.335939336960926
driven_any_mean12.335939336960926
driven_any_median12.335939336960926
driven_any_min12.335939336960926
driven_lanedir_consec_max-3.5077154749623163
driven_lanedir_consec_mean-3.5077154749623163
driven_lanedir_consec_min-3.5077154749623163
driven_lanedir_max-3.747891432660982
driven_lanedir_mean-3.747891432660982
driven_lanedir_median-3.747891432660982
driven_lanedir_min-3.747891432660982
in-drivable-lane_max27.79999999999935
in-drivable-lane_mean27.79999999999935
in-drivable-lane_min27.79999999999935
per-episodes
details{"autolab-000-ego0": {"driven_any": 12.335939336960926, "survival_time": 59.99999999999873, "driven_lanedir": -3.747891432660982, "in-drivable-lane": 27.79999999999935, "deviation-heading": 26.99981130160173, "distance-from-start": 0.1666268599487052, "deviation-center-line": 2.6153419355920184, "driven_lanedir_consec": -3.5077154749623163}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14995387Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:09:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median31.899999999999245
driven_lanedir_consec_median-3.247835328383983
deviation-center-line_median2.474378521773595


other stats
deviation-center-line_max2.474378521773595
deviation-center-line_mean2.474378521773595
deviation-center-line_min2.474378521773595
deviation-heading_max24.277741347856225
deviation-heading_mean24.277741347856225
deviation-heading_median24.277741347856225
deviation-heading_min24.277741347856225
distance-from-start_max0.1642963601752957
distance-from-start_mean0.1642963601752957
distance-from-start_median0.1642963601752957
distance-from-start_min0.1642963601752957
driven_any_max11.39914305596548
driven_any_mean11.39914305596548
driven_any_median11.39914305596548
driven_any_min11.39914305596548
driven_lanedir_consec_max-3.247835328383983
driven_lanedir_consec_mean-3.247835328383983
driven_lanedir_consec_min-3.247835328383983
driven_lanedir_max-3.4526912244443184
driven_lanedir_mean-3.4526912244443184
driven_lanedir_median-3.4526912244443184
driven_lanedir_min-3.4526912244443184
in-drivable-lane_max31.899999999999245
in-drivable-lane_mean31.899999999999245
in-drivable-lane_min31.899999999999245
per-episodes
details{"loop2-000-ego0": {"driven_any": 11.39914305596548, "survival_time": 59.99999999999873, "driven_lanedir": -3.4526912244443184, "in-drivable-lane": 31.899999999999245, "deviation-heading": 24.277741347856225, "distance-from-start": 0.1642963601752957, "deviation-center-line": 2.474378521773595, "driven_lanedir_consec": -3.247835328383983}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14993387Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-validationsim-0of4successnodavinci-stage-02-6.2.500:07:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median19.600000000000144
in-drivable-lane_median7.950000000000068
driven_lanedir_consec_median-1.1521859667075005
deviation-center-line_median0.7249181021010974


other stats
deviation-center-line_max0.7249181021010974
deviation-center-line_mean0.7249181021010974
deviation-center-line_min0.7249181021010974
deviation-heading_max9.984302065383966
deviation-heading_mean9.984302065383966
deviation-heading_median9.984302065383966
deviation-heading_min9.984302065383966
distance-from-start_max0.16785979743217966
distance-from-start_mean0.16785979743217966
distance-from-start_median0.16785979743217966
distance-from-start_min0.16785979743217966
driven_any_max3.9239064268728434
driven_any_mean3.9239064268728434
driven_any_median3.9239064268728434
driven_any_min3.9239064268728434
driven_lanedir_consec_max-1.1521859667075005
driven_lanedir_consec_mean-1.1521859667075005
driven_lanedir_consec_min-1.1521859667075005
driven_lanedir_max-1.4954807372701704
driven_lanedir_mean-1.4954807372701704
driven_lanedir_median-1.4954807372701704
driven_lanedir_min-1.4954807372701704
in-drivable-lane_max7.950000000000068
in-drivable-lane_mean7.950000000000068
in-drivable-lane_min7.950000000000068
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.9239064268728434, "survival_time": 19.600000000000144, "driven_lanedir": -1.4954807372701704, "in-drivable-lane": 7.950000000000068, "deviation-heading": 9.984302065383966, "distance-from-start": 0.16785979743217966, "deviation-center-line": 0.7249181021010974, "driven_lanedir_consec": -1.1521859667075005}}
simulation-passed1
survival_time_max19.600000000000144
survival_time_mean19.600000000000144
survival_time_min19.600000000000144
No reset possible
14992388Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14986389Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-validationsim-0of4successnodavinci-stage-02-6.2.500:09:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median58.24999999999883
in-drivable-lane_median16.649999999999675
driven_lanedir_consec_median-3.094770798421476
deviation-center-line_median3.0219414060961665


other stats
deviation-center-line_max3.0219414060961665
deviation-center-line_mean3.0219414060961665
deviation-center-line_min3.0219414060961665
deviation-heading_max28.697643054577497
deviation-heading_mean28.697643054577497
deviation-heading_median28.697643054577497
deviation-heading_min28.697643054577497
distance-from-start_max0.19135171865823583
distance-from-start_mean0.19135171865823583
distance-from-start_median0.19135171865823583
distance-from-start_min0.19135171865823583
driven_any_max11.39012922446187
driven_any_mean11.39012922446187
driven_any_median11.39012922446187
driven_any_min11.39012922446187
driven_lanedir_consec_max-3.094770798421476
driven_lanedir_consec_mean-3.094770798421476
driven_lanedir_consec_min-3.094770798421476
driven_lanedir_max-4.408109836267092
driven_lanedir_mean-4.408109836267092
driven_lanedir_median-4.408109836267092
driven_lanedir_min-4.408109836267092
in-drivable-lane_max16.649999999999675
in-drivable-lane_mean16.649999999999675
in-drivable-lane_min16.649999999999675
per-episodes
details{"4way-000-ego0": {"driven_any": 11.39012922446187, "survival_time": 58.24999999999883, "driven_lanedir": -4.408109836267092, "in-drivable-lane": 16.649999999999675, "deviation-heading": 28.697643054577497, "distance-from-start": 0.19135171865823583, "deviation-center-line": 3.0219414060961665, "driven_lanedir_consec": -3.094770798421476}}
simulation-passed1
survival_time_max58.24999999999883
survival_time_mean58.24999999999883
survival_time_min58.24999999999883
No reset possible
14976392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-1of4successnodavinci-stage-02-6.2.500:32:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median29.39999999999927
driven_lanedir_consec_median-3.330137496447422
deviation-center-line_median2.590544493700248


other stats
deviation-center-line_max3.3548963543684964
deviation-center-line_mean2.693359002705212
deviation-center-line_min2.2374506690518565
deviation-heading_max27.69997964703197
deviation-heading_mean25.49254189690776
deviation-heading_median25.41639659632095
deviation-heading_min23.43739474795716
distance-from-start_max0.19010306766495183
distance-from-start_mean0.16662246298292308
distance-from-start_median0.16185525807531115
distance-from-start_min0.15267626811611815
driven_any_max12.115284924445584
driven_any_mean11.766881422023058
driven_any_median11.725369713421674
driven_any_min11.501501336803305
driven_lanedir_consec_max-1.9342743732093073
driven_lanedir_consec_mean-3.0260081742970057
driven_lanedir_consec_min-3.5094833310838727
driven_lanedir_max-1.9342743732093073
driven_lanedir_mean-3.120913793878112
driven_lanedir_median-3.4629291839359087
driven_lanedir_min-3.623522434431323
in-drivable-lane_max37.399999999999054
in-drivable-lane_mean30.037499999999255
in-drivable-lane_min23.94999999999943
per-episodes
details{"loop-000-ego0": {"driven_any": 11.675879535493436, "survival_time": 59.99999999999873, "driven_lanedir": -3.4163750367879446, "in-drivable-lane": 23.94999999999943, "deviation-heading": 27.69997964703197, "distance-from-start": 0.15267626811611815, "deviation-center-line": 3.3548963543684964, "driven_lanedir_consec": -3.4163750367879446}, "loop-000-ego1": {"driven_any": 11.501501336803305, "survival_time": 59.99999999999873, "driven_lanedir": -1.9342743732093073, "in-drivable-lane": 37.399999999999054, "deviation-heading": 23.43739474795716, "distance-from-start": 0.19010306766495183, "deviation-center-line": 2.2374506690518565, "driven_lanedir_consec": -1.9342743732093073}, "loop-000-ego2": {"driven_any": 12.115284924445584, "survival_time": 59.99999999999873, "driven_lanedir": -3.623522434431323, "in-drivable-lane": 30.999999999999183, "deviation-heading": 24.594553093584665, "distance-from-start": 0.1678560531714668, "deviation-center-line": 2.3899889667506633, "driven_lanedir_consec": -3.2438999561068993}, "loop-000-ego3": {"driven_any": 11.774859891349916, "survival_time": 59.99999999999873, "driven_lanedir": -3.5094833310838727, "in-drivable-lane": 27.79999999999936, "deviation-heading": 26.23824009905724, "distance-from-start": 0.1558544629791555, "deviation-center-line": 2.791100020649833, "driven_lanedir_consec": -3.5094833310838727}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14972393Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:05:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median29.30000000000028
in-drivable-lane_median12.20000000000016
driven_lanedir_consec_median-0.9633336713330172
deviation-center-line_median1.477389460650655


other stats
deviation-center-line_max1.477389460650655
deviation-center-line_mean1.477389460650655
deviation-center-line_min1.477389460650655
deviation-heading_max13.827591641061934
deviation-heading_mean13.827591641061934
deviation-heading_median13.827591641061934
deviation-heading_min13.827591641061934
distance-from-start_max0.24163455688535673
distance-from-start_mean0.24163455688535673
distance-from-start_median0.24163455688535673
distance-from-start_min0.24163455688535673
driven_any_max4.933885500931681
driven_any_mean4.933885500931681
driven_any_median4.933885500931681
driven_any_min4.933885500931681
driven_lanedir_consec_max-0.9633336713330172
driven_lanedir_consec_mean-0.9633336713330172
driven_lanedir_consec_min-0.9633336713330172
driven_lanedir_max-0.9633336713330172
driven_lanedir_mean-0.9633336713330172
driven_lanedir_median-0.9633336713330172
driven_lanedir_min-0.9633336713330172
in-drivable-lane_max12.20000000000016
in-drivable-lane_mean12.20000000000016
in-drivable-lane_min12.20000000000016
per-episodes
details{"zigzag-000-ego0": {"driven_any": 4.933885500931681, "survival_time": 29.30000000000028, "driven_lanedir": -0.9633336713330172, "in-drivable-lane": 12.20000000000016, "deviation-heading": 13.827591641061934, "distance-from-start": 0.24163455688535673, "deviation-center-line": 1.477389460650655, "driven_lanedir_consec": -0.9633336713330172}}
simulation-passed1
survival_time_max29.30000000000028
survival_time_mean29.30000000000028
survival_time_min29.30000000000028
No reset possible
14969393Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:06:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median19.199999999999513
driven_lanedir_consec_median-2.5916851103409595
deviation-center-line_median3.4063278671028523


other stats
deviation-center-line_max3.4063278671028523
deviation-center-line_mean3.4063278671028523
deviation-center-line_min3.4063278671028523
deviation-heading_max29.94389041965316
deviation-heading_mean29.94389041965316
deviation-heading_median29.94389041965316
deviation-heading_min29.94389041965316
distance-from-start_max0.15482266824772206
distance-from-start_mean0.15482266824772206
distance-from-start_median0.15482266824772206
distance-from-start_min0.15482266824772206
driven_any_max10.816783183741274
driven_any_mean10.816783183741274
driven_any_median10.816783183741274
driven_any_min10.816783183741274
driven_lanedir_consec_max-2.5916851103409595
driven_lanedir_consec_mean-2.5916851103409595
driven_lanedir_consec_min-2.5916851103409595
driven_lanedir_max-2.5916851103409595
driven_lanedir_mean-2.5916851103409595
driven_lanedir_median-2.5916851103409595
driven_lanedir_min-2.5916851103409595
in-drivable-lane_max19.199999999999513
in-drivable-lane_mean19.199999999999513
in-drivable-lane_min19.199999999999513
per-episodes
details{"loop2-000-ego0": {"driven_any": 10.816783183741274, "survival_time": 59.99999999999873, "driven_lanedir": -2.5916851103409595, "in-drivable-lane": 19.199999999999513, "deviation-heading": 29.94389041965316, "distance-from-start": 0.15482266824772206, "deviation-center-line": 3.4063278671028523, "driven_lanedir_consec": -2.5916851103409595}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14962395Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-testingsim-0of4successnodavinci-stage-02-6.2.500:17:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median30.999999999999297
driven_lanedir_consec_median-3.10028018995078
deviation-center-line_median3.009621482847578


other stats
deviation-center-line_max3.009621482847578
deviation-center-line_mean3.009621482847578
deviation-center-line_min3.009621482847578
deviation-heading_max27.04380345844205
deviation-heading_mean27.04380345844205
deviation-heading_median27.04380345844205
deviation-heading_min27.04380345844205
distance-from-start_max0.12996406875968475
distance-from-start_mean0.12996406875968475
distance-from-start_median0.12996406875968475
distance-from-start_min0.12996406875968475
driven_any_max12.296938418420128
driven_any_mean12.296938418420128
driven_any_median12.296938418420128
driven_any_min12.296938418420128
driven_lanedir_consec_max-3.10028018995078
driven_lanedir_consec_mean-3.10028018995078
driven_lanedir_consec_min-3.10028018995078
driven_lanedir_max-3.10028018995078
driven_lanedir_mean-3.10028018995078
driven_lanedir_median-3.10028018995078
driven_lanedir_min-3.10028018995078
in-drivable-lane_max30.999999999999297
in-drivable-lane_mean30.999999999999297
in-drivable-lane_min30.999999999999297
per-episodes
details{"udem-000-ego0": {"driven_any": 12.296938418420128, "survival_time": 59.99999999999873, "driven_lanedir": -3.10028018995078, "in-drivable-lane": 30.999999999999297, "deviation-heading": 27.04380345844205, "distance-from-start": 0.12996406875968475, "deviation-center-line": 3.009621482847578, "driven_lanedir_consec": -3.10028018995078}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14960396Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-testingsim-0of4successnodavinci-stage-02-6.2.500:03:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median15.05000000000008
in-drivable-lane_median5.500000000000023
driven_lanedir_consec_median-0.8018703990745422
deviation-center-line_median0.34431377326921153


other stats
deviation-center-line_max0.34431377326921153
deviation-center-line_mean0.34431377326921153
deviation-center-line_min0.34431377326921153
deviation-heading_max7.839593678714124
deviation-heading_mean7.839593678714124
deviation-heading_median7.839593678714124
deviation-heading_min7.839593678714124
distance-from-start_max0.15951999946283876
distance-from-start_mean0.15951999946283876
distance-from-start_median0.15951999946283876
distance-from-start_min0.15951999946283876
driven_any_max2.749526126704576
driven_any_mean2.749526126704576
driven_any_median2.749526126704576
driven_any_min2.749526126704576
driven_lanedir_consec_max-0.8018703990745422
driven_lanedir_consec_mean-0.8018703990745422
driven_lanedir_consec_min-0.8018703990745422
driven_lanedir_max-0.7955402393540951
driven_lanedir_mean-0.7955402393540951
driven_lanedir_median-0.7955402393540951
driven_lanedir_min-0.7955402393540951
in-drivable-lane_max5.500000000000023
in-drivable-lane_mean5.500000000000023
in-drivable-lane_min5.500000000000023
per-episodes
details{"4way-000-ego0": {"driven_any": 2.749526126704576, "survival_time": 15.05000000000008, "driven_lanedir": -0.7955402393540951, "in-drivable-lane": 5.500000000000023, "deviation-heading": 7.839593678714124, "distance-from-start": 0.15951999946283876, "deviation-center-line": 0.34431377326921153, "driven_lanedir_consec": -0.8018703990745422}}
simulation-passed1
survival_time_max15.05000000000008
survival_time_mean15.05000000000008
survival_time_min15.05000000000008
No reset possible
14956398Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14951514Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-validationsim-1of4failednodavinci-stage-02-6.2.500:01:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14944516Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-validationsim-3of4failednodavinci-stage-02-6.2.500:01:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14938517Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14933518Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-validationsim-0of4failednodavinci-stage-02-6.2.500:01:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14930519Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-validationsim-3of4failednodavinci-stage-02-6.2.500:00:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14923520Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-validationsim-0of4failednodavinci-stage-02-6.2.500:01:15
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14919522Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-testingsim-0of4failednodavinci-stage-02-6.2.500:01:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14918522Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-testingsim-3of4failednodavinci-stage-02-6.2.500:00:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14916523Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-testingsim-2of4failednodavinci-stage-02-6.2.500:01:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14913524Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-testingsim-0of4failednodavinci-stage-02-6.2.500:01:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14911524Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14909524Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14907525Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-testingsim-1of4failednodavinci-stage-02-6.2.500:01:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14905525Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-testingsim-0of4failednodavinci-stage-02-6.2.500:01:22
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14903527Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14902527Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-testingsim-1of4failednodavinci-stage-02-6.2.500:01:33
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14901527Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-testingsim-0of4failednodavinci-stage-02-6.2.500:01:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14900527Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14899528Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-validationsim-2of4failednodavinci-stage-02-6.2.500:01:07
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14895529Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-validationsim-0of4successnodavinci-stage-02-6.2.500:03:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.20000000000001
in-drivable-lane_median0.0
driven_lanedir_consec_median1.2736434212353118
deviation-center-line_median0.34774863418817975


other stats
deviation-center-line_max0.34774863418817975
deviation-center-line_mean0.34774863418817975
deviation-center-line_min0.34774863418817975
deviation-heading_max1.7845184076313811
deviation-heading_mean1.7845184076313811
deviation-heading_median1.7845184076313811
deviation-heading_min1.7845184076313811
distance-from-start_max1.1058784326233932
distance-from-start_mean1.1058784326233932
distance-from-start_median1.1058784326233932
distance-from-start_min1.1058784326233932
driven_any_max1.30510104810794
driven_any_mean1.30510104810794
driven_any_median1.30510104810794
driven_any_min1.30510104810794
driven_lanedir_consec_max1.2736434212353118
driven_lanedir_consec_mean1.2736434212353118
driven_lanedir_consec_min1.2736434212353118
driven_lanedir_max1.2736434212353118
driven_lanedir_mean1.2736434212353118
driven_lanedir_median1.2736434212353118
driven_lanedir_min1.2736434212353118
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.30510104810794, "survival_time": 10.20000000000001, "driven_lanedir": 1.2736434212353118, "in-drivable-lane": 0.0, "deviation-heading": 1.7845184076313811, "distance-from-start": 1.1058784326233932, "deviation-center-line": 0.34774863418817975, "driven_lanedir_consec": 1.2736434212353118}}
simulation-passed1
survival_time_max10.20000000000001
survival_time_mean10.20000000000001
survival_time_min10.20000000000001
No reset possible
14892529Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-validationsim-1of4successnodavinci-stage-02-6.2.500:03:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median24.100000000000207
in-drivable-lane_median1.9500000000000268
driven_lanedir_consec_median3.3753764560181283
deviation-center-line_median1.348568057121646


other stats
deviation-center-line_max1.348568057121646
deviation-center-line_mean1.348568057121646
deviation-center-line_min1.348568057121646
deviation-heading_max6.999408272963577
deviation-heading_mean6.999408272963577
deviation-heading_median6.999408272963577
deviation-heading_min6.999408272963577
distance-from-start_max2.1653279945018515
distance-from-start_mean2.1653279945018515
distance-from-start_median2.1653279945018515
distance-from-start_min2.1653279945018515
driven_any_max4.078216737639902
driven_any_mean4.078216737639902
driven_any_median4.078216737639902
driven_any_min4.078216737639902
driven_lanedir_consec_max3.3753764560181283
driven_lanedir_consec_mean3.3753764560181283
driven_lanedir_consec_min3.3753764560181283
driven_lanedir_max3.3753764560181283
driven_lanedir_mean3.3753764560181283
driven_lanedir_median3.3753764560181283
driven_lanedir_min3.3753764560181283
in-drivable-lane_max1.9500000000000268
in-drivable-lane_mean1.9500000000000268
in-drivable-lane_min1.9500000000000268
per-episodes
details{"loop-000-ego0": {"driven_any": 4.078216737639902, "survival_time": 24.100000000000207, "driven_lanedir": 3.3753764560181283, "in-drivable-lane": 1.9500000000000268, "deviation-heading": 6.999408272963577, "distance-from-start": 2.1653279945018515, "deviation-center-line": 1.348568057121646, "driven_lanedir_consec": 3.3753764560181283}}
simulation-passed1
survival_time_max24.100000000000207
survival_time_mean24.100000000000207
survival_time_min24.100000000000207
No reset possible
14886531Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-validationsim-0of4successnodavinci-stage-02-6.2.500:07:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median28.000000000000263
in-drivable-lane_median0.70000000000001
driven_lanedir_consec_median3.892081646865695
deviation-center-line_median1.0963211235895622


other stats
deviation-center-line_max1.0963211235895622
deviation-center-line_mean1.0963211235895622
deviation-center-line_min1.0963211235895622
deviation-heading_max5.957580605850355
deviation-heading_mean5.957580605850355
deviation-heading_median5.957580605850355
deviation-heading_min5.957580605850355
distance-from-start_max3.284795615609748
distance-from-start_mean3.284795615609748
distance-from-start_median3.284795615609748
distance-from-start_min3.284795615609748
driven_any_max4.2452900751130915
driven_any_mean4.2452900751130915
driven_any_median4.2452900751130915
driven_any_min4.2452900751130915
driven_lanedir_consec_max3.892081646865695
driven_lanedir_consec_mean3.892081646865695
driven_lanedir_consec_min3.892081646865695
driven_lanedir_max3.892349513079272
driven_lanedir_mean3.892349513079272
driven_lanedir_median3.892349513079272
driven_lanedir_min3.892349513079272
in-drivable-lane_max0.70000000000001
in-drivable-lane_mean0.70000000000001
in-drivable-lane_min0.70000000000001
per-episodes
details{"udem-000-ego0": {"driven_any": 4.2452900751130915, "survival_time": 28.000000000000263, "driven_lanedir": 3.892349513079272, "in-drivable-lane": 0.70000000000001, "deviation-heading": 5.957580605850355, "distance-from-start": 3.284795615609748, "deviation-center-line": 1.0963211235895622, "driven_lanedir_consec": 3.892081646865695}}
simulation-passed1
survival_time_max28.000000000000263
survival_time_mean28.000000000000263
survival_time_min28.000000000000263
No reset possible
14878533Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:06:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.270244986150015
survival_time_median59.99999999999873
deviation-center-line_median3.4668862537985548
in-drivable-lane_median3.000000000000042


other stats
deviation-center-line_max3.4668862537985548
deviation-center-line_mean3.4668862537985548
deviation-center-line_min3.4668862537985548
deviation-heading_max12.8676259970388
deviation-heading_mean12.8676259970388
deviation-heading_median12.8676259970388
deviation-heading_min12.8676259970388
distance-from-start_max4.079352452773981
distance-from-start_mean4.079352452773981
distance-from-start_median4.079352452773981
distance-from-start_min4.079352452773981
driven_any_max9.08236896196813
driven_any_mean9.08236896196813
driven_any_median9.08236896196813
driven_any_min9.08236896196813
driven_lanedir_consec_max8.270244986150015
driven_lanedir_consec_mean8.270244986150015
driven_lanedir_consec_min8.270244986150015
driven_lanedir_max8.270244986150015
driven_lanedir_mean8.270244986150015
driven_lanedir_median8.270244986150015
driven_lanedir_min8.270244986150015
in-drivable-lane_max3.000000000000042
in-drivable-lane_mean3.000000000000042
in-drivable-lane_min3.000000000000042
per-episodes
details{"zigzag-000-ego0": {"driven_any": 9.08236896196813, "survival_time": 59.99999999999873, "driven_lanedir": 8.270244986150015, "in-drivable-lane": 3.000000000000042, "deviation-heading": 12.8676259970388, "distance-from-start": 4.079352452773981, "deviation-center-line": 3.4668862537985548, "driven_lanedir_consec": 8.270244986150015}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14876533Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-validationsim-0of4successnodavinci-stage-02-6.2.500:06:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.066305647321323
survival_time_median59.99999999999873
deviation-center-line_median3.13724221645772
in-drivable-lane_median0.0


other stats
deviation-center-line_max3.13724221645772
deviation-center-line_mean3.13724221645772
deviation-center-line_min3.13724221645772
deviation-heading_max14.552218965051896
deviation-heading_mean14.552218965051896
deviation-heading_median14.552218965051896
deviation-heading_min14.552218965051896
distance-from-start_max4.0450532582984655
distance-from-start_mean4.0450532582984655
distance-from-start_median4.0450532582984655
distance-from-start_min4.0450532582984655
driven_any_max9.537867817871549
driven_any_mean9.537867817871549
driven_any_median9.537867817871549
driven_any_min9.537867817871549
driven_lanedir_consec_max9.066305647321323
driven_lanedir_consec_mean9.066305647321323
driven_lanedir_consec_min9.066305647321323
driven_lanedir_max9.066305647321323
driven_lanedir_mean9.066305647321323
driven_lanedir_median9.066305647321323
driven_lanedir_min9.066305647321323
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 9.537867817871549, "survival_time": 59.99999999999873, "driven_lanedir": 9.066305647321323, "in-drivable-lane": 0.0, "deviation-heading": 14.552218965051896, "distance-from-start": 4.0450532582984655, "deviation-center-line": 3.13724221645772, "driven_lanedir_consec": 9.066305647321323}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14875534Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14874534Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-validationsim-2of4failednodavinci-stage-02-6.2.500:01:01
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14872534Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-validationsim-0of4failednodavinci-stage-02-6.2.500:01:02
The container "solut [...]
The container "solution-ego1" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14864537Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-testingsim-1of4successnodavinci-stage-02-6.2.500:11:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median17.349999999999014
driven_lanedir_consec_median7.41624734595818
deviation-center-line_median2.0272968486466048


other stats
deviation-center-line_max2.0272968486466048
deviation-center-line_mean2.0272968486466048
deviation-center-line_min2.0272968486466048
deviation-heading_max10.196174191128623
deviation-heading_mean10.196174191128623
deviation-heading_median10.196174191128623
deviation-heading_min10.196174191128623
distance-from-start_max2.9380825780426707
distance-from-start_mean2.9380825780426707
distance-from-start_median2.9380825780426707
distance-from-start_min2.9380825780426707
driven_any_max11.352083174677151
driven_any_mean11.352083174677151
driven_any_median11.352083174677151
driven_any_min11.352083174677151
driven_lanedir_consec_max7.41624734595818
driven_lanedir_consec_mean7.41624734595818
driven_lanedir_consec_min7.41624734595818
driven_lanedir_max7.41624734595818
driven_lanedir_mean7.41624734595818
driven_lanedir_median7.41624734595818
driven_lanedir_min7.41624734595818
in-drivable-lane_max17.349999999999014
in-drivable-lane_mean17.349999999999014
in-drivable-lane_min17.349999999999014
per-episodes
details{"loop-000-ego0": {"driven_any": 11.352083174677151, "survival_time": 59.99999999999873, "driven_lanedir": 7.41624734595818, "in-drivable-lane": 17.349999999999014, "deviation-heading": 10.196174191128623, "distance-from-start": 2.9380825780426707, "deviation-center-line": 2.0272968486466048, "driven_lanedir_consec": 7.41624734595818}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14843542Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-testingsim-1of4successnodavinci-stage-02-6.2.500:20:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.1750000000000025
driven_lanedir_consec_median7.2635547501344195
deviation-center-line_median4.579877986776105


other stats
deviation-center-line_max5.665374614032759
deviation-center-line_mean4.53824165803107
deviation-center-line_min3.327836044539309
deviation-heading_max23.91554600535776
deviation-heading_mean16.156777344358215
deviation-heading_median14.297739179799478
deviation-heading_min12.11608501247614
distance-from-start_max3.273175169921946
distance-from-start_mean2.0892045828878283
distance-from-start_median2.029561307055842
distance-from-start_min1.0245205475176833
driven_any_max10.732867393319994
driven_any_mean7.671780007791265
driven_any_median8.057008679030352
driven_any_min3.84023527978436
driven_lanedir_consec_max9.562086832213662
driven_lanedir_consec_mean6.945599510254092
driven_lanedir_consec_min3.6932017085338655
driven_lanedir_max9.860923376769207
driven_lanedir_mean7.20061299854229
driven_lanedir_median7.62404069625223
driven_lanedir_min3.693447224895493
in-drivable-lane_max1.3999999999999897
in-drivable-lane_mean0.43749999999999867
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 5.6997873657324645, "survival_time": 59.99999999999873, "driven_lanedir": 5.4928714528422695, "in-drivable-lane": 0.0, "deviation-heading": 12.11608501247614, "distance-from-start": 1.031550596870378, "deviation-center-line": 5.662603679136316, "driven_lanedir_consec": 5.334477308727461}, "4way-000-ego1": {"driven_any": 3.84023527978436, "survival_time": 59.99999999999873, "driven_lanedir": 3.693447224895493, "in-drivable-lane": 0.0, "deviation-heading": 23.91554600535776, "distance-from-start": 1.0245205475176833, "deviation-center-line": 5.665374614032759, "driven_lanedir_consec": 3.6932017085338655}, "4way-000-ego2": {"driven_any": 10.732867393319994, "survival_time": 59.99999999999873, "driven_lanedir": 9.860923376769207, "in-drivable-lane": 1.3999999999999897, "deviation-heading": 14.04177727843165, "distance-from-start": 3.027572017241306, "deviation-center-line": 3.327836044539309, "driven_lanedir_consec": 9.562086832213662}, "4way-000-ego3": {"driven_any": 10.414229992328238, "survival_time": 59.99999999999873, "driven_lanedir": 9.75520993966219, "in-drivable-lane": 0.350000000000005, "deviation-heading": 14.553701081167304, "distance-from-start": 3.273175169921946, "deviation-center-line": 3.4971522944158946, "driven_lanedir_consec": 9.192632191541378}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14839600Liam Paulltemplate-tensorflowaido-LF-sim-validationsim-3of4failednodavinci-stage-02-6.2.500:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14807808Andrea Censitemplate-randomaido-LFV-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:15:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median48.69999999999937
in-drivable-lane_median36.64999999999927
driven_lanedir_consec_median0.27329071924012593
deviation-center-line_median0.8940598330260409


other stats
deviation-center-line_max0.8940598330260409
deviation-center-line_mean0.8940598330260409
deviation-center-line_min0.8940598330260409
deviation-heading_max9.653852545002117
deviation-heading_mean9.653852545002117
deviation-heading_median9.653852545002117
deviation-heading_min9.653852545002117
distance-from-start_max1.1351054760255814
distance-from-start_mean1.1351054760255814
distance-from-start_median1.1351054760255814
distance-from-start_min1.1351054760255814
driven_any_max12.221812291295889
driven_any_mean12.221812291295889
driven_any_median12.221812291295889
driven_any_min12.221812291295889
driven_lanedir_consec_max0.27329071924012593
driven_lanedir_consec_mean0.27329071924012593
driven_lanedir_consec_min0.27329071924012593
driven_lanedir_max0.26112935377464863
driven_lanedir_mean0.26112935377464863
driven_lanedir_median0.26112935377464863
driven_lanedir_min0.26112935377464863
in-drivable-lane_max36.64999999999927
in-drivable-lane_mean36.64999999999927
in-drivable-lane_min36.64999999999927
per-episodes
details{"zigzag-000-ego0": {"driven_any": 12.221812291295889, "survival_time": 48.69999999999937, "driven_lanedir": 0.26112935377464863, "in-drivable-lane": 36.64999999999927, "deviation-heading": 9.653852545002117, "distance-from-start": 1.1351054760255814, "deviation-center-line": 0.8940598330260409, "driven_lanedir_consec": 0.27329071924012593}}
simulation-passed1
survival_time_max48.69999999999937
survival_time_mean48.69999999999937
survival_time_min48.69999999999937
No reset possible
14802809Andrea Censitemplate-randomaido-LFV-sim-validationsim-1of4successnodavinci-stage-02-6.2.500:06:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median23.7000000000002
in-drivable-lane_median14.450000000000168
driven_lanedir_consec_median0.2737854971621658
deviation-center-line_median0.899035755764141


other stats
deviation-center-line_max0.899035755764141
deviation-center-line_mean0.899035755764141
deviation-center-line_min0.899035755764141
deviation-heading_max6.757937307021479
deviation-heading_mean6.757937307021479
deviation-heading_median6.757937307021479
deviation-heading_min6.757937307021479
distance-from-start_max0.7357883576773867
distance-from-start_mean0.7357883576773867
distance-from-start_median0.7357883576773867
distance-from-start_min0.7357883576773867
driven_any_max5.6000766802176365
driven_any_mean5.6000766802176365
driven_any_median5.6000766802176365
driven_any_min5.6000766802176365
driven_lanedir_consec_max0.2737854971621658
driven_lanedir_consec_mean0.2737854971621658
driven_lanedir_consec_min0.2737854971621658
driven_lanedir_max0.2557752979619581
driven_lanedir_mean0.2557752979619581
driven_lanedir_median0.2557752979619581
driven_lanedir_min0.2557752979619581
in-drivable-lane_max14.450000000000168
in-drivable-lane_mean14.450000000000168
in-drivable-lane_min14.450000000000168
per-episodes
details{"loop-000-ego0": {"driven_any": 5.6000766802176365, "survival_time": 23.7000000000002, "driven_lanedir": 0.2557752979619581, "in-drivable-lane": 14.450000000000168, "deviation-heading": 6.757937307021479, "distance-from-start": 0.7357883576773867, "deviation-center-line": 0.899035755764141, "driven_lanedir_consec": 0.2737854971621658}}
simulation-passed1
survival_time_max23.7000000000002
survival_time_mean23.7000000000002
survival_time_min23.7000000000002
No reset possible
14795816Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-validationsim-0of4successnodavinci-stage-02-6.2.500:05:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.161183222767684
deviation-center-line_median0.16237308678117102


other stats
deviation-center-line_max0.16237308678117102
deviation-center-line_mean0.16237308678117102
deviation-center-line_min0.16237308678117102
deviation-heading_max1.6697144680274827
deviation-heading_mean1.6697144680274827
deviation-heading_median1.6697144680274827
deviation-heading_min1.6697144680274827
distance-from-start_max2.3375328751443054
distance-from-start_mean2.3375328751443054
distance-from-start_median2.3375328751443054
distance-from-start_min2.3375328751443054
driven_any_max5.867610759158524
driven_any_mean5.867610759158524
driven_any_median5.867610759158524
driven_any_min5.867610759158524
driven_lanedir_consec_max5.161183222767684
driven_lanedir_consec_mean5.161183222767684
driven_lanedir_consec_min5.161183222767684
driven_lanedir_max5.859601719805226
driven_lanedir_mean5.859601719805226
driven_lanedir_median5.859601719805226
driven_lanedir_min5.859601719805226
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 5.867610759158524, "survival_time": 59.99999999999873, "driven_lanedir": 5.859601719805226, "in-drivable-lane": 0.0, "deviation-heading": 1.6697144680274827, "distance-from-start": 2.3375328751443054, "deviation-center-line": 0.16237308678117102, "driven_lanedir_consec": 5.161183222767684}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14793816Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14788817Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:11:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.496299828477744
deviation-center-line_median0.17183898904941014


other stats
deviation-center-line_max0.21132079357626976
deviation-center-line_mean0.1743653873253979
deviation-center-line_min0.1424627776265016
deviation-heading_max1.5868854715733702
deviation-heading_mean1.4512616339961206
deviation-heading_median1.4728924991747463
deviation-heading_min1.2723760660616197
distance-from-start_max3.152836469048969
distance-from-start_mean2.690530320315596
distance-from-start_median2.641239810973879
distance-from-start_min2.3268051902656572
driven_any_max5.831435519999375
driven_any_mean5.567123575605065
driven_any_median5.707730195058858
driven_any_min5.021598392303173
driven_lanedir_consec_max5.704845460644086
driven_lanedir_consec_mean5.327153206008904
driven_lanedir_consec_min4.611167706436042
driven_lanedir_max5.8223962690688085
driven_lanedir_mean5.560890784650249
driven_lanedir_median5.703499571898595
driven_lanedir_min5.014167725734996
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 5.021598392303173, "survival_time": 59.99999999999873, "driven_lanedir": 5.014167725734996, "in-drivable-lane": 0.0, "deviation-heading": 1.5868854715733702, "distance-from-start": 2.339170523946391, "deviation-center-line": 0.1827495883978732, "driven_lanedir_consec": 4.611167706436042}, "4way-000-ego1": {"driven_any": 5.831435519999375, "survival_time": 59.99999999999873, "driven_lanedir": 5.8223962690688085, "in-drivable-lane": 0.0, "deviation-heading": 1.537638141336496, "distance-from-start": 3.152836469048969, "deviation-center-line": 0.21132079357626976, "driven_lanedir_consec": 5.584035348945523}, "4way-000-ego2": {"driven_any": 5.707095572773834, "survival_time": 59.99999999999873, "driven_lanedir": 5.702153535639253, "in-drivable-lane": 0.0, "deviation-heading": 1.408146857012997, "distance-from-start": 2.3268051902656572, "deviation-center-line": 0.16092838970094706, "driven_lanedir_consec": 5.408564308009964}, "4way-000-ego3": {"driven_any": 5.708364817343881, "survival_time": 59.99999999999873, "driven_lanedir": 5.704845608157938, "in-drivable-lane": 0.0, "deviation-heading": 1.2723760660616197, "distance-from-start": 2.943309098001367, "deviation-center-line": 0.1424627776265016, "driven_lanedir_consec": 5.704845460644086}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14784819Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-validation453successnodavinci-stage-02-6.2.500:09:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median2.7372244334470075
deviation-center-line_median0.2771233982146609


other stats
deviation-center-line_max0.8883814569309316
deviation-center-line_mean0.4088139596142858
deviation-center-line_min0.19262758509688985
deviation-heading_max13.914341154718024
deviation-heading_mean6.058326255658913
deviation-heading_median4.2089424310191035
deviation-heading_min1.9010790058794211
distance-from-start_max3.743285395820417
distance-from-start_mean2.17031392915282
distance-from-start_median2.468985160395432
distance-from-start_min4.965068306494546e-16
driven_any_max4.974258745269733
driven_any_mean2.615314125231832
driven_any_median2.743498877828499
driven_any_min5.95808196779335e-13
driven_lanedir_consec_max4.964125114603954
driven_lanedir_consec_mean2.6096434953744923
driven_lanedir_consec_min0.0
driven_lanedir_max4.964125114603954
driven_lanedir_mean2.6096434953744923
driven_lanedir_median2.7372244334470075
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 4.974258745269733, "survival_time": 59.99999999999873, "driven_lanedir": 4.964125114603954, "in-drivable-lane": 0.0, "deviation-heading": 1.9010790058794211, "distance-from-start": 3.743285395820417, "deviation-center-line": 0.2165270599200428, "driven_lanedir_consec": 4.964125114603954}, "autolab-000-ego1": {"driven_any": 3.0960726438909765, "survival_time": 59.99999999999873, "driven_lanedir": 3.087030709029612, "in-drivable-lane": 0.0, "deviation-heading": 2.4605577770793636, "distance-from-start": 2.569485866935876, "deviation-center-line": 0.19262758509688985, "driven_lanedir_consec": 3.087030709029612}, "autolab-000-ego2": {"driven_any": 2.3909251117660224, "survival_time": 59.99999999999873, "driven_lanedir": 2.387418157864403, "in-drivable-lane": 0.0, "deviation-heading": 5.957327084958843, "distance-from-start": 2.368484453854988, "deviation-center-line": 0.8883814569309316, "driven_lanedir_consec": 2.387418157864403}, "autolab-000-ego3": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 13.914341154718024, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.337719736509279, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14780820Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:03:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median32.250000000000306
in-drivable-lane_median0.0
driven_lanedir_consec_median3.064552505017095
deviation-center-line_median0.2147705908085717


other stats
deviation-center-line_max0.2147705908085717
deviation-center-line_mean0.2147705908085717
deviation-center-line_min0.2147705908085717
deviation-heading_max2.0427908857831625
deviation-heading_mean2.0427908857831625
deviation-heading_median2.0427908857831625
deviation-heading_min2.0427908857831625
distance-from-start_max2.4774569280358056
distance-from-start_mean2.4774569280358056
distance-from-start_median2.4774569280358056
distance-from-start_min2.4774569280358056
driven_any_max3.0766443175721947
driven_any_mean3.0766443175721947
driven_any_median3.0766443175721947
driven_any_min3.0766443175721947
driven_lanedir_consec_max3.064552505017095
driven_lanedir_consec_mean3.064552505017095
driven_lanedir_consec_min3.064552505017095
driven_lanedir_max3.064552505017095
driven_lanedir_mean3.064552505017095
driven_lanedir_median3.064552505017095
driven_lanedir_min3.064552505017095
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.0766443175721947, "survival_time": 32.250000000000306, "driven_lanedir": 3.064552505017095, "in-drivable-lane": 0.0, "deviation-heading": 2.0427908857831625, "distance-from-start": 2.4774569280358056, "deviation-center-line": 0.2147705908085717, "driven_lanedir_consec": 3.064552505017095}}
simulation-passed1
survival_time_max32.250000000000306
survival_time_mean32.250000000000306
survival_time_min32.250000000000306
No reset possible
14774821Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:03:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.667494145070765
deviation-center-line_median0.2625618403675503


other stats
deviation-center-line_max0.2625618403675503
deviation-center-line_mean0.2625618403675503
deviation-center-line_min0.2625618403675503
deviation-heading_max2.4450188093470064
deviation-heading_mean2.4450188093470064
deviation-heading_median2.4450188093470064
deviation-heading_min2.4450188093470064
distance-from-start_max1.5213034236679508
distance-from-start_mean1.5213034236679508
distance-from-start_median1.5213034236679508
distance-from-start_min1.5213034236679508
driven_any_max5.681963014330128
driven_any_mean5.681963014330128
driven_any_median5.681963014330128
driven_any_min5.681963014330128
driven_lanedir_consec_max5.667494145070765
driven_lanedir_consec_mean5.667494145070765
driven_lanedir_consec_min5.667494145070765
driven_lanedir_max5.667494145070765
driven_lanedir_mean5.667494145070765
driven_lanedir_median5.667494145070765
driven_lanedir_min5.667494145070765
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 5.681963014330128, "survival_time": 59.99999999999873, "driven_lanedir": 5.667494145070765, "in-drivable-lane": 0.0, "deviation-heading": 2.4450188093470064, "distance-from-start": 1.5213034236679508, "deviation-center-line": 0.2625618403675503, "driven_lanedir_consec": 5.667494145070765}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14770822Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-testingsim-0of4successnodavinci-stage-02-6.2.500:05:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.4065102356187873


other stats
deviation-center-line_max0.4065102356187873
deviation-center-line_mean0.4065102356187873
deviation-center-line_min0.4065102356187873
deviation-heading_max40.967332753486225
deviation-heading_mean40.967332753486225
deviation-heading_median40.967332753486225
deviation-heading_min40.967332753486225
distance-from-start_max7.63278329429795e-17
distance-from-start_mean7.63278329429795e-17
distance-from-start_median7.63278329429795e-17
distance-from-start_min7.63278329429795e-17
driven_any_max9.15933995315754e-14
driven_any_mean9.15933995315754e-14
driven_any_median9.15933995315754e-14
driven_any_min9.15933995315754e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 9.15933995315754e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 7.63278329429795e-17, "deviation-center-line": 0.4065102356187873, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14768822Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:01:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14763824Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-testingsim-1of4successnodavinci-stage-02-6.2.500:09:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.40653839040804857


other stats
deviation-center-line_max0.40653839040804857
deviation-center-line_mean0.40653839040804857
deviation-center-line_min0.40653839040804857
deviation-heading_max40.967332753486254
deviation-heading_mean40.967332753486254
deviation-heading_median40.967332753486254
deviation-heading_min40.967332753486254
distance-from-start_max1.1102230246251563e-16
distance-from-start_mean1.1102230246251563e-16
distance-from-start_median1.1102230246251563e-16
distance-from-start_min1.1102230246251563e-16
driven_any_max1.3322676295501878e-13
driven_any_mean1.3322676295501878e-13
driven_any_median1.3322676295501878e-13
driven_any_min1.3322676295501878e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 0.40653839040804857, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14758825Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:10:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median2.354121751024167
deviation-center-line_median1.5907898424502358


other stats
deviation-center-line_max3.468394386342305
deviation-center-line_mean1.7204870668180092
deviation-center-line_min0.23197419602925975
deviation-heading_max37.822937304744066
deviation-heading_mean15.410893192415545
deviation-heading_median10.924693244125017
deviation-heading_min1.9712489766680776
distance-from-start_max4.757326687346635
distance-from-start_mean1.9702948065027592
distance-from-start_median1.5619262693322007
distance-from-start_min2.220446049250313e-16
driven_any_max5.8896577604958456
driven_any_mean2.651059104566359
driven_any_median2.357289328884662
driven_any_min2.6645352591003757e-13
driven_lanedir_consec_max5.867756494746063
driven_lanedir_consec_mean2.6439994058236502
driven_lanedir_consec_min-2.3734997967039817e-06
driven_lanedir_max5.867756494746063
driven_lanedir_mean2.6439994058236502
driven_lanedir_median2.354121751024167
driven_lanedir_min-2.3734997967039817e-06
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.8896577604958456, "survival_time": 59.99999999999873, "driven_lanedir": 5.867756494746063, "in-drivable-lane": 0.0, "deviation-heading": 3.5399584722448916, "distance-from-start": 4.757326687346635, "deviation-center-line": 0.4191165927509713, "driven_lanedir_consec": 5.867756494746063}, "zigzag-000-ego1": {"driven_any": 5.49308015822675e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005143, "distance-from-start": 4.577566798522237e-16, "deviation-center-line": 3.468394386342305, "driven_lanedir_consec": 0.0}, "zigzag-000-ego2": {"driven_any": 4.714578657768775, "survival_time": 59.99999999999873, "driven_lanedir": 4.708243502048335, "in-drivable-lane": 0.0, "deviation-heading": 1.9712489766680776, "distance-from-start": 3.123852538664401, "deviation-center-line": 0.23197419602925975, "driven_lanedir_consec": 4.708243502048335}, "zigzag-000-ego3": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": -2.3734997967039817e-06, "in-drivable-lane": 0.0, "deviation-heading": 37.822937304744066, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 2.7624630921495004, "driven_lanedir_consec": -2.3734997967039817e-06}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14755825Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:04:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.007019068997936
deviation-center-line_median0.38011035127619336


other stats
deviation-center-line_max0.4837985399042229
deviation-center-line_mean0.38011035127619336
deviation-center-line_min0.2764221626481639
deviation-heading_max3.0253232596119735
deviation-heading_mean2.714016045259945
deviation-heading_median2.714016045259945
deviation-heading_min2.4027088309079163
distance-from-start_max1.521674143069448
distance-from-start_mean1.2769944684334753
distance-from-start_median1.2769944684334753
distance-from-start_min1.0323147937975024
driven_any_max5.08623281214027
driven_any_mean5.021228797880976
driven_any_median5.021228797880976
driven_any_min4.956224783621684
driven_lanedir_consec_max5.0705723110226515
driven_lanedir_consec_mean5.007019068997936
driven_lanedir_consec_min4.94346582697322
driven_lanedir_max5.0705723110226515
driven_lanedir_mean5.007019068997936
driven_lanedir_median5.007019068997936
driven_lanedir_min4.94346582697322
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 4.956224783621684, "survival_time": 59.99999999999873, "driven_lanedir": 4.94346582697322, "in-drivable-lane": 0.0, "deviation-heading": 2.4027088309079163, "distance-from-start": 1.521674143069448, "deviation-center-line": 0.2764221626481639, "driven_lanedir_consec": 4.94346582697322}, "loop2-000-ego1": {"driven_any": 5.08623281214027, "survival_time": 59.99999999999873, "driven_lanedir": 5.0705723110226515, "in-drivable-lane": 0.0, "deviation-heading": 3.0253232596119735, "distance-from-start": 1.0323147937975024, "deviation-center-line": 0.4837985399042229, "driven_lanedir_consec": 5.0705723110226515}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14749827Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-testingsim-1of4successnodavinci-stage-02-6.2.500:09:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.268486692511211
deviation-center-line_median0.2677582178916847


other stats
deviation-center-line_max0.2677582178916847
deviation-center-line_mean0.2677582178916847
deviation-center-line_min0.2677582178916847
deviation-heading_max2.3862148122965765
deviation-heading_mean2.3862148122965765
deviation-heading_median2.3862148122965765
deviation-heading_min2.3862148122965765
distance-from-start_max3.215326192663788
distance-from-start_mean3.215326192663788
distance-from-start_median3.215326192663788
distance-from-start_min3.215326192663788
driven_any_max5.282829526436911
driven_any_mean5.282829526436911
driven_any_median5.282829526436911
driven_any_min5.282829526436911
driven_lanedir_consec_max5.268486692511211
driven_lanedir_consec_mean5.268486692511211
driven_lanedir_consec_min5.268486692511211
driven_lanedir_max5.268486692511211
driven_lanedir_mean5.268486692511211
driven_lanedir_median5.268486692511211
driven_lanedir_min5.268486692511211
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 5.282829526436911, "survival_time": 59.99999999999873, "driven_lanedir": 5.268486692511211, "in-drivable-lane": 0.0, "deviation-heading": 2.3862148122965765, "distance-from-start": 3.215326192663788, "deviation-center-line": 0.2677582178916847, "driven_lanedir_consec": 5.268486692511211}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14747828Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-testingsim-1of4successnodavinci-stage-02-6.2.500:01:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.499999999999986
in-drivable-lane_median0.0
driven_lanedir_consec_median0.7152019553352842
deviation-center-line_median0.09388648296550528


other stats
deviation-center-line_max0.09388648296550528
deviation-center-line_mean0.09388648296550528
deviation-center-line_min0.09388648296550528
deviation-heading_max0.944239660915932
deviation-heading_mean0.944239660915932
deviation-heading_median0.944239660915932
deviation-heading_min0.944239660915932
distance-from-start_max0.7152240362894687
distance-from-start_mean0.7152240362894687
distance-from-start_median0.7152240362894687
distance-from-start_min0.7152240362894687
driven_any_max0.7257895926659109
driven_any_mean0.7257895926659109
driven_any_median0.7257895926659109
driven_any_min0.7257895926659109
driven_lanedir_consec_max0.7152019553352842
driven_lanedir_consec_mean0.7152019553352842
driven_lanedir_consec_min0.7152019553352842
driven_lanedir_max0.7152019553352842
driven_lanedir_mean0.7152019553352842
driven_lanedir_median0.7152019553352842
driven_lanedir_min0.7152019553352842
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 0.7257895926659109, "survival_time": 8.499999999999986, "driven_lanedir": 0.7152019553352842, "in-drivable-lane": 0.0, "deviation-heading": 0.944239660915932, "distance-from-start": 0.7152240362894687, "deviation-center-line": 0.09388648296550528, "driven_lanedir_consec": 0.7152019553352842}}
simulation-passed1
survival_time_max8.499999999999986
survival_time_mean8.499999999999986
survival_time_min8.499999999999986
No reset possible
14745828Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-testingsim-0of4successnodavinci-stage-02-6.2.500:01:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.800000000000004
in-drivable-lane_median0.0
driven_lanedir_consec_median0.838943310921324
deviation-center-line_median0.1433047164551813


other stats
deviation-center-line_max0.1433047164551813
deviation-center-line_mean0.1433047164551813
deviation-center-line_min0.1433047164551813
deviation-heading_max1.2694840494293371
deviation-heading_mean1.2694840494293371
deviation-heading_median1.2694840494293371
deviation-heading_min1.2694840494293371
distance-from-start_max0.6851393057632532
distance-from-start_mean0.6851393057632532
distance-from-start_median0.6851393057632532
distance-from-start_min0.6851393057632532
driven_any_max0.8503814872464346
driven_any_mean0.8503814872464346
driven_any_median0.8503814872464346
driven_any_min0.8503814872464346
driven_lanedir_consec_max0.838943310921324
driven_lanedir_consec_mean0.838943310921324
driven_lanedir_consec_min0.838943310921324
driven_lanedir_max0.838943310921324
driven_lanedir_mean0.838943310921324
driven_lanedir_median0.838943310921324
driven_lanedir_min0.838943310921324
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.8503814872464346, "survival_time": 9.800000000000004, "driven_lanedir": 0.838943310921324, "in-drivable-lane": 0.0, "deviation-heading": 1.2694840494293371, "distance-from-start": 0.6851393057632532, "deviation-center-line": 0.1433047164551813, "driven_lanedir_consec": 0.838943310921324}}
simulation-passed1
survival_time_max9.800000000000004
survival_time_mean9.800000000000004
survival_time_min9.800000000000004
No reset possible
14744828Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:02:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median20.250000000000153
in-drivable-lane_median0.0
driven_lanedir_consec_median1.822088964337002
deviation-center-line_median0.20357564547105955


other stats
deviation-center-line_max0.20357564547105955
deviation-center-line_mean0.20357564547105955
deviation-center-line_min0.20357564547105955
deviation-heading_max1.6073324247192475
deviation-heading_mean1.6073324247192475
deviation-heading_median1.6073324247192475
deviation-heading_min1.6073324247192475
distance-from-start_max1.059982869303493
distance-from-start_mean1.059982869303493
distance-from-start_median1.059982869303493
distance-from-start_min1.059982869303493
driven_any_max1.8350627704817688
driven_any_mean1.8350627704817688
driven_any_median1.8350627704817688
driven_any_min1.8350627704817688
driven_lanedir_consec_max1.822088964337002
driven_lanedir_consec_mean1.822088964337002
driven_lanedir_consec_min1.822088964337002
driven_lanedir_max1.822088964337002
driven_lanedir_mean1.822088964337002
driven_lanedir_median1.822088964337002
driven_lanedir_min1.822088964337002
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.8350627704817688, "survival_time": 20.250000000000153, "driven_lanedir": 1.822088964337002, "in-drivable-lane": 0.0, "deviation-heading": 1.6073324247192475, "distance-from-start": 1.059982869303493, "deviation-center-line": 0.20357564547105955, "driven_lanedir_consec": 1.822088964337002}}
simulation-passed1
survival_time_max20.250000000000153
survival_time_mean20.250000000000153
survival_time_min20.250000000000153
No reset possible
14743910Bea Baselines 🐤baseline-solutionlx22-planning-dd-dynamic-valistep1-3of4successyesdavinci-stage-02-6.2.500:00:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
14736911Bea Baselines 🐤baseline-solutionlx22-planning-dd-static-valistep1-1of4erroryesdavinci-stage-02-6.2.500:17:10
Waited 1005 seconds [...]
Waited 1005 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14726915Bea Baselines 🐤baseline-solutionlx22-planning-cc-empty-valistep1successyesdavinci-stage-02-6.2.500:09:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.925925925925926
success_ratio1.0
duration8.696897525204344
complexity16.48148148148148
avg_min_distance0.8613658087096335


other stats
nfeasible27
nsamples27
No reset possible
14725916Bea Baselines 🐤baseline-solutionlx22-planning-dd-dynamic-teststep1-2of4successyesdavinci-stage-02-6.2.500:00:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
14719917Bea Baselines 🐤baseline-solutionlx22-planning-dd-static-teststep1-1of4erroryesdavinci-stage-02-6.2.500:17:08
Waited 1006 seconds [...]
Waited 1006 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14708920Bea Baselines 🐤baseline-solutionlx22-planning-cc-static-teststep1-0of4successyesdavinci-stage-02-6.2.500:12:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration41.981813632891274
complexity92.66666666666669
avg_min_distance0.20869066973913075


other stats
nfeasible3
nsamples3
No reset possible
14705929Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:03:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.55000000000003
in-drivable-lane_median3.2500000000000204
driven_lanedir_consec_median1.0092423687054697
deviation-center-line_median0.9358459939908108


other stats
deviation-center-line_max0.9358459939908108
deviation-center-line_mean0.9358459939908108
deviation-center-line_min0.9358459939908108
deviation-heading_max1.935632653431997
deviation-heading_mean1.935632653431997
deviation-heading_median1.935632653431997
deviation-heading_min1.935632653431997
distance-from-start_max0.936061302715732
distance-from-start_mean0.936061302715732
distance-from-start_median0.936061302715732
distance-from-start_min0.936061302715732
driven_any_max1.3887279634584986
driven_any_mean1.3887279634584986
driven_any_median1.3887279634584986
driven_any_min1.3887279634584986
driven_lanedir_consec_max1.0092423687054697
driven_lanedir_consec_mean1.0092423687054697
driven_lanedir_consec_min1.0092423687054697
driven_lanedir_max1.0092423687054697
driven_lanedir_mean1.0092423687054697
driven_lanedir_median1.0092423687054697
driven_lanedir_min1.0092423687054697
in-drivable-lane_max3.2500000000000204
in-drivable-lane_mean3.2500000000000204
in-drivable-lane_min3.2500000000000204
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.3887279634584986, "survival_time": 11.55000000000003, "driven_lanedir": 1.0092423687054697, "in-drivable-lane": 3.2500000000000204, "deviation-heading": 1.935632653431997, "distance-from-start": 0.936061302715732, "deviation-center-line": 0.9358459939908108, "driven_lanedir_consec": 1.0092423687054697}}
simulation-passed1
survival_time_max11.55000000000003
survival_time_mean11.55000000000003
survival_time_min11.55000000000003
No reset possible
14702929Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-0of4successnodavinci-stage-02-6.2.500:02:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.4499999999999993
in-drivable-lane_median0.0
driven_lanedir_consec_median0.15778105885585747
deviation-center-line_median0.1825974799911933


other stats
deviation-center-line_max0.1825974799911933
deviation-center-line_mean0.1825974799911933
deviation-center-line_min0.1825974799911933
deviation-heading_max1.192776387505315
deviation-heading_mean1.192776387505315
deviation-heading_median1.192776387505315
deviation-heading_min1.192776387505315
distance-from-start_max0.18054233214989923
distance-from-start_mean0.18054233214989923
distance-from-start_median0.18054233214989923
distance-from-start_min0.18054233214989923
driven_any_max0.1805821559607532
driven_any_mean0.1805821559607532
driven_any_median0.1805821559607532
driven_any_min0.1805821559607532
driven_lanedir_consec_max0.15778105885585747
driven_lanedir_consec_mean0.15778105885585747
driven_lanedir_consec_min0.15778105885585747
driven_lanedir_max0.15778105885585747
driven_lanedir_mean0.15778105885585747
driven_lanedir_median0.15778105885585747
driven_lanedir_min0.15778105885585747
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.1805821559607532, "survival_time": 2.4499999999999993, "driven_lanedir": 0.15778105885585747, "in-drivable-lane": 0.0, "deviation-heading": 1.192776387505315, "distance-from-start": 0.18054233214989923, "deviation-center-line": 0.1825974799911933, "driven_lanedir_consec": 0.15778105885585747}}
simulation-passed1
survival_time_max2.4499999999999993
survival_time_mean2.4499999999999993
survival_time_min2.4499999999999993
No reset possible
14699930Bea Baselines 🐤baseline-duckietownaido-LF-sim-validationsim-0of4successnodavinci-stage-02-6.2.500:04:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median0.8948975282352575
in-drivable-lane_median0.0


other stats
deviation-center-line_max0.8948975282352575
deviation-center-line_mean0.8948975282352575
deviation-center-line_min0.8948975282352575
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max4.440892098500626e-16
distance-from-start_mean4.440892098500626e-16
distance-from-start_median4.440892098500626e-16
distance-from-start_min4.440892098500626e-16
driven_any_max5.329070518200751e-13
driven_any_mean5.329070518200751e-13
driven_any_median5.329070518200751e-13
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.8948975282352575, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14694960Bea Baselines 🐤template-pytorchaido-LFV-sim-validationsim-1of4successnodavinci-stage-02-6.2.500:04:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.950000000000047
in-drivable-lane_median6.100000000000039
driven_lanedir_consec_median0.7578723342556994
deviation-center-line_median0.3660789509162128


other stats
deviation-center-line_max0.3660789509162128
deviation-center-line_mean0.3660789509162128
deviation-center-line_min0.3660789509162128
deviation-heading_max5.2705366997874
deviation-heading_mean5.2705366997874
deviation-heading_median5.2705366997874
deviation-heading_min5.2705366997874
distance-from-start_max0.2284470048273289
distance-from-start_mean0.2284470048273289
distance-from-start_median0.2284470048273289
distance-from-start_min0.2284470048273289
driven_any_max2.0622904885313424
driven_any_mean2.0622904885313424
driven_any_median2.0622904885313424
driven_any_min2.0622904885313424
driven_lanedir_consec_max0.7578723342556994
driven_lanedir_consec_mean0.7578723342556994
driven_lanedir_consec_min0.7578723342556994
driven_lanedir_max0.7578723342556994
driven_lanedir_mean0.7578723342556994
driven_lanedir_median0.7578723342556994
driven_lanedir_min0.7578723342556994
in-drivable-lane_max6.100000000000039
in-drivable-lane_mean6.100000000000039
in-drivable-lane_min6.100000000000039
per-episodes
details{"loop-000-ego0": {"driven_any": 2.0622904885313424, "survival_time": 12.950000000000047, "driven_lanedir": 0.7578723342556994, "in-drivable-lane": 6.100000000000039, "deviation-heading": 5.2705366997874, "distance-from-start": 0.2284470048273289, "deviation-center-line": 0.3660789509162128, "driven_lanedir_consec": 0.7578723342556994}}
simulation-passed1
survival_time_max12.950000000000047
survival_time_mean12.950000000000047
survival_time_min12.950000000000047
No reset possible
14689962Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-1of4successnodavinci-stage-02-6.2.500:06:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median35.75000000000011
in-drivable-lane_median20.650000000000095
driven_lanedir_consec_median0.4992261780662304
deviation-center-line_median1.412204598018227


other stats
deviation-center-line_max1.412204598018227
deviation-center-line_mean1.412204598018227
deviation-center-line_min1.412204598018227
deviation-heading_max12.10352117711134
deviation-heading_mean12.10352117711134
deviation-heading_median12.10352117711134
deviation-heading_min12.10352117711134
distance-from-start_max0.43045830147671144
distance-from-start_mean0.43045830147671144
distance-from-start_median0.43045830147671144
distance-from-start_min0.43045830147671144
driven_any_max4.695020619885823
driven_any_mean4.695020619885823
driven_any_median4.695020619885823
driven_any_min4.695020619885823
driven_lanedir_consec_max0.4992261780662304
driven_lanedir_consec_mean0.4992261780662304
driven_lanedir_consec_min0.4992261780662304
driven_lanedir_max1.285718384369019
driven_lanedir_mean1.285718384369019
driven_lanedir_median1.285718384369019
driven_lanedir_min1.285718384369019
in-drivable-lane_max20.650000000000095
in-drivable-lane_mean20.650000000000095
in-drivable-lane_min20.650000000000095
per-episodes
details{"udem1-000-ego0": {"driven_any": 4.695020619885823, "survival_time": 35.75000000000011, "driven_lanedir": 1.285718384369019, "in-drivable-lane": 20.650000000000095, "deviation-heading": 12.10352117711134, "distance-from-start": 0.43045830147671144, "deviation-center-line": 1.412204598018227, "driven_lanedir_consec": 0.4992261780662304}}
simulation-passed1
survival_time_max35.75000000000011
survival_time_mean35.75000000000011
survival_time_min35.75000000000011
No reset possible
14688962Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14685963Bea Baselines 🐤template-pytorchaido-LF-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:08:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.31277397567606324
survival_time_median59.99999999999873
deviation-center-line_median0.36626095602978026
in-drivable-lane_median55.14999999999873


other stats
deviation-center-line_max0.36626095602978026
deviation-center-line_mean0.36626095602978026
deviation-center-line_min0.36626095602978026
deviation-heading_max3.6837129061939664
deviation-heading_mean3.6837129061939664
deviation-heading_median3.6837129061939664
deviation-heading_min3.6837129061939664
distance-from-start_max0.5233520466654699
distance-from-start_mean0.5233520466654699
distance-from-start_median0.5233520466654699
distance-from-start_min0.5233520466654699
driven_any_max6.581822161812802
driven_any_mean6.581822161812802
driven_any_median6.581822161812802
driven_any_min6.581822161812802
driven_lanedir_consec_max0.31277397567606324
driven_lanedir_consec_mean0.31277397567606324
driven_lanedir_consec_min0.31277397567606324
driven_lanedir_max0.31277397567606324
driven_lanedir_mean0.31277397567606324
driven_lanedir_median0.31277397567606324
driven_lanedir_min0.31277397567606324
in-drivable-lane_max55.14999999999873
in-drivable-lane_mean55.14999999999873
in-drivable-lane_min55.14999999999873
per-episodes
details{"zigzag-000-ego0": {"driven_any": 6.581822161812802, "survival_time": 59.99999999999873, "driven_lanedir": 0.31277397567606324, "in-drivable-lane": 55.14999999999873, "deviation-heading": 3.6837129061939664, "distance-from-start": 0.5233520466654699, "deviation-center-line": 0.36626095602978026, "driven_lanedir_consec": 0.31277397567606324}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14673965Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-validationsim-1of4successnodavinci-stage-02-6.2.500:25:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median51.89999999999873
driven_lanedir_consec_median0.4219479383323895
deviation-center-line_median0.6552332397383244


other stats
deviation-center-line_max2.1354656799639917
deviation-center-line_mean0.8807044171409512
deviation-center-line_min0.07688550912316428
deviation-heading_max19.191055196594135
deviation-heading_mean8.712344556824508
deviation-heading_median7.500573949875394
deviation-heading_min0.6571751309531059
distance-from-start_max1.7388267129049388
distance-from-start_mean0.7784539620841036
distance-from-start_median0.4772468973376055
distance-from-start_min0.42049534075626416
driven_any_max9.718908251513904
driven_any_mean6.551937996972358
driven_any_median8.01721028751998
driven_any_min0.4544231613355677
driven_lanedir_consec_max0.9898570762797758
driven_lanedir_consec_mean0.5048594278586135
driven_lanedir_consec_min0.18568475848989907
driven_lanedir_max2.104405441192208
driven_lanedir_mean0.9214820054228396
driven_lanedir_median0.6979189110046259
driven_lanedir_min0.18568475848989907
in-drivable-lane_max58.74999999999873
in-drivable-lane_mean49.83749999999889
in-drivable-lane_min36.799999999999386
per-episodes
details{"loop-000-ego0": {"driven_any": 9.718908251513904, "survival_time": 59.99999999999873, "driven_lanedir": 0.9898570762797758, "in-drivable-lane": 51.84999999999871, "deviation-heading": 7.168482802360092, "distance-from-start": 1.7388267129049388, "deviation-center-line": 0.6811108595565121, "driven_lanedir_consec": 0.9898570762797758}, "loop-000-ego1": {"driven_any": 6.397932766519532, "survival_time": 59.99999999999873, "driven_lanedir": 0.405980745729476, "in-drivable-lane": 51.94999999999875, "deviation-heading": 7.832665097390696, "distance-from-start": 0.42049534075626416, "deviation-center-line": 0.6293556199201367, "driven_lanedir_consec": 0.3826230743662813}, "loop-000-ego2": {"driven_any": 0.4544231613355677, "survival_time": 59.99999999999873, "driven_lanedir": 0.18568475848989907, "in-drivable-lane": 58.74999999999873, "deviation-heading": 0.6571751309531059, "distance-from-start": 0.4295440898511105, "deviation-center-line": 0.07688550912316428, "driven_lanedir_consec": 0.18568475848989907}, "loop-000-ego3": {"driven_any": 9.636487808520426, "survival_time": 59.99999999999873, "driven_lanedir": 2.104405441192208, "in-drivable-lane": 36.799999999999386, "deviation-heading": 19.191055196594135, "distance-from-start": 0.5249497048241005, "deviation-center-line": 2.1354656799639917, "driven_lanedir_consec": 0.46127280229849776}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14667972Bea Baselines 🐤template-pytorchaido-LFV-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:09:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median44.49999999999887
driven_lanedir_consec_median1.275112529237865
deviation-center-line_median1.9098469559763471


other stats
deviation-center-line_max1.9098469559763471
deviation-center-line_mean1.9098469559763471
deviation-center-line_min1.9098469559763471
deviation-heading_max8.197119146755627
deviation-heading_mean8.197119146755627
deviation-heading_median8.197119146755627
deviation-heading_min8.197119146755627
distance-from-start_max0.2726905729863136
distance-from-start_mean0.2726905729863136
distance-from-start_median0.2726905729863136
distance-from-start_min0.2726905729863136
driven_any_max6.438840049038714
driven_any_mean6.438840049038714
driven_any_median6.438840049038714
driven_any_min6.438840049038714
driven_lanedir_consec_max1.275112529237865
driven_lanedir_consec_mean1.275112529237865
driven_lanedir_consec_min1.275112529237865
driven_lanedir_max1.275112529237865
driven_lanedir_mean1.275112529237865
driven_lanedir_median1.275112529237865
driven_lanedir_min1.275112529237865
in-drivable-lane_max44.49999999999887
in-drivable-lane_mean44.49999999999887
in-drivable-lane_min44.49999999999887
per-episodes
details{"loop2-000-ego0": {"driven_any": 6.438840049038714, "survival_time": 59.99999999999873, "driven_lanedir": 1.275112529237865, "in-drivable-lane": 44.49999999999887, "deviation-heading": 8.197119146755627, "distance-from-start": 0.2726905729863136, "deviation-center-line": 1.9098469559763471, "driven_lanedir_consec": 1.275112529237865}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14664973Bea Baselines 🐤template-pytorchaido-LFVI-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14660974Bea Baselines 🐤template-pytorchaido-LFI-sim-testingsim-1of4successnodavinci-stage-02-6.2.500:02:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.099999999999997
in-drivable-lane_median1.299999999999996
driven_lanedir_consec_median0.16555922509673815
deviation-center-line_median0.07432785663217469


other stats
deviation-center-line_max0.07432785663217469
deviation-center-line_mean0.07432785663217469
deviation-center-line_min0.07432785663217469
deviation-heading_max1.206556767981284
deviation-heading_mean1.206556767981284
deviation-heading_median1.206556767981284
deviation-heading_min1.206556767981284
distance-from-start_max0.2690085594230952
distance-from-start_mean0.2690085594230952
distance-from-start_median0.2690085594230952
distance-from-start_min0.2690085594230952
driven_any_max0.3849010274744384
driven_any_mean0.3849010274744384
driven_any_median0.3849010274744384
driven_any_min0.3849010274744384
driven_lanedir_consec_max0.16555922509673815
driven_lanedir_consec_mean0.16555922509673815
driven_lanedir_consec_min0.16555922509673815
driven_lanedir_max0.16555922509673815
driven_lanedir_mean0.16555922509673815
driven_lanedir_median0.16555922509673815
driven_lanedir_min0.16555922509673815
in-drivable-lane_max1.299999999999996
in-drivable-lane_mean1.299999999999996
in-drivable-lane_min1.299999999999996
per-episodes
details{"udem1-000-ego0": {"driven_any": 0.3849010274744384, "survival_time": 3.099999999999997, "driven_lanedir": 0.16555922509673815, "in-drivable-lane": 1.299999999999996, "deviation-heading": 1.206556767981284, "distance-from-start": 0.2690085594230952, "deviation-center-line": 0.07432785663217469, "driven_lanedir_consec": 0.16555922509673815}}
simulation-passed1
survival_time_max3.099999999999997
survival_time_mean3.099999999999997
survival_time_min3.099999999999997
No reset possible
14657974Bea Baselines 🐤template-pytorchaido-LFI-sim-testingsim-0of4errornodavinci-stage-02-6.2.500:02:09
InvalidEvaluator: co [...]
InvalidEvaluator:
concurrent.futures.process._RemoteTraceback: 
"""
Traceback (most recent call last):
  File "/usr/lib/python3.8/concurrent/futures/process.py", line 239, in _process_worker
    r = call_item.fn(*call_item.args, **call_item.kwargs)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 461, in robot_stats
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/dist-packages/aido_analyze/utils_drawing.py", line 415, in read_and_draw
    draw_static(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_world/svg_drawing/misc.py", line 166, in draw_static
    os.makedirs(output_dir)
  File "/usr/lib/python3.8/os.py", line 223, in makedirs
    mkdir(name, mode)
FileExistsError: [Errno 17] File exists: '/challenges/challenge-evaluation-output/episodes/4way-000/ego0'
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 392, in main
    stats = future.result()
  File "/usr/lib/python3.8/concurrent/futures/_base.py", line 444, in result
    return self.__get_result()
  File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result
    raise self._exception
FileExistsError: [Errno 17] File exists: '/challenges/challenge-evaluation-output/episodes/4way-000/ego0'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14656975Bea Baselines 🐤template-pytorchaido-LF-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:02:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4510734280384028
survival_time_median11.200000000000024
deviation-center-line_median0.3228792321811753
in-drivable-lane_median6.850000000000026


other stats
deviation-center-line_max0.3228792321811753
deviation-center-line_mean0.3228792321811753
deviation-center-line_min0.3228792321811753
deviation-heading_max2.8757259163739244
deviation-heading_mean2.8757259163739244
deviation-heading_median2.8757259163739244
deviation-heading_min2.8757259163739244
distance-from-start_max0.3823062928535451
distance-from-start_mean0.3823062928535451
distance-from-start_median0.3823062928535451
distance-from-start_min0.3823062928535451
driven_any_max1.717474769549143
driven_any_mean1.717474769549143
driven_any_median1.717474769549143
driven_any_min1.717474769549143
driven_lanedir_consec_max0.4510734280384028
driven_lanedir_consec_mean0.4510734280384028
driven_lanedir_consec_min0.4510734280384028
driven_lanedir_max0.4510734280384028
driven_lanedir_mean0.4510734280384028
driven_lanedir_median0.4510734280384028
driven_lanedir_min0.4510734280384028
in-drivable-lane_max6.850000000000026
in-drivable-lane_mean6.850000000000026
in-drivable-lane_min6.850000000000026
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.717474769549143, "survival_time": 11.200000000000024, "driven_lanedir": 0.4510734280384028, "in-drivable-lane": 6.850000000000026, "deviation-heading": 2.8757259163739244, "distance-from-start": 0.3823062928535451, "deviation-center-line": 0.3228792321811753, "driven_lanedir_consec": 0.4510734280384028}}
simulation-passed1
survival_time_max11.200000000000024
survival_time_mean11.200000000000024
survival_time_min11.200000000000024
No reset possible
14645977Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:26:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median55.174999999998704
driven_lanedir_consec_median0.2376103346258527
deviation-center-line_median0.3741756778759469


other stats
deviation-center-line_max1.5442649764953436
deviation-center-line_mean0.5909730326749885
deviation-center-line_min0.07127579845271644
deviation-heading_max22.466994016464874
deviation-heading_mean7.415456494629024
deviation-heading_median3.2871254987047527
deviation-heading_min0.6205809646417138
distance-from-start_max0.4223442553179931
distance-from-start_mean0.2748772470473129
distance-from-start_median0.264584639252175
distance-from-start_min0.14799545436690853
driven_any_max5.2711449224479905
driven_any_mean2.4483396562388138
driven_any_median2.0974025358921367
driven_any_min0.32740863072299053
driven_lanedir_consec_max1.5812316371511206
driven_lanedir_consec_mean0.5329902240582959
driven_lanedir_consec_min0.07550858983035758
driven_lanedir_max1.5812316371511206
driven_lanedir_mean0.5329902240582959
driven_lanedir_median0.2376103346258527
driven_lanedir_min0.07550858983035758
in-drivable-lane_max59.19999999999872
in-drivable-lane_mean50.16249999999886
in-drivable-lane_min31.099999999999323
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.2711449224479905, "survival_time": 59.99999999999873, "driven_lanedir": 1.5812316371511206, "in-drivable-lane": 31.099999999999323, "deviation-heading": 22.466994016464874, "distance-from-start": 0.14799545436690853, "deviation-center-line": 1.5442649764953436, "driven_lanedir_consec": 1.5812316371511206}, "zigzag-000-ego1": {"driven_any": 3.859739389002126, "survival_time": 59.99999999999873, "driven_lanedir": 0.298418813842535, "in-drivable-lane": 51.84999999999867, "deviation-heading": 5.941011346412163, "distance-from-start": 0.4223442553179931, "deviation-center-line": 0.6729433861694782, "driven_lanedir_consec": 0.298418813842535}, "zigzag-000-ego2": {"driven_any": 0.3350656827821473, "survival_time": 59.99999999999873, "driven_lanedir": 0.17680185540917043, "in-drivable-lane": 58.49999999999873, "deviation-heading": 0.633239650997342, "distance-from-start": 0.251829073213982, "deviation-center-line": 0.07540796958241561, "driven_lanedir_consec": 0.17680185540917043}, "zigzag-000-ego3": {"driven_any": 0.32740863072299053, "survival_time": 59.99999999999873, "driven_lanedir": 0.07550858983035758, "in-drivable-lane": 59.19999999999872, "deviation-heading": 0.6205809646417138, "distance-from-start": 0.27734020529036796, "deviation-center-line": 0.07127579845271644, "driven_lanedir_consec": 0.07550858983035758}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14630982Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:13:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median2.6017417553703126e-06
deviation-center-line_median0.8949077950231444


other stats
deviation-center-line_max0.8949077950231444
deviation-center-line_mean0.8949077950231444
deviation-center-line_min0.8949077950231444
deviation-heading_max32.24912799874442
deviation-heading_mean32.24912799874442
deviation-heading_median32.24912799874442
deviation-heading_min32.24912799874442
distance-from-start_max4.440892098500626e-16
distance-from-start_mean4.440892098500626e-16
distance-from-start_median4.440892098500626e-16
distance-from-start_min4.440892098500626e-16
driven_any_max5.329070518200751e-13
driven_any_mean5.329070518200751e-13
driven_any_median5.329070518200751e-13
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max2.6017417553703126e-06
driven_lanedir_consec_mean2.6017417553703126e-06
driven_lanedir_consec_min2.6017417553703126e-06
driven_lanedir_max2.6017417553703126e-06
driven_lanedir_mean2.6017417553703126e-06
driven_lanedir_median2.6017417553703126e-06
driven_lanedir_min2.6017417553703126e-06
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 2.6017417553703126e-06, "in-drivable-lane": 0.0, "deviation-heading": 32.24912799874442, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.8949077950231444, "driven_lanedir_consec": 2.6017417553703126e-06}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14622986Bea Baselines 🐤baseline-duckietownaido-LF-sim-validationsim-1of4successnodavinci-stage-02-6.2.500:05:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.0974552079258615
survival_time_median59.99999999999873
deviation-center-line_median3.776302239570536
in-drivable-lane_median4.94999999999991


other stats
deviation-center-line_max3.776302239570536
deviation-center-line_mean3.776302239570536
deviation-center-line_min3.776302239570536
deviation-heading_max7.616558370628489
deviation-heading_mean7.616558370628489
deviation-heading_median7.616558370628489
deviation-heading_min7.616558370628489
distance-from-start_max2.6402040957469204
distance-from-start_mean2.6402040957469204
distance-from-start_median2.6402040957469204
distance-from-start_min2.6402040957469204
driven_any_max7.907937524874588
driven_any_mean7.907937524874588
driven_any_median7.907937524874588
driven_any_min7.907937524874588
driven_lanedir_consec_max7.0974552079258615
driven_lanedir_consec_mean7.0974552079258615
driven_lanedir_consec_min7.0974552079258615
driven_lanedir_max7.0974552079258615
driven_lanedir_mean7.0974552079258615
driven_lanedir_median7.0974552079258615
driven_lanedir_min7.0974552079258615
in-drivable-lane_max4.94999999999991
in-drivable-lane_mean4.94999999999991
in-drivable-lane_min4.94999999999991
per-episodes
details{"loop-000-ego0": {"driven_any": 7.907937524874588, "survival_time": 59.99999999999873, "driven_lanedir": 7.0974552079258615, "in-drivable-lane": 4.94999999999991, "deviation-heading": 7.616558370628489, "distance-from-start": 2.6402040957469204, "deviation-center-line": 3.776302239570536, "driven_lanedir_consec": 7.0974552079258615}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14618987Bea Baselines 🐤template-rosaido-LF-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2201802363267522
survival_time_median8.899999999999991
deviation-center-line_median0.22079209452663215
in-drivable-lane_median6.2499999999999964


other stats
deviation-center-line_max0.22079209452663215
deviation-center-line_mean0.22079209452663215
deviation-center-line_min0.22079209452663215
deviation-heading_max2.7535828884240026
deviation-heading_mean2.7535828884240026
deviation-heading_median2.7535828884240026
deviation-heading_min2.7535828884240026
distance-from-start_max2.0905260653461433
distance-from-start_mean2.0905260653461433
distance-from-start_median2.0905260653461433
distance-from-start_min2.0905260653461433
driven_any_max2.2774299684295833
driven_any_mean2.2774299684295833
driven_any_median2.2774299684295833
driven_any_min2.2774299684295833
driven_lanedir_consec_max0.2201802363267522
driven_lanedir_consec_mean0.2201802363267522
driven_lanedir_consec_min0.2201802363267522
driven_lanedir_max0.2718901679129948
driven_lanedir_mean0.2718901679129948
driven_lanedir_median0.2718901679129948
driven_lanedir_min0.2718901679129948
in-drivable-lane_max6.2499999999999964
in-drivable-lane_mean6.2499999999999964
in-drivable-lane_min6.2499999999999964
per-episodes
details{"zigzag-000-ego0": {"driven_any": 2.2774299684295833, "survival_time": 8.899999999999991, "driven_lanedir": 0.2718901679129948, "in-drivable-lane": 6.2499999999999964, "deviation-heading": 2.7535828884240026, "distance-from-start": 2.0905260653461433, "deviation-center-line": 0.22079209452663215, "driven_lanedir_consec": 0.2201802363267522}}
simulation-passed1
survival_time_max8.899999999999991
survival_time_mean8.899999999999991
survival_time_min8.899999999999991
No reset possible
14613989Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-validationsim-2of4failednodavinci-stage-02-6.2.500:01:12
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14608990Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-validationsim-1of4failednodavinci-stage-02-6.2.500:01:12
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14603992Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-validationsim-3of4failednodavinci-stage-02-6.2.500:00:57
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14598993Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-validationsim-0of4failednodavinci-stage-02-6.2.500:01:13
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14593994Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-validationsim-0of4failednodavinci-stage-02-6.2.500:01:13
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14590995Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-validationsim-1of4failednodavinci-stage-02-6.2.500:00:57
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145841003Bea Baselines 🐤baseline-RPL-rosaido-hello-sim-validationsanity-checkfailednodavinci-stage-02-6.2.500:01:10
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145811007Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-testingsim-1of4failednodavinci-stage-02-6.2.500:01:11
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145791008Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-testingsim-2of4failednodavinci-stage-02-6.2.500:01:13
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145751009Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-testingsim-3of4failednodavinci-stage-02-6.2.500:01:14
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145711010Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-testingsim-3of4failednodavinci-stage-02-6.2.500:00:58
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145671012Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-testingsim-2of4failednodavinci-stage-02-6.2.500:01:13
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145631012Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-testingsim-3of4failednodavinci-stage-02-6.2.500:01:13
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145581013Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-testingsim-1of4failednodavinci-stage-02-6.2.500:00:59
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145471016Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-validationsim-1of4successnodavinci-stage-02-6.2.500:06:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median5.24999999999973
driven_lanedir_consec_median3.768614774251639
deviation-center-line_median3.178521845257395


other stats
deviation-center-line_max3.178521845257395
deviation-center-line_mean3.178521845257395
deviation-center-line_min3.178521845257395
deviation-heading_max8.610893286254122
deviation-heading_mean8.610893286254122
deviation-heading_median8.610893286254122
deviation-heading_min8.610893286254122
distance-from-start_max2.9908399451127683
distance-from-start_mean2.9908399451127683
distance-from-start_median2.9908399451127683
distance-from-start_min2.9908399451127683
driven_any_max7.907820480459742
driven_any_mean7.907820480459742
driven_any_median7.907820480459742
driven_any_min7.907820480459742
driven_lanedir_consec_max3.768614774251639
driven_lanedir_consec_mean3.768614774251639
driven_lanedir_consec_min3.768614774251639
driven_lanedir_max7.004091097957279
driven_lanedir_mean7.004091097957279
driven_lanedir_median7.004091097957279
driven_lanedir_min7.004091097957279
in-drivable-lane_max5.24999999999973
in-drivable-lane_mean5.24999999999973
in-drivable-lane_min5.24999999999973
per-episodes
details{"udem1-000-ego0": {"driven_any": 7.907820480459742, "survival_time": 59.99999999999873, "driven_lanedir": 7.004091097957279, "in-drivable-lane": 5.24999999999973, "deviation-heading": 8.610893286254122, "distance-from-start": 2.9908399451127683, "deviation-center-line": 3.178521845257395, "driven_lanedir_consec": 3.768614774251639}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
145431017Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:06:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.041611612241171
survival_time_median59.99999999999873
deviation-center-line_median4.72760563170043
in-drivable-lane_median6.249999999999969


other stats
deviation-center-line_max4.72760563170043
deviation-center-line_mean4.72760563170043
deviation-center-line_min4.72760563170043
deviation-heading_max14.557161387249996
deviation-heading_mean14.557161387249996
deviation-heading_median14.557161387249996
deviation-heading_min14.557161387249996
distance-from-start_max2.1454971427673524
distance-from-start_mean2.1454971427673524
distance-from-start_median2.1454971427673524
distance-from-start_min2.1454971427673524
driven_any_max7.907462576728758
driven_any_mean7.907462576728758
driven_any_median7.907462576728758
driven_any_min7.907462576728758
driven_lanedir_consec_max4.041611612241171
driven_lanedir_consec_mean4.041611612241171
driven_lanedir_consec_min4.041611612241171
driven_lanedir_max6.5675684254509274
driven_lanedir_mean6.5675684254509274
driven_lanedir_median6.5675684254509274
driven_lanedir_min6.5675684254509274
in-drivable-lane_max6.249999999999969
in-drivable-lane_mean6.249999999999969
in-drivable-lane_min6.249999999999969
per-episodes
details{"zigzag-000-ego0": {"driven_any": 7.907462576728758, "survival_time": 59.99999999999873, "driven_lanedir": 6.5675684254509274, "in-drivable-lane": 6.249999999999969, "deviation-heading": 14.557161387249996, "distance-from-start": 2.1454971427673524, "deviation-center-line": 4.72760563170043, "driven_lanedir_consec": 4.041611612241171}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
145421017Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:01:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.38496892778065694
survival_time_median8.84999999999999
deviation-center-line_median0.1983368427805497
in-drivable-lane_median5.299999999999995


other stats
deviation-center-line_max0.1983368427805497
deviation-center-line_mean0.1983368427805497
deviation-center-line_min0.1983368427805497
deviation-heading_max1.2965316298133562
deviation-heading_mean1.2965316298133562
deviation-heading_median1.2965316298133562
deviation-heading_min1.2965316298133562
distance-from-start_max0.7563112789094238
distance-from-start_mean0.7563112789094238
distance-from-start_median0.7563112789094238
distance-from-start_min0.7563112789094238
driven_any_max1.023644538895227
driven_any_mean1.023644538895227
driven_any_median1.023644538895227
driven_any_min1.023644538895227
driven_lanedir_consec_max0.38496892778065694
driven_lanedir_consec_mean0.38496892778065694
driven_lanedir_consec_min0.38496892778065694
driven_lanedir_max0.38496892778065694
driven_lanedir_mean0.38496892778065694
driven_lanedir_median0.38496892778065694
driven_lanedir_min0.38496892778065694
in-drivable-lane_max5.299999999999995
in-drivable-lane_mean5.299999999999995
in-drivable-lane_min5.299999999999995
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.023644538895227, "survival_time": 8.84999999999999, "driven_lanedir": 0.38496892778065694, "in-drivable-lane": 5.299999999999995, "deviation-heading": 1.2965316298133562, "distance-from-start": 0.7563112789094238, "deviation-center-line": 0.1983368427805497, "driven_lanedir_consec": 0.38496892778065694}}
simulation-passed1
survival_time_max8.84999999999999
survival_time_mean8.84999999999999
survival_time_min8.84999999999999
No reset possible
145341019Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-validationsim-0of4successnodavinci-stage-02-6.2.500:18:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median53.29999999999911
in-drivable-lane_median24.42499999999952
driven_lanedir_consec_median1.2500378228857545
deviation-center-line_median1.9471072641644027


other stats
deviation-center-line_max3.967644448837063
deviation-center-line_mean2.096941384861837
deviation-center-line_min0.5259065622814778
deviation-heading_max15.405670125271662
deviation-heading_mean8.791139797766549
deviation-heading_median8.286913429140462
deviation-heading_min3.18506220751361
distance-from-start_max3.3273410866279693
distance-from-start_mean1.4530206494350264
distance-from-start_median0.8736949291459354
distance-from-start_min0.7373516528202658
driven_any_max6.9312285644704605
driven_any_mean3.3815772249655613
driven_any_median2.5103383539572577
driven_any_min1.5744036274772686
driven_lanedir_consec_max4.484742694183522
driven_lanedir_consec_mean1.9697531185856805
driven_lanedir_consec_min0.8941941343876905
driven_lanedir_max5.04395309635988
driven_lanedir_mean2.4573760474464676
driven_lanedir_median1.94567847951915
driven_lanedir_min0.8941941343876905
in-drivable-lane_max44.89999999999911
in-drivable-lane_mean23.98749999999954
in-drivable-lane_min2.2000000000000046
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.1320222682949863, "survival_time": 53.29999999999911, "driven_lanedir": 1.6305729728075309, "in-drivable-lane": 38.99999999999902, "deviation-heading": 5.097016946228178, "distance-from-start": 0.7373516528202658, "deviation-center-line": 0.9216852527154265, "driven_lanedir_consec": 0.9296006708059076}, "autolab-000-ego1": {"driven_any": 6.9312285644704605, "survival_time": 53.29999999999911, "driven_lanedir": 5.04395309635988, "in-drivable-lane": 9.850000000000026, "deviation-heading": 15.405670125271662, "distance-from-start": 3.3273410866279693, "deviation-center-line": 2.972529275613379, "driven_lanedir_consec": 4.484742694183522}, "autolab-000-ego2": {"driven_any": 2.888654439619529, "survival_time": 53.29999999999911, "driven_lanedir": 2.260783986230769, "in-drivable-lane": 2.2000000000000046, "deviation-heading": 11.476809912052746, "distance-from-start": 0.9090733337113276, "deviation-center-line": 3.967644448837063, "driven_lanedir_consec": 1.570474974965601}, "autolab-000-ego3": {"driven_any": 1.5744036274772686, "survival_time": 53.29999999999911, "driven_lanedir": 0.8941941343876905, "in-drivable-lane": 44.89999999999911, "deviation-heading": 3.18506220751361, "distance-from-start": 0.8383165245805433, "deviation-center-line": 0.5259065622814778, "driven_lanedir_consec": 0.8941941343876905}}
simulation-passed1
survival_time_max53.29999999999911
survival_time_mean53.29999999999911
survival_time_min53.29999999999911
No reset possible
145301020Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:02:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median22.05000000000018
in-drivable-lane_median6.700000000000085
driven_lanedir_consec_median1.25369257191851
deviation-center-line_median0.9844132467820452


other stats
deviation-center-line_max0.9844132467820452
deviation-center-line_mean0.9844132467820452
deviation-center-line_min0.9844132467820452
deviation-heading_max3.2807205997874536
deviation-heading_mean3.2807205997874536
deviation-heading_median3.2807205997874536
deviation-heading_min3.2807205997874536
distance-from-start_max1.3576523115450785
distance-from-start_mean1.3576523115450785
distance-from-start_median1.3576523115450785
distance-from-start_min1.3576523115450785
driven_any_max2.7761887398698835
driven_any_mean2.7761887398698835
driven_any_median2.7761887398698835
driven_any_min2.7761887398698835
driven_lanedir_consec_max1.25369257191851
driven_lanedir_consec_mean1.25369257191851
driven_lanedir_consec_min1.25369257191851
driven_lanedir_max1.8001435911825463
driven_lanedir_mean1.8001435911825463
driven_lanedir_median1.8001435911825463
driven_lanedir_min1.8001435911825463
in-drivable-lane_max6.700000000000085
in-drivable-lane_mean6.700000000000085
in-drivable-lane_min6.700000000000085
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.7761887398698835, "survival_time": 22.05000000000018, "driven_lanedir": 1.8001435911825463, "in-drivable-lane": 6.700000000000085, "deviation-heading": 3.2807205997874536, "distance-from-start": 1.3576523115450785, "deviation-center-line": 0.9844132467820452, "driven_lanedir_consec": 1.25369257191851}}
simulation-passed1
survival_time_max22.05000000000018
survival_time_mean22.05000000000018
survival_time_min22.05000000000018
No reset possible
145291020Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-validationsim-0of4successnodavinci-stage-02-6.2.500:02:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.000000000000036
in-drivable-lane_median1.5499999999999945
driven_lanedir_consec_median1.1507771343349733
deviation-center-line_median0.9028090550372264


other stats
deviation-center-line_max0.9028090550372264
deviation-center-line_mean0.9028090550372264
deviation-center-line_min0.9028090550372264
deviation-heading_max3.4793405185873865
deviation-heading_mean3.4793405185873865
deviation-heading_median3.4793405185873865
deviation-heading_min3.4793405185873865
distance-from-start_max1.1152973256386427
distance-from-start_mean1.1152973256386427
distance-from-start_median1.1152973256386427
distance-from-start_min1.1152973256386427
driven_any_max1.441888675312709
driven_any_mean1.441888675312709
driven_any_median1.441888675312709
driven_any_min1.441888675312709
driven_lanedir_consec_max1.1507771343349733
driven_lanedir_consec_mean1.1507771343349733
driven_lanedir_consec_min1.1507771343349733
driven_lanedir_max1.1507771343349733
driven_lanedir_mean1.1507771343349733
driven_lanedir_median1.1507771343349733
driven_lanedir_min1.1507771343349733
in-drivable-lane_max1.5499999999999945
in-drivable-lane_mean1.5499999999999945
in-drivable-lane_min1.5499999999999945
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.441888675312709, "survival_time": 12.000000000000036, "driven_lanedir": 1.1507771343349733, "in-drivable-lane": 1.5499999999999945, "deviation-heading": 3.4793405185873865, "distance-from-start": 1.1152973256386427, "deviation-center-line": 0.9028090550372264, "driven_lanedir_consec": 1.1507771343349733}}
simulation-passed1
survival_time_max12.000000000000036
survival_time_mean12.000000000000036
survival_time_min12.000000000000036
No reset possible
145271028Bea Baselines 🐤baseline-duckietown-mlaido-hello-sim-validationsanity-checksuccessnodavinci-stage-02-6.2.500:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.013471039678237371
deviation-center-line_median0.006583676834310284


other stats
deviation-center-line_max0.006583676834310284
deviation-center-line_mean0.006583676834310284
deviation-center-line_min0.006583676834310284
deviation-heading_max0.2586373841655202
deviation-heading_mean0.2586373841655202
deviation-heading_median0.2586373841655202
deviation-heading_min0.2586373841655202
distance-from-start_max0.01507106839084628
distance-from-start_mean0.01507106839084628
distance-from-start_median0.01507106839084628
distance-from-start_min0.01507106839084628
driven_any_max0.015084022021506887
driven_any_mean0.015084022021506887
driven_any_median0.015084022021506887
driven_any_min0.015084022021506887
driven_lanedir_consec_max0.013471039678237371
driven_lanedir_consec_mean0.013471039678237371
driven_lanedir_consec_min0.013471039678237371
driven_lanedir_max0.013471039678237371
driven_lanedir_mean0.013471039678237371
driven_lanedir_median0.013471039678237371
driven_lanedir_min0.013471039678237371
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.015084022021506887, "survival_time": 0.49999999999999994, "driven_lanedir": 0.013471039678237371, "in-drivable-lane": 0.0, "deviation-heading": 0.2586373841655202, "distance-from-start": 0.01507106839084628, "deviation-center-line": 0.006583676834310284, "driven_lanedir_consec": 0.013471039678237371}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
145201033Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-testingsim-1of4successnodavinci-stage-02-6.2.500:09:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median40.349999999999845
in-drivable-lane_median8.949999999999768
driven_lanedir_consec_median2.1253633536654752
deviation-center-line_median2.503554298503603


other stats
deviation-center-line_max2.503554298503603
deviation-center-line_mean2.503554298503603
deviation-center-line_min2.503554298503603
deviation-heading_max9.98127164795691
deviation-heading_mean9.98127164795691
deviation-heading_median9.98127164795691
deviation-heading_min9.98127164795691
distance-from-start_max1.5813709129566738
distance-from-start_mean1.5813709129566738
distance-from-start_median1.5813709129566738
distance-from-start_min1.5813709129566738
driven_any_max5.212132433642493
driven_any_mean5.212132433642493
driven_any_median5.212132433642493
driven_any_min5.212132433642493
driven_lanedir_consec_max2.1253633536654752
driven_lanedir_consec_mean2.1253633536654752
driven_lanedir_consec_min2.1253633536654752
driven_lanedir_max3.7273293367682
driven_lanedir_mean3.7273293367682
driven_lanedir_median3.7273293367682
driven_lanedir_min3.7273293367682
in-drivable-lane_max8.949999999999768
in-drivable-lane_mean8.949999999999768
in-drivable-lane_min8.949999999999768
per-episodes
details{"4way-000-ego0": {"driven_any": 5.212132433642493, "survival_time": 40.349999999999845, "driven_lanedir": 3.7273293367682, "in-drivable-lane": 8.949999999999768, "deviation-heading": 9.98127164795691, "distance-from-start": 1.5813709129566738, "deviation-center-line": 2.503554298503603, "driven_lanedir_consec": 2.1253633536654752}}
simulation-passed1
survival_time_max40.349999999999845
survival_time_mean40.349999999999845
survival_time_min40.349999999999845
No reset possible
145181034Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:02:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
145131035Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:05:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.229675635489384
survival_time_median59.99999999999873
deviation-center-line_median4.546587539114384
in-drivable-lane_median21.749999999999524


other stats
deviation-center-line_max4.546587539114384
deviation-center-line_mean4.546587539114384
deviation-center-line_min4.546587539114384
deviation-heading_max6.852651805403975
deviation-heading_mean6.852651805403975
deviation-heading_median6.852651805403975
deviation-heading_min6.852651805403975
distance-from-start_max1.4070846849323573
distance-from-start_mean1.4070846849323573
distance-from-start_median1.4070846849323573
distance-from-start_min1.4070846849323573
driven_any_max7.90757818243655
driven_any_mean7.90757818243655
driven_any_median7.90757818243655
driven_any_min7.90757818243655
driven_lanedir_consec_max2.229675635489384
driven_lanedir_consec_mean2.229675635489384
driven_lanedir_consec_min2.229675635489384
driven_lanedir_max4.832369830242145
driven_lanedir_mean4.832369830242145
driven_lanedir_median4.832369830242145
driven_lanedir_min4.832369830242145
in-drivable-lane_max21.749999999999524
in-drivable-lane_mean21.749999999999524
in-drivable-lane_min21.749999999999524
per-episodes
details{"loop2-000-ego0": {"driven_any": 7.90757818243655, "survival_time": 59.99999999999873, "driven_lanedir": 4.832369830242145, "in-drivable-lane": 21.749999999999524, "deviation-heading": 6.852651805403975, "distance-from-start": 1.4070846849323573, "deviation-center-line": 4.546587539114384, "driven_lanedir_consec": 2.229675635489384}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
145121035Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-testingsim-0of4successnodavinci-stage-02-6.2.500:05:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.560881078306696
survival_time_median59.99999999999873
deviation-center-line_median3.959338391652931
in-drivable-lane_median6.949999999999751


other stats
deviation-center-line_max3.959338391652931
deviation-center-line_mean3.959338391652931
deviation-center-line_min3.959338391652931
deviation-heading_max12.881748411411284
deviation-heading_mean12.881748411411284
deviation-heading_median12.881748411411284
deviation-heading_min12.881748411411284
distance-from-start_max2.7992340057029015
distance-from-start_mean2.7992340057029015
distance-from-start_median2.7992340057029015
distance-from-start_min2.7992340057029015
driven_any_max7.907788345505281
driven_any_mean7.907788345505281
driven_any_median7.907788345505281
driven_any_min7.907788345505281
driven_lanedir_consec_max6.560881078306696
driven_lanedir_consec_mean6.560881078306696
driven_lanedir_consec_min6.560881078306696
driven_lanedir_max6.560881078306696
driven_lanedir_mean6.560881078306696
driven_lanedir_median6.560881078306696
driven_lanedir_min6.560881078306696
in-drivable-lane_max6.949999999999751
in-drivable-lane_mean6.949999999999751
in-drivable-lane_min6.949999999999751
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.907788345505281, "survival_time": 59.99999999999873, "driven_lanedir": 6.560881078306696, "in-drivable-lane": 6.949999999999751, "deviation-heading": 12.881748411411284, "distance-from-start": 2.7992340057029015, "deviation-center-line": 3.959338391652931, "driven_lanedir_consec": 6.560881078306696}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
145101036Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
145081036Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-testingsim-1of4successnodavinci-stage-02-6.2.500:05:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.55000000000003
in-drivable-lane_median3.725000000000018
driven_lanedir_consec_median0.5299361999189056
deviation-center-line_median0.5771122922385188


other stats
deviation-center-line_max1.3721734805782488
deviation-center-line_mean0.665158497014106
deviation-center-line_min0.1342359230011377
deviation-heading_max10.683519673709103
deviation-heading_mean5.240443966253134
deviation-heading_median4.378137234023606
deviation-heading_min1.5219817232562205
distance-from-start_max0.6524926947861857
distance-from-start_mean0.5439637682846699
distance-from-start_median0.518189980749017
distance-from-start_min0.4869824168544601
driven_any_max1.388688394234144
driven_any_mean0.8675452558965154
driven_any_median0.7579683531399867
driven_any_min0.5655559230719444
driven_lanedir_consec_max0.6782753947883038
driven_lanedir_consec_mean0.5568150984843732
driven_lanedir_consec_min0.48911259931137785
driven_lanedir_max0.6782753947883038
driven_lanedir_mean0.5568150984843732
driven_lanedir_median0.5299361999189056
driven_lanedir_min0.48911259931137785
in-drivable-lane_max7.000000000000037
in-drivable-lane_mean3.6125000000000185
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 0.5986972814801673, "survival_time": 11.55000000000003, "driven_lanedir": 0.48911259931137785, "in-drivable-lane": 7.000000000000037, "deviation-heading": 1.8066801940389177, "distance-from-start": 0.4869824168544601, "deviation-center-line": 0.1342359230011377, "driven_lanedir_consec": 0.48911259931137785}, "4way-000-ego1": {"driven_any": 0.5655559230719444, "survival_time": 11.55000000000003, "driven_lanedir": 0.5088769580135879, "in-drivable-lane": 0.0, "deviation-heading": 10.683519673709103, "distance-from-start": 0.4996424101269837, "deviation-center-line": 1.3721734805782488, "driven_lanedir_consec": 0.5088769580135879}, "4way-000-ego2": {"driven_any": 1.388688394234144, "survival_time": 11.55000000000003, "driven_lanedir": 0.6782753947883038, "in-drivable-lane": 5.600000000000042, "deviation-heading": 1.5219817232562205, "distance-from-start": 0.6524926947861857, "deviation-center-line": 0.18915464933049012, "driven_lanedir_consec": 0.6782753947883038}, "4way-000-ego3": {"driven_any": 0.917239424799806, "survival_time": 11.55000000000003, "driven_lanedir": 0.5509954418242233, "in-drivable-lane": 1.8499999999999936, "deviation-heading": 6.9495942740082945, "distance-from-start": 0.5367375513710504, "deviation-center-line": 0.9650699351465474, "driven_lanedir_consec": 0.5509954418242233}}
simulation-passed1
survival_time_max11.55000000000003
survival_time_mean11.55000000000003
survival_time_min11.55000000000003
No reset possible
145051037Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:03:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median14.300000000000068
in-drivable-lane_median3.650000000000023
driven_lanedir_consec_median0.651846535055699
deviation-center-line_median1.2191286631478695


other stats
deviation-center-line_max1.7310012339741456
deviation-center-line_mean1.2191286631478695
deviation-center-line_min0.7072560923215936
deviation-heading_max10.701251696577014
deviation-heading_mean6.051398325067995
deviation-heading_median6.051398325067995
deviation-heading_min1.4015449535589743
distance-from-start_max0.8895974271240978
distance-from-start_mean0.7104675179458679
distance-from-start_median0.7104675179458679
distance-from-start_min0.5313376087676381
driven_any_max1.7472127088134657
driven_any_mean1.1862710077584282
driven_any_median1.1862710077584282
driven_any_min0.6253293067033905
driven_lanedir_consec_max0.7373435972946919
driven_lanedir_consec_mean0.651846535055699
driven_lanedir_consec_min0.5663494728167061
driven_lanedir_max0.7373435972946919
driven_lanedir_mean0.651846535055699
driven_lanedir_median0.651846535055699
driven_lanedir_min0.5663494728167061
in-drivable-lane_max7.300000000000046
in-drivable-lane_mean3.650000000000023
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.6253293067033905, "survival_time": 14.300000000000068, "driven_lanedir": 0.5663494728167061, "in-drivable-lane": 0.0, "deviation-heading": 10.701251696577014, "distance-from-start": 0.5313376087676381, "deviation-center-line": 1.7310012339741456, "driven_lanedir_consec": 0.5663494728167061}, "loop2-000-ego1": {"driven_any": 1.7472127088134657, "survival_time": 14.300000000000068, "driven_lanedir": 0.7373435972946919, "in-drivable-lane": 7.300000000000046, "deviation-heading": 1.4015449535589743, "distance-from-start": 0.8895974271240978, "deviation-center-line": 0.7072560923215936, "driven_lanedir_consec": 0.7373435972946919}}
simulation-passed1
survival_time_max14.300000000000068
survival_time_mean14.300000000000068
survival_time_min14.300000000000068
No reset possible
145011038Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:03:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median31.95000000000032
in-drivable-lane_median21.200000000000273
driven_lanedir_consec_median1.3247372287390389
deviation-center-line_median1.0764977584002304


other stats
deviation-center-line_max1.0764977584002304
deviation-center-line_mean1.0764977584002304
deviation-center-line_min1.0764977584002304
deviation-heading_max2.0282877341533703
deviation-heading_mean2.0282877341533703
deviation-heading_median2.0282877341533703
deviation-heading_min2.0282877341533703
distance-from-start_max1.381025663907996
distance-from-start_mean1.381025663907996
distance-from-start_median1.381025663907996
distance-from-start_min1.381025663907996
driven_any_max4.090628804338172
driven_any_mean4.090628804338172
driven_any_median4.090628804338172
driven_any_min4.090628804338172
driven_lanedir_consec_max1.3247372287390389
driven_lanedir_consec_mean1.3247372287390389
driven_lanedir_consec_min1.3247372287390389
driven_lanedir_max1.3247372287390389
driven_lanedir_mean1.3247372287390389
driven_lanedir_median1.3247372287390389
driven_lanedir_min1.3247372287390389
in-drivable-lane_max21.200000000000273
in-drivable-lane_mean21.200000000000273
in-drivable-lane_min21.200000000000273
per-episodes
details{"loop2-000-ego0": {"driven_any": 4.090628804338172, "survival_time": 31.95000000000032, "driven_lanedir": 1.3247372287390389, "in-drivable-lane": 21.200000000000273, "deviation-heading": 2.0282877341533703, "distance-from-start": 1.381025663907996, "deviation-center-line": 1.0764977584002304, "driven_lanedir_consec": 1.3247372287390389}}
simulation-passed1
survival_time_max31.95000000000032
survival_time_mean31.95000000000032
survival_time_min31.95000000000032
No reset possible
144891041Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-validationsim-1of4successnodavinci-stage-02-6.2.500:10:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8949033835511649


other stats
deviation-center-line_max0.8949033835511649
deviation-center-line_mean0.8949033835511649
deviation-center-line_min0.8949033835511649
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max4.965068306494546e-16
distance-from-start_mean4.965068306494546e-16
distance-from-start_median4.965068306494546e-16
distance-from-start_min4.965068306494546e-16
driven_any_max5.95808196779335e-13
driven_any_mean5.95808196779335e-13
driven_any_median5.95808196779335e-13
driven_any_min5.95808196779335e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.8949033835511649, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144871041Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
144861041Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
144841042Bea Baselines 🐤baseline-duckietownaido-LFI-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
144821042Bea Baselines 🐤baseline-duckietownaido-LFI-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
144791043Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
144741044Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-validationsim-1of4successnodavinci-stage-02-6.2.500:11:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median7.152557373046875e-05
deviation-center-line_median1.5117049755778469


other stats
deviation-center-line_max2.9467758452445567
deviation-center-line_mean1.5769826255149473
deviation-center-line_min0.33774470565953923
deviation-heading_max32.249113233675025
deviation-heading_mean22.83949643715976
deviation-heading_median22.597265680122995
deviation-heading_min13.914341154718024
distance-from-start_max6.280369834735102e-16
distance-from-start_mean1.5700924586837752e-16
distance-from-start_median0.0
distance-from-start_min0.0
driven_any_max7.536443801682175e-13
driven_any_mean1.8841109504205443e-13
driven_any_median0.0
driven_any_min0.0
driven_lanedir_consec_max0.0001430511474609375
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.0001430511474609375
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median7.152557373046875e-05
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 7.536443801682175e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 6.280369834735102e-16, "deviation-center-line": 0.8949070851524836, "driven_lanedir_consec": 0.0001430511474609375}, "loop-000-ego1": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 0.0, "deviation-center-line": 2.1285028660032097, "driven_lanedir_consec": 0.0}, "loop-000-ego2": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 14.481564596168331, "distance-from-start": 0.0, "deviation-center-line": 2.9467758452445567, "driven_lanedir_consec": 0.0}, "loop-000-ego3": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "in-drivable-lane": 0.0, "deviation-heading": 13.914341154718024, "distance-from-start": 0.0, "deviation-center-line": 0.33774470565953923, "driven_lanedir_consec": 0.0001430511474609375}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144701045Bea Baselines 🐤baseline-duckietownaido-LFP-sim-validationsim-1of4successnodavinci-stage-02-6.2.500:05:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8948975282353328


other stats
deviation-center-line_max0.8948975282353328
deviation-center-line_mean0.8948975282353328
deviation-center-line_min0.8948975282353328
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max2.7755575615628914e-17
distance-from-start_mean2.7755575615628914e-17
distance-from-start_median2.7755575615628914e-17
distance-from-start_min2.7755575615628914e-17
driven_any_max3.3306690738754696e-14
driven_any_mean3.3306690738754696e-14
driven_any_median3.3306690738754696e-14
driven_any_min3.3306690738754696e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 3.3306690738754696e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.7755575615628914e-17, "deviation-center-line": 0.8948975282353328, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144681053Bea Baselines 🐤baseline-duckietownaido-hello-sim-validationsanity-checksuccessnodavinci-stage-02-6.2.500:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median1.1920928955078125e-06
deviation-center-line_median0.007457559042937448


other stats
deviation-center-line_max0.007457559042937448
deviation-center-line_mean0.007457559042937448
deviation-center-line_min0.007457559042937448
deviation-heading_max0.26874261028062396
deviation-heading_mean0.26874261028062396
deviation-heading_median0.26874261028062396
deviation-heading_min0.26874261028062396
distance-from-start_max6.280369834735102e-16
distance-from-start_mean6.280369834735102e-16
distance-from-start_median6.280369834735102e-16
distance-from-start_min6.280369834735102e-16
driven_any_max6.280369834735102e-15
driven_any_mean6.280369834735102e-15
driven_any_median6.280369834735102e-15
driven_any_min6.280369834735102e-15
driven_lanedir_consec_max1.1920928955078125e-06
driven_lanedir_consec_mean1.1920928955078125e-06
driven_lanedir_consec_min1.1920928955078125e-06
driven_lanedir_max1.1920928955078125e-06
driven_lanedir_mean1.1920928955078125e-06
driven_lanedir_median1.1920928955078125e-06
driven_lanedir_min1.1920928955078125e-06
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 6.280369834735102e-15, "survival_time": 0.49999999999999994, "driven_lanedir": 1.1920928955078125e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.26874261028062396, "distance-from-start": 6.280369834735102e-16, "deviation-center-line": 0.007457559042937448, "driven_lanedir_consec": 1.1920928955078125e-06}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
144631058Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-testingsim-0of4successnodavinci-stage-02-6.2.500:10:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0001430511474609375
deviation-center-line_median0.40653839040804857


other stats
deviation-center-line_max0.40653839040804857
deviation-center-line_mean0.40653839040804857
deviation-center-line_min0.40653839040804857
deviation-heading_max40.967332753486254
deviation-heading_mean40.967332753486254
deviation-heading_median40.967332753486254
deviation-heading_min40.967332753486254
distance-from-start_max2.220446049250313e-16
distance-from-start_mean2.220446049250313e-16
distance-from-start_median2.220446049250313e-16
distance-from-start_min2.220446049250313e-16
driven_any_max2.6645352591003757e-13
driven_any_mean2.6645352591003757e-13
driven_any_median2.6645352591003757e-13
driven_any_min2.6645352591003757e-13
driven_lanedir_consec_max0.0001430511474609375
driven_lanedir_consec_mean0.0001430511474609375
driven_lanedir_consec_min0.0001430511474609375
driven_lanedir_max0.0001430511474609375
driven_lanedir_mean0.0001430511474609375
driven_lanedir_median0.0001430511474609375
driven_lanedir_min0.0001430511474609375
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 0.40653839040804857, "driven_lanedir_consec": 0.0001430511474609375}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144601058Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:01:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
144551060Bea Baselines 🐤baseline-duckietownaido-LF-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:04:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median0.406522978175052
in-drivable-lane_median0.0


other stats
deviation-center-line_max0.406522978175052
deviation-center-line_mean0.406522978175052
deviation-center-line_min0.406522978175052
deviation-heading_max40.967332753486254
deviation-heading_mean40.967332753486254
deviation-heading_median40.967332753486254
deviation-heading_min40.967332753486254
distance-from-start_max5.789639601072594e-17
distance-from-start_mean5.789639601072594e-17
distance-from-start_median5.789639601072594e-17
distance-from-start_min5.789639601072594e-17
driven_any_max6.947567521287112e-14
driven_any_mean6.947567521287112e-14
driven_any_median6.947567521287112e-14
driven_any_min6.947567521287112e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 6.947567521287112e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 5.789639601072594e-17, "deviation-center-line": 0.406522978175052, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144521060Bea Baselines 🐤baseline-duckietownaido-LF-sim-testingsim-1of4successnodavinci-stage-02-6.2.500:04:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median0.4065134212579011
in-drivable-lane_median0.0


other stats
deviation-center-line_max0.4065134212579011
deviation-center-line_mean0.4065134212579011
deviation-center-line_min0.4065134212579011
deviation-heading_max40.967332753486225
deviation-heading_mean40.967332753486225
deviation-heading_median40.967332753486225
deviation-heading_min40.967332753486225
distance-from-start_max2.7755575615628914e-17
distance-from-start_mean2.7755575615628914e-17
distance-from-start_median2.7755575615628914e-17
distance-from-start_min2.7755575615628914e-17
driven_any_max3.3306690738754696e-14
driven_any_mean3.3306690738754696e-14
driven_any_median3.3306690738754696e-14
driven_any_min3.3306690738754696e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 3.3306690738754696e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 2.7755575615628914e-17, "deviation-center-line": 0.4065134212579011, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144441062Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-testingsim-0of4successnodavinci-stage-02-6.2.500:13:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median-0.0001430511474609375
deviation-center-line_median1.5844950596910814


other stats
deviation-center-line_max3.4683962371431485
deviation-center-line_mean1.7151242449636883
deviation-center-line_min0.22311062332944268
deviation-heading_max40.967332753486225
deviation-heading_mean25.4379514504715
deviation-heading_median28.066180210798333
deviation-heading_min4.652112626803104
distance-from-start_max6.280369834735102e-16
distance-from-start_mean2.6803154833089315e-16
distance-from-start_median1.6653345369377348e-16
distance-from-start_min1.1102230246251563e-16
driven_any_max7.536443801682175e-13
driven_any_mean3.216378579970732e-13
driven_any_median1.9984014443252818e-13
driven_any_min1.3322676295501878e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean-0.0001430511474609375
driven_lanedir_consec_min-0.000286102294921875
driven_lanedir_max0.0
driven_lanedir_mean-0.0001430511474609375
driven_lanedir_median-0.0001430511474609375
driven_lanedir_min-0.000286102294921875
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.536443801682175e-13, "survival_time": 59.99999999999873, "driven_lanedir": -0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 6.280369834735102e-16, "deviation-center-line": 0.40651342125780654, "driven_lanedir_consec": -0.000286102294921875}, "autolab-000-ego1": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005143, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 3.4683962371431485, "driven_lanedir_consec": 0.0}, "autolab-000-ego2": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 4.652112626803104, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 0.22311062332944268, "driven_lanedir_consec": 0.0}, "autolab-000-ego3": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": -0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 2.7624766981243565, "driven_lanedir_consec": -0.000286102294921875}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144411063Bea Baselines 🐤baseline-duckietownaido-LFP-sim-testingsim-0of4successnodavinci-stage-02-6.2.500:05:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median-0.000286102294921875
deviation-center-line_median0.4065102356187871


other stats
deviation-center-line_max0.4065102356187871
deviation-center-line_mean0.4065102356187871
deviation-center-line_min0.4065102356187871
deviation-heading_max40.967332753486225
deviation-heading_mean40.967332753486225
deviation-heading_median40.967332753486225
deviation-heading_min40.967332753486225
distance-from-start_max6.661338147750939e-16
distance-from-start_mean6.661338147750939e-16
distance-from-start_median6.661338147750939e-16
distance-from-start_min6.661338147750939e-16
driven_any_max7.993605777301127e-13
driven_any_mean7.993605777301127e-13
driven_any_median7.993605777301127e-13
driven_any_min7.993605777301127e-13
driven_lanedir_consec_max-0.000286102294921875
driven_lanedir_consec_mean-0.000286102294921875
driven_lanedir_consec_min-0.000286102294921875
driven_lanedir_max-0.000286102294921875
driven_lanedir_mean-0.000286102294921875
driven_lanedir_median-0.000286102294921875
driven_lanedir_min-0.000286102294921875
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.993605777301127e-13, "survival_time": 59.99999999999873, "driven_lanedir": -0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 6.661338147750939e-16, "deviation-center-line": 0.4065102356187871, "driven_lanedir_consec": -0.000286102294921875}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144181209Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-validationsim-0of4successnodavinci-stage-02-6.2.500:12:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.0499999999998835
driven_lanedir_consec_median3.175459974733086
deviation-center-line_median7.758676361053286


other stats
deviation-center-line_max7.758676361053286
deviation-center-line_mean7.758676361053286
deviation-center-line_min7.758676361053286
deviation-heading_max5.162282612890801
deviation-heading_mean5.162282612890801
deviation-heading_median5.162282612890801
deviation-heading_min5.162282612890801
distance-from-start_max2.770171492994891
distance-from-start_mean2.770171492994891
distance-from-start_median2.770171492994891
distance-from-start_min2.770171492994891
driven_any_max3.518087280478298
driven_any_mean3.518087280478298
driven_any_median3.518087280478298
driven_any_min3.518087280478298
driven_lanedir_consec_max3.175459974733086
driven_lanedir_consec_mean3.175459974733086
driven_lanedir_consec_min3.175459974733086
driven_lanedir_max3.381680904589276
driven_lanedir_mean3.381680904589276
driven_lanedir_median3.381680904589276
driven_lanedir_min3.381680904589276
in-drivable-lane_max2.0499999999998835
in-drivable-lane_mean2.0499999999998835
in-drivable-lane_min2.0499999999998835
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.518087280478298, "survival_time": 59.99999999999873, "driven_lanedir": 3.381680904589276, "in-drivable-lane": 2.0499999999998835, "deviation-heading": 5.162282612890801, "distance-from-start": 2.770171492994891, "deviation-center-line": 7.758676361053286, "driven_lanedir_consec": 3.175459974733086}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144131210Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-validationsim-1of4successnodavinci-stage-02-6.2.500:06:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.5265618997780304
deviation-center-line_median3.553964307961913


other stats
deviation-center-line_max3.553964307961913
deviation-center-line_mean3.553964307961913
deviation-center-line_min3.553964307961913
deviation-heading_max4.887734095372573
deviation-heading_mean4.887734095372573
deviation-heading_median4.887734095372573
deviation-heading_min4.887734095372573
distance-from-start_max1.5359325577938203
distance-from-start_mean1.5359325577938203
distance-from-start_median1.5359325577938203
distance-from-start_min1.5359325577938203
driven_any_max3.579592227332615
driven_any_mean3.579592227332615
driven_any_median3.579592227332615
driven_any_min3.579592227332615
driven_lanedir_consec_max3.5265618997780304
driven_lanedir_consec_mean3.5265618997780304
driven_lanedir_consec_min3.5265618997780304
driven_lanedir_max3.553623248038845
driven_lanedir_mean3.553623248038845
driven_lanedir_median3.553623248038845
driven_lanedir_min3.553623248038845
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-000-ego0": {"driven_any": 3.579592227332615, "survival_time": 59.99999999999873, "driven_lanedir": 3.553623248038845, "in-drivable-lane": 0.0, "deviation-heading": 4.887734095372573, "distance-from-start": 1.5359325577938203, "deviation-center-line": 3.553964307961913, "driven_lanedir_consec": 3.5265618997780304}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144051212Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-validationsim-0of4successnodavinci-stage-02-6.2.500:16:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.181141245854967
deviation-center-line_median3.637790649976113


other stats
deviation-center-line_max4.94306639156408
deviation-center-line_mean3.6384672153214295
deviation-center-line_min2.335221169769412
deviation-heading_max8.096258955413703
deviation-heading_mean4.529231763948582
deviation-heading_median3.72621262109843
deviation-heading_min2.5682428581837655
distance-from-start_max2.691073047423519
distance-from-start_mean2.018255833360554
distance-from-start_median1.9479902375273632
distance-from-start_min1.4859698109639692
driven_any_max3.579594996204495
driven_any_mean3.415340175689185
driven_any_median3.5570850562678142
driven_any_min2.967595594016612
driven_lanedir_consec_max3.539826151958123
driven_lanedir_consec_mean2.923537151224604
driven_lanedir_consec_min1.792039961230358
driven_lanedir_max3.5660962143307464
driven_lanedir_mean3.362317352125506
driven_lanedir_median3.4666651400264885
driven_lanedir_min2.949842914118302
in-drivable-lane_max1.499999999999929
in-drivable-lane_mean0.37499999999998224
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 3.579594996204495, "survival_time": 59.99999999999873, "driven_lanedir": 3.5595521168819433, "in-drivable-lane": 0.0, "deviation-heading": 3.735588116547547, "distance-from-start": 2.3422362133197785, "deviation-center-line": 3.1814195463645407, "driven_lanedir_consec": 3.539826151958123}, "udem-000-ego1": {"driven_any": 3.534579691227877, "survival_time": 59.99999999999873, "driven_lanedir": 3.3737781631710337, "in-drivable-lane": 1.499999999999929, "deviation-heading": 8.096258955413703, "distance-from-start": 1.4859698109639692, "deviation-center-line": 4.094161753587684, "driven_lanedir_consec": 1.792039961230358}, "udem-000-ego2": {"driven_any": 2.967595594016612, "survival_time": 59.99999999999873, "driven_lanedir": 2.949842914118302, "in-drivable-lane": 0.0, "deviation-heading": 3.716837125649313, "distance-from-start": 1.5537442617349484, "deviation-center-line": 4.94306639156408, "driven_lanedir_consec": 2.9382421148856936}, "udem-000-ego3": {"driven_any": 3.579590421307752, "survival_time": 59.99999999999873, "driven_lanedir": 3.5660962143307464, "in-drivable-lane": 0.0, "deviation-heading": 2.5682428581837655, "distance-from-start": 2.691073047423519, "deviation-center-line": 2.335221169769412, "driven_lanedir_consec": 3.4240403768242405}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144011213Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-validationsim-0of4successnodavinci-stage-02-6.2.500:05:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.0999999999999377
driven_lanedir_consec_median3.4553761243508863
deviation-center-line_median4.120476289903731


other stats
deviation-center-line_max4.120476289903731
deviation-center-line_mean4.120476289903731
deviation-center-line_min4.120476289903731
deviation-heading_max6.775158807062685
deviation-heading_mean6.775158807062685
deviation-heading_median6.775158807062685
deviation-heading_min6.775158807062685
distance-from-start_max2.7414345611822344
distance-from-start_mean2.7414345611822344
distance-from-start_median2.7414345611822344
distance-from-start_min2.7414345611822344
driven_any_max3.5465926378379353
driven_any_mean3.5465926378379353
driven_any_median3.5465926378379353
driven_any_min3.5465926378379353
driven_lanedir_consec_max3.4553761243508863
driven_lanedir_consec_mean3.4553761243508863
driven_lanedir_consec_min3.4553761243508863
driven_lanedir_max3.4553761243508863
driven_lanedir_mean3.4553761243508863
driven_lanedir_median3.4553761243508863
driven_lanedir_min3.4553761243508863
in-drivable-lane_max1.0999999999999377
in-drivable-lane_mean1.0999999999999377
in-drivable-lane_min1.0999999999999377
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.5465926378379353, "survival_time": 59.99999999999873, "driven_lanedir": 3.4553761243508863, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 6.775158807062685, "distance-from-start": 2.7414345611822344, "deviation-center-line": 4.120476289903731, "driven_lanedir_consec": 3.4553761243508863}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143931215Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:05:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median48.599999999999376
in-drivable-lane_median3.099999999999902
driven_lanedir_consec_median2.1822085786120473
deviation-center-line_median4.281969506383752


other stats
deviation-center-line_max4.281969506383752
deviation-center-line_mean4.281969506383752
deviation-center-line_min4.281969506383752
deviation-heading_max8.956926170181262
deviation-heading_mean8.956926170181262
deviation-heading_median8.956926170181262
deviation-heading_min8.956926170181262
distance-from-start_max1.84932503046977
distance-from-start_mean1.84932503046977
distance-from-start_median1.84932503046977
distance-from-start_min1.84932503046977
driven_any_max2.760582128240964
driven_any_mean2.760582128240964
driven_any_median2.760582128240964
driven_any_min2.760582128240964
driven_lanedir_consec_max2.1822085786120473
driven_lanedir_consec_mean2.1822085786120473
driven_lanedir_consec_min2.1822085786120473
driven_lanedir_max2.5502818256429407
driven_lanedir_mean2.5502818256429407
driven_lanedir_median2.5502818256429407
driven_lanedir_min2.5502818256429407
in-drivable-lane_max3.099999999999902
in-drivable-lane_mean3.099999999999902
in-drivable-lane_min3.099999999999902
per-episodes
details{"zigzag-000-ego0": {"driven_any": 2.760582128240964, "survival_time": 48.599999999999376, "driven_lanedir": 2.5502818256429407, "in-drivable-lane": 3.099999999999902, "deviation-heading": 8.956926170181262, "distance-from-start": 1.84932503046977, "deviation-center-line": 4.281969506383752, "driven_lanedir_consec": 2.1822085786120473}}
simulation-passed1
survival_time_max48.599999999999376
survival_time_mean48.599999999999376
survival_time_min48.599999999999376
No reset possible
143921215Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-testingsim-1of4successnodavinci-stage-02-6.2.500:02:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.09999999999998
in-drivable-lane_median0.0
driven_lanedir_consec_median0.41885674395418215
deviation-center-line_median0.2592734099538108


other stats
deviation-center-line_max0.2592734099538108
deviation-center-line_mean0.2592734099538108
deviation-center-line_min0.2592734099538108
deviation-heading_max0.7151194489559713
deviation-heading_mean0.7151194489559713
deviation-heading_median0.7151194489559713
deviation-heading_min0.7151194489559713
distance-from-start_max0.4199960454985642
distance-from-start_mean0.4199960454985642
distance-from-start_median0.4199960454985642
distance-from-start_min0.4199960454985642
driven_any_max0.42359927688869903
driven_any_mean0.42359927688869903
driven_any_median0.42359927688869903
driven_any_min0.42359927688869903
driven_lanedir_consec_max0.41885674395418215
driven_lanedir_consec_mean0.41885674395418215
driven_lanedir_consec_min0.41885674395418215
driven_lanedir_max0.41885674395418215
driven_lanedir_mean0.41885674395418215
driven_lanedir_median0.41885674395418215
driven_lanedir_min0.41885674395418215
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 0.42359927688869903, "survival_time": 8.09999999999998, "driven_lanedir": 0.41885674395418215, "in-drivable-lane": 0.0, "deviation-heading": 0.7151194489559713, "distance-from-start": 0.4199960454985642, "deviation-center-line": 0.2592734099538108, "driven_lanedir_consec": 0.41885674395418215}}
simulation-passed1
survival_time_max8.09999999999998
survival_time_mean8.09999999999998
survival_time_min8.09999999999998
No reset possible
143881216Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:07:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.349999999999895
driven_lanedir_consec_median2.0916627020116696
deviation-center-line_median5.917247386091067


other stats
deviation-center-line_max5.917247386091067
deviation-center-line_mean5.917247386091067
deviation-center-line_min5.917247386091067
deviation-heading_max8.389432171221175
deviation-heading_mean8.389432171221175
deviation-heading_median8.389432171221175
deviation-heading_min8.389432171221175
distance-from-start_max1.030783298044124
distance-from-start_mean1.030783298044124
distance-from-start_median1.030783298044124
distance-from-start_min1.030783298044124
driven_any_max3.449081983725078
driven_any_mean3.449081983725078
driven_any_median3.449081983725078
driven_any_min3.449081983725078
driven_lanedir_consec_max2.0916627020116696
driven_lanedir_consec_mean2.0916627020116696
driven_lanedir_consec_min2.0916627020116696
driven_lanedir_max3.204014012014441
driven_lanedir_mean3.204014012014441
driven_lanedir_median3.204014012014441
driven_lanedir_min3.204014012014441
in-drivable-lane_max4.349999999999895
in-drivable-lane_mean4.349999999999895
in-drivable-lane_min4.349999999999895
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.449081983725078, "survival_time": 59.99999999999873, "driven_lanedir": 3.204014012014441, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.389432171221175, "distance-from-start": 1.030783298044124, "deviation-center-line": 5.917247386091067, "driven_lanedir_consec": 2.0916627020116696}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143801218Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:17:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.749999999999955
driven_lanedir_consec_median2.967583630098515
deviation-center-line_median4.936499581762261


other stats
deviation-center-line_max5.730573072686608
deviation-center-line_mean4.869852167143673
deviation-center-line_min3.875836432363564
deviation-heading_max12.742085043936966
deviation-heading_mean11.755117428407974
deviation-heading_median12.00130779644692
deviation-heading_min10.275769076801083
distance-from-start_max2.7363667230349455
distance-from-start_mean2.401179119880523
distance-from-start_median2.61282418444398
distance-from-start_min1.6427013875991858
driven_any_max3.5075798773472937
driven_any_mean3.403608315922737
driven_any_median3.4775792335299394
driven_any_min3.151694919283776
driven_lanedir_consec_max3.096555837247597
driven_lanedir_consec_mean2.687260211745085
driven_lanedir_consec_min1.7173177495357104
driven_lanedir_max3.302520401483574
driven_lanedir_mean3.1893582258787174
driven_lanedir_median3.236776064167141
driven_lanedir_min2.9813603736970133
in-drivable-lane_max3.6999999999998785
in-drivable-lane_mean2.762499999999936
in-drivable-lane_min1.8499999999999537
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.4685801016173095, "survival_time": 59.99999999999873, "driven_lanedir": 3.2300333077609547, "in-drivable-lane": 3.6999999999998785, "deviation-heading": 10.275769076801083, "distance-from-start": 2.544064021687348, "deviation-center-line": 4.350076895892649, "driven_lanedir_consec": 2.9538068865000175}, "zigzag-000-ego1": {"driven_any": 3.4865783654425693, "survival_time": 59.99999999999873, "driven_lanedir": 3.2435188205733265, "in-drivable-lane": 3.099999999999887, "deviation-heading": 11.389215220096572, "distance-from-start": 2.681584347200612, "deviation-center-line": 5.5229222676318726, "driven_lanedir_consec": 3.096555837247597}, "zigzag-000-ego2": {"driven_any": 3.5075798773472937, "survival_time": 59.99999999999873, "driven_lanedir": 3.302520401483574, "in-drivable-lane": 2.400000000000023, "deviation-heading": 12.61340037279727, "distance-from-start": 1.6427013875991858, "deviation-center-line": 3.875836432363564, "driven_lanedir_consec": 1.7173177495357104}, "zigzag-000-ego3": {"driven_any": 3.151694919283776, "survival_time": 59.99999999999873, "driven_lanedir": 2.9813603736970133, "in-drivable-lane": 1.8499999999999537, "deviation-heading": 12.742085043936966, "distance-from-start": 2.7363667230349455, "deviation-center-line": 5.730573072686608, "driven_lanedir_consec": 2.9813603736970133}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143721220Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:05:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.849999999999876
driven_lanedir_consec_median2.226136954518312
deviation-center-line_median6.024694972149957


other stats
deviation-center-line_max6.024694972149957
deviation-center-line_mean6.024694972149957
deviation-center-line_min6.024694972149957
deviation-heading_max10.118703616800987
deviation-heading_mean10.118703616800987
deviation-heading_median10.118703616800987
deviation-heading_min10.118703616800987
distance-from-start_max1.7127730347184449
distance-from-start_mean1.7127730347184449
distance-from-start_median1.7127730347184449
distance-from-start_min1.7127730347184449
driven_any_max3.434377949467938
driven_any_mean3.434377949467938
driven_any_median3.434377949467938
driven_any_min3.434377949467938
driven_lanedir_consec_max2.226136954518312
driven_lanedir_consec_mean2.226136954518312
driven_lanedir_consec_min2.226136954518312
driven_lanedir_max3.149126612551262
driven_lanedir_mean3.149126612551262
driven_lanedir_median3.149126612551262
driven_lanedir_min3.149126612551262
in-drivable-lane_max4.849999999999876
in-drivable-lane_mean4.849999999999876
in-drivable-lane_min4.849999999999876
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.434377949467938, "survival_time": 59.99999999999873, "driven_lanedir": 3.149126612551262, "in-drivable-lane": 4.849999999999876, "deviation-heading": 10.118703616800987, "distance-from-start": 1.7127730347184449, "deviation-center-line": 6.024694972149957, "driven_lanedir_consec": 2.226136954518312}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143681222Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-validationsim-1of4successnodavinci-stage-02-6.2.500:04:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.449999999999882
driven_lanedir_consec_median3.3057932853077427
deviation-center-line_median7.154226688493768


other stats
deviation-center-line_max7.154226688493768
deviation-center-line_mean7.154226688493768
deviation-center-line_min7.154226688493768
deviation-heading_max5.348097201635609
deviation-heading_mean5.348097201635609
deviation-heading_median5.348097201635609
deviation-heading_min5.348097201635609
distance-from-start_max1.6303675543068192
distance-from-start_mean1.6303675543068192
distance-from-start_median1.6303675543068192
distance-from-start_min1.6303675543068192
driven_any_max3.47609109580057
driven_any_mean3.47609109580057
driven_any_median3.47609109580057
driven_any_min3.47609109580057
driven_lanedir_consec_max3.3057932853077427
driven_lanedir_consec_mean3.3057932853077427
driven_lanedir_consec_min3.3057932853077427
driven_lanedir_max3.3057932853077427
driven_lanedir_mean3.3057932853077427
driven_lanedir_median3.3057932853077427
driven_lanedir_min3.3057932853077427
in-drivable-lane_max3.449999999999882
in-drivable-lane_mean3.449999999999882
in-drivable-lane_min3.449999999999882
per-episodes
details{"loop-000-ego0": {"driven_any": 3.47609109580057, "survival_time": 59.99999999999873, "driven_lanedir": 3.3057932853077427, "in-drivable-lane": 3.449999999999882, "deviation-heading": 5.348097201635609, "distance-from-start": 1.6303675543068192, "deviation-center-line": 7.154226688493768, "driven_lanedir_consec": 3.3057932853077427}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143631223Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-validationsim-1of4successnodavinci-stage-02-6.2.500:04:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.3284423748962833
deviation-center-line_median2.2080698436648767


other stats
deviation-center-line_max2.2080698436648767
deviation-center-line_mean2.2080698436648767
deviation-center-line_min2.2080698436648767
deviation-heading_max3.646079460993991
deviation-heading_mean3.646079460993991
deviation-heading_median3.646079460993991
deviation-heading_min3.646079460993991
distance-from-start_max2.0667500720956693
distance-from-start_mean2.0667500720956693
distance-from-start_median2.0667500720956693
distance-from-start_min2.0667500720956693
driven_any_max3.579583385567372
driven_any_mean3.579583385567372
driven_any_median3.579583385567372
driven_any_min3.579583385567372
driven_lanedir_consec_max3.3284423748962833
driven_lanedir_consec_mean3.3284423748962833
driven_lanedir_consec_min3.3284423748962833
driven_lanedir_max3.558841603983183
driven_lanedir_mean3.558841603983183
driven_lanedir_median3.558841603983183
driven_lanedir_min3.558841603983183
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-000-ego0": {"driven_any": 3.579583385567372, "survival_time": 59.99999999999873, "driven_lanedir": 3.558841603983183, "in-drivable-lane": 0.0, "deviation-heading": 3.646079460993991, "distance-from-start": 2.0667500720956693, "deviation-center-line": 2.2080698436648767, "driven_lanedir_consec": 3.3284423748962833}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143581224Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-validationsim-1of4successnodavinci-stage-02-6.2.500:09:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median1.522558677891614
deviation-center-line_median5.123208250925155


other stats
deviation-center-line_max7.953308842217784
deviation-center-line_mean5.026103289778249
deviation-center-line_min1.904687815044904
deviation-heading_max7.817092400173712
deviation-heading_mean5.15630723293663
deviation-heading_median4.732874626105395
deviation-heading_min3.3423872793620153
distance-from-start_max2.224084223392078
distance-from-start_mean1.372418883130667
distance-from-start_median1.2029346346602598
distance-from-start_min0.8597220398100703
driven_any_max3.579587032303966
driven_any_mean2.260716204012659
driven_any_median1.9288422979916977
driven_any_min1.605593187763276
driven_lanedir_consec_max3.4576714425164017
driven_lanedir_consec_mean1.8357601162686237
driven_lanedir_consec_min0.8402516667748646
driven_lanedir_max3.5592470379137566
driven_lanedir_mean2.213681704953217
driven_lanedir_median1.8578137794091545
driven_lanedir_min1.5798522230808028
in-drivable-lane_max2.050000000000029
in-drivable-lane_mean0.5125000000000073
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 1.6055966761902978, "survival_time": 59.99999999999873, "driven_lanedir": 1.5798522230808028, "in-drivable-lane": 0.0, "deviation-heading": 3.3423872793620153, "distance-from-start": 1.2287147051666274, "deviation-center-line": 7.953308842217784, "driven_lanedir_consec": 1.5798522230808028}, "udem-000-ego1": {"driven_any": 3.579587032303966, "survival_time": 59.99999999999873, "driven_lanedir": 3.5592470379137566, "in-drivable-lane": 0.0, "deviation-heading": 3.7635172998949176, "distance-from-start": 2.224084223392078, "deviation-center-line": 3.3812202063089525, "driven_lanedir_consec": 3.4576714425164017}, "udem-000-ego2": {"driven_any": 2.252087919793097, "survival_time": 59.99999999999873, "driven_lanedir": 2.1195031205111157, "in-drivable-lane": 2.050000000000029, "deviation-heading": 5.702231952315873, "distance-from-start": 0.8597220398100703, "deviation-center-line": 6.865196295541358, "driven_lanedir_consec": 0.8402516667748646}, "udem-000-ego3": {"driven_any": 1.605593187763276, "survival_time": 59.99999999999873, "driven_lanedir": 1.5961244383071926, "in-drivable-lane": 0.0, "deviation-heading": 7.817092400173712, "distance-from-start": 1.1771545641538923, "deviation-center-line": 1.904687815044904, "driven_lanedir_consec": 1.465265132702425}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143521226Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-validation456successnodavinci-stage-02-6.2.500:08:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.099999999999934
driven_lanedir_consec_median1.8973608400181132
deviation-center-line_median5.3880108744075565


other stats
deviation-center-line_max6.903445684376676
deviation-center-line_mean5.612921473090703
deviation-center-line_min4.772218459171019
deviation-heading_max15.02555174455008
deviation-heading_mean10.45449936261399
deviation-heading_median9.248893281518503
deviation-heading_min8.294659142868873
distance-from-start_max2.0804344874151774
distance-from-start_mean1.5433388633129133
distance-from-start_median1.5088470919215975
distance-from-start_min1.0752267819932797
driven_any_max3.486581671325458
driven_any_mean3.1532625917511363
driven_any_median3.468507419831603
driven_any_min2.1894538560158803
driven_lanedir_consec_max2.2300643257801345
driven_lanedir_consec_mean1.813258468942192
driven_lanedir_consec_min1.2282478699524082
driven_lanedir_max3.28215092073356
driven_lanedir_mean2.967057861142024
driven_lanedir_median3.238194418198729
driven_lanedir_min2.109691687437078
in-drivable-lane_max4.299999999999898
in-drivable-lane_mean2.8124999999999307
in-drivable-lane_min0.7499999999999574
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.486581671325458, "survival_time": 59.99999999999873, "driven_lanedir": 3.27252161740038, "in-drivable-lane": 3.099999999999902, "deviation-heading": 9.626196218066466, "distance-from-start": 2.0804344874151774, "deviation-center-line": 4.772218459171019, "driven_lanedir_consec": 2.2300643257801345}, "zigzag-000-ego1": {"driven_any": 3.4505818618765804, "survival_time": 59.99999999999873, "driven_lanedir": 3.203867218997078, "in-drivable-lane": 4.299999999999898, "deviation-heading": 8.871590344970546, "distance-from-start": 1.0752267819932797, "deviation-center-line": 5.83827182865662, "driven_lanedir_consec": 1.2282478699524082}, "zigzag-000-ego2": {"driven_any": 3.4864329777866256, "survival_time": 59.99999999999873, "driven_lanedir": 3.28215092073356, "in-drivable-lane": 3.099999999999966, "deviation-heading": 8.294659142868873, "distance-from-start": 1.1001442910232833, "deviation-center-line": 4.937749920158493, "driven_lanedir_consec": 1.6850299925991483}, "zigzag-000-ego3": {"driven_any": 2.1894538560158803, "survival_time": 59.99999999999873, "driven_lanedir": 2.109691687437078, "in-drivable-lane": 0.7499999999999574, "deviation-heading": 15.02555174455008, "distance-from-start": 1.917549892819912, "deviation-center-line": 6.903445684376676, "driven_lanedir_consec": 2.109691687437078}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143451227Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:03:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.1499999999999666
driven_lanedir_consec_median1.4204028644018567
deviation-center-line_median4.903598525098628


other stats
deviation-center-line_max4.903598525098628
deviation-center-line_mean4.903598525098628
deviation-center-line_min4.903598525098628
deviation-heading_max7.744574599008731
deviation-heading_mean7.744574599008731
deviation-heading_median7.744574599008731
deviation-heading_min7.744574599008731
distance-from-start_max1.2060007868632094
distance-from-start_mean1.2060007868632094
distance-from-start_median1.2060007868632094
distance-from-start_min1.2060007868632094
driven_any_max3.485084017697367
driven_any_mean3.485084017697367
driven_any_median3.485084017697367
driven_any_min3.485084017697367
driven_lanedir_consec_max1.4204028644018567
driven_lanedir_consec_mean1.4204028644018567
driven_lanedir_consec_min1.4204028644018567
driven_lanedir_max3.290525892781009
driven_lanedir_mean3.290525892781009
driven_lanedir_median3.290525892781009
driven_lanedir_min3.290525892781009
in-drivable-lane_max3.1499999999999666
in-drivable-lane_mean3.1499999999999666
in-drivable-lane_min3.1499999999999666
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.485084017697367, "survival_time": 59.99999999999873, "driven_lanedir": 3.290525892781009, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.744574599008731, "distance-from-start": 1.2060007868632094, "deviation-center-line": 4.903598525098628, "driven_lanedir_consec": 1.4204028644018567}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143411228Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-testingsim-0of4successnodavinci-stage-02-6.2.500:04:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.0000000000000284
driven_lanedir_consec_median2.241204615389226
deviation-center-line_median4.759684198968496


other stats
deviation-center-line_max4.759684198968496
deviation-center-line_mean4.759684198968496
deviation-center-line_min4.759684198968496
deviation-heading_max9.18078892152259
deviation-heading_mean9.18078892152259
deviation-heading_median9.18078892152259
deviation-heading_min9.18078892152259
distance-from-start_max1.6296054226673595
distance-from-start_mean1.6296054226673595
distance-from-start_median1.6296054226673595
distance-from-start_min1.6296054226673595
driven_any_max3.519583547683476
driven_any_mean3.519583547683476
driven_any_median3.519583547683476
driven_any_min3.519583547683476
driven_lanedir_consec_max2.241204615389226
driven_lanedir_consec_mean2.241204615389226
driven_lanedir_consec_min2.241204615389226
driven_lanedir_max3.353584317203001
driven_lanedir_mean3.353584317203001
driven_lanedir_median3.353584317203001
driven_lanedir_min3.353584317203001
in-drivable-lane_max2.0000000000000284
in-drivable-lane_mean2.0000000000000284
in-drivable-lane_min2.0000000000000284
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.519583547683476, "survival_time": 59.99999999999873, "driven_lanedir": 3.353584317203001, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 9.18078892152259, "distance-from-start": 1.6296054226673595, "deviation-center-line": 4.759684198968496, "driven_lanedir_consec": 2.241204615389226}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143371229Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-testingsim-0of4successnodavinci-stage-02-6.2.500:04:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median49.9499999999993
in-drivable-lane_median0.0
driven_lanedir_consec_median2.9030524638411164
deviation-center-line_median3.789617561777741


other stats
deviation-center-line_max3.789617561777741
deviation-center-line_mean3.789617561777741
deviation-center-line_min3.789617561777741
deviation-heading_max4.33452755283993
deviation-heading_mean4.33452755283993
deviation-heading_median4.33452755283993
deviation-heading_min4.33452755283993
distance-from-start_max1.573887224004309
distance-from-start_mean1.573887224004309
distance-from-start_median1.573887224004309
distance-from-start_min1.573887224004309
driven_any_max2.934594724979699
driven_any_mean2.934594724979699
driven_any_median2.934594724979699
driven_any_min2.934594724979699
driven_lanedir_consec_max2.9030524638411164
driven_lanedir_consec_mean2.9030524638411164
driven_lanedir_consec_min2.9030524638411164
driven_lanedir_max2.9099692680363995
driven_lanedir_mean2.9099692680363995
driven_lanedir_median2.9099692680363995
driven_lanedir_min2.9099692680363995
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 2.934594724979699, "survival_time": 49.9499999999993, "driven_lanedir": 2.9099692680363995, "in-drivable-lane": 0.0, "deviation-heading": 4.33452755283993, "distance-from-start": 1.573887224004309, "deviation-center-line": 3.789617561777741, "driven_lanedir_consec": 2.9030524638411164}}
simulation-passed1
survival_time_max49.9499999999993
survival_time_mean49.9499999999993
survival_time_min49.9499999999993
No reset possible
143311231Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:10:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.3736117232564378
deviation-center-line_median3.737280565079689


other stats
deviation-center-line_max3.737280565079689
deviation-center-line_mean3.737280565079689
deviation-center-line_min3.737280565079689
deviation-heading_max4.891434118207675
deviation-heading_mean4.891434118207675
deviation-heading_median4.891434118207675
deviation-heading_min4.891434118207675
distance-from-start_max2.2750369053700705
distance-from-start_mean2.2750369053700705
distance-from-start_median2.2750369053700705
distance-from-start_min2.2750369053700705
driven_any_max3.5795882003110293
driven_any_mean3.5795882003110293
driven_any_median3.5795882003110293
driven_any_min3.5795882003110293
driven_lanedir_consec_max3.3736117232564378
driven_lanedir_consec_mean3.3736117232564378
driven_lanedir_consec_min3.3736117232564378
driven_lanedir_max3.5508258394155683
driven_lanedir_mean3.5508258394155683
driven_lanedir_median3.5508258394155683
driven_lanedir_min3.5508258394155683
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 3.5795882003110293, "survival_time": 59.99999999999873, "driven_lanedir": 3.5508258394155683, "in-drivable-lane": 0.0, "deviation-heading": 4.891434118207675, "distance-from-start": 2.2750369053700705, "deviation-center-line": 3.737280565079689, "driven_lanedir_consec": 3.3736117232564378}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143231233Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-0of4successnodavinci-stage-02-6.2.500:11:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.449999999999882
driven_lanedir_consec_median3.305795356040574
deviation-center-line_median7.1542258236818705


other stats
deviation-center-line_max7.1542258236818705
deviation-center-line_mean7.1542258236818705
deviation-center-line_min7.1542258236818705
deviation-heading_max5.348097044239231
deviation-heading_mean5.348097044239231
deviation-heading_median5.348097044239231
deviation-heading_min5.348097044239231
distance-from-start_max1.6303676290838451
distance-from-start_mean1.6303676290838451
distance-from-start_median1.6303676290838451
distance-from-start_min1.6303676290838451
driven_any_max3.4760910958010065
driven_any_mean3.4760910958010065
driven_any_median3.4760910958010065
driven_any_min3.4760910958010065
driven_lanedir_consec_max3.305795356040574
driven_lanedir_consec_mean3.305795356040574
driven_lanedir_consec_min3.305795356040574
driven_lanedir_max3.305795356040574
driven_lanedir_mean3.305795356040574
driven_lanedir_median3.305795356040574
driven_lanedir_min3.305795356040574
in-drivable-lane_max3.449999999999882
in-drivable-lane_mean3.449999999999882
in-drivable-lane_min3.449999999999882
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.4760910958010065, "survival_time": 59.99999999999873, "driven_lanedir": 3.305795356040574, "in-drivable-lane": 3.449999999999882, "deviation-heading": 5.348097044239231, "distance-from-start": 1.6303676290838451, "deviation-center-line": 7.1542258236818705, "driven_lanedir_consec": 3.305795356040574}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143191234Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:05:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.349999999999895
driven_lanedir_consec_median2.091675968172336
deviation-center-line_median5.914160547874868


other stats
deviation-center-line_max5.914160547874868
deviation-center-line_mean5.914160547874868
deviation-center-line_min5.914160547874868
deviation-heading_max8.38876582052179
deviation-heading_mean8.38876582052179
deviation-heading_median8.38876582052179
deviation-heading_min8.38876582052179
distance-from-start_max1.0308143802054677
distance-from-start_mean1.0308143802054677
distance-from-start_median1.0308143802054677
distance-from-start_min1.0308143802054677
driven_any_max3.4490819834539503
driven_any_mean3.4490819834539503
driven_any_median3.4490819834539503
driven_any_min3.4490819834539503
driven_lanedir_consec_max2.091675968172336
driven_lanedir_consec_mean2.091675968172336
driven_lanedir_consec_min2.091675968172336
driven_lanedir_max3.204051662096265
driven_lanedir_mean3.204051662096265
driven_lanedir_median3.204051662096265
driven_lanedir_min3.204051662096265
in-drivable-lane_max4.349999999999895
in-drivable-lane_mean4.349999999999895
in-drivable-lane_min4.349999999999895
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.4490819834539503, "survival_time": 59.99999999999873, "driven_lanedir": 3.204051662096265, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.38876582052179, "distance-from-start": 1.0308143802054677, "deviation-center-line": 5.914160547874868, "driven_lanedir_consec": 2.091675968172336}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143151235Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:03:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.349999999999895
driven_lanedir_consec_median2.091631317677411
deviation-center-line_median5.914152927086772


other stats
deviation-center-line_max5.914152927086772
deviation-center-line_mean5.914152927086772
deviation-center-line_min5.914152927086772
deviation-heading_max8.388766833741702
deviation-heading_mean8.388766833741702
deviation-heading_median8.388766833741702
deviation-heading_min8.388766833741702
distance-from-start_max1.0308142273247416
distance-from-start_mean1.0308142273247416
distance-from-start_median1.0308142273247416
distance-from-start_min1.0308142273247416
driven_any_max3.449081983452879
driven_any_mean3.449081983452879
driven_any_median3.449081983452879
driven_any_min3.449081983452879
driven_lanedir_consec_max2.091631317677411
driven_lanedir_consec_mean2.091631317677411
driven_lanedir_consec_min2.091631317677411
driven_lanedir_max3.203997570451749
driven_lanedir_mean3.203997570451749
driven_lanedir_median3.203997570451749
driven_lanedir_min3.203997570451749
in-drivable-lane_max4.349999999999895
in-drivable-lane_mean4.349999999999895
in-drivable-lane_min4.349999999999895
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.449081983452879, "survival_time": 59.99999999999873, "driven_lanedir": 3.203997570451749, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.388766833741702, "distance-from-start": 1.0308142273247416, "deviation-center-line": 5.914152927086772, "driven_lanedir_consec": 2.091631317677411}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143081237Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:02:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.099999999999983
in-drivable-lane_median5.649999999999983
driven_lanedir_consec_median0.1397956002040246
deviation-center-line_median0.09390664341773942


other stats
deviation-center-line_max0.09390664341773942
deviation-center-line_mean0.09390664341773942
deviation-center-line_min0.09390664341773942
deviation-heading_max0.9654183287874442
deviation-heading_mean0.9654183287874442
deviation-heading_median0.9654183287874442
deviation-heading_min0.9654183287874442
distance-from-start_max1.0016247187181055
distance-from-start_mean1.0016247187181055
distance-from-start_median1.0016247187181055
distance-from-start_min1.0016247187181055
driven_any_max1.0016732136326914
driven_any_mean1.0016732136326914
driven_any_median1.0016732136326914
driven_any_min1.0016732136326914
driven_lanedir_consec_max0.1397956002040246
driven_lanedir_consec_mean0.1397956002040246
driven_lanedir_consec_min0.1397956002040246
driven_lanedir_max0.1397956002040246
driven_lanedir_mean0.1397956002040246
driven_lanedir_median0.1397956002040246
driven_lanedir_min0.1397956002040246
in-drivable-lane_max5.649999999999983
in-drivable-lane_mean5.649999999999983
in-drivable-lane_min5.649999999999983
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.0016732136326914, "survival_time": 7.099999999999983, "driven_lanedir": 0.1397956002040246, "in-drivable-lane": 5.649999999999983, "deviation-heading": 0.9654183287874442, "distance-from-start": 1.0016247187181055, "deviation-center-line": 0.09390664341773942, "driven_lanedir_consec": 0.1397956002040246}}
simulation-passed1
survival_time_max7.099999999999983
survival_time_mean7.099999999999983
survival_time_min7.099999999999983
No reset possible
143041239Bea Baselines 🐤minimal-agentaido-LFI-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
142991240Bea Baselines 🐤minimal-agentaido-LF-sim-validationsim-1of4successnodavinci-stage-02-6.2.500:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1969489134232345
survival_time_median10.450000000000014
deviation-center-line_median0.1253905781126274
in-drivable-lane_median8.700000000000014


other stats
deviation-center-line_max0.1253905781126274
deviation-center-line_mean0.1253905781126274
deviation-center-line_min0.1253905781126274
deviation-heading_max0.9520924629376072
deviation-heading_mean0.9520924629376072
deviation-heading_median0.9520924629376072
deviation-heading_min0.9520924629376072
distance-from-start_max1.5508236376562057
distance-from-start_mean1.5508236376562057
distance-from-start_median1.5508236376562057
distance-from-start_min1.5508236376562057
driven_any_max1.5511368313112754
driven_any_mean1.5511368313112754
driven_any_median1.5511368313112754
driven_any_min1.5511368313112754
driven_lanedir_consec_max0.1969489134232345
driven_lanedir_consec_mean0.1969489134232345
driven_lanedir_consec_min0.1969489134232345
driven_lanedir_max0.1969489134232345
driven_lanedir_mean0.1969489134232345
driven_lanedir_median0.1969489134232345
driven_lanedir_min0.1969489134232345
in-drivable-lane_max8.700000000000014
in-drivable-lane_mean8.700000000000014
in-drivable-lane_min8.700000000000014
per-episodes
details{"loop-000-ego0": {"driven_any": 1.5511368313112754, "survival_time": 10.450000000000014, "driven_lanedir": 0.1969489134232345, "in-drivable-lane": 8.700000000000014, "deviation-heading": 0.9520924629376072, "distance-from-start": 1.5508236376562057, "deviation-center-line": 0.1253905781126274, "driven_lanedir_consec": 0.1969489134232345}}
simulation-passed1
survival_time_max10.450000000000014
survival_time_mean10.450000000000014
survival_time_min10.450000000000014
No reset possible
142971240Bea Baselines 🐤minimal-agentaido-LF-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.19694617160956465
survival_time_median10.450000000000014
deviation-center-line_median0.1253907294304808
in-drivable-lane_median8.700000000000014


other stats
deviation-center-line_max0.1253907294304808
deviation-center-line_mean0.1253907294304808
deviation-center-line_min0.1253907294304808
deviation-heading_max0.9520924629376074
deviation-heading_mean0.9520924629376074
deviation-heading_median0.9520924629376074
deviation-heading_min0.9520924629376074
distance-from-start_max1.5508236376562086
distance-from-start_mean1.5508236376562086
distance-from-start_median1.5508236376562086
distance-from-start_min1.5508236376562086
driven_any_max1.5511368313112877
driven_any_mean1.5511368313112877
driven_any_median1.5511368313112877
driven_any_min1.5511368313112877
driven_lanedir_consec_max0.19694617160956465
driven_lanedir_consec_mean0.19694617160956465
driven_lanedir_consec_min0.19694617160956465
driven_lanedir_max0.19694617160956465
driven_lanedir_mean0.19694617160956465
driven_lanedir_median0.19694617160956465
driven_lanedir_min0.19694617160956465
in-drivable-lane_max8.700000000000014
in-drivable-lane_mean8.700000000000014
in-drivable-lane_min8.700000000000014
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.5511368313112877, "survival_time": 10.450000000000014, "driven_lanedir": 0.19694617160956465, "in-drivable-lane": 8.700000000000014, "deviation-heading": 0.9520924629376074, "distance-from-start": 1.5508236376562086, "deviation-center-line": 0.1253907294304808, "driven_lanedir_consec": 0.19694617160956465}}
simulation-passed1
survival_time_max10.450000000000014
survival_time_mean10.450000000000014
survival_time_min10.450000000000014
No reset possible
142931241Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
142911242Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:02:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.700000000000044
in-drivable-lane_median10.325000000000047
driven_lanedir_consec_median0.2454627567044649
deviation-center-line_median0.20268004628951308


other stats
deviation-center-line_max0.2697354450181819
deviation-center-line_mean0.20268004628951308
deviation-center-line_min0.13562464756084422
deviation-heading_max2.5383505748046193
deviation-heading_mean1.643080022875978
deviation-heading_median1.643080022875978
deviation-heading_min0.7478094709473364
distance-from-start_max1.9240493840830373
distance-from-start_mean1.152779949170181
distance-from-start_median1.152779949170181
distance-from-start_min0.3815105142573241
driven_any_max1.9241954407136783
driven_any_mean1.1528564552862215
driven_any_median1.1528564552862215
driven_any_min0.38151746985876434
driven_lanedir_consec_max0.33122977762117056
driven_lanedir_consec_mean0.2454627567044649
driven_lanedir_consec_min0.1596957357877593
driven_lanedir_max0.33122977762117056
driven_lanedir_mean0.2454627567044649
driven_lanedir_median0.2454627567044649
driven_lanedir_min0.1596957357877593
in-drivable-lane_max11.250000000000046
in-drivable-lane_mean10.325000000000047
in-drivable-lane_min9.40000000000005
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.9241954407136783, "survival_time": 12.700000000000044, "driven_lanedir": 0.33122977762117056, "in-drivable-lane": 9.40000000000005, "deviation-heading": 2.5383505748046193, "distance-from-start": 1.9240493840830373, "deviation-center-line": 0.2697354450181819, "driven_lanedir_consec": 0.33122977762117056}, "loop2-000-ego1": {"driven_any": 0.38151746985876434, "survival_time": 12.700000000000044, "driven_lanedir": 0.1596957357877593, "in-drivable-lane": 11.250000000000046, "deviation-heading": 0.7478094709473364, "distance-from-start": 0.3815105142573241, "deviation-center-line": 0.13562464756084422, "driven_lanedir_consec": 0.1596957357877593}}
simulation-passed1
survival_time_max12.700000000000044
survival_time_mean12.700000000000044
survival_time_min12.700000000000044
No reset possible
142841244Bea Baselines 🐤minimal-agentlx22-modconsimsuccessyesdavinci-stage-02-6.2.500:04:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median15.200000000000092
deviation-center-line_median0.0
driven_lanedir_consec_median0.0
survival_time_median15.200000000000092


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.705646613157915
distance-from-start_mean2.336800784178124
distance-from-start_median2.336800784178124
distance-from-start_min0.9679549551983332
driven_any_max3.707570013404081
driven_any_mean2.33778303094729
driven_any_median2.33778303094729
driven_any_min0.9679960484904996
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max23.5000000000002
in-drivable-lane_mean15.200000000000092
in-drivable-lane_min6.8999999999999835
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 3.707570013404081, "survival_time": 23.5000000000002, "driven_lanedir": 0.0, "in-drivable-lane": 23.5000000000002, "deviation-heading": 0.0, "distance-from-start": 3.705646613157915, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}, "LF-full-loop-001-ego0": {"driven_any": 0.9679960484904996, "survival_time": 6.8999999999999835, "driven_lanedir": 0.0, "in-drivable-lane": 6.8999999999999835, "deviation-heading": 0.0, "distance-from-start": 0.9679549551983332, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max23.5000000000002
survival_time_mean15.200000000000092
survival_time_min6.8999999999999835
No reset possible
142761259Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:04:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.950000000000106
in-drivable-lane_median10.550000000000091
driven_lanedir_consec_median0.8098306254279477
deviation-center-line_median0.6056754982599343


other stats
deviation-center-line_max0.6056754982599343
deviation-center-line_mean0.6056754982599343
deviation-center-line_min0.6056754982599343
deviation-heading_max3.6841553172183903
deviation-heading_mean3.6841553172183903
deviation-heading_median3.6841553172183903
deviation-heading_min3.6841553172183903
distance-from-start_max2.628171879536872
distance-from-start_mean2.628171879536872
distance-from-start_median2.628171879536872
distance-from-start_min2.628171879536872
driven_any_max2.628857921604552
driven_any_mean2.628857921604552
driven_any_median2.628857921604552
driven_any_min2.628857921604552
driven_lanedir_consec_max0.8098306254279477
driven_lanedir_consec_mean0.8098306254279477
driven_lanedir_consec_min0.8098306254279477
driven_lanedir_max0.8098306254279477
driven_lanedir_mean0.8098306254279477
driven_lanedir_median0.8098306254279477
driven_lanedir_min0.8098306254279477
in-drivable-lane_max10.550000000000091
in-drivable-lane_mean10.550000000000091
in-drivable-lane_min10.550000000000091
per-episodes
details{"zigzag-000-ego0": {"driven_any": 2.628857921604552, "survival_time": 16.950000000000106, "driven_lanedir": 0.8098306254279477, "in-drivable-lane": 10.550000000000091, "deviation-heading": 3.6841553172183903, "distance-from-start": 2.628171879536872, "deviation-center-line": 0.6056754982599343, "driven_lanedir_consec": 0.8098306254279477}}
simulation-passed1
survival_time_max16.950000000000106
survival_time_mean16.950000000000106
survival_time_min16.950000000000106
No reset possible
142711261Bea Baselines 🐤minimal-agentaido-LFI-sim-testingsim-0of4successnodavinci-stage-02-6.2.500:01:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.149999999999993
in-drivable-lane_median2.749999999999993
driven_lanedir_consec_median0.13666480491623578
deviation-center-line_median0.10783802485851966


other stats
deviation-center-line_max0.10783802485851966
deviation-center-line_mean0.10783802485851966
deviation-center-line_min0.10783802485851966
deviation-heading_max0.9508048428349386
deviation-heading_mean0.9508048428349386
deviation-heading_median0.9508048428349386
deviation-heading_min0.9508048428349386
distance-from-start_max0.5146479428595191
distance-from-start_mean0.5146479428595191
distance-from-start_median0.5146479428595191
distance-from-start_min0.5146479428595191
driven_any_max0.5146585239872693
driven_any_mean0.5146585239872693
driven_any_median0.5146585239872693
driven_any_min0.5146585239872693
driven_lanedir_consec_max0.13666480491623578
driven_lanedir_consec_mean0.13666480491623578
driven_lanedir_consec_min0.13666480491623578
driven_lanedir_max0.13666480491623578
driven_lanedir_mean0.13666480491623578
driven_lanedir_median0.13666480491623578
driven_lanedir_min0.13666480491623578
in-drivable-lane_max2.749999999999993
in-drivable-lane_mean2.749999999999993
in-drivable-lane_min2.749999999999993
per-episodes
details{"4way-000-ego0": {"driven_any": 0.5146585239872693, "survival_time": 4.149999999999993, "driven_lanedir": 0.13666480491623578, "in-drivable-lane": 2.749999999999993, "deviation-heading": 0.9508048428349386, "distance-from-start": 0.5146479428595191, "deviation-center-line": 0.10783802485851966, "driven_lanedir_consec": 0.13666480491623578}}
simulation-passed1
survival_time_max4.149999999999993
survival_time_mean4.149999999999993
survival_time_min4.149999999999993
No reset possible
142661262Bea Baselines 🐤minimal-agentaido-LF-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:01:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.30902388815479953
survival_time_median13.80000000000006
deviation-center-line_median0.26861568883973136
in-drivable-lane_median10.700000000000069


other stats
deviation-center-line_max0.26861568883973136
deviation-center-line_mean0.26861568883973136
deviation-center-line_min0.26861568883973136
deviation-heading_max2.499533756017491
deviation-heading_mean2.499533756017491
deviation-heading_median2.499533756017491
deviation-heading_min2.499533756017491
distance-from-start_max2.107081087129661
distance-from-start_mean2.107081087129661
distance-from-start_median2.107081087129661
distance-from-start_min2.107081087129661
driven_any_max2.107326449228953
driven_any_mean2.107326449228953
driven_any_median2.107326449228953
driven_any_min2.107326449228953
driven_lanedir_consec_max0.30902388815479953
driven_lanedir_consec_mean0.30902388815479953
driven_lanedir_consec_min0.30902388815479953
driven_lanedir_max0.30902388815479953
driven_lanedir_mean0.30902388815479953
driven_lanedir_median0.30902388815479953
driven_lanedir_min0.30902388815479953
in-drivable-lane_max10.700000000000069
in-drivable-lane_mean10.700000000000069
in-drivable-lane_min10.700000000000069
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.107326449228953, "survival_time": 13.80000000000006, "driven_lanedir": 0.30902388815479953, "in-drivable-lane": 10.700000000000069, "deviation-heading": 2.499533756017491, "distance-from-start": 2.107081087129661, "deviation-center-line": 0.26861568883973136, "driven_lanedir_consec": 0.30902388815479953}}
simulation-passed1
survival_time_max13.80000000000006
survival_time_mean13.80000000000006
survival_time_min13.80000000000006
No reset possible
142561264Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:05:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median21.200000000000166
in-drivable-lane_median19.625000000000163
driven_lanedir_consec_median0.17676532608959172
deviation-center-line_median0.12055883486711412


other stats
deviation-center-line_max0.8045746318533537
deviation-center-line_mean0.2853942640066456
deviation-center-line_min0.09588475443900028
deviation-heading_max5.2482884111975086
deviation-heading_mean1.8371274357323064
deviation-heading_median0.7612914460035247
deviation-heading_min0.5776384397246679
distance-from-start_max3.3354107982510546
distance-from-start_mean2.2110865327147784
distance-from-start_median2.191605904940471
distance-from-start_min1.1257235227271165
driven_any_max3.3361297078559655
driven_any_mean2.2114839832360524
driven_any_median2.1920133941339253
driven_any_min1.1257794368203942
driven_lanedir_consec_max1.1849271720723111
driven_lanedir_consec_mean0.4079658658358902
driven_lanedir_consec_min0.09340563909206612
driven_lanedir_max1.1849271720723111
driven_lanedir_mean0.4079658658358902
driven_lanedir_median0.17676532608959172
driven_lanedir_min0.09340563909206612
in-drivable-lane_max20.100000000000165
in-drivable-lane_mean17.837500000000155
in-drivable-lane_min12.00000000000012
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.3361297078559655, "survival_time": 21.200000000000166, "driven_lanedir": 1.1849271720723111, "in-drivable-lane": 12.00000000000012, "deviation-heading": 5.2482884111975086, "distance-from-start": 3.3354107982510546, "deviation-center-line": 0.8045746318533537, "driven_lanedir_consec": 1.1849271720723111}, "zigzag-000-ego1": {"driven_any": 2.855019965863893, "survival_time": 21.200000000000166, "driven_lanedir": 0.14869325237796405, "in-drivable-lane": 19.850000000000165, "deviation-heading": 0.5776384397246679, "distance-from-start": 2.8543136070620254, "deviation-center-line": 0.1372078405659203, "driven_lanedir_consec": 0.14869325237796405}, "zigzag-000-ego2": {"driven_any": 1.5290068224039577, "survival_time": 21.200000000000166, "driven_lanedir": 0.20483739980121937, "in-drivable-lane": 19.40000000000017, "deviation-heading": 0.7499200019270054, "distance-from-start": 1.5288982028189169, "deviation-center-line": 0.09588475443900028, "driven_lanedir_consec": 0.20483739980121937}, "zigzag-000-ego3": {"driven_any": 1.1257794368203942, "survival_time": 21.200000000000166, "driven_lanedir": 0.09340563909206612, "in-drivable-lane": 20.100000000000165, "deviation-heading": 0.772662890080044, "distance-from-start": 1.1257235227271165, "deviation-center-line": 0.10390982916830796, "driven_lanedir_consec": 0.09340563909206612}}
simulation-passed1
survival_time_max21.200000000000166
survival_time_mean21.200000000000166
survival_time_min21.200000000000166
No reset possible
142461289Bea Baselines 🐤template-randomaido-LFV-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:17:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median53.69999999999868
driven_lanedir_consec_median0.035772152071414265
deviation-center-line_median0.5480591600958397


other stats
deviation-center-line_max0.5480591600958397
deviation-center-line_mean0.5480591600958397
deviation-center-line_min0.5480591600958397
deviation-heading_max5.01528057758804
deviation-heading_mean5.01528057758804
deviation-heading_median5.01528057758804
deviation-heading_min5.01528057758804
distance-from-start_max1.4108418329398995
distance-from-start_mean1.4108418329398995
distance-from-start_median1.4108418329398995
distance-from-start_min1.4108418329398995
driven_any_max15.32631084737064
driven_any_mean15.32631084737064
driven_any_median15.32631084737064
driven_any_min15.32631084737064
driven_lanedir_consec_max0.035772152071414265
driven_lanedir_consec_mean0.035772152071414265
driven_lanedir_consec_min0.035772152071414265
driven_lanedir_max0.035772152071414265
driven_lanedir_mean0.035772152071414265
driven_lanedir_median0.035772152071414265
driven_lanedir_min0.035772152071414265
in-drivable-lane_max53.69999999999868
in-drivable-lane_mean53.69999999999868
in-drivable-lane_min53.69999999999868
per-episodes
details{"zigzag-000-ego0": {"driven_any": 15.32631084737064, "survival_time": 59.99999999999873, "driven_lanedir": 0.035772152071414265, "in-drivable-lane": 53.69999999999868, "deviation-heading": 5.01528057758804, "distance-from-start": 1.4108418329398995, "deviation-center-line": 0.5480591600958397, "driven_lanedir_consec": 0.035772152071414265}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
142391291Bea Baselines 🐤template-randomaido-LFI-sim-testingsim-1of4successnodavinci-stage-02-6.2.500:04:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median24.450000000000212
in-drivable-lane_median17.850000000000154
driven_lanedir_consec_median0.050146904256652025
deviation-center-line_median0.5014783130439592


other stats
deviation-center-line_max0.5014783130439592
deviation-center-line_mean0.5014783130439592
deviation-center-line_min0.5014783130439592
deviation-heading_max5.174156496722106
deviation-heading_mean5.174156496722106
deviation-heading_median5.174156496722106
deviation-heading_min5.174156496722106
distance-from-start_max0.796098057853711
distance-from-start_mean0.796098057853711
distance-from-start_median0.796098057853711
distance-from-start_min0.796098057853711
driven_any_max5.895396370035972
driven_any_mean5.895396370035972
driven_any_median5.895396370035972
driven_any_min5.895396370035972
driven_lanedir_consec_max0.050146904256652025
driven_lanedir_consec_mean0.050146904256652025
driven_lanedir_consec_min0.050146904256652025
driven_lanedir_max0.053494557657393305
driven_lanedir_mean0.053494557657393305
driven_lanedir_median0.053494557657393305
driven_lanedir_min0.053494557657393305
in-drivable-lane_max17.850000000000154
in-drivable-lane_mean17.850000000000154
in-drivable-lane_min17.850000000000154
per-episodes
details{"udem1-000-ego0": {"driven_any": 5.895396370035972, "survival_time": 24.450000000000212, "driven_lanedir": 0.053494557657393305, "in-drivable-lane": 17.850000000000154, "deviation-heading": 5.174156496722106, "distance-from-start": 0.796098057853711, "deviation-center-line": 0.5014783130439592, "driven_lanedir_consec": 0.050146904256652025}}
simulation-passed1
survival_time_max24.450000000000212
survival_time_mean24.450000000000212
survival_time_min24.450000000000212
No reset possible
142371291Bea Baselines 🐤template-randomaido-LFI-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
142361291Bea Baselines 🐤template-randomaido-LFI-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
142241294Bea Baselines 🐤template-randomaido-LFV_multi-sim-testingsim-1of4successnodavinci-stage-02-6.2.500:22:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.199999999998774
in-drivable-lane_median51.49999999999876
driven_lanedir_consec_median0.21853936665470375
deviation-center-line_median0.6558628477973304


other stats
deviation-center-line_max1.3919847015555789
deviation-center-line_mean0.81620218081524
deviation-center-line_min0.56109832611072
deviation-heading_max9.906601177812297
deviation-heading_mean5.728605671043064
deviation-heading_median4.536008719589965
deviation-heading_min3.9358040671800296
distance-from-start_max1.3543782763136274
distance-from-start_mean1.0494456679466913
distance-from-start_median1.023653168809703
distance-from-start_min0.7960980578537311
driven_any_max14.612175482594528
driven_any_mean10.218740534833987
driven_any_median10.08333461358712
driven_any_min6.09611742956719
driven_lanedir_consec_max0.24555746228952957
driven_lanedir_consec_mean0.20899163900592865
driven_lanedir_consec_min0.15333036042477757
driven_lanedir_max0.2358197494342854
driven_lanedir_mean0.19479761986375457
driven_lanedir_median0.2060280026190392
driven_lanedir_min0.1313147247826545
in-drivable-lane_max52.39999999999874
in-drivable-lane_mean50.149999999998734
in-drivable-lane_min45.19999999999868
per-episodes
details{"loop-000-ego0": {"driven_any": 14.612175482594528, "survival_time": 59.199999999998774, "driven_lanedir": 0.2358197494342854, "in-drivable-lane": 45.19999999999868, "deviation-heading": 9.906601177812297, "distance-from-start": 1.3543782763136274, "deviation-center-line": 1.3919847015555789, "driven_lanedir_consec": 0.24555746228952957}, "loop-000-ego1": {"driven_any": 11.349124250612942, "survival_time": 59.199999999998774, "driven_lanedir": 0.22565943649319545, "in-drivable-lane": 51.14999999999877, "deviation-heading": 4.17325696101659, "distance-from-start": 1.0442247976692065, "deviation-center-line": 0.6271479250601518, "driven_lanedir_consec": 0.2397934631518233}, "loop-000-ego2": {"driven_any": 6.09611742956719, "survival_time": 59.199999999998774, "driven_lanedir": 0.1313147247826545, "in-drivable-lane": 52.39999999999874, "deviation-heading": 3.9358040671800296, "distance-from-start": 0.7960980578537311, "deviation-center-line": 0.684577770534509, "driven_lanedir_consec": 0.15333036042477757}, "loop-000-ego3": {"driven_any": 8.817544976561296, "survival_time": 59.199999999998774, "driven_lanedir": 0.18639656874488297, "in-drivable-lane": 51.849999999998744, "deviation-heading": 4.898760478163339, "distance-from-start": 1.0030815399501998, "deviation-center-line": 0.56109832611072, "driven_lanedir_consec": 0.19728527015758424}}
simulation-passed1
survival_time_max59.199999999998774
survival_time_mean59.199999999998774
survival_time_min59.199999999998774
No reset possible
142221295Bea Baselines 🐤template-randomaido-LFP-sim-testingsim-0of4successnodavinci-stage-02-6.2.500:02:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.94999999999998
in-drivable-lane_median5.549999999999983
driven_lanedir_consec_median0.020891462039611675
deviation-center-line_median0.16974575483481455


other stats
deviation-center-line_max0.16974575483481455
deviation-center-line_mean0.16974575483481455
deviation-center-line_min0.16974575483481455
deviation-heading_max1.6654350665682798
deviation-heading_mean1.6654350665682798
deviation-heading_median1.6654350665682798
deviation-heading_min1.6654350665682798
distance-from-start_max0.5351951936475464
distance-from-start_mean0.5351951936475464
distance-from-start_median0.5351951936475464
distance-from-start_min0.5351951936475464
driven_any_max1.5709859611218706
driven_any_mean1.5709859611218706
driven_any_median1.5709859611218706
driven_any_min1.5709859611218706
driven_lanedir_consec_max0.020891462039611675
driven_lanedir_consec_mean0.020891462039611675
driven_lanedir_consec_min0.020891462039611675
driven_lanedir_max0.020891462039611675
driven_lanedir_mean0.020891462039611675
driven_lanedir_median0.020891462039611675
driven_lanedir_min0.020891462039611675
in-drivable-lane_max5.549999999999983
in-drivable-lane_mean5.549999999999983
in-drivable-lane_min5.549999999999983
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.5709859611218706, "survival_time": 7.94999999999998, "driven_lanedir": 0.020891462039611675, "in-drivable-lane": 5.549999999999983, "deviation-heading": 1.6654350665682798, "distance-from-start": 0.5351951936475464, "deviation-center-line": 0.16974575483481455, "driven_lanedir_consec": 0.020891462039611675}}
simulation-passed1
survival_time_max7.94999999999998
survival_time_mean7.94999999999998
survival_time_min7.94999999999998
No reset possible
142191267Bea Baselines 🐤template-randomaido-LFV-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:04:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median24.750000000000217
in-drivable-lane_median16.200000000000195
driven_lanedir_consec_median0.2676465159268615
deviation-center-line_median0.7555297758130887


other stats
deviation-center-line_max0.7555297758130887
deviation-center-line_mean0.7555297758130887
deviation-center-line_min0.7555297758130887
deviation-heading_max5.523299068383883
deviation-heading_mean5.523299068383883
deviation-heading_median5.523299068383883
deviation-heading_min5.523299068383883
distance-from-start_max0.796098057853727
distance-from-start_mean0.796098057853727
distance-from-start_median0.796098057853727
distance-from-start_min0.796098057853727
driven_any_max6.0666647982270385
driven_any_mean6.0666647982270385
driven_any_median6.0666647982270385
driven_any_min6.0666647982270385
driven_lanedir_consec_max0.2676465159268615
driven_lanedir_consec_mean0.2676465159268615
driven_lanedir_consec_min0.2676465159268615
driven_lanedir_max0.24963703198272744
driven_lanedir_mean0.24963703198272744
driven_lanedir_median0.24963703198272744
driven_lanedir_min0.24963703198272744
in-drivable-lane_max16.200000000000195
in-drivable-lane_mean16.200000000000195
in-drivable-lane_min16.200000000000195
per-episodes
details{"loop2-000-ego0": {"driven_any": 6.0666647982270385, "survival_time": 24.750000000000217, "driven_lanedir": 0.24963703198272744, "in-drivable-lane": 16.200000000000195, "deviation-heading": 5.523299068383883, "distance-from-start": 0.796098057853727, "deviation-center-line": 0.7555297758130887, "driven_lanedir_consec": 0.2676465159268615}}
simulation-passed1
survival_time_max24.750000000000217
survival_time_mean24.750000000000217
survival_time_min24.750000000000217
No reset possible
142161267Bea Baselines 🐤template-randomaido-LFV-sim-validationsim-0of4successnodavinci-stage-02-6.2.500:02:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.699999999999995
in-drivable-lane_median0.9
driven_lanedir_consec_median0.364506838392066
deviation-center-line_median0.14696541332404583


other stats
deviation-center-line_max0.14696541332404583
deviation-center-line_mean0.14696541332404583
deviation-center-line_min0.14696541332404583
deviation-heading_max1.6699264400950062
deviation-heading_mean1.6699264400950062
deviation-heading_median1.6699264400950062
deviation-heading_min1.6699264400950062
distance-from-start_max0.3743806210373658
distance-from-start_mean0.3743806210373658
distance-from-start_median0.3743806210373658
distance-from-start_min0.3743806210373658
driven_any_max0.3944302398862539
driven_any_mean0.3944302398862539
driven_any_median0.3944302398862539
driven_any_min0.3944302398862539
driven_lanedir_consec_max0.364506838392066
driven_lanedir_consec_mean0.364506838392066
driven_lanedir_consec_min0.364506838392066
driven_lanedir_max0.364506838392066
driven_lanedir_mean0.364506838392066
driven_lanedir_median0.364506838392066
driven_lanedir_min0.364506838392066
in-drivable-lane_max0.9
in-drivable-lane_mean0.9
in-drivable-lane_min0.9
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.3944302398862539, "survival_time": 3.699999999999995, "driven_lanedir": 0.364506838392066, "in-drivable-lane": 0.9, "deviation-heading": 1.6699264400950062, "distance-from-start": 0.3743806210373658, "deviation-center-line": 0.14696541332404583, "driven_lanedir_consec": 0.364506838392066}}
simulation-passed1
survival_time_max3.699999999999995
survival_time_mean3.699999999999995
survival_time_min3.699999999999995
No reset possible
142131268Bea Baselines 🐤template-randomaido-LFVI-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
142091269Bea Baselines 🐤template-randomaido-LFI-sim-validationsim-0of4successnodavinci-stage-02-6.2.500:02:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.7499999999999942
in-drivable-lane_median0.9
driven_lanedir_consec_median0.3901743521234762
deviation-center-line_median0.17124897035562428


other stats
deviation-center-line_max0.17124897035562428
deviation-center-line_mean0.17124897035562428
deviation-center-line_min0.17124897035562428
deviation-heading_max1.70314180472416
deviation-heading_mean1.70314180472416
deviation-heading_median1.70314180472416
deviation-heading_min1.70314180472416
distance-from-start_max0.4028556303039793
distance-from-start_mean0.4028556303039793
distance-from-start_median0.4028556303039793
distance-from-start_min0.4028556303039793
driven_any_max0.42407645028397256
driven_any_mean0.42407645028397256
driven_any_median0.42407645028397256
driven_any_min0.42407645028397256
driven_lanedir_consec_max0.3901743521234762
driven_lanedir_consec_mean0.3901743521234762
driven_lanedir_consec_min0.3901743521234762
driven_lanedir_max0.3901743521234762
driven_lanedir_mean0.3901743521234762
driven_lanedir_median0.3901743521234762
driven_lanedir_min0.3901743521234762
in-drivable-lane_max0.9
in-drivable-lane_mean0.9
in-drivable-lane_min0.9
per-episodes
details{"4way-000-ego0": {"driven_any": 0.42407645028397256, "survival_time": 3.7499999999999942, "driven_lanedir": 0.3901743521234762, "in-drivable-lane": 0.9, "deviation-heading": 1.70314180472416, "distance-from-start": 0.4028556303039793, "deviation-center-line": 0.17124897035562428, "driven_lanedir_consec": 0.3901743521234762}}
simulation-passed1
survival_time_max3.7499999999999942
survival_time_mean3.7499999999999942
survival_time_min3.7499999999999942
No reset possible
142071269Bea Baselines 🐤template-randomaido-LFI-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
142051270Bea Baselines 🐤template-randomaido-LF-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:02:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.27378584101885495
survival_time_median20.550000000000157
deviation-center-line_median0.7687309613328539
in-drivable-lane_median12.000000000000131


other stats
deviation-center-line_max0.7687309613328539
deviation-center-line_mean0.7687309613328539
deviation-center-line_min0.7687309613328539
deviation-heading_max5.7583430601860695
deviation-heading_mean5.7583430601860695
deviation-heading_median5.7583430601860695
deviation-heading_min5.7583430601860695
distance-from-start_max0.7357883576773772
distance-from-start_mean0.7357883576773772
distance-from-start_median0.7357883576773772
distance-from-start_min0.7357883576773772
driven_any_max4.915576034387011
driven_any_mean4.915576034387011
driven_any_median4.915576034387011
driven_any_min4.915576034387011
driven_lanedir_consec_max0.27378584101885495
driven_lanedir_consec_mean0.27378584101885495
driven_lanedir_consec_min0.27378584101885495
driven_lanedir_max0.2557751649818414
driven_lanedir_mean0.2557751649818414
driven_lanedir_median0.2557751649818414
driven_lanedir_min0.2557751649818414
in-drivable-lane_max12.000000000000131
in-drivable-lane_mean12.000000000000131
in-drivable-lane_min12.000000000000131
per-episodes
details{"loop2-000-ego0": {"driven_any": 4.915576034387011, "survival_time": 20.550000000000157, "driven_lanedir": 0.2557751649818414, "in-drivable-lane": 12.000000000000131, "deviation-heading": 5.7583430601860695, "distance-from-start": 0.7357883576773772, "deviation-center-line": 0.7687309613328539, "driven_lanedir_consec": 0.27378584101885495}}
simulation-passed1
survival_time_max20.550000000000157
survival_time_mean20.550000000000157
survival_time_min20.550000000000157
No reset possible
142041270Bea Baselines 🐤template-randomaido-LF-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:03:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2676465159268615
survival_time_median25.00000000000022
deviation-center-line_median0.7555297758130887
in-drivable-lane_median16.4500000000002


other stats
deviation-center-line_max0.7555297758130887
deviation-center-line_mean0.7555297758130887
deviation-center-line_min0.7555297758130887
deviation-heading_max5.523299068383883
deviation-heading_mean5.523299068383883
deviation-heading_median5.523299068383883
deviation-heading_min5.523299068383883
distance-from-start_max0.796098057853727
distance-from-start_mean0.796098057853727
distance-from-start_median0.796098057853727
distance-from-start_min0.796098057853727
driven_any_max6.187140538312911
driven_any_mean6.187140538312911
driven_any_median6.187140538312911
driven_any_min6.187140538312911
driven_lanedir_consec_max0.2676465159268615
driven_lanedir_consec_mean0.2676465159268615
driven_lanedir_consec_min0.2676465159268615
driven_lanedir_max0.24963703198272744
driven_lanedir_mean0.24963703198272744
driven_lanedir_median0.24963703198272744
driven_lanedir_min0.24963703198272744
in-drivable-lane_max16.4500000000002
in-drivable-lane_mean16.4500000000002
in-drivable-lane_min16.4500000000002
per-episodes
details{"zigzag-000-ego0": {"driven_any": 6.187140538312911, "survival_time": 25.00000000000022, "driven_lanedir": 0.24963703198272744, "in-drivable-lane": 16.4500000000002, "deviation-heading": 5.523299068383883, "distance-from-start": 0.796098057853727, "deviation-center-line": 0.7555297758130887, "driven_lanedir_consec": 0.2676465159268615}}
simulation-passed1
survival_time_max25.00000000000022
survival_time_mean25.00000000000022
survival_time_min25.00000000000022
No reset possible
142031271Bea Baselines 🐤template-randomaido-LFVI_multi-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
141971272Bea Baselines 🐤template-randomaido-LFV_multi-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:12:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median32.250000000000306
in-drivable-lane_median28.075000000000298
driven_lanedir_consec_median0.1610207737330219
deviation-center-line_median0.29879847452961933


other stats
deviation-center-line_max0.7438965564413397
deviation-center-line_mean0.3444866849816528
deviation-center-line_min0.03645323442603294
deviation-heading_max5.151628362375439
deviation-heading_mean3.250612996537796
deviation-heading_median3.3709673175115276
deviation-heading_min1.1088889887526905
distance-from-start_max0.9340577697896384
distance-from-start_mean0.6918300925811118
distance-from-start_median0.6561491304294165
distance-from-start_min0.5209643396759762
driven_any_max7.865751162007197
driven_any_mean4.149754186300885
driven_any_median4.093549808670279
driven_any_min0.5461659658557834
driven_lanedir_consec_max0.34342719852355597
driven_lanedir_consec_mean0.1843559383324774
driven_lanedir_consec_min0.07195500734030984
driven_lanedir_max0.34342719852355597
driven_lanedir_mean0.17519082439080594
driven_lanedir_median0.142690545849679
driven_lanedir_min0.07195500734030984
in-drivable-lane_max30.600000000000307
in-drivable-lane_mean27.887500000000298
in-drivable-lane_min24.80000000000028
per-episodes
details{"zigzag-000-ego0": {"driven_any": 2.557376740490916, "survival_time": 32.250000000000306, "driven_lanedir": 0.34342719852355597, "in-drivable-lane": 27.45000000000031, "deviation-heading": 4.085690366921237, "distance-from-start": 0.576509903181454, "deviation-center-line": 0.3481403947764579, "driven_lanedir_consec": 0.34342719852355597}, "zigzag-000-ego1": {"driven_any": 5.629722876849642, "survival_time": 32.250000000000306, "driven_lanedir": 0.19038935166124735, "in-drivable-lane": 24.80000000000028, "deviation-heading": 5.151628362375439, "distance-from-start": 0.7357883576773788, "deviation-center-line": 0.7438965564413397, "driven_lanedir_consec": 0.21133294232177}, "zigzag-000-ego2": {"driven_any": 7.865751162007197, "survival_time": 32.250000000000306, "driven_lanedir": 0.09499174003811064, "in-drivable-lane": 28.70000000000028, "deviation-heading": 2.6562442681018186, "distance-from-start": 0.9340577697896384, "deviation-center-line": 0.24945655428278077, "driven_lanedir_consec": 0.11070860514427378}, "zigzag-000-ego3": {"driven_any": 0.5461659658557834, "survival_time": 32.250000000000306, "driven_lanedir": 0.07195500734030984, "in-drivable-lane": 30.600000000000307, "deviation-heading": 1.1088889887526905, "distance-from-start": 0.5209643396759762, "deviation-center-line": 0.03645323442603294, "driven_lanedir_consec": 0.07195500734030984}}
simulation-passed1
survival_time_max32.250000000000306
survival_time_mean32.250000000000306
survival_time_min32.250000000000306
No reset possible
141931273Bea Baselines 🐤template-randomaido-LFP-sim-validationsim-0of4successnodavinci-stage-02-6.2.500:03:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median23.200000000000195
in-drivable-lane_median14.65000000000017
driven_lanedir_consec_median0.2737852330803683
deviation-center-line_median0.7687318160431588


other stats
deviation-center-line_max0.7687318160431588
deviation-center-line_mean0.7687318160431588
deviation-center-line_min0.7687318160431588
deviation-heading_max5.758343085491201
deviation-heading_mean5.758343085491201
deviation-heading_median5.758343085491201
deviation-heading_min5.758343085491201
distance-from-start_max0.7357883576773739
distance-from-start_mean0.7357883576773739
distance-from-start_median0.7357883576773739
distance-from-start_min0.7357883576773739
driven_any_max5.318401064622404
driven_any_mean5.318401064622404
driven_any_median5.318401064622404
driven_any_min5.318401064622404
driven_lanedir_consec_max0.2737852330803683
driven_lanedir_consec_mean0.2737852330803683
driven_lanedir_consec_min0.2737852330803683
driven_lanedir_max0.2557745570433345
driven_lanedir_mean0.2557745570433345
driven_lanedir_median0.2557745570433345
driven_lanedir_min0.2557745570433345
in-drivable-lane_max14.65000000000017
in-drivable-lane_mean14.65000000000017
in-drivable-lane_min14.65000000000017
per-episodes
details{"autolab-000-ego0": {"driven_any": 5.318401064622404, "survival_time": 23.200000000000195, "driven_lanedir": 0.2557745570433345, "in-drivable-lane": 14.65000000000017, "deviation-heading": 5.758343085491201, "distance-from-start": 0.7357883576773739, "deviation-center-line": 0.7687318160431588, "driven_lanedir_consec": 0.2737852330803683}}
simulation-passed1
survival_time_max23.200000000000195
survival_time_mean23.200000000000195
survival_time_min23.200000000000195
No reset possible
141831120Bea Baselines 🐤template-randomaido-LF-sim-testingsim-1of4abortednodavinci-stage-02-6.2.500:00:46
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1302, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 749, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
141771122Bea Baselines 🐤template-randomaido-LFV_multi-sim-testingsim-3of4abortednodavinci-stage-02-6.2.500:15:38
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1302, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 749, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
141731123Bea Baselines 🐤template-randomaido-LFP-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:02:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.300000000000026
in-drivable-lane_median7.850000000000014
driven_lanedir_consec_median0.02948472541340319
deviation-center-line_median0.3268416970813497


other stats
deviation-center-line_max0.3268416970813497
deviation-center-line_mean0.3268416970813497
deviation-center-line_min0.3268416970813497
deviation-heading_max2.548872596322993
deviation-heading_mean2.548872596322993
deviation-heading_median2.548872596322993
deviation-heading_min2.548872596322993
distance-from-start_max0.5461575079396523
distance-from-start_mean0.5461575079396523
distance-from-start_median0.5461575079396523
distance-from-start_min0.5461575079396523
driven_any_max2.2681416551684617
driven_any_mean2.2681416551684617
driven_any_median2.2681416551684617
driven_any_min2.2681416551684617
driven_lanedir_consec_max0.02948472541340319
driven_lanedir_consec_mean0.02948472541340319
driven_lanedir_consec_min0.02948472541340319
driven_lanedir_max0.032831067512037126
driven_lanedir_mean0.032831067512037126
driven_lanedir_median0.032831067512037126
driven_lanedir_min0.032831067512037126
in-drivable-lane_max7.850000000000014
in-drivable-lane_mean7.850000000000014
in-drivable-lane_min7.850000000000014
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.2681416551684617, "survival_time": 11.300000000000026, "driven_lanedir": 0.032831067512037126, "in-drivable-lane": 7.850000000000014, "deviation-heading": 2.548872596322993, "distance-from-start": 0.5461575079396523, "deviation-center-line": 0.3268416970813497, "driven_lanedir_consec": 0.02948472541340319}}
simulation-passed1
survival_time_max11.300000000000026
survival_time_mean11.300000000000026
survival_time_min11.300000000000026
No reset possible
141631125Bea Baselines 🐤template-rosaido-LFV-sim-validationsim-0of4successnodavinci-stage-02-6.2.500:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.7000000000000008
in-drivable-lane_median0.7000000000000006
driven_lanedir_consec_median0.15512837286720105
deviation-center-line_median0.06344599120965778


other stats
deviation-center-line_max0.06344599120965778
deviation-center-line_mean0.06344599120965778
deviation-center-line_min0.06344599120965778
deviation-heading_max0.6361645404986668
deviation-heading_mean0.6361645404986668
deviation-heading_median0.6361645404986668
deviation-heading_min0.6361645404986668
distance-from-start_max0.19799159960939833
distance-from-start_mean0.19799159960939833
distance-from-start_median0.19799159960939833
distance-from-start_min0.19799159960939833
driven_any_max0.19808351795437903
driven_any_mean0.19808351795437903
driven_any_median0.19808351795437903
driven_any_min0.19808351795437903
driven_lanedir_consec_max0.15512837286720105
driven_lanedir_consec_mean0.15512837286720105
driven_lanedir_consec_min0.15512837286720105
driven_lanedir_max0.15512837286720105
driven_lanedir_mean0.15512837286720105
driven_lanedir_median0.15512837286720105
driven_lanedir_min0.15512837286720105
in-drivable-lane_max0.7000000000000006
in-drivable-lane_mean0.7000000000000006
in-drivable-lane_min0.7000000000000006
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.19808351795437903, "survival_time": 1.7000000000000008, "driven_lanedir": 0.15512837286720105, "in-drivable-lane": 0.7000000000000006, "deviation-heading": 0.6361645404986668, "distance-from-start": 0.19799159960939833, "deviation-center-line": 0.06344599120965778, "driven_lanedir_consec": 0.15512837286720105}}
simulation-passed1
survival_time_max1.7000000000000008
survival_time_mean1.7000000000000008
survival_time_min1.7000000000000008
No reset possible
141591126Bea Baselines 🐤template-rosaido-LFVI-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
141531128Bea Baselines 🐤template-rosaido-LFVI_multi-sim-validationsim-1of4successnodavinci-stage-02-6.2.500:02:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.349999999999989
in-drivable-lane_median3.899999999999989
driven_lanedir_consec_median0.35537825521006716
deviation-center-line_median0.13593597898628745


other stats
deviation-center-line_max0.23056137789774547
deviation-center-line_mean0.13921812853770602
deviation-center-line_min0.05443917828050371
deviation-heading_max0.7706405674848762
deviation-heading_mean0.573876423595647
deviation-heading_median0.549489392973119
deviation-heading_min0.42588634095147326
distance-from-start_max1.1931528798293785
distance-from-start_mean0.7383506529955897
distance-from-start_median0.6766658241151102
distance-from-start_min0.4069180839227597
driven_any_max1.3124841474207332
driven_any_mean0.7730276871312372
driven_any_median0.6859434156845603
driven_any_min0.407739769735095
driven_lanedir_consec_max1.014457883078829
driven_lanedir_consec_mean0.47579533205392865
driven_lanedir_consec_min0.17796693471675162
driven_lanedir_max1.014457883078829
driven_lanedir_mean0.47579533205392865
driven_lanedir_median0.35537825521006716
driven_lanedir_min0.17796693471675162
in-drivable-lane_max4.399999999999989
in-drivable-lane_mean3.4624999999999897
in-drivable-lane_min1.649999999999994
per-episodes
details{"4way-000-ego0": {"driven_any": 0.407739769735095, "survival_time": 5.349999999999989, "driven_lanedir": 0.17796693471675162, "in-drivable-lane": 4.399999999999989, "deviation-heading": 0.5608631450786737, "distance-from-start": 0.4069180839227597, "deviation-center-line": 0.05443917828050371, "driven_lanedir_consec": 0.17796693471675162}, "4way-000-ego1": {"driven_any": 0.5835411154907945, "survival_time": 5.349999999999989, "driven_lanedir": 0.2591002349644178, "in-drivable-lane": 4.2499999999999885, "deviation-heading": 0.42588634095147326, "distance-from-start": 0.5810995675383677, "deviation-center-line": 0.11054316820812073, "driven_lanedir_consec": 0.2591002349644178}, "4way-000-ego2": {"driven_any": 0.7883457158783261, "survival_time": 5.349999999999989, "driven_lanedir": 0.4516562754557165, "in-drivable-lane": 3.5499999999999883, "deviation-heading": 0.5381156408675645, "distance-from-start": 0.7722320806918528, "deviation-center-line": 0.16132878976445414, "driven_lanedir_consec": 0.4516562754557165}, "4way-000-ego3": {"driven_any": 1.3124841474207332, "survival_time": 5.349999999999989, "driven_lanedir": 1.014457883078829, "in-drivable-lane": 1.649999999999994, "deviation-heading": 0.7706405674848762, "distance-from-start": 1.1931528798293785, "deviation-center-line": 0.23056137789774547, "driven_lanedir_consec": 1.014457883078829}}
simulation-passed1
survival_time_max5.349999999999989
survival_time_mean5.349999999999989
survival_time_min5.349999999999989
No reset possible
141471129Bea Baselines 🐤template-rosaido-LFV_multi-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:03:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.099999999999986
in-drivable-lane_median4.849999999999985
driven_lanedir_consec_median0.243674876842026
deviation-center-line_median0.08347195728884224


other stats
deviation-center-line_max0.13539637937971008
deviation-center-line_mean0.08863530277722473
deviation-center-line_min0.052200917151504336
deviation-heading_max0.6383984284258963
deviation-heading_mean0.5049637928448691
deviation-heading_median0.4958192689503645
deviation-heading_min0.3898182050528515
distance-from-start_max1.4266628574018048
distance-from-start_mean1.0527140415398095
distance-from-start_median1.0971655257185349
distance-from-start_min0.589862257320364
driven_any_max1.573891102121625
driven_any_mean1.1002400704542017
driven_any_median1.1153190744573702
driven_any_min0.5964310307804412
driven_lanedir_consec_max0.4329284100397006
driven_lanedir_consec_mean0.2680872634370926
driven_lanedir_consec_min0.15207089002461782
driven_lanedir_max0.4329284100397006
driven_lanedir_mean0.2680872634370926
driven_lanedir_median0.243674876842026
driven_lanedir_min0.15207089002461782
in-drivable-lane_max5.149999999999986
in-drivable-lane_mean4.7999999999999865
in-drivable-lane_min4.349999999999985
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.5964310307804412, "survival_time": 6.099999999999986, "driven_lanedir": 0.19094846108987973, "in-drivable-lane": 4.949999999999986, "deviation-heading": 0.6383984284258963, "distance-from-start": 0.589862257320364, "deviation-center-line": 0.0727000927051068, "driven_lanedir_consec": 0.19094846108987973}, "zigzag-000-ego1": {"driven_any": 1.3487294545835544, "survival_time": 6.099999999999986, "driven_lanedir": 0.4329284100397006, "in-drivable-lane": 4.349999999999985, "deviation-heading": 0.5275837449465736, "distance-from-start": 1.3394008749560449, "deviation-center-line": 0.13539637937971008, "driven_lanedir_consec": 0.4329284100397006}, "zigzag-000-ego2": {"driven_any": 1.573891102121625, "survival_time": 6.099999999999986, "driven_lanedir": 0.29640129259417225, "in-drivable-lane": 4.749999999999986, "deviation-heading": 0.3898182050528515, "distance-from-start": 1.4266628574018048, "deviation-center-line": 0.09424382187257768, "driven_lanedir_consec": 0.29640129259417225}, "zigzag-000-ego3": {"driven_any": 0.8819086943311861, "survival_time": 6.099999999999986, "driven_lanedir": 0.15207089002461782, "in-drivable-lane": 5.149999999999986, "deviation-heading": 0.4640547929541554, "distance-from-start": 0.8549301764810248, "deviation-center-line": 0.052200917151504336, "driven_lanedir_consec": 0.15207089002461782}}
simulation-passed1
survival_time_max6.099999999999986
survival_time_mean6.099999999999986
survival_time_min6.099999999999986
No reset possible
141441130Bea Baselines 🐤template-rosaido-LFP-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:01:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.649999999999995
in-drivable-lane_median2.7499999999999947
driven_lanedir_consec_median0.13691950490089905
deviation-center-line_median0.053023179482688115


other stats
deviation-center-line_max0.053023179482688115
deviation-center-line_mean0.053023179482688115
deviation-center-line_min0.053023179482688115
deviation-heading_max0.596846601509594
deviation-heading_mean0.596846601509594
deviation-heading_median0.596846601509594
deviation-heading_min0.596846601509594
distance-from-start_max0.7666851979347814
distance-from-start_mean0.7666851979347814
distance-from-start_median0.7666851979347814
distance-from-start_min0.7666851979347814
driven_any_max0.7706963722520448
driven_any_mean0.7706963722520448
driven_any_median0.7706963722520448
driven_any_min0.7706963722520448
driven_lanedir_consec_max0.13691950490089905
driven_lanedir_consec_mean0.13691950490089905
driven_lanedir_consec_min0.13691950490089905
driven_lanedir_max0.13691950490089905
driven_lanedir_mean0.13691950490089905
driven_lanedir_median0.13691950490089905
driven_lanedir_min0.13691950490089905
in-drivable-lane_max2.7499999999999947
in-drivable-lane_mean2.7499999999999947
in-drivable-lane_min2.7499999999999947
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.7706963722520448, "survival_time": 3.649999999999995, "driven_lanedir": 0.13691950490089905, "in-drivable-lane": 2.7499999999999947, "deviation-heading": 0.596846601509594, "distance-from-start": 0.7666851979347814, "deviation-center-line": 0.053023179482688115, "driven_lanedir_consec": 0.13691950490089905}}
simulation-passed1
survival_time_max3.649999999999995
survival_time_mean3.649999999999995
survival_time_min3.649999999999995
No reset possible
141411130Bea Baselines 🐤template-rosaido-LFP-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.94999999999999
in-drivable-lane_median3.59999999999999
driven_lanedir_consec_median0.3115475323011325
deviation-center-line_median0.11570387172232569


other stats
deviation-center-line_max0.11570387172232569
deviation-center-line_mean0.11570387172232569
deviation-center-line_min0.11570387172232569
deviation-heading_max0.5469649933930473
deviation-heading_mean0.5469649933930473
deviation-heading_median0.5469649933930473
deviation-heading_min0.5469649933930473
distance-from-start_max1.2476706894803573
distance-from-start_mean1.2476706894803573
distance-from-start_median1.2476706894803573
distance-from-start_min1.2476706894803573
driven_any_max1.2641932148663575
driven_any_mean1.2641932148663575
driven_any_median1.2641932148663575
driven_any_min1.2641932148663575
driven_lanedir_consec_max0.3115475323011325
driven_lanedir_consec_mean0.3115475323011325
driven_lanedir_consec_min0.3115475323011325
driven_lanedir_max0.3115475323011325
driven_lanedir_mean0.3115475323011325
driven_lanedir_median0.3115475323011325
driven_lanedir_min0.3115475323011325
in-drivable-lane_max3.59999999999999
in-drivable-lane_mean3.59999999999999
in-drivable-lane_min3.59999999999999
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.2641932148663575, "survival_time": 4.94999999999999, "driven_lanedir": 0.3115475323011325, "in-drivable-lane": 3.59999999999999, "deviation-heading": 0.5469649933930473, "distance-from-start": 1.2476706894803573, "deviation-center-line": 0.11570387172232569, "driven_lanedir_consec": 0.3115475323011325}}
simulation-passed1
survival_time_max4.94999999999999
survival_time_mean4.94999999999999
survival_time_min4.94999999999999
No reset possible
141351142Bea Baselines 🐤template-rosaido-LFV-sim-testingsim-0of4successnodavinci-stage-02-6.2.500:03:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.249999999999982
in-drivable-lane_median6.399999999999982
driven_lanedir_consec_median0.10768879800435592
deviation-center-line_median0.0509881707784428


other stats
deviation-center-line_max0.0509881707784428
deviation-center-line_mean0.0509881707784428
deviation-center-line_min0.0509881707784428
deviation-heading_max0.6421645836465255
deviation-heading_mean0.6421645836465255
deviation-heading_median0.6421645836465255
deviation-heading_min0.6421645836465255
distance-from-start_max1.7672340255833934
distance-from-start_mean1.7672340255833934
distance-from-start_median1.7672340255833934
distance-from-start_min1.7672340255833934
driven_any_max1.8759126847650676
driven_any_mean1.8759126847650676
driven_any_median1.8759126847650676
driven_any_min1.8759126847650676
driven_lanedir_consec_max0.10768879800435592
driven_lanedir_consec_mean0.10768879800435592
driven_lanedir_consec_min0.10768879800435592
driven_lanedir_max0.10768879800435592
driven_lanedir_mean0.10768879800435592
driven_lanedir_median0.10768879800435592
driven_lanedir_min0.10768879800435592
in-drivable-lane_max6.399999999999982
in-drivable-lane_mean6.399999999999982
in-drivable-lane_min6.399999999999982
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.8759126847650676, "survival_time": 7.249999999999982, "driven_lanedir": 0.10768879800435592, "in-drivable-lane": 6.399999999999982, "deviation-heading": 0.6421645836465255, "distance-from-start": 1.7672340255833934, "deviation-center-line": 0.0509881707784428, "driven_lanedir_consec": 0.10768879800435592}}
simulation-passed1
survival_time_max7.249999999999982
survival_time_mean7.249999999999982
survival_time_min7.249999999999982
No reset possible
141281143Bea Baselines 🐤template-rosaido-LFVI-sim-testingsim-1of4successnodavinci-stage-02-6.2.500:02:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.799999999999987
in-drivable-lane_median3.649999999999987
driven_lanedir_consec_median0.5307683429161894
deviation-center-line_median0.24158442025839905


other stats
deviation-center-line_max0.24158442025839905
deviation-center-line_mean0.24158442025839905
deviation-center-line_min0.24158442025839905
deviation-heading_max0.6371668217559243
deviation-heading_mean0.6371668217559243
deviation-heading_median0.6371668217559243
deviation-heading_min0.6371668217559243
distance-from-start_max1.3939303754563623
distance-from-start_mean1.3939303754563623
distance-from-start_median1.3939303754563623
distance-from-start_min1.3939303754563623
driven_any_max1.4132609016654327
driven_any_mean1.4132609016654327
driven_any_median1.4132609016654327
driven_any_min1.4132609016654327
driven_lanedir_consec_max0.5307683429161894
driven_lanedir_consec_mean0.5307683429161894
driven_lanedir_consec_min0.5307683429161894
driven_lanedir_max0.5307683429161894
driven_lanedir_mean0.5307683429161894
driven_lanedir_median0.5307683429161894
driven_lanedir_min0.5307683429161894
in-drivable-lane_max3.649999999999987
in-drivable-lane_mean3.649999999999987
in-drivable-lane_min3.649999999999987
per-episodes
details{"4way-000-ego0": {"driven_any": 1.4132609016654327, "survival_time": 5.799999999999987, "driven_lanedir": 0.5307683429161894, "in-drivable-lane": 3.649999999999987, "deviation-heading": 0.6371668217559243, "distance-from-start": 1.3939303754563623, "deviation-center-line": 0.24158442025839905, "driven_lanedir_consec": 0.5307683429161894}}
simulation-passed1
survival_time_max5.799999999999987
survival_time_mean5.799999999999987
survival_time_min5.799999999999987
No reset possible
141221144Bea Baselines 🐤template-rosaido-LFI-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
141201146Bea Baselines 🐤template-rosaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
141131147Bea Baselines 🐤template-rosaido-LFV_multi-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:04:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.45
in-drivable-lane_median8.499999999999998
driven_lanedir_consec_median0.14839108249247368
deviation-center-line_median0.0535581492053044


other stats
deviation-center-line_max0.13110014979840204
deviation-center-line_mean0.0710937813952812
deviation-center-line_min0.04615867737211395
deviation-heading_max0.626912565772329
deviation-heading_mean0.4860114083169177
deviation-heading_median0.47484826506087213
deviation-heading_min0.3674365373735973
distance-from-start_max2.409178293488732
distance-from-start_mean1.83091699435307
distance-from-start_median1.8772775781997169
distance-from-start_min1.1599345275241126
driven_any_max2.513828461642496
driven_any_mean1.896330763296
driven_any_median1.9447499282037328
driven_any_min1.1819947351340383
driven_lanedir_consec_max0.24689767037163168
driven_lanedir_consec_mean0.15379569684014638
driven_lanedir_consec_min0.07150295200400647
driven_lanedir_max0.24689767037163168
driven_lanedir_mean0.15379569684014638
driven_lanedir_median0.14839108249247368
driven_lanedir_min0.07150295200400647
in-drivable-lane_max8.75
in-drivable-lane_mean8.5
in-drivable-lane_min8.25
per-episodes
details{"zigzag-000-ego0": {"driven_any": 2.4929780089083877, "survival_time": 9.45, "driven_lanedir": 0.09712280721803657, "in-drivable-lane": 8.649999999999999, "deviation-heading": 0.626912565772329, "distance-from-start": 2.3829465823896396, "deviation-center-line": 0.04615867737211395, "driven_lanedir_consec": 0.09712280721803657}, "zigzag-000-ego1": {"driven_any": 2.513828461642496, "survival_time": 9.45, "driven_lanedir": 0.24689767037163168, "in-drivable-lane": 8.25, "deviation-heading": 0.3674365373735973, "distance-from-start": 2.409178293488732, "deviation-center-line": 0.13110014979840204, "driven_lanedir_consec": 0.24689767037163168}, "zigzag-000-ego2": {"driven_any": 1.3965218474990777, "survival_time": 9.45, "driven_lanedir": 0.1996593577669108, "in-drivable-lane": 8.349999999999998, "deviation-heading": 0.4001123271439549, "distance-from-start": 1.3716085740097943, "deviation-center-line": 0.04663427624764675, "driven_lanedir_consec": 0.1996593577669108}, "zigzag-000-ego3": {"driven_any": 1.1819947351340383, "survival_time": 9.45, "driven_lanedir": 0.07150295200400647, "in-drivable-lane": 8.75, "deviation-heading": 0.5495842029777894, "distance-from-start": 1.1599345275241126, "deviation-center-line": 0.06048202216296203, "driven_lanedir_consec": 0.07150295200400647}}
simulation-passed1
survival_time_max9.45
survival_time_mean9.45
survival_time_min9.45
No reset possible
141021150Bea Baselines 🐤template-tensorflowaido-LFVI-sim-validationsim-1of4failednodavinci-stage-02-6.2.500:02:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140981151Bea Baselines 🐤template-tensorflowaido-LFI-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
140921152Bea Baselines 🐤template-tensorflowaido-LF-sim-validationsim-0of4failednodavinci-stage-02-6.2.500:00:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140871153Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-validationsim-0of4failednodavinci-stage-02-6.2.500:01:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140801154Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-validationsim-0of4failednodavinci-stage-02-6.2.500:01:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140681168Bea Baselines 🐤template-tensorflowaido-LFVI-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
140621169Bea Baselines 🐤template-tensorflowaido-LFI-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
140541171Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-testingsim-1of4failednodavinci-stage-02-6.2.500:01:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140491172Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-testingsim-1of4failednodavinci-stage-02-6.2.500:01:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140471173Bea Baselines 🐤template-tensorflowaido-LFP-sim-testingsim-1of4failednodavinci-stage-02-6.2.500:01:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140371176Bea Baselines 🐤baseline-RPL-roslx22-objdetsimfailedyesdavinci-stage-02-6.2.500:00:57
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140351178Bea Baselines 🐤baseline-RPL-roslx22-state-estimationsimfailedyesdavinci-stage-02-6.2.500:01:56
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140301183Bea Baselines 🐤baseline-duckietownlx22-modconsimsuccessyesdavinci-stage-02-6.2.500:12:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median59.99999999999873
deviation-center-line_median0.0
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.220446049250313e-16
distance-from-start_mean1.1102230246251563e-16
distance-from-start_median1.1102230246251563e-16
distance-from-start_min0.0
driven_any_max2.6645352591003757e-13
driven_any_mean1.3322676295501878e-13
driven_any_median1.3322676295501878e-13
driven_any_min0.0
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 0.0, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}, "LF-full-loop-001-ego0": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
140221191Bea Baselines 🐤template-pytorchlx22-modconsimsuccessyesdavinci-stage-02-6.2.500:13:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median40.674999999999145
deviation-center-line_median2.020962380300519
driven_lanedir_consec_median1.1326368729246865
survival_time_median59.99999999999873


other stats
deviation-center-line_max2.4687997168417786
deviation-center-line_mean2.020962380300519
deviation-center-line_min1.57312504375926
deviation-heading_max22.708874831220168
deviation-heading_mean16.751977903427097
deviation-heading_median16.751977903427097
deviation-heading_min10.795080975634024
distance-from-start_max0.2228376139628256
distance-from-start_mean0.20440316205643927
distance-from-start_median0.20440316205643927
distance-from-start_min0.18596871015005292
driven_any_max6.963375035279697
driven_any_mean6.733794272630859
driven_any_median6.733794272630859
driven_any_min6.504213509982021
driven_lanedir_consec_max1.9086999882309224
driven_lanedir_consec_mean1.1326368729246865
driven_lanedir_consec_min0.35657375761845045
driven_lanedir_max1.9086999882309224
driven_lanedir_mean1.254539265576312
driven_lanedir_median1.254539265576312
driven_lanedir_min0.6003785429217019
in-drivable-lane_max49.39999999999893
in-drivable-lane_mean40.674999999999145
in-drivable-lane_min31.949999999999363
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 6.963375035279697, "survival_time": 59.99999999999873, "driven_lanedir": 0.6003785429217019, "in-drivable-lane": 49.39999999999893, "deviation-heading": 10.795080975634024, "distance-from-start": 0.2228376139628256, "deviation-center-line": 1.57312504375926, "driven_lanedir_consec": 0.35657375761845045}, "LF-full-loop-001-ego0": {"driven_any": 6.504213509982021, "survival_time": 59.99999999999873, "driven_lanedir": 1.9086999882309224, "in-drivable-lane": 31.949999999999363, "deviation-heading": 22.708874831220168, "distance-from-start": 0.18596871015005292, "deviation-center-line": 2.4687997168417786, "driven_lanedir_consec": 1.9086999882309224}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
140201193Bea Baselines 🐤template-pytorchlx22-visservoingsimsuccessyesdavinci-stage-02-6.2.500:05:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median21.97499999999951
deviation-center-line_median1.4202197273382169
driven_lanedir_consec_median0.8531559167720175
survival_time_median36.52499999999939


other stats
deviation-center-line_max2.3790069910552245
deviation-center-line_mean1.4202197273382169
deviation-center-line_min0.4614324636212091
deviation-heading_max19.34240669992787
deviation-heading_mean11.694375041362193
deviation-heading_median11.694375041362193
deviation-heading_min4.0463433827965085
distance-from-start_max0.27575952412008625
distance-from-start_mean0.2427323410759208
distance-from-start_median0.2427323410759208
distance-from-start_min0.20970515803175532
driven_any_max6.469778397528598
driven_any_mean3.866069746687762
driven_any_median3.866069746687762
driven_any_min1.2623610958469258
driven_lanedir_consec_max1.2462532198335312
driven_lanedir_consec_mean0.8531559167720175
driven_lanedir_consec_min0.4600586137105037
driven_lanedir_max1.4716095403282188
driven_lanedir_mean0.9658340770193612
driven_lanedir_median0.9658340770193612
driven_lanedir_min0.4600586137105037
in-drivable-lane_max36.949999999998994
in-drivable-lane_mean21.97499999999951
in-drivable-lane_min7.000000000000032
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 6.469778397528598, "survival_time": 59.99999999999873, "driven_lanedir": 1.4716095403282188, "in-drivable-lane": 36.949999999998994, "deviation-heading": 19.34240669992787, "distance-from-start": 0.27575952412008625, "deviation-center-line": 2.3790069910552245, "driven_lanedir_consec": 1.2462532198335312}, "LF-small-loop-001-ego0": {"driven_any": 1.2623610958469258, "survival_time": 13.05000000000005, "driven_lanedir": 0.4600586137105037, "in-drivable-lane": 7.000000000000032, "deviation-heading": 4.0463433827965085, "distance-from-start": 0.20970515803175532, "deviation-center-line": 0.4614324636212091, "driven_lanedir_consec": 0.4600586137105037}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean36.52499999999939
survival_time_min13.05000000000005
No reset possible
14015783Andrea Danieletemplate-randomaido-LF-sim-validationsim-0of4successnodavinci-stage-02-6.2.500:04:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2718401947993705
survival_time_median27.70000000000026
deviation-center-line_median0.7655517188189105
in-drivable-lane_median19.150000000000237


other stats
deviation-center-line_max0.7655517188189105
deviation-center-line_mean0.7655517188189105
deviation-center-line_min0.7655517188189105
deviation-heading_max5.708723015945327
deviation-heading_mean5.708723015945327
deviation-heading_median5.708723015945327
deviation-heading_min5.708723015945327
distance-from-start_max0.7960980578537302
distance-from-start_mean0.7960980578537302
distance-from-start_median0.7960980578537302
distance-from-start_min0.7960980578537302
driven_any_max6.635455547557208
driven_any_mean6.635455547557208
driven_any_median6.635455547557208
driven_any_min6.635455547557208
driven_lanedir_consec_max0.2718401947993705
driven_lanedir_consec_mean0.2718401947993705
driven_lanedir_consec_min0.2718401947993705
driven_lanedir_max0.25382904192484634
driven_lanedir_mean0.25382904192484634
driven_lanedir_median0.25382904192484634
driven_lanedir_min0.25382904192484634
in-drivable-lane_max19.150000000000237
in-drivable-lane_mean19.150000000000237
in-drivable-lane_min19.150000000000237
per-episodes
details{"autolab-000-ego0": {"driven_any": 6.635455547557208, "survival_time": 27.70000000000026, "driven_lanedir": 0.25382904192484634, "in-drivable-lane": 19.150000000000237, "deviation-heading": 5.708723015945327, "distance-from-start": 0.7960980578537302, "deviation-center-line": 0.7655517188189105, "driven_lanedir_consec": 0.2718401947993705}}
simulation-passed1
survival_time_max27.70000000000026
survival_time_mean27.70000000000026
survival_time_min27.70000000000026
No reset possible
14010783Andrea Danieletemplate-randomaido-LF-sim-validationsim-0of4timeoutnodavinci-stage-02-6.2.50----No reset possible
13983526Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-testingsim-3of4host-errornodavinci-stage-02-6.2.501:06:42
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 60, in check_docker_environment
    client = docker.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1107, in run_single
    cr = run_one(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1197, in run_one
    client = check_docker_environment()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 69, in check_docker_environment
    raise InvalidEnvironment(msg)
duckietown_challenges.exceptions.InvalidEnvironment: I cannot communicate with Docker:
Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Make sure the docker service is running.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13982672Bea Baselines 🐤template-tensorflowaido-LF-sim-testingsim-1of4host-errornodavinci-stage-02-6.2.500:01:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1097, in run_single
    client = DockerClient.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13981715Bea Baselines 🐤template-randomaido-LF-sim-testingsim-3of4host-errornodavinci-stage-02-6.2.500:01:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1097, in run_single
    client = DockerClient.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13980715Bea Baselines 🐤template-randomaido-LF-sim-testingsim-1of4host-errornodavinci-stage-02-6.2.500:01:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1097, in run_single
    client = DockerClient.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13979789Andrea Danieletemplate-pytorchaido-LF-sim-validationsim-2of4host-errornodavinci-stage-02-6.2.500:01:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1097, in run_single
    client = DockerClient.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13970789Andrea Danieletemplate-pytorchaido-LF-sim-validationsim-0of4host-errornodavinci-stage-02-6.2.501:10:11
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-stage-02-6.2.50-job13970-41113, down, -v]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-stage-02-6.2.50-job13970-41113', 'down', '-v']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13961783Andrea Danieletemplate-randomaido-LF-sim-validationsim-2of4host-errornodavinci-stage-02-6.2.501:11:19
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 60, in check_docker_environment
    client = docker.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1107, in run_single
    cr = run_one(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1197, in run_one
    client = check_docker_environment()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 69, in check_docker_environment
    raise InvalidEnvironment(msg)
duckietown_challenges.exceptions.InvalidEnvironment: I cannot communicate with Docker:
Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Make sure the docker service is running.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13959785Andrea Danieletemplate-rosaido-LF-sim-validationsim-0of4host-errornodavinci-stage-02-6.2.500:01:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1097, in run_single
    client = DockerClient.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13949698Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-0of4host-errornodavinci-stage-02-6.2.502:37:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 60, in check_docker_environment
    client = docker.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1107, in run_single
    cr = run_one(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1197, in run_one
    client = check_docker_environment()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 69, in check_docker_environment
    raise InvalidEnvironment(msg)
duckietown_challenges.exceptions.InvalidEnvironment: I cannot communicate with Docker:
Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Make sure the docker service is running.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13937699Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-0of4host-errornodavinci-stage-02-6.2.500:04:46
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1312, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 423, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1156, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13933700Bea Baselines 🐤minimal-agentaido-LFI-sim-testingsim-0of4successnodavinci-stage-02-6.2.500:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.149999999999993
in-drivable-lane_median2.749999999999993
driven_lanedir_consec_median0.13666480491623578
deviation-center-line_median0.10783802485851966


other stats
deviation-center-line_max0.10783802485851966
deviation-center-line_mean0.10783802485851966
deviation-center-line_min0.10783802485851966
deviation-heading_max0.9508048428349386
deviation-heading_mean0.9508048428349386
deviation-heading_median0.9508048428349386
deviation-heading_min0.9508048428349386
distance-from-start_max0.5146479428595191
distance-from-start_mean0.5146479428595191
distance-from-start_median0.5146479428595191
distance-from-start_min0.5146479428595191
driven_any_max0.5146585239872693
driven_any_mean0.5146585239872693
driven_any_median0.5146585239872693
driven_any_min0.5146585239872693
driven_lanedir_consec_max0.13666480491623578
driven_lanedir_consec_mean0.13666480491623578
driven_lanedir_consec_min0.13666480491623578
driven_lanedir_max0.13666480491623578
driven_lanedir_mean0.13666480491623578
driven_lanedir_median0.13666480491623578
driven_lanedir_min0.13666480491623578
in-drivable-lane_max2.749999999999993
in-drivable-lane_mean2.749999999999993
in-drivable-lane_min2.749999999999993
per-episodes
details{"4way-000-ego0": {"driven_any": 0.5146585239872693, "survival_time": 4.149999999999993, "driven_lanedir": 0.13666480491623578, "in-drivable-lane": 2.749999999999993, "deviation-heading": 0.9508048428349386, "distance-from-start": 0.5146479428595191, "deviation-center-line": 0.10783802485851966, "driven_lanedir_consec": 0.13666480491623578}}
simulation-passed1
survival_time_max4.149999999999993
survival_time_mean4.149999999999993
survival_time_min4.149999999999993
No reset possible
13923397Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:08:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-3.0059782859613584
survival_time_median59.99999999999873
deviation-center-line_median2.1509494940439753
in-drivable-lane_median37.19999999999909


other stats
deviation-center-line_max2.1509494940439753
deviation-center-line_mean2.1509494940439753
deviation-center-line_min2.1509494940439753
deviation-heading_max21.178882677424372
deviation-heading_mean21.178882677424372
deviation-heading_median21.178882677424372
deviation-heading_min21.178882677424372
distance-from-start_max0.1902624468792869
distance-from-start_mean0.1902624468792869
distance-from-start_median0.1902624468792869
distance-from-start_min0.1902624468792869
driven_any_max12.244344793345116
driven_any_mean12.244344793345116
driven_any_median12.244344793345116
driven_any_min12.244344793345116
driven_lanedir_consec_max-3.0059782859613584
driven_lanedir_consec_mean-3.0059782859613584
driven_lanedir_consec_min-3.0059782859613584
driven_lanedir_max-3.0059782859613584
driven_lanedir_mean-3.0059782859613584
driven_lanedir_median-3.0059782859613584
driven_lanedir_min-3.0059782859613584
in-drivable-lane_max37.19999999999909
in-drivable-lane_mean37.19999999999909
in-drivable-lane_min37.19999999999909
per-episodes
details{"zigzag-000-ego0": {"driven_any": 12.244344793345116, "survival_time": 59.99999999999873, "driven_lanedir": -3.0059782859613584, "in-drivable-lane": 37.19999999999909, "deviation-heading": 21.178882677424372, "distance-from-start": 0.1902624468792869, "deviation-center-line": 2.1509494940439753, "driven_lanedir_consec": -3.0059782859613584}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
13919526Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-testingsim-2of4failednodavinci-stage-02-6.2.500:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13910715Bea Baselines 🐤template-randomaido-LF-sim-testingsim-1of4successnodavinci-stage-02-6.2.500:04:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.24555746228952957
survival_time_median39.24999999999991
deviation-center-line_median1.3919847015555789
in-drivable-lane_median25.24999999999981


other stats
deviation-center-line_max1.3919847015555789
deviation-center-line_mean1.3919847015555789
deviation-center-line_min1.3919847015555789
deviation-heading_max9.906601177812297
deviation-heading_mean9.906601177812297
deviation-heading_median9.906601177812297
deviation-heading_min9.906601177812297
distance-from-start_max1.0093404360059268
distance-from-start_mean1.0093404360059268
distance-from-start_median1.0093404360059268
distance-from-start_min1.0093404360059268
driven_any_max9.462416332537492
driven_any_mean9.462416332537492
driven_any_median9.462416332537492
driven_any_min9.462416332537492
driven_lanedir_consec_max0.24555746228952957
driven_lanedir_consec_mean0.24555746228952957
driven_lanedir_consec_min0.24555746228952957
driven_lanedir_max0.2358197494342854
driven_lanedir_mean0.2358197494342854
driven_lanedir_median0.2358197494342854
driven_lanedir_min0.2358197494342854
in-drivable-lane_max25.24999999999981
in-drivable-lane_mean25.24999999999981
in-drivable-lane_min25.24999999999981
per-episodes
details{"loop-000-ego0": {"driven_any": 9.462416332537492, "survival_time": 39.24999999999991, "driven_lanedir": 0.2358197494342854, "in-drivable-lane": 25.24999999999981, "deviation-heading": 9.906601177812297, "distance-from-start": 1.0093404360059268, "deviation-center-line": 1.3919847015555789, "driven_lanedir_consec": 0.24555746228952957}}
simulation-passed1
survival_time_max39.24999999999991
survival_time_mean39.24999999999991
survival_time_min39.24999999999991
No reset possible
13907783Andrea Danieletemplate-randomaido-LF-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:02:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.27378584101885495
survival_time_median20.550000000000157
deviation-center-line_median0.7687309613328539
in-drivable-lane_median12.000000000000131


other stats
deviation-center-line_max0.7687309613328539
deviation-center-line_mean0.7687309613328539
deviation-center-line_min0.7687309613328539
deviation-heading_max5.7583430601860695
deviation-heading_mean5.7583430601860695
deviation-heading_median5.7583430601860695
deviation-heading_min5.7583430601860695
distance-from-start_max0.7357883576773772
distance-from-start_mean0.7357883576773772
distance-from-start_median0.7357883576773772
distance-from-start_min0.7357883576773772
driven_any_max4.915576034387011
driven_any_mean4.915576034387011
driven_any_median4.915576034387011
driven_any_min4.915576034387011
driven_lanedir_consec_max0.27378584101885495
driven_lanedir_consec_mean0.27378584101885495
driven_lanedir_consec_min0.27378584101885495
driven_lanedir_max0.2557751649818414
driven_lanedir_mean0.2557751649818414
driven_lanedir_median0.2557751649818414
driven_lanedir_min0.2557751649818414
in-drivable-lane_max12.000000000000131
in-drivable-lane_mean12.000000000000131
in-drivable-lane_min12.000000000000131
per-episodes
details{"loop2-000-ego0": {"driven_any": 4.915576034387011, "survival_time": 20.550000000000157, "driven_lanedir": 0.2557751649818414, "in-drivable-lane": 12.000000000000131, "deviation-heading": 5.7583430601860695, "distance-from-start": 0.7357883576773772, "deviation-center-line": 0.7687309613328539, "driven_lanedir_consec": 0.27378584101885495}}
simulation-passed1
survival_time_max20.550000000000157
survival_time_mean20.550000000000157
survival_time_min20.550000000000157
No reset possible
13904785Andrea Danieletemplate-rosaido-LF-sim-validationsim-1of4successnodavinci-stage-02-6.2.500:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5416212809354046
survival_time_median5.1999999999999895
deviation-center-line_median0.2019532577113771
in-drivable-lane_median3.2999999999999883


other stats
deviation-center-line_max0.2019532577113771
deviation-center-line_mean0.2019532577113771
deviation-center-line_min0.2019532577113771
deviation-heading_max0.5322102578499158
deviation-heading_mean0.5322102578499158
deviation-heading_median0.5322102578499158
deviation-heading_min0.5322102578499158
distance-from-start_max1.2850745648082549
distance-from-start_mean1.2850745648082549
distance-from-start_median1.2850745648082549
distance-from-start_min1.2850745648082549
driven_any_max1.3087818256762065
driven_any_mean1.3087818256762065
driven_any_median1.3087818256762065
driven_any_min1.3087818256762065
driven_lanedir_consec_max0.5416212809354046
driven_lanedir_consec_mean0.5416212809354046
driven_lanedir_consec_min0.5416212809354046
driven_lanedir_max0.5416212809354046
driven_lanedir_mean0.5416212809354046
driven_lanedir_median0.5416212809354046
driven_lanedir_min0.5416212809354046
in-drivable-lane_max3.2999999999999883
in-drivable-lane_mean3.2999999999999883
in-drivable-lane_min3.2999999999999883
per-episodes
details{"loop-000-ego0": {"driven_any": 1.3087818256762065, "survival_time": 5.1999999999999895, "driven_lanedir": 0.5416212809354046, "in-drivable-lane": 3.2999999999999883, "deviation-heading": 0.5322102578499158, "distance-from-start": 1.2850745648082549, "deviation-center-line": 0.2019532577113771, "driven_lanedir_consec": 0.5416212809354046}}
simulation-passed1
survival_time_max5.1999999999999895
survival_time_mean5.1999999999999895
survival_time_min5.1999999999999895
No reset possible
13902785Andrea Danieletemplate-rosaido-LF-sim-validationsim-0of4successnodavinci-stage-02-6.2.500:02:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.27247486735183424
survival_time_median12.35000000000004
deviation-center-line_median0.08130395102022532
in-drivable-lane_median11.10000000000004


other stats
deviation-center-line_max0.08130395102022532
deviation-center-line_mean0.08130395102022532
deviation-center-line_min0.08130395102022532
deviation-heading_max0.5584223896834134
deviation-heading_mean0.5584223896834134
deviation-heading_median0.5584223896834134
deviation-heading_min0.5584223896834134
distance-from-start_max3.43561784332027
distance-from-start_mean3.43561784332027
distance-from-start_median3.43561784332027
distance-from-start_min3.43561784332027
driven_any_max3.575058131258691
driven_any_mean3.575058131258691
driven_any_median3.575058131258691
driven_any_min3.575058131258691
driven_lanedir_consec_max0.27247486735183424
driven_lanedir_consec_mean0.27247486735183424
driven_lanedir_consec_min0.27247486735183424
driven_lanedir_max0.27247486735183424
driven_lanedir_mean0.27247486735183424
driven_lanedir_median0.27247486735183424
driven_lanedir_min0.27247486735183424
in-drivable-lane_max11.10000000000004
in-drivable-lane_mean11.10000000000004
in-drivable-lane_min11.10000000000004
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.575058131258691, "survival_time": 12.35000000000004, "driven_lanedir": 0.27247486735183424, "in-drivable-lane": 11.10000000000004, "deviation-heading": 0.5584223896834134, "distance-from-start": 3.43561784332027, "deviation-center-line": 0.08130395102022532, "driven_lanedir_consec": 0.27247486735183424}}
simulation-passed1
survival_time_max12.35000000000004
survival_time_mean12.35000000000004
survival_time_min12.35000000000004
No reset possible
13899785Andrea Danieletemplate-rosaido-LF-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:02:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.21289827400868555
survival_time_median5.14999999999999
deviation-center-line_median0.07634270386891893
in-drivable-lane_median4.049999999999989


other stats
deviation-center-line_max0.07634270386891893
deviation-center-line_mean0.07634270386891893
deviation-center-line_min0.07634270386891893
deviation-heading_max0.5877704823637483
deviation-heading_mean0.5877704823637483
deviation-heading_median0.5877704823637483
deviation-heading_min0.5877704823637483
distance-from-start_max1.220800717749058
distance-from-start_mean1.220800717749058
distance-from-start_median1.220800717749058
distance-from-start_min1.220800717749058
driven_any_max1.2629553341557729
driven_any_mean1.2629553341557729
driven_any_median1.2629553341557729
driven_any_min1.2629553341557729
driven_lanedir_consec_max0.21289827400868555
driven_lanedir_consec_mean0.21289827400868555
driven_lanedir_consec_min0.21289827400868555
driven_lanedir_max0.21289827400868555
driven_lanedir_mean0.21289827400868555
driven_lanedir_median0.21289827400868555
driven_lanedir_min0.21289827400868555
in-drivable-lane_max4.049999999999989
in-drivable-lane_mean4.049999999999989
in-drivable-lane_min4.049999999999989
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.2629553341557729, "survival_time": 5.14999999999999, "driven_lanedir": 0.21289827400868555, "in-drivable-lane": 4.049999999999989, "deviation-heading": 0.5877704823637483, "distance-from-start": 1.220800717749058, "deviation-center-line": 0.07634270386891893, "driven_lanedir_consec": 0.21289827400868555}}
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean5.14999999999999
survival_time_min5.14999999999999
No reset possible
13896309Andrea Censiminimal-agentaido-LFV-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13891309Andrea Censiminimal-agentaido-LFV-sim-validationsim-0of4errornodavinci-stage-02-6.2.500:01:43
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13887311Andrea Censiminimal-agentaido-LFV-sim-validationsim-0of4errornodavinci-stage-02-6.2.500:01:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13881341Liam Paulltemplate-rosaido-LF-sim-validationsim-2of4failednodavinci-stage-02-6.2.500:02:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 243, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13876356Liam Paulltemplate-rosaido-LF-sim-validationsim-3of4errornodavinci-stage-02-6.2.500:01:10
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13871389Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:01:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13866386Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:00:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13862387Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-validationsim-0of4errornodavinci-stage-02-6.2.500:01:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13857388Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-validationsim-0of4errornodavinci-stage-02-6.2.500:01:38
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13851389Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13847390Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:00:54
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13842391Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:01:22
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13835392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-0of4errornodavinci-stage-02-6.2.500:01:23
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13833393Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-testingsim-2of4errornodavinci-stage-02-6.2.500:00:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13828394Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-testingsim-2of4errornodavinci-stage-02-6.2.500:01:40
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13824395Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-testingsim-0of4errornodavinci-stage-02-6.2.500:01:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13819398Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-testingsim-0of4errornodavinci-stage-02-6.2.500:01:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13814514Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-validationsim-3of4failednodavinci-stage-02-6.2.500:01:12
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13809515Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-validationsim-2of4failednodavinci-stage-02-6.2.500:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13804516Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-validationsim-2of4failednodavinci-stage-02-6.2.500:01:36
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13799518Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13794519Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-validationsim-3of4failednodavinci-stage-02-6.2.500:00:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13792519Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-validationsim-1of4failednodavinci-stage-02-6.2.500:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13785521Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-testingsim-0of4failednodavinci-stage-02-6.2.500:01:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13781522Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-testingsim-0of4failednodavinci-stage-02-6.2.500:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13775523Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-testingsim-3of4failednodavinci-stage-02-6.2.500:01:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13770524Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13765527Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13761528Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-validationsim-3of4errornodavinci-stage-02-6.2.500:01:15
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13756529Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-validationsim-0of4errornodavinci-stage-02-6.2.500:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13753531Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13748532Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-validationsim-0of4errornodavinci-stage-02-6.2.500:01:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13743533Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-validationsim-0of4errornodavinci-stage-02-6.2.500:00:53
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13737534Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13733535Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-testingsim-3of4errornodavinci-stage-02-6.2.500:01:15
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13728537Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-testingsim-0of4errornodavinci-stage-02-6.2.500:01:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13722538Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-testingsim-0of4errornodavinci-stage-02-6.2.500:01:35
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13718539Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-testingsim-0of4errornodavinci-stage-02-6.2.500:01:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13713541Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-testingsim-2of4errornodavinci-stage-02-6.2.500:00:53
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13708542Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-testingsim-1of4errornodavinci-stage-02-6.2.500:01:16
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13703595Liam Paullbaseline-duckietownaido-LF-sim-validationsim-1of4failednodavinci-stage-02-6.2.500:00:56
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13698600Liam Paulltemplate-tensorflowaido-LF-sim-validationsim-3of4failednodavinci-stage-02-6.2.500:00:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13693604Bea Baselines 🐤template-rosaido-LFP-sim-validationsim-2of4errornodavinci-stage-02-6.2.500:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13688604Bea Baselines 🐤template-rosaido-LFP-sim-validationsim-3of4errornodavinci-stage-02-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13683606Bea Baselines 🐤template-rosaido-LFVI-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13679607Bea Baselines 🐤template-rosaido-LFI-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13674609Bea Baselines 🐤template-rosaido-LFVI_multi-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:01:21
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13670611Bea Baselines 🐤template-rosaido-LFP-sim-testingsim-2of4errornodavinci-stage-02-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13664612Bea Baselines 🐤template-rosaido-LFV-sim-testingsim-1of4errornodavinci-stage-02-6.2.500:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13659613Bea Baselines 🐤template-rosaido-LFVI-sim-testingsim-1of4errornodavinci-stage-02-6.2.500:01:38
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13652614Bea Baselines 🐤template-rosaido-LFI-sim-testingsim-0of4errornodavinci-stage-02-6.2.500:01:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13647616Bea Baselines 🐤template-rosaido-LFVI_multi-sim-testingsim-1of4errornodavinci-stage-02-6.2.500:01:19
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13642618Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:01:23
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13637620Bea Baselines 🐤baseline-duckietownaido-LFV-sim-validationsim-0of4errornodavinci-stage-02-6.2.500:01:30
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13632621Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13627622Bea Baselines 🐤baseline-duckietownaido-LFI-sim-validationsim-0of4errornodavinci-stage-02-6.2.500:01:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13622624Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13617625Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-testingsim-1of4errornodavinci-stage-02-6.2.500:01:17
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13613627Bea Baselines 🐤baseline-duckietownaido-LFV-sim-testingsim-1of4errornodavinci-stage-02-6.2.500:01:38
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13607628Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13603629Bea Baselines 🐤baseline-duckietownaido-LFI-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13597630Bea Baselines 🐤baseline-duckietownaido-LF-sim-testingsim-2of4errornodavinci-stage-02-6.2.500:01:02
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13592660Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-validationsim-3of4failednodavinci-stage-02-6.2.500:01:15
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13588661Bea Baselines 🐤template-tensorflowaido-LFP-sim-validationsim-2of4failednodavinci-stage-02-6.2.500:00:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13583663Bea Baselines 🐤template-tensorflowaido-LFVI-sim-validationsim-1of4failednodavinci-stage-02-6.2.500:01:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13574664Bea Baselines 🐤template-tensorflowaido-LFI-sim-validationsim-0of4failednodavinci-stage-02-6.2.500:01:39
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13570666Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-validationsim-0of4failednodavinci-stage-02-6.2.500:01:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13565667Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-testingsim-2of4failednodavinci-stage-02-6.2.500:01:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13560669Bea Baselines 🐤template-tensorflowaido-LFV-sim-testingsim-2of4failednodavinci-stage-02-6.2.500:01:37
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13555670Bea Baselines 🐤template-tensorflowaido-LFVI-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13551671Bea Baselines 🐤template-tensorflowaido-LFI-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13545673Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-testingsim-0of4failednodavinci-stage-02-6.2.500:01:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13540703Bea Baselines 🐤template-randomaido-LFV_multi-sim-validationsim-3of4errornodavinci-stage-02-6.2.500:01:13
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13536704Bea Baselines 🐤template-randomaido-LFP-sim-validationsim-3of4errornodavinci-stage-02-6.2.500:00:54
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13531706Bea Baselines 🐤template-randomaido-LFVI-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13526708Bea Baselines 🐤template-randomaido-LF-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:00:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13520709Bea Baselines 🐤template-randomaido-LFVI_multi-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:01:16
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13516710Bea Baselines 🐤template-randomaido-LFV_multi-sim-testingsim-3of4errornodavinci-stage-02-6.2.500:01:15
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13511712Bea Baselines 🐤template-randomaido-LFV-sim-testingsim-3of4errornodavinci-stage-02-6.2.500:01:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13505713Bea Baselines 🐤template-randomaido-LFVI-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13498714Bea Baselines 🐤template-randomaido-LFI-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13494732Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-validationsim-0of4errornodavinci-stage-02-6.2.500:01:22
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13491732Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:01:22
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13486733Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-validationsim-2of4errornodavinci-stage-02-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13482736Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-validationsim-0of4errornodavinci-stage-02-6.2.500:01:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13476737Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-validationsim-2of4errornodavinci-stage-02-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13471738Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:01:20
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13465739Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-testingsim-2of4errornodavinci-stage-02-6.2.500:01:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13460741Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-testingsim-2of4errornodavinci-stage-02-6.2.500:01:40
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13456742Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13449743Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13442746Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13438764Bea Baselines 🐤challenge-aido_LF-baseline-duckietown:daffy:d0c3b9f200e160334a96bdb0f91745327be57194aido-hello-sim-validationsanity-checkerrornodavinci-stage-02-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13433769Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-validationsim-3of4errornodavinci-stage-02-6.2.500:01:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13429770Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13425772Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:01:47
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13418773Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-validationsim-0of4errornodavinci-stage-02-6.2.500:01:30
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13413775Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-validationsim-0of4errornodavinci-stage-02-6.2.500:01:21
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13408776Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-testingsim-3of4errornodavinci-stage-02-6.2.500:01:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13402777Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-testingsim-3of4errornodavinci-stage-02-6.2.500:01:02
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13397779Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-testingsim-1of4errornodavinci-stage-02-6.2.500:01:43
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13392780Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-testingsim-1of4errornodavinci-stage-02-6.2.500:01:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13386782Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13381795Bea Baselines 🐤challenge-aido_LF-template-pytorch:daffy-staging:c5eb3df1f1017464ea091cbc60ac41b043b03a95aido-hello-sim-validationsanity-checkerrornodavinci-stage-02-6.2.500:00:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13376800Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-3of4failednodavinci-stage-02-6.2.500:00:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13371801Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-2of4failednodavinci-stage-02-6.2.500:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13368805Bea Baselines 🐤challenge-aido_LF-baseline-duckietown:daffy-staging:06423b9f834b346c04889a28f919db3673a8d2c1aido-hello-sim-validationsanity-checkerrornodavinci-stage-02-6.2.500:01:04
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13362806user1000001minimal-agentaido-LFV-sim-validationsim-3of4errornodavinci-stage-02-6.2.500:01:31
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13359808Andrea Censitemplate-randomaido-LFV-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:01:34
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13355810Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-validationsim-1of4failednodavinci-stage-02-6.2.500:01:01
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13349811Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-0of4errornodavinci-stage-02-6.2.500:01:31
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13345812Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-0of4errornodavinci-stage-02-6.2.500:01:30
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13338813Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:01:03
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13333815Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-validationsim-0of4errornodavinci-stage-02-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13328816Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13323818Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-validationsim-3of4errornodavinci-stage-02-6.2.500:01:45
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13318819Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-validation449errornodavinci-stage-02-6.2.500:01:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13313820Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-validationsim-2of4errornodavinci-stage-02-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13307822Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13302823Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-testingsim-1of4errornodavinci-stage-02-6.2.500:01:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13297824Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-testingsim-2of4errornodavinci-stage-02-6.2.500:01:45
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13291826Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:01:43
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13287827Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-testingsim-1of4errornodavinci-stage-02-6.2.500:01:43
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13281828Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-testingsim-1of4errornodavinci-stage-02-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13276829Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:01:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13269831Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-validationsim-2of4errornodavinci-stage-02-6.2.500:01:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13263832Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13258834Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:01:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13254835Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-validationsim-2of4errornodavinci-stage-02-6.2.500:01:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13248836Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-testingsim-1of4errornodavinci-stage-02-6.2.500:01:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13246837Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-testingsim-2of4errornodavinci-stage-02-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13238838Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-testingsim-2of4errornodavinci-stage-02-6.2.500:01:44
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13234840Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-testingsim-2of4host-errornodavinci-stage-02-6.2.500:01:45
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13227841Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-testingsim-0of4errornodavinci-stage-02-6.2.500:01:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13223842Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-testingsim-1of4errornodavinci-stage-02-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13219843Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13214845Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-validationsim-3of4errornodavinci-stage-02-6.2.500:01:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13210847Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-validation448errornodavinci-stage-02-6.2.500:01:32
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13205848Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-validationsim-2of4errornodavinci-stage-02-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13200849Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-testingsim-3of4errornodavinci-stage-02-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13195852Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-testingsim-3of4errornodavinci-stage-02-6.2.500:01:38
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13190853Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-testingsim-3of4errornodavinci-stage-02-6.2.500:01:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13185854Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:01:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13180855Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-testingsim-3of4errornodavinci-stage-02-6.2.500:01:33
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13175857Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:01:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13168858Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-2of4errornodavinci-stage-02-6.2.500:01:40
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13162860Bea Baselines 🐤template-pytorchaido-LFV-sim-validationsim-3of4errornodavinci-stage-02-6.2.500:01:32
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13157861Bea Baselines 🐤template-pytorchaido-LFVI-sim-validationsim-0of4errornodavinci-stage-02-6.2.500:01:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13153862Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13150863Bea Baselines 🐤template-pytorchaido-LF-sim-validationsim-3of4errornodavinci-stage-02-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13144865Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:01:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13139866Bea Baselines 🐤template-pytorchaido-LFP-sim-validationsim-3of4errornodavinci-stage-02-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13134872Bea Baselines 🐤template-pytorchaido-LFV-sim-testingsim-2of4errornodavinci-stage-02-6.2.500:02:06
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13128873Bea Baselines 🐤template-pytorchaido-LFVI-sim-testingsim-1of4errornodavinci-stage-02-6.2.500:01:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13123875Bea Baselines 🐤template-pytorchaido-LF-sim-testingsim-0of4errornodavinci-stage-02-6.2.500:01:52
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13118877Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-testingsim-0of4errornodavinci-stage-02-6.2.500:01:38
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13113878Bea Baselines 🐤template-pytorchaido-LFP-sim-testingsim-3of4errornodavinci-stage-02-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13107879Bea Baselines 🐤template-randomaido-LFV-sim-validationsim-0of4errornodavinci-stage-02-6.2.500:01:31
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13105880Bea Baselines 🐤template-rosaido-LF-sim-validationsim-2of4errornodavinci-stage-02-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13100881Bea Baselines 🐤template-tensorflowaido-LFV-sim-validationsim-3of4failednodavinci-stage-02-6.2.500:01:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13095883Bea Baselines 🐤template-tensorflowaido-LFV-sim-validationsim-2of4failednodavinci-stage-02-6.2.500:01:40
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13090884Bea Baselines 🐤template-rosaido-LF-sim-validationsim-2of4errornodavinci-stage-02-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13082689Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-validationsim-2of4errornodavinci-stage-02-6.2.500:01:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13077692Bea Baselines 🐤minimal-agentaido-LFVI-sim-validationsim-0of4errornodavinci-stage-02-6.2.500:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13074693Bea Baselines 🐤minimal-agentaido-LFI-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:01:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13069694Bea Baselines 🐤minimal-agentaido-LF-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13063696Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-testingsim-0of4errornodavinci-stage-02-6.2.500:01:17
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13058697Bea Baselines 🐤minimal-agentaido-LFP-sim-testingsim-0of4errornodavinci-stage-02-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13054699Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-1of4errornodavinci-stage-02-6.2.500:01:36
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13048700Bea Baselines 🐤minimal-agentaido-LFI-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13044701Bea Baselines 🐤minimal-agentaido-LF-sim-testingsim-1of4errornodavinci-stage-02-6.2.500:00:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13039397Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-testingsim-3of4errornodavinci-stage-02-6.2.500:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13034526Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-testingsim-3of4failednodavinci-stage-02-6.2.500:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13029672Bea Baselines 🐤template-tensorflowaido-LF-sim-testingsim-1of4failednodavinci-stage-02-6.2.500:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13024783Andrea Danieletemplate-randomaido-LF-sim-validationsim-2of4errornodavinci-stage-02-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13018785Andrea Danieletemplate-rosaido-LF-sim-validationsim-3of4errornodavinci-stage-02-6.2.500:00:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13013789Andrea Danieletemplate-pytorchaido-LF-sim-validationsim-2of4errornodavinci-stage-02-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13008844Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-validationsim-0of4errornodavinci-stage-02-6.2.500:01:31
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13003846Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-validationsim-0of4errornodavinci-stage-02-6.2.500:01:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12995847Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-validation443erroryesdavinci-stage-02-6.2.500:01:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12992848Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:01:04
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12986850Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12980851Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-testingsim-3of4errornodavinci-stage-02-6.2.500:01:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12974853Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-testingsim-2of4errornodavinci-stage-02-6.2.500:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12969853Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-testingsim-3of4errornodavinci-stage-02-6.2.500:01:31
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12963855Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-testingsim-2of4errornodavinci-stage-02-6.2.500:01:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12958857Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-3of4errornodavinci-stage-02-6.2.500:01:30
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12953858Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:01:38
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12949859Bea Baselines 🐤baseline-duckietownaido-LF-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12944860Bea Baselines 🐤template-pytorchaido-LFV-sim-validationsim-0of4errornodavinci-stage-02-6.2.500:01:30
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12939861Bea Baselines 🐤template-pytorchaido-LFVI-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12934864Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-0of4errornodavinci-stage-02-6.2.500:01:34
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12929876Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-testingsim-1of4errornodavinci-stage-02-6.2.500:01:35
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12924695Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12919695Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:01:15
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12913874Bea Baselines 🐤template-pytorchaido-LFI-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12908862Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:01:44
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12903862Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-0of4abortednodavinci-stage-02-6.2.500:01:03
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1302, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 749, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12897863Bea Baselines 🐤template-pytorchaido-LF-sim-validationsim-3of4errornodavinci-stage-02-6.2.500:01:02
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12894865Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:01:36
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12889866Bea Baselines 🐤template-pytorchaido-LFP-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12883872Bea Baselines 🐤template-pytorchaido-LFV-sim-testingsim-1of4errornodavinci-stage-02-6.2.500:01:40
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12879875Bea Baselines 🐤template-pytorchaido-LF-sim-testingsim-3of4errornodavinci-stage-02-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12872884Bea Baselines 🐤template-rosaido-LF-sim-validationsim-3of4errornodavinci-stage-02-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12868697Bea Baselines 🐤minimal-agentaido-LFP-sim-testingsim-0of4errornodavinci-stage-02-6.2.500:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12862397Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-testingsim-0of4errornodavinci-stage-02-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12857783Andrea Danieletemplate-randomaido-LF-sim-validationsim-3of4errornodavinci-stage-02-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12852789Andrea Danieletemplate-pytorchaido-LF-sim-validationsim-3of4errornodavinci-stage-02-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12847873Bea Baselines 🐤template-pytorchaido-LFVI-sim-testingsim-1of4errornodavinci-stage-02-6.2.500:01:43
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12842874Bea Baselines 🐤template-pytorchaido-LFI-sim-testingsim-1of4host-errornodavinci-stage-02-6.2.500:01:39
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12837875Bea Baselines 🐤template-pytorchaido-LF-sim-testingsim-1of4errornodavinci-stage-02-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12832876Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-testingsim-1of4errornodavinci-stage-02-6.2.500:01:36
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12828878Bea Baselines 🐤template-pytorchaido-LFP-sim-testingsim-3of4errornodavinci-stage-02-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12824878Bea Baselines 🐤template-pytorchaido-LFP-sim-testingsim-3of4errornodavinci-stage-02-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12821879Bea Baselines 🐤template-randomaido-LFV-sim-validationsim-3of4errornodavinci-stage-02-6.2.500:01:33
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12813881Bea Baselines 🐤template-tensorflowaido-LFV-sim-validationsim-1of4failednodavinci-stage-02-6.2.500:02:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12808882Bea Baselines 🐤template-randomaido-LFV-sim-validationsim-2of4errornodavinci-stage-02-6.2.500:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12802883Bea Baselines 🐤template-tensorflowaido-LFV-sim-validationsim-1of4failednodavinci-stage-02-6.2.500:01:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12800884Bea Baselines 🐤template-rosaido-LF-sim-validationsim-2of4errornodavinci-stage-02-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12788689Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-validationsim-0of4errornodavinci-stage-02-6.2.500:01:21
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12784690Bea Baselines 🐤minimal-agentaido-LFP-sim-validationsim-0of4errornodavinci-stage-02-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12779692Bea Baselines 🐤minimal-agentaido-LFVI-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12774694Bea Baselines 🐤minimal-agentaido-LF-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:00:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12769695Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12761696Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-testingsim-2of4errornodavinci-stage-02-6.2.500:01:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12757698Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-1of4errornodavinci-stage-02-6.2.500:01:38
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12752698Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-0of4errornodavinci-stage-02-6.2.500:01:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12747701Bea Baselines 🐤minimal-agentaido-LF-sim-testingsim-3of4errornodavinci-stage-02-6.2.500:00:54
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12744397Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-testingsim-1of4errornodavinci-stage-02-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12737526Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-testingsim-0of4failednodavinci-stage-02-6.2.500:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12735715Bea Baselines 🐤template-randomaido-LF-sim-testingsim-3of4errornodavinci-stage-02-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12727785Andrea Danieletemplate-rosaido-LF-sim-validationsim-2of4errornodavinci-stage-02-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12723789Andrea Danieletemplate-pytorchaido-LF-sim-validationsim-2of4errornodavinci-stage-02-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12718715Bea Baselines 🐤template-randomaido-LF-sim-testingsim-0of4errornodavinci-stage-02-6.2.500:01:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12713699Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-0of4errornodavinci-stage-02-6.2.500:01:35
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12707700Bea Baselines 🐤minimal-agentaido-LFI-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12703702Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-testingsim-0of4errornodavinci-stage-02-6.2.500:01:15
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12695702Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12692397Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-testingsim-1of4errornodavinci-stage-02-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12687783Andrea Danieletemplate-randomaido-LF-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12680789Andrea Danieletemplate-pytorchaido-LF-sim-validationsim-1of4errornodavinci-stage-02-6.2.500:01:12
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12677672Bea Baselines 🐤template-tensorflowaido-LF-sim-testingsim-0of4failednodavinci-stage-02-6.2.500:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12672715Bea Baselines 🐤template-randomaido-LF-sim-testingsim-2of4errornodavinci-stage-02-6.2.500:01:03
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12665804Bea Baselines 🐤challenge-aido_LF-template-ros:daffy-staging:3d125842a05be049b6ee6fe0059908c18c57ebb2aido-hello-sim-validationsanity-checkerrornodavinci-stage-02-6.2.500:01:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12603913Bea Baselines 🐤baseline-solutionlx22-planning-cc-dynamic-valistep1-0of4errornodavinci-stage-02-6.2.500:17:07
Waited 1006 seconds [...]
Waited 1006 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12601913Bea Baselines 🐤baseline-solutionlx22-planning-cc-dynamic-valistep1-2of4successnodavinci-stage-02-6.2.500:00:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
12586919Bea Baselines 🐤baseline-solutionlx22-planning-cc-dynamic-teststep1-0of4abortednodavinci-stage-02-6.2.500:17:11
Waited 1000 seconds [...]
Waited 1000 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12582919Bea Baselines 🐤baseline-solutionlx22-planning-cc-dynamic-teststep1-2of4successnodavinci-stage-02-6.2.500:00:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
12578920Bea Baselines 🐤baseline-solutionlx22-planning-cc-static-teststep1-1of4successnodavinci-stage-02-6.2.500:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
12555309Andrea Censiminimal-agentaido-LFV-sim-validationsim-1of4successnodavinci-stage-02-6.2.500:02:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.1999999999999895
in-drivable-lane_median3.4499999999999886
driven_lanedir_consec_median0.19955005044754337
deviation-center-line_median0.12567516126913286


other stats
deviation-center-line_max0.12567516126913286
deviation-center-line_mean0.12567516126913286
deviation-center-line_min0.12567516126913286
deviation-heading_max0.9488219555580458
deviation-heading_mean0.9488219555580458
deviation-heading_median0.9488219555580458
deviation-heading_min0.9488219555580458
distance-from-start_max0.689742337316815
distance-from-start_mean0.689742337316815
distance-from-start_median0.689742337316815
distance-from-start_min0.689742337316815
driven_any_max0.6897540728183593
driven_any_mean0.6897540728183593
driven_any_median0.6897540728183593
driven_any_min0.6897540728183593
driven_lanedir_consec_max0.19955005044754337
driven_lanedir_consec_mean0.19955005044754337
driven_lanedir_consec_min0.19955005044754337
driven_lanedir_max0.19955005044754337
driven_lanedir_mean0.19955005044754337
driven_lanedir_median0.19955005044754337
driven_lanedir_min0.19955005044754337
in-drivable-lane_max3.4499999999999886
in-drivable-lane_mean3.4499999999999886
in-drivable-lane_min3.4499999999999886
per-episodes
details{"loop-000-ego0": {"driven_any": 0.6897540728183593, "survival_time": 5.1999999999999895, "driven_lanedir": 0.19955005044754337, "in-drivable-lane": 3.4499999999999886, "deviation-heading": 0.9488219555580458, "distance-from-start": 0.689742337316815, "deviation-center-line": 0.12567516126913286, "driven_lanedir_consec": 0.19955005044754337}}
simulation-passed1
survival_time_max5.1999999999999895
survival_time_mean5.1999999999999895
survival_time_min5.1999999999999895
No reset possible
12548311Andrea Censiminimal-agentaido-LFV-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:04:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.499999999999986
in-drivable-lane_median6.749999999999985
driven_lanedir_consec_median0.19955231542410212
deviation-center-line_median0.1256753337219296


other stats
deviation-center-line_max0.1256753337219296
deviation-center-line_mean0.1256753337219296
deviation-center-line_min0.1256753337219296
deviation-heading_max0.9488219555580464
deviation-heading_mean0.9488219555580464
deviation-heading_median0.9488219555580464
deviation-heading_min0.9488219555580464
distance-from-start_max1.233057068821899
distance-from-start_mean1.233057068821899
distance-from-start_median1.233057068821899
distance-from-start_min1.233057068821899
driven_any_max1.2331286149593297
driven_any_mean1.2331286149593297
driven_any_median1.2331286149593297
driven_any_min1.2331286149593297
driven_lanedir_consec_max0.19955231542410212
driven_lanedir_consec_mean0.19955231542410212
driven_lanedir_consec_min0.19955231542410212
driven_lanedir_max0.19955231542410212
driven_lanedir_mean0.19955231542410212
driven_lanedir_median0.19955231542410212
driven_lanedir_min0.19955231542410212
in-drivable-lane_max6.749999999999985
in-drivable-lane_mean6.749999999999985
in-drivable-lane_min6.749999999999985
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.2331286149593297, "survival_time": 8.499999999999986, "driven_lanedir": 0.19955231542410212, "in-drivable-lane": 6.749999999999985, "deviation-heading": 0.9488219555580464, "distance-from-start": 1.233057068821899, "deviation-center-line": 0.1256753337219296, "driven_lanedir_consec": 0.19955231542410212}}
simulation-passed1
survival_time_max8.499999999999986
survival_time_mean8.499999999999986
survival_time_min8.499999999999986
No reset possible
12546311Andrea Censiminimal-agentaido-LFV-sim-validationsim-1of4host-errornodavinci-stage-02-6.2.500:00:39
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12544312Liam Paulltemplate-rosaido-LF-sim-validationsim-1of4successnodavinci-stage-02-6.2.500:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2878002329810061
survival_time_median4.6499999999999915
deviation-center-line_median0.10442394620216576
in-drivable-lane_median3.3499999999999908


other stats
deviation-center-line_max0.10442394620216576
deviation-center-line_mean0.10442394620216576
deviation-center-line_min0.10442394620216576
deviation-heading_max0.5675387615046817
deviation-heading_mean0.5675387615046817
deviation-heading_median0.5675387615046817
deviation-heading_min0.5675387615046817
distance-from-start_max1.0814242718961502
distance-from-start_mean1.0814242718961502
distance-from-start_median1.0814242718961502
distance-from-start_min1.0814242718961502
driven_any_max1.0968632722594445
driven_any_mean1.0968632722594445
driven_any_median1.0968632722594445
driven_any_min1.0968632722594445
driven_lanedir_consec_max0.2878002329810061
driven_lanedir_consec_mean0.2878002329810061
driven_lanedir_consec_min0.2878002329810061
driven_lanedir_max0.2878002329810061
driven_lanedir_mean0.2878002329810061
driven_lanedir_median0.2878002329810061
driven_lanedir_min0.2878002329810061
in-drivable-lane_max3.3499999999999908
in-drivable-lane_mean3.3499999999999908
in-drivable-lane_min3.3499999999999908
per-episodes
details{"loop-000-ego0": {"driven_any": 1.0968632722594445, "survival_time": 4.6499999999999915, "driven_lanedir": 0.2878002329810061, "in-drivable-lane": 3.3499999999999908, "deviation-heading": 0.5675387615046817, "distance-from-start": 1.0814242718961502, "deviation-center-line": 0.10442394620216576, "driven_lanedir_consec": 0.2878002329810061}}
simulation-passed1
survival_time_max4.6499999999999915
survival_time_mean4.6499999999999915
survival_time_min4.6499999999999915
No reset possible
12525385Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-validationsim-1of4successnodavinci-stage-02-6.2.500:32:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median27.47499999999937
driven_lanedir_consec_median-2.6033568297458927
deviation-center-line_median2.1636024168756736


other stats
deviation-center-line_max3.665076488334382
deviation-center-line_mean2.4574656108317936
deviation-center-line_min1.8375811212414457
deviation-heading_max30.35961214439682
deviation-heading_mean26.63785184087471
deviation-heading_median26.983304131317013
deviation-heading_min22.225186956467983
distance-from-start_max0.2855556703444708
distance-from-start_mean0.2082425349582598
distance-from-start_median0.1919282084792424
distance-from-start_min0.1635580525300836
driven_any_max12.46143265658705
driven_any_mean11.65629513964986
driven_any_median11.829480494950705
driven_any_min10.504786912110983
driven_lanedir_consec_max-1.8667364187365167
driven_lanedir_consec_mean-2.7398215188969934
driven_lanedir_consec_min-3.885835997359671
driven_lanedir_max-2.747637655282685
driven_lanedir_mean-3.843818451260298
driven_lanedir_median-3.5063300527837913
driven_lanedir_min-5.614976044190927
in-drivable-lane_max32.499999999999005
in-drivable-lane_mean26.21249999999927
in-drivable-lane_min17.399999999999338
per-episodes
details{"loop-000-ego0": {"driven_any": 12.46143265658705, "survival_time": 59.99999999999873, "driven_lanedir": -4.185675747891296, "in-drivable-lane": 29.149999999999395, "deviation-heading": 26.389092047892056, "distance-from-start": 0.1635580525300836, "deviation-center-line": 1.8395821370194123, "driven_lanedir_consec": -3.885835997359671}, "loop-000-ego1": {"driven_any": 10.504786912110983, "survival_time": 59.99999999999873, "driven_lanedir": -2.747637655282685, "in-drivable-lane": 25.79999999999934, "deviation-heading": 27.577516214741973, "distance-from-start": 0.1936103679087176, "deviation-center-line": 1.8375811212414457, "driven_lanedir_consec": -2.747637655282685}, "loop-000-ego2": {"driven_any": 12.38787738951152, "survival_time": 59.99999999999873, "driven_lanedir": -5.614976044190927, "in-drivable-lane": 17.399999999999338, "deviation-heading": 30.35961214439682, "distance-from-start": 0.2855556703444708, "deviation-center-line": 3.665076488334382, "driven_lanedir_consec": -1.8667364187365167}, "loop-000-ego3": {"driven_any": 11.271083600389884, "survival_time": 59.99999999999873, "driven_lanedir": -2.8269843576762863, "in-drivable-lane": 32.499999999999005, "deviation-heading": 22.225186956467983, "distance-from-start": 0.19024604904976716, "deviation-center-line": 2.4876226967319353, "driven_lanedir_consec": -2.4590760042091}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12519387Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-validationsim-0of4successnodavinci-stage-02-6.2.500:19:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median34.09999999999913
driven_lanedir_consec_median-3.205564333307529
deviation-center-line_median2.625975838738974


other stats
deviation-center-line_max2.625975838738974
deviation-center-line_mean2.625975838738974
deviation-center-line_min2.625975838738974
deviation-heading_max23.13966425368392
deviation-heading_mean23.13966425368392
deviation-heading_median23.13966425368392
deviation-heading_min23.13966425368392
distance-from-start_max0.1644280560586343
distance-from-start_mean0.1644280560586343
distance-from-start_median0.1644280560586343
distance-from-start_min0.1644280560586343
driven_any_max12.158597856381414
driven_any_mean12.158597856381414
driven_any_median12.158597856381414
driven_any_min12.158597856381414
driven_lanedir_consec_max-3.205564333307529
driven_lanedir_consec_mean-3.205564333307529
driven_lanedir_consec_min-3.205564333307529
driven_lanedir_max-3.393256727538292
driven_lanedir_mean-3.393256727538292
driven_lanedir_median-3.393256727538292
driven_lanedir_min-3.393256727538292
in-drivable-lane_max34.09999999999913
in-drivable-lane_mean34.09999999999913
in-drivable-lane_min34.09999999999913
per-episodes
details{"autolab-000-ego0": {"driven_any": 12.158597856381414, "survival_time": 59.99999999999873, "driven_lanedir": -3.393256727538292, "in-drivable-lane": 34.09999999999913, "deviation-heading": 23.13966425368392, "distance-from-start": 0.1644280560586343, "deviation-center-line": 2.625975838738974, "driven_lanedir_consec": -3.205564333307529}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12514388Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-validationsim-1of4successnodavinci-stage-02-6.2.500:06:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median20.450000000000156
in-drivable-lane_median6.300000000000045
driven_lanedir_consec_median-0.8855555938117998
deviation-center-line_median0.8620013771664495


other stats
deviation-center-line_max0.8620013771664495
deviation-center-line_mean0.8620013771664495
deviation-center-line_min0.8620013771664495
deviation-heading_max10.315534765559478
deviation-heading_mean10.315534765559478
deviation-heading_median10.315534765559478
deviation-heading_min10.315534765559478
distance-from-start_max0.1663730185188506
distance-from-start_mean0.1663730185188506
distance-from-start_median0.1663730185188506
distance-from-start_min0.1663730185188506
driven_any_max3.64099688162242
driven_any_mean3.64099688162242
driven_any_median3.64099688162242
driven_any_min3.64099688162242
driven_lanedir_consec_max-0.8855555938117998
driven_lanedir_consec_mean-0.8855555938117998
driven_lanedir_consec_min-0.8855555938117998
driven_lanedir_max-1.14806331089325
driven_lanedir_mean-1.14806331089325
driven_lanedir_median-1.14806331089325
driven_lanedir_min-1.14806331089325
in-drivable-lane_max6.300000000000045
in-drivable-lane_mean6.300000000000045
in-drivable-lane_min6.300000000000045
per-episodes
details{"4way-000-ego0": {"driven_any": 3.64099688162242, "survival_time": 20.450000000000156, "driven_lanedir": -1.14806331089325, "in-drivable-lane": 6.300000000000045, "deviation-heading": 10.315534765559478, "distance-from-start": 0.1663730185188506, "deviation-center-line": 0.8620013771664495, "driven_lanedir_consec": -0.8855555938117998}}
simulation-passed1
survival_time_max20.450000000000156
survival_time_mean20.450000000000156
survival_time_min20.450000000000156
No reset possible
12512389Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12511389Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:01:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12501392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:33:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median36.024999999999146
driven_lanedir_consec_median-1.94117279416262
deviation-center-line_median2.213415206788241


other stats
deviation-center-line_max4.487069802055514
deviation-center-line_mean2.5753198435277147
deviation-center-line_min1.3873791584788635
deviation-heading_max25.874328402326647
deviation-heading_mean16.116563888280144
deviation-heading_median14.758957988932538
deviation-heading_min9.07401117292885
distance-from-start_max0.1679623256832792
distance-from-start_mean0.1389971736599422
distance-from-start_median0.1596405040823301
distance-from-start_min0.06874536079182941
driven_any_max13.177043635176249
driven_any_mean9.42263270975084
driven_any_median12.2215012947719
driven_any_min0.07048461428331204
driven_lanedir_consec_max0.06632886269851967
driven_lanedir_consec_mean-1.8651429602944525
driven_lanedir_consec_min-3.644555115551089
driven_lanedir_max0.06632886269851967
driven_lanedir_mean-2.0422043402066805
driven_lanedir_median-2.2952955539870765
driven_lanedir_min-3.644555115551089
in-drivable-lane_max46.54999999999889
in-drivable-lane_mean29.649999999999295
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 11.853618039625594, "survival_time": 59.99999999999873, "driven_lanedir": -3.644555115551089, "in-drivable-lane": 30.949999999999346, "deviation-heading": 25.874328402326647, "distance-from-start": 0.15599031267427177, "deviation-center-line": 2.536434555875835, "driven_lanedir_consec": -3.644555115551089}, "zigzag-000-ego1": {"driven_any": 12.589384549918206, "survival_time": 59.99999999999873, "driven_lanedir": -1.6346622438996334, "in-drivable-lane": 46.54999999999889, "deviation-heading": 13.693188480115827, "distance-from-start": 0.1632906954903885, "deviation-center-line": 1.3873791584788635, "driven_lanedir_consec": -1.6346622438996334}, "zigzag-000-ego2": {"driven_any": 13.177043635176249, "survival_time": 59.99999999999873, "driven_lanedir": -2.9559288640745196, "in-drivable-lane": 41.09999999999894, "deviation-heading": 15.82472749774925, "distance-from-start": 0.1679623256832792, "deviation-center-line": 1.8903958577006463, "driven_lanedir_consec": -2.2476833444256066}, "zigzag-000-ego3": {"driven_any": 0.07048461428331204, "survival_time": 59.99999999999873, "driven_lanedir": 0.06632886269851967, "in-drivable-lane": 0.0, "deviation-heading": 9.07401117292885, "distance-from-start": 0.06874536079182941, "deviation-center-line": 4.487069802055514, "driven_lanedir_consec": 0.06632886269851967}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12487398Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-testingsim-0of4successnodavinci-stage-02-6.2.500:34:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median25.549999999999308
driven_lanedir_consec_median-3.0680521641240945
deviation-center-line_median3.643458052749258


other stats
deviation-center-line_max4.8139738606610845
deviation-center-line_mean3.6371559050720097
deviation-center-line_min2.447733654128436
deviation-heading_max28.159370009840583
deviation-heading_mean23.628708094997094
deviation-heading_median24.733225327329805
deviation-heading_min16.8890117154882
distance-from-start_max0.1989274035365937
distance-from-start_mean0.17832814720110352
distance-from-start_median0.17517310622687626
distance-from-start_min0.1640389728140679
driven_any_max12.513141669618362
driven_any_mean9.954691433171316
driven_any_median11.741443105018083
driven_any_min3.8227378530307305
driven_lanedir_consec_max-1.1337008649559022
driven_lanedir_consec_mean-2.610920453539629
driven_lanedir_consec_min-3.173876620954426
driven_lanedir_max-1.1258857650950145
driven_lanedir_mean-2.6449247801068076
driven_lanedir_median-3.0680521641240945
driven_lanedir_min-3.3177090270840273
in-drivable-lane_max33.44999999999921
in-drivable-lane_mean23.07499999999947
in-drivable-lane_min7.750000000000051
per-episodes
details{"udem-000-ego0": {"driven_any": 3.8227378530307305, "survival_time": 59.99999999999873, "driven_lanedir": -1.1258857650950145, "in-drivable-lane": 7.750000000000051, "deviation-heading": 16.8890117154882, "distance-from-start": 0.16492160786910834, "deviation-center-line": 4.8139738606610845, "driven_lanedir_consec": -1.1337008649559022}, "udem-000-ego1": {"driven_any": 11.938757868751413, "survival_time": 59.99999999999873, "driven_lanedir": -3.0723152445589044, "in-drivable-lane": 21.899999999999427, "deviation-heading": 28.159370009840583, "distance-from-start": 0.1854246045846442, "deviation-center-line": 4.26036779744188, "driven_lanedir_consec": -3.0723152445589044}, "udem-000-ego2": {"driven_any": 11.54412834128476, "survival_time": 59.99999999999873, "driven_lanedir": -3.3177090270840273, "in-drivable-lane": 33.44999999999921, "deviation-heading": 22.621534881815315, "distance-from-start": 0.1640389728140679, "deviation-center-line": 2.447733654128436, "driven_lanedir_consec": -3.173876620954426}, "udem-000-ego3": {"driven_any": 12.513141669618362, "survival_time": 59.99999999999873, "driven_lanedir": -3.0637890836892847, "in-drivable-lane": 29.19999999999919, "deviation-heading": 26.844915772844292, "distance-from-start": 0.1989274035365937, "deviation-center-line": 3.026548308056636, "driven_lanedir_consec": -3.0637890836892847}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12484393Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-testingsim-1of4successnodavinci-stage-02-6.2.500:08:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median34.24999999999896
driven_lanedir_consec_median-1.0779943484515069
deviation-center-line_median2.651206897870493


other stats
deviation-center-line_max2.651206897870493
deviation-center-line_mean2.651206897870493
deviation-center-line_min2.651206897870493
deviation-heading_max22.866062602321904
deviation-heading_mean22.866062602321904
deviation-heading_median22.866062602321904
deviation-heading_min22.866062602321904
distance-from-start_max0.16329454211130565
distance-from-start_mean0.16329454211130565
distance-from-start_median0.16329454211130565
distance-from-start_min0.16329454211130565
driven_any_max10.388023138051723
driven_any_mean10.388023138051723
driven_any_median10.388023138051723
driven_any_min10.388023138051723
driven_lanedir_consec_max-1.0779943484515069
driven_lanedir_consec_mean-1.0779943484515069
driven_lanedir_consec_min-1.0779943484515069
driven_lanedir_max-1.0779943484515069
driven_lanedir_mean-1.0779943484515069
driven_lanedir_median-1.0779943484515069
driven_lanedir_min-1.0779943484515069
in-drivable-lane_max34.24999999999896
in-drivable-lane_mean34.24999999999896
in-drivable-lane_min34.24999999999896
per-episodes
details{"loop-000-ego0": {"driven_any": 10.388023138051723, "survival_time": 59.99999999999873, "driven_lanedir": -1.0779943484515069, "in-drivable-lane": 34.24999999999896, "deviation-heading": 22.866062602321904, "distance-from-start": 0.16329454211130565, "deviation-center-line": 2.651206897870493, "driven_lanedir_consec": -1.0779943484515069}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12480394Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-testingsim-1of4successnodavinci-stage-02-6.2.500:14:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median43.899999999998826
driven_lanedir_consec_median-1.877426443319486
deviation-center-line_median1.433147459270801


other stats
deviation-center-line_max1.433147459270801
deviation-center-line_mean1.433147459270801
deviation-center-line_min1.433147459270801
deviation-heading_max14.86057601673578
deviation-heading_mean14.86057601673578
deviation-heading_median14.86057601673578
deviation-heading_min14.86057601673578
distance-from-start_max0.19656514824319132
distance-from-start_mean0.19656514824319132
distance-from-start_median0.19656514824319132
distance-from-start_min0.19656514824319132
driven_any_max10.721063841160127
driven_any_mean10.721063841160127
driven_any_median10.721063841160127
driven_any_min10.721063841160127
driven_lanedir_consec_max-1.877426443319486
driven_lanedir_consec_mean-1.877426443319486
driven_lanedir_consec_min-1.877426443319486
driven_lanedir_max-1.877426443319486
driven_lanedir_mean-1.877426443319486
driven_lanedir_median-1.877426443319486
driven_lanedir_min-1.877426443319486
in-drivable-lane_max43.899999999998826
in-drivable-lane_mean43.899999999998826
in-drivable-lane_min43.899999999998826
per-episodes
details{"loop-000-ego0": {"driven_any": 10.721063841160127, "survival_time": 59.99999999999873, "driven_lanedir": -1.877426443319486, "in-drivable-lane": 43.899999999998826, "deviation-heading": 14.86057601673578, "distance-from-start": 0.19656514824319132, "deviation-center-line": 1.433147459270801, "driven_lanedir_consec": -1.877426443319486}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12477395Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-testingsim-0of4successnodavinci-stage-02-6.2.500:02:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.649999999999988
in-drivable-lane_median0.0
driven_lanedir_consec_median-0.01091606038679771
deviation-center-line_median0.19893540455240377


other stats
deviation-center-line_max0.19893540455240377
deviation-center-line_mean0.19893540455240377
deviation-center-line_min0.19893540455240377
deviation-heading_max4.578832601506375
deviation-heading_mean4.578832601506375
deviation-heading_median4.578832601506375
deviation-heading_min4.578832601506375
distance-from-start_max0.1400106794239338
distance-from-start_mean0.1400106794239338
distance-from-start_median0.1400106794239338
distance-from-start_min0.1400106794239338
driven_any_max0.6178749632543953
driven_any_mean0.6178749632543953
driven_any_median0.6178749632543953
driven_any_min0.6178749632543953
driven_lanedir_consec_max-0.01091606038679771
driven_lanedir_consec_mean-0.01091606038679771
driven_lanedir_consec_min-0.01091606038679771
driven_lanedir_max-0.010242685531190787
driven_lanedir_mean-0.010242685531190787
driven_lanedir_median-0.010242685531190787
driven_lanedir_min-0.010242685531190787
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 0.6178749632543953, "survival_time": 5.649999999999988, "driven_lanedir": -0.010242685531190787, "in-drivable-lane": 0.0, "deviation-heading": 4.578832601506375, "distance-from-start": 0.1400106794239338, "deviation-center-line": 0.19893540455240377, "driven_lanedir_consec": -0.01091606038679771}}
simulation-passed1
survival_time_max5.649999999999988
survival_time_mean5.649999999999988
survival_time_min5.649999999999988
No reset possible
12472396Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-testingsim-1of4successnodavinci-stage-02-6.2.500:03:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median17.550000000000114
in-drivable-lane_median9.950000000000076
driven_lanedir_consec_median-0.7525972935171126
deviation-center-line_median0.5321493034133984


other stats
deviation-center-line_max0.5321493034133984
deviation-center-line_mean0.5321493034133984
deviation-center-line_min0.5321493034133984
deviation-heading_max6.483799648079252
deviation-heading_mean6.483799648079252
deviation-heading_median6.483799648079252
deviation-heading_min6.483799648079252
distance-from-start_max0.1850098376140193
distance-from-start_mean0.1850098376140193
distance-from-start_median0.1850098376140193
distance-from-start_min0.1850098376140193
driven_any_max3.086670200096986
driven_any_mean3.086670200096986
driven_any_median3.086670200096986
driven_any_min3.086670200096986
driven_lanedir_consec_max-0.7525972935171126
driven_lanedir_consec_mean-0.7525972935171126
driven_lanedir_consec_min-0.7525972935171126
driven_lanedir_max-0.7525972935171126
driven_lanedir_mean-0.7525972935171126
driven_lanedir_median-0.7525972935171126
driven_lanedir_min-0.7525972935171126
in-drivable-lane_max9.950000000000076
in-drivable-lane_mean9.950000000000076
in-drivable-lane_min9.950000000000076
per-episodes
details{"udem1-000-ego0": {"driven_any": 3.086670200096986, "survival_time": 17.550000000000114, "driven_lanedir": -0.7525972935171126, "in-drivable-lane": 9.950000000000076, "deviation-heading": 6.483799648079252, "distance-from-start": 0.1850098376140193, "deviation-center-line": 0.5321493034133984, "driven_lanedir_consec": -0.7525972935171126}}
simulation-passed1
survival_time_max17.550000000000114
survival_time_mean17.550000000000114
survival_time_min17.550000000000114
No reset possible
12467398Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:01:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12462514Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-validationsim-3of4failednodavinci-stage-02-6.2.500:01:11
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12458515Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-validationsim-2of4failednodavinci-stage-02-6.2.500:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12455516Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-validationsim-3of4failednodavinci-stage-02-6.2.500:01:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12451518Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12446519Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-validationsim-1of4failednodavinci-stage-02-6.2.500:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12441519Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-validationsim-3of4failednodavinci-stage-02-6.2.500:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12438520Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-validationsim-1of4failednodavinci-stage-02-6.2.500:01:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12413528Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:23:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.5249999999999901
driven_lanedir_consec_median8.7435900813615
deviation-center-line_median2.982445176787063


other stats
deviation-center-line_max3.6546903167332343
deviation-center-line_mean3.0275211432419
deviation-center-line_min2.49050390266024
deviation-heading_max14.795812502688475
deviation-heading_mean14.02721795286882
deviation-heading_median14.077562496955192
deviation-heading_min13.15793431487642
distance-from-start_max4.475949187976357
distance-from-start_mean3.825467965450247
distance-from-start_median3.777151657129337
distance-from-start_min3.271619359565958
driven_any_max9.899073186981294
driven_any_mean9.339993562044876
driven_any_median9.219066490365948
driven_any_min9.022768080466314
driven_lanedir_consec_max9.225553883590267
driven_lanedir_consec_mean8.790490595936081
driven_lanedir_consec_min8.449228337431052
driven_lanedir_max9.225553883590267
driven_lanedir_mean8.790490595936081
driven_lanedir_median8.7435900813615
driven_lanedir_min8.449228337431052
in-drivable-lane_max1.549999999999912
in-drivable-lane_mean0.649999999999973
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 9.899073186981294, "survival_time": 59.99999999999873, "driven_lanedir": 9.225553883590267, "in-drivable-lane": 0.7499999999999973, "deviation-heading": 14.41312362165588, "distance-from-start": 3.848316470765267, "deviation-center-line": 2.7840010860265263, "driven_lanedir_consec": 9.225553883590267}, "zigzag-000-ego1": {"driven_any": 9.022768080466314, "survival_time": 59.99999999999873, "driven_lanedir": 8.554141776369818, "in-drivable-lane": 0.29999999999998295, "deviation-heading": 14.795812502688475, "distance-from-start": 3.271619359565958, "deviation-center-line": 3.6546903167332343, "driven_lanedir_consec": 8.554141776369818}, "zigzag-000-ego2": {"driven_any": 9.336740663695355, "survival_time": 59.99999999999873, "driven_lanedir": 8.933038386353182, "in-drivable-lane": 0.0, "deviation-heading": 13.15793431487642, "distance-from-start": 3.7059868434934073, "deviation-center-line": 2.49050390266024, "driven_lanedir_consec": 8.933038386353182}, "zigzag-000-ego3": {"driven_any": 9.101392317036542, "survival_time": 59.99999999999873, "driven_lanedir": 8.449228337431052, "in-drivable-lane": 1.549999999999912, "deviation-heading": 13.742001372254505, "distance-from-start": 4.475949187976357, "deviation-center-line": 3.1808892675475997, "driven_lanedir_consec": 8.449228337431052}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12407529Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:04:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median19.650000000000144
in-drivable-lane_median0.0
driven_lanedir_consec_median2.722861203574882
deviation-center-line_median0.7026084810740768


other stats
deviation-center-line_max0.7026084810740768
deviation-center-line_mean0.7026084810740768
deviation-center-line_min0.7026084810740768
deviation-heading_max4.293226045882428
deviation-heading_mean4.293226045882428
deviation-heading_median4.293226045882428
deviation-heading_min4.293226045882428
distance-from-start_max2.425143814173943
distance-from-start_mean2.425143814173943
distance-from-start_median2.425143814173943
distance-from-start_min2.425143814173943
driven_any_max2.8038623788817785
driven_any_mean2.8038623788817785
driven_any_median2.8038623788817785
driven_any_min2.8038623788817785
driven_lanedir_consec_max2.722861203574882
driven_lanedir_consec_mean2.722861203574882
driven_lanedir_consec_min2.722861203574882
driven_lanedir_max2.722861203574882
driven_lanedir_mean2.722861203574882
driven_lanedir_median2.722861203574882
driven_lanedir_min2.722861203574882
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 2.8038623788817785, "survival_time": 19.650000000000144, "driven_lanedir": 2.722861203574882, "in-drivable-lane": 0.0, "deviation-heading": 4.293226045882428, "distance-from-start": 2.425143814173943, "deviation-center-line": 0.7026084810740768, "driven_lanedir_consec": 2.722861203574882}}
simulation-passed1
survival_time_max19.650000000000144
survival_time_mean19.650000000000144
survival_time_min19.650000000000144
No reset possible
12406530Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-validationsim-1of4successnodavinci-stage-02-6.2.500:06:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median22.05000000000018
in-drivable-lane_median1.2500000000000178
driven_lanedir_consec_median3.280773284078366
deviation-center-line_median0.7956975227903527


other stats
deviation-center-line_max0.7956975227903527
deviation-center-line_mean0.7956975227903527
deviation-center-line_min0.7956975227903527
deviation-heading_max4.4117826811274705
deviation-heading_mean4.4117826811274705
deviation-heading_median4.4117826811274705
deviation-heading_min4.4117826811274705
distance-from-start_max2.694394331826788
distance-from-start_mean2.694394331826788
distance-from-start_median2.694394331826788
distance-from-start_min2.694394331826788
driven_any_max3.5242241380865007
driven_any_mean3.5242241380865007
driven_any_median3.5242241380865007
driven_any_min3.5242241380865007
driven_lanedir_consec_max3.280773284078366
driven_lanedir_consec_mean3.280773284078366
driven_lanedir_consec_min3.280773284078366
driven_lanedir_max3.280773284078366
driven_lanedir_mean3.280773284078366
driven_lanedir_median3.280773284078366
driven_lanedir_min3.280773284078366
in-drivable-lane_max1.2500000000000178
in-drivable-lane_mean1.2500000000000178
in-drivable-lane_min1.2500000000000178
per-episodes
details{"loop-000-ego0": {"driven_any": 3.5242241380865007, "survival_time": 22.05000000000018, "driven_lanedir": 3.280773284078366, "in-drivable-lane": 1.2500000000000178, "deviation-heading": 4.4117826811274705, "distance-from-start": 2.694394331826788, "deviation-center-line": 0.7956975227903527, "driven_lanedir_consec": 3.280773284078366}}
simulation-passed1
survival_time_max22.05000000000018
survival_time_mean22.05000000000018
survival_time_min22.05000000000018
No reset possible
12399532Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-validationsim-0of4successnodavinci-stage-02-6.2.500:06:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median9.665757172859092
deviation-center-line_median3.2226816687251825


other stats
deviation-center-line_max3.2226816687251825
deviation-center-line_mean3.2226816687251825
deviation-center-line_min3.2226816687251825
deviation-heading_max16.32465868654159
deviation-heading_mean16.32465868654159
deviation-heading_median16.32465868654159
deviation-heading_min16.32465868654159
distance-from-start_max1.038886227346464
distance-from-start_mean1.038886227346464
distance-from-start_median1.038886227346464
distance-from-start_min1.038886227346464
driven_any_max10.15031724821502
driven_any_mean10.15031724821502
driven_any_median10.15031724821502
driven_any_min10.15031724821502
driven_lanedir_consec_max9.665757172859092
driven_lanedir_consec_mean9.665757172859092
driven_lanedir_consec_min9.665757172859092
driven_lanedir_max9.665757211537144
driven_lanedir_mean9.665757211537144
driven_lanedir_median9.665757211537144
driven_lanedir_min9.665757211537144
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 10.15031724821502, "survival_time": 59.99999999999873, "driven_lanedir": 9.665757211537144, "in-drivable-lane": 0.0, "deviation-heading": 16.32465868654159, "distance-from-start": 1.038886227346464, "deviation-center-line": 3.2226816687251825, "driven_lanedir_consec": 9.665757172859092}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12393533Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:06:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median10.248595983680948
survival_time_median59.99999999999873
deviation-center-line_median2.6544231216198084
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.6544231216198084
deviation-center-line_mean2.6544231216198084
deviation-center-line_min2.6544231216198084
deviation-heading_max10.716995821990132
deviation-heading_mean10.716995821990132
deviation-heading_median10.716995821990132
deviation-heading_min10.716995821990132
distance-from-start_max1.082452117826442
distance-from-start_mean1.082452117826442
distance-from-start_median1.082452117826442
distance-from-start_min1.082452117826442
driven_any_max10.501788303065345
driven_any_mean10.501788303065345
driven_any_median10.501788303065345
driven_any_min10.501788303065345
driven_lanedir_consec_max10.248595983680948
driven_lanedir_consec_mean10.248595983680948
driven_lanedir_consec_min10.248595983680948
driven_lanedir_max10.248595983680948
driven_lanedir_mean10.248595983680948
driven_lanedir_median10.248595983680948
driven_lanedir_min10.248595983680948
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 10.501788303065345, "survival_time": 59.99999999999873, "driven_lanedir": 10.248595983680948, "in-drivable-lane": 0.0, "deviation-heading": 10.716995821990132, "distance-from-start": 1.082452117826442, "deviation-center-line": 2.6544231216198084, "driven_lanedir_consec": 10.248595983680948}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12392535Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-testingsim-3of4failednodavinci-stage-02-6.2.500:02:55
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12382535Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:09:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median27.949999999999292
driven_lanedir_consec_median5.617055239328614
deviation-center-line_median2.2296248144445316


other stats
deviation-center-line_max3.892876744324454
deviation-center-line_mean2.2296248144445316
deviation-center-line_min0.5663728845646099
deviation-heading_max16.716501672385235
deviation-heading_mean10.25367782021588
deviation-heading_median10.25367782021588
deviation-heading_min3.7908539680465263
distance-from-start_max1.8993312254209611
distance-from-start_mean1.5011087543004338
distance-from-start_median1.5011087543004338
distance-from-start_min1.1028862831799064
driven_any_max11.52767490929019
driven_any_mean7.106157482611733
driven_any_median7.106157482611733
driven_any_min2.6846400559332775
driven_lanedir_consec_max9.974518253397145
driven_lanedir_consec_mean5.617055239328614
driven_lanedir_consec_min1.2595922252600855
driven_lanedir_max9.974518253397145
driven_lanedir_mean5.617055239328614
driven_lanedir_median5.617055239328614
driven_lanedir_min1.2595922252600855
in-drivable-lane_max51.64999999999873
in-drivable-lane_mean27.949999999999292
in-drivable-lane_min4.249999999999854
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.6846400559332775, "survival_time": 59.99999999999873, "driven_lanedir": 1.2595922252600855, "in-drivable-lane": 51.64999999999873, "deviation-heading": 3.7908539680465263, "distance-from-start": 1.8993312254209611, "deviation-center-line": 0.5663728845646099, "driven_lanedir_consec": 1.2595922252600855}, "loop2-000-ego1": {"driven_any": 11.52767490929019, "survival_time": 59.99999999999873, "driven_lanedir": 9.974518253397145, "in-drivable-lane": 4.249999999999854, "deviation-heading": 16.716501672385235, "distance-from-start": 1.1028862831799064, "deviation-center-line": 3.892876744324454, "driven_lanedir_consec": 9.974518253397145}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12367537Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-testingsim-0of4successnodavinci-stage-02-6.2.500:14:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.4499999999999176
driven_lanedir_consec_median7.566491358450882
deviation-center-line_median3.6837249346598058


other stats
deviation-center-line_max3.6837249346598058
deviation-center-line_mean3.6837249346598058
deviation-center-line_min3.6837249346598058
deviation-heading_max12.956775847704243
deviation-heading_mean12.956775847704243
deviation-heading_median12.956775847704243
deviation-heading_min12.956775847704243
distance-from-start_max3.2849474008866992
distance-from-start_mean3.2849474008866992
distance-from-start_median3.2849474008866992
distance-from-start_min3.2849474008866992
driven_any_max8.157520910404868
driven_any_mean8.157520910404868
driven_any_median8.157520910404868
driven_any_min8.157520910404868
driven_lanedir_consec_max7.566491358450882
driven_lanedir_consec_mean7.566491358450882
driven_lanedir_consec_min7.566491358450882
driven_lanedir_max7.566491358450882
driven_lanedir_mean7.566491358450882
driven_lanedir_median7.566491358450882
driven_lanedir_min7.566491358450882
in-drivable-lane_max1.4499999999999176
in-drivable-lane_mean1.4499999999999176
in-drivable-lane_min1.4499999999999176
per-episodes
details{"autolab-000-ego0": {"driven_any": 8.157520910404868, "survival_time": 59.99999999999873, "driven_lanedir": 7.566491358450882, "in-drivable-lane": 1.4499999999999176, "deviation-heading": 12.956775847704243, "distance-from-start": 3.2849474008866992, "deviation-center-line": 3.6837249346598058, "driven_lanedir_consec": 7.566491358450882}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12363539Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-testingsim-0of4successnodavinci-stage-02-6.2.500:01:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.649999999999995
in-drivable-lane_median0.0
driven_lanedir_consec_median0.4610058352529951
deviation-center-line_median0.24063063901144244


other stats
deviation-center-line_max0.24063063901144244
deviation-center-line_mean0.24063063901144244
deviation-center-line_min0.24063063901144244
deviation-heading_max1.3181346214686465
deviation-heading_mean1.3181346214686465
deviation-heading_median1.3181346214686465
deviation-heading_min1.3181346214686465
distance-from-start_max0.466905765692663
distance-from-start_mean0.466905765692663
distance-from-start_median0.466905765692663
distance-from-start_min0.466905765692663
driven_any_max0.4875070181075725
driven_any_mean0.4875070181075725
driven_any_median0.4875070181075725
driven_any_min0.4875070181075725
driven_lanedir_consec_max0.4610058352529951
driven_lanedir_consec_mean0.4610058352529951
driven_lanedir_consec_min0.4610058352529951
driven_lanedir_max0.4610058352529951
driven_lanedir_mean0.4610058352529951
driven_lanedir_median0.4610058352529951
driven_lanedir_min0.4610058352529951
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 0.4875070181075725, "survival_time": 3.649999999999995, "driven_lanedir": 0.4610058352529951, "in-drivable-lane": 0.0, "deviation-heading": 1.3181346214686465, "distance-from-start": 0.466905765692663, "deviation-center-line": 0.24063063901144244, "driven_lanedir_consec": 0.4610058352529951}}
simulation-passed1
survival_time_max3.649999999999995
survival_time_mean3.649999999999995
survival_time_min3.649999999999995
No reset possible
12347542Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-testingsim-0of4successnodavinci-stage-02-6.2.500:19:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.3499999999999801
driven_lanedir_consec_median3.45527694591659
deviation-center-line_median4.683115934591801


other stats
deviation-center-line_max7.721779963391045
deviation-center-line_mean4.942659505487548
deviation-center-line_min2.6826261893755463
deviation-heading_max41.08347159330458
deviation-heading_mean25.242670047112902
deviation-heading_median24.06336628070825
deviation-heading_min11.760476033730534
distance-from-start_max3.6389944984155833
distance-from-start_mean2.246820594067877
distance-from-start_median2.150452125007468
distance-from-start_min1.0473836278409892
driven_any_max10.354425808275645
driven_any_mean5.120880985051564
driven_any_median4.0128604281572855
driven_any_min2.103377275616041
driven_lanedir_consec_max9.229415862151438
driven_lanedir_consec_mean4.5391679711571165
driven_lanedir_consec_min2.016702130643848
driven_lanedir_max9.82234537719802
driven_lanedir_mean4.77730947496232
driven_lanedir_median3.6350951960037063
driven_lanedir_min2.016702130643848
in-drivable-lane_max2.250000000000032
in-drivable-lane_mean0.737499999999998
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 2.103377275616041, "survival_time": 59.99999999999873, "driven_lanedir": 2.016702130643848, "in-drivable-lane": 0.0, "deviation-heading": 41.08347159330458, "distance-from-start": 1.0473836278409892, "deviation-center-line": 5.559202381179099, "driven_lanedir_consec": 2.016702130643848}, "udem-000-ego1": {"driven_any": 10.354425808275645, "survival_time": 59.99999999999873, "driven_lanedir": 9.82234537719802, "in-drivable-lane": 0.6999999999999602, "deviation-heading": 11.760476033730534, "distance-from-start": 3.6389944984155833, "deviation-center-line": 2.6826261893755463, "driven_lanedir_consec": 9.229415862151438}, "udem-000-ego2": {"driven_any": 3.929653548620874, "survival_time": 59.99999999999873, "driven_lanedir": 3.7714541472320406, "in-drivable-lane": 0.0, "deviation-heading": 19.322834984867335, "distance-from-start": 2.1975062839999135, "deviation-center-line": 3.807029488004503, "driven_lanedir_consec": 3.442597562168343}, "udem-000-ego3": {"driven_any": 4.096067307693697, "survival_time": 59.99999999999873, "driven_lanedir": 3.498736244775372, "in-drivable-lane": 2.250000000000032, "deviation-heading": 28.803897576549172, "distance-from-start": 2.103397966015022, "deviation-center-line": 7.721779963391045, "driven_lanedir_consec": 3.467956329664837}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12337603Bea Baselines 🐤template-rosaido-LFV_multi-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:03:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.299999999999989
in-drivable-lane_median3.7999999999999887
driven_lanedir_consec_median0.34520418263342745
deviation-center-line_median0.09787189380621825


other stats
deviation-center-line_max0.32382470547385456
deviation-center-line_mean0.14229522905407552
deviation-center-line_min0.04961242313001098
deviation-heading_max0.6852841243969109
deviation-heading_mean0.585197280998131
deviation-heading_median0.5916511764563824
deviation-heading_min0.47220264668284817
distance-from-start_max1.3193632294985531
distance-from-start_mean1.0189430172385114
distance-from-start_median1.1106368340700092
distance-from-start_min0.535135171315474
driven_any_max1.368176758442511
driven_any_mean1.0415669566374448
driven_any_median1.1295957874762816
driven_any_min0.5388994931547046
driven_lanedir_consec_max0.7932588934237446
driven_lanedir_consec_mean0.40460610987041434
driven_lanedir_consec_min0.134757180791058
driven_lanedir_max0.7932588934237446
driven_lanedir_mean0.40460610987041434
driven_lanedir_median0.34520418263342745
driven_lanedir_min0.134757180791058
in-drivable-lane_max4.449999999999989
in-drivable-lane_mean3.5874999999999897
in-drivable-lane_min2.299999999999992
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.1145856237300056, "survival_time": 5.299999999999989, "driven_lanedir": 0.7932588934237446, "in-drivable-lane": 2.299999999999992, "deviation-heading": 0.6828921720026202, "distance-from-start": 1.0846004860100278, "deviation-center-line": 0.32382470547385456, "driven_lanedir_consec": 0.7932588934237446}, "zigzag-000-ego1": {"driven_any": 1.1446059512225577, "survival_time": 5.299999999999989, "driven_lanedir": 0.28669619281947845, "in-drivable-lane": 3.899999999999989, "deviation-heading": 0.6852841243969109, "distance-from-start": 1.1366731821299907, "deviation-center-line": 0.0924559215959079, "driven_lanedir_consec": 0.28669619281947845}, "zigzag-000-ego2": {"driven_any": 1.368176758442511, "survival_time": 5.299999999999989, "driven_lanedir": 0.4037121724473765, "in-drivable-lane": 3.6999999999999886, "deviation-heading": 0.5004101809101447, "distance-from-start": 1.3193632294985531, "deviation-center-line": 0.10328786601652858, "driven_lanedir_consec": 0.4037121724473765}, "zigzag-000-ego3": {"driven_any": 0.5388994931547046, "survival_time": 5.299999999999989, "driven_lanedir": 0.134757180791058, "in-drivable-lane": 4.449999999999989, "deviation-heading": 0.47220264668284817, "distance-from-start": 0.535135171315474, "deviation-center-line": 0.04961242313001098, "driven_lanedir_consec": 0.134757180791058}}
simulation-passed1
survival_time_max5.299999999999989
survival_time_mean5.299999999999989
survival_time_min5.299999999999989
No reset possible
12332603Bea Baselines 🐤template-rosaido-LFV_multi-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:04:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.349999999999998
in-drivable-lane_median7.899999999999997
driven_lanedir_consec_median0.28315520219940393
deviation-center-line_median0.0919637433597932


other stats
deviation-center-line_max0.1637782232973536
deviation-center-line_mean0.1002647598818004
deviation-center-line_min0.05335332951026152
deviation-heading_max0.7835920963246447
deviation-heading_mean0.6063704641504419
deviation-heading_median0.5673149889556202
deviation-heading_min0.5072597823658829
distance-from-start_max2.5308427360691206
distance-from-start_mean1.303296009580949
distance-from-start_median1.0890469351554155
distance-from-start_min0.5042474319438444
driven_any_max2.6455508933126053
driven_any_mean1.3406055564546844
driven_any_median1.1059420240674198
driven_any_min0.5049872843712927
driven_lanedir_consec_max0.6466642350547298
driven_lanedir_consec_mean0.3437508521851351
driven_lanedir_consec_min0.16202876928700283
driven_lanedir_max0.6466642350547298
driven_lanedir_mean0.3437508521851351
driven_lanedir_median0.28315520219940393
driven_lanedir_min0.16202876928700283
in-drivable-lane_max8.399999999999999
in-drivable-lane_mean7.737499999999998
in-drivable-lane_min6.749999999999999
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.5049872843712927, "survival_time": 9.349999999999998, "driven_lanedir": 0.16202876928700283, "in-drivable-lane": 8.399999999999999, "deviation-heading": 0.5808491680150456, "distance-from-start": 0.5042474319438444, "deviation-center-line": 0.05335332951026152, "driven_lanedir_consec": 0.16202876928700283}, "zigzag-000-ego1": {"driven_any": 1.5231093752669602, "survival_time": 9.349999999999998, "driven_lanedir": 0.38297631920465114, "in-drivable-lane": 7.549999999999997, "deviation-heading": 0.7835920963246447, "distance-from-start": 1.4959638947715324, "deviation-center-line": 0.11943394005830088, "driven_lanedir_consec": 0.38297631920465114}, "zigzag-000-ego2": {"driven_any": 2.6455508933126053, "survival_time": 9.349999999999998, "driven_lanedir": 0.6466642350547298, "in-drivable-lane": 6.749999999999999, "deviation-heading": 0.5537808098961948, "distance-from-start": 2.5308427360691206, "deviation-center-line": 0.1637782232973536, "driven_lanedir_consec": 0.6466642350547298}, "zigzag-000-ego3": {"driven_any": 0.6887746728678794, "survival_time": 9.349999999999998, "driven_lanedir": 0.18333408519415673, "in-drivable-lane": 8.249999999999996, "deviation-heading": 0.5072597823658829, "distance-from-start": 0.6821299755392991, "deviation-center-line": 0.06449354666128557, "driven_lanedir_consec": 0.18333408519415673}}
simulation-passed1
survival_time_max9.349999999999998
survival_time_mean9.349999999999998
survival_time_min9.349999999999998
No reset possible
12327604Bea Baselines 🐤template-rosaido-LFP-sim-validationsim-0of4successnodavinci-stage-02-6.2.500:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.199999999999993
in-drivable-lane_median2.8999999999999924
driven_lanedir_consec_median0.2468272740485764
deviation-center-line_median0.09664368391667125


other stats
deviation-center-line_max0.09664368391667125
deviation-center-line_mean0.09664368391667125
deviation-center-line_min0.09664368391667125
deviation-heading_max0.6317527905396324
deviation-heading_mean0.6317527905396324
deviation-heading_median0.6317527905396324
deviation-heading_min0.6317527905396324
distance-from-start_max0.9025767215785736
distance-from-start_mean0.9025767215785736
distance-from-start_median0.9025767215785736
distance-from-start_min0.9025767215785736
driven_any_max0.904739343737537
driven_any_mean0.904739343737537
driven_any_median0.904739343737537
driven_any_min0.904739343737537
driven_lanedir_consec_max0.2468272740485764
driven_lanedir_consec_mean0.2468272740485764
driven_lanedir_consec_min0.2468272740485764
driven_lanedir_max0.2468272740485764
driven_lanedir_mean0.2468272740485764
driven_lanedir_median0.2468272740485764
driven_lanedir_min0.2468272740485764
in-drivable-lane_max2.8999999999999924
in-drivable-lane_mean2.8999999999999924
in-drivable-lane_min2.8999999999999924
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.904739343737537, "survival_time": 4.199999999999993, "driven_lanedir": 0.2468272740485764, "in-drivable-lane": 2.8999999999999924, "deviation-heading": 0.6317527905396324, "distance-from-start": 0.9025767215785736, "deviation-center-line": 0.09664368391667125, "driven_lanedir_consec": 0.2468272740485764}}
simulation-passed1
survival_time_max4.199999999999993
survival_time_mean4.199999999999993
survival_time_min4.199999999999993
No reset possible
12321605Bea Baselines 🐤template-rosaido-LFV-sim-validationsim-1of4successnodavinci-stage-02-6.2.500:03:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.1999999999999966
in-drivable-lane_median2.2999999999999963
driven_lanedir_consec_median0.15284938370717427
deviation-center-line_median0.049395039966434656


other stats
deviation-center-line_max0.049395039966434656
deviation-center-line_mean0.049395039966434656
deviation-center-line_min0.049395039966434656
deviation-heading_max0.5567148112733814
deviation-heading_mean0.5567148112733814
deviation-heading_median0.5567148112733814
deviation-heading_min0.5567148112733814
distance-from-start_max0.6807368303329573
distance-from-start_mean0.6807368303329573
distance-from-start_median0.6807368303329573
distance-from-start_min0.6807368303329573
driven_any_max0.6915816697815963
driven_any_mean0.6915816697815963
driven_any_median0.6915816697815963
driven_any_min0.6915816697815963
driven_lanedir_consec_max0.15284938370717427
driven_lanedir_consec_mean0.15284938370717427
driven_lanedir_consec_min0.15284938370717427
driven_lanedir_max0.15284938370717427
driven_lanedir_mean0.15284938370717427
driven_lanedir_median0.15284938370717427
driven_lanedir_min0.15284938370717427
in-drivable-lane_max2.2999999999999963
in-drivable-lane_mean2.2999999999999963
in-drivable-lane_min2.2999999999999963
per-episodes
details{"loop-000-ego0": {"driven_any": 0.6915816697815963, "survival_time": 3.1999999999999966, "driven_lanedir": 0.15284938370717427, "in-drivable-lane": 2.2999999999999963, "deviation-heading": 0.5567148112733814, "distance-from-start": 0.6807368303329573, "deviation-center-line": 0.049395039966434656, "driven_lanedir_consec": 0.15284938370717427}}
simulation-passed1
survival_time_max3.1999999999999966
survival_time_mean3.1999999999999966
survival_time_min3.1999999999999966
No reset possible
12314605Bea Baselines 🐤template-rosaido-LFV-sim-validationsim-1of4successnodavinci-stage-02-6.2.500:03:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.15000000000001
in-drivable-lane_median8.100000000000012
driven_lanedir_consec_median0.3727675432988948
deviation-center-line_median0.16966830809729366


other stats
deviation-center-line_max0.16966830809729366
deviation-center-line_mean0.16966830809729366
deviation-center-line_min0.16966830809729366
deviation-heading_max1.4334890703947762
deviation-heading_mean1.4334890703947762
deviation-heading_median1.4334890703947762
deviation-heading_min1.4334890703947762
distance-from-start_max2.381204921209183
distance-from-start_mean2.381204921209183
distance-from-start_median2.381204921209183
distance-from-start_min2.381204921209183
driven_any_max2.6679566172882883
driven_any_mean2.6679566172882883
driven_any_median2.6679566172882883
driven_any_min2.6679566172882883
driven_lanedir_consec_max0.3727675432988948
driven_lanedir_consec_mean0.3727675432988948
driven_lanedir_consec_min0.3727675432988948
driven_lanedir_max0.3727675432988948
driven_lanedir_mean0.3727675432988948
driven_lanedir_median0.3727675432988948
driven_lanedir_min0.3727675432988948
in-drivable-lane_max8.100000000000012
in-drivable-lane_mean8.100000000000012
in-drivable-lane_min8.100000000000012
per-episodes
details{"loop-000-ego0": {"driven_any": 2.6679566172882883, "survival_time": 10.15000000000001, "driven_lanedir": 0.3727675432988948, "in-drivable-lane": 8.100000000000012, "deviation-heading": 1.4334890703947762, "distance-from-start": 2.381204921209183, "deviation-center-line": 0.16966830809729366, "driven_lanedir_consec": 0.3727675432988948}}
simulation-passed1
survival_time_max10.15000000000001
survival_time_mean10.15000000000001
survival_time_min10.15000000000001
No reset possible
12309606Bea Baselines 🐤template-rosaido-LFVI-sim-validationsim-0of4host-errornodavinci-stage-02-6.2.500:01:21
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12301609Bea Baselines 🐤template-rosaido-LFVI_multi-sim-validationsim-1of4successnodavinci-stage-02-6.2.500:03:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.549999999999981
in-drivable-lane_median5.749999999999982
driven_lanedir_consec_median0.3205535830624803
deviation-center-line_median0.1316364057038443


other stats
deviation-center-line_max0.14214714239396029
deviation-center-line_mean0.12070954134729048
deviation-center-line_min0.07741821158751298
deviation-heading_max1.912615931656283
deviation-heading_mean0.9135457095825414
deviation-heading_median0.6717969151305802
deviation-heading_min0.3979730764127222
distance-from-start_max1.818900162062245
distance-from-start_mean1.1614026543635148
distance-from-start_median1.2312017707204306
distance-from-start_min0.3643069139509535
driven_any_max1.9710806714412237
driven_any_mean1.234783962180296
driven_any_median1.3016819019845616
driven_any_min0.3646913733108379
driven_lanedir_consec_max0.7213363941916915
driven_lanedir_consec_mean0.3778647921894907
driven_lanedir_consec_min0.1490156084413108
driven_lanedir_max0.7270990592658897
driven_lanedir_mean0.37930545845804026
driven_lanedir_median0.3205535830624803
driven_lanedir_min0.1490156084413108
in-drivable-lane_max6.599999999999981
in-drivable-lane_mean5.624999999999982
in-drivable-lane_min4.399999999999984
per-episodes
details{"4way-000-ego0": {"driven_any": 1.9710806714412237, "survival_time": 7.549999999999981, "driven_lanedir": 0.16052426067376313, "in-drivable-lane": 5.749999999999984, "deviation-heading": 1.912615931656283, "distance-from-start": 1.818900162062245, "deviation-center-line": 0.13956010900178045, "driven_lanedir_consec": 0.16052426067376313}, "4way-000-ego1": {"driven_any": 0.3646913733108379, "survival_time": 7.549999999999981, "driven_lanedir": 0.1490156084413108, "in-drivable-lane": 6.599999999999981, "deviation-heading": 0.5063809811905815, "distance-from-start": 0.3643069139509535, "deviation-center-line": 0.07741821158751298, "driven_lanedir_consec": 0.1490156084413108}, "4way-000-ego2": {"driven_any": 1.2605651509240523, "survival_time": 7.549999999999981, "driven_lanedir": 0.4805829054511974, "in-drivable-lane": 5.7499999999999805, "deviation-heading": 0.3979730764127222, "distance-from-start": 1.2063057107323387, "deviation-center-line": 0.12371270240590812, "driven_lanedir_consec": 0.4805829054511974}, "4way-000-ego3": {"driven_any": 1.3427986530450708, "survival_time": 7.549999999999981, "driven_lanedir": 0.7270990592658897, "in-drivable-lane": 4.399999999999984, "deviation-heading": 0.8372128490705788, "distance-from-start": 1.2560978307085222, "deviation-center-line": 0.14214714239396029, "driven_lanedir_consec": 0.7213363941916915}}
simulation-passed1
survival_time_max7.549999999999981
survival_time_mean7.549999999999981
survival_time_min7.549999999999981
No reset possible
12293610Bea Baselines 🐤template-rosaido-LFV_multi-sim-testingsim-0of4successnodavinci-stage-02-6.2.500:04:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.700000000000015
in-drivable-lane_median8.850000000000017
driven_lanedir_consec_median0.43390054877372375
deviation-center-line_median0.17340799650553967


other stats
deviation-center-line_max0.40240244556535576
deviation-center-line_mean0.20427209921368317
deviation-center-line_min0.0678699582782975
deviation-heading_max2.410435478615306
deviation-heading_mean1.020430755114149
deviation-heading_median0.5854956927435755
deviation-heading_min0.5002961563541387
distance-from-start_max2.8277830399519517
distance-from-start_mean1.6239670535887087
distance-from-start_median1.717088780976367
distance-from-start_min0.23390761245014904
driven_any_max2.9354299752945217
driven_any_mean1.6781822894586047
driven_any_median1.7716750272319666
driven_any_min0.2339491280759644
driven_lanedir_consec_max0.963890891913767
driven_lanedir_consec_mean0.4868973089989085
driven_lanedir_consec_min0.11589724653441946
driven_lanedir_max0.9924621916920726
driven_lanedir_mean0.4940401339434849
driven_lanedir_median0.43390054877372375
driven_lanedir_min0.11589724653441946
in-drivable-lane_max9.900000000000016
in-drivable-lane_mean8.43750000000002
in-drivable-lane_min6.150000000000026
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.85987153832284, "survival_time": 10.700000000000015, "driven_lanedir": 0.17304717527728908, "in-drivable-lane": 9.650000000000016, "deviation-heading": 0.6176567312959803, "distance-from-start": 1.7750615636965237, "deviation-center-line": 0.07227527626388479, "driven_lanedir_consec": 0.17304717527728908}, "autolab-000-ego1": {"driven_any": 1.6834785161410928, "survival_time": 10.700000000000015, "driven_lanedir": 0.6947539222701584, "in-drivable-lane": 8.050000000000018, "deviation-heading": 0.5533346541911707, "distance-from-start": 1.6591159982562107, "deviation-center-line": 0.27454071674719455, "driven_lanedir_consec": 0.6947539222701584}, "autolab-000-ego2": {"driven_any": 2.9354299752945217, "survival_time": 10.700000000000015, "driven_lanedir": 0.9924621916920726, "in-drivable-lane": 6.150000000000026, "deviation-heading": 2.410435478615306, "distance-from-start": 2.8277830399519517, "deviation-center-line": 0.40240244556535576, "driven_lanedir_consec": 0.963890891913767}, "autolab-000-ego3": {"driven_any": 0.2339491280759644, "survival_time": 10.700000000000015, "driven_lanedir": 0.11589724653441946, "in-drivable-lane": 9.900000000000016, "deviation-heading": 0.5002961563541387, "distance-from-start": 0.23390761245014904, "deviation-center-line": 0.0678699582782975, "driven_lanedir_consec": 0.11589724653441946}}
simulation-passed1
survival_time_max10.700000000000015
survival_time_mean10.700000000000015
survival_time_min10.700000000000015
No reset possible
12288612Bea Baselines 🐤template-rosaido-LFV-sim-testingsim-1of4successnodavinci-stage-02-6.2.500:02:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.2999999999999963
in-drivable-lane_median2.399999999999996
driven_lanedir_consec_median0.11493257442130744
deviation-center-line_median0.0611432122460956


other stats
deviation-center-line_max0.0611432122460956
deviation-center-line_mean0.0611432122460956
deviation-center-line_min0.0611432122460956
deviation-heading_max0.6854504487028947
deviation-heading_mean0.6854504487028947
deviation-heading_median0.6854504487028947
deviation-heading_min0.6854504487028947
distance-from-start_max0.6509946694385252
distance-from-start_mean0.6509946694385252
distance-from-start_median0.6509946694385252
distance-from-start_min0.6509946694385252
driven_any_max0.6748140526235802
driven_any_mean0.6748140526235802
driven_any_median0.6748140526235802
driven_any_min0.6748140526235802
driven_lanedir_consec_max0.11493257442130744
driven_lanedir_consec_mean0.11493257442130744
driven_lanedir_consec_min0.11493257442130744
driven_lanedir_max0.11493257442130744
driven_lanedir_mean0.11493257442130744
driven_lanedir_median0.11493257442130744
driven_lanedir_min0.11493257442130744
in-drivable-lane_max2.399999999999996
in-drivable-lane_mean2.399999999999996
in-drivable-lane_min2.399999999999996
per-episodes
details{"loop-000-ego0": {"driven_any": 0.6748140526235802, "survival_time": 3.2999999999999963, "driven_lanedir": 0.11493257442130744, "in-drivable-lane": 2.399999999999996, "deviation-heading": 0.6854504487028947, "distance-from-start": 0.6509946694385252, "deviation-center-line": 0.0611432122460956, "driven_lanedir_consec": 0.11493257442130744}}
simulation-passed1
survival_time_max3.2999999999999963
survival_time_mean3.2999999999999963
survival_time_min3.2999999999999963
No reset possible
12283613Bea Baselines 🐤template-rosaido-LFVI-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:01:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12281614Bea Baselines 🐤template-rosaido-LFI-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12275615Bea Baselines 🐤template-rosaido-LF-sim-testingsim-0of4successnodavinci-stage-02-6.2.500:02:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5110843590749194
survival_time_median20.300000000000153
deviation-center-line_median0.3206878828054935
in-drivable-lane_median16.800000000000125


other stats
deviation-center-line_max0.3206878828054935
deviation-center-line_mean0.3206878828054935
deviation-center-line_min0.3206878828054935
deviation-heading_max3.3790232535043776
deviation-heading_mean3.3790232535043776
deviation-heading_median3.3790232535043776
deviation-heading_min3.3790232535043776
distance-from-start_max4.609766975362213
distance-from-start_mean4.609766975362213
distance-from-start_median4.609766975362213
distance-from-start_min4.609766975362213
driven_any_max5.479750398262754
driven_any_mean5.479750398262754
driven_any_median5.479750398262754
driven_any_min5.479750398262754
driven_lanedir_consec_max0.5110843590749194
driven_lanedir_consec_mean0.5110843590749194
driven_lanedir_consec_min0.5110843590749194
driven_lanedir_max0.5110843590749194
driven_lanedir_mean0.5110843590749194
driven_lanedir_median0.5110843590749194
driven_lanedir_min0.5110843590749194
in-drivable-lane_max16.800000000000125
in-drivable-lane_mean16.800000000000125
in-drivable-lane_min16.800000000000125
per-episodes
details{"autolab-000-ego0": {"driven_any": 5.479750398262754, "survival_time": 20.300000000000153, "driven_lanedir": 0.5110843590749194, "in-drivable-lane": 16.800000000000125, "deviation-heading": 3.3790232535043776, "distance-from-start": 4.609766975362213, "deviation-center-line": 0.3206878828054935, "driven_lanedir_consec": 0.5110843590749194}}
simulation-passed1
survival_time_max20.300000000000153
survival_time_mean20.300000000000153
survival_time_min20.300000000000153
No reset possible
12262618Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-validationsim-1of4successnodavinci-stage-02-6.2.500:21:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median12.899999999999514
driven_lanedir_consec_median4.221895462881242
deviation-center-line_median3.094981181352746


other stats
deviation-center-line_max3.8687861747531063
deviation-center-line_mean2.6274348758472827
deviation-center-line_min0.4509909659305318
deviation-heading_max17.747166911908916
deviation-heading_mean11.875098787272004
deviation-heading_median13.91163231296382
deviation-heading_min1.929963611251452
distance-from-start_max2.7919695087164795
distance-from-start_mean2.0256390374392
distance-from-start_median2.242498079753368
distance-from-start_min0.8255904815335846
driven_any_max7.913742055235132
driven_any_mean6.280691818514453
driven_any_median7.913475317973762
driven_any_min1.382074582875154
driven_lanedir_consec_max5.420904988182704
driven_lanedir_consec_mean3.6938713231509186
driven_lanedir_consec_min0.9107893786584866
driven_lanedir_max5.931538125898758
driven_lanedir_mean4.520897904531085
driven_lanedir_median5.620632056783548
driven_lanedir_min0.9107893786584866
in-drivable-lane_max52.19999999999875
in-drivable-lane_mean21.799999999999397
in-drivable-lane_min9.199999999999807
per-episodes
details{"loop-000-ego0": {"driven_any": 7.913634500376531, "survival_time": 59.99999999999873, "driven_lanedir": 5.608962662487706, "in-drivable-lane": 13.0499999999996, "deviation-heading": 13.678992969278504, "distance-from-start": 2.028925570404128, "deviation-center-line": 3.1397757737579512, "driven_lanedir_consec": 5.420904988182704}, "loop-000-ego1": {"driven_any": 7.913316135570994, "survival_time": 59.99999999999873, "driven_lanedir": 5.931538125898758, "in-drivable-lane": 9.199999999999807, "deviation-heading": 17.747166911908916, "distance-from-start": 2.7919695087164795, "deviation-center-line": 3.8687861747531063, "driven_lanedir_consec": 4.368234811278029}, "loop-000-ego2": {"driven_any": 1.382074582875154, "survival_time": 59.99999999999873, "driven_lanedir": 0.9107893786584866, "in-drivable-lane": 52.19999999999875, "deviation-heading": 1.929963611251452, "distance-from-start": 0.8255904815335846, "deviation-center-line": 0.4509909659305318, "driven_lanedir_consec": 0.9107893786584866}, "loop-000-ego3": {"driven_any": 7.913742055235132, "survival_time": 59.99999999999873, "driven_lanedir": 5.632301451079391, "in-drivable-lane": 12.749999999999428, "deviation-heading": 14.144271656649137, "distance-from-start": 2.4560705891026084, "deviation-center-line": 3.050186588947541, "driven_lanedir_consec": 4.0755561144844545}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12253620Bea Baselines 🐤baseline-duckietownaido-LFV-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:11:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median40.59999999999983
in-drivable-lane_median9.850000000000062
driven_lanedir_consec_median1.7165491775520063
deviation-center-line_median2.4566477995214044


other stats
deviation-center-line_max2.4566477995214044
deviation-center-line_mean2.4566477995214044
deviation-center-line_min2.4566477995214044
deviation-heading_max10.60375557292471
deviation-heading_mean10.60375557292471
deviation-heading_median10.60375557292471
deviation-heading_min10.60375557292471
distance-from-start_max1.4600389577240835
distance-from-start_mean1.4600389577240835
distance-from-start_median1.4600389577240835
distance-from-start_min1.4600389577240835
driven_any_max5.245203806361594
driven_any_mean5.245203806361594
driven_any_median5.245203806361594
driven_any_min5.245203806361594
driven_lanedir_consec_max1.7165491775520063
driven_lanedir_consec_mean1.7165491775520063
driven_lanedir_consec_min1.7165491775520063
driven_lanedir_max3.615231600931488
driven_lanedir_mean3.615231600931488
driven_lanedir_median3.615231600931488
driven_lanedir_min3.615231600931488
in-drivable-lane_max9.850000000000062
in-drivable-lane_mean9.850000000000062
in-drivable-lane_min9.850000000000062
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.245203806361594, "survival_time": 40.59999999999983, "driven_lanedir": 3.615231600931488, "in-drivable-lane": 9.850000000000062, "deviation-heading": 10.60375557292471, "distance-from-start": 1.4600389577240835, "deviation-center-line": 2.4566477995214044, "driven_lanedir_consec": 1.7165491775520063}}
simulation-passed1
survival_time_max40.59999999999983
survival_time_mean40.59999999999983
survival_time_min40.59999999999983
No reset possible
12251621Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12248622Bea Baselines 🐤baseline-duckietownaido-LFI-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:02:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12239625Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-testingsim-0of4successnodavinci-stage-02-6.2.500:16:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median39.3499999999999
in-drivable-lane_median28.324999999999875
driven_lanedir_consec_median1.2319253557046597
deviation-center-line_median0.5773479067247473


other stats
deviation-center-line_max1.886215839903948
deviation-center-line_mean0.8270238888262438
deviation-center-line_min0.26718390195153263
deviation-heading_max14.856562092694409
deviation-heading_mean6.285008352804972
deviation-heading_median3.884299120484252
deviation-heading_min2.5148730775569783
distance-from-start_max1.4813019684561346
distance-from-start_mean1.0445821458773
distance-from-start_median0.9746724510342616
distance-from-start_min0.7476817129845421
driven_any_max5.07865538546195
driven_any_mean3.331545836379684
driven_any_median3.32989927310566
driven_any_min1.5877294138454652
driven_lanedir_consec_max1.7868880772666464
driven_lanedir_consec_mean1.1497830725099834
driven_lanedir_consec_min0.34839350136396785
driven_lanedir_max2.169871477501309
driven_lanedir_mean1.245528922568649
driven_lanedir_median1.2319253557046597
driven_lanedir_min0.34839350136396785
in-drivable-lane_max35.149999999999906
in-drivable-lane_mean27.08749999999985
in-drivable-lane_min16.54999999999974
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.733722999845846, "survival_time": 39.3499999999999, "driven_lanedir": 0.34839350136396785, "in-drivable-lane": 35.149999999999906, "deviation-heading": 2.996943195853542, "distance-from-start": 0.7476817129845421, "deviation-center-line": 0.26718390195153263, "driven_lanedir_consec": 0.34839350136396785}, "autolab-000-ego1": {"driven_any": 1.5877294138454652, "survival_time": 39.3499999999999, "driven_lanedir": 0.7874920936654655, "in-drivable-lane": 32.34999999999992, "deviation-heading": 2.5148730775569783, "distance-from-start": 0.7536587637856422, "deviation-center-line": 0.48117641792552457, "driven_lanedir_consec": 0.7874920936654655}, "autolab-000-ego2": {"driven_any": 4.926075546365474, "survival_time": 39.3499999999999, "driven_lanedir": 1.676358617743854, "in-drivable-lane": 24.299999999999823, "deviation-heading": 4.771655045114962, "distance-from-start": 1.4813019684561346, "deviation-center-line": 0.67351939552397, "driven_lanedir_consec": 1.676358617743854}, "autolab-000-ego3": {"driven_any": 5.07865538546195, "survival_time": 39.3499999999999, "driven_lanedir": 2.169871477501309, "in-drivable-lane": 16.54999999999974, "deviation-heading": 14.856562092694409, "distance-from-start": 1.1956861382828812, "deviation-center-line": 1.886215839903948, "driven_lanedir_consec": 1.7868880772666464}}
simulation-passed1
survival_time_max39.3499999999999
survival_time_mean39.3499999999999
survival_time_min39.3499999999999
No reset possible
12235626Bea Baselines 🐤baseline-duckietownaido-LFP-sim-testingsim-0of4successnodavinci-stage-02-6.2.500:04:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median33.45000000000024
in-drivable-lane_median4.4000000000000625
driven_lanedir_consec_median3.589630725424493
deviation-center-line_median1.959976671109697


other stats
deviation-center-line_max1.959976671109697
deviation-center-line_mean1.959976671109697
deviation-center-line_min1.959976671109697
deviation-heading_max5.138044517623638
deviation-heading_mean5.138044517623638
deviation-heading_median5.138044517623638
deviation-heading_min5.138044517623638
distance-from-start_max2.757819549196233
distance-from-start_mean2.757819549196233
distance-from-start_median2.757819549196233
distance-from-start_min2.757819549196233
driven_any_max4.2964278076783256
driven_any_mean4.2964278076783256
driven_any_median4.2964278076783256
driven_any_min4.2964278076783256
driven_lanedir_consec_max3.589630725424493
driven_lanedir_consec_mean3.589630725424493
driven_lanedir_consec_min3.589630725424493
driven_lanedir_max3.589630725424493
driven_lanedir_mean3.589630725424493
driven_lanedir_median3.589630725424493
driven_lanedir_min3.589630725424493
in-drivable-lane_max4.4000000000000625
in-drivable-lane_mean4.4000000000000625
in-drivable-lane_min4.4000000000000625
per-episodes
details{"autolab-000-ego0": {"driven_any": 4.2964278076783256, "survival_time": 33.45000000000024, "driven_lanedir": 3.589630725424493, "in-drivable-lane": 4.4000000000000625, "deviation-heading": 5.138044517623638, "distance-from-start": 2.757819549196233, "deviation-center-line": 1.959976671109697, "driven_lanedir_consec": 3.589630725424493}}
simulation-passed1
survival_time_max33.45000000000024
survival_time_mean33.45000000000024
survival_time_min33.45000000000024
No reset possible
12230627Bea Baselines 🐤baseline-duckietownaido-LFV-sim-testingsim-1of4successnodavinci-stage-02-6.2.500:08:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median39.74999999999988
in-drivable-lane_median0.0
driven_lanedir_consec_median5.080980925227314
deviation-center-line_median1.3841567310963208


other stats
deviation-center-line_max1.3841567310963208
deviation-center-line_mean1.3841567310963208
deviation-center-line_min1.3841567310963208
deviation-heading_max4.206755422504252
deviation-heading_mean4.206755422504252
deviation-heading_median4.206755422504252
deviation-heading_min4.206755422504252
distance-from-start_max2.026911671509816
distance-from-start_mean2.026911671509816
distance-from-start_median2.026911671509816
distance-from-start_min2.026911671509816
driven_any_max5.132979668630304
driven_any_mean5.132979668630304
driven_any_median5.132979668630304
driven_any_min5.132979668630304
driven_lanedir_consec_max5.080980925227314
driven_lanedir_consec_mean5.080980925227314
driven_lanedir_consec_min5.080980925227314
driven_lanedir_max5.080980925227314
driven_lanedir_mean5.080980925227314
driven_lanedir_median5.080980925227314
driven_lanedir_min5.080980925227314
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 5.132979668630304, "survival_time": 39.74999999999988, "driven_lanedir": 5.080980925227314, "in-drivable-lane": 0.0, "deviation-heading": 4.206755422504252, "distance-from-start": 2.026911671509816, "deviation-center-line": 1.3841567310963208, "driven_lanedir_consec": 5.080980925227314}}
simulation-passed1
survival_time_max39.74999999999988
survival_time_mean39.74999999999988
survival_time_min39.74999999999988
No reset possible
12226628Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12223629Bea Baselines 🐤baseline-duckietownaido-LFI-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:01:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12219630Bea Baselines 🐤baseline-duckietownaido-LF-sim-testingsim-0of4successnodavinci-stage-02-6.2.500:05:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.153082395136554
survival_time_median59.99999999999873
deviation-center-line_median5.029170764177764
in-drivable-lane_median9.849999999999726


other stats
deviation-center-line_max5.029170764177764
deviation-center-line_mean5.029170764177764
deviation-center-line_min5.029170764177764
deviation-heading_max12.736436305120964
deviation-heading_mean12.736436305120964
deviation-heading_median12.736436305120964
deviation-heading_min12.736436305120964
distance-from-start_max3.887497086007508
distance-from-start_mean3.887497086007508
distance-from-start_median3.887497086007508
distance-from-start_min3.887497086007508
driven_any_max7.90782221862918
driven_any_mean7.90782221862918
driven_any_median7.90782221862918
driven_any_min7.90782221862918
driven_lanedir_consec_max6.153082395136554
driven_lanedir_consec_mean6.153082395136554
driven_lanedir_consec_min6.153082395136554
driven_lanedir_max6.153082395136554
driven_lanedir_mean6.153082395136554
driven_lanedir_median6.153082395136554
driven_lanedir_min6.153082395136554
in-drivable-lane_max9.849999999999726
in-drivable-lane_mean9.849999999999726
in-drivable-lane_min9.849999999999726
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.90782221862918, "survival_time": 59.99999999999873, "driven_lanedir": 6.153082395136554, "in-drivable-lane": 9.849999999999726, "deviation-heading": 12.736436305120964, "distance-from-start": 3.887497086007508, "deviation-center-line": 5.029170764177764, "driven_lanedir_consec": 6.153082395136554}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12216631Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12210660Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-validationsim-0of4failednodavinci-stage-02-6.2.500:01:12
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12206661Bea Baselines 🐤template-tensorflowaido-LFP-sim-validationsim-2of4failednodavinci-stage-02-6.2.500:01:13
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12202663Bea Baselines 🐤template-tensorflowaido-LFVI-sim-validationsim-0of4failednodavinci-stage-02-6.2.500:01:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12199664Bea Baselines 🐤template-tensorflowaido-LFI-sim-validationsim-0of4failednodavinci-stage-02-6.2.500:01:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12195665Bea Baselines 🐤template-tensorflowaido-LF-sim-validationsim-1of4failednodavinci-stage-02-6.2.500:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12189666Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-validationsim-0of4failednodavinci-stage-02-6.2.500:01:20
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12185667Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-testingsim-2of4failednodavinci-stage-02-6.2.500:01:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12180669Bea Baselines 🐤template-tensorflowaido-LFV-sim-testingsim-1of4failednodavinci-stage-02-6.2.500:01:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12177669Bea Baselines 🐤template-tensorflowaido-LFV-sim-testingsim-3of4failednodavinci-stage-02-6.2.500:01:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12173671Bea Baselines 🐤template-tensorflowaido-LFI-sim-testingsim-1of4failednodavinci-stage-02-6.2.500:01:46
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12170671Bea Baselines 🐤template-tensorflowaido-LFI-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:02:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12169671Bea Baselines 🐤template-tensorflowaido-LFI-sim-testingsim-0of4failednodavinci-stage-02-6.2.500:01:24
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12167673Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-testingsim-1of4failednodavinci-stage-02-6.2.500:01:16
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12165673Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12159703Bea Baselines 🐤template-randomaido-LFV_multi-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:06:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median29.000000000000277
in-drivable-lane_median20.025000000000247
driven_lanedir_consec_median0.23004863869940056
deviation-center-line_median0.7278799269429306


other stats
deviation-center-line_max0.8194317074657906
deviation-center-line_mean0.7278799269429306
deviation-center-line_min0.6363281464200705
deviation-heading_max6.73261632177244
deviation-heading_mean6.633830808409963
deviation-heading_median6.633830808409963
deviation-heading_min6.535045295047486
distance-from-start_max0.8626308120701064
distance-from-start_mean0.8293644349619179
distance-from-start_median0.8293644349619179
distance-from-start_min0.7960980578537294
driven_any_max7.222519405652156
driven_any_mean6.586737153678611
driven_any_median6.586737153678611
driven_any_min5.950954901705066
driven_lanedir_consec_max0.26576074471389377
driven_lanedir_consec_mean0.23004863869940056
driven_lanedir_consec_min0.19433653268490736
driven_lanedir_max0.24775126076977572
driven_lanedir_mean0.21437974622313744
driven_lanedir_median0.21437974622313744
driven_lanedir_min0.18100823167649915
in-drivable-lane_max20.30000000000025
in-drivable-lane_mean20.025000000000247
in-drivable-lane_min19.750000000000245
per-episodes
details{"loop2-000-ego0": {"driven_any": 5.950954901705066, "survival_time": 29.000000000000277, "driven_lanedir": 0.24775126076977572, "in-drivable-lane": 19.750000000000245, "deviation-heading": 6.73261632177244, "distance-from-start": 0.7960980578537294, "deviation-center-line": 0.8194317074657906, "driven_lanedir_consec": 0.26576074471389377}, "loop2-000-ego1": {"driven_any": 7.222519405652156, "survival_time": 29.000000000000277, "driven_lanedir": 0.18100823167649915, "in-drivable-lane": 20.30000000000025, "deviation-heading": 6.535045295047486, "distance-from-start": 0.8626308120701064, "deviation-center-line": 0.6363281464200705, "driven_lanedir_consec": 0.19433653268490736}}
simulation-passed1
survival_time_max29.000000000000277
survival_time_mean29.000000000000277
survival_time_min29.000000000000277
No reset possible
12156704Bea Baselines 🐤template-randomaido-LFP-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.7499999999999805
in-drivable-lane_median3.74999999999999
driven_lanedir_consec_median0.3176161276974132
deviation-center-line_median0.27533253301389016


other stats
deviation-center-line_max0.27533253301389016
deviation-center-line_mean0.27533253301389016
deviation-center-line_min0.27533253301389016
deviation-heading_max3.128947285557921
deviation-heading_mean3.128947285557921
deviation-heading_median3.128947285557921
deviation-heading_min3.128947285557921
distance-from-start_max0.5223892996766406
distance-from-start_mean0.5223892996766406
distance-from-start_median0.5223892996766406
distance-from-start_min0.5223892996766406
driven_any_max1.4596542667951202
driven_any_mean1.4596542667951202
driven_any_median1.4596542667951202
driven_any_min1.4596542667951202
driven_lanedir_consec_max0.3176161276974132
driven_lanedir_consec_mean0.3176161276974132
driven_lanedir_consec_min0.3176161276974132
driven_lanedir_max0.3176161276974132
driven_lanedir_mean0.3176161276974132
driven_lanedir_median0.3176161276974132
driven_lanedir_min0.3176161276974132
in-drivable-lane_max3.74999999999999
in-drivable-lane_mean3.74999999999999
in-drivable-lane_min3.74999999999999
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.4596542667951202, "survival_time": 7.7499999999999805, "driven_lanedir": 0.3176161276974132, "in-drivable-lane": 3.74999999999999, "deviation-heading": 3.128947285557921, "distance-from-start": 0.5223892996766406, "deviation-center-line": 0.27533253301389016, "driven_lanedir_consec": 0.3176161276974132}}
simulation-passed1
survival_time_max7.7499999999999805
survival_time_mean7.7499999999999805
survival_time_min7.7499999999999805
No reset possible
12153706Bea Baselines 🐤template-randomaido-LFVI-sim-validationsim-0of4successnodavinci-stage-02-6.2.500:03:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.7499999999999942
in-drivable-lane_median0.9
driven_lanedir_consec_median0.39017518658850303
deviation-center-line_median0.1712487257959815


other stats
deviation-center-line_max0.1712487257959815
deviation-center-line_mean0.1712487257959815
deviation-center-line_min0.1712487257959815
deviation-heading_max1.7031418047241604
deviation-heading_mean1.7031418047241604
deviation-heading_median1.7031418047241604
deviation-heading_min1.7031418047241604
distance-from-start_max0.40285563030397936
distance-from-start_mean0.40285563030397936
distance-from-start_median0.40285563030397936
distance-from-start_min0.40285563030397936
driven_any_max0.4240764502839653
driven_any_mean0.4240764502839653
driven_any_median0.4240764502839653
driven_any_min0.4240764502839653
driven_lanedir_consec_max0.39017518658850303
driven_lanedir_consec_mean0.39017518658850303
driven_lanedir_consec_min0.39017518658850303
driven_lanedir_max0.39017518658850303
driven_lanedir_mean0.39017518658850303
driven_lanedir_median0.39017518658850303
driven_lanedir_min0.39017518658850303
in-drivable-lane_max0.9
in-drivable-lane_mean0.9
in-drivable-lane_min0.9
per-episodes
details{"udem-000-ego0": {"driven_any": 0.4240764502839653, "survival_time": 3.7499999999999942, "driven_lanedir": 0.39017518658850303, "in-drivable-lane": 0.9, "deviation-heading": 1.7031418047241604, "distance-from-start": 0.40285563030397936, "deviation-center-line": 0.1712487257959815, "driven_lanedir_consec": 0.39017518658850303}}
simulation-passed1
survival_time_max3.7499999999999942
survival_time_mean3.7499999999999942
survival_time_min3.7499999999999942
No reset possible
12150707Bea Baselines 🐤template-randomaido-LFI-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12140710Bea Baselines 🐤template-randomaido-LFV_multi-sim-testingsim-0of4successnodavinci-stage-02-6.2.500:23:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median51.799999999999194
in-drivable-lane_median44.52499999999915
driven_lanedir_consec_median0.17645690696034633
deviation-center-line_median0.6288359436091835


other stats
deviation-center-line_max0.6863070684206949
deviation-center-line_mean0.6132347216191781
deviation-center-line_min0.5089599308376506
deviation-heading_max5.904235246936352
deviation-heading_mean4.779753520384025
deviation-heading_median4.657001419426715
deviation-heading_min3.900775995746317
distance-from-start_max1.2120262829129491
distance-from-start_mean1.0474942275906278
distance-from-start_median1.090926284797921
distance-from-start_min0.79609805785372
driven_any_max12.87870380836423
driven_any_mean10.630699349059253
driven_any_median11.702531035811734
driven_any_min6.239031516249309
driven_lanedir_consec_max0.24485749504972
driven_lanedir_consec_mean0.16302815368948875
driven_lanedir_consec_min0.05434130578754237
driven_lanedir_max0.23072215708841037
driven_lanedir_mean0.15210419461121738
driven_lanedir_median0.16000521526986278
driven_lanedir_min0.057684190816733594
in-drivable-lane_max44.99999999999916
in-drivable-lane_mean44.44999999999917
in-drivable-lane_min43.74999999999919
per-episodes
details{"autolab-000-ego0": {"driven_any": 12.87870380836423, "survival_time": 51.799999999999194, "driven_lanedir": 0.057684190816733594, "in-drivable-lane": 44.24999999999912, "deviation-heading": 5.904235246936352, "distance-from-start": 1.2120262829129491, "deviation-center-line": 0.6346589459314982, "driven_lanedir_consec": 0.05434130578754237}, "autolab-000-ego1": {"driven_any": 6.239031516249309, "survival_time": 51.799999999999194, "driven_lanedir": 0.23072215708841037, "in-drivable-lane": 43.74999999999919, "deviation-heading": 4.4349341204672275, "distance-from-start": 0.79609805785372, "deviation-center-line": 0.6230129412868688, "driven_lanedir_consec": 0.24485749504972}, "autolab-000-ego2": {"driven_any": 11.02110496898548, "survival_time": 51.799999999999194, "driven_lanedir": 0.13091436524500333, "in-drivable-lane": 44.99999999999916, "deviation-heading": 3.900775995746317, "distance-from-start": 1.044224797669194, "deviation-center-line": 0.6863070684206949, "driven_lanedir_consec": 0.15293166981715745}, "autolab-000-ego3": {"driven_any": 12.383957102637988, "survival_time": 51.799999999999194, "driven_lanedir": 0.18909606529472223, "in-drivable-lane": 44.79999999999918, "deviation-heading": 4.879068718386203, "distance-from-start": 1.137627771926648, "deviation-center-line": 0.5089599308376506, "driven_lanedir_consec": 0.1999821441035352}}
simulation-passed1
survival_time_max51.799999999999194
survival_time_mean51.799999999999194
survival_time_min51.799999999999194
No reset possible
12135710Bea Baselines 🐤template-randomaido-LFV_multi-sim-testingsim-1of4host-errornodavinci-stage-02-6.2.500:04:48
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1312, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 423, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1156, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12130711Bea Baselines 🐤template-randomaido-LFP-sim-testingsim-0of4successnodavinci-stage-02-6.2.500:04:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median32.70000000000028
in-drivable-lane_median26.450000000000227
driven_lanedir_consec_median0.01242473178359728
deviation-center-line_median0.584969651111141


other stats
deviation-center-line_max0.584969651111141
deviation-center-line_mean0.584969651111141
deviation-center-line_min0.584969651111141
deviation-heading_max4.775258874675082
deviation-heading_mean4.775258874675082
deviation-heading_median4.775258874675082
deviation-heading_min4.775258874675082
distance-from-start_max0.9340577697896082
distance-from-start_mean0.9340577697896082
distance-from-start_median0.9340577697896082
distance-from-start_min0.9340577697896082
driven_any_max8.108127605402737
driven_any_mean8.108127605402737
driven_any_median8.108127605402737
driven_any_min8.108127605402737
driven_lanedir_consec_max0.01242473178359728
driven_lanedir_consec_mean0.01242473178359728
driven_lanedir_consec_min0.01242473178359728
driven_lanedir_max0.015771073882231215
driven_lanedir_mean0.015771073882231215
driven_lanedir_median0.015771073882231215
driven_lanedir_min0.015771073882231215
in-drivable-lane_max26.450000000000227
in-drivable-lane_mean26.450000000000227
in-drivable-lane_min26.450000000000227
per-episodes
details{"autolab-000-ego0": {"driven_any": 8.108127605402737, "survival_time": 32.70000000000028, "driven_lanedir": 0.015771073882231215, "in-drivable-lane": 26.450000000000227, "deviation-heading": 4.775258874675082, "distance-from-start": 0.9340577697896082, "deviation-center-line": 0.584969651111141, "driven_lanedir_consec": 0.01242473178359728}}
simulation-passed1
survival_time_max32.70000000000028
survival_time_mean32.70000000000028
survival_time_min32.70000000000028
No reset possible
12127712Bea Baselines 🐤template-randomaido-LFV-sim-testingsim-1of4successnodavinci-stage-02-6.2.500:04:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.900000000000034
in-drivable-lane_median8.450000000000022
driven_lanedir_consec_median0.02606802234991923
deviation-center-line_median0.3267559166059044


other stats
deviation-center-line_max0.3267559166059044
deviation-center-line_mean0.3267559166059044
deviation-center-line_min0.3267559166059044
deviation-heading_max2.5569354443903323
deviation-heading_mean2.5569354443903323
deviation-heading_median2.5569354443903323
deviation-heading_min2.5569354443903323
distance-from-start_max0.6207818224254961
distance-from-start_mean0.6207818224254961
distance-from-start_median0.6207818224254961
distance-from-start_min0.6207818224254961
driven_any_max2.607887888367928
driven_any_mean2.607887888367928
driven_any_median2.607887888367928
driven_any_min2.607887888367928
driven_lanedir_consec_max0.02606802234991923
driven_lanedir_consec_mean0.02606802234991923
driven_lanedir_consec_min0.02606802234991923
driven_lanedir_max0.029415675750660508
driven_lanedir_mean0.029415675750660508
driven_lanedir_median0.029415675750660508
driven_lanedir_min0.029415675750660508
in-drivable-lane_max8.450000000000022
in-drivable-lane_mean8.450000000000022
in-drivable-lane_min8.450000000000022
per-episodes
details{"loop-000-ego0": {"driven_any": 2.607887888367928, "survival_time": 11.900000000000034, "driven_lanedir": 0.029415675750660508, "in-drivable-lane": 8.450000000000022, "deviation-heading": 2.5569354443903323, "distance-from-start": 0.6207818224254961, "deviation-center-line": 0.3267559166059044, "driven_lanedir_consec": 0.02606802234991923}}
simulation-passed1
survival_time_max11.900000000000034
survival_time_mean11.900000000000034
survival_time_min11.900000000000034
No reset possible
12123712Bea Baselines 🐤template-randomaido-LFV-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:02:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.850000000000032
in-drivable-lane_median8.400000000000022
driven_lanedir_consec_median0.026069146445470537
deviation-center-line_median0.32675612925723413


other stats
deviation-center-line_max0.32675612925723413
deviation-center-line_mean0.32675612925723413
deviation-center-line_min0.32675612925723413
deviation-heading_max2.5569355297042424
deviation-heading_mean2.5569355297042424
deviation-heading_median2.5569355297042424
deviation-heading_min2.5569355297042424
distance-from-start_max0.602406023935488
distance-from-start_mean0.602406023935488
distance-from-start_median0.602406023935488
distance-from-start_min0.602406023935488
driven_any_max2.587018858615978
driven_any_mean2.587018858615978
driven_any_median2.587018858615978
driven_any_min2.587018858615978
driven_lanedir_consec_max0.026069146445470537
driven_lanedir_consec_mean0.026069146445470537
driven_lanedir_consec_min0.026069146445470537
driven_lanedir_max0.02941536933481892
driven_lanedir_mean0.02941536933481892
driven_lanedir_median0.02941536933481892
driven_lanedir_min0.02941536933481892
in-drivable-lane_max8.400000000000022
in-drivable-lane_mean8.400000000000022
in-drivable-lane_min8.400000000000022
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.587018858615978, "survival_time": 11.850000000000032, "driven_lanedir": 0.02941536933481892, "in-drivable-lane": 8.400000000000022, "deviation-heading": 2.5569355297042424, "distance-from-start": 0.602406023935488, "deviation-center-line": 0.32675612925723413, "driven_lanedir_consec": 0.026069146445470537}}
simulation-passed1
survival_time_max11.850000000000032
survival_time_mean11.850000000000032
survival_time_min11.850000000000032
No reset possible
12119714Bea Baselines 🐤template-randomaido-LFI-sim-testingsim-0of4successnodavinci-stage-02-6.2.500:02:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.350000000000026
in-drivable-lane_median7.900000000000015
driven_lanedir_consec_median0.02948472541340319
deviation-center-line_median0.3268416970813497


other stats
deviation-center-line_max0.3268416970813497
deviation-center-line_mean0.3268416970813497
deviation-center-line_min0.3268416970813497
deviation-heading_max2.548872596322993
deviation-heading_mean2.548872596322993
deviation-heading_median2.548872596322993
deviation-heading_min2.548872596322993
distance-from-start_max0.5461575079396523
distance-from-start_mean0.5461575079396523
distance-from-start_median0.5461575079396523
distance-from-start_min0.5461575079396523
driven_any_max2.2955250818765194
driven_any_mean2.2955250818765194
driven_any_median2.2955250818765194
driven_any_min2.2955250818765194
driven_lanedir_consec_max0.02948472541340319
driven_lanedir_consec_mean0.02948472541340319
driven_lanedir_consec_min0.02948472541340319
driven_lanedir_max0.032831067512037126
driven_lanedir_mean0.032831067512037126
driven_lanedir_median0.032831067512037126
driven_lanedir_min0.032831067512037126
in-drivable-lane_max7.900000000000015
in-drivable-lane_mean7.900000000000015
in-drivable-lane_min7.900000000000015
per-episodes
details{"4way-000-ego0": {"driven_any": 2.2955250818765194, "survival_time": 11.350000000000026, "driven_lanedir": 0.032831067512037126, "in-drivable-lane": 7.900000000000015, "deviation-heading": 2.548872596322993, "distance-from-start": 0.5461575079396523, "deviation-center-line": 0.3268416970813497, "driven_lanedir_consec": 0.02948472541340319}}
simulation-passed1
survival_time_max11.350000000000026
survival_time_mean11.350000000000026
survival_time_min11.350000000000026
No reset possible
12110732Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-validationsim-0of4successnodavinci-stage-02-6.2.500:12:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median1.5116951606795332


other stats
deviation-center-line_max2.946768139128097
deviation-center-line_mean1.576975791536685
deviation-center-line_min0.3377447056595774
deviation-heading_max32.249113233675025
deviation-heading_mean22.83949643715976
deviation-heading_median22.59726568012299
deviation-heading_min13.914341154718024
distance-from-start_max3.1401849173675503e-16
distance-from-start_mean1.3401577416544655e-16
distance-from-start_median1.1102230246251563e-16
distance-from-start_min0.0
driven_any_max3.7682219008410875e-13
driven_any_mean1.608189289985366e-13
driven_any_median1.3322676295501878e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 0.0, "deviation-center-line": 0.894912424505976, "driven_lanedir_consec": 0.0}, "autolab-000-ego1": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 0.0, "deviation-center-line": 2.12847789685309, "driven_lanedir_consec": 0.0}, "autolab-000-ego2": {"driven_any": 3.7682219008410875e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 14.481564596168328, "distance-from-start": 3.1401849173675503e-16, "deviation-center-line": 2.946768139128097, "driven_lanedir_consec": 0.0}, "autolab-000-ego3": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 13.914341154718024, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 0.3377447056595774, "driven_lanedir_consec": 0.000286102294921875}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12100735Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-validationsim-1of4successnodavinci-stage-02-6.2.500:12:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8949025646750288


other stats
deviation-center-line_max0.8949025646750288
deviation-center-line_mean0.8949025646750288
deviation-center-line_min0.8949025646750288
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max2.220446049250313e-16
distance-from-start_mean2.220446049250313e-16
distance-from-start_median2.220446049250313e-16
distance-from-start_min2.220446049250313e-16
driven_any_max2.6645352591003757e-13
driven_any_mean2.6645352591003757e-13
driven_any_median2.6645352591003757e-13
driven_any_min2.6645352591003757e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 0.8949025646750288, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12094737Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-validationsim-3of4successnodavinci-stage-02-6.2.500:05:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.6017417553703126e-06
survival_time_median59.99999999999873
deviation-center-line_median0.8949077950231444
in-drivable-lane_median0.0


other stats
deviation-center-line_max0.8949077950231444
deviation-center-line_mean0.8949077950231444
deviation-center-line_min0.8949077950231444
deviation-heading_max32.24912799874442
deviation-heading_mean32.24912799874442
deviation-heading_median32.24912799874442
deviation-heading_min32.24912799874442
distance-from-start_max4.440892098500626e-16
distance-from-start_mean4.440892098500626e-16
distance-from-start_median4.440892098500626e-16
distance-from-start_min4.440892098500626e-16
driven_any_max5.329070518200751e-13
driven_any_mean5.329070518200751e-13
driven_any_median5.329070518200751e-13
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max2.6017417553703126e-06
driven_lanedir_consec_mean2.6017417553703126e-06
driven_lanedir_consec_min2.6017417553703126e-06
driven_lanedir_max2.6017417553703126e-06
driven_lanedir_mean2.6017417553703126e-06
driven_lanedir_median2.6017417553703126e-06
driven_lanedir_min2.6017417553703126e-06
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 2.6017417553703126e-06, "in-drivable-lane": 0.0, "deviation-heading": 32.24912799874442, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.8949077950231444, "driven_lanedir_consec": 2.6017417553703126e-06}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12091737Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-validationsim-2of4successnodavinci-stage-02-6.2.500:05:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median0.8948943425963037
in-drivable-lane_median0.0


other stats
deviation-center-line_max0.8948943425963037
deviation-center-line_mean0.8948943425963037
deviation-center-line_min0.8948943425963037
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max1.3877787807814454e-16
distance-from-start_mean1.3877787807814454e-16
distance-from-start_median1.3877787807814454e-16
distance-from-start_min1.3877787807814454e-16
driven_any_max1.665334536937735e-13
driven_any_mean1.665334536937735e-13
driven_any_median1.665334536937735e-13
driven_any_min1.665334536937735e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.665334536937735e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 1.3877787807814454e-16, "deviation-center-line": 0.8948943425963037, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12085739Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-testingsim-3of4successnodavinci-stage-02-6.2.500:13:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median-8.005811347189251e-07
deviation-center-line_median1.5844989127493232


other stats
deviation-center-line_max3.4683931889545456
deviation-center-line_mean1.7151217085698922
deviation-center-line_min0.2230958198263772
deviation-heading_max40.967332753486254
deviation-heading_mean25.4379548287734
deviation-heading_median28.066168080220784
deviation-heading_min4.652150401165767
distance-from-start_max4.965068306494546e-16
distance-from-start_mean3.6346596789574973e-16
distance-from-start_median4.509229448511432e-16
distance-from-start_min5.551115123125783e-17
driven_any_max5.95808196779335e-13
driven_any_mean4.361591614748986e-13
driven_any_median5.41107533821375e-13
driven_any_min6.661338147750939e-14
driven_lanedir_consec_max1.6144275249985185e-05
driven_lanedir_consec_mean-6.788979548533192e-05
driven_lanedir_consec_min-0.000286102294921875
driven_lanedir_max1.6144275249985185e-05
driven_lanedir_mean-6.788979548533192e-05
driven_lanedir_median-8.005811347189251e-07
driven_lanedir_min-0.000286102294921875
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 6.661338147750939e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.4065243130134252, "driven_lanedir_consec": 0.0}, "zigzag-000-ego1": {"driven_any": 5.49308015822675e-13, "survival_time": 59.99999999999873, "driven_lanedir": 1.6144275249985185e-05, "in-drivable-lane": 0.0, "deviation-heading": 18.30940375485005, "distance-from-start": 4.577566798522237e-16, "deviation-center-line": 3.4683931889545456, "driven_lanedir_consec": 1.6144275249985185e-05}, "zigzag-000-ego2": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": -1.6011622694378502e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.652150401165767, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.2230958198263772, "driven_lanedir_consec": -1.6011622694378502e-06}, "zigzag-000-ego3": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": -0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 2.7624735124852213, "driven_lanedir_consec": -0.000286102294921875}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12081740Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:05:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.4065274986524565


other stats
deviation-center-line_max0.4065274986524565
deviation-center-line_mean0.4065274986524565
deviation-center-line_min0.4065274986524565
deviation-heading_max40.967332753486254
deviation-heading_mean40.967332753486254
deviation-heading_median40.967332753486254
deviation-heading_min40.967332753486254
distance-from-start_max0.0
distance-from-start_mean0.0
distance-from-start_median0.0
distance-from-start_min0.0
driven_any_max0.0
driven_any_mean0.0
driven_any_median0.0
driven_any_min0.0
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 0.0, "deviation-center-line": 0.4065274986524565, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12075741Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-testingsim-1of4successnodavinci-stage-02-6.2.500:10:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.4065147560962461


other stats
deviation-center-line_max0.4065147560962461
deviation-center-line_mean0.4065147560962461
deviation-center-line_min0.4065147560962461
deviation-heading_max40.967332753486225
deviation-heading_mean40.967332753486225
deviation-heading_median40.967332753486225
deviation-heading_min40.967332753486225
distance-from-start_max2.7755575615628914e-17
distance-from-start_mean2.7755575615628914e-17
distance-from-start_median2.7755575615628914e-17
distance-from-start_min2.7755575615628914e-17
driven_any_max3.3306690738754696e-14
driven_any_mean3.3306690738754696e-14
driven_any_median3.3306690738754696e-14
driven_any_min3.3306690738754696e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 3.3306690738754696e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 2.7755575615628914e-17, "deviation-center-line": 0.4065147560962461, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12069743Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-testingsim-0of4successnodavinci-stage-02-6.2.500:05:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.4065274986524565


other stats
deviation-center-line_max0.4065274986524565
deviation-center-line_mean0.4065274986524565
deviation-center-line_min0.4065274986524565
deviation-heading_max40.967332753486254
deviation-heading_mean40.967332753486254
deviation-heading_median40.967332753486254
deviation-heading_min40.967332753486254
distance-from-start_max0.0
distance-from-start_mean0.0
distance-from-start_median0.0
distance-from-start_min0.0
driven_any_max0.0
driven_any_mean0.0
driven_any_median0.0
driven_any_min0.0
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 0.0, "deviation-center-line": 0.4065274986524565, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12066743Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-testingsim-2of4successnodavinci-stage-02-6.2.500:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12052746Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-testingsim-1of4successnodavinci-stage-02-6.2.500:13:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median1.584490539213638


other stats
deviation-center-line_max3.468403943259581
deviation-center-line_mean1.7151239112540893
deviation-center-line_min0.22311062332950052
deviation-heading_max40.967332753486254
deviation-heading_mean25.43795145047151
deviation-heading_median28.06618021079834
deviation-heading_min4.652112626803104
distance-from-start_max4.965068306494546e-16
distance-from-start_mean3.037645665559851e-16
distance-from-start_median3.592757177872429e-16
distance-from-start_min0.0
driven_any_max5.95808196779335e-13
driven_any_mean3.645174798671769e-13
driven_any_median4.3113086134468626e-13
driven_any_min0.0
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.406518457697633, "driven_lanedir_consec": 0.0}, "4way-000-ego1": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005157, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 3.468403943259581, "driven_lanedir_consec": 0.0}, "4way-000-ego2": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 4.652112626803104, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.22311062332950052, "driven_lanedir_consec": 0.0}, "4way-000-ego3": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 0.0, "deviation-center-line": 2.762462620729643, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible