Duckietown Challenges Home Challenges Submissions

Evaluator 111

ID111
evaluatordavinci-stage-04-6.2.50
owneruser1000001
machinedavinci-stage
processdavinci-stage-04-6.2.50
version6.2.50
first heard
last heard
statusinactive
# evaluating
# success291 12050
# timeout1 14011
# failed79 12179
# error178 12614
# aborted3 12904
# host-error21 12133
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)2.8 GHz
Free % of processors98%
RAM total (MB)251.6 GB
RAM free (MB)243.1 GB
Disk (MB)491.1 GB
Disk available (MB)200.4 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, ETH_small_intersect
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
150411310Andrea Censibaseline-solutionlx22-collision-check-teststep1successyesdavinci-stage-04-6.2.500:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.0


other stats
nsamples200
No reset possible
150311297Andrea Censicollision-check-exerciselx22-collision-check-valistep1host-erroryesdavinci-stage-04-6.2.500:00:42
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.41/images/create?tag=2022_11_24_17_26_06&fromImage=registry-stage2.duckietown.org%2Fandreacensi%2Faido-submissions

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 93, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 429, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.ImageNotFound: 404 Client Error for http+docker://localhost/v1.41/images/create?tag=2022_11_24_17_26_06&fromImage=registry-stage2.duckietown.org%2Fandreacensi%2Faido-submissions: Not Found ("pull access denied for registry-stage2.duckietown.org/andreacensi/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 112, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  registry-stage2.duckietown.org/andreacensi/aido-submissions@sha256:840e7105f36db90b5d37324bdcab451125a96c2e8b8f5c02658293c659de9b5d  tag  2022_11_24_17_26_06

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 51, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull registry-stage2.duckietown.org/andreacensi/aido-submissions:2022_11_24_17_26_06@sha256:840e7105f36db90b5d37324bdcab451125a96c2e8b8f5c02658293c659de9b5d
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15026309Andrea Censiminimal-agentaido-LFV-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:03:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.700000000000044
in-drivable-lane_median10.950000000000044
driven_lanedir_consec_median0.19955171937759708
deviation-center-line_median0.12567511082985278


other stats
deviation-center-line_max0.12567511082985278
deviation-center-line_mean0.12567511082985278
deviation-center-line_min0.12567511082985278
deviation-heading_max0.9488219555580464
deviation-heading_mean0.9488219555580464
deviation-heading_median0.9488219555580464
deviation-heading_min0.9488219555580464
distance-from-start_max1.924049384083022
distance-from-start_mean1.924049384083022
distance-from-start_median1.924049384083022
distance-from-start_min1.924049384083022
driven_any_max1.924195440713655
driven_any_mean1.924195440713655
driven_any_median1.924195440713655
driven_any_min1.924195440713655
driven_lanedir_consec_max0.19955171937759708
driven_lanedir_consec_mean0.19955171937759708
driven_lanedir_consec_min0.19955171937759708
driven_lanedir_max0.19955171937759708
driven_lanedir_mean0.19955171937759708
driven_lanedir_median0.19955171937759708
driven_lanedir_min0.19955171937759708
in-drivable-lane_max10.950000000000044
in-drivable-lane_mean10.950000000000044
in-drivable-lane_min10.950000000000044
per-episodes
details{"loop-000-ego0": {"driven_any": 1.924195440713655, "survival_time": 12.700000000000044, "driven_lanedir": 0.19955171937759708, "in-drivable-lane": 10.950000000000044, "deviation-heading": 0.9488219555580464, "distance-from-start": 1.924049384083022, "deviation-center-line": 0.12567511082985278, "driven_lanedir_consec": 0.19955171937759708}}
simulation-passed1
survival_time_max12.700000000000044
survival_time_mean12.700000000000044
survival_time_min12.700000000000044
No reset possible
15001385Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-validationsim-0of4successnodavinci-stage-04-6.2.500:34:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median24.7999999999994
driven_lanedir_consec_median-3.6557043379575553
deviation-center-line_median2.9654318926489327


other stats
deviation-center-line_max6.124322107265249
deviation-center-line_mean3.6009488211751677
deviation-center-line_min2.3486093921375537
deviation-heading_max35.03063391115348
deviation-heading_mean29.73308843454468
deviation-heading_median28.233946433092154
deviation-heading_min27.433826960840936
distance-from-start_max0.1872319616632824
distance-from-start_mean0.16894702146768825
distance-from-start_median0.16594057682367772
distance-from-start_min0.1566749705601151
driven_any_max15.099731574964403
driven_any_mean12.711814863074087
driven_any_median12.146132371372548
driven_any_min11.455263134586854
driven_lanedir_consec_max-3.1994062072594365
driven_lanedir_consec_mean-3.7970903781856142
driven_lanedir_consec_min-4.677546629567911
driven_lanedir_max-3.1994062072594365
driven_lanedir_mean-5.0113145709766
driven_lanedir_median-3.816678936165488
driven_lanedir_min-9.212494204315988
in-drivable-lane_max27.849999999999376
in-drivable-lane_mean21.4249999999995
in-drivable-lane_min8.249999999999826
per-episodes
details{"autolab-000-ego0": {"driven_any": 11.598489208903302, "survival_time": 59.99999999999873, "driven_lanedir": -3.571282091039791, "in-drivable-lane": 25.349999999999365, "deviation-heading": 28.6280679091645, "distance-from-start": 0.16987148609587374, "deviation-center-line": 2.3486093921375537, "driven_lanedir_consec": -3.3665625498161047}, "autolab-000-ego1": {"driven_any": 11.455263134586854, "survival_time": 59.99999999999873, "driven_lanedir": -3.1994062072594365, "in-drivable-lane": 24.24999999999944, "deviation-heading": 27.839824957019808, "distance-from-start": 0.1620096675514817, "deviation-center-line": 3.501027553653337, "driven_lanedir_consec": -3.1994062072594365}, "autolab-000-ego2": {"driven_any": 15.099731574964403, "survival_time": 59.99999999999873, "driven_lanedir": -9.212494204315988, "in-drivable-lane": 8.249999999999826, "deviation-heading": 35.03063391115348, "distance-from-start": 0.1872319616632824, "deviation-center-line": 6.124322107265249, "driven_lanedir_consec": -4.677546629567911}, "autolab-000-ego3": {"driven_any": 12.69377553384179, "survival_time": 59.99999999999873, "driven_lanedir": -4.062075781291185, "in-drivable-lane": 27.849999999999376, "deviation-heading": 27.433826960840936, "distance-from-start": 0.1566749705601151, "deviation-center-line": 2.4298362316445283, "driven_lanedir_consec": -3.9448461260990064}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14997387Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:15:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median20.799999999999507
driven_lanedir_consec_median-2.4633678424537897
deviation-center-line_median3.4086087410356


other stats
deviation-center-line_max3.4086087410356
deviation-center-line_mean3.4086087410356
deviation-center-line_min3.4086087410356
deviation-heading_max29.28405265123732
deviation-heading_mean29.28405265123732
deviation-heading_median29.28405265123732
deviation-heading_min29.28405265123732
distance-from-start_max0.20887369721039975
distance-from-start_mean0.20887369721039975
distance-from-start_median0.20887369721039975
distance-from-start_min0.20887369721039975
driven_any_max10.33939869130297
driven_any_mean10.33939869130297
driven_any_median10.33939869130297
driven_any_min10.33939869130297
driven_lanedir_consec_max-2.4633678424537897
driven_lanedir_consec_mean-2.4633678424537897
driven_lanedir_consec_min-2.4633678424537897
driven_lanedir_max-2.714875402515465
driven_lanedir_mean-2.714875402515465
driven_lanedir_median-2.714875402515465
driven_lanedir_min-2.714875402515465
in-drivable-lane_max20.799999999999507
in-drivable-lane_mean20.799999999999507
in-drivable-lane_min20.799999999999507
per-episodes
details{"loop-000-ego0": {"driven_any": 10.33939869130297, "survival_time": 59.99999999999873, "driven_lanedir": -2.714875402515465, "in-drivable-lane": 20.799999999999507, "deviation-heading": 29.28405265123732, "distance-from-start": 0.20887369721039975, "deviation-center-line": 3.4086087410356, "driven_lanedir_consec": -2.4633678424537897}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14989388Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:17:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median26.39999999999954
driven_lanedir_consec_median-4.2971290778352635
deviation-center-line_median2.390450000440824


other stats
deviation-center-line_max2.390450000440824
deviation-center-line_mean2.390450000440824
deviation-center-line_min2.390450000440824
deviation-heading_max27.275479856429268
deviation-heading_mean27.275479856429268
deviation-heading_median27.275479856429268
deviation-heading_min27.275479856429268
distance-from-start_max0.2583186428006614
distance-from-start_mean0.2583186428006614
distance-from-start_median0.2583186428006614
distance-from-start_min0.2583186428006614
driven_any_max14.129442900159171
driven_any_mean14.129442900159171
driven_any_median14.129442900159171
driven_any_min14.129442900159171
driven_lanedir_consec_max-4.2971290778352635
driven_lanedir_consec_mean-4.2971290778352635
driven_lanedir_consec_min-4.2971290778352635
driven_lanedir_max-4.5988125656209675
driven_lanedir_mean-4.5988125656209675
driven_lanedir_median-4.5988125656209675
driven_lanedir_min-4.5988125656209675
in-drivable-lane_max26.39999999999954
in-drivable-lane_mean26.39999999999954
in-drivable-lane_min26.39999999999954
per-episodes
details{"4way-000-ego0": {"driven_any": 14.129442900159171, "survival_time": 59.99999999999873, "driven_lanedir": -4.5988125656209675, "in-drivable-lane": 26.39999999999954, "deviation-heading": 27.275479856429268, "distance-from-start": 0.2583186428006614, "deviation-center-line": 2.390450000440824, "driven_lanedir_consec": -4.2971290778352635}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14988388Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14987389Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14984389Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14974392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-0of4successnodavinci-stage-04-6.2.500:34:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median31.79999999999918
driven_lanedir_consec_median-2.4992402862930616
deviation-center-line_median2.287336011095758


other stats
deviation-center-line_max2.947709428105387
deviation-center-line_mean2.346629087963606
deviation-center-line_min1.8641349015575204
deviation-heading_max29.799252880870068
deviation-heading_mean24.380572549866777
deviation-heading_median24.497385055775403
deviation-heading_min18.728267207046223
distance-from-start_max0.1647701582725784
distance-from-start_mean0.1495631297119435
distance-from-start_median0.14822326572511652
distance-from-start_min0.13703582912496243
driven_any_max11.9316239782198
driven_any_mean10.833196363385763
driven_any_median11.202482276982796
driven_any_min8.996196921357663
driven_lanedir_consec_max-1.4510977090948036
driven_lanedir_consec_mean-2.4687033580797064
driven_lanedir_consec_min-3.4252351506378975
driven_lanedir_max-1.4510977090948036
driven_lanedir_mean-2.524090390646572
driven_lanedir_median-2.4992402862930616
driven_lanedir_min-3.64678328090536
in-drivable-lane_max38.94999999999891
in-drivable-lane_mean31.87499999999917
in-drivable-lane_min24.94999999999941
per-episodes
details{"autolab-000-ego0": {"driven_any": 11.409119027341164, "survival_time": 59.99999999999873, "driven_lanedir": -3.1702059402962712, "in-drivable-lane": 24.99999999999937, "deviation-heading": 29.11156997777272, "distance-from-start": 0.13703582912496243, "deviation-center-line": 2.947709428105387, "driven_lanedir_consec": -3.1702059402962712}, "autolab-000-ego1": {"driven_any": 8.996196921357663, "survival_time": 59.99999999999873, "driven_lanedir": -1.4510977090948036, "in-drivable-lane": 38.599999999998985, "deviation-heading": 18.728267207046223, "distance-from-start": 0.145512543167685, "deviation-center-line": 2.236540858505136, "driven_lanedir_consec": -1.4510977090948036}, "autolab-000-ego2": {"driven_any": 11.9316239782198, "survival_time": 59.99999999999873, "driven_lanedir": -3.64678328090536, "in-drivable-lane": 24.94999999999941, "deviation-heading": 29.799252880870068, "distance-from-start": 0.1647701582725784, "deviation-center-line": 1.8641349015575204, "driven_lanedir_consec": -3.4252351506378975}, "autolab-000-ego3": {"driven_any": 10.995845526624423, "survival_time": 59.99999999999873, "driven_lanedir": -1.8282746322898524, "in-drivable-lane": 38.94999999999891, "deviation-heading": 19.88320013377809, "distance-from-start": 0.15093398828254806, "deviation-center-line": 2.3381311636863793, "driven_lanedir_consec": -1.8282746322898524}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14966394Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:19:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median36.499999999999055
driven_lanedir_consec_median-2.1366236675375143
deviation-center-line_median2.3194135100050355


other stats
deviation-center-line_max2.3194135100050355
deviation-center-line_mean2.3194135100050355
deviation-center-line_min2.3194135100050355
deviation-heading_max20.866624075207383
deviation-heading_mean20.866624075207383
deviation-heading_median20.866624075207383
deviation-heading_min20.866624075207383
distance-from-start_max0.19407152898029084
distance-from-start_mean0.19407152898029084
distance-from-start_median0.19407152898029084
distance-from-start_min0.19407152898029084
driven_any_max10.654678702958568
driven_any_mean10.654678702958568
driven_any_median10.654678702958568
driven_any_min10.654678702958568
driven_lanedir_consec_max-2.1366236675375143
driven_lanedir_consec_mean-2.1366236675375143
driven_lanedir_consec_min-2.1366236675375143
driven_lanedir_max-2.1366236675375143
driven_lanedir_mean-2.1366236675375143
driven_lanedir_median-2.1366236675375143
driven_lanedir_min-2.1366236675375143
in-drivable-lane_max36.499999999999055
in-drivable-lane_mean36.499999999999055
in-drivable-lane_min36.499999999999055
per-episodes
details{"zigzag-000-ego0": {"driven_any": 10.654678702958568, "survival_time": 59.99999999999873, "driven_lanedir": -2.1366236675375143, "in-drivable-lane": 36.499999999999055, "deviation-heading": 20.866624075207383, "distance-from-start": 0.19407152898029084, "deviation-center-line": 2.3194135100050355, "driven_lanedir_consec": -2.1366236675375143}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14965395Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14958396Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-testingsim-1of4successnodavinci-stage-04-6.2.500:09:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median35.699999999999065
driven_lanedir_consec_median-2.7467744679470396
deviation-center-line_median2.2005527772601057


other stats
deviation-center-line_max2.2005527772601057
deviation-center-line_mean2.2005527772601057
deviation-center-line_min2.2005527772601057
deviation-heading_max22.94964232600839
deviation-heading_mean22.94964232600839
deviation-heading_median22.94964232600839
deviation-heading_min22.94964232600839
distance-from-start_max0.1729313951968888
distance-from-start_mean0.1729313951968888
distance-from-start_median0.1729313951968888
distance-from-start_min0.1729313951968888
driven_any_max12.088402105967726
driven_any_mean12.088402105967726
driven_any_median12.088402105967726
driven_any_min12.088402105967726
driven_lanedir_consec_max-2.7467744679470396
driven_lanedir_consec_mean-2.7467744679470396
driven_lanedir_consec_min-2.7467744679470396
driven_lanedir_max-2.7467744679470396
driven_lanedir_mean-2.7467744679470396
driven_lanedir_median-2.7467744679470396
driven_lanedir_min-2.7467744679470396
in-drivable-lane_max35.699999999999065
in-drivable-lane_mean35.699999999999065
in-drivable-lane_min35.699999999999065
per-episodes
details{"udem1-000-ego0": {"driven_any": 12.088402105967726, "survival_time": 59.99999999999873, "driven_lanedir": -2.7467744679470396, "in-drivable-lane": 35.699999999999065, "deviation-heading": 22.94964232600839, "distance-from-start": 0.1729313951968888, "deviation-center-line": 2.2005527772601057, "driven_lanedir_consec": -2.7467744679470396}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14954396Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14948514Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-validationsim-2of4failednodavinci-stage-04-6.2.500:01:24
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14943516Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-validationsim-0of4failednodavinci-stage-04-6.2.500:01:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14939517Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-validationsim-0of4failednodavinci-stage-04-6.2.500:01:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14934518Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14929519Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-validationsim-1of4failednodavinci-stage-04-6.2.500:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14925521Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-testingsim-1of4failednodavinci-stage-04-6.2.500:01:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14896528Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:22:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.6749999999999816
driven_lanedir_consec_median8.46122834486169
deviation-center-line_median2.7089431240634383


other stats
deviation-center-line_max3.7256773160647394
deviation-center-line_mean2.856666457499799
deviation-center-line_min2.2831022658075795
deviation-heading_max14.890894021195985
deviation-heading_mean12.843581700367206
deviation-heading_median12.329913726844392
deviation-heading_min11.82360532658406
distance-from-start_max4.479531800257838
distance-from-start_mean4.1009326624105125
distance-from-start_median4.11199646727924
distance-from-start_min3.700205914825734
driven_any_max9.571070257440994
driven_any_mean9.028559727624462
driven_any_median8.9698883857089
driven_any_min8.603391881639052
driven_lanedir_consec_max8.539820618283436
driven_lanedir_consec_mean8.423655692361853
driven_lanedir_consec_min8.232345461440598
driven_lanedir_max8.539820618283436
driven_lanedir_mean8.423655692361853
driven_lanedir_median8.46122834486169
driven_lanedir_min8.232345461440598
in-drivable-lane_max2.699999999999953
in-drivable-lane_mean1.137499999999972
in-drivable-lane_min0.4999999999999716
per-episodes
details{"zigzag-000-ego0": {"driven_any": 8.899242358685079, "survival_time": 59.99999999999873, "driven_lanedir": 8.43188038573333, "in-drivable-lane": 0.5999999999999659, "deviation-heading": 12.200984895229675, "distance-from-start": 3.700205914825734, "deviation-center-line": 2.44241992563526, "driven_lanedir_consec": 8.43188038573333}, "zigzag-000-ego1": {"driven_any": 9.040534412732722, "survival_time": 59.99999999999873, "driven_lanedir": 8.49057630399005, "in-drivable-lane": 0.7499999999999973, "deviation-heading": 12.458842558459107, "distance-from-start": 3.7988182856552735, "deviation-center-line": 2.2831022658075795, "driven_lanedir_consec": 8.49057630399005}, "zigzag-000-ego2": {"driven_any": 9.571070257440994, "survival_time": 59.99999999999873, "driven_lanedir": 8.539820618283436, "in-drivable-lane": 2.699999999999953, "deviation-heading": 14.890894021195985, "distance-from-start": 4.425174648903206, "deviation-center-line": 3.7256773160647394, "driven_lanedir_consec": 8.539820618283436}, "zigzag-000-ego3": {"driven_any": 8.603391881639052, "survival_time": 59.99999999999873, "driven_lanedir": 8.232345461440598, "in-drivable-lane": 0.4999999999999716, "deviation-heading": 11.82360532658406, "distance-from-start": 4.479531800257838, "deviation-center-line": 2.9754663224916165, "driven_lanedir_consec": 8.232345461440598}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14894529Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:03:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.00000000000002
in-drivable-lane_median0.0
driven_lanedir_consec_median1.6092636768777293
deviation-center-line_median0.6554157278922419


other stats
deviation-center-line_max0.6554157278922419
deviation-center-line_mean0.6554157278922419
deviation-center-line_min0.6554157278922419
deviation-heading_max3.4175875775760653
deviation-heading_mean3.4175875775760653
deviation-heading_median3.4175875775760653
deviation-heading_min3.4175875775760653
distance-from-start_max1.407845547522126
distance-from-start_mean1.407845547522126
distance-from-start_median1.407845547522126
distance-from-start_min1.407845547522126
driven_any_max1.7417078319863182
driven_any_mean1.7417078319863182
driven_any_median1.7417078319863182
driven_any_min1.7417078319863182
driven_lanedir_consec_max1.6092636768777293
driven_lanedir_consec_mean1.6092636768777293
driven_lanedir_consec_min1.6092636768777293
driven_lanedir_max1.6092636768777293
driven_lanedir_mean1.6092636768777293
driven_lanedir_median1.6092636768777293
driven_lanedir_min1.6092636768777293
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.7417078319863182, "survival_time": 11.00000000000002, "driven_lanedir": 1.6092636768777293, "in-drivable-lane": 0.0, "deviation-heading": 3.4175875775760653, "distance-from-start": 1.407845547522126, "deviation-center-line": 0.6554157278922419, "driven_lanedir_consec": 1.6092636768777293}}
simulation-passed1
survival_time_max11.00000000000002
survival_time_mean11.00000000000002
survival_time_min11.00000000000002
No reset possible
14889530Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:06:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median29.30000000000028
in-drivable-lane_median1.2499999999999971
driven_lanedir_consec_median4.5226685006498215
deviation-center-line_median1.2694884102369797


other stats
deviation-center-line_max1.2694884102369797
deviation-center-line_mean1.2694884102369797
deviation-center-line_min1.2694884102369797
deviation-heading_max7.219743997167535
deviation-heading_mean7.219743997167535
deviation-heading_median7.219743997167535
deviation-heading_min7.219743997167535
distance-from-start_max2.343502686899028
distance-from-start_mean2.343502686899028
distance-from-start_median2.343502686899028
distance-from-start_min2.343502686899028
driven_any_max5.090803046337011
driven_any_mean5.090803046337011
driven_any_median5.090803046337011
driven_any_min5.090803046337011
driven_lanedir_consec_max4.5226685006498215
driven_lanedir_consec_mean4.5226685006498215
driven_lanedir_consec_min4.5226685006498215
driven_lanedir_max4.5226685006498215
driven_lanedir_mean4.5226685006498215
driven_lanedir_median4.5226685006498215
driven_lanedir_min4.5226685006498215
in-drivable-lane_max1.2499999999999971
in-drivable-lane_mean1.2499999999999971
in-drivable-lane_min1.2499999999999971
per-episodes
details{"loop-000-ego0": {"driven_any": 5.090803046337011, "survival_time": 29.30000000000028, "driven_lanedir": 4.5226685006498215, "in-drivable-lane": 1.2499999999999971, "deviation-heading": 7.219743997167535, "distance-from-start": 2.343502686899028, "deviation-center-line": 1.2694884102369797, "driven_lanedir_consec": 4.5226685006498215}}
simulation-passed1
survival_time_max29.30000000000028
survival_time_mean29.30000000000028
survival_time_min29.30000000000028
No reset possible
14873534Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:21:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.14999999999999147
driven_lanedir_consec_median8.902301560514125
deviation-center-line_median3.1852194805850944


other stats
deviation-center-line_max6.134547847585762
deviation-center-line_mean3.860561706955607
deviation-center-line_min2.9372600190664775
deviation-heading_max29.00964017651232
deviation-heading_mean17.290596815944898
deviation-heading_median13.704528058230512
deviation-heading_min12.74369097080624
distance-from-start_max3.0389469599442696
distance-from-start_mean2.5033869155266117
distance-from-start_median3.0120826456572045
distance-from-start_min0.9504354108477676
driven_any_max10.437751582076467
driven_any_mean8.034632174399226
driven_any_median10.20932945328332
driven_any_min1.2821182089538012
driven_lanedir_consec_max9.119308455163493
driven_lanedir_consec_mean7.038573535898035
driven_lanedir_consec_min1.230382567400399
driven_lanedir_max9.97530418924947
driven_lanedir_mean7.614440879055349
driven_lanedir_median9.626038379785763
driven_lanedir_min1.230382567400399
in-drivable-lane_max0.5000000000000071
in-drivable-lane_mean0.1999999999999975
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 1.2821182089538012, "survival_time": 59.99999999999873, "driven_lanedir": 1.230382567400399, "in-drivable-lane": 0.0, "deviation-heading": 29.00964017651232, "distance-from-start": 0.9504354108477676, "deviation-center-line": 6.134547847585762, "driven_lanedir_consec": 1.230382567400399}, "4way-000-ego1": {"driven_any": 10.075048170419024, "survival_time": 59.99999999999873, "driven_lanedir": 9.548621768553572, "in-drivable-lane": 0.29999999999998295, "deviation-heading": 12.74369097080624, "distance-from-start": 3.0389469599442696, "deviation-center-line": 2.9372600190664775, "driven_lanedir_consec": 8.955076692644685}, "4way-000-ego2": {"driven_any": 10.343610736147616, "survival_time": 59.99999999999873, "driven_lanedir": 9.703454991017956, "in-drivable-lane": 0.5000000000000071, "deviation-heading": 14.01260970467814, "distance-from-start": 3.0012292868197368, "deviation-center-line": 3.2896919871596775, "driven_lanedir_consec": 8.849526428383566}, "4way-000-ego3": {"driven_any": 10.437751582076467, "survival_time": 59.99999999999873, "driven_lanedir": 9.97530418924947, "in-drivable-lane": 0.0, "deviation-heading": 13.396446411782886, "distance-from-start": 3.0229360044946727, "deviation-center-line": 3.080746974010511, "driven_lanedir_consec": 9.119308455163493}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14869535Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-testingsim-3of4failednodavinci-stage-04-6.2.500:01:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 722, in run_episode
    msg = await loop.run_in_executor(executor, f)
  File "/usr/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 243, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 333, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 360, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 413, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 586, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 74, in on_received_get_commands
              ||     velocity, omega = self.compute_action(self.current_image)
              ||   File "solution.py", line 70, in compute_action
              ||     action = self.model.predict(observation)
              ||   File "/workspace/model.py", line 125, in predict
              ||     is_speed_up, steering_angle = self.forward(images)
              ||   File "/workspace/model.py", line 108, in forward
              ||     features = self.feature_extractor(images)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 1102, in _call_impl
              ||     return forward_call(*input, **kwargs)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/container.py", line 141, in forward
              ||     input = module(input)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 1102, in _call_impl
              ||     return forward_call(*input, **kwargs)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/conv.py", line 446, in forward
              ||     return self._conv_forward(input, self.weight, self.bias)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/conv.py", line 442, in _conv_forward
              ||     return F.conv2d(input, weight, bias, self.stride,
              || RuntimeError: cuDNN error: CUDNN_STATUS_ALLOC_FAILED
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14867536Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-testingsim-1of4successnodavinci-stage-04-6.2.500:03:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.700000000000102
in-drivable-lane_median0.0
driven_lanedir_consec_median3.013057360133526
deviation-center-line_median1.0242442412264618


other stats
deviation-center-line_max1.0242442412264618
deviation-center-line_mean1.0242442412264618
deviation-center-line_min1.0242442412264618
deviation-heading_max4.225386681739768
deviation-heading_mean4.225386681739768
deviation-heading_median4.225386681739768
deviation-heading_min4.225386681739768
distance-from-start_max1.6578855662468808
distance-from-start_mean1.6578855662468808
distance-from-start_median1.6578855662468808
distance-from-start_min1.6578855662468808
driven_any_max3.124487464667665
driven_any_mean3.124487464667665
driven_any_median3.124487464667665
driven_any_min3.124487464667665
driven_lanedir_consec_max3.013057360133526
driven_lanedir_consec_mean3.013057360133526
driven_lanedir_consec_min3.013057360133526
driven_lanedir_max3.013057360133526
driven_lanedir_mean3.013057360133526
driven_lanedir_median3.013057360133526
driven_lanedir_min3.013057360133526
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 3.124487464667665, "survival_time": 16.700000000000102, "driven_lanedir": 3.013057360133526, "in-drivable-lane": 0.0, "deviation-heading": 4.225386681739768, "distance-from-start": 1.6578855662468808, "deviation-center-line": 1.0242442412264618, "driven_lanedir_consec": 3.013057360133526}}
simulation-passed1
survival_time_max16.700000000000102
survival_time_mean16.700000000000102
survival_time_min16.700000000000102
No reset possible
14866536Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:04:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median26.40000000000024
in-drivable-lane_median0.0
driven_lanedir_consec_median3.3459723479876877
deviation-center-line_median0.891501871812824


other stats
deviation-center-line_max0.891501871812824
deviation-center-line_mean0.891501871812824
deviation-center-line_min0.891501871812824
deviation-heading_max4.875979334952273
deviation-heading_mean4.875979334952273
deviation-heading_median4.875979334952273
deviation-heading_min4.875979334952273
distance-from-start_max2.2583851647542974
distance-from-start_mean2.2583851647542974
distance-from-start_median2.2583851647542974
distance-from-start_min2.2583851647542974
driven_any_max3.4359378846661386
driven_any_mean3.4359378846661386
driven_any_median3.4359378846661386
driven_any_min3.4359378846661386
driven_lanedir_consec_max3.3459723479876877
driven_lanedir_consec_mean3.3459723479876877
driven_lanedir_consec_min3.3459723479876877
driven_lanedir_max3.3459723479876877
driven_lanedir_mean3.3459723479876877
driven_lanedir_median3.3459723479876877
driven_lanedir_min3.3459723479876877
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.4359378846661386, "survival_time": 26.40000000000024, "driven_lanedir": 3.3459723479876877, "in-drivable-lane": 0.0, "deviation-heading": 4.875979334952273, "distance-from-start": 2.2583851647542974, "deviation-center-line": 0.891501871812824, "driven_lanedir_consec": 3.3459723479876877}}
simulation-passed1
survival_time_max26.40000000000024
survival_time_mean26.40000000000024
survival_time_min26.40000000000024
No reset possible
14863536Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-testingsim-0of4successnodavinci-stage-04-6.2.500:03:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median20.550000000000157
in-drivable-lane_median0.0
driven_lanedir_consec_median2.3814100471050494
deviation-center-line_median0.8236333937661441


other stats
deviation-center-line_max0.8236333937661441
deviation-center-line_mean0.8236333937661441
deviation-center-line_min0.8236333937661441
deviation-heading_max4.61226655284473
deviation-heading_mean4.61226655284473
deviation-heading_median4.61226655284473
deviation-heading_min4.61226655284473
distance-from-start_max2.1140618952833288
distance-from-start_mean2.1140618952833288
distance-from-start_median2.1140618952833288
distance-from-start_min2.1140618952833288
driven_any_max2.4595508590889987
driven_any_mean2.4595508590889987
driven_any_median2.4595508590889987
driven_any_min2.4595508590889987
driven_lanedir_consec_max2.3814100471050494
driven_lanedir_consec_mean2.3814100471050494
driven_lanedir_consec_min2.3814100471050494
driven_lanedir_max2.3814100471050494
driven_lanedir_mean2.3814100471050494
driven_lanedir_median2.3814100471050494
driven_lanedir_min2.3814100471050494
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.4595508590889987, "survival_time": 20.550000000000157, "driven_lanedir": 2.3814100471050494, "in-drivable-lane": 0.0, "deviation-heading": 4.61226655284473, "distance-from-start": 2.1140618952833288, "deviation-center-line": 0.8236333937661441, "driven_lanedir_consec": 2.3814100471050494}}
simulation-passed1
survival_time_max20.550000000000157
survival_time_mean20.550000000000157
survival_time_min20.550000000000157
No reset possible
14862536Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:02:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median20.300000000000153
in-drivable-lane_median2.20000000000001
driven_lanedir_consec_median2.844354784574112
deviation-center-line_median1.3197559727690185


other stats
deviation-center-line_max1.3197559727690185
deviation-center-line_mean1.3197559727690185
deviation-center-line_min1.3197559727690185
deviation-heading_max7.705932213965922
deviation-heading_mean7.705932213965922
deviation-heading_median7.705932213965922
deviation-heading_min7.705932213965922
distance-from-start_max1.6159648479576962
distance-from-start_mean1.6159648479576962
distance-from-start_median1.6159648479576962
distance-from-start_min1.6159648479576962
driven_any_max3.7273798533446785
driven_any_mean3.7273798533446785
driven_any_median3.7273798533446785
driven_any_min3.7273798533446785
driven_lanedir_consec_max2.844354784574112
driven_lanedir_consec_mean2.844354784574112
driven_lanedir_consec_min2.844354784574112
driven_lanedir_max2.844354784574112
driven_lanedir_mean2.844354784574112
driven_lanedir_median2.844354784574112
driven_lanedir_min2.844354784574112
in-drivable-lane_max2.20000000000001
in-drivable-lane_mean2.20000000000001
in-drivable-lane_min2.20000000000001
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.7273798533446785, "survival_time": 20.300000000000153, "driven_lanedir": 2.844354784574112, "in-drivable-lane": 2.20000000000001, "deviation-heading": 7.705932213965922, "distance-from-start": 1.6159648479576962, "deviation-center-line": 1.3197559727690185, "driven_lanedir_consec": 2.844354784574112}}
simulation-passed1
survival_time_max20.300000000000153
survival_time_mean20.300000000000153
survival_time_min20.300000000000153
No reset possible
14857538Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-testingsim-1of4successnodavinci-stage-04-6.2.500:05:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median18.70000000000013
in-drivable-lane_median1.0000000000000142
driven_lanedir_consec_median2.7510535200511237
deviation-center-line_median1.1568355858850894


other stats
deviation-center-line_max1.1568355858850894
deviation-center-line_mean1.1568355858850894
deviation-center-line_min1.1568355858850894
deviation-heading_max4.860373930346602
deviation-heading_mean4.860373930346602
deviation-heading_median4.860373930346602
deviation-heading_min4.860373930346602
distance-from-start_max1.0197718572386203
distance-from-start_mean1.0197718572386203
distance-from-start_median1.0197718572386203
distance-from-start_min1.0197718572386203
driven_any_max3.107257047283072
driven_any_mean3.107257047283072
driven_any_median3.107257047283072
driven_any_min3.107257047283072
driven_lanedir_consec_max2.7510535200511237
driven_lanedir_consec_mean2.7510535200511237
driven_lanedir_consec_min2.7510535200511237
driven_lanedir_max2.756037376663201
driven_lanedir_mean2.756037376663201
driven_lanedir_median2.756037376663201
driven_lanedir_min2.756037376663201
in-drivable-lane_max1.0000000000000142
in-drivable-lane_mean1.0000000000000142
in-drivable-lane_min1.0000000000000142
per-episodes
details{"4way-000-ego0": {"driven_any": 3.107257047283072, "survival_time": 18.70000000000013, "driven_lanedir": 2.756037376663201, "in-drivable-lane": 1.0000000000000142, "deviation-heading": 4.860373930346602, "distance-from-start": 1.0197718572386203, "deviation-center-line": 1.1568355858850894, "driven_lanedir_consec": 2.7510535200511237}}
simulation-passed1
survival_time_max18.70000000000013
survival_time_mean18.70000000000013
survival_time_min18.70000000000013
No reset possible
14855539Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14851541Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-testingsim-1of4successnodavinci-stage-04-6.2.500:06:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.083933855970264
survival_time_median59.99999999999873
deviation-center-line_median3.178443738933589
in-drivable-lane_median2.8499999999998877


other stats
deviation-center-line_max3.178443738933589
deviation-center-line_mean3.178443738933589
deviation-center-line_min3.178443738933589
deviation-heading_max17.917106733039663
deviation-heading_mean17.917106733039663
deviation-heading_median17.917106733039663
deviation-heading_min17.917106733039663
distance-from-start_max3.257642946582765
distance-from-start_mean3.257642946582765
distance-from-start_median3.257642946582765
distance-from-start_min3.257642946582765
driven_any_max10.469958753736591
driven_any_mean10.469958753736591
driven_any_median10.469958753736591
driven_any_min10.469958753736591
driven_lanedir_consec_max9.083933855970264
driven_lanedir_consec_mean9.083933855970264
driven_lanedir_consec_min9.083933855970264
driven_lanedir_max9.083933855970264
driven_lanedir_mean9.083933855970264
driven_lanedir_median9.083933855970264
driven_lanedir_min9.083933855970264
in-drivable-lane_max2.8499999999998877
in-drivable-lane_mean2.8499999999998877
in-drivable-lane_min2.8499999999998877
per-episodes
details{"loop-000-ego0": {"driven_any": 10.469958753736591, "survival_time": 59.99999999999873, "driven_lanedir": 9.083933855970264, "in-drivable-lane": 2.8499999999998877, "deviation-heading": 17.917106733039663, "distance-from-start": 3.257642946582765, "deviation-center-line": 3.178443738933589, "driven_lanedir_consec": 9.083933855970264}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14847542Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14842595Liam Paullbaseline-duckietownaido-LF-sim-validationsim-2of4failednodavinci-stage-04-6.2.500:00:55
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14836599Liam Paulltemplate-randomaido-hello-sim-validationsanity-checksuccessnodavinci-stage-04-6.2.500:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median1.1920928955078125e-06
deviation-center-line_median0.007457559042937448


other stats
deviation-center-line_max0.007457559042937448
deviation-center-line_mean0.007457559042937448
deviation-center-line_min0.007457559042937448
deviation-heading_max0.1966171946901932
deviation-heading_mean0.1966171946901932
deviation-heading_median0.1966171946901932
deviation-heading_min0.1966171946901932
distance-from-start_max6.280369834735102e-16
distance-from-start_mean6.280369834735102e-16
distance-from-start_median6.280369834735102e-16
distance-from-start_min6.280369834735102e-16
driven_any_max4.1538810900383696e-15
driven_any_mean4.1538810900383696e-15
driven_any_median4.1538810900383696e-15
driven_any_min4.1538810900383696e-15
driven_lanedir_consec_max1.1920928955078125e-06
driven_lanedir_consec_mean1.1920928955078125e-06
driven_lanedir_consec_min1.1920928955078125e-06
driven_lanedir_max1.1920928955078125e-06
driven_lanedir_mean1.1920928955078125e-06
driven_lanedir_median1.1920928955078125e-06
driven_lanedir_min1.1920928955078125e-06
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 4.1538810900383696e-15, "survival_time": 0.49999999999999994, "driven_lanedir": 1.1920928955078125e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.1966171946901932, "distance-from-start": 6.280369834735102e-16, "deviation-center-line": 0.007457559042937448, "driven_lanedir_consec": 1.1920928955078125e-06}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
14834600Liam Paulltemplate-tensorflowaido-LF-sim-validationsim-2of4failednodavinci-stage-04-6.2.500:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14827765Bea Baselines 🐤challenge-aido_LF-template-pytorch:daffy-staging:bc692490acbff19e3dcb581b0cdc6ef53963f802aido-hello-sim-validationsanity-checksuccessnodavinci-stage-04-6.2.500:02:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.04551503384198696
deviation-center-line_median0.006260935577470677


other stats
deviation-center-line_max0.006260935577470677
deviation-center-line_mean0.006260935577470677
deviation-center-line_min0.006260935577470677
deviation-heading_max0.27421425716052905
deviation-heading_mean0.27421425716052905
deviation-heading_median0.27421425716052905
deviation-heading_min0.27421425716052905
distance-from-start_max0.053856167047413625
distance-from-start_mean0.053856167047413625
distance-from-start_median0.053856167047413625
distance-from-start_min0.053856167047413625
driven_any_max0.0538657753089849
driven_any_mean0.0538657753089849
driven_any_median0.0538657753089849
driven_any_min0.0538657753089849
driven_lanedir_consec_max0.04551503384198696
driven_lanedir_consec_mean0.04551503384198696
driven_lanedir_consec_min0.04551503384198696
driven_lanedir_max0.04551503384198696
driven_lanedir_mean0.04551503384198696
driven_lanedir_median0.04551503384198696
driven_lanedir_min0.04551503384198696
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.0538657753089849, "survival_time": 0.49999999999999994, "driven_lanedir": 0.04551503384198696, "in-drivable-lane": 0.0, "deviation-heading": 0.27421425716052905, "distance-from-start": 0.053856167047413625, "deviation-center-line": 0.006260935577470677, "driven_lanedir_consec": 0.04551503384198696}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
14826800Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-3of4failednodavinci-stage-04-6.2.500:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14822800Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-2of4failednodavinci-stage-04-6.2.500:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14818801Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-3of4failednodavinci-stage-04-6.2.500:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14814802Bea Baselines 🐤challenge-aido_LF-template-pytorch:daffy-staging:3ee0deff6949110710f97b6d814764f4be1d4551aido-hello-sim-validationsanity-checksuccessnodavinci-stage-04-6.2.500:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.021288429219947114
deviation-center-line_median0.005489073274425835


other stats
deviation-center-line_max0.005489073274425835
deviation-center-line_mean0.005489073274425835
deviation-center-line_min0.005489073274425835
deviation-heading_max0.31213727740758623
deviation-heading_mean0.31213727740758623
deviation-heading_median0.31213727740758623
deviation-heading_min0.31213727740758623
distance-from-start_max0.028570091102786774
distance-from-start_mean0.028570091102786774
distance-from-start_median0.028570091102786774
distance-from-start_min0.028570091102786774
driven_any_max0.028736164949730504
driven_any_mean0.028736164949730504
driven_any_median0.028736164949730504
driven_any_min0.028736164949730504
driven_lanedir_consec_max0.021288429219947114
driven_lanedir_consec_mean0.021288429219947114
driven_lanedir_consec_min0.021288429219947114
driven_lanedir_max0.021288429219947114
driven_lanedir_mean0.021288429219947114
driven_lanedir_median0.021288429219947114
driven_lanedir_min0.021288429219947114
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.028736164949730504, "survival_time": 0.49999999999999994, "driven_lanedir": 0.021288429219947114, "in-drivable-lane": 0.0, "deviation-heading": 0.31213727740758623, "distance-from-start": 0.028570091102786774, "deviation-center-line": 0.005489073274425835, "driven_lanedir_consec": 0.021288429219947114}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
14811806user1000001minimal-agentaido-LFV-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:02:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.400000000000013
in-drivable-lane_median7.100000000000017
driven_lanedir_consec_median0.33123013524902545
deviation-center-line_median0.26973522366843383


other stats
deviation-center-line_max0.26973522366843383
deviation-center-line_mean0.26973522366843383
deviation-center-line_min0.26973522366843383
deviation-heading_max2.53835057480462
deviation-heading_mean2.53835057480462
deviation-heading_median2.53835057480462
deviation-heading_min2.53835057480462
distance-from-start_max1.5453191784191067
distance-from-start_mean1.5453191784191067
distance-from-start_median1.5453191784191067
distance-from-start_min1.5453191784191067
driven_any_max1.545427894810905
driven_any_mean1.545427894810905
driven_any_median1.545427894810905
driven_any_min1.545427894810905
driven_lanedir_consec_max0.33123013524902545
driven_lanedir_consec_mean0.33123013524902545
driven_lanedir_consec_min0.33123013524902545
driven_lanedir_max0.33123013524902545
driven_lanedir_mean0.33123013524902545
driven_lanedir_median0.33123013524902545
driven_lanedir_min0.33123013524902545
in-drivable-lane_max7.100000000000017
in-drivable-lane_mean7.100000000000017
in-drivable-lane_min7.100000000000017
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.545427894810905, "survival_time": 10.400000000000013, "driven_lanedir": 0.33123013524902545, "in-drivable-lane": 7.100000000000017, "deviation-heading": 2.53835057480462, "distance-from-start": 1.5453191784191067, "deviation-center-line": 0.26973522366843383, "driven_lanedir_consec": 0.33123013524902545}}
simulation-passed1
survival_time_max10.400000000000013
survival_time_mean10.400000000000013
survival_time_min10.400000000000013
No reset possible
14808806user1000001minimal-agentaido-LFV-sim-validationsim-0of4successnodavinci-stage-04-6.2.500:02:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.2
in-drivable-lane_median0.0
driven_lanedir_consec_median0.16440570511787245
deviation-center-line_median0.19162140900760455


other stats
deviation-center-line_max0.19162140900760455
deviation-center-line_mean0.19162140900760455
deviation-center-line_min0.19162140900760455
deviation-heading_max1.1939422489088862
deviation-heading_mean1.1939422489088862
deviation-heading_median1.1939422489088862
deviation-heading_min1.1939422489088862
distance-from-start_max0.19201183050647508
distance-from-start_mean0.19201183050647508
distance-from-start_median0.19201183050647508
distance-from-start_min0.19201183050647508
driven_any_max0.19201481064322065
driven_any_mean0.19201481064322065
driven_any_median0.19201481064322065
driven_any_min0.19201481064322065
driven_lanedir_consec_max0.16440570511787245
driven_lanedir_consec_mean0.16440570511787245
driven_lanedir_consec_min0.16440570511787245
driven_lanedir_max0.16440570511787245
driven_lanedir_mean0.16440570511787245
driven_lanedir_median0.16440570511787245
driven_lanedir_min0.16440570511787245
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.19201481064322065, "survival_time": 2.2, "driven_lanedir": 0.16440570511787245, "in-drivable-lane": 0.0, "deviation-heading": 1.1939422489088862, "distance-from-start": 0.19201183050647508, "deviation-center-line": 0.19162140900760455, "driven_lanedir_consec": 0.16440570511787245}}
simulation-passed1
survival_time_max2.2
survival_time_mean2.2
survival_time_min2.2
No reset possible
14806808Andrea Censitemplate-randomaido-LFV-sim-validationsim-0of4successnodavinci-stage-04-6.2.500:02:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.699999999999995
in-drivable-lane_median0.9
driven_lanedir_consec_median0.364506838392066
deviation-center-line_median0.14696541332404583


other stats
deviation-center-line_max0.14696541332404583
deviation-center-line_mean0.14696541332404583
deviation-center-line_min0.14696541332404583
deviation-heading_max1.6699264400950062
deviation-heading_mean1.6699264400950062
deviation-heading_median1.6699264400950062
deviation-heading_min1.6699264400950062
distance-from-start_max0.3743806210373658
distance-from-start_mean0.3743806210373658
distance-from-start_median0.3743806210373658
distance-from-start_min0.3743806210373658
driven_any_max0.3944302398862539
driven_any_mean0.3944302398862539
driven_any_median0.3944302398862539
driven_any_min0.3944302398862539
driven_lanedir_consec_max0.364506838392066
driven_lanedir_consec_mean0.364506838392066
driven_lanedir_consec_min0.364506838392066
driven_lanedir_max0.364506838392066
driven_lanedir_mean0.364506838392066
driven_lanedir_median0.364506838392066
driven_lanedir_min0.364506838392066
in-drivable-lane_max0.9
in-drivable-lane_mean0.9
in-drivable-lane_min0.9
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.3944302398862539, "survival_time": 3.699999999999995, "driven_lanedir": 0.364506838392066, "in-drivable-lane": 0.9, "deviation-heading": 1.6699264400950062, "distance-from-start": 0.3743806210373658, "deviation-center-line": 0.14696541332404583, "driven_lanedir_consec": 0.364506838392066}}
simulation-passed1
survival_time_max3.699999999999995
survival_time_mean3.699999999999995
survival_time_min3.699999999999995
No reset possible
14800809Andrea Censitemplate-randomaido-LFV-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:04:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median24.750000000000217
in-drivable-lane_median16.200000000000195
driven_lanedir_consec_median0.2676465159268615
deviation-center-line_median0.7555297758130887


other stats
deviation-center-line_max0.7555297758130887
deviation-center-line_mean0.7555297758130887
deviation-center-line_min0.7555297758130887
deviation-heading_max5.523299068383883
deviation-heading_mean5.523299068383883
deviation-heading_median5.523299068383883
deviation-heading_min5.523299068383883
distance-from-start_max0.796098057853727
distance-from-start_mean0.796098057853727
distance-from-start_median0.796098057853727
distance-from-start_min0.796098057853727
driven_any_max6.0666647982270385
driven_any_mean6.0666647982270385
driven_any_median6.0666647982270385
driven_any_min6.0666647982270385
driven_lanedir_consec_max0.2676465159268615
driven_lanedir_consec_mean0.2676465159268615
driven_lanedir_consec_min0.2676465159268615
driven_lanedir_max0.24963703198272744
driven_lanedir_mean0.24963703198272744
driven_lanedir_median0.24963703198272744
driven_lanedir_min0.24963703198272744
in-drivable-lane_max16.200000000000195
in-drivable-lane_mean16.200000000000195
in-drivable-lane_min16.200000000000195
per-episodes
details{"loop2-000-ego0": {"driven_any": 6.0666647982270385, "survival_time": 24.750000000000217, "driven_lanedir": 0.24963703198272744, "in-drivable-lane": 16.200000000000195, "deviation-heading": 5.523299068383883, "distance-from-start": 0.796098057853727, "deviation-center-line": 0.7555297758130887, "driven_lanedir_consec": 0.2676465159268615}}
simulation-passed1
survival_time_max24.750000000000217
survival_time_mean24.750000000000217
survival_time_min24.750000000000217
No reset possible
14797815Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:04:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.692768953399423
deviation-center-line_median0.22838243511519724


other stats
deviation-center-line_max0.22838243511519724
deviation-center-line_mean0.22838243511519724
deviation-center-line_min0.22838243511519724
deviation-heading_max2.327018578184933
deviation-heading_mean2.327018578184933
deviation-heading_median2.327018578184933
deviation-heading_min2.327018578184933
distance-from-start_max1.517284045125221
distance-from-start_mean1.517284045125221
distance-from-start_median1.517284045125221
distance-from-start_min1.517284045125221
driven_any_max5.702917901484924
driven_any_mean5.702917901484924
driven_any_median5.702917901484924
driven_any_min5.702917901484924
driven_lanedir_consec_max5.692768953399423
driven_lanedir_consec_mean5.692768953399423
driven_lanedir_consec_min5.692768953399423
driven_lanedir_max5.692768953399423
driven_lanedir_mean5.692768953399423
driven_lanedir_median5.692768953399423
driven_lanedir_min5.692768953399423
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 5.702917901484924, "survival_time": 59.99999999999873, "driven_lanedir": 5.692768953399423, "in-drivable-lane": 0.0, "deviation-heading": 2.327018578184933, "distance-from-start": 1.517284045125221, "deviation-center-line": 0.22838243511519724, "driven_lanedir_consec": 5.692768953399423}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14792816Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:05:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.560422051338984
deviation-center-line_median0.27120156757925695


other stats
deviation-center-line_max0.27120156757925695
deviation-center-line_mean0.27120156757925695
deviation-center-line_min0.27120156757925695
deviation-heading_max2.2601023015918167
deviation-heading_mean2.2601023015918167
deviation-heading_median2.2601023015918167
deviation-heading_min2.2601023015918167
distance-from-start_max2.771434789584769
distance-from-start_mean2.771434789584769
distance-from-start_median2.771434789584769
distance-from-start_min2.771434789584769
driven_any_max5.976806373273059
driven_any_mean5.976806373273059
driven_any_median5.976806373273059
driven_any_min5.976806373273059
driven_lanedir_consec_max5.560422051338984
driven_lanedir_consec_mean5.560422051338984
driven_lanedir_consec_min5.560422051338984
driven_lanedir_max5.964295771107123
driven_lanedir_mean5.964295771107123
driven_lanedir_median5.964295771107123
driven_lanedir_min5.964295771107123
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-000-ego0": {"driven_any": 5.976806373273059, "survival_time": 59.99999999999873, "driven_lanedir": 5.964295771107123, "in-drivable-lane": 0.0, "deviation-heading": 2.2601023015918167, "distance-from-start": 2.771434789584769, "deviation-center-line": 0.27120156757925695, "driven_lanedir_consec": 5.560422051338984}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14787818Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-validationsim-0of4successnodavinci-stage-04-6.2.500:10:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.4477076357371352
deviation-center-line_median0.0719572483263306


other stats
deviation-center-line_max0.0719572483263306
deviation-center-line_mean0.0719572483263306
deviation-center-line_min0.0719572483263306
deviation-heading_max1.9197947517405864
deviation-heading_mean1.9197947517405864
deviation-heading_median1.9197947517405864
deviation-heading_min1.9197947517405864
distance-from-start_max0.4476854412517205
distance-from-start_mean0.4476854412517205
distance-from-start_median0.4476854412517205
distance-from-start_min0.4476854412517205
driven_any_max0.4483014753438006
driven_any_mean0.4483014753438006
driven_any_median0.4483014753438006
driven_any_min0.4483014753438006
driven_lanedir_consec_max0.4477076357371352
driven_lanedir_consec_mean0.4477076357371352
driven_lanedir_consec_min0.4477076357371352
driven_lanedir_max0.4477076357371352
driven_lanedir_mean0.4477076357371352
driven_lanedir_median0.4477076357371352
driven_lanedir_min0.4477076357371352
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-001-ego0": {"driven_any": 0.4483014753438006, "survival_time": 59.99999999999873, "driven_lanedir": 0.4477076357371352, "in-drivable-lane": 0.0, "deviation-heading": 1.9197947517405864, "distance-from-start": 0.4476854412517205, "deviation-center-line": 0.0719572483263306, "driven_lanedir_consec": 0.4477076357371352}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14782819Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-validation456successnodavinci-stage-04-6.2.500:09:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.336943150269365
deviation-center-line_median0.35398135932393326


other stats
deviation-center-line_max0.5002723744132395
deviation-center-line_mean0.3710099660307943
deviation-center-line_min0.2758047710620712
deviation-heading_max3.615679561969475
deviation-heading_mean2.9390617656596474
deviation-heading_median2.8878718185667296
deviation-heading_min2.3648238635356553
distance-from-start_max3.2765040404829486
distance-from-start_mean2.8250819441849204
distance-from-start_median2.852533000136213
distance-from-start_min2.318757735984306
driven_any_max5.690932498547804
driven_any_mean5.3619025577410895
driven_any_median5.347462119618692
driven_any_min5.061753493179171
driven_lanedir_consec_max5.663935077640696
driven_lanedir_consec_mean5.346442419212684
driven_lanedir_consec_min5.047948298671309
driven_lanedir_max5.663935077640696
driven_lanedir_mean5.346442419212684
driven_lanedir_median5.336943150269365
driven_lanedir_min5.047948298671309
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.061753493179171, "survival_time": 59.99999999999873, "driven_lanedir": 5.047948298671309, "in-drivable-lane": 0.0, "deviation-heading": 2.825842325600178, "distance-from-start": 2.436784412155726, "deviation-center-line": 0.3373147013146382, "driven_lanedir_consec": 5.047948298671309}, "zigzag-000-ego1": {"driven_any": 5.690932498547804, "survival_time": 59.99999999999873, "driven_lanedir": 5.663935077640696, "in-drivable-lane": 0.0, "deviation-heading": 3.615679561969475, "distance-from-start": 3.2682815881167, "deviation-center-line": 0.5002723744132395, "driven_lanedir_consec": 5.663935077640696}, "zigzag-000-ego2": {"driven_any": 5.452544223950681, "survival_time": 59.99999999999873, "driven_lanedir": 5.438806889847818, "in-drivable-lane": 0.0, "deviation-heading": 2.9499013115332806, "distance-from-start": 3.2765040404829486, "deviation-center-line": 0.37064801733322833, "driven_lanedir_consec": 5.438806889847818}, "zigzag-000-ego3": {"driven_any": 5.242380015286703, "survival_time": 59.99999999999873, "driven_lanedir": 5.235079410690911, "in-drivable-lane": 0.0, "deviation-heading": 2.3648238635356553, "distance-from-start": 2.318757735984306, "deviation-center-line": 0.2758047710620712, "driven_lanedir_consec": 5.235079410690911}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14776820Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:04:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8948975282353535


other stats
deviation-center-line_max0.8948975282353535
deviation-center-line_mean0.8948975282353535
deviation-center-line_min0.8948975282353535
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max2.482534153247273e-16
distance-from-start_mean2.482534153247273e-16
distance-from-start_median2.482534153247273e-16
distance-from-start_min2.482534153247273e-16
driven_any_max2.9790409838966753e-13
driven_any_mean2.9790409838966753e-13
driven_any_median2.9790409838966753e-13
driven_any_min2.9790409838966753e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 0.8948975282353535, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14767823Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:11:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.38577379311006
deviation-center-line_median0.2253916973044201


other stats
deviation-center-line_max0.25150945762104626
deviation-center-line_mean0.2258728989276509
deviation-center-line_min0.20119874348071703
deviation-heading_max1.870868162450936
deviation-heading_mean1.6814661218930986
deviation-heading_median1.6978808943178063
deviation-heading_min1.4592345364858448
distance-from-start_max2.4901635835539864
distance-from-start_mean2.340615857594544
distance-from-start_median2.4217755218392245
distance-from-start_min2.0287488031457404
driven_any_max5.888840872450049
driven_any_mean5.666255234642627
driven_any_median5.696354385105463
driven_any_min5.383471295909528
driven_lanedir_consec_max5.88286659371623
driven_lanedir_consec_mean5.383274938407007
driven_lanedir_consec_min4.878685573691682
driven_lanedir_max5.88286659371623
driven_lanedir_mean5.6600988125150735
driven_lanedir_median5.689408214739162
driven_lanedir_min5.378712226865741
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-001-ego0": {"driven_any": 5.589326286428048, "survival_time": 59.99999999999873, "driven_lanedir": 5.583554682769149, "in-drivable-lane": 0.0, "deviation-heading": 1.828622792773347, "distance-from-start": 2.3544469360186357, "deviation-center-line": 0.2485102614270095, "driven_lanedir_consec": 4.878685573691682}, "4way-001-ego1": {"driven_any": 5.888840872450049, "survival_time": 59.99999999999873, "driven_lanedir": 5.88286659371623, "in-drivable-lane": 0.0, "deviation-heading": 1.4592345364858448, "distance-from-start": 2.4891041076598133, "deviation-center-line": 0.20119874348071703, "driven_lanedir_consec": 5.88286659371623}, "4way-001-ego2": {"driven_any": 5.803382483782878, "survival_time": 59.99999999999873, "driven_lanedir": 5.795261746709174, "in-drivable-lane": 0.0, "deviation-heading": 1.870868162450936, "distance-from-start": 2.4901635835539864, "deviation-center-line": 0.25150945762104626, "driven_lanedir_consec": 5.392835359354378}, "4way-001-ego3": {"driven_any": 5.383471295909528, "survival_time": 59.99999999999873, "driven_lanedir": 5.378712226865741, "in-drivable-lane": 0.0, "deviation-heading": 1.567138995862266, "distance-from-start": 2.0287488031457404, "deviation-center-line": 0.2022731331818307, "driven_lanedir_consec": 5.378712226865741}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14762824Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:10:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.9255344112495525
deviation-center-line_median0.16823253637776917


other stats
deviation-center-line_max0.16823253637776917
deviation-center-line_mean0.16823253637776917
deviation-center-line_min0.16823253637776917
deviation-heading_max1.2427067181497071
deviation-heading_mean1.2427067181497071
deviation-heading_median1.2427067181497071
deviation-heading_min1.2427067181497071
distance-from-start_max3.1528512934161523
distance-from-start_mean3.1528512934161523
distance-from-start_median3.1528512934161523
distance-from-start_min3.1528512934161523
driven_any_max5.930776876357659
driven_any_mean5.930776876357659
driven_any_median5.930776876357659
driven_any_min5.930776876357659
driven_lanedir_consec_max5.9255344112495525
driven_lanedir_consec_mean5.9255344112495525
driven_lanedir_consec_min5.9255344112495525
driven_lanedir_max5.9255344226858995
driven_lanedir_mean5.9255344226858995
driven_lanedir_median5.9255344226858995
driven_lanedir_min5.9255344226858995
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-001-ego0": {"driven_any": 5.930776876357659, "survival_time": 59.99999999999873, "driven_lanedir": 5.9255344226858995, "in-drivable-lane": 0.0, "deviation-heading": 1.2427067181497071, "distance-from-start": 3.1528512934161523, "deviation-center-line": 0.16823253637776917, "driven_lanedir_consec": 5.9255344112495525}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14757825Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-testingsim-1of4successnodavinci-stage-04-6.2.500:09:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.432891091920204
deviation-center-line_median0.289208824985897


other stats
deviation-center-line_max0.3421554544578389
deviation-center-line_mean0.28103246849939895
deviation-center-line_min0.20355676956796287
deviation-heading_max2.532090128626256
deviation-heading_mean2.1233379748915846
deviation-heading_median2.091598288393426
deviation-heading_min1.77806519415323
distance-from-start_max3.1537593976013736
distance-from-start_mean2.7244723642293835
distance-from-start_median2.704318718385367
distance-from-start_min2.3354926225454276
driven_any_max5.681727317187617
driven_any_mean5.356790518866223
driven_any_median5.444463301686621
driven_any_min4.856508154904032
driven_lanedir_consec_max5.66768880982045
driven_lanedir_consec_mean5.346200743455493
driven_lanedir_consec_min4.851331980161115
driven_lanedir_max5.66768880982045
driven_lanedir_mean5.346200743455493
driven_lanedir_median5.432891091920204
driven_lanedir_min4.851331980161115
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 5.292009447895602, "survival_time": 59.99999999999873, "driven_lanedir": 5.278658727024759, "in-drivable-lane": 0.0, "deviation-heading": 2.532090128626256, "distance-from-start": 2.693777297091483, "deviation-center-line": 0.295448770789397, "driven_lanedir_consec": 5.278658727024759}, "loop-000-ego1": {"driven_any": 5.596917155477642, "survival_time": 59.99999999999873, "driven_lanedir": 5.5871234568156485, "in-drivable-lane": 0.0, "deviation-heading": 2.16404711059614, "distance-from-start": 2.3354926225454276, "deviation-center-line": 0.3421554544578389, "driven_lanedir_consec": 5.5871234568156485}, "loop-000-ego2": {"driven_any": 4.856508154904032, "survival_time": 59.99999999999873, "driven_lanedir": 4.851331980161115, "in-drivable-lane": 0.0, "deviation-heading": 1.77806519415323, "distance-from-start": 3.1537593976013736, "deviation-center-line": 0.20355676956796287, "driven_lanedir_consec": 4.851331980161115}, "loop-000-ego3": {"driven_any": 5.681727317187617, "survival_time": 59.99999999999873, "driven_lanedir": 5.66768880982045, "in-drivable-lane": 0.0, "deviation-heading": 2.0191494661907115, "distance-from-start": 2.7148601396792507, "deviation-center-line": 0.282968879182397, "driven_lanedir_consec": 5.66768880982045}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14748827Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-testingsim-0of4successnodavinci-stage-04-6.2.500:11:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.1417360050531755
deviation-center-line_median0.53453245126959


other stats
deviation-center-line_max0.53453245126959
deviation-center-line_mean0.53453245126959
deviation-center-line_min0.53453245126959
deviation-heading_max4.002468114919836
deviation-heading_mean4.002468114919836
deviation-heading_median4.002468114919836
deviation-heading_min4.002468114919836
distance-from-start_max3.4062886142559416
distance-from-start_mean3.4062886142559416
distance-from-start_median3.4062886142559416
distance-from-start_min3.4062886142559416
driven_any_max5.164260198360464
driven_any_mean5.164260198360464
driven_any_median5.164260198360464
driven_any_min5.164260198360464
driven_lanedir_consec_max5.1417360050531755
driven_lanedir_consec_mean5.1417360050531755
driven_lanedir_consec_min5.1417360050531755
driven_lanedir_max5.1417360050531755
driven_lanedir_mean5.1417360050531755
driven_lanedir_median5.1417360050531755
driven_lanedir_min5.1417360050531755
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 5.164260198360464, "survival_time": 59.99999999999873, "driven_lanedir": 5.1417360050531755, "in-drivable-lane": 0.0, "deviation-heading": 4.002468114919836, "distance-from-start": 3.4062886142559416, "deviation-center-line": 0.53453245126959, "driven_lanedir_consec": 5.1417360050531755}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14738911Bea Baselines 🐤baseline-solutionlx22-planning-dd-static-valistep1-0of4erroryesdavinci-stage-04-6.2.500:17:02
Waited 1000 seconds [...]
Waited 1000 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14729914Bea Baselines 🐤baseline-solutionlx22-planning-cc-static-valistep1-0of4successyesdavinci-stage-04-6.2.500:12:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration51.85669812417199
complexity120.66666666666669
avg_min_distance0.21382628904148104


other stats
nfeasible3
nsamples3
No reset possible
14728914Bea Baselines 🐤baseline-solutionlx22-planning-cc-static-valistep1-3of4successyesdavinci-stage-04-6.2.500:00:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
14727914Bea Baselines 🐤baseline-solutionlx22-planning-cc-static-valistep1-2of4successyesdavinci-stage-04-6.2.500:00:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
14720917Bea Baselines 🐤baseline-solutionlx22-planning-dd-static-teststep1-2of4erroryesdavinci-stage-04-6.2.500:17:05
Waited 1004 seconds [...]
Waited 1004 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14717918Bea Baselines 🐤baseline-solutionlx22-planning-dd-empty-teststep1successyesdavinci-stage-04-6.2.500:11:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio1.0
duration11.168187248703932
complexity15.925925925925926
avg_min_distance0.8746658000716123


other stats
nfeasible27
nsamples27
No reset possible
14703929Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:10:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median54.74999999999903
in-drivable-lane_median8.650000000000112
driven_lanedir_consec_median4.741684308414983
deviation-center-line_median1.971933541239024


other stats
deviation-center-line_max1.971933541239024
deviation-center-line_mean1.971933541239024
deviation-center-line_min1.971933541239024
deviation-heading_max12.65175373073032
deviation-heading_mean12.65175373073032
deviation-heading_median12.65175373073032
deviation-heading_min12.65175373073032
distance-from-start_max2.271617627148934
distance-from-start_mean2.271617627148934
distance-from-start_median2.271617627148934
distance-from-start_min2.271617627148934
driven_any_max7.124097190543854
driven_any_mean7.124097190543854
driven_any_median7.124097190543854
driven_any_min7.124097190543854
driven_lanedir_consec_max4.741684308414983
driven_lanedir_consec_mean4.741684308414983
driven_lanedir_consec_min4.741684308414983
driven_lanedir_max5.455072762089677
driven_lanedir_mean5.455072762089677
driven_lanedir_median5.455072762089677
driven_lanedir_min5.455072762089677
in-drivable-lane_max8.650000000000112
in-drivable-lane_mean8.650000000000112
in-drivable-lane_min8.650000000000112
per-episodes
details{"loop-000-ego0": {"driven_any": 7.124097190543854, "survival_time": 54.74999999999903, "driven_lanedir": 5.455072762089677, "in-drivable-lane": 8.650000000000112, "deviation-heading": 12.65175373073032, "distance-from-start": 2.271617627148934, "deviation-center-line": 1.971933541239024, "driven_lanedir_consec": 4.741684308414983}}
simulation-passed1
survival_time_max54.74999999999903
survival_time_mean54.74999999999903
survival_time_min54.74999999999903
No reset possible
14697960Bea Baselines 🐤template-pytorchaido-LFV-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:06:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median40.14999999999986
in-drivable-lane_median19.24999999999993
driven_lanedir_consec_median1.7077794621450355
deviation-center-line_median2.0321479137988083


other stats
deviation-center-line_max2.0321479137988083
deviation-center-line_mean2.0321479137988083
deviation-center-line_min2.0321479137988083
deviation-heading_max16.013328454936694
deviation-heading_mean16.013328454936694
deviation-heading_median16.013328454936694
deviation-heading_min16.013328454936694
distance-from-start_max0.4442970929596283
distance-from-start_mean0.4442970929596283
distance-from-start_median0.4442970929596283
distance-from-start_min0.4442970929596283
driven_any_max5.1341814137263775
driven_any_mean5.1341814137263775
driven_any_median5.1341814137263775
driven_any_min5.1341814137263775
driven_lanedir_consec_max1.7077794621450355
driven_lanedir_consec_mean1.7077794621450355
driven_lanedir_consec_min1.7077794621450355
driven_lanedir_max1.7077794621450355
driven_lanedir_mean1.7077794621450355
driven_lanedir_median1.7077794621450355
driven_lanedir_min1.7077794621450355
in-drivable-lane_max19.24999999999993
in-drivable-lane_mean19.24999999999993
in-drivable-lane_min19.24999999999993
per-episodes
details{"loop2-000-ego0": {"driven_any": 5.1341814137263775, "survival_time": 40.14999999999986, "driven_lanedir": 1.7077794621450355, "in-drivable-lane": 19.24999999999993, "deviation-heading": 16.013328454936694, "distance-from-start": 0.4442970929596283, "deviation-center-line": 2.0321479137988083, "driven_lanedir_consec": 1.7077794621450355}}
simulation-passed1
survival_time_max40.14999999999986
survival_time_mean40.14999999999986
survival_time_min40.14999999999986
No reset possible
14683964Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-0of4successnodavinci-stage-04-6.2.500:27:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median53.72499999999869
driven_lanedir_consec_median0.235423945072358
deviation-center-line_median0.4678247937836101


other stats
deviation-center-line_max1.4962621344465716
deviation-center-line_mean0.6143671307926453
deviation-center-line_min0.02555680115678908
deviation-heading_max23.3438977753944
deviation-heading_mean8.541949760636317
deviation-heading_median5.036635453412643
deviation-heading_min0.750630360325587
distance-from-start_max0.7448924649144328
distance-from-start_mean0.32711218434875616
distance-from-start_median0.2344857736023891
distance-from-start_min0.0945847252758136
driven_any_max7.807890174509247
driven_any_mean2.8095999803770213
driven_any_median1.6224627013153752
driven_any_min0.1855843443680882
driven_lanedir_consec_max1.0815677143297815
driven_lanedir_consec_mean0.40149808794931474
driven_lanedir_consec_min0.05357674732276152
driven_lanedir_max1.0815677143297815
driven_lanedir_mean0.5495348480990945
driven_lanedir_median0.5314974653719174
driven_lanedir_min0.05357674732276152
in-drivable-lane_max58.99999999999873
in-drivable-lane_mean48.94999999999888
in-drivable-lane_min29.349999999999387
per-episodes
details{"udem-000-ego0": {"driven_any": 7.807890174509247, "survival_time": 59.99999999999873, "driven_lanedir": 0.9889909096222316, "in-drivable-lane": 48.84999999999864, "deviation-heading": 9.222916919280385, "distance-from-start": 0.7448924649144328, "deviation-center-line": 0.8578740776069982, "driven_lanedir_consec": 0.39684386902311264}, "udem-000-ego1": {"driven_any": 0.1855843443680882, "survival_time": 59.99999999999873, "driven_lanedir": 0.05357674732276152, "in-drivable-lane": 58.99999999999873, "deviation-heading": 0.8503539875449022, "distance-from-start": 0.17650808698184864, "deviation-center-line": 0.077775509960222, "driven_lanedir_consec": 0.05357674732276152}, "udem-000-ego2": {"driven_any": 3.009487024938911, "survival_time": 59.99999999999873, "driven_lanedir": 1.0815677143297815, "in-drivable-lane": 29.349999999999387, "deviation-heading": 23.3438977753944, "distance-from-start": 0.29246346022292957, "deviation-center-line": 1.4962621344465716, "driven_lanedir_consec": 1.0815677143297815}, "udem-000-ego3": {"driven_any": 0.23543837769183948, "survival_time": 59.99999999999873, "driven_lanedir": 0.07400402112160331, "in-drivable-lane": 58.59999999999873, "deviation-heading": 0.750630360325587, "distance-from-start": 0.0945847252758136, "deviation-center-line": 0.02555680115678908, "driven_lanedir_consec": 0.07400402112160331}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14679964Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:07:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median17.85000000000012
in-drivable-lane_median16.425000000000118
driven_lanedir_consec_median0.111781976966007
deviation-center-line_median0.05581423511863176


other stats
deviation-center-line_max0.5582083685874936
deviation-center-line_mean0.17439284598201416
deviation-center-line_min0.0277345451032995
deviation-heading_max6.723948530129747
deviation-heading_mean2.2445911243070027
deviation-heading_median0.8361109487746415
deviation-heading_min0.5821940695489799
distance-from-start_max0.23391344676814713
distance-from-start_mean0.12197430716141326
distance-from-start_median0.1007279563306366
distance-from-start_min0.05252786921623274
driven_any_max1.825049558449368
driven_any_mean0.6122904202529028
driven_any_median0.27662830235295544
driven_any_min0.07085551785633239
driven_lanedir_consec_max0.547565968164073
driven_lanedir_consec_mean0.19407696605788743
driven_lanedir_consec_min0.005177942135462743
driven_lanedir_max0.547565968164073
driven_lanedir_mean0.19407696605788743
driven_lanedir_median0.111781976966007
driven_lanedir_min0.005177942135462743
in-drivable-lane_max17.15000000000012
in-drivable-lane_mean14.825000000000106
in-drivable-lane_min9.300000000000068
per-episodes
details{"4way-000-ego0": {"driven_any": 1.825049558449368, "survival_time": 17.85000000000012, "driven_lanedir": 0.547565968164073, "in-drivable-lane": 9.300000000000068, "deviation-heading": 6.723948530129747, "distance-from-start": 0.07425938267682983, "deviation-center-line": 0.5582083685874936, "driven_lanedir_consec": 0.547565968164073}, "4way-000-ego1": {"driven_any": 0.07085551785633239, "survival_time": 17.85000000000012, "driven_lanedir": 0.005177942135462743, "in-drivable-lane": 17.15000000000012, "deviation-heading": 0.5821940695489799, "distance-from-start": 0.05252786921623274, "deviation-center-line": 0.0277345451032995, "driven_lanedir_consec": 0.005177942135462743}, "4way-000-ego2": {"driven_any": 0.14768151133427293, "survival_time": 17.85000000000012, "driven_lanedir": 0.04066035276405966, "in-drivable-lane": 16.85000000000012, "deviation-heading": 0.7031713973553879, "distance-from-start": 0.12719652998444336, "deviation-center-line": 0.03433846570480393, "driven_lanedir_consec": 0.04066035276405966}, "4way-000-ego3": {"driven_any": 0.4055750933716379, "survival_time": 17.85000000000012, "driven_lanedir": 0.18290360116795432, "in-drivable-lane": 16.000000000000117, "deviation-heading": 0.9690505001938952, "distance-from-start": 0.23391344676814713, "deviation-center-line": 0.0772900045324596, "driven_lanedir_consec": 0.18290360116795432}}
simulation-passed1
survival_time_max17.85000000000012
survival_time_mean17.85000000000012
survival_time_min17.85000000000012
No reset possible
14677964Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14668972Bea Baselines 🐤template-pytorchaido-LFV-sim-testingsim-0of4successnodavinci-stage-04-6.2.500:18:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median53.1499999999987
driven_lanedir_consec_median0.8747542464203091
deviation-center-line_median0.523419945544555


other stats
deviation-center-line_max0.523419945544555
deviation-center-line_mean0.523419945544555
deviation-center-line_min0.523419945544555
deviation-heading_max4.947459360087781
deviation-heading_mean4.947459360087781
deviation-heading_median4.947459360087781
deviation-heading_min4.947459360087781
distance-from-start_max0.7584585284303127
distance-from-start_mean0.7584585284303127
distance-from-start_median0.7584585284303127
distance-from-start_min0.7584585284303127
driven_any_max12.85874773780132
driven_any_mean12.85874773780132
driven_any_median12.85874773780132
driven_any_min12.85874773780132
driven_lanedir_consec_max0.8747542464203091
driven_lanedir_consec_mean0.8747542464203091
driven_lanedir_consec_min0.8747542464203091
driven_lanedir_max0.8747542464203091
driven_lanedir_mean0.8747542464203091
driven_lanedir_median0.8747542464203091
driven_lanedir_min0.8747542464203091
in-drivable-lane_max53.1499999999987
in-drivable-lane_mean53.1499999999987
in-drivable-lane_min53.1499999999987
per-episodes
details{"autolab-000-ego0": {"driven_any": 12.85874773780132, "survival_time": 59.99999999999873, "driven_lanedir": 0.8747542464203091, "in-drivable-lane": 53.1499999999987, "deviation-heading": 4.947459360087781, "distance-from-start": 0.7584585284303127, "deviation-center-line": 0.523419945544555, "driven_lanedir_consec": 0.8747542464203091}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14663973Bea Baselines 🐤template-pytorchaido-LFVI-sim-testingsim-1of4successnodavinci-stage-04-6.2.500:02:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.1999999999999966
in-drivable-lane_median1.899999999999996
driven_lanedir_consec_median0.051382385536334896
deviation-center-line_median0.018232801110085024


other stats
deviation-center-line_max0.018232801110085024
deviation-center-line_mean0.018232801110085024
deviation-center-line_min0.018232801110085024
deviation-heading_max0.8322319427746856
deviation-heading_mean0.8322319427746856
deviation-heading_median0.8322319427746856
deviation-heading_min0.8322319427746856
distance-from-start_max0.07061181872260575
distance-from-start_mean0.07061181872260575
distance-from-start_median0.07061181872260575
distance-from-start_min0.07061181872260575
driven_any_max0.1800847127397037
driven_any_mean0.1800847127397037
driven_any_median0.1800847127397037
driven_any_min0.1800847127397037
driven_lanedir_consec_max0.051382385536334896
driven_lanedir_consec_mean0.051382385536334896
driven_lanedir_consec_min0.051382385536334896
driven_lanedir_max0.051382385536334896
driven_lanedir_mean0.051382385536334896
driven_lanedir_median0.051382385536334896
driven_lanedir_min0.051382385536334896
in-drivable-lane_max1.899999999999996
in-drivable-lane_mean1.899999999999996
in-drivable-lane_min1.899999999999996
per-episodes
details{"4way-000-ego0": {"driven_any": 0.1800847127397037, "survival_time": 3.1999999999999966, "driven_lanedir": 0.051382385536334896, "in-drivable-lane": 1.899999999999996, "deviation-heading": 0.8322319427746856, "distance-from-start": 0.07061181872260575, "deviation-center-line": 0.018232801110085024, "driven_lanedir_consec": 0.051382385536334896}}
simulation-passed1
survival_time_max3.1999999999999966
survival_time_mean3.1999999999999966
survival_time_min3.1999999999999966
No reset possible
14654975Bea Baselines 🐤template-pytorchaido-LF-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:08:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.724407529728774
survival_time_median59.99999999999873
deviation-center-line_median3.0557123821411856
in-drivable-lane_median32.14999999999924


other stats
deviation-center-line_max3.0557123821411856
deviation-center-line_mean3.0557123821411856
deviation-center-line_min3.0557123821411856
deviation-heading_max22.24728546074651
deviation-heading_mean22.24728546074651
deviation-heading_median22.24728546074651
deviation-heading_min22.24728546074651
distance-from-start_max0.39072718780386817
distance-from-start_mean0.39072718780386817
distance-from-start_median0.39072718780386817
distance-from-start_min0.39072718780386817
driven_any_max5.5425375881507435
driven_any_mean5.5425375881507435
driven_any_median5.5425375881507435
driven_any_min5.5425375881507435
driven_lanedir_consec_max1.724407529728774
driven_lanedir_consec_mean1.724407529728774
driven_lanedir_consec_min1.724407529728774
driven_lanedir_max1.724407529728774
driven_lanedir_mean1.724407529728774
driven_lanedir_median1.724407529728774
driven_lanedir_min1.724407529728774
in-drivable-lane_max32.14999999999924
in-drivable-lane_mean32.14999999999924
in-drivable-lane_min32.14999999999924
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.5425375881507435, "survival_time": 59.99999999999873, "driven_lanedir": 1.724407529728774, "in-drivable-lane": 32.14999999999924, "deviation-heading": 22.24728546074651, "distance-from-start": 0.39072718780386817, "deviation-center-line": 3.0557123821411856, "driven_lanedir_consec": 1.724407529728774}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14653975Bea Baselines 🐤template-pytorchaido-LF-sim-testingsim-1of4successnodavinci-stage-04-6.2.500:07:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4377608817448284
survival_time_median59.99999999999873
deviation-center-line_median0.937925092223324
in-drivable-lane_median49.74999999999865


other stats
deviation-center-line_max0.937925092223324
deviation-center-line_mean0.937925092223324
deviation-center-line_min0.937925092223324
deviation-heading_max6.396726794316972
deviation-heading_mean6.396726794316972
deviation-heading_median6.396726794316972
deviation-heading_min6.396726794316972
distance-from-start_max0.5579848596786671
distance-from-start_mean0.5579848596786671
distance-from-start_median0.5579848596786671
distance-from-start_min0.5579848596786671
driven_any_max12.225582432985886
driven_any_mean12.225582432985886
driven_any_median12.225582432985886
driven_any_min12.225582432985886
driven_lanedir_consec_max1.4377608817448284
driven_lanedir_consec_mean1.4377608817448284
driven_lanedir_consec_min1.4377608817448284
driven_lanedir_max1.4377608817448284
driven_lanedir_mean1.4377608817448284
driven_lanedir_median1.4377608817448284
driven_lanedir_min1.4377608817448284
in-drivable-lane_max49.74999999999865
in-drivable-lane_mean49.74999999999865
in-drivable-lane_min49.74999999999865
per-episodes
details{"loop-000-ego0": {"driven_any": 12.225582432985886, "survival_time": 59.99999999999873, "driven_lanedir": 1.4377608817448284, "in-drivable-lane": 49.74999999999865, "deviation-heading": 6.396726794316972, "distance-from-start": 0.5579848596786671, "deviation-center-line": 0.937925092223324, "driven_lanedir_consec": 1.4377608817448284}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14652976Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:02:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
14648977Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:13:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median40.52499999999898
driven_lanedir_consec_median1.7511631892808648
deviation-center-line_median2.2687108818884525


other stats
deviation-center-line_max2.6382911611221367
deviation-center-line_mean2.2687108818884525
deviation-center-line_min1.8991306026547683
deviation-heading_max18.80679176168204
deviation-heading_mean14.718821715412007
deviation-heading_median14.718821715412007
deviation-heading_min10.630851669141975
distance-from-start_max0.6020582306348224
distance-from-start_mean0.4912028590829956
distance-from-start_median0.4912028590829956
distance-from-start_min0.3803474875311688
driven_any_max11.387660003371838
driven_any_mean8.063086251300732
driven_any_median8.063086251300732
driven_any_min4.738512499229624
driven_lanedir_consec_max2.509679947372163
driven_lanedir_consec_mean1.7511631892808648
driven_lanedir_consec_min0.9926464311895664
driven_lanedir_max2.509679947372163
driven_lanedir_mean1.7511631892808648
driven_lanedir_median1.7511631892808648
driven_lanedir_min0.9926464311895664
in-drivable-lane_max42.249999999999005
in-drivable-lane_mean40.52499999999898
in-drivable-lane_min38.79999999999896
per-episodes
details{"loop2-000-ego0": {"driven_any": 4.738512499229624, "survival_time": 59.99999999999873, "driven_lanedir": 0.9926464311895664, "in-drivable-lane": 38.79999999999896, "deviation-heading": 18.80679176168204, "distance-from-start": 0.6020582306348224, "deviation-center-line": 2.6382911611221367, "driven_lanedir_consec": 0.9926464311895664}, "loop2-000-ego1": {"driven_any": 11.387660003371838, "survival_time": 59.99999999999873, "driven_lanedir": 2.509679947372163, "in-drivable-lane": 42.249999999999005, "deviation-heading": 10.630851669141975, "distance-from-start": 0.3803474875311688, "deviation-center-line": 1.8991306026547683, "driven_lanedir_consec": 2.509679947372163}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14641978Bea Baselines 🐤template-pytorchaido-LFP-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:02:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median18.10000000000012
in-drivable-lane_median14.750000000000126
driven_lanedir_consec_median0.3553934472927729
deviation-center-line_median0.2752550993211545


other stats
deviation-center-line_max0.2752550993211545
deviation-center-line_mean0.2752550993211545
deviation-center-line_min0.2752550993211545
deviation-heading_max2.066314843613227
deviation-heading_mean2.066314843613227
deviation-heading_median2.066314843613227
deviation-heading_min2.066314843613227
distance-from-start_max0.8177821674263538
distance-from-start_mean0.8177821674263538
distance-from-start_median0.8177821674263538
distance-from-start_min0.8177821674263538
driven_any_max2.9502110044689145
driven_any_mean2.9502110044689145
driven_any_median2.9502110044689145
driven_any_min2.9502110044689145
driven_lanedir_consec_max0.3553934472927729
driven_lanedir_consec_mean0.3553934472927729
driven_lanedir_consec_min0.3553934472927729
driven_lanedir_max0.3553934472927729
driven_lanedir_mean0.3553934472927729
driven_lanedir_median0.3553934472927729
driven_lanedir_min0.3553934472927729
in-drivable-lane_max14.750000000000126
in-drivable-lane_mean14.750000000000126
in-drivable-lane_min14.750000000000126
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.9502110044689145, "survival_time": 18.10000000000012, "driven_lanedir": 0.3553934472927729, "in-drivable-lane": 14.750000000000126, "deviation-heading": 2.066314843613227, "distance-from-start": 0.8177821674263538, "deviation-center-line": 0.2752550993211545, "driven_lanedir_consec": 0.3553934472927729}}
simulation-passed1
survival_time_max18.10000000000012
survival_time_mean18.10000000000012
survival_time_min18.10000000000012
No reset possible
14638980Bea Baselines 🐤template-rosaido-LF-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:01:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.22391525256268777
survival_time_median7.299999999999982
deviation-center-line_median0.09186411163867415
in-drivable-lane_median6.049999999999981


other stats
deviation-center-line_max0.09186411163867415
deviation-center-line_mean0.09186411163867415
deviation-center-line_min0.09186411163867415
deviation-heading_max0.6274232220195933
deviation-heading_mean0.6274232220195933
deviation-heading_median0.6274232220195933
deviation-heading_min0.6274232220195933
distance-from-start_max1.7754796790823328
distance-from-start_mean1.7754796790823328
distance-from-start_median1.7754796790823328
distance-from-start_min1.7754796790823328
driven_any_max1.811291721556882
driven_any_mean1.811291721556882
driven_any_median1.811291721556882
driven_any_min1.811291721556882
driven_lanedir_consec_max0.22391525256268777
driven_lanedir_consec_mean0.22391525256268777
driven_lanedir_consec_min0.22391525256268777
driven_lanedir_max0.22391525256268777
driven_lanedir_mean0.22391525256268777
driven_lanedir_median0.22391525256268777
driven_lanedir_min0.22391525256268777
in-drivable-lane_max6.049999999999981
in-drivable-lane_mean6.049999999999981
in-drivable-lane_min6.049999999999981
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.811291721556882, "survival_time": 7.299999999999982, "driven_lanedir": 0.22391525256268777, "in-drivable-lane": 6.049999999999981, "deviation-heading": 0.6274232220195933, "distance-from-start": 1.7754796790823328, "deviation-center-line": 0.09186411163867415, "driven_lanedir_consec": 0.22391525256268777}}
simulation-passed1
survival_time_max7.299999999999982
survival_time_mean7.299999999999982
survival_time_min7.299999999999982
No reset possible
14636981Bea Baselines 🐤template-tensorflowaido-LFV-sim-validationsim-0of4failednodavinci-stage-04-6.2.500:01:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14631982Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:06:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8949084199908675


other stats
deviation-center-line_max0.8949084199908675
deviation-center-line_mean0.8949084199908675
deviation-center-line_min0.8949084199908675
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max4.002966042486721e-16
distance-from-start_mean4.002966042486721e-16
distance-from-start_median4.002966042486721e-16
distance-from-start_min4.002966042486721e-16
driven_any_max4.803559250983913e-13
driven_any_mean4.803559250983913e-13
driven_any_median4.803559250983913e-13
driven_any_min4.803559250983913e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 4.803559250983913e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.002966042486721e-16, "deviation-center-line": 0.8949084199908675, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14625986Bea Baselines 🐤baseline-duckietownaido-LF-sim-validationsim-0of4successnodavinci-stage-04-6.2.500:05:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.365429666065143
survival_time_median59.99999999999873
deviation-center-line_median3.442715110291029
in-drivable-lane_median4.950000000000006


other stats
deviation-center-line_max3.442715110291029
deviation-center-line_mean3.442715110291029
deviation-center-line_min3.442715110291029
deviation-heading_max9.526185431942071
deviation-heading_mean9.526185431942071
deviation-heading_median9.526185431942071
deviation-heading_min9.526185431942071
distance-from-start_max2.3227127075333773
distance-from-start_mean2.3227127075333773
distance-from-start_median2.3227127075333773
distance-from-start_min2.3227127075333773
driven_any_max7.907852893260013
driven_any_mean7.907852893260013
driven_any_median7.907852893260013
driven_any_min7.907852893260013
driven_lanedir_consec_max5.365429666065143
driven_lanedir_consec_mean5.365429666065143
driven_lanedir_consec_min5.365429666065143
driven_lanedir_max6.9697431695302114
driven_lanedir_mean6.9697431695302114
driven_lanedir_median6.9697431695302114
driven_lanedir_min6.9697431695302114
in-drivable-lane_max4.950000000000006
in-drivable-lane_mean4.950000000000006
in-drivable-lane_min4.950000000000006
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.907852893260013, "survival_time": 59.99999999999873, "driven_lanedir": 6.9697431695302114, "in-drivable-lane": 4.950000000000006, "deviation-heading": 9.526185431942071, "distance-from-start": 2.3227127075333773, "deviation-center-line": 3.442715110291029, "driven_lanedir_consec": 5.365429666065143}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14620987Bea Baselines 🐤template-rosaido-LF-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1851601597936607
survival_time_median5.449999999999989
deviation-center-line_median0.07027595468128714
in-drivable-lane_median4.399999999999989


other stats
deviation-center-line_max0.07027595468128714
deviation-center-line_mean0.07027595468128714
deviation-center-line_min0.07027595468128714
deviation-heading_max0.5995608126050261
deviation-heading_mean0.5995608126050261
deviation-heading_median0.5995608126050261
deviation-heading_min0.5995608126050261
distance-from-start_max1.3056115077780983
distance-from-start_mean1.3056115077780983
distance-from-start_median1.3056115077780983
distance-from-start_min1.3056115077780983
driven_any_max1.328013491551752
driven_any_mean1.328013491551752
driven_any_median1.328013491551752
driven_any_min1.328013491551752
driven_lanedir_consec_max0.1851601597936607
driven_lanedir_consec_mean0.1851601597936607
driven_lanedir_consec_min0.1851601597936607
driven_lanedir_max0.1851601597936607
driven_lanedir_mean0.1851601597936607
driven_lanedir_median0.1851601597936607
driven_lanedir_min0.1851601597936607
in-drivable-lane_max4.399999999999989
in-drivable-lane_mean4.399999999999989
in-drivable-lane_min4.399999999999989
per-episodes
details{"loop-000-ego0": {"driven_any": 1.328013491551752, "survival_time": 5.449999999999989, "driven_lanedir": 0.1851601597936607, "in-drivable-lane": 4.399999999999989, "deviation-heading": 0.5995608126050261, "distance-from-start": 1.3056115077780983, "deviation-center-line": 0.07027595468128714, "driven_lanedir_consec": 0.1851601597936607}}
simulation-passed1
survival_time_max5.449999999999989
survival_time_mean5.449999999999989
survival_time_min5.449999999999989
No reset possible
14616989Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-validationsim-1of4failednodavinci-stage-04-6.2.500:01:14
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14610990Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-validationsim-3of4failednodavinci-stage-04-6.2.500:01:16
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14605991Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-validationsim-2of4failednodavinci-stage-04-6.2.500:01:12
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14601993Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-validationsim-3of4failednodavinci-stage-04-6.2.500:01:11
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14596993Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-validationsim-1of4failednodavinci-stage-04-6.2.500:01:11
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14592995Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-validationsim-0of4failednodavinci-stage-04-6.2.500:00:58
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145851007Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-testingsim-0of4failednodavinci-stage-04-6.2.500:01:24
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145821008Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-testingsim-3of4failednodavinci-stage-04-6.2.500:01:15
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145781009Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-testingsim-2of4failednodavinci-stage-04-6.2.500:01:13
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145741009Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-testingsim-0of4failednodavinci-stage-04-6.2.500:01:13
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145701011Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-testingsim-2of4failednodavinci-stage-04-6.2.500:01:11
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145661011Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-testingsim-3of4failednodavinci-stage-04-6.2.500:01:10
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
145491015Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-validationsim-0of4successnodavinci-stage-04-6.2.500:08:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median37.50000000000001
in-drivable-lane_median1.500000000000021
driven_lanedir_consec_median3.4450947629026936
deviation-center-line_median2.646270259693296


other stats
deviation-center-line_max2.646270259693296
deviation-center-line_mean2.646270259693296
deviation-center-line_min2.646270259693296
deviation-heading_max7.42337089214144
deviation-heading_mean7.42337089214144
deviation-heading_median7.42337089214144
deviation-heading_min7.42337089214144
distance-from-start_max3.154568497929932
distance-from-start_mean3.154568497929932
distance-from-start_median3.154568497929932
distance-from-start_min3.154568497929932
driven_any_max4.834162093292226
driven_any_mean4.834162093292226
driven_any_median4.834162093292226
driven_any_min4.834162093292226
driven_lanedir_consec_max3.4450947629026936
driven_lanedir_consec_mean3.4450947629026936
driven_lanedir_consec_min3.4450947629026936
driven_lanedir_max4.367787399699036
driven_lanedir_mean4.367787399699036
driven_lanedir_median4.367787399699036
driven_lanedir_min4.367787399699036
in-drivable-lane_max1.500000000000021
in-drivable-lane_mean1.500000000000021
in-drivable-lane_min1.500000000000021
per-episodes
details{"udem-000-ego0": {"driven_any": 4.834162093292226, "survival_time": 37.50000000000001, "driven_lanedir": 4.367787399699036, "in-drivable-lane": 1.500000000000021, "deviation-heading": 7.42337089214144, "distance-from-start": 3.154568497929932, "deviation-center-line": 2.646270259693296, "driven_lanedir_consec": 3.4450947629026936}}
simulation-passed1
survival_time_max37.50000000000001
survival_time_mean37.50000000000001
survival_time_min37.50000000000001
No reset possible
145461016Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:01:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
145451016Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-validationsim-0of4successnodavinci-stage-04-6.2.500:02:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.349999999999989
in-drivable-lane_median0.0
driven_lanedir_consec_median0.5408980649418136
deviation-center-line_median0.22420792691927757


other stats
deviation-center-line_max0.22420792691927757
deviation-center-line_mean0.22420792691927757
deviation-center-line_min0.22420792691927757
deviation-heading_max1.271601344911955
deviation-heading_mean1.271601344911955
deviation-heading_median1.271601344911955
deviation-heading_min1.271601344911955
distance-from-start_max0.5341275945753144
distance-from-start_mean0.5341275945753144
distance-from-start_median0.5341275945753144
distance-from-start_min0.5341275945753144
driven_any_max0.5589539070677016
driven_any_mean0.5589539070677016
driven_any_median0.5589539070677016
driven_any_min0.5589539070677016
driven_lanedir_consec_max0.5408980649418136
driven_lanedir_consec_mean0.5408980649418136
driven_lanedir_consec_min0.5408980649418136
driven_lanedir_max0.5417266865916166
driven_lanedir_mean0.5417266865916166
driven_lanedir_median0.5417266865916166
driven_lanedir_min0.5417266865916166
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 0.5589539070677016, "survival_time": 5.349999999999989, "driven_lanedir": 0.5417266865916166, "in-drivable-lane": 0.0, "deviation-heading": 1.271601344911955, "distance-from-start": 0.5341275945753144, "deviation-center-line": 0.22420792691927757, "driven_lanedir_consec": 0.5408980649418136}}
simulation-passed1
survival_time_max5.349999999999989
survival_time_mean5.349999999999989
survival_time_min5.349999999999989
No reset possible
145381018Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:18:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median51.14999999999923
in-drivable-lane_median8.624999999999995
driven_lanedir_consec_median1.3434888725834448
deviation-center-line_median3.945168608516011


other stats
deviation-center-line_max5.94798916272211
deviation-center-line_mean3.5346260732315784
deviation-center-line_min0.3001779131721807
deviation-heading_max40.32005893695534
deviation-heading_mean15.844900052991289
deviation-heading_median10.56553646425214
deviation-heading_min1.9284683465055297
distance-from-start_max2.4280569331263417
distance-from-start_mean1.4048218415713514
distance-from-start_median1.2396345758208138
distance-from-start_min0.7119612815174354
driven_any_max6.645699222186771
driven_any_mean3.3201061726998344
driven_any_median2.6960452318239803
driven_any_min1.2426350049646064
driven_lanedir_consec_max3.582685470530282
driven_lanedir_consec_mean1.765716131571592
driven_lanedir_consec_min0.7932013105891971
driven_lanedir_max4.544734505193018
driven_lanedir_mean2.377785484176901
driven_lanedir_median2.0866030604626946
driven_lanedir_min0.7932013105891971
in-drivable-lane_max43.99999999999923
in-drivable-lane_mean15.312499999999805
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 2.7824143308711133, "survival_time": 51.14999999999923, "driven_lanedir": 2.621735584605637, "in-drivable-lane": 0.0, "deviation-heading": 9.61382284909005, "distance-from-start": 1.7180263043663508, "deviation-center-line": 5.94798916272211, "driven_lanedir_consec": 1.6397474832481322}, "4way-000-ego1": {"driven_any": 2.6096761327768467, "survival_time": 51.14999999999923, "driven_lanedir": 1.5514705363197527, "in-drivable-lane": 5.150000000000062, "deviation-heading": 40.32005893695534, "distance-from-start": 0.7612428472752766, "deviation-center-line": 5.122564347206897, "driven_lanedir_consec": 1.0472302619187572}, "4way-000-ego2": {"driven_any": 6.645699222186771, "survival_time": 51.14999999999923, "driven_lanedir": 4.544734505193018, "in-drivable-lane": 12.099999999999929, "deviation-heading": 11.517250079414229, "distance-from-start": 2.4280569331263417, "deviation-center-line": 2.7677728698251256, "driven_lanedir_consec": 3.582685470530282}, "4way-000-ego3": {"driven_any": 1.2426350049646064, "survival_time": 51.14999999999923, "driven_lanedir": 0.7932013105891971, "in-drivable-lane": 43.99999999999923, "deviation-heading": 1.9284683465055297, "distance-from-start": 0.7119612815174354, "deviation-center-line": 0.3001779131721807, "driven_lanedir_consec": 0.7932013105891971}}
simulation-passed1
survival_time_max51.14999999999923
survival_time_mean51.14999999999923
survival_time_min51.14999999999923
No reset possible
145351018Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
145331019Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:03:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.150000000000095
in-drivable-lane_median10.025000000000109
driven_lanedir_consec_median0.7155459538628006
deviation-center-line_median0.48105316902220274


other stats
deviation-center-line_max0.4981781310874603
deviation-center-line_mean0.48105316902220274
deviation-center-line_min0.46392820695694525
deviation-heading_max2.275116739481306
deviation-heading_mean1.8221943936703917
deviation-heading_median1.8221943936703917
deviation-heading_min1.3692720478594769
distance-from-start_max1.7065843261939926
distance-from-start_mean1.1368470467440344
distance-from-start_median1.1368470467440344
distance-from-start_min0.5671097672940759
driven_any_max1.9928925671292963
driven_any_mean1.335672397912721
driven_any_median1.335672397912721
driven_any_min0.6784522286961455
driven_lanedir_consec_max0.8154621053763224
driven_lanedir_consec_mean0.7155459538628006
driven_lanedir_consec_min0.615629802349279
driven_lanedir_max0.8154621053763224
driven_lanedir_mean0.7155459538628006
driven_lanedir_median0.7155459538628006
driven_lanedir_min0.615629802349279
in-drivable-lane_max10.900000000000103
in-drivable-lane_mean10.025000000000109
in-drivable-lane_min9.150000000000112
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.9928925671292963, "survival_time": 16.150000000000095, "driven_lanedir": 0.8154621053763224, "in-drivable-lane": 9.150000000000112, "deviation-heading": 2.275116739481306, "distance-from-start": 1.7065843261939926, "deviation-center-line": 0.46392820695694525, "driven_lanedir_consec": 0.8154621053763224}, "loop2-000-ego1": {"driven_any": 0.6784522286961455, "survival_time": 16.150000000000095, "driven_lanedir": 0.615629802349279, "in-drivable-lane": 10.900000000000103, "deviation-heading": 1.3692720478594769, "distance-from-start": 0.5671097672940759, "deviation-center-line": 0.4981781310874603, "driven_lanedir_consec": 0.615629802349279}}
simulation-passed1
survival_time_max16.150000000000095
survival_time_mean16.150000000000095
survival_time_min16.150000000000095
No reset possible
145251032Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:14:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median53.14999999999912
in-drivable-lane_median2.349999999999961
driven_lanedir_consec_median4.089811893386584
deviation-center-line_median3.8004521431054377


other stats
deviation-center-line_max3.8004521431054377
deviation-center-line_mean3.8004521431054377
deviation-center-line_min3.8004521431054377
deviation-heading_max17.678419924594426
deviation-heading_mean17.678419924594426
deviation-heading_median17.678419924594426
deviation-heading_min17.678419924594426
distance-from-start_max3.0862105321403357
distance-from-start_mean3.0862105321403357
distance-from-start_median3.0862105321403357
distance-from-start_min3.0862105321403357
driven_any_max6.911629938002818
driven_any_mean6.911629938002818
driven_any_median6.911629938002818
driven_any_min6.911629938002818
driven_lanedir_consec_max4.089811893386584
driven_lanedir_consec_mean4.089811893386584
driven_lanedir_consec_min4.089811893386584
driven_lanedir_max5.9054607953377065
driven_lanedir_mean5.9054607953377065
driven_lanedir_median5.9054607953377065
driven_lanedir_min5.9054607953377065
in-drivable-lane_max2.349999999999961
in-drivable-lane_mean2.349999999999961
in-drivable-lane_min2.349999999999961
per-episodes
details{"zigzag-000-ego0": {"driven_any": 6.911629938002818, "survival_time": 53.14999999999912, "driven_lanedir": 5.9054607953377065, "in-drivable-lane": 2.349999999999961, "deviation-heading": 17.678419924594426, "distance-from-start": 3.0862105321403357, "deviation-center-line": 3.8004521431054377, "driven_lanedir_consec": 4.089811893386584}}
simulation-passed1
survival_time_max53.14999999999912
survival_time_mean53.14999999999912
survival_time_min53.14999999999912
No reset possible
145221033Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
145171034Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:02:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
145141035Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-testingsim-1of4successnodavinci-stage-04-6.2.500:05:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.912480469834864
survival_time_median59.99999999999873
deviation-center-line_median3.799240122140146
in-drivable-lane_median5.49999999999997


other stats
deviation-center-line_max3.799240122140146
deviation-center-line_mean3.799240122140146
deviation-center-line_min3.799240122140146
deviation-heading_max10.542962340715494
deviation-heading_mean10.542962340715494
deviation-heading_median10.542962340715494
deviation-heading_min10.542962340715494
distance-from-start_max2.831627841192258
distance-from-start_mean2.831627841192258
distance-from-start_median2.831627841192258
distance-from-start_min2.831627841192258
driven_any_max7.907539255809936
driven_any_mean7.907539255809936
driven_any_median7.907539255809936
driven_any_min7.907539255809936
driven_lanedir_consec_max3.912480469834864
driven_lanedir_consec_mean3.912480469834864
driven_lanedir_consec_min3.912480469834864
driven_lanedir_max6.777731391487915
driven_lanedir_mean6.777731391487915
driven_lanedir_median6.777731391487915
driven_lanedir_min6.777731391487915
in-drivable-lane_max5.49999999999997
in-drivable-lane_mean5.49999999999997
in-drivable-lane_min5.49999999999997
per-episodes
details{"loop-000-ego0": {"driven_any": 7.907539255809936, "survival_time": 59.99999999999873, "driven_lanedir": 6.777731391487915, "in-drivable-lane": 5.49999999999997, "deviation-heading": 10.542962340715494, "distance-from-start": 2.831627841192258, "deviation-center-line": 3.799240122140146, "driven_lanedir_consec": 3.912480469834864}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
145111035Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:05:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.43168796187337
survival_time_median59.99999999999873
deviation-center-line_median4.398833289207252
in-drivable-lane_median16.79999999999923


other stats
deviation-center-line_max4.398833289207252
deviation-center-line_mean4.398833289207252
deviation-center-line_min4.398833289207252
deviation-heading_max9.026358784535129
deviation-heading_mean9.026358784535129
deviation-heading_median9.026358784535129
deviation-heading_min9.026358784535129
distance-from-start_max3.1195894414073573
distance-from-start_mean3.1195894414073573
distance-from-start_median3.1195894414073573
distance-from-start_min3.1195894414073573
driven_any_max7.907800318883154
driven_any_mean7.907800318883154
driven_any_median7.907800318883154
driven_any_min7.907800318883154
driven_lanedir_consec_max5.43168796187337
driven_lanedir_consec_mean5.43168796187337
driven_lanedir_consec_min5.43168796187337
driven_lanedir_max5.43168796187337
driven_lanedir_mean5.43168796187337
driven_lanedir_median5.43168796187337
driven_lanedir_min5.43168796187337
in-drivable-lane_max16.79999999999923
in-drivable-lane_mean16.79999999999923
in-drivable-lane_min16.79999999999923
per-episodes
details{"zigzag-000-ego0": {"driven_any": 7.907800318883154, "survival_time": 59.99999999999873, "driven_lanedir": 5.43168796187337, "in-drivable-lane": 16.79999999999923, "deviation-heading": 9.026358784535129, "distance-from-start": 3.1195894414073573, "deviation-center-line": 4.398833289207252, "driven_lanedir_consec": 5.43168796187337}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
145091036Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:02:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
145071036Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-testingsim-0of4successnodavinci-stage-04-6.2.500:07:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.150000000000095
in-drivable-lane_median1.8249999999999953
driven_lanedir_consec_median0.8062430311072992
deviation-center-line_median1.0537782877122366


other stats
deviation-center-line_max1.9839826904437157
deviation-center-line_mean1.219635139104828
deviation-center-line_min0.7870012905511232
deviation-heading_max4.464923461199657
deviation-heading_mean3.934640242839722
deviation-heading_median3.822512901103563
deviation-heading_min3.628611707952106
distance-from-start_max1.9029102136938283
distance-from-start_mean0.957421049450264
distance-from-start_median0.7266047798325332
distance-from-start_min0.4735644244421614
driven_any_max1.9994617393576912
driven_any_mean1.486572501129533
driven_any_median1.7304473566411922
driven_any_min0.4859335518780558
driven_lanedir_consec_max1.9303024433630185
driven_lanedir_consec_mean1.0035457396074272
driven_lanedir_consec_min0.4713944528520919
driven_lanedir_max1.9365291346613596
driven_lanedir_mean1.095674362075957
driven_lanedir_median0.9873869303951884
driven_lanedir_min0.4713944528520919
in-drivable-lane_max5.5500000000000576
in-drivable-lane_mean2.3000000000000123
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 1.9994617393576912, "survival_time": 16.150000000000095, "driven_lanedir": 1.9365291346613596, "in-drivable-lane": 0.0, "deviation-heading": 3.6533794656641216, "distance-from-start": 1.9029102136938283, "deviation-center-line": 0.8948177819920778, "driven_lanedir_consec": 1.9303024433630185}, "udem-000-ego1": {"driven_any": 0.4859335518780558, "survival_time": 16.150000000000095, "driven_lanedir": 0.4713944528520919, "in-drivable-lane": 0.0, "deviation-heading": 4.464923461199657, "distance-from-start": 0.4735644244421614, "deviation-center-line": 1.9839826904437157, "driven_lanedir_consec": 0.4713944528520919}, "udem-000-ego2": {"driven_any": 1.999375403714575, "survival_time": 16.150000000000095, "driven_lanedir": 1.153228080138471, "in-drivable-lane": 5.5500000000000576, "deviation-heading": 3.628611707952106, "distance-from-start": 0.9692397557378016, "deviation-center-line": 0.7870012905511232, "driven_lanedir_consec": 1.0082798069604826}, "udem-000-ego3": {"driven_any": 1.4615193095678094, "survival_time": 16.150000000000095, "driven_lanedir": 0.821545780651906, "in-drivable-lane": 3.6499999999999906, "deviation-heading": 3.991646336543005, "distance-from-start": 0.48396980392726496, "deviation-center-line": 1.2127387934323954, "driven_lanedir_consec": 0.6042062552541159}}
simulation-passed1
survival_time_max16.150000000000095
survival_time_mean16.150000000000095
survival_time_min16.150000000000095
No reset possible
145041038Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-testingsim-1of4successnodavinci-stage-04-6.2.500:01:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.749999999999988
in-drivable-lane_median0.0
driven_lanedir_consec_median0.597778586636559
deviation-center-line_median0.21664064404362213


other stats
deviation-center-line_max0.21664064404362213
deviation-center-line_mean0.21664064404362213
deviation-center-line_min0.21664064404362213
deviation-heading_max1.1389098376007971
deviation-heading_mean1.1389098376007971
deviation-heading_median1.1389098376007971
deviation-heading_min1.1389098376007971
distance-from-start_max0.5753841573592428
distance-from-start_mean0.5753841573592428
distance-from-start_median0.5753841573592428
distance-from-start_min0.5753841573592428
driven_any_max0.6120740161655013
driven_any_mean0.6120740161655013
driven_any_median0.6120740161655013
driven_any_min0.6120740161655013
driven_lanedir_consec_max0.597778586636559
driven_lanedir_consec_mean0.597778586636559
driven_lanedir_consec_min0.597778586636559
driven_lanedir_max0.597778586636559
driven_lanedir_mean0.597778586636559
driven_lanedir_median0.597778586636559
driven_lanedir_min0.597778586636559
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 0.6120740161655013, "survival_time": 5.749999999999988, "driven_lanedir": 0.597778586636559, "in-drivable-lane": 0.0, "deviation-heading": 1.1389098376007971, "distance-from-start": 0.5753841573592428, "deviation-center-line": 0.21664064404362213, "driven_lanedir_consec": 0.597778586636559}}
simulation-passed1
survival_time_max5.749999999999988
survival_time_mean5.749999999999988
survival_time_min5.749999999999988
No reset possible
144911040Bea Baselines 🐤baseline-duckietownaido-LFV-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:09:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8949116056299469


other stats
deviation-center-line_max0.8949116056299469
deviation-center-line_mean0.8949116056299469
deviation-center-line_min0.8949116056299469
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max4.577566798522237e-16
distance-from-start_mean4.577566798522237e-16
distance-from-start_median4.577566798522237e-16
distance-from-start_min4.577566798522237e-16
driven_any_max5.49308015822675e-13
driven_any_mean5.49308015822675e-13
driven_any_median5.49308015822675e-13
driven_any_min5.49308015822675e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 5.49308015822675e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.577566798522237e-16, "deviation-center-line": 0.8949116056299469, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144781043Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-validationsim-0of4successnodavinci-stage-04-6.2.500:13:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median1.511712681694341


other stats
deviation-center-line_max2.946761767849859
deviation-center-line_mean1.5769794398758672
deviation-center-line_min0.33773062826492745
deviation-heading_max32.249113233675025
deviation-heading_mean22.83949643715976
deviation-heading_median22.597265680122995
deviation-heading_min13.914341154718024
distance-from-start_max6.661338147750939e-16
distance-from-start_mean3.0054922785922e-16
distance-from-start_median2.6803154833089315e-16
distance-from-start_min0.0
driven_any_max7.993605777301127e-13
driven_any_mean3.6065907343106473e-13
driven_any_median3.216378579970732e-13
driven_any_min0.0
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 7.993605777301127e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 6.661338147750939e-16, "deviation-center-line": 0.8949084199908675, "driven_lanedir_consec": 0.0}, "udem-000-ego1": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 2.1285169433978144, "driven_lanedir_consec": 0.0}, "udem-000-ego2": {"driven_any": 3.7682219008410875e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 14.481564596168331, "distance-from-start": 3.1401849173675503e-16, "deviation-center-line": 2.946761767849859, "driven_lanedir_consec": 0.0}, "udem-000-ego3": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 13.914341154718024, "distance-from-start": 0.0, "deviation-center-line": 0.33773062826492745, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144651057Bea Baselines 🐤baseline-duckietownaido-LFV-sim-testingsim-1of4successnodavinci-stage-04-6.2.500:09:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.4065243130134252


other stats
deviation-center-line_max0.4065243130134252
deviation-center-line_mean0.4065243130134252
deviation-center-line_min0.4065243130134252
deviation-heading_max40.967332753486254
deviation-heading_mean40.967332753486254
deviation-heading_median40.967332753486254
deviation-heading_min40.967332753486254
distance-from-start_max1.1102230246251563e-16
distance-from-start_mean1.1102230246251563e-16
distance-from-start_median1.1102230246251563e-16
distance-from-start_min1.1102230246251563e-16
driven_any_max1.3322676295501878e-13
driven_any_mean1.3322676295501878e-13
driven_any_median1.3322676295501878e-13
driven_any_min1.3322676295501878e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 0.4065243130134252, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144571059Bea Baselines 🐤baseline-duckietownaido-LFI-sim-testingsim-0of4successnodavinci-stage-04-6.2.500:05:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.4065102356187873


other stats
deviation-center-line_max0.4065102356187873
deviation-center-line_mean0.4065102356187873
deviation-center-line_min0.4065102356187873
deviation-heading_max40.967332753486225
deviation-heading_mean40.967332753486225
deviation-heading_median40.967332753486225
deviation-heading_min40.967332753486225
distance-from-start_max7.63278329429795e-17
distance-from-start_mean7.63278329429795e-17
distance-from-start_median7.63278329429795e-17
distance-from-start_min7.63278329429795e-17
driven_any_max9.15933995315754e-14
driven_any_mean9.15933995315754e-14
driven_any_median9.15933995315754e-14
driven_any_min9.15933995315754e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 9.15933995315754e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 7.63278329429795e-17, "deviation-center-line": 0.4065102356187873, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144541060Bea Baselines 🐤baseline-duckietownaido-LF-sim-testingsim-0of4successnodavinci-stage-04-6.2.500:04:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median0.4065197925359665
in-drivable-lane_median0.0


other stats
deviation-center-line_max0.4065197925359665
deviation-center-line_mean0.4065197925359665
deviation-center-line_min0.4065197925359665
deviation-heading_max40.967332753486254
deviation-heading_mean40.967332753486254
deviation-heading_median40.967332753486254
deviation-heading_min40.967332753486254
distance-from-start_max5.095246377785861e-16
distance-from-start_mean5.095246377785861e-16
distance-from-start_median5.095246377785861e-16
distance-from-start_min5.095246377785861e-16
driven_any_max6.114295653343089e-13
driven_any_mean6.114295653343089e-13
driven_any_median6.114295653343089e-13
driven_any_min6.114295653343089e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 6.114295653343089e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 5.095246377785861e-16, "deviation-center-line": 0.4065197925359665, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144461062Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-testingsim-1of4successnodavinci-stage-04-6.2.500:12:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median1.5844880209937735


other stats
deviation-center-line_max3.468399422782216
deviation-center-line_mean1.7151250413734709
deviation-center-line_min0.22312470072411936
deviation-heading_max40.967332753486225
deviation-heading_mean25.437951450471505
deviation-heading_median28.06618021079834
deviation-heading_min4.652112626803105
distance-from-start_max1.1102230246251563e-16
distance-from-start_mean3.4694469519536136e-17
distance-from-start_median1.3877787807814457e-17
distance-from-start_min0.0
driven_any_max1.3322676295501878e-13
driven_any_mean4.1633363423443377e-14
driven_any_median1.6653345369377348e-14
driven_any_min0.0
driven_lanedir_consec_max0.0001430511474609375
driven_lanedir_consec_mean3.5762786865234375e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.0001430511474609375
driven_lanedir_mean3.5762786865234375e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 3.3306690738754696e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 2.7755575615628914e-17, "deviation-center-line": 0.4065134212579011, "driven_lanedir_consec": 0.0}, "loop-000-ego1": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005157, "distance-from-start": 0.0, "deviation-center-line": 3.468399422782216, "driven_lanedir_consec": 0.0}, "loop-000-ego2": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 4.652112626803105, "distance-from-start": 0.0, "deviation-center-line": 0.22312470072411936, "driven_lanedir_consec": 0.0}, "loop-000-ego3": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 2.7624626207296465, "driven_lanedir_consec": 0.0001430511474609375}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144331065Bea Baselines 🐤baseline-simple-yieldaido-hello-sim-state-validationsanity-checksuccessnodavinci-stage-04-6.2.500:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.02249654394867484
deviation-center-line_median0.0052536287874529785


other stats
deviation-center-line_max0.0052536287874529785
deviation-center-line_mean0.0052536287874529785
deviation-center-line_min0.0052536287874529785
deviation-heading_max0.2537079422480557
deviation-heading_mean0.2537079422480557
deviation-heading_median0.2537079422480557
deviation-heading_min0.2537079422480557
distance-from-start_max0.025223546623389756
distance-from-start_mean0.025223546623389756
distance-from-start_median0.025223546623389756
distance-from-start_min0.025223546623389756
driven_any_max0.025243366614066683
driven_any_mean0.025243366614066683
driven_any_median0.025243366614066683
driven_any_min0.025243366614066683
driven_lanedir_consec_max0.02249654394867484
driven_lanedir_consec_mean0.02249654394867484
driven_lanedir_consec_min0.02249654394867484
driven_lanedir_max0.02249654394867484
driven_lanedir_mean0.02249654394867484
driven_lanedir_median0.02249654394867484
driven_lanedir_min0.02249654394867484
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.025243366614066683, "survival_time": 0.49999999999999994, "driven_lanedir": 0.02249654394867484, "in-drivable-lane": 0.0, "deviation-heading": 0.2537079422480557, "distance-from-start": 0.025223546623389756, "deviation-center-line": 0.0052536287874529785, "driven_lanedir_consec": 0.02249654394867484}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
144241207Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
144211208Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:04:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.1499999999999666
driven_lanedir_consec_median1.4203998040440715
deviation-center-line_median4.904463356399461


other stats
deviation-center-line_max4.904463356399461
deviation-center-line_mean4.904463356399461
deviation-center-line_min4.904463356399461
deviation-heading_max7.745124858723169
deviation-heading_mean7.745124858723169
deviation-heading_median7.745124858723169
deviation-heading_min7.745124858723169
distance-from-start_max1.2059816832534165
distance-from-start_mean1.2059816832534165
distance-from-start_median1.2059816832534165
distance-from-start_min1.2059816832534165
driven_any_max3.485084016236962
driven_any_mean3.485084016236962
driven_any_median3.485084016236962
driven_any_min3.485084016236962
driven_lanedir_consec_max1.4203998040440715
driven_lanedir_consec_mean1.4203998040440715
driven_lanedir_consec_min1.4203998040440715
driven_lanedir_max3.2905050472289954
driven_lanedir_mean3.2905050472289954
driven_lanedir_median3.2905050472289954
driven_lanedir_min3.2905050472289954
in-drivable-lane_max3.1499999999999666
in-drivable-lane_mean3.1499999999999666
in-drivable-lane_min3.1499999999999666
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.485084016236962, "survival_time": 59.99999999999873, "driven_lanedir": 3.2905050472289954, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.745124858723169, "distance-from-start": 1.2059816832534165, "deviation-center-line": 4.904463356399461, "driven_lanedir_consec": 1.4203998040440715}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144161209Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:07:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median5.099999999999877
driven_lanedir_consec_median2.8916689297600247
deviation-center-line_median5.681440925821353


other stats
deviation-center-line_max5.681440925821353
deviation-center-line_mean5.681440925821353
deviation-center-line_min5.681440925821353
deviation-heading_max11.493741379653043
deviation-heading_mean11.493741379653043
deviation-heading_median11.493741379653043
deviation-heading_min11.493741379653043
distance-from-start_max2.522916946842169
distance-from-start_mean2.522916946842169
distance-from-start_median2.522916946842169
distance-from-start_min2.522916946842169
driven_any_max3.4265750568184306
driven_any_mean3.4265750568184306
driven_any_median3.4265750568184306
driven_any_min3.4265750568184306
driven_lanedir_consec_max2.8916689297600247
driven_lanedir_consec_mean2.8916689297600247
driven_lanedir_consec_min2.8916689297600247
driven_lanedir_max3.0974169287243676
driven_lanedir_mean3.0974169287243676
driven_lanedir_median3.0974169287243676
driven_lanedir_min3.0974169287243676
in-drivable-lane_max5.099999999999877
in-drivable-lane_mean5.099999999999877
in-drivable-lane_min5.099999999999877
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.4265750568184306, "survival_time": 59.99999999999873, "driven_lanedir": 3.0974169287243676, "in-drivable-lane": 5.099999999999877, "deviation-heading": 11.493741379653043, "distance-from-start": 2.522916946842169, "deviation-center-line": 5.681440925821353, "driven_lanedir_consec": 2.8916689297600247}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
144091211Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-validationsim-0of4successnodavinci-stage-04-6.2.500:15:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.024999999999956
driven_lanedir_consec_median2.7186759709641253
deviation-center-line_median5.862131942992704


other stats
deviation-center-line_max6.8926428573142395
deviation-center-line_mean5.678345665140167
deviation-center-line_min4.0964759172610234
deviation-heading_max8.918457822311643
deviation-heading_mean7.081123884150349
deviation-heading_median7.087670971017298
deviation-heading_min5.2306957722551575
distance-from-start_max2.8296782642090292
distance-from-start_mean1.888864829800502
distance-from-start_median1.639347737745438
distance-from-start_min1.4470855795021027
driven_any_max3.524090671773667
driven_any_mean3.5147133774298376
driven_any_median3.518834998148701
driven_any_min3.4970928416482807
driven_lanedir_consec_max3.391077995430446
driven_lanedir_consec_mean2.708466243383813
driven_lanedir_consec_min2.0054350361765554
driven_lanedir_max3.391077995430446
driven_lanedir_mean3.3679532290440797
driven_lanedir_median3.3641150341728117
driven_lanedir_min3.3525048524002488
in-drivable-lane_max2.749999999999872
in-drivable-lane_mean2.162499999999953
in-drivable-lane_min1.8500000000000263
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.5180863448801456, "survival_time": 59.99999999999873, "driven_lanedir": 3.373947912234794, "in-drivable-lane": 2.0499999999998835, "deviation-heading": 6.8453385018692146, "distance-from-start": 1.6666260059194336, "deviation-center-line": 4.0964759172610234, "driven_lanedir_consec": 2.0054350361765554}, "autolab-000-ego1": {"driven_any": 3.524090671773667, "survival_time": 59.99999999999873, "driven_lanedir": 3.391077995430446, "in-drivable-lane": 1.8500000000000263, "deviation-heading": 7.33000344016538, "distance-from-start": 2.8296782642090292, "deviation-center-line": 6.250381576789261, "driven_lanedir_consec": 3.391077995430446}, "autolab-000-ego2": {"driven_any": 3.4970928416482807, "survival_time": 59.99999999999873, "driven_lanedir": 3.354282156110829, "in-drivable-lane": 2.749999999999872, "deviation-heading": 5.2306957722551575, "distance-from-start": 1.612069469571442, "deviation-center-line": 6.8926428573142395, "driven_lanedir_consec": 3.354282156110829}, "autolab-000-ego3": {"driven_any": 3.5195836514172565, "survival_time": 59.99999999999873, "driven_lanedir": 3.3525048524002488, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 8.918457822311643, "distance-from-start": 1.4470855795021027, "deviation-center-line": 5.4738823091961475, "driven_lanedir_consec": 2.0830697858174214}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143981214Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-testingsim-0of4successnodavinci-stage-04-6.2.500:11:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.3819713089277443
deviation-center-line_median3.670190139750301


other stats
deviation-center-line_max3.670190139750301
deviation-center-line_mean3.670190139750301
deviation-center-line_min3.670190139750301
deviation-heading_max4.682835183981122
deviation-heading_mean4.682835183981122
deviation-heading_median4.682835183981122
deviation-heading_min4.682835183981122
distance-from-start_max2.2320761555794064
distance-from-start_mean2.2320761555794064
distance-from-start_median2.2320761555794064
distance-from-start_min2.2320761555794064
driven_any_max3.5795864361741097
driven_any_mean3.5795864361741097
driven_any_median3.5795864361741097
driven_any_min3.5795864361741097
driven_lanedir_consec_max3.3819713089277443
driven_lanedir_consec_mean3.3819713089277443
driven_lanedir_consec_min3.3819713089277443
driven_lanedir_max3.551265460849699
driven_lanedir_mean3.551265460849699
driven_lanedir_median3.551265460849699
driven_lanedir_min3.551265460849699
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 3.5795864361741097, "survival_time": 59.99999999999873, "driven_lanedir": 3.551265460849699, "in-drivable-lane": 0.0, "deviation-heading": 4.682835183981122, "distance-from-start": 2.2320761555794064, "deviation-center-line": 3.670190139750301, "driven_lanedir_consec": 3.3819713089277443}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143891216Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-testingsim-1of4successnodavinci-stage-04-6.2.500:09:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.3499999999998664
driven_lanedir_consec_median3.381630870892481
deviation-center-line_median6.662994790807998


other stats
deviation-center-line_max6.662994790807998
deviation-center-line_mean6.662994790807998
deviation-center-line_min6.662994790807998
deviation-heading_max5.427561246722322
deviation-heading_mean5.427561246722322
deviation-heading_median5.427561246722322
deviation-heading_min5.427561246722322
distance-from-start_max2.1860021307337045
distance-from-start_mean2.1860021307337045
distance-from-start_median2.1860021307337045
distance-from-start_min2.1860021307337045
driven_any_max3.509092323425108
driven_any_mean3.509092323425108
driven_any_median3.509092323425108
driven_any_min3.509092323425108
driven_lanedir_consec_max3.381630870892481
driven_lanedir_consec_mean3.381630870892481
driven_lanedir_consec_min3.381630870892481
driven_lanedir_max3.381630870892481
driven_lanedir_mean3.381630870892481
driven_lanedir_median3.381630870892481
driven_lanedir_min3.381630870892481
in-drivable-lane_max2.3499999999998664
in-drivable-lane_mean2.3499999999998664
in-drivable-lane_min2.3499999999998664
per-episodes
details{"loop-000-ego0": {"driven_any": 3.509092323425108, "survival_time": 59.99999999999873, "driven_lanedir": 3.381630870892481, "in-drivable-lane": 2.3499999999998664, "deviation-heading": 5.427561246722322, "distance-from-start": 2.1860021307337045, "deviation-center-line": 6.662994790807998, "driven_lanedir_consec": 3.381630870892481}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143841217Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-testingsim-1of4successnodavinci-stage-04-6.2.500:06:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.548233752078826
deviation-center-line_median3.912747138035832


other stats
deviation-center-line_max3.912747138035832
deviation-center-line_mean3.912747138035832
deviation-center-line_min3.912747138035832
deviation-heading_max4.215826059025193
deviation-heading_mean4.215826059025193
deviation-heading_median4.215826059025193
deviation-heading_min4.215826059025193
distance-from-start_max2.339774613830501
distance-from-start_mean2.339774613830501
distance-from-start_median2.339774613830501
distance-from-start_min2.339774613830501
driven_any_max3.5795947794156975
driven_any_mean3.5795947794156975
driven_any_median3.5795947794156975
driven_any_min3.5795947794156975
driven_lanedir_consec_max3.548233752078826
driven_lanedir_consec_mean3.548233752078826
driven_lanedir_consec_min3.548233752078826
driven_lanedir_max3.555210141629624
driven_lanedir_mean3.555210141629624
driven_lanedir_median3.555210141629624
driven_lanedir_min3.555210141629624
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-000-ego0": {"driven_any": 3.5795947794156975, "survival_time": 59.99999999999873, "driven_lanedir": 3.555210141629624, "in-drivable-lane": 0.0, "deviation-heading": 4.215826059025193, "distance-from-start": 2.339774613830501, "deviation-center-line": 3.912747138035832, "driven_lanedir_consec": 3.548233752078826}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143771219Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-testingsim-0of4successnodavinci-stage-04-6.2.500:15:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.9999999999999432
driven_lanedir_consec_median2.7698955282609887
deviation-center-line_median5.138314652956844


other stats
deviation-center-line_max5.756194777372426
deviation-center-line_mean5.209270854058739
deviation-center-line_min4.804259332948843
deviation-heading_max6.908634530888926
deviation-heading_mean4.98100070740749
deviation-heading_median4.854233439147025
deviation-heading_min3.306901420446983
distance-from-start_max2.3695697937288083
distance-from-start_mean1.915876448579448
distance-from-start_median1.8549502450769235
distance-from-start_min1.584035510435136
driven_any_max3.579595424156211
driven_any_mean3.3748668292703963
driven_any_median3.501638142781199
driven_any_min2.916595607362977
driven_lanedir_consec_max3.5364749076240765
driven_lanedir_consec_mean2.8157555010672786
driven_lanedir_consec_min2.1867560401230626
driven_lanedir_max3.5633303928470905
driven_lanedir_mean3.282461667675166
driven_lanedir_median3.333349215260178
driven_lanedir_min2.899817847333218
in-drivable-lane_max3.249999999999958
in-drivable-lane_mean1.312499999999961
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 3.483691022698869, "survival_time": 59.99999999999873, "driven_lanedir": 3.2991131995927705, "in-drivable-lane": 3.249999999999958, "deviation-heading": 6.230770184307429, "distance-from-start": 1.62980092342675, "deviation-center-line": 5.756194777372426, "driven_lanedir_consec": 2.1867560401230626}, "udem-000-ego1": {"driven_any": 3.579595424156211, "survival_time": 59.99999999999873, "driven_lanedir": 3.5633303928470905, "in-drivable-lane": 0.0, "deviation-heading": 3.306901420446983, "distance-from-start": 2.3695697937288083, "deviation-center-line": 4.804259332948843, "driven_lanedir_consec": 3.5364749076240765}, "udem-000-ego2": {"driven_any": 2.916595607362977, "survival_time": 59.99999999999873, "driven_lanedir": 2.899817847333218, "in-drivable-lane": 0.0, "deviation-heading": 3.477696693986621, "distance-from-start": 1.584035510435136, "deviation-center-line": 4.959405407533967, "driven_lanedir_consec": 2.883822177258341}, "udem-000-ego3": {"driven_any": 3.519585262863529, "survival_time": 59.99999999999873, "driven_lanedir": 3.3675852309275847, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 6.908634530888926, "distance-from-start": 2.080099566727098, "deviation-center-line": 5.317223898379722, "driven_lanedir_consec": 2.655968879263636}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143711220Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-testingsim-1of4successnodavinci-stage-04-6.2.500:04:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.1999999999999318
driven_lanedir_consec_median3.4359165318271345
deviation-center-line_median4.892013423501352


other stats
deviation-center-line_max4.892013423501352
deviation-center-line_mean4.892013423501352
deviation-center-line_min4.892013423501352
deviation-heading_max7.875545669467039
deviation-heading_mean7.875545669467039
deviation-heading_median7.875545669467039
deviation-heading_min7.875545669467039
distance-from-start_max2.786057442773228
distance-from-start_mean2.786057442773228
distance-from-start_median2.786057442773228
distance-from-start_min2.786057442773228
driven_any_max3.5436077823063186
driven_any_mean3.5436077823063186
driven_any_median3.5436077823063186
driven_any_min3.5436077823063186
driven_lanedir_consec_max3.4359165318271345
driven_lanedir_consec_mean3.4359165318271345
driven_lanedir_consec_min3.4359165318271345
driven_lanedir_max3.4359165318271345
driven_lanedir_mean3.4359165318271345
driven_lanedir_median3.4359165318271345
driven_lanedir_min3.4359165318271345
in-drivable-lane_max1.1999999999999318
in-drivable-lane_mean1.1999999999999318
in-drivable-lane_min1.1999999999999318
per-episodes
details{"loop-000-ego0": {"driven_any": 3.5436077823063186, "survival_time": 59.99999999999873, "driven_lanedir": 3.4359165318271345, "in-drivable-lane": 1.1999999999999318, "deviation-heading": 7.875545669467039, "distance-from-start": 2.786057442773228, "deviation-center-line": 4.892013423501352, "driven_lanedir_consec": 3.4359165318271345}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143611224Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:10:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.4156597876014327
deviation-center-line_median5.989789523960853


other stats
deviation-center-line_max8.495537949245412
deviation-center-line_mean5.971732905101129
deviation-center-line_min3.411814623237397
deviation-heading_max5.897113234379067
deviation-heading_mean4.048666897035051
deviation-heading_median3.883494575102228
deviation-heading_min2.53056520355668
distance-from-start_max2.619089336031859
distance-from-start_mean2.081728511655291
distance-from-start_median2.273437348983144
distance-from-start_min1.1609500126230166
driven_any_max3.5795929797204047
driven_any_mean3.0144689618920215
driven_any_median3.5518420920250877
driven_any_min1.3745986837975066
driven_lanedir_consec_max3.4641594614086646
driven_lanedir_consec_mean2.914869629053038
driven_lanedir_consec_min1.3639994796006216
driven_lanedir_max3.558362293690531
driven_lanedir_mean2.9724232090689076
driven_lanedir_median3.483665531492239
driven_lanedir_min1.3639994796006216
in-drivable-lane_max1.8499999999998948
in-drivable-lane_mean0.4624999999999737
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 3.5795929797204047, "survival_time": 59.99999999999873, "driven_lanedir": 3.5411070899715265, "in-drivable-lane": 0.0, "deviation-heading": 5.897113234379067, "distance-from-start": 2.263048461522456, "deviation-center-line": 5.473740300006772, "driven_lanedir_consec": 3.4641594614086646}, "4way-000-ego1": {"driven_any": 3.524094913434593, "survival_time": 59.99999999999873, "driven_lanedir": 3.4262239730129513, "in-drivable-lane": 1.8499999999998948, "deviation-heading": 3.513531876713755, "distance-from-start": 2.619089336031859, "deviation-center-line": 6.505838747914936, "driven_lanedir_consec": 3.4262237769992145}, "4way-000-ego2": {"driven_any": 3.579589270615582, "survival_time": 59.99999999999873, "driven_lanedir": 3.558362293690531, "in-drivable-lane": 0.0, "deviation-heading": 4.2534572734907, "distance-from-start": 2.2838262364438315, "deviation-center-line": 3.411814623237397, "driven_lanedir_consec": 3.4050957982036514}, "4way-000-ego3": {"driven_any": 1.3745986837975066, "survival_time": 59.99999999999873, "driven_lanedir": 1.3639994796006216, "in-drivable-lane": 0.0, "deviation-heading": 2.53056520355668, "distance-from-start": 1.1609500126230166, "deviation-center-line": 8.495537949245412, "driven_lanedir_consec": 1.3639994796006216}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143561225Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:08:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median49.9999999999993
in-drivable-lane_median0.0
driven_lanedir_consec_median2.896613408548548
deviation-center-line_median3.8033318362841073


other stats
deviation-center-line_max3.8033318362841073
deviation-center-line_mean3.8033318362841073
deviation-center-line_min3.8033318362841073
deviation-heading_max4.074858735595133
deviation-heading_mean4.074858735595133
deviation-heading_median4.074858735595133
deviation-heading_min4.074858735595133
distance-from-start_max1.574553399562494
distance-from-start_mean1.574553399562494
distance-from-start_median1.574553399562494
distance-from-start_min1.574553399562494
driven_any_max2.9375948144939867
driven_any_mean2.9375948144939867
driven_any_median2.9375948144939867
driven_any_min2.9375948144939867
driven_lanedir_consec_max2.896613408548548
driven_lanedir_consec_mean2.896613408548548
driven_lanedir_consec_min2.896613408548548
driven_lanedir_max2.916242176218421
driven_lanedir_mean2.916242176218421
driven_lanedir_median2.916242176218421
driven_lanedir_min2.916242176218421
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 2.9375948144939867, "survival_time": 49.9999999999993, "driven_lanedir": 2.916242176218421, "in-drivable-lane": 0.0, "deviation-heading": 4.074858735595133, "distance-from-start": 1.574553399562494, "deviation-center-line": 3.8033318362841073, "driven_lanedir_consec": 2.896613408548548}}
simulation-passed1
survival_time_max49.9999999999993
survival_time_mean49.9999999999993
survival_time_min49.9999999999993
No reset possible
143551225Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-validationsim-0of4successnodavinci-stage-04-6.2.500:03:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median15.85000000000009
in-drivable-lane_median0.0
driven_lanedir_consec_median0.8682838146430726
deviation-center-line_median0.9280014701980372


other stats
deviation-center-line_max0.9280014701980372
deviation-center-line_mean0.9280014701980372
deviation-center-line_min0.9280014701980372
deviation-heading_max2.313567244971171
deviation-heading_mean2.313567244971171
deviation-heading_median2.313567244971171
deviation-heading_min2.313567244971171
distance-from-start_max0.7827181653982369
distance-from-start_mean0.7827181653982369
distance-from-start_median0.7827181653982369
distance-from-start_min0.7827181653982369
driven_any_max0.888597530769245
driven_any_mean0.888597530769245
driven_any_median0.888597530769245
driven_any_min0.888597530769245
driven_lanedir_consec_max0.8682838146430726
driven_lanedir_consec_mean0.8682838146430726
driven_lanedir_consec_min0.8682838146430726
driven_lanedir_max0.8682838146430726
driven_lanedir_mean0.8682838146430726
driven_lanedir_median0.8682838146430726
driven_lanedir_min0.8682838146430726
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-001-ego0": {"driven_any": 0.888597530769245, "survival_time": 15.85000000000009, "driven_lanedir": 0.8682838146430726, "in-drivable-lane": 0.0, "deviation-heading": 2.313567244971171, "distance-from-start": 0.7827181653982369, "deviation-center-line": 0.9280014701980372, "driven_lanedir_consec": 0.8682838146430726}}
simulation-passed1
survival_time_max15.85000000000009
survival_time_mean15.85000000000009
survival_time_min15.85000000000009
No reset possible
143501226Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-validation455successnodavinci-stage-04-6.2.500:04:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.149999999999869
driven_lanedir_consec_median3.254673936145931
deviation-center-line_median7.242436875186144


other stats
deviation-center-line_max7.370373883930351
deviation-center-line_mean7.242436875186144
deviation-center-line_min7.114499866441937
deviation-heading_max6.468693085672813
deviation-heading_mean6.085664677525856
deviation-heading_median6.085664677525856
deviation-heading_min5.7026362693789
distance-from-start_max1.6480966941271764
distance-from-start_mean1.639232148271026
distance-from-start_median1.639232148271026
distance-from-start_min1.6303676024148757
driven_any_max3.4663369172887455
driven_any_mean3.4599631629635637
driven_any_median3.4599631629635637
driven_any_min3.453589408638382
driven_lanedir_consec_max3.265479618005762
driven_lanedir_consec_mean3.254673936145931
driven_lanedir_consec_min3.2438682542860997
driven_lanedir_max3.265479618005762
driven_lanedir_mean3.254673936145931
driven_lanedir_median3.254673936145931
driven_lanedir_min3.2438682542860997
in-drivable-lane_max4.199999999999893
in-drivable-lane_mean4.149999999999869
in-drivable-lane_min4.099999999999845
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.4663369172887455, "survival_time": 59.99999999999873, "driven_lanedir": 3.265479618005762, "in-drivable-lane": 4.099999999999845, "deviation-heading": 5.7026362693789, "distance-from-start": 1.6303676024148757, "deviation-center-line": 7.114499866441937, "driven_lanedir_consec": 3.265479618005762}, "loop2-000-ego1": {"driven_any": 3.453589408638382, "survival_time": 59.99999999999873, "driven_lanedir": 3.2438682542860997, "in-drivable-lane": 4.199999999999893, "deviation-heading": 6.468693085672813, "distance-from-start": 1.6480966941271764, "deviation-center-line": 7.370373883930351, "driven_lanedir_consec": 3.2438682542860997}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143471227Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:01:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.850000000000048
in-drivable-lane_median0.0
driven_lanedir_consec_median0.7038638560362473
deviation-center-line_median0.4396047224602857


other stats
deviation-center-line_max0.4396047224602857
deviation-center-line_mean0.4396047224602857
deviation-center-line_min0.4396047224602857
deviation-heading_max0.7151205809324869
deviation-heading_mean0.7151205809324869
deviation-heading_median0.7151205809324869
deviation-heading_min0.7151205809324869
distance-from-start_max0.7045347730331369
distance-from-start_mean0.7045347730331369
distance-from-start_median0.7045347730331369
distance-from-start_min0.7045347730331369
driven_any_max0.708599276888723
driven_any_mean0.708599276888723
driven_any_median0.708599276888723
driven_any_min0.708599276888723
driven_lanedir_consec_max0.7038638560362473
driven_lanedir_consec_mean0.7038638560362473
driven_lanedir_consec_min0.7038638560362473
driven_lanedir_max0.7038638560362473
driven_lanedir_mean0.7038638560362473
driven_lanedir_median0.7038638560362473
driven_lanedir_min0.7038638560362473
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 0.708599276888723, "survival_time": 12.850000000000048, "driven_lanedir": 0.7038638560362473, "in-drivable-lane": 0.0, "deviation-heading": 0.7151205809324869, "distance-from-start": 0.7045347730331369, "deviation-center-line": 0.4396047224602857, "driven_lanedir_consec": 0.7038638560362473}}
simulation-passed1
survival_time_max12.850000000000048
survival_time_mean12.850000000000048
survival_time_min12.850000000000048
No reset possible
143431228Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:03:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.04999999999878
in-drivable-lane_median3.549999999999798
driven_lanedir_consec_median3.250910080242586
deviation-center-line_median6.40909921931243


other stats
deviation-center-line_max6.40909921931243
deviation-center-line_mean6.40909921931243
deviation-center-line_min6.40909921931243
deviation-heading_max5.86874944154476
deviation-heading_mean5.86874944154476
deviation-heading_median5.86874944154476
deviation-heading_min5.86874944154476
distance-from-start_max1.63145897748322
distance-from-start_mean1.63145897748322
distance-from-start_median1.63145897748322
distance-from-start_min1.63145897748322
driven_any_max3.4043224992272147
driven_any_mean3.4043224992272147
driven_any_median3.4043224992272147
driven_any_min3.4043224992272147
driven_lanedir_consec_max3.250910080242586
driven_lanedir_consec_mean3.250910080242586
driven_lanedir_consec_min3.250910080242586
driven_lanedir_max3.250910080242586
driven_lanedir_mean3.250910080242586
driven_lanedir_median3.250910080242586
driven_lanedir_min3.250910080242586
in-drivable-lane_max3.549999999999798
in-drivable-lane_mean3.549999999999798
in-drivable-lane_min3.549999999999798
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.4043224992272147, "survival_time": 59.04999999999878, "driven_lanedir": 3.250910080242586, "in-drivable-lane": 3.549999999999798, "deviation-heading": 5.86874944154476, "distance-from-start": 1.63145897748322, "deviation-center-line": 6.40909921931243, "driven_lanedir_consec": 3.250910080242586}}
simulation-passed1
survival_time_max59.04999999999878
survival_time_mean59.04999999999878
survival_time_min59.04999999999878
No reset possible
143401229Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
143351230Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:09:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.0050106271821506
deviation-center-line_median4.908963644722344


other stats
deviation-center-line_max6.01198792060873
deviation-center-line_mean4.593358939184355
deviation-center-line_min2.5435205466839994
deviation-heading_max5.727471290631747
deviation-heading_mean4.526175130231045
deviation-heading_median4.686700534848095
deviation-heading_min3.003828160596244
distance-from-start_max2.5613241003039633
distance-from-start_mean1.914912599777095
distance-from-start_median1.98188247541307
distance-from-start_min1.134561347978277
driven_any_max3.579580754957026
driven_any_mean3.2360870781772753
driven_any_median3.2450849856660264
driven_any_min2.8745975864200206
driven_lanedir_consec_max3.211958001358496
driven_lanedir_consec_mean3.019665595541482
driven_lanedir_consec_min2.856683126443131
driven_lanedir_max3.5310621633486874
driven_lanedir_mean3.181338396476557
driven_lanedir_median3.1688041281752737
driven_lanedir_min2.856683166206994
in-drivable-lane_max2.2000000000000313
in-drivable-lane_mean0.5500000000000078
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 2.8745975864200206, "survival_time": 59.99999999999873, "driven_lanedir": 2.856683166206994, "in-drivable-lane": 0.0, "deviation-heading": 3.003828160596244, "distance-from-start": 2.345983319386262, "deviation-center-line": 5.525958630071963, "driven_lanedir_consec": 2.856683126443131}, "4way-000-ego1": {"driven_any": 2.9765951859105204, "survival_time": 59.99999999999873, "driven_lanedir": 2.9585702681138724, "in-drivable-lane": 0.0, "deviation-heading": 3.74577370363053, "distance-from-start": 1.6177816314398783, "deviation-center-line": 6.01198792060873, "driven_lanedir_consec": 2.9318251947402816}, "4way-000-ego2": {"driven_any": 3.513574785421533, "survival_time": 59.99999999999873, "driven_lanedir": 3.379037988236675, "in-drivable-lane": 2.2000000000000313, "deviation-heading": 5.62762736606566, "distance-from-start": 2.5613241003039633, "deviation-center-line": 2.5435205466839994, "driven_lanedir_consec": 3.0781960596240197}, "4way-000-ego3": {"driven_any": 3.579580754957026, "survival_time": 59.99999999999873, "driven_lanedir": 3.5310621633486874, "in-drivable-lane": 0.0, "deviation-heading": 5.727471290631747, "distance-from-start": 1.134561347978277, "deviation-center-line": 4.291968659372725, "driven_lanedir_consec": 3.211958001358496}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143301231Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-testingsim-0of4successnodavinci-stage-04-6.2.500:04:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median23.100000000000193
in-drivable-lane_median0.0
driven_lanedir_consec_median1.3040934355288318
deviation-center-line_median1.289217129104995


other stats
deviation-center-line_max1.289217129104995
deviation-center-line_mean1.289217129104995
deviation-center-line_min1.289217129104995
deviation-heading_max2.1907426992170524
deviation-heading_mean2.1907426992170524
deviation-heading_median2.1907426992170524
deviation-heading_min2.1907426992170524
distance-from-start_max1.2851043260193775
distance-from-start_mean1.2851043260193775
distance-from-start_median1.2851043260193775
distance-from-start_min1.2851043260193775
driven_any_max1.3235977943332726
driven_any_mean1.3235977943332726
driven_any_median1.3235977943332726
driven_any_min1.3235977943332726
driven_lanedir_consec_max1.3040934355288318
driven_lanedir_consec_mean1.3040934355288318
driven_lanedir_consec_min1.3040934355288318
driven_lanedir_max1.3040934355288318
driven_lanedir_mean1.3040934355288318
driven_lanedir_median1.3040934355288318
driven_lanedir_min1.3040934355288318
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-001-ego0": {"driven_any": 1.3235977943332726, "survival_time": 23.100000000000193, "driven_lanedir": 1.3040934355288318, "in-drivable-lane": 0.0, "deviation-heading": 2.1907426992170524, "distance-from-start": 1.2851043260193775, "deviation-center-line": 1.289217129104995, "driven_lanedir_consec": 1.3040934355288318}}
simulation-passed1
survival_time_max23.100000000000193
survival_time_mean23.100000000000193
survival_time_min23.100000000000193
No reset possible
143261233Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:09:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.1499999999999666
driven_lanedir_consec_median1.4204229695892396
deviation-center-line_median4.903602912090087


other stats
deviation-center-line_max4.903602912090087
deviation-center-line_mean4.903602912090087
deviation-center-line_min4.903602912090087
deviation-heading_max7.744574187082735
deviation-heading_mean7.744574187082735
deviation-heading_median7.744574187082735
deviation-heading_min7.744574187082735
distance-from-start_max1.206000814743228
distance-from-start_mean1.206000814743228
distance-from-start_median1.206000814743228
distance-from-start_min1.206000814743228
driven_any_max3.4850840176979623
driven_any_mean3.4850840176979623
driven_any_median3.4850840176979623
driven_any_min3.4850840176979623
driven_lanedir_consec_max1.4204229695892396
driven_lanedir_consec_mean1.4204229695892396
driven_lanedir_consec_min1.4204229695892396
driven_lanedir_max3.2904978754707774
driven_lanedir_mean3.2904978754707774
driven_lanedir_median3.2904978754707774
driven_lanedir_min3.2904978754707774
in-drivable-lane_max3.1499999999999666
in-drivable-lane_mean3.1499999999999666
in-drivable-lane_min3.1499999999999666
per-episodes
details{"loop-000-ego0": {"driven_any": 3.4850840176979623, "survival_time": 59.99999999999873, "driven_lanedir": 3.2904978754707774, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.744574187082735, "distance-from-start": 1.206000814743228, "deviation-center-line": 4.903602912090087, "driven_lanedir_consec": 1.4204229695892396}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143211234Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:05:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.099999999999824
driven_lanedir_consec_median3.094905429410056
deviation-center-line_median4.472617520975966


other stats
deviation-center-line_max4.472617520975966
deviation-center-line_mean4.472617520975966
deviation-center-line_min4.472617520975966
deviation-heading_max11.268842029535884
deviation-heading_mean11.268842029535884
deviation-heading_median11.268842029535884
deviation-heading_min11.268842029535884
distance-from-start_max2.5739500581986148
distance-from-start_mean2.5739500581986148
distance-from-start_median2.5739500581986148
distance-from-start_min2.5739500581986148
driven_any_max3.486579242992935
driven_any_mean3.486579242992935
driven_any_median3.486579242992935
driven_any_min3.486579242992935
driven_lanedir_consec_max3.094905429410056
driven_lanedir_consec_mean3.094905429410056
driven_lanedir_consec_min3.094905429410056
driven_lanedir_max3.2535717731810343
driven_lanedir_mean3.2535717731810343
driven_lanedir_median3.2535717731810343
driven_lanedir_min3.2535717731810343
in-drivable-lane_max3.099999999999824
in-drivable-lane_mean3.099999999999824
in-drivable-lane_min3.099999999999824
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.486579242992935, "survival_time": 59.99999999999873, "driven_lanedir": 3.2535717731810343, "in-drivable-lane": 3.099999999999824, "deviation-heading": 11.268842029535884, "distance-from-start": 2.5739500581986148, "deviation-center-line": 4.472617520975966, "driven_lanedir_consec": 3.094905429410056}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143141235Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:05:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.489526926942431
deviation-center-line_median5.459978779188341


other stats
deviation-center-line_max5.459978779188341
deviation-center-line_mean5.459978779188341
deviation-center-line_min5.459978779188341
deviation-heading_max11.314241959835243
deviation-heading_mean11.314241959835243
deviation-heading_median11.314241959835243
deviation-heading_min11.314241959835243
distance-from-start_max3.0851207054617977
distance-from-start_mean3.0851207054617977
distance-from-start_median3.0851207054617977
distance-from-start_min3.0851207054617977
driven_any_max3.57958884925181
driven_any_mean3.57958884925181
driven_any_median3.57958884925181
driven_any_min3.57958884925181
driven_lanedir_consec_max3.489526926942431
driven_lanedir_consec_mean3.489526926942431
driven_lanedir_consec_min3.489526926942431
driven_lanedir_max3.489526926942431
driven_lanedir_mean3.489526926942431
driven_lanedir_median3.489526926942431
driven_lanedir_min3.489526926942431
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.57958884925181, "survival_time": 59.99999999999873, "driven_lanedir": 3.489526926942431, "in-drivable-lane": 0.0, "deviation-heading": 11.314241959835243, "distance-from-start": 3.0851207054617977, "deviation-center-line": 5.459978779188341, "driven_lanedir_consec": 3.489526926942431}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
143101237Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:02:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.400000000000013
in-drivable-lane_median7.100000000000017
driven_lanedir_consec_median0.33123013524902545
deviation-center-line_median0.26973522366843383


other stats
deviation-center-line_max0.26973522366843383
deviation-center-line_mean0.26973522366843383
deviation-center-line_min0.26973522366843383
deviation-heading_max2.53835057480462
deviation-heading_mean2.53835057480462
deviation-heading_median2.53835057480462
deviation-heading_min2.53835057480462
distance-from-start_max1.5453191784191067
distance-from-start_mean1.5453191784191067
distance-from-start_median1.5453191784191067
distance-from-start_min1.5453191784191067
driven_any_max1.545427894810905
driven_any_mean1.545427894810905
driven_any_median1.545427894810905
driven_any_min1.545427894810905
driven_lanedir_consec_max0.33123013524902545
driven_lanedir_consec_mean0.33123013524902545
driven_lanedir_consec_min0.33123013524902545
driven_lanedir_max0.33123013524902545
driven_lanedir_mean0.33123013524902545
driven_lanedir_median0.33123013524902545
driven_lanedir_min0.33123013524902545
in-drivable-lane_max7.100000000000017
in-drivable-lane_mean7.100000000000017
in-drivable-lane_min7.100000000000017
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.545427894810905, "survival_time": 10.400000000000013, "driven_lanedir": 0.33123013524902545, "in-drivable-lane": 7.100000000000017, "deviation-heading": 2.53835057480462, "distance-from-start": 1.5453191784191067, "deviation-center-line": 0.26973522366843383, "driven_lanedir_consec": 0.33123013524902545}}
simulation-passed1
survival_time_max10.400000000000013
survival_time_mean10.400000000000013
survival_time_min10.400000000000013
No reset possible
143061238Bea Baselines 🐤minimal-agentaido-LFVI-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
143021239Bea Baselines 🐤minimal-agentaido-LFI-sim-validationsim-0of4successnodavinci-stage-04-6.2.500:01:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.2999999999999963
in-drivable-lane_median1.5499999999999954
driven_lanedir_consec_median0.19955231542409924
deviation-center-line_median0.12567511082985364


other stats
deviation-center-line_max0.12567511082985364
deviation-center-line_mean0.12567511082985364
deviation-center-line_min0.12567511082985364
deviation-heading_max0.9488219555580458
deviation-heading_mean0.9488219555580458
deviation-heading_median0.9488219555580458
deviation-heading_min0.9488219555580458
distance-from-start_max0.3731007861754618
distance-from-start_mean0.3731007861754618
distance-from-start_median0.3731007861754618
distance-from-start_min0.3731007861754618
driven_any_max0.37310743381811584
driven_any_mean0.37310743381811584
driven_any_median0.37310743381811584
driven_any_min0.37310743381811584
driven_lanedir_consec_max0.19955231542409924
driven_lanedir_consec_mean0.19955231542409924
driven_lanedir_consec_min0.19955231542409924
driven_lanedir_max0.19955231542409924
driven_lanedir_mean0.19955231542409924
driven_lanedir_median0.19955231542409924
driven_lanedir_min0.19955231542409924
in-drivable-lane_max1.5499999999999954
in-drivable-lane_mean1.5499999999999954
in-drivable-lane_min1.5499999999999954
per-episodes
details{"4way-000-ego0": {"driven_any": 0.37310743381811584, "survival_time": 3.2999999999999963, "driven_lanedir": 0.19955231542409924, "in-drivable-lane": 1.5499999999999954, "deviation-heading": 0.9488219555580458, "distance-from-start": 0.3731007861754618, "deviation-center-line": 0.12567511082985364, "driven_lanedir_consec": 0.19955231542409924}}
simulation-passed1
survival_time_max3.2999999999999963
survival_time_mean3.2999999999999963
survival_time_min3.2999999999999963
No reset possible
142951241Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:03:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.250000000000025
in-drivable-lane_median8.525000000000027
driven_lanedir_consec_median0.3694034459669367
deviation-center-line_median0.2032026824105824


other stats
deviation-center-line_max0.49385537805641655
deviation-center-line_mean0.2564840317596989
deviation-center-line_min0.1256753841612143
deviation-heading_max2.207424396094566
deviation-heading_mean1.2068820169473446
deviation-heading_median0.9361471003737372
deviation-heading_min0.7478094709473372
distance-from-start_max1.6837476731392336
distance-from-start_mean0.85867246141252
distance-from-start_median0.688920693167693
distance-from-start_min0.3731007861754605
driven_any_max1.6838575324025151
driven_any_mean0.8587081494464717
driven_any_median0.6889338157826281
driven_any_min0.3731074338181155
driven_lanedir_consec_max0.737521974955665
driven_lanedir_consec_mean0.40900650829720153
driven_lanedir_consec_min0.15969716629926767
driven_lanedir_max0.737521974955665
driven_lanedir_mean0.40900650829720153
driven_lanedir_median0.3694034459669367
driven_lanedir_min0.15969716629926767
in-drivable-lane_max9.800000000000026
in-drivable-lane_mean8.17500000000003
in-drivable-lane_min5.850000000000036
per-episodes
details{"4way-000-ego0": {"driven_any": 0.3731074338181155, "survival_time": 11.250000000000025, "driven_lanedir": 0.1995526730519679, "in-drivable-lane": 9.500000000000025, "deviation-heading": 0.9488219555580462, "distance-from-start": 0.3731007861754605, "deviation-center-line": 0.1256753841612143, "driven_lanedir_consec": 0.1995526730519679}, "4way-000-ego1": {"driven_any": 0.5816642445221152, "survival_time": 11.250000000000025, "driven_lanedir": 0.15969716629926767, "in-drivable-lane": 9.800000000000026, "deviation-heading": 0.7478094709473372, "distance-from-start": 0.5816528382740916, "deviation-center-line": 0.1356249107782691, "driven_lanedir_consec": 0.15969716629926767}, "4way-000-ego2": {"driven_any": 0.7962033870431411, "survival_time": 11.250000000000025, "driven_lanedir": 0.5392542188819056, "in-drivable-lane": 7.55000000000003, "deviation-heading": 0.9234722451894284, "distance-from-start": 0.7961885480612942, "deviation-center-line": 0.27078045404289575, "driven_lanedir_consec": 0.5392542188819056}, "4way-000-ego3": {"driven_any": 1.6838575324025151, "survival_time": 11.250000000000025, "driven_lanedir": 0.737521974955665, "in-drivable-lane": 5.850000000000036, "deviation-heading": 2.207424396094566, "distance-from-start": 1.6837476731392336, "deviation-center-line": 0.49385537805641655, "driven_lanedir_consec": 0.737521974955665}}
simulation-passed1
survival_time_max11.250000000000025
survival_time_mean11.250000000000025
survival_time_min11.250000000000025
No reset possible
142921242Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-validationsim-0of4successnodavinci-stage-04-6.2.500:03:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.250000000000025
in-drivable-lane_median8.775000000000027
driven_lanedir_consec_median0.3301338553680937
deviation-center-line_median0.20320237015909776


other stats
deviation-center-line_max0.27574141344199116
deviation-center-line_mean0.2019553718705288
deviation-center-line_min0.12567533372192854
deviation-heading_max0.9488219555580462
deviation-heading_mean0.8390918912315833
deviation-heading_median0.8356408604491967
deviation-heading_min0.7362638884698938
distance-from-start_max1.6837476731392351
distance-from-start_mean1.1946840199531843
distance-from-start_median1.3150560032892975
distance-from-start_min0.46487640009490705
driven_any_max1.6838575324025415
driven_any_mean1.194754885742435
driven_any_median1.3151384084002675
driven_any_min0.4648851937666637
driven_lanedir_consec_max0.5392559894853717
driven_lanedir_consec_mean0.3398044417698246
driven_lanedir_consec_min0.15969406685773935
driven_lanedir_max0.5392559894853717
driven_lanedir_mean0.3398044417698246
driven_lanedir_median0.3301338553680937
driven_lanedir_min0.15969406685773935
in-drivable-lane_max9.800000000000026
in-drivable-lane_mean8.725000000000026
in-drivable-lane_min7.55000000000003
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.4648851937666637, "survival_time": 11.250000000000025, "driven_lanedir": 0.19955171937759708, "in-drivable-lane": 9.500000000000025, "deviation-heading": 0.9488219555580462, "distance-from-start": 0.46487640009490705, "deviation-center-line": 0.12567533372192854, "driven_lanedir_consec": 0.19955171937759708}, "autolab-000-ego1": {"driven_any": 1.463212954741934, "survival_time": 11.250000000000025, "driven_lanedir": 0.15969406685773935, "in-drivable-lane": 9.800000000000026, "deviation-heading": 0.7478094709473367, "distance-from-start": 1.4631057991302578, "deviation-center-line": 0.1356249107782703, "driven_lanedir_consec": 0.15969406685773935}, "autolab-000-ego2": {"driven_any": 1.1670638620586014, "survival_time": 11.250000000000025, "driven_lanedir": 0.5392559894853717, "in-drivable-lane": 7.55000000000003, "deviation-heading": 0.9234722499510568, "distance-from-start": 1.1670062074483376, "deviation-center-line": 0.2707798295399252, "driven_lanedir_consec": 0.5392559894853717}, "autolab-000-ego3": {"driven_any": 1.6838575324025415, "survival_time": 11.250000000000025, "driven_lanedir": 0.4607159913585903, "in-drivable-lane": 8.05000000000003, "deviation-heading": 0.7362638884698938, "distance-from-start": 1.6837476731392351, "deviation-center-line": 0.27574141344199116, "driven_lanedir_consec": 0.4607159913585903}}
simulation-passed1
survival_time_max11.250000000000025
survival_time_mean11.250000000000025
survival_time_min11.250000000000025
No reset possible
142871243Bea Baselines 🐤minimal-agentaido-LFP-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:01:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.850000000000003
in-drivable-lane_median8.100000000000005
driven_lanedir_consec_median0.19955231542410212
deviation-center-line_median0.12567533372192938


other stats
deviation-center-line_max0.12567533372192938
deviation-center-line_mean0.12567533372192938
deviation-center-line_min0.12567533372192938
deviation-heading_max0.9488219555580464
deviation-heading_mean0.9488219555580464
deviation-heading_median0.9488219555580464
deviation-heading_min0.9488219555580464
distance-from-start_max1.4547842507789297
distance-from-start_mean1.4547842507789297
distance-from-start_median1.4547842507789297
distance-from-start_min1.4547842507789297
driven_any_max1.4548913237462744
driven_any_mean1.4548913237462744
driven_any_median1.4548913237462744
driven_any_min1.4548913237462744
driven_lanedir_consec_max0.19955231542410212
driven_lanedir_consec_mean0.19955231542410212
driven_lanedir_consec_min0.19955231542410212
driven_lanedir_max0.19955231542410212
driven_lanedir_mean0.19955231542410212
driven_lanedir_median0.19955231542410212
driven_lanedir_min0.19955231542410212
in-drivable-lane_max8.100000000000005
in-drivable-lane_mean8.100000000000005
in-drivable-lane_min8.100000000000005
per-episodes
details{"loop-000-ego0": {"driven_any": 1.4548913237462744, "survival_time": 9.850000000000003, "driven_lanedir": 0.19955231542410212, "in-drivable-lane": 8.100000000000005, "deviation-heading": 0.9488219555580464, "distance-from-start": 1.4547842507789297, "deviation-center-line": 0.12567533372192938, "driven_lanedir_consec": 0.19955231542410212}}
simulation-passed1
survival_time_max9.850000000000003
survival_time_mean9.850000000000003
survival_time_min9.850000000000003
No reset possible
142851243Bea Baselines 🐤minimal-agentaido-LFP-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.599999999999988
in-drivable-lane_median4.149999999999988
driven_lanedir_consec_median0.1397964307794325
deviation-center-line_median0.0939067534990478


other stats
deviation-center-line_max0.0939067534990478
deviation-center-line_mean0.0939067534990478
deviation-center-line_min0.0939067534990478
deviation-heading_max0.965418398279237
deviation-heading_mean0.965418398279237
deviation-heading_median0.965418398279237
deviation-heading_min0.965418398279237
distance-from-start_max0.7557867445766083
distance-from-start_mean0.7557867445766083
distance-from-start_median0.7557867445766083
distance-from-start_min0.7557867445766083
driven_any_max0.7557995755351957
driven_any_mean0.7557995755351957
driven_any_median0.7557995755351957
driven_any_min0.7557995755351957
driven_lanedir_consec_max0.1397964307794325
driven_lanedir_consec_mean0.1397964307794325
driven_lanedir_consec_min0.1397964307794325
driven_lanedir_max0.1397964307794325
driven_lanedir_mean0.1397964307794325
driven_lanedir_median0.1397964307794325
driven_lanedir_min0.1397964307794325
in-drivable-lane_max4.149999999999988
in-drivable-lane_mean4.149999999999988
in-drivable-lane_min4.149999999999988
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.7557995755351957, "survival_time": 5.599999999999988, "driven_lanedir": 0.1397964307794325, "in-drivable-lane": 4.149999999999988, "deviation-heading": 0.965418398279237, "distance-from-start": 0.7557867445766083, "deviation-center-line": 0.0939067534990478, "driven_lanedir_consec": 0.1397964307794325}}
simulation-passed1
survival_time_max5.599999999999988
survival_time_mean5.599999999999988
survival_time_min5.599999999999988
No reset possible
142791259Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-0of4successnodavinci-stage-04-6.2.500:02:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.549999999999988
in-drivable-lane_median4.149999999999988
driven_lanedir_consec_median0.1366657585905482
deviation-center-line_median0.10783820466790534


other stats
deviation-center-line_max0.10783820466790534
deviation-center-line_mean0.10783820466790534
deviation-center-line_min0.10783820466790534
deviation-heading_max0.9508048428349386
deviation-heading_mean0.9508048428349386
deviation-heading_median0.9508048428349386
deviation-heading_min0.9508048428349386
distance-from-start_max0.7476573144701085
distance-from-start_mean0.7476573144701085
distance-from-start_median0.7476573144701085
distance-from-start_min0.7476573144701085
driven_any_max0.7476698075499906
driven_any_mean0.7476698075499906
driven_any_median0.7476698075499906
driven_any_min0.7476698075499906
driven_lanedir_consec_max0.1366657585905482
driven_lanedir_consec_mean0.1366657585905482
driven_lanedir_consec_min0.1366657585905482
driven_lanedir_max0.1366657585905482
driven_lanedir_mean0.1366657585905482
driven_lanedir_median0.1366657585905482
driven_lanedir_min0.1366657585905482
in-drivable-lane_max4.149999999999988
in-drivable-lane_mean4.149999999999988
in-drivable-lane_min4.149999999999988
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.7476698075499906, "survival_time": 5.549999999999988, "driven_lanedir": 0.1366657585905482, "in-drivable-lane": 4.149999999999988, "deviation-heading": 0.9508048428349386, "distance-from-start": 0.7476573144701085, "deviation-center-line": 0.10783820466790534, "driven_lanedir_consec": 0.1366657585905482}}
simulation-passed1
survival_time_max5.549999999999988
survival_time_mean5.549999999999988
survival_time_min5.549999999999988
No reset possible
142751260Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-0of4successnodavinci-stage-04-6.2.500:02:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.549999999999985
in-drivable-lane_median5.149999999999984
driven_lanedir_consec_median0.1366674275206068
deviation-center-line_median0.10783868180360472


other stats
deviation-center-line_max0.10783868180360472
deviation-center-line_mean0.10783868180360472
deviation-center-line_min0.10783868180360472
deviation-heading_max0.9508048428349388
deviation-heading_mean0.9508048428349388
deviation-heading_median0.9508048428349388
deviation-heading_min0.9508048428349388
distance-from-start_max0.9098858043373246
distance-from-start_mean0.9098858043373246
distance-from-start_median0.9098858043373246
distance-from-start_min0.9098858043373246
driven_any_max0.9099105248203296
driven_any_mean0.9099105248203296
driven_any_median0.9099105248203296
driven_any_min0.9099105248203296
driven_lanedir_consec_max0.1366674275206068
driven_lanedir_consec_mean0.1366674275206068
driven_lanedir_consec_min0.1366674275206068
driven_lanedir_max0.1366674275206068
driven_lanedir_mean0.1366674275206068
driven_lanedir_median0.1366674275206068
driven_lanedir_min0.1366674275206068
in-drivable-lane_max5.149999999999984
in-drivable-lane_mean5.149999999999984
in-drivable-lane_min5.149999999999984
per-episodes
details{"udem-000-ego0": {"driven_any": 0.9099105248203296, "survival_time": 6.549999999999985, "driven_lanedir": 0.1366674275206068, "in-drivable-lane": 5.149999999999984, "deviation-heading": 0.9508048428349388, "distance-from-start": 0.9098858043373246, "deviation-center-line": 0.10783868180360472, "driven_lanedir_consec": 0.1366674275206068}}
simulation-passed1
survival_time_max6.549999999999985
survival_time_mean6.549999999999985
survival_time_min6.549999999999985
No reset possible
142701261Bea Baselines 🐤minimal-agentaido-LFI-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
142651262Bea Baselines 🐤minimal-agentaido-LF-sim-testingsim-0of4successnodavinci-stage-04-6.2.500:01:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.13666265914899656
survival_time_median16.300000000000097
deviation-center-line_median0.10783824785325348
in-drivable-lane_median14.900000000000096


other stats
deviation-center-line_max0.10783824785325348
deviation-center-line_mean0.10783824785325348
deviation-center-line_min0.10783824785325348
deviation-heading_max0.9508048428349388
deviation-heading_mean0.9508048428349388
deviation-heading_median0.9508048428349388
deviation-heading_min0.9508048428349388
distance-from-start_max2.521293261515461
distance-from-start_mean2.521293261515461
distance-from-start_median2.521293261515461
distance-from-start_min2.521293261515461
driven_any_max2.521966526425084
driven_any_mean2.521966526425084
driven_any_median2.521966526425084
driven_any_min2.521966526425084
driven_lanedir_consec_max0.13666265914899656
driven_lanedir_consec_mean0.13666265914899656
driven_lanedir_consec_min0.13666265914899656
driven_lanedir_max0.13666265914899656
driven_lanedir_mean0.13666265914899656
driven_lanedir_median0.13666265914899656
driven_lanedir_min0.13666265914899656
in-drivable-lane_max14.900000000000096
in-drivable-lane_mean14.900000000000096
in-drivable-lane_min14.900000000000096
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.521966526425084, "survival_time": 16.300000000000097, "driven_lanedir": 0.13666265914899656, "in-drivable-lane": 14.900000000000096, "deviation-heading": 0.9508048428349388, "distance-from-start": 2.521293261515461, "deviation-center-line": 0.10783824785325348, "driven_lanedir_consec": 0.13666265914899656}}
simulation-passed1
survival_time_max16.300000000000097
survival_time_mean16.300000000000097
survival_time_min16.300000000000097
No reset possible
142611263Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-testingsim-1of4successnodavinci-stage-04-6.2.500:03:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.79999999999998
in-drivable-lane_median6.174999999999979
driven_lanedir_consec_median0.18712389148079245
deviation-center-line_median0.15973064632096934


other stats
deviation-center-line_max0.25956483782942774
deviation-center-line_mean0.17171613953350223
deviation-center-line_min0.1078384276626425
deviation-heading_max0.9508048428349388
deviation-heading_mean0.7378303653221978
deviation-heading_median0.7134396501489888
deviation-heading_min0.5736373181558746
distance-from-start_max1.1174703819521252
distance-from-start_mean0.5801993351597357
distance-from-start_median0.4397243952004576
distance-from-start_min0.323878168285902
driven_any_max1.1175260347648366
driven_any_mean0.5802187299655663
driven_any_median0.4397328577718137
driven_any_min0.3238831695538013
driven_lanedir_consec_max0.6843001798814146
driven_lanedir_consec_mean0.2932298736878741
driven_lanedir_consec_min0.11437153190849704
driven_lanedir_max0.6843001798814146
driven_lanedir_mean0.2932298736878741
driven_lanedir_median0.18712389148079245
driven_lanedir_min0.11437153190849704
in-drivable-lane_max6.59999999999998
in-drivable-lane_mean5.549999999999982
in-drivable-lane_min3.2499999999999885
per-episodes
details{"4way-000-ego0": {"driven_any": 0.5146585239873271, "survival_time": 7.79999999999998, "driven_lanedir": 0.13666599700910398, "in-drivable-lane": 6.39999999999998, "deviation-heading": 0.9508048428349388, "distance-from-start": 0.5146479428595184, "deviation-center-line": 0.1078384276626425, "driven_lanedir_consec": 0.13666599700910398}, "4way-000-ego1": {"driven_any": 0.3648071915563002, "survival_time": 7.79999999999998, "driven_lanedir": 0.23758178595248092, "in-drivable-lane": 5.94999999999998, "deviation-heading": 0.5736373181558746, "distance-from-start": 0.36480084754139674, "deviation-center-line": 0.20320962418622623, "driven_lanedir_consec": 0.23758178595248092}, "4way-000-ego2": {"driven_any": 1.1175260347648366, "survival_time": 7.79999999999998, "driven_lanedir": 0.6843001798814146, "in-drivable-lane": 3.2499999999999885, "deviation-heading": 0.6676943794629474, "distance-from-start": 1.1174703819521252, "deviation-center-line": 0.25956483782942774, "driven_lanedir_consec": 0.6843001798814146}, "4way-000-ego3": {"driven_any": 0.3238831695538013, "survival_time": 7.79999999999998, "driven_lanedir": 0.11437153190849704, "in-drivable-lane": 6.59999999999998, "deviation-heading": 0.7591849208350303, "distance-from-start": 0.323878168285902, "deviation-center-line": 0.11625166845571244, "driven_lanedir_consec": 0.11437153190849704}}
simulation-passed1
survival_time_max7.79999999999998
survival_time_mean7.79999999999998
survival_time_min7.79999999999998
No reset possible
142601263Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
142501277Bea Baselines 🐤template-randomlx22-state-estimationsimsuccessyesdavinci-stage-04-6.2.500:12:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.07536801496639489
survival_time_median59.99999999999873
deviation-center-line_median0.6735665136853142
in-drivable-lane_median49.44999999999911


other stats
deviation-center-line_max0.8579388817399466
deviation-center-line_mean0.6660984451379334
deviation-center-line_min0.4667899399885391
deviation-heading_max5.582370303572385
deviation-heading_mean4.330594699634891
deviation-heading_median3.851668979994983
deviation-heading_min3.5577448153373066
distance-from-start_max1.4108418329399044
distance-from-start_mean1.2749217352766675
distance-from-start_median1.4108418329398824
distance-from-start_min1.0030815399502164
driven_any_max15.32631084737068
driven_any_mean13.156722223767504
driven_any_median15.326310847370546
driven_any_min8.81754497656128
driven_lanedir_consec_max0.15436172858886033
driven_lanedir_consec_mean0.06086423316366729
driven_lanedir_consec_min-0.04713704406425334
driven_lanedir_max0.13361915084339548
driven_lanedir_mean0.04596436275685415
driven_lanedir_median0.06382708081740152
driven_lanedir_min-0.05955314339023454
in-drivable-lane_max53.2499999999987
in-drivable-lane_mean44.49999999999929
in-drivable-lane_min30.80000000000006
per-episodes
details{"LF-zig-zag-000-ego0": {"driven_any": 15.326310847370546, "survival_time": 59.99999999999873, "driven_lanedir": 0.13361915084339548, "in-drivable-lane": 53.2499999999987, "deviation-heading": 3.851668979994983, "distance-from-start": 1.4108418329398824, "deviation-center-line": 0.6735665136853142, "driven_lanedir_consec": 0.15436172858886033}, "LF-zig-zag-001-ego0": {"driven_any": 8.81754497656128, "survival_time": 35.9000000000001, "driven_lanedir": 0.06382708081740152, "in-drivable-lane": 30.80000000000006, "deviation-heading": 3.5577448153373066, "distance-from-start": 1.0030815399502164, "deviation-center-line": 0.4667899399885391, "driven_lanedir_consec": 0.07536801496639489}, "LF-zig-zag-002-ego0": {"driven_any": 15.32631084737068, "survival_time": 59.99999999999873, "driven_lanedir": -0.05955314339023454, "in-drivable-lane": 49.44999999999911, "deviation-heading": 5.582370303572385, "distance-from-start": 1.4108418329399044, "deviation-center-line": 0.8579388817399466, "driven_lanedir_consec": -0.04713704406425334}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean51.96666666666585
survival_time_min35.9000000000001
No reset possible
142451289Bea Baselines 🐤template-randomaido-LFV-sim-testingsim-1of4successnodavinci-stage-04-6.2.500:06:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median27.70000000000026
in-drivable-lane_median21.450000000000205
driven_lanedir_consec_median0.012425607873532307
deviation-center-line_median0.5849703367275559


other stats
deviation-center-line_max0.5849703367275559
deviation-center-line_mean0.5849703367275559
deviation-center-line_min0.5849703367275559
deviation-heading_max4.775258728877611
deviation-heading_mean4.775258728877611
deviation-heading_median4.775258728877611
deviation-heading_min4.775258728877611
distance-from-start_max0.7960980578537297
distance-from-start_mean0.7960980578537297
distance-from-start_median0.7960980578537297
distance-from-start_min0.7960980578537297
driven_any_max6.63545554755722
driven_any_mean6.63545554755722
driven_any_median6.63545554755722
driven_any_min6.63545554755722
driven_lanedir_consec_max0.012425607873532307
driven_lanedir_consec_mean0.012425607873532307
driven_lanedir_consec_min0.012425607873532307
driven_lanedir_max0.01577326127428158
driven_lanedir_mean0.01577326127428158
driven_lanedir_median0.01577326127428158
driven_lanedir_min0.01577326127428158
in-drivable-lane_max21.450000000000205
in-drivable-lane_mean21.450000000000205
in-drivable-lane_min21.450000000000205
per-episodes
details{"loop-000-ego0": {"driven_any": 6.63545554755722, "survival_time": 27.70000000000026, "driven_lanedir": 0.01577326127428158, "in-drivable-lane": 21.450000000000205, "deviation-heading": 4.775258728877611, "distance-from-start": 0.7960980578537297, "deviation-center-line": 0.5849703367275559, "driven_lanedir_consec": 0.012425607873532307}}
simulation-passed1
survival_time_max27.70000000000026
survival_time_mean27.70000000000026
survival_time_min27.70000000000026
No reset possible
142421290Bea Baselines 🐤template-randomaido-LFVI-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
142311293Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-0of4successnodavinci-stage-04-6.2.500:12:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median31.650000000000315
in-drivable-lane_median25.07500000000031
driven_lanedir_consec_median0.19631883983708276
deviation-center-line_median0.5303169595499431


other stats
deviation-center-line_max0.6346587556337292
deviation-center-line_mean0.4498294317662554
deviation-center-line_min0.10402505233140616
deviation-heading_max5.9042352469363495
deviation-heading_mean3.531571794786276
deviation-heading_median3.404936745672125
deviation-heading_min1.4121784408645055
distance-from-start_max0.8626308120701025
distance-from-start_mean0.621002716979991
distance-from-start_median0.6516762295571965
distance-from-start_min0.318027596735469
driven_any_max7.64129018112013
driven_any_mean3.877106290822701
driven_any_median3.7658309486532184
driven_any_min0.335473084864234
driven_lanedir_consec_max0.30624803336021755
driven_lanedir_consec_mean0.18830365526398113
driven_lanedir_consec_min0.05432890802154144
driven_lanedir_max0.30624803336021755
driven_lanedir_mean0.1907956986975728
driven_lanedir_median0.19962933842245056
driven_lanedir_min0.05767608458517248
in-drivable-lane_max29.60000000000032
in-drivable-lane_mean25.962500000000293
in-drivable-lane_min24.100000000000243
per-episodes
details{"udem-000-ego0": {"driven_any": 7.64129018112013, "survival_time": 31.650000000000315, "driven_lanedir": 0.05767608458517248, "in-drivable-lane": 24.100000000000243, "deviation-heading": 5.9042352469363495, "distance-from-start": 0.8626308120701025, "deviation-center-line": 0.6346587556337292, "driven_lanedir_consec": 0.05432890802154144}, "udem-000-ego1": {"driven_any": 3.4738391388470204, "survival_time": 31.650000000000315, "driven_lanedir": 0.26180184701004805, "in-drivable-lane": 24.50000000000032, "deviation-heading": 3.4753443866524747, "distance-from-start": 0.6297514211538991, "deviation-center-line": 0.5182786416817282, "driven_lanedir_consec": 0.2397963333994584}, "udem-000-ego2": {"driven_any": 4.057822758459417, "survival_time": 31.650000000000315, "driven_lanedir": 0.13745682983485308, "in-drivable-lane": 25.650000000000297, "deviation-heading": 3.3345291046917755, "distance-from-start": 0.6736010379604938, "deviation-center-line": 0.5423552774181579, "driven_lanedir_consec": 0.1528413462747071}, "udem-000-ego3": {"driven_any": 0.335473084864234, "survival_time": 31.650000000000315, "driven_lanedir": 0.30624803336021755, "in-drivable-lane": 29.60000000000032, "deviation-heading": 1.4121784408645055, "distance-from-start": 0.318027596735469, "deviation-center-line": 0.10402505233140616, "driven_lanedir_consec": 0.30624803336021755}}
simulation-passed1
survival_time_max31.650000000000315
survival_time_mean31.650000000000315
survival_time_min31.650000000000315
No reset possible
142291293Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
142271294Bea Baselines 🐤template-randomaido-LFV_multi-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:07:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median44.99999999999958
in-drivable-lane_median39.249999999999574
driven_lanedir_consec_median0.1329316137267978
deviation-center-line_median0.4769519451920501


other stats
deviation-center-line_max0.627148077892518
deviation-center-line_mean0.4769519451920501
deviation-center-line_min0.3267558124915822
deviation-heading_max4.173256858222429
deviation-heading_mean3.3650961945019375
deviation-heading_median3.3650961945019375
deviation-heading_min2.5569355307814456
distance-from-start_max1.0442247976691823
distance-from-start_mean0.7951911528044138
distance-from-start_median0.7951911528044138
distance-from-start_min0.5461575079396452
driven_any_max11.349124250612952
driven_any_mean6.923556868843365
driven_any_median6.923556868843365
driven_any_min2.497989487073778
driven_lanedir_consec_max0.2397940766790495
driven_lanedir_consec_mean0.1329316137267978
driven_lanedir_consec_min0.02606915077454608
driven_lanedir_max0.2256600500204217
driven_lanedir_mean0.1275377118421561
driven_lanedir_median0.1275377118421561
driven_lanedir_min0.029415373663890465
in-drivable-lane_max41.54999999999957
in-drivable-lane_mean39.249999999999574
in-drivable-lane_min36.94999999999958
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.497989487073778, "survival_time": 44.99999999999958, "driven_lanedir": 0.029415373663890465, "in-drivable-lane": 41.54999999999957, "deviation-heading": 2.5569355307814456, "distance-from-start": 0.5461575079396452, "deviation-center-line": 0.3267558124915822, "driven_lanedir_consec": 0.02606915077454608}, "loop2-000-ego1": {"driven_any": 11.349124250612952, "survival_time": 44.99999999999958, "driven_lanedir": 0.2256600500204217, "in-drivable-lane": 36.94999999999958, "deviation-heading": 4.173256858222429, "distance-from-start": 1.0442247976691823, "deviation-center-line": 0.627148077892518, "driven_lanedir_consec": 0.2397940766790495}}
simulation-passed1
survival_time_max44.99999999999958
survival_time_mean44.99999999999958
survival_time_min44.99999999999958
No reset possible
142171267Bea Baselines 🐤template-randomaido-LFV-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:14:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median48.69999999999937
in-drivable-lane_median36.64999999999927
driven_lanedir_consec_median0.27329071924012593
deviation-center-line_median0.8940598330260409


other stats
deviation-center-line_max0.8940598330260409
deviation-center-line_mean0.8940598330260409
deviation-center-line_min0.8940598330260409
deviation-heading_max9.653852545002117
deviation-heading_mean9.653852545002117
deviation-heading_median9.653852545002117
deviation-heading_min9.653852545002117
distance-from-start_max1.1351054760255814
distance-from-start_mean1.1351054760255814
distance-from-start_median1.1351054760255814
distance-from-start_min1.1351054760255814
driven_any_max12.221812291295889
driven_any_mean12.221812291295889
driven_any_median12.221812291295889
driven_any_min12.221812291295889
driven_lanedir_consec_max0.27329071924012593
driven_lanedir_consec_mean0.27329071924012593
driven_lanedir_consec_min0.27329071924012593
driven_lanedir_max0.26112935377464863
driven_lanedir_mean0.26112935377464863
driven_lanedir_median0.26112935377464863
driven_lanedir_min0.26112935377464863
in-drivable-lane_max36.64999999999927
in-drivable-lane_mean36.64999999999927
in-drivable-lane_min36.64999999999927
per-episodes
details{"zigzag-000-ego0": {"driven_any": 12.221812291295889, "survival_time": 48.69999999999937, "driven_lanedir": 0.26112935377464863, "in-drivable-lane": 36.64999999999927, "deviation-heading": 9.653852545002117, "distance-from-start": 1.1351054760255814, "deviation-center-line": 0.8940598330260409, "driven_lanedir_consec": 0.27329071924012593}}
simulation-passed1
survival_time_max48.69999999999937
survival_time_mean48.69999999999937
survival_time_min48.69999999999937
No reset possible
142101269Bea Baselines 🐤template-randomaido-LFI-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:03:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median20.70000000000016
in-drivable-lane_median12.150000000000135
driven_lanedir_consec_median0.2718508044257806
deviation-center-line_median0.7655525719315331


other stats
deviation-center-line_max0.7655525719315331
deviation-center-line_mean0.7655525719315331
deviation-center-line_min0.7655525719315331
deviation-heading_max5.708723015945327
deviation-heading_mean5.708723015945327
deviation-heading_median5.708723015945327
deviation-heading_min5.708723015945327
distance-from-start_max0.7357883576773756
distance-from-start_mean0.7357883576773756
distance-from-start_median0.7357883576773756
distance-from-start_min0.7357883576773756
driven_any_max5.001991003394682
driven_any_mean5.001991003394682
driven_any_median5.001991003394682
driven_any_min5.001991003394682
driven_lanedir_consec_max0.2718508044257806
driven_lanedir_consec_mean0.2718508044257806
driven_lanedir_consec_min0.2718508044257806
driven_lanedir_max0.2538357176450212
driven_lanedir_mean0.2538357176450212
driven_lanedir_median0.2538357176450212
driven_lanedir_min0.2538357176450212
in-drivable-lane_max12.150000000000135
in-drivable-lane_mean12.150000000000135
in-drivable-lane_min12.150000000000135
per-episodes
details{"udem1-000-ego0": {"driven_any": 5.001991003394682, "survival_time": 20.70000000000016, "driven_lanedir": 0.2538357176450212, "in-drivable-lane": 12.150000000000135, "deviation-heading": 5.708723015945327, "distance-from-start": 0.7357883576773756, "deviation-center-line": 0.7655525719315331, "driven_lanedir_consec": 0.2718508044257806}}
simulation-passed1
survival_time_max20.70000000000016
survival_time_mean20.70000000000016
survival_time_min20.70000000000016
No reset possible
142011271Bea Baselines 🐤template-randomaido-LFVI_multi-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:15:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median43.29999999999968
in-drivable-lane_median35.19999999999969
driven_lanedir_consec_median0.1481685404123385
deviation-center-line_median0.6130052941053471


other stats
deviation-center-line_max6.361236990588696
deviation-center-line_mean1.968961967548878
deviation-center-line_min0.28860029139612103
deviation-heading_max22.59467278731015
deviation-heading_mean9.325639720688413
deviation-heading_median6.178891513015082
deviation-heading_min2.350103069413334
distance-from-start_max1.0093404360059293
distance-from-start_mean0.6788871313560756
distance-from-start_median0.651676229557197
distance-from-start_min0.40285563030397936
driven_any_max10.522906217249696
driven_any_mean4.533111394485939
driven_any_median3.592731455205004
driven_any_min0.4240764502840531
driven_lanedir_consec_max0.3902130173718561
driven_lanedir_consec_mean0.1975964492168203
driven_lanedir_consec_min0.10383569867074804
driven_lanedir_max0.3902130173718561
driven_lanedir_mean0.18988251265665312
driven_lanedir_median0.1348795225002798
driven_lanedir_min0.09955798825419682
in-drivable-lane_max39.84999999999967
in-drivable-lane_mean27.787499999999763
in-drivable-lane_min0.9
per-episodes
details{"4way-000-ego0": {"driven_any": 0.4240764502840531, "survival_time": 43.29999999999968, "driven_lanedir": 0.3902130173718561, "in-drivable-lane": 0.9, "deviation-heading": 22.59467278731015, "distance-from-start": 0.40285563030397936, "deviation-center-line": 6.361236990588696, "driven_lanedir_consec": 0.3902130173718561}, "4way-000-ego1": {"driven_any": 10.522906217249696, "survival_time": 43.29999999999968, "driven_lanedir": 0.13630120329834927, "in-drivable-lane": 32.44999999999972, "deviation-heading": 9.32828495552219, "distance-from-start": 1.0093404360059293, "deviation-center-line": 0.7830123872563919, "driven_lanedir_consec": 0.14963153086450776}, "4way-000-ego2": {"driven_any": 4.117732239446985, "survival_time": 43.29999999999968, "driven_lanedir": 0.1334578417022103, "in-drivable-lane": 37.94999999999966, "deviation-heading": 3.0294980705079753, "distance-from-start": 0.6736010379604934, "deviation-center-line": 0.4429982009543024, "driven_lanedir_consec": 0.14670554996016927}, "4way-000-ego3": {"driven_any": 3.067730670963023, "survival_time": 43.29999999999968, "driven_lanedir": 0.09955798825419682, "in-drivable-lane": 39.84999999999967, "deviation-heading": 2.350103069413334, "distance-from-start": 0.6297514211539005, "deviation-center-line": 0.28860029139612103, "driven_lanedir_consec": 0.10383569867074804}}
simulation-passed1
survival_time_max43.29999999999968
survival_time_mean43.29999999999968
survival_time_min43.29999999999968
No reset possible
141961272Bea Baselines 🐤template-randomaido-LFV_multi-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:08:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median45.099999999999575
in-drivable-lane_median37.09999999999956
driven_lanedir_consec_median0.23705557260553295
deviation-center-line_median0.6463758558852182


other stats
deviation-center-line_max0.7555292890833561
deviation-center-line_mean0.6463758558852182
deviation-center-line_min0.5372224226870801
deviation-heading_max5.523299123594233
deviation-heading_mean5.0377292657796975
deviation-heading_median5.0377292657796975
deviation-heading_min4.552159407965162
distance-from-start_max1.0442247976691843
distance-from-start_mean0.9534278048696496
distance-from-start_median0.9534278048696496
distance-from-start_min0.8626308120701148
driven_any_max11.376062002465083
driven_any_mean9.15341861992026
driven_any_median9.15341861992026
driven_any_min6.9307752373754345
driven_lanedir_consec_max0.26764947507969805
driven_lanedir_consec_mean0.23705557260553295
driven_lanedir_consec_min0.20646167013136785
driven_lanedir_max0.2496387990426845
driven_lanedir_mean0.2213862628967403
driven_lanedir_median0.2213862628967403
driven_lanedir_min0.1931337267507961
in-drivable-lane_max37.649999999999565
in-drivable-lane_mean37.09999999999956
in-drivable-lane_min36.54999999999956
per-episodes
details{"loop2-000-ego0": {"driven_any": 11.376062002465083, "survival_time": 45.099999999999575, "driven_lanedir": 0.2496387990426845, "in-drivable-lane": 36.54999999999956, "deviation-heading": 5.523299123594233, "distance-from-start": 1.0442247976691843, "deviation-center-line": 0.7555292890833561, "driven_lanedir_consec": 0.26764947507969805}, "loop2-000-ego1": {"driven_any": 6.9307752373754345, "survival_time": 45.099999999999575, "driven_lanedir": 0.1931337267507961, "in-drivable-lane": 37.649999999999565, "deviation-heading": 4.552159407965162, "distance-from-start": 0.8626308120701148, "deviation-center-line": 0.5372224226870801, "driven_lanedir_consec": 0.20646167013136785}}
simulation-passed1
survival_time_max45.099999999999575
survival_time_mean45.099999999999575
survival_time_min45.099999999999575
No reset possible
141941273Bea Baselines 🐤template-randomaido-LFP-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:02:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median15.700000000000088
in-drivable-lane_median8.100000000000078
driven_lanedir_consec_median0.27378153863999577
deviation-center-line_median0.6226670229639317


other stats
deviation-center-line_max0.6226670229639317
deviation-center-line_mean0.6226670229639317
deviation-center-line_min0.6226670229639317
deviation-heading_max4.9776949056766355
deviation-heading_mean4.9776949056766355
deviation-heading_median4.9776949056766355
deviation-heading_min4.9776949056766355
distance-from-start_max0.6297514211538986
distance-from-start_mean0.6297514211538986
distance-from-start_median0.6297514211538986
distance-from-start_min0.6297514211538986
driven_any_max3.532822332695487
driven_any_mean3.532822332695487
driven_any_median3.532822332695487
driven_any_min3.532822332695487
driven_lanedir_consec_max0.27378153863999577
driven_lanedir_consec_mean0.27378153863999577
driven_lanedir_consec_min0.27378153863999577
driven_lanedir_max0.2627748326499355
driven_lanedir_mean0.2627748326499355
driven_lanedir_median0.2627748326499355
driven_lanedir_min0.2627748326499355
in-drivable-lane_max8.100000000000078
in-drivable-lane_mean8.100000000000078
in-drivable-lane_min8.100000000000078
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.532822332695487, "survival_time": 15.700000000000088, "driven_lanedir": 0.2627748326499355, "in-drivable-lane": 8.100000000000078, "deviation-heading": 4.9776949056766355, "distance-from-start": 0.6297514211538986, "deviation-center-line": 0.6226670229639317, "driven_lanedir_consec": 0.27378153863999577}}
simulation-passed1
survival_time_max15.700000000000088
survival_time_mean15.700000000000088
survival_time_min15.700000000000088
No reset possible
141841121Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-2of4abortednodavinci-stage-04-6.2.500:01:55
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1302, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 749, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
141811121Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
141791121Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-1of4successnodavinci-stage-04-6.2.500:07:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.850000000000104
in-drivable-lane_median12.125000000000089
driven_lanedir_consec_median0.0914085509908058
deviation-center-line_median0.43295730670036126


other stats
deviation-center-line_max0.9740434407320936
deviation-center-line_mean0.4859958968604682
deviation-center-line_min0.10402553330905678
deviation-heading_max11.275693531416076
deviation-heading_mean4.654809102682379
deviation-heading_median2.965682219224468
deviation-heading_min1.412178440864505
distance-from-start_max0.6736010379604943
distance-from-start_mean0.3985347917343786
distance-from-start_median0.4602690644885098
distance-from-start_min6.280369834735102e-16
driven_any_max4.057822758459427
driven_any_mean1.6869445200555797
driven_any_median1.3449776608814374
driven_any_min1.6723002649096045e-14
driven_lanedir_consec_max0.3062479141509611
driven_lanedir_consec_mean0.12226625403314316
driven_lanedir_consec_min0.0
driven_lanedir_max0.3062479141509611
driven_lanedir_mean0.11925650183156368
driven_lanedir_median0.08538904658764679
driven_lanedir_min0.0
in-drivable-lane_max14.800000000000107
in-drivable-lane_mean9.76250000000007
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 2.295525081876566, "survival_time": 16.850000000000104, "driven_lanedir": 0.03283062049203522, "in-drivable-lane": 13.400000000000093, "deviation-heading": 2.548872644626666, "distance-from-start": 0.5461575079396546, "deviation-center-line": 0.3268416966298657, "driven_lanedir_consec": 0.029485112858473883}, "4way-000-ego1": {"driven_any": 1.6723002649096045e-14, "survival_time": 16.850000000000104, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 11.275693531416076, "distance-from-start": 6.280369834735102e-16, "deviation-center-line": 0.9740434407320936, "driven_lanedir_consec": 0.0}, "4way-000-ego2": {"driven_any": 4.057822758459427, "survival_time": 16.850000000000104, "driven_lanedir": 0.13794747268325835, "in-drivable-lane": 10.850000000000088, "deviation-heading": 3.3824917938222696, "distance-from-start": 0.6736010379604943, "deviation-center-line": 0.5390729167708568, "driven_lanedir_consec": 0.15333198912313772}, "4way-000-ego3": {"driven_any": 0.3944302398863089, "survival_time": 16.850000000000104, "driven_lanedir": 0.3062479141509611, "in-drivable-lane": 14.800000000000107, "deviation-heading": 1.412178440864505, "distance-from-start": 0.37438062103736497, "deviation-center-line": 0.10402553330905678, "driven_lanedir_consec": 0.3062479141509611}}
simulation-passed1
survival_time_max16.850000000000104
survival_time_mean16.850000000000104
survival_time_min16.850000000000104
No reset possible
141711123Bea Baselines 🐤template-randomaido-LFP-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:08:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median36.34999999999917
driven_lanedir_consec_median0.23799216289173675
deviation-center-line_median2.122382603135255


other stats
deviation-center-line_max2.122382603135255
deviation-center-line_mean2.122382603135255
deviation-center-line_min2.122382603135255
deviation-heading_max20.52214487263099
deviation-heading_mean20.52214487263099
deviation-heading_median20.52214487263099
deviation-heading_min20.52214487263099
distance-from-start_max1.4108418329398902
distance-from-start_mean1.4108418329398902
distance-from-start_median1.4108418329398902
distance-from-start_min1.4108418329398902
driven_any_max15.326310847370609
driven_any_mean15.326310847370609
driven_any_median15.326310847370609
driven_any_min15.326310847370609
driven_lanedir_consec_max0.23799216289173675
driven_lanedir_consec_mean0.23799216289173675
driven_lanedir_consec_min0.23799216289173675
driven_lanedir_max0.2454177542370326
driven_lanedir_mean0.2454177542370326
driven_lanedir_median0.2454177542370326
driven_lanedir_min0.2454177542370326
in-drivable-lane_max36.34999999999917
in-drivable-lane_mean36.34999999999917
in-drivable-lane_min36.34999999999917
per-episodes
details{"zigzag-000-ego0": {"driven_any": 15.326310847370609, "survival_time": 59.99999999999873, "driven_lanedir": 0.2454177542370326, "in-drivable-lane": 36.34999999999917, "deviation-heading": 20.52214487263099, "distance-from-start": 1.4108418329398902, "deviation-center-line": 2.122382603135255, "driven_lanedir_consec": 0.23799216289173675}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
141601126Bea Baselines 🐤template-rosaido-LFVI-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:02:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.899999999999991
in-drivable-lane_median3.0999999999999934
driven_lanedir_consec_median0.2414127931030774
deviation-center-line_median0.1446830124466218


other stats
deviation-center-line_max0.1446830124466218
deviation-center-line_mean0.1446830124466218
deviation-center-line_min0.1446830124466218
deviation-heading_max1.605905722540692
deviation-heading_mean1.605905722540692
deviation-heading_median1.605905722540692
deviation-heading_min1.605905722540692
distance-from-start_max1.1547641559399455
distance-from-start_mean1.1547641559399455
distance-from-start_median1.1547641559399455
distance-from-start_min1.1547641559399455
driven_any_max1.163940094295357
driven_any_mean1.163940094295357
driven_any_median1.163940094295357
driven_any_min1.163940094295357
driven_lanedir_consec_max0.2414127931030774
driven_lanedir_consec_mean0.2414127931030774
driven_lanedir_consec_min0.2414127931030774
driven_lanedir_max0.2414127931030774
driven_lanedir_mean0.2414127931030774
driven_lanedir_median0.2414127931030774
driven_lanedir_min0.2414127931030774
in-drivable-lane_max3.0999999999999934
in-drivable-lane_mean3.0999999999999934
in-drivable-lane_min3.0999999999999934
per-episodes
details{"4way-000-ego0": {"driven_any": 1.163940094295357, "survival_time": 4.899999999999991, "driven_lanedir": 0.2414127931030774, "in-drivable-lane": 3.0999999999999934, "deviation-heading": 1.605905722540692, "distance-from-start": 1.1547641559399455, "deviation-center-line": 0.1446830124466218, "driven_lanedir_consec": 0.2414127931030774}}
simulation-passed1
survival_time_max4.899999999999991
survival_time_mean4.899999999999991
survival_time_min4.899999999999991
No reset possible
141561127Bea Baselines 🐤template-rosaido-LFI-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:02:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.399999999999992
in-drivable-lane_median3.199999999999992
driven_lanedir_consec_median0.1960756130317376
deviation-center-line_median0.0794015257239138


other stats
deviation-center-line_max0.0794015257239138
deviation-center-line_mean0.0794015257239138
deviation-center-line_min0.0794015257239138
deviation-heading_max0.669263783516599
deviation-heading_mean0.669263783516599
deviation-heading_median0.669263783516599
deviation-heading_min0.669263783516599
distance-from-start_max0.9293229785216356
distance-from-start_mean0.9293229785216356
distance-from-start_median0.9293229785216356
distance-from-start_min0.9293229785216356
driven_any_max0.9335297778458084
driven_any_mean0.9335297778458084
driven_any_median0.9335297778458084
driven_any_min0.9335297778458084
driven_lanedir_consec_max0.1960756130317376
driven_lanedir_consec_mean0.1960756130317376
driven_lanedir_consec_min0.1960756130317376
driven_lanedir_max0.1960756130317376
driven_lanedir_mean0.1960756130317376
driven_lanedir_median0.1960756130317376
driven_lanedir_min0.1960756130317376
in-drivable-lane_max3.199999999999992
in-drivable-lane_mean3.199999999999992
in-drivable-lane_min3.199999999999992
per-episodes
details{"udem1-000-ego0": {"driven_any": 0.9335297778458084, "survival_time": 4.399999999999992, "driven_lanedir": 0.1960756130317376, "in-drivable-lane": 3.199999999999992, "deviation-heading": 0.669263783516599, "distance-from-start": 0.9293229785216356, "deviation-center-line": 0.0794015257239138, "driven_lanedir_consec": 0.1960756130317376}}
simulation-passed1
survival_time_max4.399999999999992
survival_time_mean4.399999999999992
survival_time_min4.399999999999992
No reset possible
141491129Bea Baselines 🐤template-rosaido-LFV_multi-sim-validationsim-0of4successnodavinci-stage-04-6.2.500:03:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.349999999999985
in-drivable-lane_median4.999999999999985
driven_lanedir_consec_median0.2758496226055053
deviation-center-line_median0.08108632489445469


other stats
deviation-center-line_max0.10099616234894104
deviation-center-line_mean0.08110571255691933
deviation-center-line_min0.06125403808982689
deviation-heading_max0.5884917363404036
deviation-heading_mean0.4925569565461348
deviation-heading_median0.4970893149142285
deviation-heading_min0.3875574600156787
distance-from-start_max1.5877362359653824
distance-from-start_mean1.083080007744911
distance-from-start_median1.1419646737295954
distance-from-start_min0.46065444755507035
driven_any_max1.6289423726054186
driven_any_mean1.1043147857926665
driven_any_median1.1616220565550184
driven_any_min0.4650726574552108
driven_lanedir_consec_max0.43409227352807145
driven_lanedir_consec_mean0.28197052936501626
driven_lanedir_consec_min0.14209059872098306
driven_lanedir_max0.43409227352807145
driven_lanedir_mean0.28197052936501626
driven_lanedir_median0.2758496226055053
driven_lanedir_min0.14209059872098306
in-drivable-lane_max5.599999999999985
in-drivable-lane_mean5.074999999999985
in-drivable-lane_min4.699999999999984
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.4650726574552108, "survival_time": 6.349999999999985, "driven_lanedir": 0.2234945656614271, "in-drivable-lane": 5.199999999999985, "deviation-heading": 0.5884917363404036, "distance-from-start": 0.46065444755507035, "deviation-center-line": 0.0728835838691255, "driven_lanedir_consec": 0.2234945656614271}, "autolab-000-ego1": {"driven_any": 1.0501813318270516, "survival_time": 6.349999999999985, "driven_lanedir": 0.14209059872098306, "in-drivable-lane": 5.599999999999985, "deviation-heading": 0.4299511105106536, "distance-from-start": 1.0347673235267996, "deviation-center-line": 0.06125403808982689, "driven_lanedir_consec": 0.14209059872098306}, "autolab-000-ego2": {"driven_any": 1.6289423726054186, "survival_time": 6.349999999999985, "driven_lanedir": 0.32820467954958343, "in-drivable-lane": 4.799999999999985, "deviation-heading": 0.5642275193178033, "distance-from-start": 1.5877362359653824, "deviation-center-line": 0.08928906591978389, "driven_lanedir_consec": 0.32820467954958343}, "autolab-000-ego3": {"driven_any": 1.2730627812829851, "survival_time": 6.349999999999985, "driven_lanedir": 0.43409227352807145, "in-drivable-lane": 4.699999999999984, "deviation-heading": 0.3875574600156787, "distance-from-start": 1.2491620239323915, "deviation-center-line": 0.10099616234894104, "driven_lanedir_consec": 0.43409227352807145}}
simulation-passed1
survival_time_max6.349999999999985
survival_time_mean6.349999999999985
survival_time_min6.349999999999985
No reset possible
141451130Bea Baselines 🐤template-rosaido-LFP-sim-validationsim-0of4successnodavinci-stage-04-6.2.500:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.999999999999994
in-drivable-lane_median3.0499999999999936
driven_lanedir_consec_median0.1414173812675832
deviation-center-line_median0.05783697266108296


other stats
deviation-center-line_max0.05783697266108296
deviation-center-line_mean0.05783697266108296
deviation-center-line_min0.05783697266108296
deviation-heading_max0.6310002556259808
deviation-heading_mean0.6310002556259808
deviation-heading_median0.6310002556259808
deviation-heading_min0.6310002556259808
distance-from-start_max0.8801429130889312
distance-from-start_mean0.8801429130889312
distance-from-start_median0.8801429130889312
distance-from-start_min0.8801429130889312
driven_any_max0.8962672570910794
driven_any_mean0.8962672570910794
driven_any_median0.8962672570910794
driven_any_min0.8962672570910794
driven_lanedir_consec_max0.1414173812675832
driven_lanedir_consec_mean0.1414173812675832
driven_lanedir_consec_min0.1414173812675832
driven_lanedir_max0.1414173812675832
driven_lanedir_mean0.1414173812675832
driven_lanedir_median0.1414173812675832
driven_lanedir_min0.1414173812675832
in-drivable-lane_max3.0499999999999936
in-drivable-lane_mean3.0499999999999936
in-drivable-lane_min3.0499999999999936
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.8962672570910794, "survival_time": 3.999999999999994, "driven_lanedir": 0.1414173812675832, "in-drivable-lane": 3.0499999999999936, "deviation-heading": 0.6310002556259808, "distance-from-start": 0.8801429130889312, "deviation-center-line": 0.05783697266108296, "driven_lanedir_consec": 0.1414173812675832}}
simulation-passed1
survival_time_max3.999999999999994
survival_time_mean3.999999999999994
survival_time_min3.999999999999994
No reset possible
141421130Bea Baselines 🐤template-rosaido-LFP-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.4
in-drivable-lane_median3.600000000000011
driven_lanedir_consec_median1.5932799458241746
deviation-center-line_median0.5352425743656266


other stats
deviation-center-line_max0.5352425743656266
deviation-center-line_mean0.5352425743656266
deviation-center-line_min0.5352425743656266
deviation-heading_max1.7599567363360082
deviation-heading_mean1.7599567363360082
deviation-heading_median1.7599567363360082
deviation-heading_min1.7599567363360082
distance-from-start_max2.252565891631525
distance-from-start_mean2.252565891631525
distance-from-start_median2.252565891631525
distance-from-start_min2.252565891631525
driven_any_max2.568414654720989
driven_any_mean2.568414654720989
driven_any_median2.568414654720989
driven_any_min2.568414654720989
driven_lanedir_consec_max1.5932799458241746
driven_lanedir_consec_mean1.5932799458241746
driven_lanedir_consec_min1.5932799458241746
driven_lanedir_max1.5932799458241746
driven_lanedir_mean1.5932799458241746
driven_lanedir_median1.5932799458241746
driven_lanedir_min1.5932799458241746
in-drivable-lane_max3.600000000000011
in-drivable-lane_mean3.600000000000011
in-drivable-lane_min3.600000000000011
per-episodes
details{"loop-000-ego0": {"driven_any": 2.568414654720989, "survival_time": 9.4, "driven_lanedir": 1.5932799458241746, "in-drivable-lane": 3.600000000000011, "deviation-heading": 1.7599567363360082, "distance-from-start": 2.252565891631525, "deviation-center-line": 0.5352425743656266, "driven_lanedir_consec": 1.5932799458241746}}
simulation-passed1
survival_time_max9.4
survival_time_mean9.4
survival_time_min9.4
No reset possible
141341142Bea Baselines 🐤template-rosaido-LFV-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:02:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.599999999999995
in-drivable-lane_median1.499999999999995
driven_lanedir_consec_median0.43921399779262815
deviation-center-line_median0.13635091451687936


other stats
deviation-center-line_max0.13635091451687936
deviation-center-line_mean0.13635091451687936
deviation-center-line_min0.13635091451687936
deviation-heading_max1.1150666181391644
deviation-heading_mean1.1150666181391644
deviation-heading_median1.1150666181391644
deviation-heading_min1.1150666181391644
distance-from-start_max0.7640125423000645
distance-from-start_mean0.7640125423000645
distance-from-start_median0.7640125423000645
distance-from-start_min0.7640125423000645
driven_any_max0.7741490942574163
driven_any_mean0.7741490942574163
driven_any_median0.7741490942574163
driven_any_min0.7741490942574163
driven_lanedir_consec_max0.43921399779262815
driven_lanedir_consec_mean0.43921399779262815
driven_lanedir_consec_min0.43921399779262815
driven_lanedir_max0.43921399779262815
driven_lanedir_mean0.43921399779262815
driven_lanedir_median0.43921399779262815
driven_lanedir_min0.43921399779262815
in-drivable-lane_max1.499999999999995
in-drivable-lane_mean1.499999999999995
in-drivable-lane_min1.499999999999995
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.7741490942574163, "survival_time": 3.599999999999995, "driven_lanedir": 0.43921399779262815, "in-drivable-lane": 1.499999999999995, "deviation-heading": 1.1150666181391644, "distance-from-start": 0.7640125423000645, "deviation-center-line": 0.13635091451687936, "driven_lanedir_consec": 0.43921399779262815}}
simulation-passed1
survival_time_max3.599999999999995
survival_time_mean3.599999999999995
survival_time_min3.599999999999995
No reset possible
141311143Bea Baselines 🐤template-rosaido-LFVI-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
141241144Bea Baselines 🐤template-rosaido-LFI-sim-testingsim-1of4successnodavinci-stage-04-6.2.500:02:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.999999999999987
in-drivable-lane_median5.149999999999986
driven_lanedir_consec_median0.1147462544674096
deviation-center-line_median0.04762501396049994


other stats
deviation-center-line_max0.04762501396049994
deviation-center-line_mean0.04762501396049994
deviation-center-line_min0.04762501396049994
deviation-heading_max0.6156464658152464
deviation-heading_mean0.6156464658152464
deviation-heading_median0.6156464658152464
deviation-heading_min0.6156464658152464
distance-from-start_max1.559228226466982
distance-from-start_mean1.559228226466982
distance-from-start_median1.559228226466982
distance-from-start_min1.559228226466982
driven_any_max1.5751939141165343
driven_any_mean1.5751939141165343
driven_any_median1.5751939141165343
driven_any_min1.5751939141165343
driven_lanedir_consec_max0.1147462544674096
driven_lanedir_consec_mean0.1147462544674096
driven_lanedir_consec_min0.1147462544674096
driven_lanedir_max0.1147462544674096
driven_lanedir_mean0.1147462544674096
driven_lanedir_median0.1147462544674096
driven_lanedir_min0.1147462544674096
in-drivable-lane_max5.149999999999986
in-drivable-lane_mean5.149999999999986
in-drivable-lane_min5.149999999999986
per-episodes
details{"udem1-000-ego0": {"driven_any": 1.5751939141165343, "survival_time": 5.999999999999987, "driven_lanedir": 0.1147462544674096, "in-drivable-lane": 5.149999999999986, "deviation-heading": 0.6156464658152464, "distance-from-start": 1.559228226466982, "deviation-center-line": 0.04762501396049994, "driven_lanedir_consec": 0.1147462544674096}}
simulation-passed1
survival_time_max5.999999999999987
survival_time_mean5.999999999999987
survival_time_min5.999999999999987
No reset possible
141181145Bea Baselines 🐤template-rosaido-LF-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.26763645637747313
survival_time_median5.249999999999989
deviation-center-line_median0.15460750697499265
in-drivable-lane_median3.3999999999999924


other stats
deviation-center-line_max0.15460750697499265
deviation-center-line_mean0.15460750697499265
deviation-center-line_min0.15460750697499265
deviation-heading_max1.58270912398427
deviation-heading_mean1.58270912398427
deviation-heading_median1.58270912398427
deviation-heading_min1.58270912398427
distance-from-start_max1.1794087465972078
distance-from-start_mean1.1794087465972078
distance-from-start_median1.1794087465972078
distance-from-start_min1.1794087465972078
driven_any_max1.2109820217604088
driven_any_mean1.2109820217604088
driven_any_median1.2109820217604088
driven_any_min1.2109820217604088
driven_lanedir_consec_max0.26763645637747313
driven_lanedir_consec_mean0.26763645637747313
driven_lanedir_consec_min0.26763645637747313
driven_lanedir_max0.26763645637747313
driven_lanedir_mean0.26763645637747313
driven_lanedir_median0.26763645637747313
driven_lanedir_min0.26763645637747313
in-drivable-lane_max3.3999999999999924
in-drivable-lane_mean3.3999999999999924
in-drivable-lane_min3.3999999999999924
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.2109820217604088, "survival_time": 5.249999999999989, "driven_lanedir": 0.26763645637747313, "in-drivable-lane": 3.3999999999999924, "deviation-heading": 1.58270912398427, "distance-from-start": 1.1794087465972078, "deviation-center-line": 0.15460750697499265, "driven_lanedir_consec": 0.26763645637747313}}
simulation-passed1
survival_time_max5.249999999999989
survival_time_mean5.249999999999989
survival_time_min5.249999999999989
No reset possible
141141147Bea Baselines 🐤template-rosaido-LFV_multi-sim-testingsim-1of4successnodavinci-stage-04-6.2.500:03:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.099999999999986
in-drivable-lane_median4.624999999999988
driven_lanedir_consec_median0.21077906000886604
deviation-center-line_median0.1326730819616352


other stats
deviation-center-line_max0.27089697917850536
deviation-center-line_mean0.15052859604454305
deviation-center-line_min0.06587124107639644
deviation-heading_max2.418361949816546
deviation-heading_mean1.0930986024885945
deviation-heading_median0.7811442573697094
deviation-heading_min0.39174394539841223
distance-from-start_max1.5053194755477388
distance-from-start_mean1.179872196680838
distance-from-start_median1.2507784747609032
distance-from-start_min0.712612361653806
driven_any_max1.5306233132812168
driven_any_mean1.2371522100371832
driven_any_median1.3493886735556222
driven_any_min0.7192081797562725
driven_lanedir_consec_max0.2863350129341149
driven_lanedir_consec_mean0.20845241416310897
driven_lanedir_consec_min0.1259165237005888
driven_lanedir_max0.30112096058604276
driven_lanedir_mean0.2121489010760909
driven_lanedir_median0.21077906000886604
driven_lanedir_min0.1259165237005888
in-drivable-lane_max5.199999999999986
in-drivable-lane_mean4.462499999999988
in-drivable-lane_min3.3999999999999906
per-episodes
details{"loop-000-ego0": {"driven_any": 1.452082828349873, "survival_time": 6.099999999999986, "driven_lanedir": 0.1259165237005888, "in-drivable-lane": 4.4499999999999895, "deviation-heading": 1.0583196924352691, "distance-from-start": 1.3094676019546023, "deviation-center-line": 0.17827588470771866, "driven_lanedir_consec": 0.1259165237005888}, "loop-000-ego1": {"driven_any": 1.2466945187613712, "survival_time": 6.099999999999986, "driven_lanedir": 0.30112096058604276, "in-drivable-lane": 3.3999999999999906, "deviation-heading": 2.418361949816546, "distance-from-start": 1.192089347567204, "deviation-center-line": 0.27089697917850536, "driven_lanedir_consec": 0.2863350129341149}, "loop-000-ego2": {"driven_any": 1.5306233132812168, "survival_time": 6.099999999999986, "driven_lanedir": 0.27410842525509516, "in-drivable-lane": 4.799999999999986, "deviation-heading": 0.39174394539841223, "distance-from-start": 1.5053194755477388, "deviation-center-line": 0.06587124107639644, "driven_lanedir_consec": 0.27410842525509516}, "loop-000-ego3": {"driven_any": 0.7192081797562725, "survival_time": 6.099999999999986, "driven_lanedir": 0.14744969476263692, "in-drivable-lane": 5.199999999999986, "deviation-heading": 0.5039688223041496, "distance-from-start": 0.712612361653806, "deviation-center-line": 0.08707027921555174, "driven_lanedir_consec": 0.14744969476263692}}
simulation-passed1
survival_time_max6.099999999999986
survival_time_mean6.099999999999986
survival_time_min6.099999999999986
No reset possible
141091148Bea Baselines 🐤template-rosaido-LFP-sim-testingsim-1of4successnodavinci-stage-04-6.2.500:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.5499999999999954
in-drivable-lane_median2.499999999999995
driven_lanedir_consec_median0.1981177052060341
deviation-center-line_median0.08178305365555395


other stats
deviation-center-line_max0.08178305365555395
deviation-center-line_mean0.08178305365555395
deviation-center-line_min0.08178305365555395
deviation-heading_max0.5702357389695344
deviation-heading_mean0.5702357389695344
deviation-heading_median0.5702357389695344
deviation-heading_min0.5702357389695344
distance-from-start_max0.7356439799389728
distance-from-start_mean0.7356439799389728
distance-from-start_median0.7356439799389728
distance-from-start_min0.7356439799389728
driven_any_max0.7403701031717685
driven_any_mean0.7403701031717685
driven_any_median0.7403701031717685
driven_any_min0.7403701031717685
driven_lanedir_consec_max0.1981177052060341
driven_lanedir_consec_mean0.1981177052060341
driven_lanedir_consec_min0.1981177052060341
driven_lanedir_max0.1981177052060341
driven_lanedir_mean0.1981177052060341
driven_lanedir_median0.1981177052060341
driven_lanedir_min0.1981177052060341
in-drivable-lane_max2.499999999999995
in-drivable-lane_mean2.499999999999995
in-drivable-lane_min2.499999999999995
per-episodes
details{"loop-000-ego0": {"driven_any": 0.7403701031717685, "survival_time": 3.5499999999999954, "driven_lanedir": 0.1981177052060341, "in-drivable-lane": 2.499999999999995, "deviation-heading": 0.5702357389695344, "distance-from-start": 0.7356439799389728, "deviation-center-line": 0.08178305365555395, "driven_lanedir_consec": 0.1981177052060341}}
simulation-passed1
survival_time_max3.5499999999999954
survival_time_mean3.5499999999999954
survival_time_min3.5499999999999954
No reset possible
141001150Bea Baselines 🐤template-tensorflowaido-LFVI-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
140951151Bea Baselines 🐤template-tensorflowaido-LFI-sim-validationsim-0of4host-errornodavinci-stage-04-6.2.500:01:37
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140901152Bea Baselines 🐤template-tensorflowaido-LF-sim-validationsim-3of4failednodavinci-stage-04-6.2.500:00:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140841154Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-validationsim-1of4failednodavinci-stage-04-6.2.500:01:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140831155Bea Baselines 🐤template-tensorflowaido-LFP-sim-validationsim-3of4failednodavinci-stage-04-6.2.500:01:00
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140691167Bea Baselines 🐤template-tensorflowaido-LFV-sim-testingsim-0of4failednodavinci-stage-04-6.2.500:01:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140641168Bea Baselines 🐤template-tensorflowaido-LFVI-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
140601170Bea Baselines 🐤template-tensorflowaido-LF-sim-testingsim-0of4failednodavinci-stage-04-6.2.500:00:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140571170Bea Baselines 🐤template-tensorflowaido-LF-sim-testingsim-1of4failednodavinci-stage-04-6.2.500:01:00
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
140521171Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
140341179Bea Baselines 🐤baseline-duckietown-mllx22-modconsimsuccessyesdavinci-stage-04-6.2.500:09:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median13.575000000000092
deviation-center-line_median0.9575431948064368
driven_lanedir_consec_median3.700738870393203
survival_time_median41.54999999999946


other stats
deviation-center-line_max1.9150863896128736
deviation-center-line_mean0.9575431948064368
deviation-center-line_min0.0
deviation-heading_max3.7901503366853286
deviation-heading_mean1.8950751683426643
deviation-heading_median1.8950751683426643
deviation-heading_min0.0
distance-from-start_max7.886945223810515
distance-from-start_mean5.380900986928026
distance-from-start_median5.380900986928026
distance-from-start_min2.8748567500455375
driven_any_max7.921285717323138
driven_any_mean5.418497760559028
driven_any_median5.418497760559028
driven_any_min2.915709803794917
driven_lanedir_consec_max7.401477740786406
driven_lanedir_consec_mean3.700738870393203
driven_lanedir_consec_min0.0
driven_lanedir_max7.401477740786406
driven_lanedir_mean3.700738870393203
driven_lanedir_median3.700738870393203
driven_lanedir_min0.0
in-drivable-lane_max23.100000000000193
in-drivable-lane_mean13.575000000000092
in-drivable-lane_min4.049999999999994
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 7.921285717323138, "survival_time": 59.99999999999873, "driven_lanedir": 7.401477740786406, "in-drivable-lane": 4.049999999999994, "deviation-heading": 3.7901503366853286, "distance-from-start": 7.886945223810515, "deviation-center-line": 1.9150863896128736, "driven_lanedir_consec": 7.401477740786406}, "LF-full-loop-001-ego0": {"driven_any": 2.915709803794917, "survival_time": 23.100000000000193, "driven_lanedir": 0.0, "in-drivable-lane": 23.100000000000193, "deviation-heading": 0.0, "distance-from-start": 2.8748567500455375, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean41.54999999999946
survival_time_min23.100000000000193
No reset possible
140291184Bea Baselines 🐤baseline-duckietownlx22-objdetsimsuccessyesdavinci-stage-04-6.2.500:13:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
driven_lanedir_consec_median0.0001430511474609375


other stats
deviation-center-line_max1.4153832435607612
deviation-center-line_mean0.9025621175765756
deviation-center-line_median0.9025621175765756
deviation-center-line_min0.3897409915923899
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.0
distance-from-start_mean0.0
distance-from-start_median0.0
distance-from-start_min0.0
driven_any_max0.0
driven_any_mean0.0
driven_any_median0.0
driven_any_min0.0
driven_lanedir_consec_max0.0001430511474609375
driven_lanedir_consec_mean0.0001430511474609375
driven_lanedir_consec_min0.0001430511474609375
driven_lanedir_max0.0001430511474609375
driven_lanedir_mean0.0001430511474609375
driven_lanedir_median0.0001430511474609375
driven_lanedir_min0.0001430511474609375
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_median0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "distance-from-start": 0.0, "deviation-center-line": 0.3897409915923899, "driven_lanedir_consec": 0.0001430511474609375}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "distance-from-start": 0.0, "deviation-center-line": 1.4153832435607612, "driven_lanedir_consec": 0.0001430511474609375}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
140271187Bea Baselines 🐤minimal-agentlx22-modconsimsuccessyesdavinci-stage-04-6.2.500:04:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median15.200000000000092
deviation-center-line_median0.0
driven_lanedir_consec_median0.0
survival_time_median15.200000000000092


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.705646613157915
distance-from-start_mean2.336800784178124
distance-from-start_median2.336800784178124
distance-from-start_min0.9679549551983332
driven_any_max3.707570013404081
driven_any_mean2.33778303094729
driven_any_median2.33778303094729
driven_any_min0.9679960484904996
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max23.5000000000002
in-drivable-lane_mean15.200000000000092
in-drivable-lane_min6.8999999999999835
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 3.707570013404081, "survival_time": 23.5000000000002, "driven_lanedir": 0.0, "in-drivable-lane": 23.5000000000002, "deviation-heading": 0.0, "distance-from-start": 3.705646613157915, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}, "LF-full-loop-001-ego0": {"driven_any": 0.9679960484904996, "survival_time": 6.8999999999999835, "driven_lanedir": 0.0, "in-drivable-lane": 6.8999999999999835, "deviation-heading": 0.0, "distance-from-start": 0.9679549551983332, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max23.5000000000002
survival_time_mean15.200000000000092
survival_time_min6.8999999999999835
No reset possible
140231190Bea Baselines 🐤minimal-agentlx22-state-estimationsimsuccessyesdavinci-stage-04-6.2.500:03:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.602316779928666
survival_time_median11.250000000000025
deviation-center-line_median0.25844063605243855
in-drivable-lane_median6.600000000000033


other stats
deviation-center-line_max0.46940419435631386
deviation-center-line_mean0.31601951040293014
deviation-center-line_min0.220213700800038
deviation-heading_max2.138198727189773
deviation-heading_mean1.3887557886235824
deviation-heading_median1.3576715425669252
deviation-heading_min0.6703970961140492
distance-from-start_max2.9006007855190927
distance-from-start_mean2.0801990954134797
distance-from-start_median1.6889817408539205
distance-from-start_min1.651014759867426
driven_any_max2.9015373770561546
driven_any_mean2.0805808076947017
driven_any_median1.68908053965813
driven_any_min1.65112450636982
driven_lanedir_consec_max0.6591118533086625
driven_lanedir_consec_mean0.5555566616524058
driven_lanedir_consec_min0.40524135171988895
driven_lanedir_max0.6591118533086625
driven_lanedir_mean0.5555566616524058
driven_lanedir_median0.602316779928666
driven_lanedir_min0.40524135171988895
in-drivable-lane_max15.750000000000131
in-drivable-lane_mean9.550000000000065
in-drivable-lane_min6.300000000000031
per-episodes
details{"LF-zig-zag-000-ego0": {"driven_any": 1.65112450636982, "survival_time": 11.050000000000022, "driven_lanedir": 0.6591118533086625, "in-drivable-lane": 6.300000000000031, "deviation-heading": 1.3576715425669252, "distance-from-start": 1.651014759867426, "deviation-center-line": 0.220213700800038, "driven_lanedir_consec": 0.6591118533086625}, "LF-zig-zag-001-ego0": {"driven_any": 2.9015373770561546, "survival_time": 18.60000000000013, "driven_lanedir": 0.40524135171988895, "in-drivable-lane": 15.750000000000131, "deviation-heading": 0.6703970961140492, "distance-from-start": 2.9006007855190927, "deviation-center-line": 0.25844063605243855, "driven_lanedir_consec": 0.40524135171988895}, "LF-zig-zag-002-ego0": {"driven_any": 1.68908053965813, "survival_time": 11.250000000000025, "driven_lanedir": 0.602316779928666, "in-drivable-lane": 6.600000000000033, "deviation-heading": 2.138198727189773, "distance-from-start": 1.6889817408539205, "deviation-center-line": 0.46940419435631386, "driven_lanedir_consec": 0.602316779928666}}
simulation-passed1
survival_time_max18.60000000000013
survival_time_mean13.633333333333391
survival_time_min11.050000000000022
No reset possible
140181196Bea Baselines 🐤template-randomlx22-objdetsimsuccessyesdavinci-stage-04-6.2.500:11:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median54.49999999999904
driven_lanedir_consec_median0.26709798212212443


other stats
deviation-center-line_max1.037569790997506
deviation-center-line_mean0.8435604085256779
deviation-center-line_median0.8435604085256779
deviation-center-line_min0.64955102605385
deviation-heading_max4.206744090268851
deviation-heading_mean4.053028283662815
deviation-heading_median4.053028283662815
deviation-heading_min3.899312477056781
distance-from-start_max1.4108418329398793
distance-from-start_mean1.2742348024332677
distance-from-start_median1.2742348024332677
distance-from-start_min1.1376277719266563
driven_any_max15.326310847370594
driven_any_mean13.855133975004188
driven_any_median13.855133975004188
driven_any_min12.38395710263778
driven_lanedir_consec_max0.46522399883077714
driven_lanedir_consec_mean0.26709798212212443
driven_lanedir_consec_min0.06897196541347173
driven_lanedir_max0.4443159195617077
driven_lanedir_mean0.24618990285305495
driven_lanedir_median0.24618990285305495
driven_lanedir_min0.04806388614440227
in-drivable-lane_max53.699999999998695
in-drivable-lane_mean46.67499999999907
in-drivable-lane_median46.67499999999907
in-drivable-lane_min39.64999999999946
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 15.326310847370594, "survival_time": 59.99999999999873, "driven_lanedir": 0.4443159195617077, "in-drivable-lane": 53.699999999998695, "deviation-heading": 3.899312477056781, "distance-from-start": 1.4108418329398793, "deviation-center-line": 0.64955102605385, "driven_lanedir_consec": 0.46522399883077714}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 12.38395710263778, "survival_time": 48.99999999999935, "driven_lanedir": 0.04806388614440227, "in-drivable-lane": 39.64999999999946, "deviation-heading": 4.206744090268851, "distance-from-start": 1.1376277719266563, "deviation-center-line": 1.037569790997506, "driven_lanedir_consec": 0.06897196541347173}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean54.49999999999904
survival_time_min48.99999999999935
No reset possible
140131203Bea Baselines 🐤template-tensorflowlx22-modconsimfailedyesdavinci-stage-04-6.2.500:02:20
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14011526Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-testingsim-3of4timeoutnodavinci-stage-04-6.2.50----No reset possible
13985783Andrea Danieletemplate-randomaido-LF-sim-validationsim-2of4host-errornodavinci-stage-04-6.2.501:05:45
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-stage-04-6.2.50-job13985-777807, down, -v]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-stage-04-6.2.50-job13985-777807', 'down', '-v']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13984789Andrea Danieletemplate-pytorchaido-LF-sim-validationsim-0of4host-errornodavinci-stage-04-6.2.500:01:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1097, in run_single
    client = DockerClient.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13972785Andrea Danieletemplate-rosaido-LF-sim-validationsim-0of4host-errornodavinci-stage-04-6.2.501:14:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 60, in check_docker_environment
    client = docker.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1107, in run_single
    cr = run_one(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1197, in run_one
    client = check_docker_environment()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 69, in check_docker_environment
    raise InvalidEnvironment(msg)
duckietown_challenges.exceptions.InvalidEnvironment: I cannot communicate with Docker:
Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Make sure the docker service is running.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13971789Andrea Danieletemplate-pytorchaido-LF-sim-validationsim-2of4host-errornodavinci-stage-04-6.2.500:01:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1097, in run_single
    client = DockerClient.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13960783Andrea Danieletemplate-randomaido-LF-sim-validationsim-0of4host-errornodavinci-stage-04-6.2.501:14:06
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 60, in check_docker_environment
    client = docker.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1107, in run_single
    cr = run_one(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1197, in run_one
    client = check_docker_environment()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 69, in check_docker_environment
    raise InvalidEnvironment(msg)
duckietown_challenges.exceptions.InvalidEnvironment: I cannot communicate with Docker:
Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Make sure the docker service is running.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13953699Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-0of4host-errornodavinci-stage-04-6.2.502:37:55
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 60, in check_docker_environment
    client = docker.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1118, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 125, in write_logs
    client = check_docker_environment()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 69, in check_docker_environment
    raise InvalidEnvironment(msg)
duckietown_challenges.exceptions.InvalidEnvironment: I cannot communicate with Docker:
Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Make sure the docker service is running.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13947699Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-1of4host-errornodavinci-stage-04-6.2.500:01:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1097, in run_single
    client = DockerClient.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13944698Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-0of4host-errornodavinci-stage-04-6.2.500:01:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1097, in run_single
    client = DockerClient.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13939699Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-3of4host-errornodavinci-stage-04-6.2.500:01:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1097, in run_single
    client = DockerClient.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13934700Bea Baselines 🐤minimal-agentaido-LFI-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13930701Bea Baselines 🐤minimal-agentaido-LF-sim-testingsim-1of4successnodavinci-stage-04-6.2.500:01:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1366657585905522
survival_time_median7.549999999999981
deviation-center-line_median0.10783809919009872
in-drivable-lane_median6.149999999999981


other stats
deviation-center-line_max0.10783809919009872
deviation-center-line_mean0.10783809919009872
deviation-center-line_min0.10783809919009872
deviation-heading_max0.9508048428349384
deviation-heading_mean0.9508048428349384
deviation-heading_median0.9508048428349384
deviation-heading_min0.9508048428349384
distance-from-start_max1.076322287151137
distance-from-start_mean1.076322287151137
distance-from-start_median1.076322287151137
distance-from-start_min1.076322287151137
driven_any_max1.0763767010128955
driven_any_mean1.0763767010128955
driven_any_median1.0763767010128955
driven_any_min1.0763767010128955
driven_lanedir_consec_max0.1366657585905522
driven_lanedir_consec_mean0.1366657585905522
driven_lanedir_consec_min0.1366657585905522
driven_lanedir_max0.1366657585905522
driven_lanedir_mean0.1366657585905522
driven_lanedir_median0.1366657585905522
driven_lanedir_min0.1366657585905522
in-drivable-lane_max6.149999999999981
in-drivable-lane_mean6.149999999999981
in-drivable-lane_min6.149999999999981
per-episodes
details{"loop-000-ego0": {"driven_any": 1.0763767010128955, "survival_time": 7.549999999999981, "driven_lanedir": 0.1366657585905522, "in-drivable-lane": 6.149999999999981, "deviation-heading": 0.9508048428349384, "distance-from-start": 1.076322287151137, "deviation-center-line": 0.10783809919009872, "driven_lanedir_consec": 0.1366657585905522}}
simulation-passed1
survival_time_max7.549999999999981
survival_time_mean7.549999999999981
survival_time_min7.549999999999981
No reset possible
13929702Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:01:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13921397Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-testingsim-1of4successnodavinci-stage-04-6.2.500:06:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-2.9761296417091208
survival_time_median59.99999999999873
deviation-center-line_median2.5015987837630935
in-drivable-lane_median25.499999999999375


other stats
deviation-center-line_max2.5015987837630935
deviation-center-line_mean2.5015987837630935
deviation-center-line_min2.5015987837630935
deviation-heading_max26.381933059263588
deviation-heading_mean26.381933059263588
deviation-heading_median26.381933059263588
deviation-heading_min26.381933059263588
distance-from-start_max0.1550589525010605
distance-from-start_mean0.1550589525010605
distance-from-start_median0.1550589525010605
distance-from-start_min0.1550589525010605
driven_any_max10.71479370565674
driven_any_mean10.71479370565674
driven_any_median10.71479370565674
driven_any_min10.71479370565674
driven_lanedir_consec_max-2.9761296417091208
driven_lanedir_consec_mean-2.9761296417091208
driven_lanedir_consec_min-2.9761296417091208
driven_lanedir_max-2.9761296417091208
driven_lanedir_mean-2.9761296417091208
driven_lanedir_median-2.9761296417091208
driven_lanedir_min-2.9761296417091208
in-drivable-lane_max25.499999999999375
in-drivable-lane_mean25.499999999999375
in-drivable-lane_min25.499999999999375
per-episodes
details{"loop-000-ego0": {"driven_any": 10.71479370565674, "survival_time": 59.99999999999873, "driven_lanedir": -2.9761296417091208, "in-drivable-lane": 25.499999999999375, "deviation-heading": 26.381933059263588, "distance-from-start": 0.1550589525010605, "deviation-center-line": 2.5015987837630935, "driven_lanedir_consec": -2.9761296417091208}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
13917526Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-testingsim-3of4failednodavinci-stage-04-6.2.500:00:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13915672Bea Baselines 🐤template-tensorflowaido-LF-sim-testingsim-0of4failednodavinci-stage-04-6.2.500:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13912715Bea Baselines 🐤template-randomaido-LF-sim-testingsim-0of4successnodavinci-stage-04-6.2.500:02:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.029483020207996535
survival_time_median11.450000000000028
deviation-center-line_median0.32684152243677644
in-drivable-lane_median8.000000000000016


other stats
deviation-center-line_max0.32684152243677644
deviation-center-line_mean0.32684152243677644
deviation-center-line_min0.32684152243677644
deviation-heading_max2.5488727326530465
deviation-heading_mean2.5488727326530465
deviation-heading_median2.5488727326530465
deviation-heading_min2.5488727326530465
distance-from-start_max0.5461575079396548
distance-from-start_mean0.5461575079396548
distance-from-start_median0.5461575079396548
distance-from-start_min0.5461575079396548
driven_any_max2.3519174817467863
driven_any_mean2.3519174817467863
driven_any_median2.3519174817467863
driven_any_min2.3519174817467863
driven_lanedir_consec_max0.029483020207996535
driven_lanedir_consec_mean0.029483020207996535
driven_lanedir_consec_min0.029483020207996535
driven_lanedir_max0.03283067360874581
driven_lanedir_mean0.03283067360874581
driven_lanedir_median0.03283067360874581
driven_lanedir_min0.03283067360874581
in-drivable-lane_max8.000000000000016
in-drivable-lane_mean8.000000000000016
in-drivable-lane_min8.000000000000016
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.3519174817467863, "survival_time": 11.450000000000028, "driven_lanedir": 0.03283067360874581, "in-drivable-lane": 8.000000000000016, "deviation-heading": 2.5488727326530465, "distance-from-start": 0.5461575079396548, "deviation-center-line": 0.32684152243677644, "driven_lanedir_consec": 0.029483020207996535}}
simulation-passed1
survival_time_max11.450000000000028
survival_time_mean11.450000000000028
survival_time_min11.450000000000028
No reset possible
13906783Andrea Danieletemplate-randomaido-LF-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:05:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2701303550718044
survival_time_median49.74999999999931
deviation-center-line_median0.8041846674982114
in-drivable-lane_median40.59999999999928


other stats
deviation-center-line_max0.8041846674982114
deviation-center-line_mean0.8041846674982114
deviation-center-line_min0.8041846674982114
deviation-heading_max6.675380463416964
deviation-heading_mean6.675380463416964
deviation-heading_median6.675380463416964
deviation-heading_min6.675380463416964
distance-from-start_max1.137627771926658
distance-from-start_mean1.137627771926658
distance-from-start_median1.137627771926658
distance-from-start_min1.137627771926658
driven_any_max12.45015338279087
driven_any_mean12.45015338279087
driven_any_median12.45015338279087
driven_any_min12.45015338279087
driven_lanedir_consec_max0.2701303550718044
driven_lanedir_consec_mean0.2701303550718044
driven_lanedir_consec_min0.2701303550718044
driven_lanedir_max0.2521152682910448
driven_lanedir_mean0.2521152682910448
driven_lanedir_median0.2521152682910448
driven_lanedir_min0.2521152682910448
in-drivable-lane_max40.59999999999928
in-drivable-lane_mean40.59999999999928
in-drivable-lane_min40.59999999999928
per-episodes
details{"loop-000-ego0": {"driven_any": 12.45015338279087, "survival_time": 49.74999999999931, "driven_lanedir": 0.2521152682910448, "in-drivable-lane": 40.59999999999928, "deviation-heading": 6.675380463416964, "distance-from-start": 1.137627771926658, "deviation-center-line": 0.8041846674982114, "driven_lanedir_consec": 0.2701303550718044}}
simulation-passed1
survival_time_max49.74999999999931
survival_time_mean49.74999999999931
survival_time_min49.74999999999931
No reset possible
13900789Andrea Danieletemplate-pytorchaido-LF-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:05:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.7992153903235668
survival_time_median37.84999999999999
deviation-center-line_median1.2974822655885925
in-drivable-lane_median24.299999999999923


other stats
deviation-center-line_max1.2974822655885925
deviation-center-line_mean1.2974822655885925
deviation-center-line_min1.2974822655885925
deviation-heading_max8.977594619956538
deviation-heading_mean8.977594619956538
deviation-heading_median8.977594619956538
deviation-heading_min8.977594619956538
distance-from-start_max0.7730433274701594
distance-from-start_mean0.7730433274701594
distance-from-start_median0.7730433274701594
distance-from-start_min0.7730433274701594
driven_any_max7.369689507032121
driven_any_mean7.369689507032121
driven_any_median7.369689507032121
driven_any_min7.369689507032121
driven_lanedir_consec_max1.7992153903235668
driven_lanedir_consec_mean1.7992153903235668
driven_lanedir_consec_min1.7992153903235668
driven_lanedir_max1.7992153903235668
driven_lanedir_mean1.7992153903235668
driven_lanedir_median1.7992153903235668
driven_lanedir_min1.7992153903235668
in-drivable-lane_max24.299999999999923
in-drivable-lane_mean24.299999999999923
in-drivable-lane_min24.299999999999923
per-episodes
details{"loop-000-ego0": {"driven_any": 7.369689507032121, "survival_time": 37.84999999999999, "driven_lanedir": 1.7992153903235668, "in-drivable-lane": 24.299999999999923, "deviation-heading": 8.977594619956538, "distance-from-start": 0.7730433274701594, "deviation-center-line": 1.2974822655885925, "driven_lanedir_consec": 1.7992153903235668}}
simulation-passed1
survival_time_max37.84999999999999
survival_time_mean37.84999999999999
survival_time_min37.84999999999999
No reset possible
13895309Andrea Censiminimal-agentaido-LFV-sim-validationsim-2of4errornodavinci-stage-04-6.2.500:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13890310Andrea Censiminimal-agentaido-LFV-sim-validationsim-2of4errornodavinci-stage-04-6.2.500:01:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13884311Andrea Censiminimal-agentaido-LFV-sim-validationsim-3of4errornodavinci-stage-04-6.2.500:01:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13882312Liam Paulltemplate-rosaido-LF-sim-validationsim-0of4errornodavinci-stage-04-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13880312Liam Paulltemplate-rosaido-LF-sim-validationsim-2of4errornodavinci-stage-04-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13875356Liam Paulltemplate-rosaido-LF-sim-validationsim-1of4errornodavinci-stage-04-6.2.500:01:10
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13870385Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-validationsim-1of4errornodavinci-stage-04-6.2.500:01:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13863389Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-validationsim-1of4host-errornodavinci-stage-04-6.2.500:01:36
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13858389Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-validationsim-0of4errornodavinci-stage-04-6.2.500:02:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13853388Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13850390Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-validationsim-2of4errornodavinci-stage-04-6.2.500:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13843391Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-validationsim-0of4errornodavinci-stage-04-6.2.500:01:23
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13838392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-2of4errornodavinci-stage-04-6.2.500:01:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13832394Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-testingsim-3of4errornodavinci-stage-04-6.2.500:01:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13827395Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13823396Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-testingsim-0of4host-errornodavinci-stage-04-6.2.500:01:34
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13818398Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13811514Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-validationsim-1of4failednodavinci-stage-04-6.2.500:01:15
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13807516Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-validationsim-0of4failednodavinci-stage-04-6.2.500:01:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13801517Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-validationsim-0of4failednodavinci-stage-04-6.2.500:01:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13795518Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13790520Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13786521Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-testingsim-3of4failednodavinci-stage-04-6.2.500:01:15
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13779523Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-testingsim-1of4failednodavinci-stage-04-6.2.500:01:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13774524Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-testingsim-0of4failednodavinci-stage-04-6.2.500:01:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13769525Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13764527Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-testingsim-1of4failednodavinci-stage-04-6.2.500:01:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13762529Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-validationsim-2of4errornodavinci-stage-04-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13757529Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-validationsim-3of4errornodavinci-stage-04-6.2.500:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13750530Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-validationsim-3of4errornodavinci-stage-04-6.2.500:01:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13746531Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-validationsim-1of4errornodavinci-stage-04-6.2.500:01:35
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13740534Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-validationsim-1of4errornodavinci-stage-04-6.2.500:01:13
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13734535Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-testingsim-1of4errornodavinci-stage-04-6.2.500:01:14
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13732536Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-testingsim-1of4errornodavinci-stage-04-6.2.500:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13727536Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-testingsim-0of4errornodavinci-stage-04-6.2.500:00:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13723538Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-testingsim-1of4errornodavinci-stage-04-6.2.500:01:35
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13717539Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13712542Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13707595Liam Paullbaseline-duckietownaido-LF-sim-validationsim-0of4failednodavinci-stage-04-6.2.500:00:56
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13701599Liam Paulltemplate-randomaido-hello-sim-validationsanity-checkerrornodavinci-stage-04-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13697603Bea Baselines 🐤template-rosaido-LFV_multi-sim-validationsim-2of4errornodavinci-stage-04-6.2.500:01:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13689605Bea Baselines 🐤template-rosaido-LFV-sim-validationsim-2of4errornodavinci-stage-04-6.2.500:01:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13685606Bea Baselines 🐤template-rosaido-LFVI-sim-validationsim-0of4errornodavinci-stage-04-6.2.500:01:38
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13678607Bea Baselines 🐤template-rosaido-LFI-sim-validationsim-0of4errornodavinci-stage-04-6.2.500:01:30
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13675609Bea Baselines 🐤template-rosaido-LFVI_multi-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13671611Bea Baselines 🐤template-rosaido-LFP-sim-testingsim-3of4errornodavinci-stage-04-6.2.500:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13666611Bea Baselines 🐤template-rosaido-LFP-sim-testingsim-1of4errornodavinci-stage-04-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13661613Bea Baselines 🐤template-rosaido-LFVI-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13656614Bea Baselines 🐤template-rosaido-LFI-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13651615Bea Baselines 🐤template-rosaido-LF-sim-testingsim-3of4errornodavinci-stage-04-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13645618Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-validationsim-3of4errornodavinci-stage-04-6.2.500:01:23
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13640619Bea Baselines 🐤baseline-duckietownaido-LFP-sim-validationsim-3of4errornodavinci-stage-04-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13634620Bea Baselines 🐤baseline-duckietownaido-LFV-sim-validationsim-2of4errornodavinci-stage-04-6.2.500:01:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13629621Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13625624Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-validationsim-1of4errornodavinci-stage-04-6.2.500:01:22
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13620625Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-testingsim-3of4errornodavinci-stage-04-6.2.500:01:20
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13614626Bea Baselines 🐤baseline-duckietownaido-LFP-sim-testingsim-2of4errornodavinci-stage-04-6.2.500:01:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13609627Bea Baselines 🐤baseline-duckietownaido-LFV-sim-testingsim-3of4errornodavinci-stage-04-6.2.500:01:31
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13605629Bea Baselines 🐤baseline-duckietownaido-LFI-sim-testingsim-1of4errornodavinci-stage-04-6.2.500:01:34
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13599630Bea Baselines 🐤baseline-duckietownaido-LF-sim-testingsim-0of4errornodavinci-stage-04-6.2.500:01:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13594631Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-testingsim-1of4errornodavinci-stage-04-6.2.500:01:19
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13586664Bea Baselines 🐤template-tensorflowaido-LFI-sim-validationsim-1of4failednodavinci-stage-04-6.2.500:02:26
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13582663Bea Baselines 🐤template-tensorflowaido-LFVI-sim-validationsim-0of4failednodavinci-stage-04-6.2.500:01:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13575664Bea Baselines 🐤template-tensorflowaido-LFI-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13573665Bea Baselines 🐤template-tensorflowaido-LF-sim-validationsim-0of4failednodavinci-stage-04-6.2.500:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13567667Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-testingsim-1of4failednodavinci-stage-04-6.2.500:01:15
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13563668Bea Baselines 🐤template-tensorflowaido-LFP-sim-testingsim-3of4failednodavinci-stage-04-6.2.500:00:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13557669Bea Baselines 🐤template-tensorflowaido-LFV-sim-testingsim-0of4failednodavinci-stage-04-6.2.500:01:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13552670Bea Baselines 🐤template-tensorflowaido-LFVI-sim-testingsim-0of4failednodavinci-stage-04-6.2.500:01:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13547671Bea Baselines 🐤template-tensorflowaido-LFI-sim-testingsim-1of4host-errornodavinci-stage-04-6.2.500:01:33
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13542703Bea Baselines 🐤template-randomaido-LFV_multi-sim-validationsim-2of4errornodavinci-stage-04-6.2.500:01:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13537704Bea Baselines 🐤template-randomaido-LFP-sim-validationsim-1of4errornodavinci-stage-04-6.2.500:00:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13532706Bea Baselines 🐤template-randomaido-LFVI-sim-validationsim-1of4errornodavinci-stage-04-6.2.500:01:35
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13527707Bea Baselines 🐤template-randomaido-LFI-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13521709Bea Baselines 🐤template-randomaido-LFVI_multi-sim-validationsim-0of4errornodavinci-stage-04-6.2.500:01:18
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13514710Bea Baselines 🐤template-randomaido-LFV_multi-sim-testingsim-1of4errornodavinci-stage-04-6.2.500:01:14
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13509712Bea Baselines 🐤template-randomaido-LFV-sim-testingsim-1of4errornodavinci-stage-04-6.2.500:01:36
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13503713Bea Baselines 🐤template-randomaido-LFVI-sim-testingsim-1of4errornodavinci-stage-04-6.2.500:01:36
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13500716Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-0of4errornodavinci-stage-04-6.2.500:01:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13495732Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-validationsim-2of4errornodavinci-stage-04-6.2.500:01:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13490733Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-validationsim-3of4errornodavinci-stage-04-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13483735Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13480736Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13475737Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-validationsim-1of4errornodavinci-stage-04-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13470738Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13466740Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-testingsim-3of4errornodavinci-stage-04-6.2.500:01:02
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13461741Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-testingsim-0of4errornodavinci-stage-04-6.2.500:01:30
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13455742Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13447743Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13445746Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-testingsim-0of4errornodavinci-stage-04-6.2.500:01:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13440766Bea Baselines 🐤challenge-aido_LF-template-tensorflow:daffy-staging:38486fc8c2bf41d1f9b206035ae484c5873c8a4baido-hello-sim-validationsanity-checkfailednodavinci-stage-04-6.2.500:00:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13434769Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-validationsim-0of4errornodavinci-stage-04-6.2.500:01:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13427771Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-validationsim-1of4errornodavinci-stage-04-6.2.500:01:44
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13422772Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-validationsim-0of4errornodavinci-stage-04-6.2.500:01:44
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13417773Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13412775Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13407777Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-testingsim-2of4errornodavinci-stage-04-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13403777Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-testingsim-1of4errornodavinci-stage-04-6.2.500:01:02
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13398779Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-testingsim-0of4errornodavinci-stage-04-6.2.500:01:44
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13393780Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13388781Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-testingsim-2of4errornodavinci-stage-04-6.2.500:01:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13383791Bea Baselines 🐤challenge-aido_LF-baseline-RPL-ros:daffy-staging:61ce4781fdb88fb08748da51bde492a74499e71daido-hello-sim-validationsanity-checkerrornodavinci-stage-04-6.2.500:01:02
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13380800Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-2of4failednodavinci-stage-04-6.2.500:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13375801Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-0of4failednodavinci-stage-04-6.2.500:00:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13369806user1000001minimal-agentaido-LFV-sim-validationsim-2of4errornodavinci-stage-04-6.2.500:01:38
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13364808Andrea Censitemplate-randomaido-LFV-sim-validationsim-0of4errornodavinci-stage-04-6.2.500:01:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13357809Andrea Censitemplate-randomaido-LFV-sim-validationsim-2of4errornodavinci-stage-04-6.2.500:01:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13352811Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-3of4errornodavinci-stage-04-6.2.500:01:35
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13346812Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-3of4errornodavinci-stage-04-6.2.500:01:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13342813Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-validationsim-2of4errornodavinci-stage-04-6.2.500:01:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13337814Bea Baselines 🐤baseline-duckietownaido-LF-sim-validationsim-0of4errornodavinci-stage-04-6.2.500:01:05
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13332815Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-validationsim-1of4errornodavinci-stage-04-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13327817Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-validationsim-2of4errornodavinci-stage-04-6.2.500:01:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13322818Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-validationsim-1of4errornodavinci-stage-04-6.2.500:01:44
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13317819Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-validation448errornodavinci-stage-04-6.2.500:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13312820Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-validationsim-0of4errornodavinci-stage-04-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13308821Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-testingsim-1of4errornodavinci-stage-04-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13303823Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-testingsim-0of4errornodavinci-stage-04-6.2.500:01:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13298824Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-testingsim-0of4errornodavinci-stage-04-6.2.500:01:45
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13293825Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-testingsim-1of4errornodavinci-stage-04-6.2.500:01:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13288826Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-validationsim-2of4errornodavinci-stage-04-6.2.500:01:47
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13283828Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-testingsim-2of4errornodavinci-stage-04-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13278829Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-validationsim-0of4errornodavinci-stage-04-6.2.500:01:40
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13273830Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-validationsim-1of4errornodavinci-stage-04-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13268831Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-validationsim-1of4errornodavinci-stage-04-6.2.500:01:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13264833Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-validationsim-0of4errornodavinci-stage-04-6.2.500:01:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13259834Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-validationsim-0of4errornodavinci-stage-04-6.2.500:01:23
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13253835Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-validationsim-1of4errornodavinci-stage-04-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13250836Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13242838Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-testingsim-0of4errornodavinci-stage-04-6.2.500:01:31
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13241840Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-testingsim-2of4errornodavinci-stage-04-6.2.500:01:34
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13235839Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-testingsim-3of4host-errornodavinci-stage-04-6.2.500:00:18
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon' 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13233840Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-testingsim-0of4errornodavinci-stage-04-6.2.500:01:34
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13226841Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:01:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13217844Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-validationsim-1of4errornodavinci-stage-04-6.2.500:02:14
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13211846Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-validationsim-2of4errornodavinci-stage-04-6.2.500:01:40
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13207847Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-validation446errornodavinci-stage-04-6.2.500:01:30
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13201848Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-validationsim-0of4errornodavinci-stage-04-6.2.500:01:03
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13199849Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-testingsim-1of4errornodavinci-stage-04-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13193852Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-testingsim-1of4errornodavinci-stage-04-6.2.500:01:44
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13188854Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-3of4errornodavinci-stage-04-6.2.500:01:30
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13184855Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-testingsim-2of4errornodavinci-stage-04-6.2.500:01:40
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13178856Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-testingsim-3of4errornodavinci-stage-04-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13173857Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-0of4errornodavinci-stage-04-6.2.500:01:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13170859Bea Baselines 🐤baseline-duckietownaido-LF-sim-validationsim-3of4errornodavinci-stage-04-6.2.500:01:03
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13163860Bea Baselines 🐤template-pytorchaido-LFV-sim-validationsim-1of4errornodavinci-stage-04-6.2.500:01:40
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13158861Bea Baselines 🐤template-pytorchaido-LFVI-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13154862Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-0of4errornodavinci-stage-04-6.2.500:01:45
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13149863Bea Baselines 🐤template-pytorchaido-LF-sim-validationsim-0of4errornodavinci-stage-04-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13145865Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-validationsim-3of4errornodavinci-stage-04-6.2.500:01:33
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13140866Bea Baselines 🐤template-pytorchaido-LFP-sim-validationsim-2of4errornodavinci-stage-04-6.2.500:01:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13136872Bea Baselines 🐤template-pytorchaido-LFV-sim-testingsim-1of4errornodavinci-stage-04-6.2.500:01:45
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13131873Bea Baselines 🐤template-pytorchaido-LFVI-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13126874Bea Baselines 🐤template-pytorchaido-LFI-sim-testingsim-1of4errornodavinci-stage-04-6.2.500:01:33
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13122875Bea Baselines 🐤template-pytorchaido-LF-sim-testingsim-3of4errornodavinci-stage-04-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13117877Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-testingsim-3of4errornodavinci-stage-04-6.2.500:01:36
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13112878Bea Baselines 🐤template-pytorchaido-LFP-sim-testingsim-2of4errornodavinci-stage-04-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13109880Bea Baselines 🐤template-rosaido-LF-sim-validationsim-1of4errornodavinci-stage-04-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13103881Bea Baselines 🐤template-tensorflowaido-LFV-sim-validationsim-0of4failednodavinci-stage-04-6.2.500:01:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13097882Bea Baselines 🐤template-randomaido-LFV-sim-validationsim-2of4errornodavinci-stage-04-6.2.500:01:36
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13091883Bea Baselines 🐤template-tensorflowaido-LFV-sim-validationsim-0of4failednodavinci-stage-04-6.2.500:01:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13086689Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-validationsim-0of4errornodavinci-stage-04-6.2.500:01:14
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13081690Bea Baselines 🐤minimal-agentaido-LFP-sim-validationsim-2of4errornodavinci-stage-04-6.2.500:00:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13076692Bea Baselines 🐤minimal-agentaido-LFVI-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13072694Bea Baselines 🐤minimal-agentaido-LF-sim-validationsim-2of4errornodavinci-stage-04-6.2.500:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13066695Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
13064697Bea Baselines 🐤minimal-agentaido-LFP-sim-testingsim-3of4errornodavinci-stage-04-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13059697Bea Baselines 🐤minimal-agentaido-LFP-sim-testingsim-1of4errornodavinci-stage-04-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13053698Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-3of4errornodavinci-stage-04-6.2.500:01:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13049700Bea Baselines 🐤minimal-agentaido-LFI-sim-testingsim-1of4errornodavinci-stage-04-6.2.500:01:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13041702Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-testingsim-1of4errornodavinci-stage-04-6.2.500:01:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13037526Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-testingsim-1of4failednodavinci-stage-04-6.2.500:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13031672Bea Baselines 🐤template-tensorflowaido-LF-sim-testingsim-2of4failednodavinci-stage-04-6.2.500:00:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13025715Bea Baselines 🐤template-randomaido-LF-sim-testingsim-0of4errornodavinci-stage-04-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13020783Andrea Danieletemplate-randomaido-LF-sim-validationsim-0of4errornodavinci-stage-04-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13016789Andrea Danieletemplate-pytorchaido-LF-sim-validationsim-1of4errornodavinci-stage-04-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13011843Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-validationsim-0of4abortednodavinci-stage-04-6.2.500:00:49
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1302, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 749, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13006844Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-validationsim-1of4errornodavinci-stage-04-6.2.500:01:32
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13001846Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-validationsim-3of4errornodavinci-stage-04-6.2.500:01:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12998847Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-validation445erroryesdavinci-stage-04-6.2.500:01:21
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12991849Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-testingsim-0of4errornodavinci-stage-04-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12987850Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-testingsim-1of4errornodavinci-stage-04-6.2.500:01:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12982851Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-testingsim-2of4errornodavinci-stage-04-6.2.500:01:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12977852Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-testingsim-1of4errornodavinci-stage-04-6.2.500:01:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12970854Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-1of4errornodavinci-stage-04-6.2.500:01:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12964855Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-testingsim-1of4errornodavinci-stage-04-6.2.500:01:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12959857Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-2of4errornodavinci-stage-04-6.2.500:01:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12954858Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-2of4errornodavinci-stage-04-6.2.500:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12948860Bea Baselines 🐤template-pytorchaido-LFV-sim-validationsim-1of4errornodavinci-stage-04-6.2.500:01:43
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12943862Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-0of4errornodavinci-stage-04-6.2.500:01:43
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12937862Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12930864Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12928695Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-validationsim-0of4errornodavinci-stage-04-6.2.500:01:13
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12923702Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-testingsim-0of4errornodavinci-stage-04-6.2.500:01:17
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12918695Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:01:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12914700Bea Baselines 🐤minimal-agentaido-LFI-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12909693Bea Baselines 🐤minimal-agentaido-LFI-sim-validationsim-0of4errornodavinci-stage-04-6.2.500:01:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12904862Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-2of4abortednodavinci-stage-04-6.2.500:01:03
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1302, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 749, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12899864Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-0of4errornodavinci-stage-04-6.2.500:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12892864Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-1of4errornodavinci-stage-04-6.2.500:01:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12888696Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-testingsim-2of4errornodavinci-stage-04-6.2.500:01:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12884872Bea Baselines 🐤template-pytorchaido-LFV-sim-testingsim-3of4errornodavinci-stage-04-6.2.500:01:30
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12877878Bea Baselines 🐤template-pytorchaido-LFP-sim-testingsim-1of4errornodavinci-stage-04-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12871880Bea Baselines 🐤template-rosaido-LF-sim-validationsim-3of4errornodavinci-stage-04-6.2.500:01:02
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12866694Bea Baselines 🐤minimal-agentaido-LF-sim-validationsim-2of4errornodavinci-stage-04-6.2.500:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12863526Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-testingsim-3of4failednodavinci-stage-04-6.2.500:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12859715Bea Baselines 🐤template-randomaido-LF-sim-testingsim-0of4errornodavinci-stage-04-6.2.500:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12853785Andrea Danieletemplate-rosaido-LF-sim-validationsim-2of4errornodavinci-stage-04-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12848872Bea Baselines 🐤template-pytorchaido-LFV-sim-testingsim-0of4errornodavinci-stage-04-6.2.500:01:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12843873Bea Baselines 🐤template-pytorchaido-LFVI-sim-testingsim-0of4errornodavinci-stage-04-6.2.500:01:43
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12840875Bea Baselines 🐤template-pytorchaido-LF-sim-testingsim-0of4errornodavinci-stage-04-6.2.500:01:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12836875Bea Baselines 🐤template-pytorchaido-LF-sim-testingsim-3of4errornodavinci-stage-04-6.2.500:01:02
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12831877Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-testingsim-3of4errornodavinci-stage-04-6.2.500:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12826878Bea Baselines 🐤template-pytorchaido-LFP-sim-testingsim-0of4errornodavinci-stage-04-6.2.500:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12819879Bea Baselines 🐤template-randomaido-LFV-sim-validationsim-1of4errornodavinci-stage-04-6.2.500:01:50
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12814881Bea Baselines 🐤template-tensorflowaido-LFV-sim-validationsim-2of4failednodavinci-stage-04-6.2.500:02:39
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12809882Bea Baselines 🐤template-randomaido-LFV-sim-validationsim-0of4errornodavinci-stage-04-6.2.500:01:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12804883Bea Baselines 🐤template-tensorflowaido-LFV-sim-validationsim-0of4failednodavinci-stage-04-6.2.500:01:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12794688Bea Baselines 🐤baseline-simple-yieldaido-hello-sim-state-validationsanity-checkerrornodavinci-stage-04-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12789689Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-validationsim-1of4errornodavinci-stage-04-6.2.500:01:16
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12783692Bea Baselines 🐤minimal-agentaido-LFVI-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12776693Bea Baselines 🐤minimal-agentaido-LFI-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12771694Bea Baselines 🐤minimal-agentaido-LF-sim-validationsim-0of4errornodavinci-stage-04-6.2.500:00:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12766695Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-validationsim-0of4errornodavinci-stage-04-6.2.500:01:16
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12762697Bea Baselines 🐤minimal-agentaido-LFP-sim-testingsim-2of4errornodavinci-stage-04-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12756698Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-2of4errornodavinci-stage-04-6.2.500:01:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12751699Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-0of4errornodavinci-stage-04-6.2.500:01:36
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12746397Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-testingsim-3of4errornodavinci-stage-04-6.2.500:00:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12741526Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-testingsim-3of4failednodavinci-stage-04-6.2.500:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12736672Bea Baselines 🐤template-tensorflowaido-LF-sim-testingsim-2of4failednodavinci-stage-04-6.2.500:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12731783Andrea Danieletemplate-randomaido-LF-sim-validationsim-0of4errornodavinci-stage-04-6.2.500:00:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12726785Andrea Danieletemplate-rosaido-LF-sim-validationsim-1of4errornodavinci-stage-04-6.2.500:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12722789Andrea Danieletemplate-pytorchaido-LF-sim-validationsim-0of4errornodavinci-stage-04-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12719715Bea Baselines 🐤template-randomaido-LF-sim-testingsim-1of4errornodavinci-stage-04-6.2.500:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12714698Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-3of4errornodavinci-stage-04-6.2.500:01:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12709700Bea Baselines 🐤minimal-agentaido-LFI-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12704701Bea Baselines 🐤minimal-agentaido-LF-sim-testingsim-1of4errornodavinci-stage-04-6.2.500:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12696702Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-testingsim-1of4errornodavinci-stage-04-6.2.500:01:21
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12691783Andrea Danieletemplate-randomaido-LF-sim-validationsim-0of4errornodavinci-stage-04-6.2.500:00:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12686785Andrea Danieletemplate-rosaido-LF-sim-validationsim-3of4errornodavinci-stage-04-6.2.500:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12684789Andrea Danieletemplate-pytorchaido-LF-sim-validationsim-2of4errornodavinci-stage-04-6.2.500:00:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12679526Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-testingsim-3of4failednodavinci-stage-04-6.2.500:00:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12673715Bea Baselines 🐤template-randomaido-LF-sim-testingsim-1of4errornodavinci-stage-04-6.2.500:00:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12669731Bea Baselines 🐤minimal-agent-stateaido-hello-sim-state-validationsanity-checkerrornodavinci-stage-04-6.2.500:01:47
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12614919Bea Baselines 🐤baseline-solutionlx22-planning-cc-dynamic-teststep1-0of4errornodavinci-stage-04-6.2.500:17:16
Waited 1006 seconds [...]
Waited 1006 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12613910Bea Baselines 🐤baseline-solutionlx22-planning-dd-dynamic-valistep1-2of4successnodavinci-stage-04-6.2.500:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
12612910Bea Baselines 🐤baseline-solutionlx22-planning-dd-dynamic-valistep1-1of4successnodavinci-stage-04-6.2.500:00:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
12610911Bea Baselines 🐤baseline-solutionlx22-planning-dd-static-valistep1-2of4successnodavinci-stage-04-6.2.500:00:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
12608911Bea Baselines 🐤baseline-solutionlx22-planning-dd-static-valistep1-3of4successnodavinci-stage-04-6.2.500:00:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
12596914Bea Baselines 🐤baseline-solutionlx22-planning-cc-static-valistep1-0of4successnodavinci-stage-04-6.2.500:12:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration51.85669812417199
complexity120.66666666666669
avg_min_distance0.21382628904148104


other stats
nfeasible3
nsamples3
No reset possible
12593916Bea Baselines 🐤baseline-solutionlx22-planning-dd-dynamic-teststep1-3of4successnodavinci-stage-04-6.2.500:00:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
12583920Bea Baselines 🐤baseline-solutionlx22-planning-cc-static-teststep1-0of4successnodavinci-stage-04-6.2.500:12:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration41.981813632891274
complexity92.66666666666669
avg_min_distance0.20869066973913075


other stats
nfeasible3
nsamples3
No reset possible
12575922Bea Baselines 🐤baseline-solutionlx22-collision-check-valistep1successnodavinci-stage-04-6.2.500:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.0


other stats
nsamples200
No reset possible
12574909Bea Baselines 🐤baseline-solutionlx22-collision-check-valistep1successnodavinci-stage-04-6.2.500:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.0


other stats
nsamples200
No reset possible
12553310Andrea Censiminimal-agentaido-LFV-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:03:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.499999999999986
in-drivable-lane_median6.749999999999985
driven_lanedir_consec_median0.19955231542410212
deviation-center-line_median0.1256753337219296


other stats
deviation-center-line_max0.1256753337219296
deviation-center-line_mean0.1256753337219296
deviation-center-line_min0.1256753337219296
deviation-heading_max0.9488219555580464
deviation-heading_mean0.9488219555580464
deviation-heading_median0.9488219555580464
deviation-heading_min0.9488219555580464
distance-from-start_max1.233057068821899
distance-from-start_mean1.233057068821899
distance-from-start_median1.233057068821899
distance-from-start_min1.233057068821899
driven_any_max1.2331286149593297
driven_any_mean1.2331286149593297
driven_any_median1.2331286149593297
driven_any_min1.2331286149593297
driven_lanedir_consec_max0.19955231542410212
driven_lanedir_consec_mean0.19955231542410212
driven_lanedir_consec_min0.19955231542410212
driven_lanedir_max0.19955231542410212
driven_lanedir_mean0.19955231542410212
driven_lanedir_median0.19955231542410212
driven_lanedir_min0.19955231542410212
in-drivable-lane_max6.749999999999985
in-drivable-lane_mean6.749999999999985
in-drivable-lane_min6.749999999999985
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.2331286149593297, "survival_time": 8.499999999999986, "driven_lanedir": 0.19955231542410212, "in-drivable-lane": 6.749999999999985, "deviation-heading": 0.9488219555580464, "distance-from-start": 1.233057068821899, "deviation-center-line": 0.1256753337219296, "driven_lanedir_consec": 0.19955231542410212}}
simulation-passed1
survival_time_max8.499999999999986
survival_time_mean8.499999999999986
survival_time_min8.499999999999986
No reset possible
12549311Andrea Censiminimal-agentaido-LFV-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:03:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.1999999999999895
in-drivable-lane_median3.4499999999999886
driven_lanedir_consec_median0.19955005044754337
deviation-center-line_median0.12567516126913286


other stats
deviation-center-line_max0.12567516126913286
deviation-center-line_mean0.12567516126913286
deviation-center-line_min0.12567516126913286
deviation-heading_max0.9488219555580458
deviation-heading_mean0.9488219555580458
deviation-heading_median0.9488219555580458
deviation-heading_min0.9488219555580458
distance-from-start_max0.689742337316815
distance-from-start_mean0.689742337316815
distance-from-start_median0.689742337316815
distance-from-start_min0.689742337316815
driven_any_max0.6897540728183593
driven_any_mean0.6897540728183593
driven_any_median0.6897540728183593
driven_any_min0.6897540728183593
driven_lanedir_consec_max0.19955005044754337
driven_lanedir_consec_mean0.19955005044754337
driven_lanedir_consec_min0.19955005044754337
driven_lanedir_max0.19955005044754337
driven_lanedir_mean0.19955005044754337
driven_lanedir_median0.19955005044754337
driven_lanedir_min0.19955005044754337
in-drivable-lane_max3.4499999999999886
in-drivable-lane_mean3.4499999999999886
in-drivable-lane_min3.4499999999999886
per-episodes
details{"loop-000-ego0": {"driven_any": 0.6897540728183593, "survival_time": 5.1999999999999895, "driven_lanedir": 0.19955005044754337, "in-drivable-lane": 3.4499999999999886, "deviation-heading": 0.9488219555580458, "distance-from-start": 0.689742337316815, "deviation-center-line": 0.12567516126913286, "driven_lanedir_consec": 0.19955005044754337}}
simulation-passed1
survival_time_max5.1999999999999895
survival_time_mean5.1999999999999895
survival_time_min5.1999999999999895
No reset possible
12545312Liam Paulltemplate-rosaido-LF-sim-validationsim-0of4successnodavinci-stage-04-6.2.500:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.26192120349830805
survival_time_median5.599999999999988
deviation-center-line_median0.10787903465150708
in-drivable-lane_median4.249999999999988


other stats
deviation-center-line_max0.10787903465150708
deviation-center-line_mean0.10787903465150708
deviation-center-line_min0.10787903465150708
deviation-heading_max0.6151842171497539
deviation-heading_mean0.6151842171497539
deviation-heading_median0.6151842171497539
deviation-heading_min0.6151842171497539
distance-from-start_max1.3126351095758828
distance-from-start_mean1.3126351095758828
distance-from-start_median1.3126351095758828
distance-from-start_min1.3126351095758828
driven_any_max1.3715668318733245
driven_any_mean1.3715668318733245
driven_any_median1.3715668318733245
driven_any_min1.3715668318733245
driven_lanedir_consec_max0.26192120349830805
driven_lanedir_consec_mean0.26192120349830805
driven_lanedir_consec_min0.26192120349830805
driven_lanedir_max0.26192120349830805
driven_lanedir_mean0.26192120349830805
driven_lanedir_median0.26192120349830805
driven_lanedir_min0.26192120349830805
in-drivable-lane_max4.249999999999988
in-drivable-lane_mean4.249999999999988
in-drivable-lane_min4.249999999999988
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.3715668318733245, "survival_time": 5.599999999999988, "driven_lanedir": 0.26192120349830805, "in-drivable-lane": 4.249999999999988, "deviation-heading": 0.6151842171497539, "distance-from-start": 1.3126351095758828, "deviation-center-line": 0.10787903465150708, "driven_lanedir_consec": 0.26192120349830805}}
simulation-passed1
survival_time_max5.599999999999988
survival_time_mean5.599999999999988
survival_time_min5.599999999999988
No reset possible
12542312Liam Paulltemplate-rosaido-LF-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4418817061045215
survival_time_median7.299999999999982
deviation-center-line_median0.18320514259840148
in-drivable-lane_median5.049999999999985


other stats
deviation-center-line_max0.18320514259840148
deviation-center-line_mean0.18320514259840148
deviation-center-line_min0.18320514259840148
deviation-heading_max1.4154492506287584
deviation-heading_mean1.4154492506287584
deviation-heading_median1.4154492506287584
deviation-heading_min1.4154492506287584
distance-from-start_max1.7564915420370832
distance-from-start_mean1.7564915420370832
distance-from-start_median1.7564915420370832
distance-from-start_min1.7564915420370832
driven_any_max1.8065503017973588
driven_any_mean1.8065503017973588
driven_any_median1.8065503017973588
driven_any_min1.8065503017973588
driven_lanedir_consec_max0.4418817061045215
driven_lanedir_consec_mean0.4418817061045215
driven_lanedir_consec_min0.4418817061045215
driven_lanedir_max0.4418817061045215
driven_lanedir_mean0.4418817061045215
driven_lanedir_median0.4418817061045215
driven_lanedir_min0.4418817061045215
in-drivable-lane_max5.049999999999985
in-drivable-lane_mean5.049999999999985
in-drivable-lane_min5.049999999999985
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.8065503017973588, "survival_time": 7.299999999999982, "driven_lanedir": 0.4418817061045215, "in-drivable-lane": 5.049999999999985, "deviation-heading": 1.4154492506287584, "distance-from-start": 1.7564915420370832, "deviation-center-line": 0.18320514259840148, "driven_lanedir_consec": 0.4418817061045215}}
simulation-passed1
survival_time_max7.299999999999982
survival_time_mean7.299999999999982
survival_time_min7.299999999999982
No reset possible
12540341Liam Paulltemplate-rosaido-LF-sim-validationsim-2of4failednodavinci-stage-04-6.2.500:03:04
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 243, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12538341Liam Paulltemplate-rosaido-LF-sim-validationsim-0of4failednodavinci-stage-04-6.2.500:03:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 243, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12528385Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:12:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median23.949999999999346
driven_lanedir_consec_median-2.084662178616332
deviation-center-line_median3.542523739566056


other stats
deviation-center-line_max3.6875327417883494
deviation-center-line_mean3.542523739566056
deviation-center-line_min3.397514737343762
deviation-heading_max28.51415103259981
deviation-heading_mean27.91089516620631
deviation-heading_median27.91089516620631
deviation-heading_min27.307639299812813
distance-from-start_max0.22124624328620224
distance-from-start_mean0.201762241250494
distance-from-start_median0.201762241250494
distance-from-start_min0.1822782392147858
driven_any_max10.40858918523253
driven_any_mean10.071730743896632
driven_any_median10.071730743896632
driven_any_min9.734872302560731
driven_lanedir_consec_max-1.7268258637860343
driven_lanedir_consec_mean-2.084662178616332
driven_lanedir_consec_min-2.44249849344663
driven_lanedir_max-1.7268258637860343
driven_lanedir_mean-2.084662178616332
driven_lanedir_median-2.084662178616332
driven_lanedir_min-2.44249849344663
in-drivable-lane_max25.499999999999293
in-drivable-lane_mean23.949999999999346
in-drivable-lane_min22.399999999999388
per-episodes
details{"loop2-000-ego0": {"driven_any": 10.40858918523253, "survival_time": 59.99999999999873, "driven_lanedir": -2.44249849344663, "in-drivable-lane": 22.399999999999388, "deviation-heading": 28.51415103259981, "distance-from-start": 0.1822782392147858, "deviation-center-line": 3.6875327417883494, "driven_lanedir_consec": -2.44249849344663}, "loop2-000-ego1": {"driven_any": 9.734872302560731, "survival_time": 59.99999999999873, "driven_lanedir": -1.7268258637860343, "in-drivable-lane": 25.499999999999293, "deviation-heading": 27.307639299812813, "distance-from-start": 0.22124624328620224, "deviation-center-line": 3.397514737343762, "driven_lanedir_consec": -1.7268258637860343}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12523386Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:08:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median22.849999999999497
driven_lanedir_consec_median-3.223794810841998
deviation-center-line_median2.575159386888358


other stats
deviation-center-line_max2.575159386888358
deviation-center-line_mean2.575159386888358
deviation-center-line_min2.575159386888358
deviation-heading_max30.811681511287052
deviation-heading_mean30.811681511287052
deviation-heading_median30.811681511287052
deviation-heading_min30.811681511287052
distance-from-start_max0.17218621681295349
distance-from-start_mean0.17218621681295349
distance-from-start_median0.17218621681295349
distance-from-start_min0.17218621681295349
driven_any_max11.757209896770592
driven_any_mean11.757209896770592
driven_any_median11.757209896770592
driven_any_min11.757209896770592
driven_lanedir_consec_max-3.223794810841998
driven_lanedir_consec_mean-3.223794810841998
driven_lanedir_consec_min-3.223794810841998
driven_lanedir_max-3.525172483785638
driven_lanedir_mean-3.525172483785638
driven_lanedir_median-3.525172483785638
driven_lanedir_min-3.525172483785638
in-drivable-lane_max22.849999999999497
in-drivable-lane_mean22.849999999999497
in-drivable-lane_min22.849999999999497
per-episodes
details{"loop-000-ego0": {"driven_any": 11.757209896770592, "survival_time": 59.99999999999873, "driven_lanedir": -3.525172483785638, "in-drivable-lane": 22.849999999999497, "deviation-heading": 30.811681511287052, "distance-from-start": 0.17218621681295349, "deviation-center-line": 2.575159386888358, "driven_lanedir_consec": -3.223794810841998}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12520387Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:10:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median28.44999999999925
driven_lanedir_consec_median-2.793475972372674
deviation-center-line_median2.9566652670651203


other stats
deviation-center-line_max2.9566652670651203
deviation-center-line_mean2.9566652670651203
deviation-center-line_min2.9566652670651203
deviation-heading_max25.210736453494867
deviation-heading_mean25.210736453494867
deviation-heading_median25.210736453494867
deviation-heading_min25.210736453494867
distance-from-start_max0.162939163576655
distance-from-start_mean0.162939163576655
distance-from-start_median0.162939163576655
distance-from-start_min0.162939163576655
driven_any_max11.031888228455683
driven_any_mean11.031888228455683
driven_any_median11.031888228455683
driven_any_min11.031888228455683
driven_lanedir_consec_max-2.793475972372674
driven_lanedir_consec_mean-2.793475972372674
driven_lanedir_consec_min-2.793475972372674
driven_lanedir_max-3.0190652239523112
driven_lanedir_mean-3.0190652239523112
driven_lanedir_median-3.0190652239523112
driven_lanedir_min-3.0190652239523112
in-drivable-lane_max28.44999999999925
in-drivable-lane_mean28.44999999999925
in-drivable-lane_min28.44999999999925
per-episodes
details{"loop2-000-ego0": {"driven_any": 11.031888228455683, "survival_time": 59.99999999999873, "driven_lanedir": -3.0190652239523112, "in-drivable-lane": 28.44999999999925, "deviation-heading": 25.210736453494867, "distance-from-start": 0.162939163576655, "deviation-center-line": 2.9566652670651203, "driven_lanedir_consec": -2.793475972372674}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12518387Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:06:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median19.600000000000144
in-drivable-lane_median5.700000000000036
driven_lanedir_consec_median-0.5806945471173646
deviation-center-line_median0.7879674954148413


other stats
deviation-center-line_max0.7879674954148413
deviation-center-line_mean0.7879674954148413
deviation-center-line_min0.7879674954148413
deviation-heading_max9.67021840264294
deviation-heading_mean9.67021840264294
deviation-heading_median9.67021840264294
deviation-heading_min9.67021840264294
distance-from-start_max0.1498744753297858
distance-from-start_mean0.1498744753297858
distance-from-start_median0.1498744753297858
distance-from-start_min0.1498744753297858
driven_any_max3.2166819653894567
driven_any_mean3.2166819653894567
driven_any_median3.2166819653894567
driven_any_min3.2166819653894567
driven_lanedir_consec_max-0.5806945471173646
driven_lanedir_consec_mean-0.5806945471173646
driven_lanedir_consec_min-0.5806945471173646
driven_lanedir_max-0.6363404470046563
driven_lanedir_mean-0.6363404470046563
driven_lanedir_median-0.6363404470046563
driven_lanedir_min-0.6363404470046563
in-drivable-lane_max5.700000000000036
in-drivable-lane_mean5.700000000000036
in-drivable-lane_min5.700000000000036
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.2166819653894567, "survival_time": 19.600000000000144, "driven_lanedir": -0.6363404470046563, "in-drivable-lane": 5.700000000000036, "deviation-heading": 9.67021840264294, "distance-from-start": 0.1498744753297858, "deviation-center-line": 0.7879674954148413, "driven_lanedir_consec": -0.5806945471173646}}
simulation-passed1
survival_time_max19.600000000000144
survival_time_mean19.600000000000144
survival_time_min19.600000000000144
No reset possible
12516388Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12510389Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:09:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median28.79999999999925
driven_lanedir_consec_median-3.1100690104854847
deviation-center-line_median2.688888286143872


other stats
deviation-center-line_max2.688888286143872
deviation-center-line_mean2.688888286143872
deviation-center-line_min2.688888286143872
deviation-heading_max27.9964026453071
deviation-heading_mean27.9964026453071
deviation-heading_median27.9964026453071
deviation-heading_min27.9964026453071
distance-from-start_max0.17810455430973438
distance-from-start_mean0.17810455430973438
distance-from-start_median0.17810455430973438
distance-from-start_min0.17810455430973438
driven_any_max11.335860024296633
driven_any_mean11.335860024296633
driven_any_median11.335860024296633
driven_any_min11.335860024296633
driven_lanedir_consec_max-3.1100690104854847
driven_lanedir_consec_mean-3.1100690104854847
driven_lanedir_consec_min-3.1100690104854847
driven_lanedir_max-3.4580245427685337
driven_lanedir_mean-3.4580245427685337
driven_lanedir_median-3.4580245427685337
driven_lanedir_min-3.4580245427685337
in-drivable-lane_max28.79999999999925
in-drivable-lane_mean28.79999999999925
in-drivable-lane_min28.79999999999925
per-episodes
details{"udem1-000-ego0": {"driven_any": 11.335860024296633, "survival_time": 59.99999999999873, "driven_lanedir": -3.4580245427685337, "in-drivable-lane": 28.79999999999925, "deviation-heading": 27.9964026453071, "distance-from-start": 0.17810455430973438, "deviation-center-line": 2.688888286143872, "driven_lanedir_consec": -3.1100690104854847}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12508391Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12498392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-0of4successnodavinci-stage-04-6.2.500:34:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median29.224999999999337
driven_lanedir_consec_median-3.4410487956310405
deviation-center-line_median2.348173791327582


other stats
deviation-center-line_max3.1753896440256764
deviation-center-line_mean2.5064496293964593
deviation-center-line_min2.154061290904997
deviation-heading_max27.937316660122285
deviation-heading_mean25.94201736256157
deviation-heading_median26.50282479123082
deviation-heading_min22.82510320766236
distance-from-start_max0.16619251620981298
distance-from-start_mean0.1608659164236524
distance-from-start_median0.15979953024118076
distance-from-start_min0.1576720890024351
driven_any_max12.821150651383796
driven_any_mean11.976527700412976
driven_any_median11.778966795362496
driven_any_min11.527026559543112
driven_lanedir_consec_max-3.112432491391621
driven_lanedir_consec_mean-3.484052728651608
driven_lanedir_consec_min-3.9416808319527297
driven_lanedir_max-3.112432491391621
driven_lanedir_mean-3.5518624758078707
driven_lanedir_median-3.4410487956310405
driven_lanedir_min-4.21291982057778
in-drivable-lane_max34.299999999999116
in-drivable-lane_mean29.599999999999294
in-drivable-lane_min25.649999999999405
per-episodes
details{"autolab-000-ego0": {"driven_any": 12.007183546327957, "survival_time": 59.99999999999873, "driven_lanedir": -3.680179940126981, "in-drivable-lane": 29.499999999999307, "deviation-heading": 27.303100417038017, "distance-from-start": 0.15941146562754435, "deviation-center-line": 2.154061290904997, "driven_lanedir_consec": -3.680179940126981}, "autolab-000-ego1": {"driven_any": 11.550750044397034, "survival_time": 59.99999999999873, "driven_lanedir": -3.2019176511351004, "in-drivable-lane": 25.649999999999405, "deviation-heading": 27.937316660122285, "distance-from-start": 0.1576720890024351, "deviation-center-line": 3.1753896440256764, "driven_lanedir_consec": -3.2019176511351004}, "autolab-000-ego2": {"driven_any": 12.821150651383796, "survival_time": 59.99999999999873, "driven_lanedir": -4.21291982057778, "in-drivable-lane": 28.949999999999356, "deviation-heading": 25.702549165423623, "distance-from-start": 0.16619251620981298, "deviation-center-line": 2.32115104392431, "driven_lanedir_consec": -3.9416808319527297}, "autolab-000-ego3": {"driven_any": 11.527026559543112, "survival_time": 59.99999999999873, "driven_lanedir": -3.112432491391621, "in-drivable-lane": 34.299999999999116, "deviation-heading": 22.82510320766236, "distance-from-start": 0.16018759485481715, "deviation-center-line": 2.375196538730855, "driven_lanedir_consec": -3.112432491391621}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12485398Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-testingsim-1of4successnodavinci-stage-04-6.2.500:32:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median14.574999999999765
driven_lanedir_consec_median-2.8199610587857227
deviation-center-line_median3.7532322113498098


other stats
deviation-center-line_max6.92373718844141
deviation-center-line_mean4.055009549588172
deviation-center-line_min1.789836587211661
deviation-heading_max40.31511430902566
deviation-heading_mean30.612898628034166
deviation-heading_median29.731991848777117
deviation-heading_min22.67249650555677
distance-from-start_max0.2574981692581587
distance-from-start_mean0.18978040428710935
distance-from-start_median0.17352190093328673
distance-from-start_min0.15457964602370527
driven_any_max15.05818487824537
driven_any_mean9.181595942712072
driven_any_median10.234519090915654
driven_any_min1.1991607107716151
driven_lanedir_consec_max-0.22008884736594347
driven_lanedir_consec_mean-2.6525583843168956
driven_lanedir_consec_min-4.750222572330195
driven_lanedir_max-0.22008884736594347
driven_lanedir_mean-3.5154723714062586
driven_lanedir_median-2.8199610587857227
driven_lanedir_min-8.201878520687647
in-drivable-lane_max23.44999999999942
in-drivable-lane_mean13.662499999999737
in-drivable-lane_min2.0499999999999927
per-episodes
details{"4way-000-ego0": {"driven_any": 7.99941278401216, "survival_time": 59.99999999999873, "driven_lanedir": -2.1508807259624927, "in-drivable-lane": 14.799999999999857, "deviation-heading": 40.31511430902566, "distance-from-start": 0.15518746017813756, "deviation-center-line": 1.789836587211661, "driven_lanedir_consec": -2.1508807259624927}, "4way-000-ego1": {"driven_any": 1.1991607107716151, "survival_time": 59.99999999999873, "driven_lanedir": -0.22008884736594347, "in-drivable-lane": 2.0499999999999927, "deviation-heading": 22.67249650555677, "distance-from-start": 0.15457964602370527, "deviation-center-line": 6.92373718844141, "driven_lanedir_consec": -0.22008884736594347}, "4way-000-ego2": {"driven_any": 15.05818487824537, "survival_time": 59.99999999999873, "driven_lanedir": -8.201878520687647, "in-drivable-lane": 14.349999999999676, "deviation-heading": 29.5918933853404, "distance-from-start": 0.19185634168843588, "deviation-center-line": 4.518397223707714, "driven_lanedir_consec": -4.750222572330195}, "4way-000-ego3": {"driven_any": 12.469625397819147, "survival_time": 59.99999999999873, "driven_lanedir": -3.4890413916089527, "in-drivable-lane": 23.44999999999942, "deviation-heading": 29.872090312213835, "distance-from-start": 0.2574981692581587, "deviation-center-line": 2.9880671989919056, "driven_lanedir_consec": -3.4890413916089527}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12483393Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-testingsim-0of4successnodavinci-stage-04-6.2.500:09:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median32.49999999999919
driven_lanedir_consec_median-2.43416686049874
deviation-center-line_median2.7661863466385817


other stats
deviation-center-line_max2.7661863466385817
deviation-center-line_mean2.7661863466385817
deviation-center-line_min2.7661863466385817
deviation-heading_max23.460184843190348
deviation-heading_mean23.460184843190348
deviation-heading_median23.460184843190348
deviation-heading_min23.460184843190348
distance-from-start_max0.15371794844730627
distance-from-start_mean0.15371794844730627
distance-from-start_median0.15371794844730627
distance-from-start_min0.15371794844730627
driven_any_max10.378392700050552
driven_any_mean10.378392700050552
driven_any_median10.378392700050552
driven_any_min10.378392700050552
driven_lanedir_consec_max-2.43416686049874
driven_lanedir_consec_mean-2.43416686049874
driven_lanedir_consec_min-2.43416686049874
driven_lanedir_max-2.43416686049874
driven_lanedir_mean-2.43416686049874
driven_lanedir_median-2.43416686049874
driven_lanedir_min-2.43416686049874
in-drivable-lane_max32.49999999999919
in-drivable-lane_mean32.49999999999919
in-drivable-lane_min32.49999999999919
per-episodes
details{"autolab-000-ego0": {"driven_any": 10.378392700050552, "survival_time": 59.99999999999873, "driven_lanedir": -2.43416686049874, "in-drivable-lane": 32.49999999999919, "deviation-heading": 23.460184843190348, "distance-from-start": 0.15371794844730627, "deviation-center-line": 2.7661863466385817, "driven_lanedir_consec": -2.43416686049874}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12482394Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:02:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.7499999999999805
in-drivable-lane_median2.649999999999991
driven_lanedir_consec_median-0.294358346478824
deviation-center-line_median0.1858526864205273


other stats
deviation-center-line_max0.1858526864205273
deviation-center-line_mean0.1858526864205273
deviation-center-line_min0.1858526864205273
deviation-heading_max4.092743986237769
deviation-heading_mean4.092743986237769
deviation-heading_median4.092743986237769
deviation-heading_min4.092743986237769
distance-from-start_max0.1601789501146687
distance-from-start_mean0.1601789501146687
distance-from-start_median0.1601789501146687
distance-from-start_min0.1601789501146687
driven_any_max1.1514206214548883
driven_any_mean1.1514206214548883
driven_any_median1.1514206214548883
driven_any_min1.1514206214548883
driven_lanedir_consec_max-0.294358346478824
driven_lanedir_consec_mean-0.294358346478824
driven_lanedir_consec_min-0.294358346478824
driven_lanedir_max-0.294358346478824
driven_lanedir_mean-0.294358346478824
driven_lanedir_median-0.294358346478824
driven_lanedir_min-0.294358346478824
in-drivable-lane_max2.649999999999991
in-drivable-lane_mean2.649999999999991
in-drivable-lane_min2.649999999999991
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.1514206214548883, "survival_time": 7.7499999999999805, "driven_lanedir": -0.294358346478824, "in-drivable-lane": 2.649999999999991, "deviation-heading": 4.092743986237769, "distance-from-start": 0.1601789501146687, "deviation-center-line": 0.1858526864205273, "driven_lanedir_consec": -0.294358346478824}}
simulation-passed1
survival_time_max7.7499999999999805
survival_time_mean7.7499999999999805
survival_time_min7.7499999999999805
No reset possible
12481394Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-testingsim-0of4successnodavinci-stage-04-6.2.500:03:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.5999999999999845
in-drivable-lane_median2.199999999999992
driven_lanedir_consec_median-0.19884382613840712
deviation-center-line_median0.18839853031288312


other stats
deviation-center-line_max0.18839853031288312
deviation-center-line_mean0.18839853031288312
deviation-center-line_min0.18839853031288312
deviation-heading_max3.2378819817775315
deviation-heading_mean3.2378819817775315
deviation-heading_median3.2378819817775315
deviation-heading_min3.2378819817775315
distance-from-start_max0.16228901441607116
distance-from-start_mean0.16228901441607116
distance-from-start_median0.16228901441607116
distance-from-start_min0.16228901441607116
driven_any_max0.8951360786659989
driven_any_mean0.8951360786659989
driven_any_median0.8951360786659989
driven_any_min0.8951360786659989
driven_lanedir_consec_max-0.19884382613840712
driven_lanedir_consec_mean-0.19884382613840712
driven_lanedir_consec_min-0.19884382613840712
driven_lanedir_max-0.19884382613840712
driven_lanedir_mean-0.19884382613840712
driven_lanedir_median-0.19884382613840712
driven_lanedir_min-0.19884382613840712
in-drivable-lane_max2.199999999999992
in-drivable-lane_mean2.199999999999992
in-drivable-lane_min2.199999999999992
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.8951360786659989, "survival_time": 6.5999999999999845, "driven_lanedir": -0.19884382613840712, "in-drivable-lane": 2.199999999999992, "deviation-heading": 3.2378819817775315, "distance-from-start": 0.16228901441607116, "deviation-center-line": 0.18839853031288312, "driven_lanedir_consec": -0.19884382613840712}}
simulation-passed1
survival_time_max6.5999999999999845
survival_time_mean6.5999999999999845
survival_time_min6.5999999999999845
No reset possible
12476395Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-testingsim-1of4successnodavinci-stage-04-6.2.500:05:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median14.800000000000075
in-drivable-lane_median6.750000000000039
driven_lanedir_consec_median-0.9767671667996534
deviation-center-line_median0.3293276062964357


other stats
deviation-center-line_max0.3293276062964357
deviation-center-line_mean0.3293276062964357
deviation-center-line_min0.3293276062964357
deviation-heading_max6.5399837923461845
deviation-heading_mean6.5399837923461845
deviation-heading_median6.5399837923461845
deviation-heading_min6.5399837923461845
distance-from-start_max0.1628591751460858
distance-from-start_mean0.1628591751460858
distance-from-start_median0.1628591751460858
distance-from-start_min0.1628591751460858
driven_any_max3.100550630179019
driven_any_mean3.100550630179019
driven_any_median3.100550630179019
driven_any_min3.100550630179019
driven_lanedir_consec_max-0.9767671667996534
driven_lanedir_consec_mean-0.9767671667996534
driven_lanedir_consec_min-0.9767671667996534
driven_lanedir_max-0.967514269665528
driven_lanedir_mean-0.967514269665528
driven_lanedir_median-0.967514269665528
driven_lanedir_min-0.967514269665528
in-drivable-lane_max6.750000000000039
in-drivable-lane_mean6.750000000000039
in-drivable-lane_min6.750000000000039
per-episodes
details{"4way-000-ego0": {"driven_any": 3.100550630179019, "survival_time": 14.800000000000075, "driven_lanedir": -0.967514269665528, "in-drivable-lane": 6.750000000000039, "deviation-heading": 6.5399837923461845, "distance-from-start": 0.1628591751460858, "deviation-center-line": 0.3293276062964357, "driven_lanedir_consec": -0.9767671667996534}}
simulation-passed1
survival_time_max14.800000000000075
survival_time_mean14.800000000000075
survival_time_min14.800000000000075
No reset possible
12475395Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12473396Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12468398Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12463515Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-validationsim-3of4failednodavinci-stage-04-6.2.500:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12457515Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-validationsim-0of4failednodavinci-stage-04-6.2.500:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12452517Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-validationsim-0of4failednodavinci-stage-04-6.2.500:01:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12447518Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-validationsim-1of4failednodavinci-stage-04-6.2.500:01:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12444520Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12439521Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-testingsim-2of4failednodavinci-stage-04-6.2.500:01:21
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12431523Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-testingsim-1of4failednodavinci-stage-04-6.2.500:02:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12426524Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-testingsim-1of4failednodavinci-stage-04-6.2.500:02:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12423524Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:02:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12421525Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:01:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12420525Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12419525Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-testingsim-1of4failednodavinci-stage-04-6.2.500:01:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12418527Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-testingsim-1of4failednodavinci-stage-04-6.2.500:01:38
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12417527Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-testingsim-0of4failednodavinci-stage-04-6.2.500:01:08
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12416527Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12414527Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:01:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12408529Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:06:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median9.84253288862679
deviation-center-line_median2.9092980828324695


other stats
deviation-center-line_max2.9092980828324695
deviation-center-line_mean2.9092980828324695
deviation-center-line_min2.9092980828324695
deviation-heading_max12.42473288046157
deviation-heading_mean12.42473288046157
deviation-heading_median12.42473288046157
deviation-heading_min12.42473288046157
distance-from-start_max1.0676989598039377
distance-from-start_mean1.0676989598039377
distance-from-start_median1.0676989598039377
distance-from-start_min1.0676989598039377
driven_any_max10.179510973572384
driven_any_mean10.179510973572384
driven_any_median10.179510973572384
driven_any_min10.179510973572384
driven_lanedir_consec_max9.84253288862679
driven_lanedir_consec_mean9.84253288862679
driven_lanedir_consec_min9.84253288862679
driven_lanedir_max9.84253288862679
driven_lanedir_mean9.84253288862679
driven_lanedir_median9.84253288862679
driven_lanedir_min9.84253288862679
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 10.179510973572384, "survival_time": 59.99999999999873, "driven_lanedir": 9.84253288862679, "in-drivable-lane": 0.0, "deviation-heading": 12.42473288046157, "distance-from-start": 1.0676989598039377, "deviation-center-line": 2.9092980828324695, "driven_lanedir_consec": 9.84253288862679}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12405530Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:08:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.39999999999997726
driven_lanedir_consec_median10.144261846466812
deviation-center-line_median3.2943868016622053


other stats
deviation-center-line_max3.2943868016622053
deviation-center-line_mean3.2943868016622053
deviation-center-line_min3.2943868016622053
deviation-heading_max14.085877559005237
deviation-heading_mean14.085877559005237
deviation-heading_median14.085877559005237
deviation-heading_min14.085877559005237
distance-from-start_max1.1094478953915077
distance-from-start_mean1.1094478953915077
distance-from-start_median1.1094478953915077
distance-from-start_min1.1094478953915077
driven_any_max10.682557584187132
driven_any_mean10.682557584187132
driven_any_median10.682557584187132
driven_any_min10.682557584187132
driven_lanedir_consec_max10.144261846466812
driven_lanedir_consec_mean10.144261846466812
driven_lanedir_consec_min10.144261846466812
driven_lanedir_max10.144261846466812
driven_lanedir_mean10.144261846466812
driven_lanedir_median10.144261846466812
driven_lanedir_min10.144261846466812
in-drivable-lane_max0.39999999999997726
in-drivable-lane_mean0.39999999999997726
in-drivable-lane_min0.39999999999997726
per-episodes
details{"loop2-000-ego0": {"driven_any": 10.682557584187132, "survival_time": 59.99999999999873, "driven_lanedir": 10.144261846466812, "in-drivable-lane": 0.39999999999997726, "deviation-heading": 14.085877559005237, "distance-from-start": 1.1094478953915077, "deviation-center-line": 3.2943868016622053, "driven_lanedir_consec": 10.144261846466812}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12401531Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-validationsim-0of4successnodavinci-stage-04-6.2.500:03:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.6
in-drivable-lane_median0.0
driven_lanedir_consec_median1.2156201492212184
deviation-center-line_median0.542886416877013


other stats
deviation-center-line_max0.542886416877013
deviation-center-line_mean0.542886416877013
deviation-center-line_min0.542886416877013
deviation-heading_max3.129131332282327
deviation-heading_mean3.129131332282327
deviation-heading_median3.129131332282327
deviation-heading_min3.129131332282327
distance-from-start_max0.9530497925276796
distance-from-start_mean0.9530497925276796
distance-from-start_median0.9530497925276796
distance-from-start_min0.9530497925276796
driven_any_max1.2779466070663783
driven_any_mean1.2779466070663783
driven_any_median1.2779466070663783
driven_any_min1.2779466070663783
driven_lanedir_consec_max1.2156201492212184
driven_lanedir_consec_mean1.2156201492212184
driven_lanedir_consec_min1.2156201492212184
driven_lanedir_max1.2156214560831464
driven_lanedir_mean1.2156214560831464
driven_lanedir_median1.2156214560831464
driven_lanedir_min1.2156214560831464
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 1.2779466070663783, "survival_time": 9.6, "driven_lanedir": 1.2156214560831464, "in-drivable-lane": 0.0, "deviation-heading": 3.129131332282327, "distance-from-start": 0.9530497925276796, "deviation-center-line": 0.542886416877013, "driven_lanedir_consec": 1.2156201492212184}}
simulation-passed1
survival_time_max9.6
survival_time_mean9.6
survival_time_min9.6
No reset possible
12397532Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:02:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12381535Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-testingsim-0of4successnodavinci-stage-04-6.2.500:18:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.5565222806895065
deviation-center-line_median2.8991721087872095


other stats
deviation-center-line_max4.306375521076352
deviation-center-line_mean3.1362114283338327
deviation-center-line_min2.440125974684561
deviation-heading_max21.550897512559324
deviation-heading_mean12.592265407606934
deviation-heading_median11.901957693550072
deviation-heading_min5.01424873076827
distance-from-start_max4.3441153602962626
distance-from-start_mean2.5034961806931904
distance-from-start_median1.960291902542849
distance-from-start_min1.749285557390802
driven_any_max10.37298220969949
driven_any_mean5.04955294600559
driven_any_median3.672938558373192
driven_any_min2.479352457576485
driven_lanedir_consec_max9.250115318531623
driven_lanedir_consec_mean4.6785567036292415
driven_lanedir_consec_min2.351066934606327
driven_lanedir_max9.250115318531623
driven_lanedir_mean4.6785567036292415
driven_lanedir_median3.5565222806895065
driven_lanedir_min2.351066934606327
in-drivable-lane_max3.049999999999826
in-drivable-lane_mean0.7624999999999567
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.1703921482541406, "survival_time": 59.99999999999873, "driven_lanedir": 3.054499390071708, "in-drivable-lane": 0.0, "deviation-heading": 8.464409256353328, "distance-from-start": 1.749285557390802, "deviation-center-line": 2.440125974684561, "driven_lanedir_consec": 3.054499390071708}, "autolab-000-ego1": {"driven_any": 10.37298220969949, "survival_time": 59.99999999999873, "driven_lanedir": 9.250115318531623, "in-drivable-lane": 3.049999999999826, "deviation-heading": 15.339506130746816, "distance-from-start": 4.3441153602962626, "deviation-center-line": 2.9538994063332424, "driven_lanedir_consec": 9.250115318531623}, "autolab-000-ego2": {"driven_any": 4.175484968492244, "survival_time": 59.99999999999873, "driven_lanedir": 4.058545171307305, "in-drivable-lane": 0.0, "deviation-heading": 21.550897512559324, "distance-from-start": 1.90340979812021, "deviation-center-line": 2.8444448112411767, "driven_lanedir_consec": 4.058545171307305}, "autolab-000-ego3": {"driven_any": 2.479352457576485, "survival_time": 59.99999999999873, "driven_lanedir": 2.351066934606327, "in-drivable-lane": 0.0, "deviation-heading": 5.01424873076827, "distance-from-start": 2.0171740069654875, "deviation-center-line": 4.306375521076352, "driven_lanedir_consec": 2.351066934606327}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12376537Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:08:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median27.550000000000257
in-drivable-lane_median2.4500000000000126
driven_lanedir_consec_median3.5216081434909605
deviation-center-line_median1.3050305759253154


other stats
deviation-center-line_max1.3050305759253154
deviation-center-line_mean1.3050305759253154
deviation-center-line_min1.3050305759253154
deviation-heading_max5.831980312949134
deviation-heading_mean5.831980312949134
deviation-heading_median5.831980312949134
deviation-heading_min5.831980312949134
distance-from-start_max3.1711619590577156
distance-from-start_mean3.1711619590577156
distance-from-start_median3.1711619590577156
distance-from-start_min3.1711619590577156
driven_any_max4.17501870471583
driven_any_mean4.17501870471583
driven_any_median4.17501870471583
driven_any_min4.17501870471583
driven_lanedir_consec_max3.5216081434909605
driven_lanedir_consec_mean3.5216081434909605
driven_lanedir_consec_min3.5216081434909605
driven_lanedir_max3.5216081434909605
driven_lanedir_mean3.5216081434909605
driven_lanedir_median3.5216081434909605
driven_lanedir_min3.5216081434909605
in-drivable-lane_max2.4500000000000126
in-drivable-lane_mean2.4500000000000126
in-drivable-lane_min2.4500000000000126
per-episodes
details{"zigzag-000-ego0": {"driven_any": 4.17501870471583, "survival_time": 27.550000000000257, "driven_lanedir": 3.5216081434909605, "in-drivable-lane": 2.4500000000000126, "deviation-heading": 5.831980312949134, "distance-from-start": 3.1711619590577156, "deviation-center-line": 1.3050305759253154, "driven_lanedir_consec": 3.5216081434909605}}
simulation-passed1
survival_time_max27.550000000000257
survival_time_mean27.550000000000257
survival_time_min27.550000000000257
No reset possible
12371537Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-testingsim-2of4host-errornodavinci-stage-04-6.2.500:01:09
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon' 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12368537Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-testingsim-1of4host-errornodavinci-stage-04-6.2.500:00:50
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon' 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12364538Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12348542Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-testingsim-1of4successnodavinci-stage-04-6.2.500:19:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.540932130472182
deviation-center-line_median4.347297600725017


other stats
deviation-center-line_max6.8121805535931035
deviation-center-line_mean4.6253526240346
deviation-center-line_min2.994634741095264
deviation-heading_max34.54780746510574
deviation-heading_mean22.927946627769465
deviation-heading_median21.46935606019364
deviation-heading_min14.225266925584837
distance-from-start_max3.2401022677314493
distance-from-start_mean1.4657550938292163
distance-from-start_median1.0304373533032838
distance-from-start_min0.5620434009788479
driven_any_max10.640214919647676
driven_any_mean5.718716316645528
driven_any_median5.813833980066603
driven_any_min0.6069823868012312
driven_lanedir_consec_max9.076970441193058
driven_lanedir_consec_mean5.184052725708102
driven_lanedir_consec_min0.5773762006949854
driven_lanedir_max9.823919901304413
driven_lanedir_mean5.38347977633018
driven_lanedir_median5.5662888235728545
driven_lanedir_min0.5774215568705974
in-drivable-lane_max1.1499999999999917
in-drivable-lane_mean0.28749999999999787
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 10.640214919647676, "survival_time": 59.99999999999873, "driven_lanedir": 9.823919901304413, "in-drivable-lane": 1.1499999999999917, "deviation-heading": 14.225266925584837, "distance-from-start": 3.2401022677314493, "deviation-center-line": 3.196705345200389, "driven_lanedir_consec": 9.027350115978562}, "4way-000-ego1": {"driven_any": 0.6069823868012312, "survival_time": 59.99999999999873, "driven_lanedir": 0.5774215568705974, "in-drivable-lane": 0.0, "deviation-heading": 26.80559477373986, "distance-from-start": 0.5620434009788479, "deviation-center-line": 6.8121805535931035, "driven_lanedir_consec": 0.5773762006949854}, "4way-000-ego2": {"driven_any": 2.1629825094877555, "survival_time": 59.99999999999873, "driven_lanedir": 2.055607205952651, "in-drivable-lane": 0.0, "deviation-heading": 34.54780746510574, "distance-from-start": 1.0527168956198405, "deviation-center-line": 5.497889856249644, "driven_lanedir_consec": 2.0545141449658013}, "4way-000-ego3": {"driven_any": 9.46468545064545, "survival_time": 59.99999999999873, "driven_lanedir": 9.076970441193058, "in-drivable-lane": 0.0, "deviation-heading": 16.133117346647424, "distance-from-start": 1.008157810986727, "deviation-center-line": 2.994634741095264, "driven_lanedir_consec": 9.076970441193058}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12336603Bea Baselines 🐤template-rosaido-LFV_multi-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:04:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.249999999999982
in-drivable-lane_median6.374999999999984
driven_lanedir_consec_median0.34624012798547665
deviation-center-line_median0.1511931788883748


other stats
deviation-center-line_max0.2877312893997545
deviation-center-line_mean0.16815754788677115
deviation-center-line_min0.08251254437058048
deviation-heading_max1.738578158332069
deviation-heading_mean0.9855182401346804
deviation-heading_median0.8514317429539995
deviation-heading_min0.500631316298653
distance-from-start_max2.1096145034476153
distance-from-start_mean1.3795126992421578
distance-from-start_median1.4392718403841416
distance-from-start_min0.5298926127527324
driven_any_max2.15624593713476
driven_any_mean1.4418550685468403
driven_any_median1.5399462437377447
driven_any_min0.5312818495771123
driven_lanedir_consec_max0.7794333387172112
driven_lanedir_consec_mean0.4046466323540047
driven_lanedir_consec_min0.14667293472785436
driven_lanedir_max0.7794333387172112
driven_lanedir_mean0.4062838223407576
driven_lanedir_median0.3495145079589824
driven_lanedir_min0.14667293472785436
in-drivable-lane_max7.349999999999982
in-drivable-lane_mean6.262499999999983
in-drivable-lane_min4.949999999999986
per-episodes
details{"loop-000-ego0": {"driven_any": 2.15624593713476, "survival_time": 8.249999999999982, "driven_lanedir": 0.3564637419939738, "in-drivable-lane": 5.949999999999985, "deviation-heading": 1.738578158332069, "distance-from-start": 2.1096145034476153, "deviation-center-line": 0.20056246177700313, "driven_lanedir_consec": 0.34991498204696225}, "loop-000-ego1": {"driven_any": 1.2426899638462094, "survival_time": 8.249999999999982, "driven_lanedir": 0.14667293472785436, "in-drivable-lane": 7.349999999999982, "deviation-heading": 0.500631316298653, "distance-from-start": 1.1816799681120438, "deviation-center-line": 0.08251254437058048, "driven_lanedir_consec": 0.14667293472785436}, "loop-000-ego2": {"driven_any": 0.5312818495771123, "survival_time": 8.249999999999982, "driven_lanedir": 0.34256527392399105, "in-drivable-lane": 6.799999999999982, "deviation-heading": 0.5216320357368802, "distance-from-start": 0.5298926127527324, "deviation-center-line": 0.10182389599974644, "driven_lanedir_consec": 0.34256527392399105}, "loop-000-ego3": {"driven_any": 1.83720252362928, "survival_time": 8.249999999999982, "driven_lanedir": 0.7794333387172112, "in-drivable-lane": 4.949999999999986, "deviation-heading": 1.1812314501711187, "distance-from-start": 1.6968637126562396, "deviation-center-line": 0.2877312893997545, "driven_lanedir_consec": 0.7794333387172112}}
simulation-passed1
survival_time_max8.249999999999982
survival_time_mean8.249999999999982
survival_time_min8.249999999999982
No reset possible
12329603Bea Baselines 🐤template-rosaido-LFV_multi-sim-validationsim-0of4successnodavinci-stage-04-6.2.500:04:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.649999999999981
in-drivable-lane_median5.674999999999982
driven_lanedir_consec_median0.3949521451188893
deviation-center-line_median0.15319479360141905


other stats
deviation-center-line_max0.2116828048969887
deviation-center-line_mean0.14909894594322823
deviation-center-line_min0.07832339167308609
deviation-heading_max1.51508537977902
deviation-heading_mean0.8652540826067447
deviation-heading_median0.7329168884127781
deviation-heading_min0.48009717382240297
distance-from-start_max1.807180514543562
distance-from-start_mean1.6067335060180483
distance-from-start_median1.720233741755457
distance-from-start_min1.1792860260177167
driven_any_max1.8828393208387348
driven_any_mean1.677445173655574
driven_any_median1.816790560847289
driven_any_min1.1933602520889832
driven_lanedir_consec_max0.5011296249581547
driven_lanedir_consec_mean0.35792548477712444
driven_lanedir_consec_min0.1406680239125644
driven_lanedir_max0.5011296249581547
driven_lanedir_mean0.35792548477712444
driven_lanedir_median0.3949521451188893
driven_lanedir_min0.1406680239125644
in-drivable-lane_max6.79999999999998
in-drivable-lane_mean5.849999999999983
in-drivable-lane_min5.249999999999984
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.8127268606989917, "survival_time": 7.649999999999981, "driven_lanedir": 0.5011296249581547, "in-drivable-lane": 5.449999999999984, "deviation-heading": 0.9791615438268244, "distance-from-start": 1.7114176554497322, "deviation-center-line": 0.2116828048969887, "driven_lanedir_consec": 0.5011296249581547}, "autolab-000-ego1": {"driven_any": 1.1933602520889832, "survival_time": 7.649999999999981, "driven_lanedir": 0.1406680239125644, "in-drivable-lane": 6.79999999999998, "deviation-heading": 0.48009717382240297, "distance-from-start": 1.1792860260177167, "deviation-center-line": 0.07832339167308609, "driven_lanedir_consec": 0.1406680239125644}, "autolab-000-ego2": {"driven_any": 1.8828393208387348, "survival_time": 7.649999999999981, "driven_lanedir": 0.4345863173904445, "in-drivable-lane": 5.249999999999984, "deviation-heading": 1.51508537977902, "distance-from-start": 1.729049828061182, "deviation-center-line": 0.19224461204565668, "driven_lanedir_consec": 0.4345863173904445}, "autolab-000-ego3": {"driven_any": 1.8208542609955864, "survival_time": 7.649999999999981, "driven_lanedir": 0.35531797284733413, "in-drivable-lane": 5.89999999999998, "deviation-heading": 0.48667223299873186, "distance-from-start": 1.807180514543562, "deviation-center-line": 0.1141449751571814, "driven_lanedir_consec": 0.35531797284733413}}
simulation-passed1
survival_time_max7.649999999999981
survival_time_mean7.649999999999981
survival_time_min7.649999999999981
No reset possible
12324605Bea Baselines 🐤template-rosaido-LFV-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:02:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.299999999999986
in-drivable-lane_median1.999999999999993
driven_lanedir_consec_median1.123036701567105
deviation-center-line_median0.27587578126284856


other stats
deviation-center-line_max0.27587578126284856
deviation-center-line_mean0.27587578126284856
deviation-center-line_min0.27587578126284856
deviation-heading_max1.4355342418846244
deviation-heading_mean1.4355342418846244
deviation-heading_median1.4355342418846244
deviation-heading_min1.4355342418846244
distance-from-start_max1.4722198888597962
distance-from-start_mean1.4722198888597962
distance-from-start_median1.4722198888597962
distance-from-start_min1.4722198888597962
driven_any_max1.6186532788435983
driven_any_mean1.6186532788435983
driven_any_median1.6186532788435983
driven_any_min1.6186532788435983
driven_lanedir_consec_max1.123036701567105
driven_lanedir_consec_mean1.123036701567105
driven_lanedir_consec_min1.123036701567105
driven_lanedir_max1.123036701567105
driven_lanedir_mean1.123036701567105
driven_lanedir_median1.123036701567105
driven_lanedir_min1.123036701567105
in-drivable-lane_max1.999999999999993
in-drivable-lane_mean1.999999999999993
in-drivable-lane_min1.999999999999993
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.6186532788435983, "survival_time": 6.299999999999986, "driven_lanedir": 1.123036701567105, "in-drivable-lane": 1.999999999999993, "deviation-heading": 1.4355342418846244, "distance-from-start": 1.4722198888597962, "deviation-center-line": 0.27587578126284856, "driven_lanedir_consec": 1.123036701567105}}
simulation-passed1
survival_time_max6.299999999999986
survival_time_mean6.299999999999986
survival_time_min6.299999999999986
No reset possible
12317605Bea Baselines 🐤template-rosaido-LFV-sim-validationsim-0of4host-errornodavinci-stage-04-6.2.500:01:34
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon' 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12312606Bea Baselines 🐤template-rosaido-LFVI-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:03:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12308607Bea Baselines 🐤template-rosaido-LFI-sim-validationsim-2of4host-errornodavinci-stage-04-6.2.500:01:36
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 139, in download_artefacts
    get_file_from_cache(fn, sha256hex)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner_cache.py", line 63, in get_file_from_cache
    raise KeyError(msg)
KeyError: 'Hash not in cache'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1032, in run_single
    prepare_dir(wd, aws_config, steps2artefacts=steps2artefacts, steps2scores=steps2scores, use_ipfs=use_ipfs)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1465, in prepare_dir
    download_artefacts(aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 155, in download_artefacts
    get_object(aws_config, bucket_name, object_key, fn)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 204, in get_object
    aws_object.download_file(fn)
  File "/usr/local/lib/python3.8/dist-packages/boto3/s3/inject.py", line 359, in object_download_file
    return self.meta.client.download_file(
  File "/usr/local/lib/python3.8/dist-packages/boto3/s3/inject.py", line 190, in download_file
    return transfer.download_file(
  File "/usr/local/lib/python3.8/dist-packages/boto3/s3/transfer.py", line 320, in download_file
    future.result()
  File "/usr/local/lib/python3.8/dist-packages/s3transfer/futures.py", line 103, in result
    return self._coordinator.result()
  File "/usr/local/lib/python3.8/dist-packages/s3transfer/futures.py", line 266, in result
    raise self._exception
  File "/usr/local/lib/python3.8/dist-packages/s3transfer/tasks.py", line 269, in _main
    self._submit(transfer_future=transfer_future, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/s3transfer/download.py", line 354, in _submit
    response = client.head_object(
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 515, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 917, in _make_api_call
    http, parsed_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 940, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 119, in make_request
    return self._send_request(request_dict, operation_model)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 202, in _send_request
    while self._needs_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 354, in _needs_retry
    responses = self._event_emitter.emit(
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 412, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 256, in emit
    return self._emit(event_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 239, in _emit
    response = handler(**kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/utils.py", line 1595, in redirect_from_error
    new_region = self.get_bucket_region(bucket, response)
  File "/usr/local/lib/python3.8/dist-packages/botocore/utils.py", line 1665, in get_bucket_region
    response = self._client.head_bucket(Bucket=bucket)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 515, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 917, in _make_api_call
    http, parsed_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 940, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 119, in make_request
    return self._send_request(request_dict, operation_model)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 202, in _send_request
    while self._needs_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 354, in _needs_retry
    responses = self._event_emitter.emit(
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 412, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 256, in emit
    return self._emit(event_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 239, in _emit
    response = handler(**kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 207, in __call__
    if self._checker(**checker_kwargs):
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 284, in __call__
    should_retry = self._should_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 320, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 363, in __call__
    checker_response = checker(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 247, in __call__
    return self._check_caught_exception(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 416, in _check_caught_exception
    raise caught_exception
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 281, in _do_get_response
    http_response = self._send(request)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 377, in _send
    return self.http_session.send(request)
  File "/usr/local/lib/python3.8/dist-packages/botocore/httpsession.py", line 484, in send
    raise EndpointConnectionError(endpoint_url=request.url, error=e)
botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "https://duckietown-ai-driving-olympics-1.s3.us-east-2.amazonaws.com/"
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12302607Bea Baselines 🐤template-rosaido-LFI-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:03:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.499999999999981
in-drivable-lane_median5.799999999999984
driven_lanedir_consec_median0.1794725708755065
deviation-center-line_median0.12249350655142605


other stats
deviation-center-line_max0.12249350655142605
deviation-center-line_mean0.12249350655142605
deviation-center-line_min0.12249350655142605
deviation-heading_max1.5395017639735615
deviation-heading_mean1.5395017639735615
deviation-heading_median1.5395017639735615
deviation-heading_min1.5395017639735615
distance-from-start_max1.7581494238673052
distance-from-start_mean1.7581494238673052
distance-from-start_median1.7581494238673052
distance-from-start_min1.7581494238673052
driven_any_max1.866411627251412
driven_any_mean1.866411627251412
driven_any_median1.866411627251412
driven_any_min1.866411627251412
driven_lanedir_consec_max0.1794725708755065
driven_lanedir_consec_mean0.1794725708755065
driven_lanedir_consec_min0.1794725708755065
driven_lanedir_max0.214032503817835
driven_lanedir_mean0.214032503817835
driven_lanedir_median0.214032503817835
driven_lanedir_min0.214032503817835
in-drivable-lane_max5.799999999999984
in-drivable-lane_mean5.799999999999984
in-drivable-lane_min5.799999999999984
per-episodes
details{"udem1-000-ego0": {"driven_any": 1.866411627251412, "survival_time": 7.499999999999981, "driven_lanedir": 0.214032503817835, "in-drivable-lane": 5.799999999999984, "deviation-heading": 1.5395017639735615, "distance-from-start": 1.7581494238673052, "deviation-center-line": 0.12249350655142605, "driven_lanedir_consec": 0.1794725708755065}}
simulation-passed1
survival_time_max7.499999999999981
survival_time_mean7.499999999999981
survival_time_min7.499999999999981
No reset possible
12298609Bea Baselines 🐤template-rosaido-LFVI_multi-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:01:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12294610Bea Baselines 🐤template-rosaido-LFV_multi-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:02:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.5999999999999845
in-drivable-lane_median4.724999999999987
driven_lanedir_consec_median0.2882608302047629
deviation-center-line_median0.15964568234736926


other stats
deviation-center-line_max0.1663718152025004
deviation-center-line_mean0.15964568234736926
deviation-center-line_min0.15291954949223813
deviation-heading_max1.5118358231553417
deviation-heading_mean1.423519404130238
deviation-heading_median1.423519404130238
deviation-heading_min1.3352029851051344
distance-from-start_max1.6633424883663086
distance-from-start_mean1.4540055959492957
distance-from-start_median1.4540055959492957
distance-from-start_min1.2446687035322828
driven_any_max1.7178187563949256
driven_any_mean1.4948594411824545
driven_any_median1.4948594411824545
driven_any_min1.2719001259699834
driven_lanedir_consec_max0.33307265500843264
driven_lanedir_consec_mean0.2882608302047629
driven_lanedir_consec_min0.24344900540109315
driven_lanedir_max0.33307265500843264
driven_lanedir_mean0.2882608302047629
driven_lanedir_median0.2882608302047629
driven_lanedir_min0.24344900540109315
in-drivable-lane_max4.849999999999987
in-drivable-lane_mean4.724999999999987
in-drivable-lane_min4.599999999999988
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.7178187563949256, "survival_time": 6.5999999999999845, "driven_lanedir": 0.33307265500843264, "in-drivable-lane": 4.599999999999988, "deviation-heading": 1.5118358231553417, "distance-from-start": 1.6633424883663086, "deviation-center-line": 0.15291954949223813, "driven_lanedir_consec": 0.33307265500843264}, "loop2-000-ego1": {"driven_any": 1.2719001259699834, "survival_time": 6.5999999999999845, "driven_lanedir": 0.24344900540109315, "in-drivable-lane": 4.849999999999987, "deviation-heading": 1.3352029851051344, "distance-from-start": 1.2446687035322828, "deviation-center-line": 0.1663718152025004, "driven_lanedir_consec": 0.24344900540109315}}
simulation-passed1
survival_time_max6.5999999999999845
survival_time_mean6.5999999999999845
survival_time_min6.5999999999999845
No reset possible
12289611Bea Baselines 🐤template-rosaido-LFP-sim-testingsim-0of4successnodavinci-stage-04-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.849999999999984
in-drivable-lane_median5.6499999999999835
driven_lanedir_consec_median0.19769522228184
deviation-center-line_median0.09236938528424368


other stats
deviation-center-line_max0.09236938528424368
deviation-center-line_mean0.09236938528424368
deviation-center-line_min0.09236938528424368
deviation-heading_max0.6553649295344498
deviation-heading_mean0.6553649295344498
deviation-heading_median0.6553649295344498
deviation-heading_min0.6553649295344498
distance-from-start_max1.7120667070892712
distance-from-start_mean1.7120667070892712
distance-from-start_median1.7120667070892712
distance-from-start_min1.7120667070892712
driven_any_max1.7268653751171656
driven_any_mean1.7268653751171656
driven_any_median1.7268653751171656
driven_any_min1.7268653751171656
driven_lanedir_consec_max0.19769522228184
driven_lanedir_consec_mean0.19769522228184
driven_lanedir_consec_min0.19769522228184
driven_lanedir_max0.19769522228184
driven_lanedir_mean0.19769522228184
driven_lanedir_median0.19769522228184
driven_lanedir_min0.19769522228184
in-drivable-lane_max5.6499999999999835
in-drivable-lane_mean5.6499999999999835
in-drivable-lane_min5.6499999999999835
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.7268653751171656, "survival_time": 6.849999999999984, "driven_lanedir": 0.19769522228184, "in-drivable-lane": 5.6499999999999835, "deviation-heading": 0.6553649295344498, "distance-from-start": 1.7120667070892712, "deviation-center-line": 0.09236938528424368, "driven_lanedir_consec": 0.19769522228184}}
simulation-passed1
survival_time_max6.849999999999984
survival_time_mean6.849999999999984
survival_time_min6.849999999999984
No reset possible
12286612Bea Baselines 🐤template-rosaido-LFV-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:02:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.6499999999999915
in-drivable-lane_median3.7999999999999914
driven_lanedir_consec_median0.12573106269746992
deviation-center-line_median0.0560456757924535


other stats
deviation-center-line_max0.0560456757924535
deviation-center-line_mean0.0560456757924535
deviation-center-line_min0.0560456757924535
deviation-heading_max0.5972233340563262
deviation-heading_mean0.5972233340563262
deviation-heading_median0.5972233340563262
deviation-heading_min0.5972233340563262
distance-from-start_max1.0472134405057547
distance-from-start_mean1.0472134405057547
distance-from-start_median1.0472134405057547
distance-from-start_min1.0472134405057547
driven_any_max1.0998965241615677
driven_any_mean1.0998965241615677
driven_any_median1.0998965241615677
driven_any_min1.0998965241615677
driven_lanedir_consec_max0.12573106269746992
driven_lanedir_consec_mean0.12573106269746992
driven_lanedir_consec_min0.12573106269746992
driven_lanedir_max0.12573106269746992
driven_lanedir_mean0.12573106269746992
driven_lanedir_median0.12573106269746992
driven_lanedir_min0.12573106269746992
in-drivable-lane_max3.7999999999999914
in-drivable-lane_mean3.7999999999999914
in-drivable-lane_min3.7999999999999914
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.0998965241615677, "survival_time": 4.6499999999999915, "driven_lanedir": 0.12573106269746992, "in-drivable-lane": 3.7999999999999914, "deviation-heading": 0.5972233340563262, "distance-from-start": 1.0472134405057547, "deviation-center-line": 0.0560456757924535, "driven_lanedir_consec": 0.12573106269746992}}
simulation-passed1
survival_time_max4.6499999999999915
survival_time_mean4.6499999999999915
survival_time_min4.6499999999999915
No reset possible
12280614Bea Baselines 🐤template-rosaido-LFI-sim-testingsim-0of4successnodavinci-stage-04-6.2.500:02:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.199999999999993
in-drivable-lane_median1.5999999999999976
driven_lanedir_consec_median0.3954195184863649
deviation-center-line_median0.2812670463377154


other stats
deviation-center-line_max0.2812670463377154
deviation-center-line_mean0.2812670463377154
deviation-center-line_min0.2812670463377154
deviation-heading_max2.2932086099164866
deviation-heading_mean2.2932086099164866
deviation-heading_median2.2932086099164866
deviation-heading_min2.2932086099164866
distance-from-start_max1.061766114696944
distance-from-start_mean1.061766114696944
distance-from-start_median1.061766114696944
distance-from-start_min1.061766114696944
driven_any_max1.0704147131600985
driven_any_mean1.0704147131600985
driven_any_median1.0704147131600985
driven_any_min1.0704147131600985
driven_lanedir_consec_max0.3954195184863649
driven_lanedir_consec_mean0.3954195184863649
driven_lanedir_consec_min0.3954195184863649
driven_lanedir_max0.3954213864331963
driven_lanedir_mean0.3954213864331963
driven_lanedir_median0.3954213864331963
driven_lanedir_min0.3954213864331963
in-drivable-lane_max1.5999999999999976
in-drivable-lane_mean1.5999999999999976
in-drivable-lane_min1.5999999999999976
per-episodes
details{"4way-000-ego0": {"driven_any": 1.0704147131600985, "survival_time": 4.199999999999993, "driven_lanedir": 0.3954213864331963, "in-drivable-lane": 1.5999999999999976, "deviation-heading": 2.2932086099164866, "distance-from-start": 1.061766114696944, "deviation-center-line": 0.2812670463377154, "driven_lanedir_consec": 0.3954195184863649}}
simulation-passed1
survival_time_max4.199999999999993
survival_time_mean4.199999999999993
survival_time_min4.199999999999993
No reset possible
12276615Bea Baselines 🐤template-rosaido-LF-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:02:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.22260025844407116
survival_time_median11.750000000000032
deviation-center-line_median0.20330632372897295
in-drivable-lane_median9.350000000000025


other stats
deviation-center-line_max0.20330632372897295
deviation-center-line_mean0.20330632372897295
deviation-center-line_min0.20330632372897295
deviation-heading_max2.677953215688886
deviation-heading_mean2.677953215688886
deviation-heading_median2.677953215688886
deviation-heading_min2.677953215688886
distance-from-start_max2.9560853064706434
distance-from-start_mean2.9560853064706434
distance-from-start_median2.9560853064706434
distance-from-start_min2.9560853064706434
driven_any_max3.329906760985455
driven_any_mean3.329906760985455
driven_any_median3.329906760985455
driven_any_min3.329906760985455
driven_lanedir_consec_max0.22260025844407116
driven_lanedir_consec_mean0.22260025844407116
driven_lanedir_consec_min0.22260025844407116
driven_lanedir_max0.22260025844407116
driven_lanedir_mean0.22260025844407116
driven_lanedir_median0.22260025844407116
driven_lanedir_min0.22260025844407116
in-drivable-lane_max9.350000000000025
in-drivable-lane_mean9.350000000000025
in-drivable-lane_min9.350000000000025
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.329906760985455, "survival_time": 11.750000000000032, "driven_lanedir": 0.22260025844407116, "in-drivable-lane": 9.350000000000025, "deviation-heading": 2.677953215688886, "distance-from-start": 2.9560853064706434, "deviation-center-line": 0.20330632372897295, "driven_lanedir_consec": 0.22260025844407116}}
simulation-passed1
survival_time_max11.750000000000032
survival_time_mean11.750000000000032
survival_time_min11.750000000000032
No reset possible
12273615Bea Baselines 🐤template-rosaido-LF-sim-testingsim-1of4successnodavinci-stage-04-6.2.500:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4048156072411917
survival_time_median6.399999999999985
deviation-center-line_median0.1868212783485554
in-drivable-lane_median4.249999999999989


other stats
deviation-center-line_max0.1868212783485554
deviation-center-line_mean0.1868212783485554
deviation-center-line_min0.1868212783485554
deviation-heading_max1.4825064317425
deviation-heading_mean1.4825064317425
deviation-heading_median1.4825064317425
deviation-heading_min1.4825064317425
distance-from-start_max1.5715627980137823
distance-from-start_mean1.5715627980137823
distance-from-start_median1.5715627980137823
distance-from-start_min1.5715627980137823
driven_any_max1.5911001333561787
driven_any_mean1.5911001333561787
driven_any_median1.5911001333561787
driven_any_min1.5911001333561787
driven_lanedir_consec_max0.4048156072411917
driven_lanedir_consec_mean0.4048156072411917
driven_lanedir_consec_min0.4048156072411917
driven_lanedir_max0.4048156072411917
driven_lanedir_mean0.4048156072411917
driven_lanedir_median0.4048156072411917
driven_lanedir_min0.4048156072411917
in-drivable-lane_max4.249999999999989
in-drivable-lane_mean4.249999999999989
in-drivable-lane_min4.249999999999989
per-episodes
details{"loop-000-ego0": {"driven_any": 1.5911001333561787, "survival_time": 6.399999999999985, "driven_lanedir": 0.4048156072411917, "in-drivable-lane": 4.249999999999989, "deviation-heading": 1.4825064317425, "distance-from-start": 1.5715627980137823, "deviation-center-line": 0.1868212783485554, "driven_lanedir_consec": 0.4048156072411917}}
simulation-passed1
survival_time_max6.399999999999985
survival_time_mean6.399999999999985
survival_time_min6.399999999999985
No reset possible
12271616Bea Baselines 🐤template-rosaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:03:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12269616Bea Baselines 🐤template-rosaido-LFVI_multi-sim-testingsim-1of4successnodavinci-stage-04-6.2.500:06:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.249999999999982
in-drivable-lane_median5.974999999999982
driven_lanedir_consec_median0.19177855671657495
deviation-center-line_median0.09333727388841198


other stats
deviation-center-line_max0.19975804056736768
deviation-center-line_mean0.11333006316592888
deviation-center-line_min0.06688766431952395
deviation-heading_max2.5754981521149167
deviation-heading_mean1.0085652313234617
deviation-heading_median0.5368986816669205
deviation-heading_min0.3849654098450884
distance-from-start_max1.650387851770776
distance-from-start_mean0.8564480115252405
distance-from-start_median0.7158927495098988
distance-from-start_min0.34361869531038863
driven_any_max1.876999436224902
driven_any_mean0.932832317399907
driven_any_median0.7532717215937352
driven_any_min0.3477863901872553
driven_lanedir_consec_max0.28200326987899293
driven_lanedir_consec_mean0.2013672892792942
driven_lanedir_consec_min0.13990877380503397
driven_lanedir_max0.28200326987899293
driven_lanedir_mean0.2073490279630233
driven_lanedir_median0.19379367866720076
driven_lanedir_min0.1598054846386987
in-drivable-lane_max6.299999999999982
in-drivable-lane_mean5.824999999999982
in-drivable-lane_min5.049999999999987
per-episodes
details{"4way-000-ego0": {"driven_any": 0.9339348487414594, "survival_time": 7.249999999999982, "driven_lanedir": 0.1598054846386987, "in-drivable-lane": 6.299999999999982, "deviation-heading": 0.5939385593776628, "distance-from-start": 0.9003409983408986, "deviation-center-line": 0.06978165102804909, "driven_lanedir_consec": 0.1598054846386987}, "4way-000-ego1": {"driven_any": 0.3477863901872553, "survival_time": 7.249999999999982, "driven_lanedir": 0.2237516287944512, "in-drivable-lane": 6.099999999999982, "deviation-heading": 0.3849654098450884, "distance-from-start": 0.34361869531038863, "deviation-center-line": 0.11689289674877486, "driven_lanedir_consec": 0.2237516287944512}, "4way-000-ego2": {"driven_any": 0.5726085944460112, "survival_time": 7.249999999999982, "driven_lanedir": 0.28200326987899293, "in-drivable-lane": 5.849999999999982, "deviation-heading": 0.4798588039561781, "distance-from-start": 0.5314445006788988, "deviation-center-line": 0.06688766431952395, "driven_lanedir_consec": 0.28200326987899293}, "4way-000-ego3": {"driven_any": 1.876999436224902, "survival_time": 7.249999999999982, "driven_lanedir": 0.16383572853995032, "in-drivable-lane": 5.049999999999987, "deviation-heading": 2.5754981521149167, "distance-from-start": 1.650387851770776, "deviation-center-line": 0.19975804056736768, "driven_lanedir_consec": 0.13990877380503397}}
simulation-passed1
survival_time_max7.249999999999982
survival_time_mean7.249999999999982
survival_time_min7.249999999999982
No reset possible
12267618Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-validationsim-2of4host-errornodavinci-stage-04-6.2.500:00:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: Get https://registry-stage2.duckietown.org/v2/token?account=duckietowndaemon&client_id=docker&offline_token=true&service=registry-stage2.duckietown.org: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon' 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12266616Bea Baselines 🐤template-rosaido-LFVI_multi-sim-testingsim-0of4successnodavinci-stage-04-6.2.500:03:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.449999999999992
in-drivable-lane_median3.374999999999992
driven_lanedir_consec_median0.1864233476013776
deviation-center-line_median0.08361000266502724


other stats
deviation-center-line_max0.12305252113179388
deviation-center-line_mean0.0855182234883961
deviation-center-line_min0.05180036749173602
deviation-heading_max0.7020783020037592
deviation-heading_mean0.5228023263701456
deviation-heading_median0.5049244647098593
deviation-heading_min0.37928207405710446
distance-from-start_max0.9718848939337734
distance-from-start_mean0.6604871045172949
distance-from-start_median0.6475930398002264
distance-from-start_min0.3748774445349533
driven_any_max1.020651081936111
driven_any_mean0.6781520689208729
driven_any_median0.6566300270617353
driven_any_min0.37869713962390944
driven_lanedir_consec_max0.5446828871799352
driven_lanedir_consec_mean0.2512887974161124
driven_lanedir_consec_min0.08762560728175917
driven_lanedir_max0.5446828871799352
driven_lanedir_mean0.2512887974161124
driven_lanedir_median0.1864233476013776
driven_lanedir_min0.08762560728175917
in-drivable-lane_max3.599999999999992
in-drivable-lane_mean3.137499999999992
in-drivable-lane_min2.199999999999992
per-episodes
details{"udem-000-ego0": {"driven_any": 0.4749604015253672, "survival_time": 4.449999999999992, "driven_lanedir": 0.08762560728175917, "in-drivable-lane": 3.599999999999992, "deviation-heading": 0.7020783020037592, "distance-from-start": 0.45962861169236985, "deviation-center-line": 0.05180036749173602, "driven_lanedir_consec": 0.08762560728175917}, "udem-000-ego1": {"driven_any": 0.8382996525981035, "survival_time": 4.449999999999992, "driven_lanedir": 0.2285993809035709, "in-drivable-lane": 3.249999999999992, "deviation-heading": 0.37928207405710446, "distance-from-start": 0.8355574679080829, "deviation-center-line": 0.12305252113179388, "driven_lanedir_consec": 0.2285993809035709}, "udem-000-ego2": {"driven_any": 1.020651081936111, "survival_time": 4.449999999999992, "driven_lanedir": 0.5446828871799352, "in-drivable-lane": 2.199999999999992, "deviation-heading": 0.4598547363038549, "distance-from-start": 0.9718848939337734, "deviation-center-line": 0.07843636109499202, "driven_lanedir_consec": 0.5446828871799352}, "udem-000-ego3": {"driven_any": 0.37869713962390944, "survival_time": 4.449999999999992, "driven_lanedir": 0.14424731429918425, "in-drivable-lane": 3.499999999999992, "deviation-heading": 0.5499941931158636, "distance-from-start": 0.3748774445349533, "deviation-center-line": 0.08878364423506246, "driven_lanedir_consec": 0.14424731429918425}}
simulation-passed1
survival_time_max4.449999999999992
survival_time_mean4.449999999999992
survival_time_min4.449999999999992
No reset possible
12264617Bea Baselines 🐤challenge-aido_LF-template-ros:daffy-staging:e107400fd98b91bb7c02b7b24d7be5f5d7623035aido-hello-sim-validationsanity-checksuccessnodavinci-stage-04-6.2.500:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.044719821183590414
deviation-center-line_median0.005880326680269394


other stats
deviation-center-line_max0.005880326680269394
deviation-center-line_mean0.005880326680269394
deviation-center-line_min0.005880326680269394
deviation-heading_max0.26316347450531824
deviation-heading_mean0.26316347450531824
deviation-heading_median0.26316347450531824
deviation-heading_min0.26316347450531824
distance-from-start_max0.0514216743004644
distance-from-start_mean0.0514216743004644
distance-from-start_median0.0514216743004644
distance-from-start_min0.0514216743004644
driven_any_max0.05142326906279078
driven_any_mean0.05142326906279078
driven_any_median0.05142326906279078
driven_any_min0.05142326906279078
driven_lanedir_consec_max0.044719821183590414
driven_lanedir_consec_mean0.044719821183590414
driven_lanedir_consec_min0.044719821183590414
driven_lanedir_max0.044719821183590414
driven_lanedir_mean0.044719821183590414
driven_lanedir_median0.044719821183590414
driven_lanedir_min0.044719821183590414
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.05142326906279078, "survival_time": 0.49999999999999994, "driven_lanedir": 0.044719821183590414, "in-drivable-lane": 0.0, "deviation-heading": 0.26316347450531824, "distance-from-start": 0.0514216743004644, "deviation-center-line": 0.005880326680269394, "driven_lanedir_consec": 0.044719821183590414}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
12256620Bea Baselines 🐤baseline-duckietownaido-LFV-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:14:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median48.799999999998704
driven_lanedir_consec_median1.1448971902224343
deviation-center-line_median0.6118829368092521


other stats
deviation-center-line_max0.6118829368092521
deviation-center-line_mean0.6118829368092521
deviation-center-line_min0.6118829368092521
deviation-heading_max3.9067090509996447
deviation-heading_mean3.9067090509996447
deviation-heading_median3.9067090509996447
deviation-heading_min3.9067090509996447
distance-from-start_max2.49762284794067
distance-from-start_mean2.49762284794067
distance-from-start_median2.49762284794067
distance-from-start_min2.49762284794067
driven_any_max7.912832986579503
driven_any_mean7.912832986579503
driven_any_median7.912832986579503
driven_any_min7.912832986579503
driven_lanedir_consec_max1.1448971902224343
driven_lanedir_consec_mean1.1448971902224343
driven_lanedir_consec_min1.1448971902224343
driven_lanedir_max1.268342898025328
driven_lanedir_mean1.268342898025328
driven_lanedir_median1.268342898025328
driven_lanedir_min1.268342898025328
in-drivable-lane_max48.799999999998704
in-drivable-lane_mean48.799999999998704
in-drivable-lane_min48.799999999998704
per-episodes
details{"loop-000-ego0": {"driven_any": 7.912832986579503, "survival_time": 59.99999999999873, "driven_lanedir": 1.268342898025328, "in-drivable-lane": 48.799999999998704, "deviation-heading": 3.9067090509996447, "distance-from-start": 2.49762284794067, "deviation-center-line": 0.6118829368092521, "driven_lanedir_consec": 1.1448971902224343}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12252621Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12247622Bea Baselines 🐤baseline-duckietownaido-LFI-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:05:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median31.050000000000303
in-drivable-lane_median2.2499999999999964
driven_lanedir_consec_median3.21941049244653
deviation-center-line_median2.589966043924696


other stats
deviation-center-line_max2.589966043924696
deviation-center-line_mean2.589966043924696
deviation-center-line_min2.589966043924696
deviation-heading_max9.705713610069694
deviation-heading_mean9.705713610069694
deviation-heading_median9.705713610069694
deviation-heading_min9.705713610069694
distance-from-start_max2.590238095986583
distance-from-start_mean2.590238095986583
distance-from-start_median2.590238095986583
distance-from-start_min2.590238095986583
driven_any_max3.971110910997421
driven_any_mean3.971110910997421
driven_any_median3.971110910997421
driven_any_min3.971110910997421
driven_lanedir_consec_max3.21941049244653
driven_lanedir_consec_mean3.21941049244653
driven_lanedir_consec_min3.21941049244653
driven_lanedir_max3.302653439594108
driven_lanedir_mean3.302653439594108
driven_lanedir_median3.302653439594108
driven_lanedir_min3.302653439594108
in-drivable-lane_max2.2499999999999964
in-drivable-lane_mean2.2499999999999964
in-drivable-lane_min2.2499999999999964
per-episodes
details{"udem1-000-ego0": {"driven_any": 3.971110910997421, "survival_time": 31.050000000000303, "driven_lanedir": 3.302653439594108, "in-drivable-lane": 2.2499999999999964, "deviation-heading": 9.705713610069694, "distance-from-start": 2.590238095986583, "deviation-center-line": 2.589966043924696, "driven_lanedir_consec": 3.21941049244653}}
simulation-passed1
survival_time_max31.050000000000303
survival_time_mean31.050000000000303
survival_time_min31.050000000000303
No reset possible
12244624Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:06:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.450000000000014
in-drivable-lane_median1.0749999999999962
driven_lanedir_consec_median0.4584538803369791
deviation-center-line_median0.8473015001647295


other stats
deviation-center-line_max1.1913594875837772
deviation-center-line_mean0.8636697608064136
deviation-center-line_min0.5687165553124183
deviation-heading_max10.942521091023249
deviation-heading_mean6.413381708072011
deviation-heading_median6.261140475215703
deviation-heading_min2.1887247908333904
distance-from-start_max0.9277367528866588
distance-from-start_mean0.6523966017470316
distance-from-start_median0.626355533819429
distance-from-start_min0.4291385864626102
driven_any_max1.2425914608978923
driven_any_mean0.8310845078808075
driven_any_median0.7912821668947937
driven_any_min0.4991822368357503
driven_lanedir_consec_max0.8215812333717235
driven_lanedir_consec_mean0.5402490109821819
driven_lanedir_consec_min0.4225070498830459
driven_lanedir_max0.8215812333717235
driven_lanedir_mean0.5402490109821819
driven_lanedir_median0.4584538803369791
driven_lanedir_min0.4225070498830459
in-drivable-lane_max3.799999999999992
in-drivable-lane_mean1.487499999999996
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 1.0701095837438273, "survival_time": 10.450000000000014, "driven_lanedir": 0.4888681805008632, "in-drivable-lane": 3.799999999999992, "deviation-heading": 2.1887247908333904, "distance-from-start": 0.8162651624517738, "deviation-center-line": 0.5687165553124183, "driven_lanedir_consec": 0.4888681805008632}, "4way-000-ego1": {"driven_any": 0.4991822368357503, "survival_time": 10.450000000000014, "driven_lanedir": 0.4225070498830459, "in-drivable-lane": 0.0, "deviation-heading": 10.942521091023249, "distance-from-start": 0.4291385864626102, "deviation-center-line": 1.1913594875837772, "driven_lanedir_consec": 0.4225070498830459}, "4way-000-ego2": {"driven_any": 1.2425914608978923, "survival_time": 10.450000000000014, "driven_lanedir": 0.8215812333717235, "in-drivable-lane": 2.1499999999999924, "deviation-heading": 3.65988201243173, "distance-from-start": 0.9277367528866588, "deviation-center-line": 0.6448747806055141, "driven_lanedir_consec": 0.8215812333717235}, "4way-000-ego3": {"driven_any": 0.5124547500457601, "survival_time": 10.450000000000014, "driven_lanedir": 0.42803958017309496, "in-drivable-lane": 0.0, "deviation-heading": 8.862398937999677, "distance-from-start": 0.4364459051870841, "deviation-center-line": 1.0497282197239448, "driven_lanedir_consec": 0.42803958017309496}}
simulation-passed1
survival_time_max10.450000000000014
survival_time_mean10.450000000000014
survival_time_min10.450000000000014
No reset possible
12242624Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12241624Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:02:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12240625Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:04:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median19.150000000000137
in-drivable-lane_median2.075000000000006
driven_lanedir_consec_median1.6356263794416868
deviation-center-line_median1.1653896857873685


other stats
deviation-center-line_max1.5723098487591558
deviation-center-line_mean1.1653896857873685
deviation-center-line_min0.7584695228155812
deviation-heading_max4.257290794749518
deviation-heading_mean3.6795833001023857
deviation-heading_median3.6795833001023857
deviation-heading_min3.1018758054552538
distance-from-start_max1.0708046079619191
distance-from-start_mean1.0179600811754668
distance-from-start_median1.0179600811754668
distance-from-start_min0.965115554389014
driven_any_max2.3978133978163756
driven_any_mean2.3977509344215724
driven_any_median2.3977509344215724
driven_any_min2.3976884710267687
driven_lanedir_consec_max1.8138939989700429
driven_lanedir_consec_mean1.6356263794416868
driven_lanedir_consec_min1.4573587599133306
driven_lanedir_max2.190653913270032
driven_lanedir_mean2.0640829800260576
driven_lanedir_median2.0640829800260576
driven_lanedir_min1.937512046782083
in-drivable-lane_max3.1500000000000155
in-drivable-lane_mean2.075000000000006
in-drivable-lane_min0.9999999999999964
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.3978133978163756, "survival_time": 19.150000000000137, "driven_lanedir": 2.190653913270032, "in-drivable-lane": 0.9999999999999964, "deviation-heading": 3.1018758054552538, "distance-from-start": 0.965115554389014, "deviation-center-line": 0.7584695228155812, "driven_lanedir_consec": 1.4573587599133306}, "loop2-000-ego1": {"driven_any": 2.3976884710267687, "survival_time": 19.150000000000137, "driven_lanedir": 1.937512046782083, "in-drivable-lane": 3.1500000000000155, "deviation-heading": 4.257290794749518, "distance-from-start": 1.0708046079619191, "deviation-center-line": 1.5723098487591558, "driven_lanedir_consec": 1.8138939989700429}}
simulation-passed1
survival_time_max19.150000000000137
survival_time_mean19.150000000000137
survival_time_min19.150000000000137
No reset possible
12236626Bea Baselines 🐤baseline-duckietownaido-LFP-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:03:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.000000000000009
in-drivable-lane_median2.6499999999999915
driven_lanedir_consec_median0.5626517904904342
deviation-center-line_median0.8209021894627296


other stats
deviation-center-line_max0.8209021894627296
deviation-center-line_mean0.8209021894627296
deviation-center-line_min0.8209021894627296
deviation-heading_max2.993245414490548
deviation-heading_mean2.993245414490548
deviation-heading_median2.993245414490548
deviation-heading_min2.993245414490548
distance-from-start_max0.548523350549151
distance-from-start_mean0.548523350549151
distance-from-start_median0.548523350549151
distance-from-start_min0.548523350549151
driven_any_max1.1828490000502303
driven_any_mean1.1828490000502303
driven_any_median1.1828490000502303
driven_any_min1.1828490000502303
driven_lanedir_consec_max0.5626517904904342
driven_lanedir_consec_mean0.5626517904904342
driven_lanedir_consec_min0.5626517904904342
driven_lanedir_max0.6852297256303101
driven_lanedir_mean0.6852297256303101
driven_lanedir_median0.6852297256303101
driven_lanedir_min0.6852297256303101
in-drivable-lane_max2.6499999999999915
in-drivable-lane_mean2.6499999999999915
in-drivable-lane_min2.6499999999999915
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.1828490000502303, "survival_time": 10.000000000000009, "driven_lanedir": 0.6852297256303101, "in-drivable-lane": 2.6499999999999915, "deviation-heading": 2.993245414490548, "distance-from-start": 0.548523350549151, "deviation-center-line": 0.8209021894627296, "driven_lanedir_consec": 0.5626517904904342}}
simulation-passed1
survival_time_max10.000000000000009
survival_time_mean10.000000000000009
survival_time_min10.000000000000009
No reset possible
12232627Bea Baselines 🐤baseline-duckietownaido-LFV-sim-testingsim-0of4successnodavinci-stage-04-6.2.500:05:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median17.800000000000118
in-drivable-lane_median3.7000000000000526
driven_lanedir_consec_median1.7177119351166654
deviation-center-line_median1.363930475578968


other stats
deviation-center-line_max1.363930475578968
deviation-center-line_mean1.363930475578968
deviation-center-line_min1.363930475578968
deviation-heading_max3.38718472409325
deviation-heading_mean3.38718472409325
deviation-heading_median3.38718472409325
deviation-heading_min3.38718472409325
distance-from-start_max1.3491497905674388
distance-from-start_mean1.3491497905674388
distance-from-start_median1.3491497905674388
distance-from-start_min1.3491497905674388
driven_any_max2.218444053212872
driven_any_mean2.218444053212872
driven_any_median2.218444053212872
driven_any_min2.218444053212872
driven_lanedir_consec_max1.7177119351166654
driven_lanedir_consec_mean1.7177119351166654
driven_lanedir_consec_min1.7177119351166654
driven_lanedir_max1.7177119351166654
driven_lanedir_mean1.7177119351166654
driven_lanedir_median1.7177119351166654
driven_lanedir_min1.7177119351166654
in-drivable-lane_max3.7000000000000526
in-drivable-lane_mean3.7000000000000526
in-drivable-lane_min3.7000000000000526
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.218444053212872, "survival_time": 17.800000000000118, "driven_lanedir": 1.7177119351166654, "in-drivable-lane": 3.7000000000000526, "deviation-heading": 3.38718472409325, "distance-from-start": 1.3491497905674388, "deviation-center-line": 1.363930475578968, "driven_lanedir_consec": 1.7177119351166654}}
simulation-passed1
survival_time_max17.800000000000118
survival_time_mean17.800000000000118
survival_time_min17.800000000000118
No reset possible
12227628Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-testingsim-1of4successnodavinci-stage-04-6.2.500:04:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.25000000000004
in-drivable-lane_median1.400000000000002
driven_lanedir_consec_median1.0994000811642597
deviation-center-line_median1.0325835279140236


other stats
deviation-center-line_max1.0325835279140236
deviation-center-line_mean1.0325835279140236
deviation-center-line_min1.0325835279140236
deviation-heading_max5.392902775240045
deviation-heading_mean5.392902775240045
deviation-heading_median5.392902775240045
deviation-heading_min5.392902775240045
distance-from-start_max0.9431422951361436
distance-from-start_mean0.9431422951361436
distance-from-start_median0.9431422951361436
distance-from-start_min0.9431422951361436
driven_any_max1.481551362556354
driven_any_mean1.481551362556354
driven_any_median1.481551362556354
driven_any_min1.481551362556354
driven_lanedir_consec_max1.0994000811642597
driven_lanedir_consec_mean1.0994000811642597
driven_lanedir_consec_min1.0994000811642597
driven_lanedir_max1.0994000811642597
driven_lanedir_mean1.0994000811642597
driven_lanedir_median1.0994000811642597
driven_lanedir_min1.0994000811642597
in-drivable-lane_max1.400000000000002
in-drivable-lane_mean1.400000000000002
in-drivable-lane_min1.400000000000002
per-episodes
details{"4way-000-ego0": {"driven_any": 1.481551362556354, "survival_time": 12.25000000000004, "driven_lanedir": 1.0994000811642597, "in-drivable-lane": 1.400000000000002, "deviation-heading": 5.392902775240045, "distance-from-start": 0.9431422951361436, "deviation-center-line": 1.0325835279140236, "driven_lanedir_consec": 1.0994000811642597}}
simulation-passed1
survival_time_max12.25000000000004
survival_time_mean12.25000000000004
survival_time_min12.25000000000004
No reset possible
12222629Bea Baselines 🐤baseline-duckietownaido-LFI-sim-testingsim-0of4successnodavinci-stage-04-6.2.500:03:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.550000000000017
in-drivable-lane_median1.0999999999999988
driven_lanedir_consec_median0.7967809173286187
deviation-center-line_median0.49525864647617707


other stats
deviation-center-line_max0.49525864647617707
deviation-center-line_mean0.49525864647617707
deviation-center-line_min0.49525864647617707
deviation-heading_max2.475764936127518
deviation-heading_mean2.475764936127518
deviation-heading_median2.475764936127518
deviation-heading_min2.475764936127518
distance-from-start_max0.6538824806358963
distance-from-start_mean0.6538824806358963
distance-from-start_median0.6538824806358963
distance-from-start_min0.6538824806358963
driven_any_max1.249217687249055
driven_any_mean1.249217687249055
driven_any_median1.249217687249055
driven_any_min1.249217687249055
driven_lanedir_consec_max0.7967809173286187
driven_lanedir_consec_mean0.7967809173286187
driven_lanedir_consec_min0.7967809173286187
driven_lanedir_max1.0225331400202191
driven_lanedir_mean1.0225331400202191
driven_lanedir_median1.0225331400202191
driven_lanedir_min1.0225331400202191
in-drivable-lane_max1.0999999999999988
in-drivable-lane_mean1.0999999999999988
in-drivable-lane_min1.0999999999999988
per-episodes
details{"4way-000-ego0": {"driven_any": 1.249217687249055, "survival_time": 10.550000000000017, "driven_lanedir": 1.0225331400202191, "in-drivable-lane": 1.0999999999999988, "deviation-heading": 2.475764936127518, "distance-from-start": 0.6538824806358963, "deviation-center-line": 0.49525864647617707, "driven_lanedir_consec": 0.7967809173286187}}
simulation-passed1
survival_time_max10.550000000000017
survival_time_mean10.550000000000017
survival_time_min10.550000000000017
No reset possible
12217630Bea Baselines 🐤baseline-duckietownaido-LF-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:06:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.72981489551916
survival_time_median59.99999999999873
deviation-center-line_median4.304583756552859
in-drivable-lane_median6.499999999999888


other stats
deviation-center-line_max4.304583756552859
deviation-center-line_mean4.304583756552859
deviation-center-line_min4.304583756552859
deviation-heading_max12.088016172643984
deviation-heading_mean12.088016172643984
deviation-heading_median12.088016172643984
deviation-heading_min12.088016172643984
distance-from-start_max3.1819850440718955
distance-from-start_mean3.1819850440718955
distance-from-start_median3.1819850440718955
distance-from-start_min3.1819850440718955
driven_any_max7.907797882783436
driven_any_mean7.907797882783436
driven_any_median7.907797882783436
driven_any_min7.907797882783436
driven_lanedir_consec_max6.72981489551916
driven_lanedir_consec_mean6.72981489551916
driven_lanedir_consec_min6.72981489551916
driven_lanedir_max6.72981489551916
driven_lanedir_mean6.72981489551916
driven_lanedir_median6.72981489551916
driven_lanedir_min6.72981489551916
in-drivable-lane_max6.499999999999888
in-drivable-lane_mean6.499999999999888
in-drivable-lane_min6.499999999999888
per-episodes
details{"zigzag-000-ego0": {"driven_any": 7.907797882783436, "survival_time": 59.99999999999873, "driven_lanedir": 6.72981489551916, "in-drivable-lane": 6.499999999999888, "deviation-heading": 12.088016172643984, "distance-from-start": 3.1819850440718955, "deviation-center-line": 4.304583756552859, "driven_lanedir_consec": 6.72981489551916}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12212660Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-validationsim-2of4failednodavinci-stage-04-6.2.500:01:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12205661Bea Baselines 🐤template-tensorflowaido-LFP-sim-validationsim-3of4failednodavinci-stage-04-6.2.500:01:19
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12203663Bea Baselines 🐤template-tensorflowaido-LFVI-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12198664Bea Baselines 🐤template-tensorflowaido-LFI-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12194665Bea Baselines 🐤template-tensorflowaido-LF-sim-validationsim-2of4failednodavinci-stage-04-6.2.500:00:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12190666Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12186667Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-testingsim-1of4failednodavinci-stage-04-6.2.500:01:15
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12182668Bea Baselines 🐤template-tensorflowaido-LFP-sim-testingsim-0of4failednodavinci-stage-04-6.2.500:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12179669Bea Baselines 🐤template-tensorflowaido-LFV-sim-testingsim-0of4failednodavinci-stage-04-6.2.500:01:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12161703Bea Baselines 🐤template-randomaido-LFV_multi-sim-validationsim-0of4successnodavinci-stage-04-6.2.500:12:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median31.750000000000316
in-drivable-lane_median25.175000000000296
driven_lanedir_consec_median0.18552469171877983
deviation-center-line_median0.49966350574004126


other stats
deviation-center-line_max0.7555299219673969
deviation-center-line_mean0.5108643440264811
deviation-center-line_min0.2886004426584447
deviation-heading_max5.677922521471409
deviation-heading_mean4.088893264090181
deviation-heading_median4.163773732737991
deviation-heading_min2.3501030694133327
distance-from-start_max0.8824046752191012
distance-from-start_mean0.7245653197432453
distance-from-start_median0.7348495479071131
distance-from-start_min0.5461575079396542
driven_any_max7.70048061152867
driven_any_mean5.0586670251615145
driven_any_median5.018099001021708
driven_any_min2.497989487073972
driven_lanedir_consec_max0.26764923329146384
driven_lanedir_consec_mean0.1856362610589692
driven_lanedir_consec_min0.10384642750685336
driven_lanedir_max0.2496385572544461
driven_lanedir_mean0.17341917865234155
driven_lanedir_median0.17223668708559425
driven_lanedir_min0.09956478318373164
in-drivable-lane_max28.300000000000303
in-drivable-lane_mean25.4625000000003
in-drivable-lane_min23.200000000000298
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.70048061152867, "survival_time": 31.750000000000316, "driven_lanedir": 0.2496385572544461, "in-drivable-lane": 23.200000000000298, "deviation-heading": 5.523299075233993, "distance-from-start": 0.8824046752191012, "deviation-center-line": 0.7555299219673969, "driven_lanedir_consec": 0.26764923329146384}, "autolab-000-ego1": {"driven_any": 6.066664798227061, "survival_time": 31.750000000000316, "driven_lanedir": 0.19493515195653055, "in-drivable-lane": 23.700000000000298, "deviation-heading": 5.677922521471409, "distance-from-start": 0.7960980578537342, "deviation-center-line": 0.5957741014324853, "driven_lanedir_consec": 0.20826345296493876}, "autolab-000-ego2": {"driven_any": 3.969533203816355, "survival_time": 31.750000000000316, "driven_lanedir": 0.14953822221465796, "in-drivable-lane": 26.650000000000297, "deviation-heading": 2.8042483902419892, "distance-from-start": 0.6736010379604919, "deviation-center-line": 0.40355291004759714, "driven_lanedir_consec": 0.1627859304726209}, "autolab-000-ego3": {"driven_any": 2.497989487073972, "survival_time": 31.750000000000316, "driven_lanedir": 0.09956478318373164, "in-drivable-lane": 28.300000000000303, "deviation-heading": 2.3501030694133327, "distance-from-start": 0.5461575079396542, "deviation-center-line": 0.2886004426584447, "driven_lanedir_consec": 0.10384642750685336}}
simulation-passed1
survival_time_max31.750000000000316
survival_time_mean31.750000000000316
survival_time_min31.750000000000316
No reset possible
12160704Bea Baselines 🐤template-randomaido-LFP-sim-validationsim-0of4successnodavinci-stage-04-6.2.500:03:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.4500000000001
in-drivable-lane_median8.850000000000088
driven_lanedir_consec_median0.27376192919933695
deviation-center-line_median0.6226667356941823


other stats
deviation-center-line_max0.6226667356941823
deviation-center-line_mean0.6226667356941823
deviation-center-line_min0.6226667356941823
deviation-heading_max4.977695202648224
deviation-heading_mean4.977695202648224
deviation-heading_median4.977695202648224
deviation-heading_min4.977695202648224
distance-from-start_max0.6736010379605029
distance-from-start_mean0.6736010379605029
distance-from-start_median0.6736010379605029
distance-from-start_min0.6736010379605029
driven_any_max3.8273590406355353
driven_any_mean3.8273590406355353
driven_any_median3.8273590406355353
driven_any_min3.8273590406355353
driven_lanedir_consec_max0.27376192919933695
driven_lanedir_consec_mean0.27376192919933695
driven_lanedir_consec_min0.27376192919933695
driven_lanedir_max0.26276154130140084
driven_lanedir_mean0.26276154130140084
driven_lanedir_median0.26276154130140084
driven_lanedir_min0.26276154130140084
in-drivable-lane_max8.850000000000088
in-drivable-lane_mean8.850000000000088
in-drivable-lane_min8.850000000000088
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.8273590406355353, "survival_time": 16.4500000000001, "driven_lanedir": 0.26276154130140084, "in-drivable-lane": 8.850000000000088, "deviation-heading": 4.977695202648224, "distance-from-start": 0.6736010379605029, "deviation-center-line": 0.6226667356941823, "driven_lanedir_consec": 0.27376192919933695}}
simulation-passed1
survival_time_max16.4500000000001
survival_time_mean16.4500000000001
survival_time_min16.4500000000001
No reset possible
12151707Bea Baselines 🐤template-randomaido-LFI-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:06:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median45.099999999999575
in-drivable-lane_median36.54999999999956
driven_lanedir_consec_median0.26764888474322424
deviation-center-line_median0.7555295615924859


other stats
deviation-center-line_max0.7555295615924859
deviation-center-line_mean0.7555295615924859
deviation-center-line_min0.7555295615924859
deviation-heading_max5.523298977694424
deviation-heading_mean5.523298977694424
deviation-heading_median5.523298977694424
deviation-heading_min5.523298977694424
distance-from-start_max1.0442247976692045
distance-from-start_mean1.0442247976692045
distance-from-start_median1.0442247976692045
distance-from-start_min1.0442247976692045
driven_any_max11.376062002465131
driven_any_mean11.376062002465131
driven_any_median11.376062002465131
driven_any_min11.376062002465131
driven_lanedir_consec_max0.26764888474322424
driven_lanedir_consec_mean0.26764888474322424
driven_lanedir_consec_min0.26764888474322424
driven_lanedir_max0.2496386855430165
driven_lanedir_mean0.2496386855430165
driven_lanedir_median0.2496386855430165
driven_lanedir_min0.2496386855430165
in-drivable-lane_max36.54999999999956
in-drivable-lane_mean36.54999999999956
in-drivable-lane_min36.54999999999956
per-episodes
details{"udem1-000-ego0": {"driven_any": 11.376062002465131, "survival_time": 45.099999999999575, "driven_lanedir": 0.2496386855430165, "in-drivable-lane": 36.54999999999956, "deviation-heading": 5.523298977694424, "distance-from-start": 1.0442247976692045, "deviation-center-line": 0.7555295615924859, "driven_lanedir_consec": 0.26764888474322424}}
simulation-passed1
survival_time_max45.099999999999575
survival_time_mean45.099999999999575
survival_time_min45.099999999999575
No reset possible
12147707Bea Baselines 🐤template-randomaido-LFI-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:02:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12145708Bea Baselines 🐤template-randomaido-LF-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:07:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.27329071924012593
survival_time_median49.74999999999931
deviation-center-line_median0.8940598330260409
in-drivable-lane_median37.69999999999921


other stats
deviation-center-line_max0.8940598330260409
deviation-center-line_mean0.8940598330260409
deviation-center-line_min0.8940598330260409
deviation-heading_max9.653852545002117
deviation-heading_mean9.653852545002117
deviation-heading_median9.653852545002117
deviation-heading_min9.653852545002117
distance-from-start_max1.1376277719266703
distance-from-start_mean1.1376277719266703
distance-from-start_median1.1376277719266703
distance-from-start_min1.1376277719266703
driven_any_max12.450153382790822
driven_any_mean12.450153382790822
driven_any_median12.450153382790822
driven_any_min12.450153382790822
driven_lanedir_consec_max0.27329071924012593
driven_lanedir_consec_mean0.27329071924012593
driven_lanedir_consec_min0.27329071924012593
driven_lanedir_max0.26112935377464863
driven_lanedir_mean0.26112935377464863
driven_lanedir_median0.26112935377464863
driven_lanedir_min0.26112935377464863
in-drivable-lane_max37.69999999999921
in-drivable-lane_mean37.69999999999921
in-drivable-lane_min37.69999999999921
per-episodes
details{"zigzag-000-ego0": {"driven_any": 12.450153382790822, "survival_time": 49.74999999999931, "driven_lanedir": 0.26112935377464863, "in-drivable-lane": 37.69999999999921, "deviation-heading": 9.653852545002117, "distance-from-start": 1.1376277719266703, "deviation-center-line": 0.8940598330260409, "driven_lanedir_consec": 0.27329071924012593}}
simulation-passed1
survival_time_max49.74999999999931
survival_time_mean49.74999999999931
survival_time_min49.74999999999931
No reset possible
12143709Bea Baselines 🐤template-randomaido-LFVI_multi-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12138709Bea Baselines 🐤template-randomaido-LFVI_multi-sim-validationsim-0of4successnodavinci-stage-04-6.2.500:13:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median33.75000000000022
in-drivable-lane_median29.825000000000212
driven_lanedir_consec_median0.21731228142323933
deviation-center-line_median0.3331807431846997


other stats
deviation-center-line_max0.7655512378412563
deviation-center-line_mean0.379245390698747
deviation-center-line_min0.0850688385843324
deviation-heading_max5.708723015945328
deviation-heading_mean2.8582267855416443
deviation-heading_median2.247219992369361
deviation-heading_min1.229744141482529
distance-from-start_max0.9340577697896516
distance-from-start_mean0.6073071039932331
distance-from-start_median0.5461575079396492
distance-from-start_min0.4028556303039823
driven_any_max8.310583890769195
driven_any_mean3.410525124545609
driven_any_median2.453720078564638
driven_any_min0.4240764502839678
driven_lanedir_consec_max0.3926134494082678
driven_lanedir_consec_mean0.2327684277313727
driven_lanedir_consec_min0.10383569867074448
driven_lanedir_max0.3926134494082678
driven_lanedir_mean0.2281267458150863
driven_lanedir_median0.21016777279894416
driven_lanedir_min0.09955798825418904
in-drivable-lane_max31.650000000000222
in-drivable-lane_mean29.125000000000213
in-drivable-lane_min25.2000000000002
per-episodes
details{"udem-000-ego0": {"driven_any": 8.310583890769195, "survival_time": 33.75000000000022, "driven_lanedir": 0.25382856508768814, "in-drivable-lane": 25.2000000000002, "deviation-heading": 5.708723015945328, "distance-from-start": 0.9340577697896516, "deviation-center-line": 0.7655512378412563, "driven_lanedir_consec": 0.2718370953578422}, "udem-000-ego1": {"driven_any": 0.4240764502839678, "survival_time": 33.75000000000022, "driven_lanedir": 0.3926134494082678, "in-drivable-lane": 31.650000000000222, "deviation-heading": 1.229744141482529, "distance-from-start": 0.4028556303039823, "deviation-center-line": 0.0850688385843324, "driven_lanedir_consec": 0.3926134494082678}, "udem-000-ego2": {"driven_any": 2.4390062983425578, "survival_time": 33.75000000000022, "driven_lanedir": 0.1665069805102002, "in-drivable-lane": 29.350000000000215, "deviation-heading": 2.144336915325389, "distance-from-start": 0.5461575079396477, "deviation-center-line": 0.3777614073769809, "driven_lanedir_consec": 0.16278746748863648}, "udem-000-ego3": {"driven_any": 2.4684338587867183, "survival_time": 33.75000000000022, "driven_lanedir": 0.09955798825418904, "in-drivable-lane": 30.30000000000021, "deviation-heading": 2.350103069413333, "distance-from-start": 0.5461575079396509, "deviation-center-line": 0.2886000789924186, "driven_lanedir_consec": 0.10383569867074448}}
simulation-passed1
survival_time_max33.75000000000022
survival_time_mean33.75000000000022
survival_time_min33.75000000000022
No reset possible
12133710Bea Baselines 🐤template-randomaido-LFV_multi-sim-testingsim-0of4host-errornodavinci-stage-04-6.2.500:05:48
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1312, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 423, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1156, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12131711Bea Baselines 🐤template-randomaido-LFP-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:02:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.7499999999999942
in-drivable-lane_median2.2499999999999947
driven_lanedir_consec_median0.022350044024311844
deviation-center-line_median0.02664350798512652


other stats
deviation-center-line_max0.02664350798512652
deviation-center-line_mean0.02664350798512652
deviation-center-line_min0.02664350798512652
deviation-heading_max1.126574172093021
deviation-heading_mean1.126574172093021
deviation-heading_median1.126574172093021
deviation-heading_min1.126574172093021
distance-from-start_max0.4028556303039825
distance-from-start_mean0.4028556303039825
distance-from-start_median0.4028556303039825
distance-from-start_min0.4028556303039825
driven_any_max0.4240764502839735
driven_any_mean0.4240764502839735
driven_any_median0.4240764502839735
driven_any_min0.4240764502839735
driven_lanedir_consec_max0.022350044024311844
driven_lanedir_consec_mean0.022350044024311844
driven_lanedir_consec_min0.022350044024311844
driven_lanedir_max0.022350044024311844
driven_lanedir_mean0.022350044024311844
driven_lanedir_median0.022350044024311844
driven_lanedir_min0.022350044024311844
in-drivable-lane_max2.2499999999999947
in-drivable-lane_mean2.2499999999999947
in-drivable-lane_min2.2499999999999947
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.4240764502839735, "survival_time": 3.7499999999999942, "driven_lanedir": 0.022350044024311844, "in-drivable-lane": 2.2499999999999947, "deviation-heading": 1.126574172093021, "distance-from-start": 0.4028556303039825, "deviation-center-line": 0.02664350798512652, "driven_lanedir_consec": 0.022350044024311844}}
simulation-passed1
survival_time_max3.7499999999999942
survival_time_mean3.7499999999999942
survival_time_min3.7499999999999942
No reset possible
12128711Bea Baselines 🐤template-randomaido-LFP-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:04:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median23.750000000000203
in-drivable-lane_median18.450000000000163
driven_lanedir_consec_median0.02131905156671587
deviation-center-line_median0.43050856325619097


other stats
deviation-center-line_max0.43050856325619097
deviation-center-line_mean0.43050856325619097
deviation-center-line_min0.43050856325619097
deviation-heading_max4.072119010163631
deviation-heading_mean4.072119010163631
deviation-heading_median4.072119010163631
deviation-heading_min4.072119010163631
distance-from-start_max0.7357883576773695
distance-from-start_mean0.7357883576773695
distance-from-start_median0.7357883576773695
distance-from-start_min0.7357883576773695
driven_any_max5.629722876849649
driven_any_mean5.629722876849649
driven_any_median5.629722876849649
driven_any_min5.629722876849649
driven_lanedir_consec_max0.02131905156671587
driven_lanedir_consec_mean0.02131905156671587
driven_lanedir_consec_min0.02131905156671587
driven_lanedir_max0.004357978552197217
driven_lanedir_mean0.004357978552197217
driven_lanedir_median0.004357978552197217
driven_lanedir_min0.004357978552197217
in-drivable-lane_max18.450000000000163
in-drivable-lane_mean18.450000000000163
in-drivable-lane_min18.450000000000163
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.629722876849649, "survival_time": 23.750000000000203, "driven_lanedir": 0.004357978552197217, "in-drivable-lane": 18.450000000000163, "deviation-heading": 4.072119010163631, "distance-from-start": 0.7357883576773695, "deviation-center-line": 0.43050856325619097, "driven_lanedir_consec": 0.02131905156671587}}
simulation-passed1
survival_time_max23.750000000000203
survival_time_mean23.750000000000203
survival_time_min23.750000000000203
No reset possible
12124713Bea Baselines 🐤template-randomaido-LFVI-sim-testingsim-1of4successnodavinci-stage-04-6.2.500:04:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.350000000000026
in-drivable-lane_median7.900000000000015
driven_lanedir_consec_median0.02729653158692802
deviation-center-line_median0.3268218383633572


other stats
deviation-center-line_max0.3268218383633572
deviation-center-line_mean0.3268218383633572
deviation-center-line_min0.3268218383633572
deviation-heading_max2.554024904051201
deviation-heading_mean2.554024904051201
deviation-heading_median2.554024904051201
deviation-heading_min2.554024904051201
distance-from-start_max0.5461575079396507
distance-from-start_mean0.5461575079396507
distance-from-start_median0.5461575079396507
distance-from-start_min0.5461575079396507
driven_any_max2.2955250818765167
driven_any_mean2.2955250818765167
driven_any_median2.2955250818765167
driven_any_min2.2955250818765167
driven_lanedir_consec_max0.02729653158692802
driven_lanedir_consec_mean0.02729653158692802
driven_lanedir_consec_min0.02729653158692802
driven_lanedir_max0.03064203922048936
driven_lanedir_mean0.03064203922048936
driven_lanedir_median0.03064203922048936
driven_lanedir_min0.03064203922048936
in-drivable-lane_max7.900000000000015
in-drivable-lane_mean7.900000000000015
in-drivable-lane_min7.900000000000015
per-episodes
details{"4way-000-ego0": {"driven_any": 2.2955250818765167, "survival_time": 11.350000000000026, "driven_lanedir": 0.03064203922048936, "in-drivable-lane": 7.900000000000015, "deviation-heading": 2.554024904051201, "distance-from-start": 0.5461575079396507, "deviation-center-line": 0.3268218383633572, "driven_lanedir_consec": 0.02729653158692802}}
simulation-passed1
survival_time_max11.350000000000026
survival_time_mean11.350000000000026
survival_time_min11.350000000000026
No reset possible
12120713Bea Baselines 🐤template-randomaido-LFVI-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12116714Bea Baselines 🐤template-randomaido-LFI-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12115716Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12108732Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:13:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median1.5117008645384518


other stats
deviation-center-line_max2.9467867370001506
deviation-center-line_mean1.5769805699952473
deviation-center-line_min0.33773381390393437
deviation-heading_max32.249113233675025
deviation-heading_mean22.83949643715976
deviation-heading_median22.59726568012299
deviation-heading_min13.914341154718024
distance-from-start_max3.1401849173675503e-16
distance-from-start_mean1.4056797676537055e-16
distance-from-start_median1.2412670766236366e-16
distance-from-start_min0.0
driven_any_max3.7682219008410875e-13
driven_any_mean1.6868157211844408e-13
driven_any_median1.4895204919483376e-13
driven_any_min0.0
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 0.0, "deviation-center-line": 0.8948988630736971, "driven_lanedir_consec": 0.0}, "loop-000-ego1": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 2.1285028660032066, "driven_lanedir_consec": 0.0}, "loop-000-ego2": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 14.481564596168328, "distance-from-start": 0.0, "deviation-center-line": 2.9467867370001506, "driven_lanedir_consec": 0.0}, "loop-000-ego3": {"driven_any": 3.7682219008410875e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 13.914341154718024, "distance-from-start": 3.1401849173675503e-16, "deviation-center-line": 0.33773381390393437, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12105733Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-validationsim-0of4successnodavinci-stage-04-6.2.500:05:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median-0.000286102294921875
deviation-center-line_median0.8948943425962731


other stats
deviation-center-line_max0.8948943425962731
deviation-center-line_mean0.8948943425962731
deviation-center-line_min0.8948943425962731
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max1.1102230246251563e-16
distance-from-start_mean1.1102230246251563e-16
distance-from-start_median1.1102230246251563e-16
distance-from-start_min1.1102230246251563e-16
driven_any_max1.3322676295501878e-13
driven_any_mean1.3322676295501878e-13
driven_any_median1.3322676295501878e-13
driven_any_min1.3322676295501878e-13
driven_lanedir_consec_max-0.000286102294921875
driven_lanedir_consec_mean-0.000286102294921875
driven_lanedir_consec_min-0.000286102294921875
driven_lanedir_max-0.000286102294921875
driven_lanedir_mean-0.000286102294921875
driven_lanedir_median-0.000286102294921875
driven_lanedir_min-0.000286102294921875
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": -0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 0.8948943425962731, "driven_lanedir_consec": -0.000286102294921875}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12102735Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-validationsim-3of4successnodavinci-stage-04-6.2.500:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12098736Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:02:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12093737Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-validationsim-0of4successnodavinci-stage-04-6.2.500:04:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.000286102294921875
survival_time_median59.99999999999873
deviation-center-line_median0.8949116056299469
in-drivable-lane_median0.0


other stats
deviation-center-line_max0.8949116056299469
deviation-center-line_mean0.8949116056299469
deviation-center-line_min0.8949116056299469
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max2.576064361825558e-16
distance-from-start_mean2.576064361825558e-16
distance-from-start_median2.576064361825558e-16
distance-from-start_min2.576064361825558e-16
driven_any_max3.0912772341906697e-13
driven_any_mean3.0912772341906697e-13
driven_any_median3.0912772341906697e-13
driven_any_min3.0912772341906697e-13
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean0.000286102294921875
driven_lanedir_consec_min0.000286102294921875
driven_lanedir_max0.000286102294921875
driven_lanedir_mean0.000286102294921875
driven_lanedir_median0.000286102294921875
driven_lanedir_min0.000286102294921875
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.0912772341906697e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.576064361825558e-16, "deviation-center-line": 0.8949116056299469, "driven_lanedir_consec": 0.000286102294921875}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12092737Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-validationsim-1of4successnodavinci-stage-04-6.2.500:05:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median0.8949084199908882
in-drivable-lane_median0.0


other stats
deviation-center-line_max0.8949084199908882
deviation-center-line_mean0.8949084199908882
deviation-center-line_min0.8949084199908882
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max5.551115123125783e-17
distance-from-start_mean5.551115123125783e-17
distance-from-start_median5.551115123125783e-17
distance-from-start_min5.551115123125783e-17
driven_any_max6.661338147750939e-14
driven_any_mean6.661338147750939e-14
driven_any_median6.661338147750939e-14
driven_any_min6.661338147750939e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 6.661338147750939e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.8949084199908882, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12090738Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-validationsim-2of4successnodavinci-stage-04-6.2.500:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12083739Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-testingsim-1of4successnodavinci-stage-04-6.2.500:13:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median1.5844880209937626


other stats
deviation-center-line_max3.468400757620591
deviation-center-line_mean1.715124244963702
deviation-center-line_min0.22312018024669147
deviation-heading_max40.967332753486225
deviation-heading_mean25.437951450471505
deviation-heading_median28.06618021079834
deviation-heading_min4.652112626803105
distance-from-start_max4.965068306494546e-16
distance-from-start_mean3.0415125785996837e-16
distance-from-start_median3.4617131258739496e-16
distance-from-start_min2.7755575615628914e-17
driven_any_max5.95808196779335e-13
driven_any_mean3.649815094319581e-13
driven_any_median4.154055751048713e-13
driven_any_min3.3306690738754696e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.406513421257873, "driven_lanedir_consec": 0.0}, "loop-000-ego1": {"driven_any": 3.3306690738754696e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005157, "distance-from-start": 2.7755575615628914e-17, "deviation-center-line": 3.468400757620591, "driven_lanedir_consec": 0.0}, "loop-000-ego2": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 4.652112626803105, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.22312018024669147, "driven_lanedir_consec": 0.0}, "loop-000-ego3": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 2.7624626207296523, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12080740Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-testingsim-0of4successnodavinci-stage-04-6.2.500:06:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.40649934386321146


other stats
deviation-center-line_max0.40649934386321146
deviation-center-line_mean0.40649934386321146
deviation-center-line_min0.40649934386321146
deviation-heading_max40.967332753486225
deviation-heading_mean40.967332753486225
deviation-heading_median40.967332753486225
deviation-heading_min40.967332753486225
distance-from-start_max0.0
distance-from-start_mean0.0
distance-from-start_median0.0
distance-from-start_min0.0
driven_any_max0.0
driven_any_mean0.0
driven_any_median0.0
driven_any_min0.0
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 0.0, "deviation-center-line": 0.40649934386321146, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12071742Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-testingsim-0of4successnodavinci-stage-04-6.2.500:10:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.4065134212579011


other stats
deviation-center-line_max0.4065134212579011
deviation-center-line_mean0.4065134212579011
deviation-center-line_min0.4065134212579011
deviation-heading_max40.967332753486225
deviation-heading_mean40.967332753486225
deviation-heading_median40.967332753486225
deviation-heading_min40.967332753486225
distance-from-start_max4.965068306494546e-16
distance-from-start_mean4.965068306494546e-16
distance-from-start_median4.965068306494546e-16
distance-from-start_min4.965068306494546e-16
driven_any_max5.95808196779335e-13
driven_any_mean5.95808196779335e-13
driven_any_median5.95808196779335e-13
driven_any_min5.95808196779335e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.4065134212579011, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12055745Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-testingsim-2of4successnodavinci-stage-04-6.2.500:05:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median0.4065102356188296
in-drivable-lane_median0.0


other stats
deviation-center-line_max0.4065102356188296
deviation-center-line_mean0.4065102356188296
deviation-center-line_min0.4065102356188296
deviation-heading_max40.967332753486225
deviation-heading_mean40.967332753486225
deviation-heading_median40.967332753486225
deviation-heading_min40.967332753486225
distance-from-start_max7.63278329429795e-17
distance-from-start_mean7.63278329429795e-17
distance-from-start_median7.63278329429795e-17
distance-from-start_min7.63278329429795e-17
driven_any_max9.15933995315754e-14
driven_any_mean9.15933995315754e-14
driven_any_median9.15933995315754e-14
driven_any_min9.15933995315754e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 9.15933995315754e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 7.63278329429795e-17, "deviation-center-line": 0.4065102356188296, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12050745Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-testingsim-3of4successnodavinci-stage-04-6.2.500:06:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.00011186901405224604
survival_time_median59.99999999999873
deviation-center-line_median0.4065202417301896
in-drivable-lane_median0.0


other stats
deviation-center-line_max0.4065202417301896
deviation-center-line_mean0.4065202417301896
deviation-center-line_min0.4065202417301896
deviation-heading_max40.96728891675156
deviation-heading_mean40.96728891675156
deviation-heading_median40.96728891675156
deviation-heading_min40.96728891675156
distance-from-start_max8.881784197001252e-16
distance-from-start_mean8.881784197001252e-16
distance-from-start_median8.881784197001252e-16
distance-from-start_min8.881784197001252e-16
driven_any_max1.0658141036401505e-12
driven_any_mean1.0658141036401505e-12
driven_any_median1.0658141036401505e-12
driven_any_min1.0658141036401505e-12
driven_lanedir_consec_max0.00011186901405224604
driven_lanedir_consec_mean0.00011186901405224604
driven_lanedir_consec_min0.00011186901405224604
driven_lanedir_max0.00011186901405224604
driven_lanedir_mean0.00011186901405224604
driven_lanedir_median0.00011186901405224604
driven_lanedir_min0.00011186901405224604
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.0658141036401505e-12, "survival_time": 59.99999999999873, "driven_lanedir": 0.00011186901405224604, "in-drivable-lane": 0.0, "deviation-heading": 40.96728891675156, "distance-from-start": 8.881784197001252e-16, "deviation-center-line": 0.4065202417301896, "driven_lanedir_consec": 0.00011186901405224604}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible