Evaluator 112

lx22-collision-check-vali

baseline-solution

step1

success

yes

2022-11-24 19:17:10+00:00

2022-11-24 19:18:26+00:00

0:01:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

false_negative_rate	0.0
false_positive_rate	0.0

other stats

nsamples

200

No reset possible

15029

1297

lx22-collision-check-vali

collision-check-exercise

step1

host-error

yes

2022-11-24 16:28:22+00:00

2022-11-24 16:29:05+00:00

0:00:43

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.41/images/create?tag=2022_11_24_17_26_06&fromImage=registry-stage2.duckietown.org%2Fandreacensi%2Faido-submissions

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 93, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 429, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.ImageNotFound: 404 Client Error for http+docker://localhost/v1.41/images/create?tag=2022_11_24_17_26_06&fromImage=registry-stage2.duckietown.org%2Fandreacensi%2Faido-submissions: Not Found ("pull access denied for registry-stage2.duckietown.org/andreacensi/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 112, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  registry-stage2.duckietown.org/andreacensi/aido-submissions@sha256:840e7105f36db90b5d37324bdcab451125a96c2e8b8f5c02658293c659de9b5d  tag  2022_11_24_17_26_06

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 51, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull registry-stage2.duckietown.org/andreacensi/aido-submissions:2022_11_24_17_26_06@sha256:840e7105f36db90b5d37324bdcab451125a96c2e8b8f5c02658293c659de9b5d

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

15002

385

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-3of4

success

2022-11-24 11:07:57+00:00

2022-11-24 11:44:54+00:00

0:36:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	26.09999999999932
driven_lanedir_consec_median	-3.61921181361624
deviation-center-line_median	2.7603188989181167

other stats

deviation-center-line_max	4.704062811546163
deviation-center-line_mean	2.9379707105353807
deviation-center-line_min	1.527182232759125
deviation-heading_max	29.496797479167338
deviation-heading_mean	23.829348943202223
deviation-heading_median	25.03545039526729
deviation-heading_min	15.749697503106978
distance-from-start_max	0.16823574645123707
distance-from-start_mean	0.16628509932038685
distance-from-start_median	0.16631382061504235
distance-from-start_min	0.1642770096002256
driven_any_max	16.101993308643813
driven_any_mean	13.80726924599431
driven_any_median	13.784384952950854
driven_any_min	11.55831376943171
driven_lanedir_consec_max	-2.01804615368927
driven_lanedir_consec_mean	-3.3669049617992353
driven_lanedir_consec_min	-4.211150066275192
driven_lanedir_max	-2.0319180637447154
driven_lanedir_mean	-5.158866309098748
driven_lanedir_median	-5.067874255082766
driven_lanedir_min	-8.467798662484745
in-drivable-lane_max	41.94999999999909
in-drivable-lane_mean	27.349999999999316
in-drivable-lane_min	15.24999999999953
per-episodes	details {"zigzag-000-ego0": {"driven_any": 12.552422562242974, "survival_time": 59.99999999999873, "driven_lanedir": -4.710400505295952, "in-drivable-lane": 23.99999999999951, "deviation-heading": 29.496797479167338, "distance-from-start": 0.1642770096002256, "deviation-center-line": 3.105022299497315, "driven_lanedir_consec": -4.211150066275192}, "zigzag-000-ego1": {"driven_any": 11.55831376943171, "survival_time": 59.99999999999873, "driven_lanedir": -2.0319180637447154, "in-drivable-lane": 41.94999999999909, "deviation-heading": 15.749697503106978, "distance-from-start": 0.16480085009517428, "deviation-center-line": 1.527182232759125, "driven_lanedir_consec": -2.01804615368927}, "zigzag-000-ego2": {"driven_any": 16.101993308643813, "survival_time": 59.99999999999873, "driven_lanedir": -8.467798662484745, "in-drivable-lane": 15.24999999999953, "deviation-heading": 28.462844426961684, "distance-from-start": 0.16823574645123707, "deviation-center-line": 4.704062811546163, "driven_lanedir_consec": -3.8958837743765184}, "zigzag-000-ego3": {"driven_any": 15.016347343658731, "survival_time": 59.99999999999873, "driven_lanedir": -5.425348004869581, "in-drivable-lane": 28.199999999999132, "deviation-heading": 21.608056363572896, "distance-from-start": 0.16782679113491042, "deviation-center-line": 2.4156154983389184, "driven_lanedir_consec": -3.342539852855961}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14994

387

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-3of4

success

2022-11-24 10:47:32+00:00

2022-11-24 11:07:21+00:00

0:19:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	12.349999999999634
driven_lanedir_consec_median	-4.6963749016674985
deviation-center-line_median	5.019796610693272

other stats

deviation-center-line_max	5.019796610693272
deviation-center-line_mean	5.019796610693272
deviation-center-line_min	5.019796610693272
deviation-heading_max	29.909076864722607
deviation-heading_mean	29.909076864722607
deviation-heading_median	29.909076864722607
deviation-heading_min	29.909076864722607
distance-from-start_max	0.30189705966097313
distance-from-start_mean	0.30189705966097313
distance-from-start_median	0.30189705966097313
distance-from-start_min	0.30189705966097313
driven_any_max	13.837575387792084
driven_any_mean	13.837575387792084
driven_any_median	13.837575387792084
driven_any_min	13.837575387792084
driven_lanedir_consec_max	-4.6963749016674985
driven_lanedir_consec_mean	-4.6963749016674985
driven_lanedir_consec_min	-4.6963749016674985
driven_lanedir_max	-7.385548851405549
driven_lanedir_mean	-7.385548851405549
driven_lanedir_median	-7.385548851405549
driven_lanedir_min	-7.385548851405549
in-drivable-lane_max	12.349999999999634
in-drivable-lane_mean	12.349999999999634
in-drivable-lane_min	12.349999999999634
per-episodes	details {"zigzag-000-ego0": {"driven_any": 13.837575387792084, "survival_time": 59.99999999999873, "driven_lanedir": -7.385548851405549, "in-drivable-lane": 12.349999999999634, "deviation-heading": 29.909076864722607, "distance-from-start": 0.30189705966097313, "deviation-center-line": 5.019796610693272, "driven_lanedir_consec": -4.6963749016674985}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14991

389

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-1of4

success

2022-11-24 10:37:04+00:00

2022-11-24 10:47:19+00:00

0:10:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	24.499999999999368
driven_lanedir_consec_median	-3.383351056960308
deviation-center-line_median	2.4835901878294573

other stats

deviation-center-line_max	2.4835901878294573
deviation-center-line_mean	2.4835901878294573
deviation-center-line_min	2.4835901878294573
deviation-heading_max	29.337632938842976
deviation-heading_mean	29.337632938842976
deviation-heading_median	29.337632938842976
deviation-heading_min	29.337632938842976
distance-from-start_max	0.1674518417307787
distance-from-start_mean	0.1674518417307787
distance-from-start_median	0.1674518417307787
distance-from-start_min	0.1674518417307787
driven_any_max	11.838929531706135
driven_any_mean	11.838929531706135
driven_any_median	11.838929531706135
driven_any_min	11.838929531706135
driven_lanedir_consec_max	-3.383351056960308
driven_lanedir_consec_mean	-3.383351056960308
driven_lanedir_consec_min	-3.383351056960308
driven_lanedir_max	-3.412043326334837
driven_lanedir_mean	-3.412043326334837
driven_lanedir_median	-3.412043326334837
driven_lanedir_min	-3.412043326334837
in-drivable-lane_max	24.499999999999368
in-drivable-lane_mean	24.499999999999368
in-drivable-lane_min	24.499999999999368
per-episodes	details {"udem1-000-ego0": {"driven_any": 11.838929531706135, "survival_time": 59.99999999999873, "driven_lanedir": -3.412043326334837, "in-drivable-lane": 24.499999999999368, "deviation-heading": 29.337632938842976, "distance-from-start": 0.1674518417307787, "deviation-center-line": 2.4835901878294573, "driven_lanedir_consec": -3.383351056960308}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14985

390

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-0of4

success

2022-11-24 10:28:05+00:00

2022-11-24 10:36:31+00:00

0:08:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-3.215663788563358
survival_time_median	59.99999999999873
deviation-center-line_median	2.486346915986605
in-drivable-lane_median	24.699999999999346

other stats

deviation-center-line_max	2.486346915986605
deviation-center-line_mean	2.486346915986605
deviation-center-line_min	2.486346915986605
deviation-heading_max	28.79022767221327
deviation-heading_mean	28.79022767221327
deviation-heading_median	28.79022767221327
deviation-heading_min	28.79022767221327
distance-from-start_max	0.16741599192633386
distance-from-start_mean	0.16741599192633386
distance-from-start_median	0.16741599192633386
distance-from-start_min	0.16741599192633386
driven_any_max	11.577392202488658
driven_any_mean	11.577392202488658
driven_any_median	11.577392202488658
driven_any_min	11.577392202488658
driven_lanedir_consec_max	-3.215663788563358
driven_lanedir_consec_mean	-3.215663788563358
driven_lanedir_consec_min	-3.215663788563358
driven_lanedir_max	-3.317616903347154
driven_lanedir_mean	-3.317616903347154
driven_lanedir_median	-3.317616903347154
driven_lanedir_min	-3.317616903347154
in-drivable-lane_max	24.699999999999346
in-drivable-lane_mean	24.699999999999346
in-drivable-lane_min	24.699999999999346
per-episodes	details {"autolab-000-ego0": {"driven_any": 11.577392202488658, "survival_time": 59.99999999999873, "driven_lanedir": -3.317616903347154, "in-drivable-lane": 24.699999999999346, "deviation-heading": 28.79022767221327, "distance-from-start": 0.16741599192633386, "deviation-center-line": 2.486346915986605, "driven_lanedir_consec": -3.215663788563358}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14980

390

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-3of4

success

2022-11-24 10:18:29+00:00

2022-11-24 10:27:36+00:00

0:09:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-4.183491966025468
survival_time_median	59.99999999999873
deviation-center-line_median	1.9179077351206024
in-drivable-lane_median	28.149999999999437

other stats

deviation-center-line_max	1.9179077351206024
deviation-center-line_mean	1.9179077351206024
deviation-center-line_min	1.9179077351206024
deviation-heading_max	27.233436505936567
deviation-heading_mean	27.233436505936567
deviation-heading_median	27.233436505936567
deviation-heading_min	27.233436505936567
distance-from-start_max	0.22399852566414352
distance-from-start_mean	0.22399852566414352
distance-from-start_median	0.22399852566414352
distance-from-start_min	0.22399852566414352
driven_any_max	13.45209404077216
driven_any_mean	13.45209404077216
driven_any_median	13.45209404077216
driven_any_min	13.45209404077216
driven_lanedir_consec_max	-4.183491966025468
driven_lanedir_consec_mean	-4.183491966025468
driven_lanedir_consec_min	-4.183491966025468
driven_lanedir_max	-4.477060466489169
driven_lanedir_mean	-4.477060466489169
driven_lanedir_median	-4.477060466489169
driven_lanedir_min	-4.477060466489169
in-drivable-lane_max	28.149999999999437
in-drivable-lane_mean	28.149999999999437
in-drivable-lane_min	28.149999999999437
per-episodes	details {"zigzag-000-ego0": {"driven_any": 13.45209404077216, "survival_time": 59.99999999999873, "driven_lanedir": -4.477060466489169, "in-drivable-lane": 28.149999999999437, "deviation-heading": 27.233436505936567, "distance-from-start": 0.22399852566414352, "deviation-center-line": 1.9179077351206024, "driven_lanedir_consec": -4.183491966025468}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14979

390

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-1of4

success

2022-11-24 10:11:04+00:00

2022-11-24 10:18:09+00:00

0:07:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-3.165473743819737
survival_time_median	59.99999999999873
deviation-center-line_median	3.0250525283302183
in-drivable-lane_median	24.549999999999425

other stats

deviation-center-line_max	3.0250525283302183
deviation-center-line_mean	3.0250525283302183
deviation-center-line_min	3.0250525283302183
deviation-heading_max	26.789704111798542
deviation-heading_mean	26.789704111798542
deviation-heading_median	26.789704111798542
deviation-heading_min	26.789704111798542
distance-from-start_max	0.2047974490129602
distance-from-start_mean	0.2047974490129602
distance-from-start_median	0.2047974490129602
distance-from-start_min	0.2047974490129602
driven_any_max	11.359407482543144
driven_any_mean	11.359407482543144
driven_any_median	11.359407482543144
driven_any_min	11.359407482543144
driven_lanedir_consec_max	-3.165473743819737
driven_lanedir_consec_mean	-3.165473743819737
driven_lanedir_consec_min	-3.165473743819737
driven_lanedir_max	-3.2075430662617457
driven_lanedir_mean	-3.2075430662617457
driven_lanedir_median	-3.2075430662617457
driven_lanedir_min	-3.2075430662617457
in-drivable-lane_max	24.549999999999425
in-drivable-lane_mean	24.549999999999425
in-drivable-lane_min	24.549999999999425
per-episodes	details {"loop-000-ego0": {"driven_any": 11.359407482543144, "survival_time": 59.99999999999873, "driven_lanedir": -3.2075430662617457, "in-drivable-lane": 24.549999999999425, "deviation-heading": 26.789704111798542, "distance-from-start": 0.2047974490129602, "deviation-center-line": 3.0250525283302183, "driven_lanedir_consec": -3.165473743819737}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14978

391

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-3of4

success

2022-11-24 10:09:31+00:00

2022-11-24 10:10:47+00:00

0:01:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

14975

392

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-2of4

success

2022-11-24 09:56:04+00:00

2022-11-24 10:09:07+00:00

0:13:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	36.024999999999096
driven_lanedir_consec_median	-2.481963171882547
deviation-center-line_median	2.5789137844904677

other stats

deviation-center-line_max	3.1190963262736946
deviation-center-line_mean	2.5789137844904677
deviation-center-line_min	2.038731242707241
deviation-heading_max	21.516739969742115
deviation-heading_mean	20.40292224093229
deviation-heading_median	20.40292224093229
deviation-heading_min	19.289104512122464
distance-from-start_max	0.1653871315413926
distance-from-start_mean	0.1388941146796504
distance-from-start_median	0.1388941146796504
distance-from-start_min	0.11240109781790822
driven_any_max	11.120753937702208
driven_any_mean	10.884936831230998
driven_any_median	10.884936831230998
driven_any_min	10.649119724759789
driven_lanedir_consec_max	-2.4607817946491473
driven_lanedir_consec_mean	-2.481963171882547
driven_lanedir_consec_min	-2.5031445491159463
driven_lanedir_max	-2.4607817946491473
driven_lanedir_mean	-2.481963171882547
driven_lanedir_median	-2.481963171882547
driven_lanedir_min	-2.5031445491159463
in-drivable-lane_max	39.14999999999899
in-drivable-lane_mean	36.024999999999096
in-drivable-lane_min	32.89999999999921
per-episodes	details {"loop2-000-ego0": {"driven_any": 11.120753937702208, "survival_time": 59.99999999999873, "driven_lanedir": -2.5031445491159463, "in-drivable-lane": 39.14999999999899, "deviation-heading": 19.289104512122464, "distance-from-start": 0.1653871315413926, "deviation-center-line": 2.038731242707241, "driven_lanedir_consec": -2.5031445491159463}, "loop2-000-ego1": {"driven_any": 10.649119724759789, "survival_time": 59.99999999999873, "driven_lanedir": -2.4607817946491473, "in-drivable-lane": 32.89999999999921, "deviation-heading": 21.516739969742115, "distance-from-start": 0.11240109781790822, "deviation-center-line": 3.1190963262736946, "driven_lanedir_consec": -2.4607817946491473}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14970

393

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-1of4

success

2022-11-24 09:46:30+00:00

2022-11-24 09:55:39+00:00

0:09:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	28.6999999999994
driven_lanedir_consec_median	-3.851623249230924
deviation-center-line_median	3.156760094575481

other stats

deviation-center-line_max	3.156760094575481
deviation-center-line_mean	3.156760094575481
deviation-center-line_min	3.156760094575481
deviation-heading_max	28.054126786096244
deviation-heading_mean	28.054126786096244
deviation-heading_median	28.054126786096244
deviation-heading_min	28.054126786096244
distance-from-start_max	0.13581969581733608
distance-from-start_mean	0.13581969581733608
distance-from-start_median	0.13581969581733608
distance-from-start_min	0.13581969581733608
driven_any_max	12.38809899564965
driven_any_mean	12.38809899564965
driven_any_median	12.38809899564965
driven_any_min	12.38809899564965
driven_lanedir_consec_max	-3.851623249230924
driven_lanedir_consec_mean	-3.851623249230924
driven_lanedir_consec_min	-3.851623249230924
driven_lanedir_max	-3.851623249230924
driven_lanedir_mean	-3.851623249230924
driven_lanedir_median	-3.851623249230924
driven_lanedir_min	-3.851623249230924
in-drivable-lane_max	28.6999999999994
in-drivable-lane_mean	28.6999999999994
in-drivable-lane_min	28.6999999999994
per-episodes	details {"loop-000-ego0": {"driven_any": 12.38809899564965, "survival_time": 59.99999999999873, "driven_lanedir": -3.851623249230924, "in-drivable-lane": 28.6999999999994, "deviation-heading": 28.054126786096244, "distance-from-start": 0.13581969581733608, "deviation-center-line": 3.156760094575481, "driven_lanedir_consec": -3.851623249230924}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14957

398

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-1of4

success

2022-11-24 09:20:43+00:00

2022-11-24 09:46:06+00:00

0:25:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	12.124999999999904
driven_lanedir_consec_median	-1.594068045607094
deviation-center-line_median	4.4437547764413505

other stats

deviation-center-line_max	7.245870864493539
deviation-center-line_mean	4.786526438570396
deviation-center-line_min	3.012725336905347
deviation-heading_max	49.50139404783318
deviation-heading_mean	32.669551438281054
deviation-heading_median	29.477432259698535
deviation-heading_min	22.22194718589396
distance-from-start_max	0.24112340487810985
distance-from-start_mean	0.16957551731841558
distance-from-start_median	0.16861599604327543
distance-from-start_min	0.09994667230900166
driven_any_max	12.696231889373149
driven_any_mean	6.393706081811876
driven_any_median	6.108277449847329
driven_any_min	0.6620375381796981
driven_lanedir_consec_max	-0.07352276447125394
driven_lanedir_consec_mean	-1.6365495766343217
driven_lanedir_consec_min	-3.284539450851844
driven_lanedir_max	-0.07352276447125394
driven_lanedir_mean	-1.708073011310849
driven_lanedir_median	-1.73711491496015
driven_lanedir_min	-3.284539450851844
in-drivable-lane_max	29.04999999999929
in-drivable-lane_mean	13.562499999999773
in-drivable-lane_min	0.9499999999999966
per-episodes	details {"4way-000-ego0": {"driven_any": 3.718090858850663, "survival_time": 59.99999999999873, "driven_lanedir": -0.9577809854472744, "in-drivable-lane": 5.850000000000035, "deviation-heading": 31.896424416821375, "distance-from-start": 0.15313769029341773, "deviation-center-line": 4.468029328643431, "driven_lanedir_consec": -0.9178905244380228}, "4way-000-ego1": {"driven_any": 0.6620375381796981, "survival_time": 59.99999999999873, "driven_lanedir": -0.07352276447125394, "in-drivable-lane": 0.9499999999999966, "deviation-heading": 49.50139404783318, "distance-from-start": 0.09994667230900166, "deviation-center-line": 7.245870864493539, "driven_lanedir_consec": -0.07352276447125394}, "4way-000-ego2": {"driven_any": 8.498464040843995, "survival_time": 59.99999999999873, "driven_lanedir": -2.5164488444730253, "in-drivable-lane": 18.39999999999977, "deviation-heading": 22.22194718589396, "distance-from-start": 0.24112340487810985, "deviation-center-line": 4.419480224239269, "driven_lanedir_consec": -2.2702455667761656}, "4way-000-ego3": {"driven_any": 12.696231889373149, "survival_time": 59.99999999999873, "driven_lanedir": -3.284539450851844, "in-drivable-lane": 29.04999999999929, "deviation-heading": 27.058440102575695, "distance-from-start": 0.1840943017931331, "deviation-center-line": 3.012725336905347, "driven_lanedir_consec": -3.284539450851844}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14952

515

Bea Baselines 🐤

baseline-behavior-cloning

sim-1of4

failed

2022-11-24 09:19:09+00:00

2022-11-24 09:20:05+00:00

0:00:56

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14946

515

Bea Baselines 🐤

baseline-behavior-cloning

sim-2of4

failed

2022-11-24 09:17:58+00:00

2022-11-24 09:18:52+00:00

0:00:54

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14940

517

Bea Baselines 🐤

baseline-behavior-cloning

sim-3of4

success

2022-11-24 09:15:56+00:00

2022-11-24 09:17:25+00:00

0:01:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

14937

518

Bea Baselines 🐤

baseline-behavior-cloning

sim-1of4

failed

2022-11-24 09:14:23+00:00

2022-11-24 09:15:49+00:00

0:01:26

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14928

520

Bea Baselines 🐤

baseline-behavior-cloning

sim-3of4

success

2022-11-24 09:12:32+00:00

2022-11-24 09:13:46+00:00

0:01:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

14924

521

Bea Baselines 🐤

baseline-behavior-cloning

sim-2of4

failed

2022-11-24 09:10:54+00:00

2022-11-24 09:12:20+00:00

0:01:26

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14920

522

Bea Baselines 🐤

baseline-behavior-cloning

sim-2of4

failed

2022-11-24 09:09:48+00:00

2022-11-24 09:10:47+00:00

0:00:59

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14898

528

Bea Baselines 🐤

baseline-dagger-pytorch

sim-0of4

success

2022-11-24 08:48:45+00:00

2022-11-24 09:09:11+00:00

0:20:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.3499999999999801
driven_lanedir_consec_median	8.474577769830287
deviation-center-line_median	2.762214694320421

other stats

deviation-center-line_max	4.471979376616096
deviation-center-line_mean	3.187751176557747
deviation-center-line_min	2.7545959409740517
deviation-heading_max	23.33457803803622
deviation-heading_mean	15.387308664829538
deviation-heading_median	12.917068646040024
deviation-heading_min	12.380519329201888
distance-from-start_max	4.419471319713456
distance-from-start_mean	3.948061088740584
distance-from-start_median	3.959674895306131
distance-from-start_min	3.4534232446366153
driven_any_max	9.123224409765044
driven_any_mean	8.34600340541545
driven_any_median	8.926485452199124
driven_any_min	6.407818307498511
driven_lanedir_consec_max	8.710728696228234
driven_lanedir_consec_mean	7.8156269493507455
driven_lanedir_consec_min	5.60262356151418
driven_lanedir_max	8.710728696228234
driven_lanedir_mean	7.8156269493507455
driven_lanedir_median	8.474577769830287
driven_lanedir_min	5.60262356151418
in-drivable-lane_max	2.299999999999933
in-drivable-lane_mean	0.7499999999999734
in-drivable-lane_min	0.0
per-episodes	details {"autolab-000-ego0": {"driven_any": 9.123224409765044, "survival_time": 59.99999999999873, "driven_lanedir": 8.702411497773886, "in-drivable-lane": 0.0, "deviation-heading": 13.144662983668583, "distance-from-start": 4.3100314287592365, "deviation-center-line": 2.7545959409740517, "driven_lanedir_consec": 8.702411497773886}, "autolab-000-ego1": {"driven_any": 9.06049360411316, "survival_time": 59.99999999999873, "driven_lanedir": 8.710728696228234, "in-drivable-lane": 0.0, "deviation-heading": 12.380519329201888, "distance-from-start": 3.4534232446366153, "deviation-center-line": 2.764760005961661, "driven_lanedir_consec": 8.710728696228234}, "autolab-000-ego2": {"driven_any": 8.792477300285087, "survival_time": 59.99999999999873, "driven_lanedir": 8.246744041886686, "in-drivable-lane": 0.6999999999999602, "deviation-heading": 12.689474308411466, "distance-from-start": 4.419471319713456, "deviation-center-line": 2.7596693826791805, "driven_lanedir_consec": 8.246744041886686}, "autolab-000-ego3": {"driven_any": 6.407818307498511, "survival_time": 59.99999999999873, "driven_lanedir": 5.60262356151418, "in-drivable-lane": 2.299999999999933, "deviation-heading": 23.33457803803622, "distance-from-start": 3.6093183618530262, "deviation-center-line": 4.471979376616096, "driven_lanedir_consec": 5.60262356151418}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14890

530

Bea Baselines 🐤

baseline-dagger-pytorch

sim-0of4

success

2022-11-24 08:38:49+00:00

2022-11-24 08:48:36+00:00

0:09:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	37.94999999999998
in-drivable-lane_median	0.0
driven_lanedir_consec_median	4.746291943652437
deviation-center-line_median	2.1812929450174297

other stats

deviation-center-line_max	2.1812929450174297
deviation-center-line_mean	2.1812929450174297
deviation-center-line_min	2.1812929450174297
deviation-heading_max	8.21813390403306
deviation-heading_mean	8.21813390403306
deviation-heading_median	8.21813390403306
deviation-heading_min	8.21813390403306
distance-from-start_max	3.282636303154616
distance-from-start_mean	3.282636303154616
distance-from-start_median	3.282636303154616
distance-from-start_min	3.282636303154616
driven_any_max	4.931737717270076
driven_any_mean	4.931737717270076
driven_any_median	4.931737717270076
driven_any_min	4.931737717270076
driven_lanedir_consec_max	4.746291943652437
driven_lanedir_consec_mean	4.746291943652437
driven_lanedir_consec_min	4.746291943652437
driven_lanedir_max	4.746291943652437
driven_lanedir_mean	4.746291943652437
driven_lanedir_median	4.746291943652437
driven_lanedir_min	4.746291943652437
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"autolab-000-ego0": {"driven_any": 4.931737717270076, "survival_time": 37.94999999999998, "driven_lanedir": 4.746291943652437, "in-drivable-lane": 0.0, "deviation-heading": 8.21813390403306, "distance-from-start": 3.282636303154616, "deviation-center-line": 2.1812929450174297, "driven_lanedir_consec": 4.746291943652437}}
simulation-passed	1
survival_time_max	37.94999999999998
survival_time_mean	37.94999999999998
survival_time_min	37.94999999999998

No reset possible

14882

532

Bea Baselines 🐤

baseline-dagger-pytorch

sim-1of4

success

2022-11-24 08:31:30+00:00

2022-11-24 08:38:40+00:00

0:07:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	8.607800027124856
deviation-center-line_median	2.5221132092223844

other stats

deviation-center-line_max	2.5221132092223844
deviation-center-line_mean	2.5221132092223844
deviation-center-line_min	2.5221132092223844
deviation-heading_max	12.349556965446189
deviation-heading_mean	12.349556965446189
deviation-heading_median	12.349556965446189
deviation-heading_min	12.349556965446189
distance-from-start_max	3.445964557589181
distance-from-start_mean	3.445964557589181
distance-from-start_median	3.445964557589181
distance-from-start_min	3.445964557589181
driven_any_max	9.859417876571
driven_any_mean	9.859417876571
driven_any_median	9.859417876571
driven_any_min	9.859417876571
driven_lanedir_consec_max	8.607800027124856
driven_lanedir_consec_mean	8.607800027124856
driven_lanedir_consec_min	8.607800027124856
driven_lanedir_max	9.442491397249771
driven_lanedir_mean	9.442491397249771
driven_lanedir_median	9.442491397249771
driven_lanedir_min	9.442491397249771
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"udem1-000-ego0": {"driven_any": 9.859417876571, "survival_time": 59.99999999999873, "driven_lanedir": 9.442491397249771, "in-drivable-lane": 0.0, "deviation-heading": 12.349556965446189, "distance-from-start": 3.445964557589181, "deviation-center-line": 2.5221132092223844, "driven_lanedir_consec": 8.607800027124856}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14879

533

Bea Baselines 🐤

baseline-dagger-pytorch

sim-2of4

success

2022-11-24 08:28:17+00:00

2022-11-24 08:31:02+00:00

0:02:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.1504059881829596
survival_time_median	15.400000000000084
deviation-center-line_median	0.5705563903177135
in-drivable-lane_median	6.600000000000088

other stats

deviation-center-line_max	0.5705563903177135
deviation-center-line_mean	0.5705563903177135
deviation-center-line_min	0.5705563903177135
deviation-heading_max	4.346846813146984
deviation-heading_mean	4.346846813146984
deviation-heading_median	4.346846813146984
deviation-heading_min	4.346846813146984
distance-from-start_max	1.4688825276529938
distance-from-start_mean	1.4688825276529938
distance-from-start_median	1.4688825276529938
distance-from-start_min	1.4688825276529938
driven_any_max	2.6693840737492036
driven_any_mean	2.6693840737492036
driven_any_median	2.6693840737492036
driven_any_min	2.6693840737492036
driven_lanedir_consec_max	1.1504059881829596
driven_lanedir_consec_mean	1.1504059881829596
driven_lanedir_consec_min	1.1504059881829596
driven_lanedir_max	1.1504059881829596
driven_lanedir_mean	1.1504059881829596
driven_lanedir_median	1.1504059881829596
driven_lanedir_min	1.1504059881829596
in-drivable-lane_max	6.600000000000088
in-drivable-lane_mean	6.600000000000088
in-drivable-lane_min	6.600000000000088
per-episodes	details {"loop2-000-ego0": {"driven_any": 2.6693840737492036, "survival_time": 15.400000000000084, "driven_lanedir": 1.1504059881829596, "in-drivable-lane": 6.600000000000088, "deviation-heading": 4.346846813146984, "distance-from-start": 1.4688825276529938, "deviation-center-line": 0.5705563903177135, "driven_lanedir_consec": 1.1504059881829596}}
simulation-passed	1
survival_time_max	15.400000000000084
survival_time_mean	15.400000000000084
survival_time_min	15.400000000000084

No reset possible

14877

533

Bea Baselines 🐤

baseline-dagger-pytorch

sim-1of4

success

2022-11-24 08:20:55+00:00

2022-11-24 08:27:56+00:00

0:07:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	8.86488887030895
survival_time_median	59.99999999999873
deviation-center-line_median	3.1770232828200857
in-drivable-lane_median	3.199999999999914

other stats

deviation-center-line_max	3.1770232828200857
deviation-center-line_mean	3.1770232828200857
deviation-center-line_min	3.1770232828200857
deviation-heading_max	18.334180445435937
deviation-heading_mean	18.334180445435937
deviation-heading_median	18.334180445435937
deviation-heading_min	18.334180445435937
distance-from-start_max	2.7781474101348156
distance-from-start_mean	2.7781474101348156
distance-from-start_median	2.7781474101348156
distance-from-start_min	2.7781474101348156
driven_any_max	10.335488498943898
driven_any_mean	10.335488498943898
driven_any_median	10.335488498943898
driven_any_min	10.335488498943898
driven_lanedir_consec_max	8.86488887030895
driven_lanedir_consec_mean	8.86488887030895
driven_lanedir_consec_min	8.86488887030895
driven_lanedir_max	8.86488887030895
driven_lanedir_mean	8.86488887030895
driven_lanedir_median	8.86488887030895
driven_lanedir_min	8.86488887030895
in-drivable-lane_max	3.199999999999914
in-drivable-lane_mean	3.199999999999914
in-drivable-lane_min	3.199999999999914
per-episodes	details {"loop-000-ego0": {"driven_any": 10.335488498943898, "survival_time": 59.99999999999873, "driven_lanedir": 8.86488887030895, "in-drivable-lane": 3.199999999999914, "deviation-heading": 18.334180445435937, "distance-from-start": 2.7781474101348156, "deviation-center-line": 3.1770232828200857, "driven_lanedir_consec": 8.86488887030895}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14868

535

Bea Baselines 🐤

baseline-dagger-pytorch

sim-2of4

success

2022-11-24 08:11:07+00:00

2022-11-24 08:20:28+00:00

0:09:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	10.7513459452614
deviation-center-line_median	3.2690721811168615

other stats

deviation-center-line_max	3.414451234978837
deviation-center-line_mean	3.2690721811168615
deviation-center-line_min	3.1236931272548856
deviation-heading_max	13.297757424785477
deviation-heading_mean	13.159291083802795
deviation-heading_median	13.159291083802795
deviation-heading_min	13.020824742820114
distance-from-start_max	1.064644838954249
distance-from-start_mean	1.0604739241110144
distance-from-start_median	1.0604739241110144
distance-from-start_min	1.0563030092677794
driven_any_max	11.286079748612858
driven_any_mean	11.140285079797444
driven_any_median	11.140285079797444
driven_any_min	10.99449041098203
driven_lanedir_consec_max	10.883119967001583
driven_lanedir_consec_mean	10.7513459452614
driven_lanedir_consec_min	10.619571923521212
driven_lanedir_max	10.883119967001583
driven_lanedir_mean	10.7513459452614
driven_lanedir_median	10.7513459452614
driven_lanedir_min	10.619571923521212
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop2-000-ego0": {"driven_any": 10.99449041098203, "survival_time": 59.99999999999873, "driven_lanedir": 10.619571923521212, "in-drivable-lane": 0.0, "deviation-heading": 13.020824742820114, "distance-from-start": 1.064644838954249, "deviation-center-line": 3.1236931272548856, "driven_lanedir_consec": 10.619571923521212}, "loop2-000-ego1": {"driven_any": 11.286079748612858, "survival_time": 59.99999999999873, "driven_lanedir": 10.883119967001583, "in-drivable-lane": 0.0, "deviation-heading": 13.297757424785477, "distance-from-start": 1.0563030092677794, "deviation-center-line": 3.414451234978837, "driven_lanedir_consec": 10.883119967001583}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14865

537

Bea Baselines 🐤

baseline-dagger-pytorch

sim-2of4

success

2022-11-24 08:03:01+00:00

2022-11-24 08:10:45+00:00

0:07:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	3.0500000000000043
driven_lanedir_consec_median	9.874993969816575
deviation-center-line_median	3.942127802367956

other stats

deviation-center-line_max	3.942127802367956
deviation-center-line_mean	3.942127802367956
deviation-center-line_min	3.942127802367956
deviation-heading_max	19.642143563958925
deviation-heading_mean	19.642143563958925
deviation-heading_median	19.642143563958925
deviation-heading_min	19.642143563958925
distance-from-start_max	1.597190847178524
distance-from-start_mean	1.597190847178524
distance-from-start_median	1.597190847178524
distance-from-start_min	1.597190847178524
driven_any_max	11.491546204631732
driven_any_mean	11.491546204631732
driven_any_median	11.491546204631732
driven_any_min	11.491546204631732
driven_lanedir_consec_max	9.874993969816575
driven_lanedir_consec_mean	9.874993969816575
driven_lanedir_consec_min	9.874993969816575
driven_lanedir_max	9.874993969816575
driven_lanedir_mean	9.874993969816575
driven_lanedir_median	9.874993969816575
driven_lanedir_min	9.874993969816575
in-drivable-lane_max	3.0500000000000043
in-drivable-lane_mean	3.0500000000000043
in-drivable-lane_min	3.0500000000000043
per-episodes	details {"loop2-000-ego0": {"driven_any": 11.491546204631732, "survival_time": 59.99999999999873, "driven_lanedir": 9.874993969816575, "in-drivable-lane": 3.0500000000000043, "deviation-heading": 19.642143563958925, "distance-from-start": 1.597190847178524, "deviation-center-line": 3.942127802367956, "driven_lanedir_consec": 9.874993969816575}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14856

538

Bea Baselines 🐤

baseline-dagger-pytorch

sim-0of4

success

2022-11-24 07:53:45+00:00

2022-11-24 08:02:46+00:00

0:09:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	37.7
in-drivable-lane_median	0.4500000000000064
driven_lanedir_consec_median	5.704463088580428
deviation-center-line_median	1.6224061667640597

other stats

deviation-center-line_max	1.6224061667640597
deviation-center-line_mean	1.6224061667640597
deviation-center-line_min	1.6224061667640597
deviation-heading_max	7.542201942590517
deviation-heading_mean	7.542201942590517
deviation-heading_median	7.542201942590517
deviation-heading_min	7.542201942590517
distance-from-start_max	3.456194281585529
distance-from-start_mean	3.456194281585529
distance-from-start_median	3.456194281585529
distance-from-start_min	3.456194281585529
driven_any_max	6.127259321076953
driven_any_mean	6.127259321076953
driven_any_median	6.127259321076953
driven_any_min	6.127259321076953
driven_lanedir_consec_max	5.704463088580428
driven_lanedir_consec_mean	5.704463088580428
driven_lanedir_consec_min	5.704463088580428
driven_lanedir_max	5.7700002833910915
driven_lanedir_mean	5.7700002833910915
driven_lanedir_median	5.7700002833910915
driven_lanedir_min	5.7700002833910915
in-drivable-lane_max	0.4500000000000064
in-drivable-lane_mean	0.4500000000000064
in-drivable-lane_min	0.4500000000000064
per-episodes	details {"udem-000-ego0": {"driven_any": 6.127259321076953, "survival_time": 37.7, "driven_lanedir": 5.7700002833910915, "in-drivable-lane": 0.4500000000000064, "deviation-heading": 7.542201942590517, "distance-from-start": 3.456194281585529, "deviation-center-line": 1.6224061667640597, "driven_lanedir_consec": 5.704463088580428}}
simulation-passed	1
survival_time_max	37.7
survival_time_mean	37.7
survival_time_min	37.7

No reset possible

14854

539

Bea Baselines 🐤

baseline-dagger-pytorch

sim-2of4

success

2022-11-24 07:51:16+00:00

2022-11-24 07:53:10+00:00

0:01:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

14850

541

Bea Baselines 🐤

baseline-dagger-pytorch

sim-0of4

success

2022-11-24 07:44:56+00:00

2022-11-24 07:50:56+00:00

0:06:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	8.983041488067531
survival_time_median	59.99999999999873
deviation-center-line_median	2.653068478325882
in-drivable-lane_median	1.3999999999999204

other stats

deviation-center-line_max	2.653068478325882
deviation-center-line_mean	2.653068478325882
deviation-center-line_min	2.653068478325882
deviation-heading_max	12.42097402251533
deviation-heading_mean	12.42097402251533
deviation-heading_median	12.42097402251533
deviation-heading_min	12.42097402251533
distance-from-start_max	2.9238105931304763
distance-from-start_mean	2.9238105931304763
distance-from-start_median	2.9238105931304763
distance-from-start_min	2.9238105931304763
driven_any_max	9.588122778640043
driven_any_mean	9.588122778640043
driven_any_median	9.588122778640043
driven_any_min	9.588122778640043
driven_lanedir_consec_max	8.983041488067531
driven_lanedir_consec_mean	8.983041488067531
driven_lanedir_consec_min	8.983041488067531
driven_lanedir_max	8.983041488067531
driven_lanedir_mean	8.983041488067531
driven_lanedir_median	8.983041488067531
driven_lanedir_min	8.983041488067531
in-drivable-lane_max	1.3999999999999204
in-drivable-lane_mean	1.3999999999999204
in-drivable-lane_min	1.3999999999999204
per-episodes	details {"autolab-000-ego0": {"driven_any": 9.588122778640043, "survival_time": 59.99999999999873, "driven_lanedir": 8.983041488067531, "in-drivable-lane": 1.3999999999999204, "deviation-heading": 12.42097402251533, "distance-from-start": 2.9238105931304763, "deviation-center-line": 2.653068478325882, "driven_lanedir_consec": 8.983041488067531}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14845

542

Bea Baselines 🐤

baseline-dagger-pytorch

sim-3of4

success

2022-11-24 07:43:34+00:00

2022-11-24 07:44:50+00:00

0:01:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

14840

595

baseline-duckietown

sim-1of4

failed

2022-11-24 07:42:16+00:00

2022-11-24 07:43:13+00:00

0:00:57

The container "solut [...]

The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14838

600

template-tensorflow

sim-0of4

failed

2022-11-24 07:40:55+00:00

2022-11-24 07:41:50+00:00

0:00:55

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14833

617

Bea Baselines 🐤

challenge-aido_LF-template-ros:daffy-staging:e107400fd98b91bb7c02b7b24d7be5f5d7623035

sanity-check

success

2022-11-24 07:39:34+00:00

2022-11-24 07:40:42+00:00

0:01:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	0.49999999999999994
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.054401202397647674
deviation-center-line_median	0.006791193722481005

other stats

deviation-center-line_max	0.006791193722481005
deviation-center-line_mean	0.006791193722481005
deviation-center-line_min	0.006791193722481005
deviation-heading_max	0.2671247482247391
deviation-heading_mean	0.2671247482247391
deviation-heading_median	0.2671247482247391
deviation-heading_min	0.2671247482247391
distance-from-start_max	0.06274247284978003
distance-from-start_mean	0.06274247284978003
distance-from-start_median	0.06274247284978003
distance-from-start_min	0.06274247284978003
driven_any_max	0.06276475647462507
driven_any_mean	0.06276475647462507
driven_any_median	0.06276475647462507
driven_any_min	0.06276475647462507
driven_lanedir_consec_max	0.054401202397647674
driven_lanedir_consec_mean	0.054401202397647674
driven_lanedir_consec_min	0.054401202397647674
driven_lanedir_max	0.054401202397647674
driven_lanedir_mean	0.054401202397647674
driven_lanedir_median	0.054401202397647674
driven_lanedir_min	0.054401202397647674
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"scenarios-ego0": {"driven_any": 0.06276475647462507, "survival_time": 0.49999999999999994, "driven_lanedir": 0.054401202397647674, "in-drivable-lane": 0.0, "deviation-heading": 0.2671247482247391, "distance-from-start": 0.06274247284978003, "deviation-center-line": 0.006791193722481005, "driven_lanedir_consec": 0.054401202397647674}}
simulation-passed	1
survival_time_max	0.49999999999999994
survival_time_mean	0.49999999999999994
survival_time_min	0.49999999999999994

No reset possible

14828

768

Bea Baselines 🐤

challenge-aido_LF-baseline-RPL-ros:daffy-staging:e625ad6e3d7dcafd3e31a42aa57e3ac0e2ccc484

sanity-check

success

2022-11-24 07:37:35+00:00

2022-11-24 07:39:00+00:00

0:01:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	0.49999999999999994
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.009247376210578915
deviation-center-line_median	0.007002301927932246

other stats

deviation-center-line_max	0.007002301927932246
deviation-center-line_mean	0.007002301927932246
deviation-center-line_min	0.007002301927932246
deviation-heading_max	0.2641542029951474
deviation-heading_mean	0.2641542029951474
deviation-heading_median	0.2641542029951474
deviation-heading_min	0.2641542029951474
distance-from-start_max	0.010493437380525389
distance-from-start_mean	0.010493437380525389
distance-from-start_median	0.010493437380525389
distance-from-start_min	0.010493437380525389
driven_any_max	0.01049672469455408
driven_any_mean	0.01049672469455408
driven_any_median	0.01049672469455408
driven_any_min	0.01049672469455408
driven_lanedir_consec_max	0.009247376210578915
driven_lanedir_consec_mean	0.009247376210578915
driven_lanedir_consec_min	0.009247376210578915
driven_lanedir_max	0.009247376210578915
driven_lanedir_mean	0.009247376210578915
driven_lanedir_median	0.009247376210578915
driven_lanedir_min	0.009247376210578915
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"scenarios-ego0": {"driven_any": 0.01049672469455408, "survival_time": 0.49999999999999994, "driven_lanedir": 0.009247376210578915, "in-drivable-lane": 0.0, "deviation-heading": 0.2641542029951474, "distance-from-start": 0.010493437380525389, "deviation-center-line": 0.007002301927932246, "driven_lanedir_consec": 0.009247376210578915}}
simulation-passed	1
survival_time_max	0.49999999999999994
survival_time_mean	0.49999999999999994
survival_time_min	0.49999999999999994

No reset possible

14824

797

Bea Baselines 🐤

challenge-aido_LF-template-ros:daffy-staging:9c5ebcaaac3c2c24fe955f2dfc9f86ef7741bb3d

sanity-check

success

2022-11-24 07:36:07+00:00

2022-11-24 07:37:21+00:00

0:01:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	0.49999999999999994
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.04960542402860324
deviation-center-line_median	0.006672489466205272

other stats

deviation-center-line_max	0.006672489466205272
deviation-center-line_mean	0.006672489466205272
deviation-center-line_min	0.006672489466205272
deviation-heading_max	0.2772102978028701
deviation-heading_mean	0.2772102978028701
deviation-heading_median	0.2772102978028701
deviation-heading_min	0.2772102978028701
distance-from-start_max	0.05922077030526593
distance-from-start_mean	0.05922077030526593
distance-from-start_median	0.05922077030526593
distance-from-start_min	0.05922077030526593
driven_any_max	0.05923802925647079
driven_any_mean	0.05923802925647079
driven_any_median	0.05923802925647079
driven_any_min	0.05923802925647079
driven_lanedir_consec_max	0.04960542402860324
driven_lanedir_consec_mean	0.04960542402860324
driven_lanedir_consec_min	0.04960542402860324
driven_lanedir_max	0.04960542402860324
driven_lanedir_mean	0.04960542402860324
driven_lanedir_median	0.04960542402860324
driven_lanedir_min	0.04960542402860324
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"scenarios-ego0": {"driven_any": 0.05923802925647079, "survival_time": 0.49999999999999994, "driven_lanedir": 0.04960542402860324, "in-drivable-lane": 0.0, "deviation-heading": 0.2772102978028701, "distance-from-start": 0.05922077030526593, "deviation-center-line": 0.006672489466205272, "driven_lanedir_consec": 0.04960542402860324}}
simulation-passed	1
survival_time_max	0.49999999999999994
survival_time_mean	0.49999999999999994
survival_time_min	0.49999999999999994

No reset possible

14819

801

template-tensorflow

sim-1of4

failed

2022-11-24 07:34:35+00:00

2022-11-24 07:35:33+00:00

0:00:58

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14816

801

template-tensorflow

sim-2of4

failed

2022-11-24 07:33:17+00:00

2022-11-24 07:34:14+00:00

0:00:57

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14813

804

Bea Baselines 🐤

challenge-aido_LF-template-ros:daffy-staging:3d125842a05be049b6ee6fe0059908c18c57ebb2

sanity-check

success

2022-11-24 07:31:36+00:00

2022-11-24 07:32:46+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	0.49999999999999994
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.045965089579490526
deviation-center-line_median	0.005544606744480212

other stats

deviation-center-line_max	0.005544606744480212
deviation-center-line_mean	0.005544606744480212
deviation-center-line_min	0.005544606744480212
deviation-heading_max	0.23899147193753123
deviation-heading_mean	0.23899147193753123
deviation-heading_median	0.23899147193753123
deviation-heading_min	0.23899147193753123
distance-from-start_max	0.05010378325377641
distance-from-start_mean	0.05010378325377641
distance-from-start_median	0.05010378325377641
distance-from-start_min	0.05010378325377641
driven_any_max	0.05019112334761222
driven_any_mean	0.05019112334761222
driven_any_median	0.05019112334761222
driven_any_min	0.05019112334761222
driven_lanedir_consec_max	0.045965089579490526
driven_lanedir_consec_mean	0.045965089579490526
driven_lanedir_consec_min	0.045965089579490526
driven_lanedir_max	0.045965089579490526
driven_lanedir_mean	0.045965089579490526
driven_lanedir_median	0.045965089579490526
driven_lanedir_min	0.045965089579490526
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"scenarios-ego0": {"driven_any": 0.05019112334761222, "survival_time": 0.49999999999999994, "driven_lanedir": 0.045965089579490526, "in-drivable-lane": 0.0, "deviation-heading": 0.23899147193753123, "distance-from-start": 0.05010378325377641, "deviation-center-line": 0.005544606744480212, "driven_lanedir_consec": 0.045965089579490526}}
simulation-passed	1
survival_time_max	0.49999999999999994
survival_time_mean	0.49999999999999994
survival_time_min	0.49999999999999994

No reset possible

14810

806

user1000001

minimal-agent

sim-3of4

success

2022-11-24 07:27:56+00:00

2022-11-24 07:31:10+00:00

0:03:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	7.099999999999983
in-drivable-lane_median	5.649999999999983
driven_lanedir_consec_median	0.1397956002040246
deviation-center-line_median	0.09390664341773942

other stats

deviation-center-line_max	0.09390664341773942
deviation-center-line_mean	0.09390664341773942
deviation-center-line_min	0.09390664341773942
deviation-heading_max	0.9654183287874442
deviation-heading_mean	0.9654183287874442
deviation-heading_median	0.9654183287874442
deviation-heading_min	0.9654183287874442
distance-from-start_max	1.0016247187181055
distance-from-start_mean	1.0016247187181055
distance-from-start_median	1.0016247187181055
distance-from-start_min	1.0016247187181055
driven_any_max	1.0016732136326914
driven_any_mean	1.0016732136326914
driven_any_median	1.0016732136326914
driven_any_min	1.0016732136326914
driven_lanedir_consec_max	0.1397956002040246
driven_lanedir_consec_mean	0.1397956002040246
driven_lanedir_consec_min	0.1397956002040246
driven_lanedir_max	0.1397956002040246
driven_lanedir_mean	0.1397956002040246
driven_lanedir_median	0.1397956002040246
driven_lanedir_min	0.1397956002040246
in-drivable-lane_max	5.649999999999983
in-drivable-lane_mean	5.649999999999983
in-drivable-lane_min	5.649999999999983
per-episodes	details {"zigzag-000-ego0": {"driven_any": 1.0016732136326914, "survival_time": 7.099999999999983, "driven_lanedir": 0.1397956002040246, "in-drivable-lane": 5.649999999999983, "deviation-heading": 0.9654183287874442, "distance-from-start": 1.0016247187181055, "deviation-center-line": 0.09390664341773942, "driven_lanedir_consec": 0.1397956002040246}}
simulation-passed	1
survival_time_max	7.099999999999983
survival_time_mean	7.099999999999983
survival_time_min	7.099999999999983

No reset possible

14804

808

template-random

sim-1of4

success

2022-11-24 07:21:08+00:00

2022-11-24 07:27:24+00:00

0:06:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	23.7000000000002
in-drivable-lane_median	14.450000000000168
driven_lanedir_consec_median	0.2737854971621658
deviation-center-line_median	0.899035755764141

other stats

deviation-center-line_max	0.899035755764141
deviation-center-line_mean	0.899035755764141
deviation-center-line_min	0.899035755764141
deviation-heading_max	6.757937307021479
deviation-heading_mean	6.757937307021479
deviation-heading_median	6.757937307021479
deviation-heading_min	6.757937307021479
distance-from-start_max	0.7357883576773867
distance-from-start_mean	0.7357883576773867
distance-from-start_median	0.7357883576773867
distance-from-start_min	0.7357883576773867
driven_any_max	5.6000766802176365
driven_any_mean	5.6000766802176365
driven_any_median	5.6000766802176365
driven_any_min	5.6000766802176365
driven_lanedir_consec_max	0.2737854971621658
driven_lanedir_consec_mean	0.2737854971621658
driven_lanedir_consec_min	0.2737854971621658
driven_lanedir_max	0.2557752979619581
driven_lanedir_mean	0.2557752979619581
driven_lanedir_median	0.2557752979619581
driven_lanedir_min	0.2557752979619581
in-drivable-lane_max	14.450000000000168
in-drivable-lane_mean	14.450000000000168
in-drivable-lane_min	14.450000000000168
per-episodes	details {"loop-000-ego0": {"driven_any": 5.6000766802176365, "survival_time": 23.7000000000002, "driven_lanedir": 0.2557752979619581, "in-drivable-lane": 14.450000000000168, "deviation-heading": 6.757937307021479, "distance-from-start": 0.7357883576773867, "deviation-center-line": 0.899035755764141, "driven_lanedir_consec": 0.2737854971621658}}
simulation-passed	1
survival_time_max	23.7000000000002
survival_time_mean	23.7000000000002
survival_time_min	23.7000000000002

No reset possible

14799

815

Bea Baselines 🐤

baseline-simple-yield

sim-0of4

success

2022-11-24 07:16:18+00:00

2022-11-24 07:20:36+00:00

0:04:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	5.675696836821229
deviation-center-line_median	0.19635223125533263

other stats

deviation-center-line_max	0.19635223125533263
deviation-center-line_mean	0.19635223125533263
deviation-center-line_min	0.19635223125533263
deviation-heading_max	1.81505389113436
deviation-heading_mean	1.81505389113436
deviation-heading_median	1.81505389113436
deviation-heading_min	1.81505389113436
distance-from-start_max	3.5639702148835872
distance-from-start_mean	3.5639702148835872
distance-from-start_median	3.5639702148835872
distance-from-start_min	3.5639702148835872
driven_any_max	5.684198905858687
driven_any_mean	5.684198905858687
driven_any_median	5.684198905858687
driven_any_min	5.684198905858687
driven_lanedir_consec_max	5.675696836821229
driven_lanedir_consec_mean	5.675696836821229
driven_lanedir_consec_min	5.675696836821229
driven_lanedir_max	5.675696836821229
driven_lanedir_mean	5.675696836821229
driven_lanedir_median	5.675696836821229
driven_lanedir_min	5.675696836821229
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"autolab-000-ego0": {"driven_any": 5.684198905858687, "survival_time": 59.99999999999873, "driven_lanedir": 5.675696836821229, "in-drivable-lane": 0.0, "deviation-heading": 1.81505389113436, "distance-from-start": 3.5639702148835872, "deviation-center-line": 0.19635223125533263, "driven_lanedir_consec": 5.675696836821229}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14791

817

Bea Baselines 🐤

baseline-simple-yield

sim-1of4

success

2022-11-24 07:05:34+00:00

2022-11-24 07:15:57+00:00

0:10:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.35641596777958673
deviation-center-line_median	0.5955312146522322

other stats

deviation-center-line_max	2.128491974247639
deviation-center-line_mean	0.9139675952717752
deviation-center-line_min	0.33631597753499803
deviation-heading_max	30.712966764077652
deviation-heading_mean	12.7034688538512
deviation-heading_median	8.860215367203583
deviation-heading_min	2.3804779169199795
distance-from-start_max	2.866773837264375
distance-from-start_mean	0.8802267381267181
distance-from-start_median	0.3270665576212487
distance-from-start_min	2.2887833992611187e-16
driven_any_max	4.95910239753371
driven_any_mean	1.4197330129653098
driven_any_median	0.3599148271636274
driven_any_min	2.746540079113375e-13
driven_lanedir_consec_max	4.9492867887322785
driven_lanedir_consec_mean	1.415529681072863
driven_lanedir_consec_min	0.0
driven_lanedir_max	4.9492867887322785
driven_lanedir_mean	1.415529681072863
driven_lanedir_median	0.35641596777958673
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"udem-000-ego0": {"driven_any": 0.7198296543267219, "survival_time": 59.99999999999873, "driven_lanedir": 0.7128319355591735, "in-drivable-lane": 0.0, "deviation-heading": 3.8060895796891416, "distance-from-start": 0.654133115242497, "deviation-center-line": 0.8533318010395783, "driven_lanedir_consec": 0.7128319355591735}, "udem-000-ego1": {"driven_any": 2.746540079113375e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 2.2887833992611187e-16, "deviation-center-line": 2.128491974247639, "driven_lanedir_consec": 0.0}, "udem-000-ego2": {"driven_any": 4.95910239753371, "survival_time": 59.99999999999873, "driven_lanedir": 4.9492867887322785, "in-drivable-lane": 0.0, "deviation-heading": 2.3804779169199795, "distance-from-start": 2.866773837264375, "deviation-center-line": 0.33631597753499803, "driven_lanedir_consec": 4.9492867887322785}, "udem-000-ego3": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 13.914341154718024, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.33773062826488615, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14786

818

Bea Baselines 🐤

baseline-simple-yield

sim-2of4

success

aido-LFV_multi-state-sim-validation

2022-11-24 06:54:47+00:00

2022-11-24 07:05:26+00:00

0:10:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	6.0817422473064955
deviation-center-line_median	0.25576965235048754

other stats

deviation-center-line_max	0.25576965235048754
deviation-center-line_mean	0.25576965235048754
deviation-center-line_min	0.25576965235048754
deviation-heading_max	1.94582432309865
deviation-heading_mean	1.94582432309865
deviation-heading_median	1.94582432309865
deviation-heading_min	1.94582432309865
distance-from-start_max	2.49941447398169
distance-from-start_mean	2.49941447398169
distance-from-start_median	2.49941447398169
distance-from-start_min	2.49941447398169
driven_any_max	6.0939946438635975
driven_any_mean	6.0939946438635975
driven_any_median	6.0939946438635975
driven_any_min	6.0939946438635975
driven_lanedir_consec_max	6.0817422473064955
driven_lanedir_consec_mean	6.0817422473064955
driven_lanedir_consec_min	6.0817422473064955
driven_lanedir_max	6.081742517685205
driven_lanedir_mean	6.081742517685205
driven_lanedir_median	6.081742517685205
driven_lanedir_min	6.081742517685205
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"4way-000-ego0": {"driven_any": 6.0939946438635975, "survival_time": 59.99999999999873, "driven_lanedir": 6.081742517685205, "in-drivable-lane": 0.0, "deviation-heading": 1.94582432309865, "distance-from-start": 2.49941447398169, "deviation-center-line": 0.25576965235048754, "driven_lanedir_consec": 6.0817422473064955}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14779

819

Bea Baselines 🐤

baseline-simple-yield

454

success

2022-11-24 06:46:12+00:00

2022-11-24 06:54:33+00:00

0:08:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0
deviation-center-line_median	1.2862747030869404

other stats

deviation-center-line_max	2.946761767849859
deviation-center-line_mean	1.4642604505721564
deviation-center-line_min	0.33773062826488615
deviation-heading_max	30.712966764077652
deviation-heading_mean	15.625794127001647
deviation-heading_median	14.197952875443178
deviation-heading_min	3.394303993042581
distance-from-start_max	1.88308872651973
distance-from-start_mean	0.4707721816299328
distance-from-start_median	6.535160765178321e-16
distance-from-start_min	2.2887833992611187e-16
driven_any_max	2.7383405532173355
driven_any_mean	0.6845851383047946
driven_any_median	7.842192918213893e-13
driven_any_min	2.746540079113375e-13
driven_lanedir_consec_max	2.730356436521755
driven_lanedir_consec_mean	0.6825891091304388
driven_lanedir_consec_min	0.0
driven_lanedir_max	2.730356436521755
driven_lanedir_mean	0.6825891091304388
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop-000-ego0": {"driven_any": 2.7383405532173355, "survival_time": 59.99999999999873, "driven_lanedir": 2.730356436521755, "in-drivable-lane": 0.0, "deviation-heading": 3.394303993042581, "distance-from-start": 1.88308872651973, "deviation-center-line": 0.4440574319262342, "driven_lanedir_consec": 2.730356436521755}, "loop-000-ego1": {"driven_any": 2.746540079113375e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 2.2887833992611187e-16, "deviation-center-line": 2.1284919742476465, "driven_lanedir_consec": 0.0}, "loop-000-ego2": {"driven_any": 3.7682219008410875e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 14.481564596168331, "distance-from-start": 3.1401849173675503e-16, "deviation-center-line": 2.946761767849859, "driven_lanedir_consec": 0.0}, "loop-000-ego3": {"driven_any": 1.19161639355867e-12, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 13.914341154718024, "distance-from-start": 9.930136612989092e-16, "deviation-center-line": 0.33773062826488615, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14775

821

Bea Baselines 🐤

baseline-simple-yield

sim-0of4

success

aido-LFI-state-sim-testing

2022-11-24 06:41:53+00:00

2022-11-24 06:46:06+00:00

0:04:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	5.6173794793891885
deviation-center-line_median	0.3790863571459804

other stats

deviation-center-line_max	0.3790863571459804
deviation-center-line_mean	0.3790863571459804
deviation-center-line_min	0.3790863571459804
deviation-heading_max	2.844192295741865
deviation-heading_mean	2.844192295741865
deviation-heading_median	2.844192295741865
deviation-heading_min	2.844192295741865
distance-from-start_max	2.723986924723346
distance-from-start_mean	2.723986924723346
distance-from-start_median	2.723986924723346
distance-from-start_min	2.723986924723346
driven_any_max	5.636243490208466
driven_any_mean	5.636243490208466
driven_any_median	5.636243490208466
driven_any_min	5.636243490208466
driven_lanedir_consec_max	5.6173794793891885
driven_lanedir_consec_mean	5.6173794793891885
driven_lanedir_consec_min	5.6173794793891885
driven_lanedir_max	5.6173794793891885
driven_lanedir_mean	5.6173794793891885
driven_lanedir_median	5.6173794793891885
driven_lanedir_min	5.6173794793891885
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"autolab-000-ego0": {"driven_any": 5.636243490208466, "survival_time": 59.99999999999873, "driven_lanedir": 5.6173794793891885, "in-drivable-lane": 0.0, "deviation-heading": 2.844192295741865, "distance-from-start": 2.723986924723346, "deviation-center-line": 0.3790863571459804, "driven_lanedir_consec": 5.6173794793891885}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14771

822

Bea Baselines 🐤

baseline-simple-yield

sim-3of4

success

2022-11-24 06:39:33+00:00

2022-11-24 06:41:38+00:00

0:02:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

14765

823

Bea Baselines 🐤

baseline-simple-yield

sim-0of4

success

aido-LFVI-state-sim-testing

2022-11-24 06:28:13+00:00

2022-11-24 06:39:13+00:00

0:11:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	5.237107191226386
deviation-center-line_median	0.23759334910349403

other stats

deviation-center-line_max	2.1326977700633005
deviation-center-line_mean	0.6838879528223635
deviation-center-line_min	0.1276673430191657
deviation-heading_max	13.12196147454032
deviation-heading_mean	4.364557637939925
deviation-heading_median	1.584486276774531
deviation-heading_min	1.1672965236703177
distance-from-start_max	3.1342802968590027
distance-from-start_mean	1.8729192379232904
distance-from-start_median	2.1786983274170795
distance-from-start_min	4.440892098500626e-16
driven_any_max	5.758579747198662
driven_any_mean	4.134329883566824
driven_any_median	5.389369893534051
driven_any_min	5.329070518200751e-13
driven_lanedir_consec_max	5.458898880219736
driven_lanedir_consec_mean	3.983314078454992
driven_lanedir_consec_min	0.0001430511474609375
driven_lanedir_max	5.755160319127538
driven_lanedir_mean	4.130829489397701
driven_lanedir_median	5.384007293657903
driven_lanedir_min	0.0001430511474609375
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"udem-001-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "in-drivable-lane": 0.0, "deviation-heading": 13.12196147454032, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 2.1326977700633005, "driven_lanedir_consec": 0.0001430511474609375}, "udem-001-ego1": {"driven_any": 5.250523118831771, "survival_time": 59.99999999999873, "driven_lanedir": 5.244914558422043, "in-drivable-lane": 0.0, "deviation-heading": 1.5492135672194798, "distance-from-start": 2.858024790062626, "deviation-center-line": 0.24799702258050904, "driven_lanedir_consec": 5.244914558422043}, "udem-001-ego2": {"driven_any": 5.758579747198662, "survival_time": 59.99999999999873, "driven_lanedir": 5.755160319127538, "in-drivable-lane": 0.0, "deviation-heading": 1.1672965236703177, "distance-from-start": 3.1342802968590027, "deviation-center-line": 0.1276673430191657, "driven_lanedir_consec": 5.458898880219736}, "udem-001-ego3": {"driven_any": 5.52821666823633, "survival_time": 59.99999999999873, "driven_lanedir": 5.523100028893762, "in-drivable-lane": 0.0, "deviation-heading": 1.6197589863295825, "distance-from-start": 1.4993718647715328, "deviation-center-line": 0.22718967562647904, "driven_lanedir_consec": 5.229299824030728}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14761

824

Bea Baselines 🐤

baseline-simple-yield

sim-0of4

success

aido-LFV-state-sim-validation

2022-11-24 06:17:12+00:00

2022-11-24 06:27:44+00:00

0:10:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	1.2100199545198067
deviation-center-line_median	1.272693831894064

other stats

deviation-center-line_max	1.272693831894064
deviation-center-line_mean	1.272693831894064
deviation-center-line_min	1.272693831894064
deviation-heading_max	5.855606525916092
deviation-heading_mean	5.855606525916092
deviation-heading_median	5.855606525916092
deviation-heading_min	5.855606525916092
distance-from-start_max	1.194075152462886
distance-from-start_mean	1.194075152462886
distance-from-start_median	1.194075152462886
distance-from-start_min	1.194075152462886
driven_any_max	1.2141472555607715
driven_any_mean	1.2141472555607715
driven_any_median	1.2141472555607715
driven_any_min	1.2141472555607715
driven_lanedir_consec_max	1.2100199545198067
driven_lanedir_consec_mean	1.2100199545198067
driven_lanedir_consec_min	1.2100199545198067
driven_lanedir_max	1.2100199545198067
driven_lanedir_mean	1.2100199545198067
driven_lanedir_median	1.2100199545198067
driven_lanedir_min	1.2100199545198067
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"udem-001-ego0": {"driven_any": 1.2141472555607715, "survival_time": 59.99999999999873, "driven_lanedir": 1.2100199545198067, "in-drivable-lane": 0.0, "deviation-heading": 5.855606525916092, "distance-from-start": 1.194075152462886, "deviation-center-line": 1.272693831894064, "driven_lanedir_consec": 1.2100199545198067}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14754

826

Bea Baselines 🐤

baseline-simple-yield

sim-1of4

success

2022-11-24 06:07:23+00:00

2022-11-24 06:16:57+00:00

0:09:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	4.085488757766068
deviation-center-line_median	0.29109357156287574

other stats

deviation-center-line_max	0.29109357156287574
deviation-center-line_mean	0.29109357156287574
deviation-center-line_min	0.29109357156287574
deviation-heading_max	2.2331060010618957
deviation-heading_mean	2.2331060010618957
deviation-heading_median	2.2331060010618957
deviation-heading_min	2.2331060010618957
distance-from-start_max	2.255025037659017
distance-from-start_mean	2.255025037659017
distance-from-start_median	2.255025037659017
distance-from-start_min	2.255025037659017
driven_any_max	4.097561841074084
driven_any_mean	4.097561841074084
driven_any_median	4.097561841074084
driven_any_min	4.097561841074084
driven_lanedir_consec_max	4.085488757766068
driven_lanedir_consec_mean	4.085488757766068
driven_lanedir_consec_min	4.085488757766068
driven_lanedir_max	4.085488757766068
driven_lanedir_mean	4.085488757766068
driven_lanedir_median	4.085488757766068
driven_lanedir_min	4.085488757766068
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop-000-ego0": {"driven_any": 4.097561841074084, "survival_time": 59.99999999999873, "driven_lanedir": 4.085488757766068, "in-drivable-lane": 0.0, "deviation-heading": 2.2331060010618957, "distance-from-start": 2.255025037659017, "deviation-center-line": 0.29109357156287574, "driven_lanedir_consec": 4.085488757766068}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14742

910

Bea Baselines 🐤

baseline-solution

step1-0of4

error

yes

2022-11-24 05:49:46+00:00

2022-11-24 06:06:55+00:00

0:17:09

Waited 1002 seconds [...]

Waited 1002 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14741

910

Bea Baselines 🐤

baseline-solution

step1-1of4

success

yes

2022-11-24 05:48:55+00:00

2022-11-24 05:49:35+00:00

0:00:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

mistakes	0.0
success_ratio	0.0
duration	1000.0
complexity	1000.0
avg_min_distance	0.0

other stats

nfeasible	0
nsamples	0

No reset possible

14740

910

Bea Baselines 🐤

baseline-solution

step1-2of4

success

yes

lx22-planning-cc-dynamic-vali

2022-11-24 05:48:06+00:00

2022-11-24 05:48:48+00:00

0:00:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

mistakes	0.0
success_ratio	0.0
duration	1000.0
complexity	1000.0
avg_min_distance	0.0

other stats

nfeasible	0
nsamples	0

No reset possible

14732

913

Bea Baselines 🐤

baseline-solution

step1-0of4

error

yes

lx22-planning-dd-static-test

2022-11-24 05:30:52+00:00

2022-11-24 05:48:00+00:00

0:17:08

Waited 1006 seconds [...]

Waited 1006 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14721

917

Bea Baselines 🐤

baseline-solution

step1-0of4

error

yes

lx22-planning-cc-dynamic-test

2022-11-24 05:13:26+00:00

2022-11-24 05:30:32+00:00

0:17:06

Waited 1004 seconds [...]

Waited 1004 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14714

919

Bea Baselines 🐤

baseline-solution

step1-0of4

error

yes

lx22-planning-cc-static-test

2022-11-24 04:55:46+00:00

2022-11-24 05:12:54+00:00

0:17:08

Waited 1005 seconds [...]

Waited 1005 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14712

920

Bea Baselines 🐤

baseline-solution

step1-3of4

success

yes

lx22-planning-cc-static-test

2022-11-24 04:54:40+00:00

2022-11-24 04:55:24+00:00

0:00:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

mistakes	0.0
success_ratio	0.0
duration	1000.0
complexity	1000.0
avg_min_distance	0.0

other stats

nfeasible	0
nsamples	0

No reset possible

14710

920

Bea Baselines 🐤

baseline-solution

step1-2of4

success

yes

lx22-collision-check-vali

2022-11-24 04:53:52+00:00

2022-11-24 04:54:33+00:00

0:00:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

mistakes	0.0
success_ratio	0.0
duration	1000.0
complexity	1000.0
avg_min_distance	0.0

other stats

nfeasible	0
nsamples	0

No reset possible

14707

922

Bea Baselines 🐤

baseline-solution

step1

success

yes

2022-11-24 04:52:42+00:00

2022-11-24 04:53:46+00:00

0:01:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

false_negative_rate	0.0
false_positive_rate	0.0

other stats

nsamples

200

No reset possible

14693

961

Bea Baselines 🐤

template-pytorch

sim-0of4

success

2022-11-24 04:34:48+00:00

2022-11-24 04:52:16+00:00

0:17:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	33.44999999999918
driven_lanedir_consec_median	0.7219624986994018
deviation-center-line_median	1.5165626820106823

other stats

deviation-center-line_max	1.5165626820106823
deviation-center-line_mean	1.5165626820106823
deviation-center-line_min	1.5165626820106823
deviation-heading_max	21.144688849998175
deviation-heading_mean	21.144688849998175
deviation-heading_median	21.144688849998175
deviation-heading_min	21.144688849998175
distance-from-start_max	0.23129845569750207
distance-from-start_mean	0.23129845569750207
distance-from-start_median	0.23129845569750207
distance-from-start_min	0.23129845569750207
driven_any_max	2.678240308497647
driven_any_mean	2.678240308497647
driven_any_median	2.678240308497647
driven_any_min	2.678240308497647
driven_lanedir_consec_max	0.7219624986994018
driven_lanedir_consec_mean	0.7219624986994018
driven_lanedir_consec_min	0.7219624986994018
driven_lanedir_max	0.722053333274935
driven_lanedir_mean	0.722053333274935
driven_lanedir_median	0.722053333274935
driven_lanedir_min	0.722053333274935
in-drivable-lane_max	33.44999999999918
in-drivable-lane_mean	33.44999999999918
in-drivable-lane_min	33.44999999999918
per-episodes	details {"udem-000-ego0": {"driven_any": 2.678240308497647, "survival_time": 59.99999999999873, "driven_lanedir": 0.722053333274935, "in-drivable-lane": 33.44999999999918, "deviation-heading": 21.144688849998175, "distance-from-start": 0.23129845569750207, "deviation-center-line": 1.5165626820106823, "driven_lanedir_consec": 0.7219624986994018}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14675

965

Bea Baselines 🐤

template-pytorch

sim-3of4

success

2022-11-24 03:56:26+00:00

2022-11-24 04:34:39+00:00

0:38:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	38.97499999999884
driven_lanedir_consec_median	1.690342244124715
deviation-center-line_median	1.664606920635285

other stats

deviation-center-line_max	2.630727040218961
deviation-center-line_mean	1.751003540707158
deviation-center-line_min	1.0440732813391018
deviation-heading_max	20.95950362140074
deviation-heading_mean	16.147118779900687
deviation-heading_median	15.835125585235726
deviation-heading_min	11.95872032773056
distance-from-start_max	0.9513860915230148
distance-from-start_mean	0.6382664512984817
distance-from-start_median	0.5695015784471906
distance-from-start_min	0.4626765567765304
driven_any_max	10.59752598621342
driven_any_mean	8.892463216262566
driven_any_median	8.658080844918633
driven_any_min	7.656165188999582
driven_lanedir_consec_max	3.497260524966606
driven_lanedir_consec_mean	1.7666539128337333
driven_lanedir_consec_min	0.18867063811889784
driven_lanedir_max	3.497260524966606
driven_lanedir_mean	2.2511100803305006
driven_lanedir_median	2.163082765934421
driven_lanedir_min	1.181014264486555
in-drivable-lane_max	46.04999999999892
in-drivable-lane_mean	38.09999999999894
in-drivable-lane_min	28.399999999999196
per-episodes	details {"zigzag-000-ego0": {"driven_any": 7.656165188999582, "survival_time": 59.99999999999873, "driven_lanedir": 1.349570524736297, "in-drivable-lane": 43.54999999999862, "deviation-heading": 12.919004725391876, "distance-from-start": 0.5847485074901579, "deviation-center-line": 1.0440732813391018, "driven_lanedir_consec": 1.349570524736297}, "zigzag-000-ego1": {"driven_any": 8.162932881555152, "survival_time": 59.99999999999873, "driven_lanedir": 1.181014264486555, "in-drivable-lane": 46.04999999999892, "deviation-heading": 11.95872032773056, "distance-from-start": 0.9513860915230148, "deviation-center-line": 1.3206712966286906, "driven_lanedir_consec": 0.18867063811889784}, "zigzag-000-ego2": {"driven_any": 10.59752598621342, "survival_time": 59.99999999999873, "driven_lanedir": 2.9765950071325444, "in-drivable-lane": 34.39999999999906, "deviation-heading": 18.751246445079573, "distance-from-start": 0.4626765567765304, "deviation-center-line": 2.008542544641879, "driven_lanedir_consec": 2.031113963513133}, "zigzag-000-ego3": {"driven_any": 9.153228808282114, "survival_time": 59.99999999999873, "driven_lanedir": 3.497260524966606, "in-drivable-lane": 28.399999999999196, "deviation-heading": 20.95950362140074, "distance-from-start": 0.5542546494042234, "deviation-center-line": 2.630727040218961, "driven_lanedir_consec": 3.497260524966606}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14661

973

Bea Baselines 🐤

template-pytorch

sim-0of4

success

2022-11-24 03:39:35+00:00

2022-11-24 03:56:19+00:00

0:16:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	30.64999999999937
driven_lanedir_consec_median	2.330265057914278
deviation-center-line_median	2.385072375814705

other stats

deviation-center-line_max	2.385072375814705
deviation-center-line_mean	2.385072375814705
deviation-center-line_min	2.385072375814705
deviation-heading_max	22.645658474661285
deviation-heading_mean	22.645658474661285
deviation-heading_median	22.645658474661285
deviation-heading_min	22.645658474661285
distance-from-start_max	0.3476594947348637
distance-from-start_mean	0.3476594947348637
distance-from-start_median	0.3476594947348637
distance-from-start_min	0.3476594947348637
driven_any_max	7.30662983731504
driven_any_mean	7.30662983731504
driven_any_median	7.30662983731504
driven_any_min	7.30662983731504
driven_lanedir_consec_max	2.330265057914278
driven_lanedir_consec_mean	2.330265057914278
driven_lanedir_consec_min	2.330265057914278
driven_lanedir_max	2.330265057914278
driven_lanedir_mean	2.330265057914278
driven_lanedir_median	2.330265057914278
driven_lanedir_min	2.330265057914278
in-drivable-lane_max	30.64999999999937
in-drivable-lane_mean	30.64999999999937
in-drivable-lane_min	30.64999999999937
per-episodes	details {"udem-000-ego0": {"driven_any": 7.30662983731504, "survival_time": 59.99999999999873, "driven_lanedir": 2.330265057914278, "in-drivable-lane": 30.64999999999937, "deviation-heading": 22.645658474661285, "distance-from-start": 0.3476594947348637, "deviation-center-line": 2.385072375814705, "driven_lanedir_consec": 2.330265057914278}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14651

976

Bea Baselines 🐤

template-pytorch

sim-0of4

success

2022-11-24 03:19:15+00:00

2022-11-24 03:39:15+00:00

0:20:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	58.69999999999872
driven_lanedir_consec_median	0.09169385527433428
deviation-center-line_median	0.08873879619252409

other stats

deviation-center-line_max	1.3059300103405007
deviation-center-line_mean	0.38780910570639454
deviation-center-line_min	0.06782882010002925
deviation-heading_max	13.44567556511567
deviation-heading_mean	3.953349265064365
deviation-heading_median	0.8029618946551569
deviation-heading_min	0.7617977058314754
distance-from-start_max	0.8144170073001693
distance-from-start_mean	0.3107658380342786
distance-from-start_median	0.16795350823714106
distance-from-start_min	0.09273932836266292
driven_any_max	9.463693396761828
driven_any_mean	2.5316466698136324
driven_any_median	0.2690900372257372
driven_any_min	0.12471320804122751
driven_lanedir_consec_max	1.8008971369831306
driven_lanedir_consec_mean	0.5042732292897043
driven_lanedir_consec_min	0.03280806962701788
driven_lanedir_max	1.8008971369831306
driven_lanedir_mean	0.5042732292897043
driven_lanedir_median	0.09169385527433428
driven_lanedir_min	0.03280806962701788
in-drivable-lane_max	59.14999999999873
in-drivable-lane_mean	54.58749999999871
in-drivable-lane_min	41.7999999999987
per-episodes	details {"udem-000-ego0": {"driven_any": 9.463693396761828, "survival_time": 59.99999999999873, "driven_lanedir": 1.8008971369831306, "in-drivable-lane": 41.7999999999987, "deviation-heading": 13.44567556511567, "distance-from-start": 0.8144170073001693, "deviation-center-line": 1.3059300103405007, "driven_lanedir_consec": 1.8008971369831306}, "udem-000-ego1": {"driven_any": 0.12471320804122751, "survival_time": 59.99999999999873, "driven_lanedir": 0.03479775794719542, "in-drivable-lane": 58.94999999999872, "deviation-heading": 0.7617977058314754, "distance-from-start": 0.09273932836266292, "deviation-center-line": 0.0837903945774886, "driven_lanedir_consec": 0.03479775794719542}, "udem-000-ego2": {"driven_any": 0.4028626866879818, "survival_time": 59.99999999999873, "driven_lanedir": 0.14858995260147312, "in-drivable-lane": 58.44999999999872, "deviation-heading": 0.8064420411998574, "distance-from-start": 0.22840995247430845, "deviation-center-line": 0.09368719780755956, "driven_lanedir_consec": 0.14858995260147312}, "udem-000-ego3": {"driven_any": 0.1353173877634926, "survival_time": 59.99999999999873, "driven_lanedir": 0.03280806962701788, "in-drivable-lane": 59.14999999999873, "deviation-heading": 0.7994817481104562, "distance-from-start": 0.10749706399997372, "deviation-center-line": 0.06782882010002925, "driven_lanedir_consec": 0.03280806962701788}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14650

976

Bea Baselines 🐤

template-pytorch

sim-1of4

success

2022-11-24 03:11:04+00:00

2022-11-24 03:18:57+00:00

0:07:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	21.050000000000164
in-drivable-lane_median	19.500000000000163
driven_lanedir_consec_median	0.1952768511994467
deviation-center-line_median	0.07546334309723268

other stats

deviation-center-line_max	0.5919053252916605
deviation-center-line_mean	0.1997101038076919
deviation-center-line_min	0.05600840374464194
deviation-heading_max	4.959113290236561
deviation-heading_mean	1.8333108257093236
deviation-heading_median	0.9145303697026468
deviation-heading_min	0.5450692731954394
distance-from-start_max	0.6831245773976969
distance-from-start_mean	0.35887439400872767
distance-from-start_median	0.3534857937696162
distance-from-start_min	0.04540141109798119
driven_any_max	4.906722877426539
driven_any_mean	1.493190198783382
driven_any_median	0.5080991114910626
driven_any_min	0.049839694724863985
driven_lanedir_consec_max	0.3724518880466443
driven_lanedir_consec_mean	0.1926665138290863
driven_lanedir_consec_min	0.007660464870807626
driven_lanedir_max	1.0620154959332526
driven_lanedir_mean	0.3650574158007384
driven_lanedir_median	0.1952768511994467
driven_lanedir_min	0.007660464870807626
in-drivable-lane_max	20.200000000000163
in-drivable-lane_mean	18.412500000000147
in-drivable-lane_min	14.450000000000102
per-episodes	details {"4way-000-ego0": {"driven_any": 0.45834469757101853, "survival_time": 21.050000000000164, "driven_lanedir": 0.21370520089327497, "in-drivable-lane": 19.200000000000163, "deviation-heading": 1.1711510459398833, "distance-from-start": 0.2454945259842243, "deviation-center-line": 0.0813227516094393, "driven_lanedir_consec": 0.21370520089327497}, "4way-000-ego1": {"driven_any": 0.049839694724863985, "survival_time": 21.050000000000164, "driven_lanedir": 0.007660464870807626, "in-drivable-lane": 20.200000000000163, "deviation-heading": 0.6579096934654103, "distance-from-start": 0.04540141109798119, "deviation-center-line": 0.05600840374464194, "driven_lanedir_consec": 0.007660464870807626}, "4way-000-ego2": {"driven_any": 0.5578535254111067, "survival_time": 21.050000000000164, "driven_lanedir": 0.17684850150561848, "in-drivable-lane": 19.800000000000164, "deviation-heading": 0.5450692731954394, "distance-from-start": 0.46147706155500806, "deviation-center-line": 0.06960393458502608, "driven_lanedir_consec": 0.17684850150561848}, "4way-000-ego3": {"driven_any": 4.906722877426539, "survival_time": 21.050000000000164, "driven_lanedir": 1.0620154959332526, "in-drivable-lane": 14.450000000000102, "deviation-heading": 4.959113290236561, "distance-from-start": 0.6831245773976969, "deviation-center-line": 0.5919053252916605, "driven_lanedir_consec": 0.3724518880466443}}
simulation-passed	1
survival_time_max	21.050000000000164
survival_time_mean	21.050000000000164
survival_time_min	21.050000000000164

No reset possible

14649

976

Bea Baselines 🐤

template-pytorch

sim-2of4

success

2022-11-24 03:09:11+00:00

2022-11-24 03:10:38+00:00

0:01:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

14644

978

Bea Baselines 🐤

template-pytorch

sim-3of4

success

2022-11-24 03:06:05+00:00

2022-11-24 03:08:45+00:00

0:02:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	11.350000000000026
in-drivable-lane_median	5.800000000000017
driven_lanedir_consec_median	0.2693209670687682
deviation-center-line_median	0.3954703519295259

other stats

deviation-center-line_max	0.3954703519295259
deviation-center-line_mean	0.3954703519295259
deviation-center-line_min	0.3954703519295259
deviation-heading_max	4.201310395086394
deviation-heading_mean	4.201310395086394
deviation-heading_median	4.201310395086394
deviation-heading_min	4.201310395086394
distance-from-start_max	0.1653171520990681
distance-from-start_mean	0.1653171520990681
distance-from-start_median	0.1653171520990681
distance-from-start_min	0.1653171520990681
driven_any_max	0.9135308026278536
driven_any_mean	0.9135308026278536
driven_any_median	0.9135308026278536
driven_any_min	0.9135308026278536
driven_lanedir_consec_max	0.2693209670687682
driven_lanedir_consec_mean	0.2693209670687682
driven_lanedir_consec_min	0.2693209670687682
driven_lanedir_max	0.2693209670687682
driven_lanedir_mean	0.2693209670687682
driven_lanedir_median	0.2693209670687682
driven_lanedir_min	0.2693209670687682
in-drivable-lane_max	5.800000000000017
in-drivable-lane_mean	5.800000000000017
in-drivable-lane_min	5.800000000000017
per-episodes	details {"zigzag-000-ego0": {"driven_any": 0.9135308026278536, "survival_time": 11.350000000000026, "driven_lanedir": 0.2693209670687682, "in-drivable-lane": 5.800000000000017, "deviation-heading": 4.201310395086394, "distance-from-start": 0.1653171520990681, "deviation-center-line": 0.3954703519295259, "driven_lanedir_consec": 0.2693209670687682}}
simulation-passed	1
survival_time_max	11.350000000000026
survival_time_mean	11.350000000000026
survival_time_min	11.350000000000026

No reset possible

14640

980

Bea Baselines 🐤

template-ros

sim-0of4

success

2022-11-24 03:03:46+00:00

2022-11-24 03:05:31+00:00

0:01:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.13759110544945807
survival_time_median	2.3
deviation-center-line_median	0.053988895725462005
in-drivable-lane_median	1.2999999999999996

other stats

deviation-center-line_max	0.053988895725462005
deviation-center-line_mean	0.053988895725462005
deviation-center-line_min	0.053988895725462005
deviation-heading_max	0.649669285447423
deviation-heading_mean	0.649669285447423
deviation-heading_median	0.649669285447423
deviation-heading_min	0.649669285447423
distance-from-start_max	0.33801856285383236
distance-from-start_mean	0.33801856285383236
distance-from-start_median	0.33801856285383236
distance-from-start_min	0.33801856285383236
driven_any_max	0.3395722131527542
driven_any_mean	0.3395722131527542
driven_any_median	0.3395722131527542
driven_any_min	0.3395722131527542
driven_lanedir_consec_max	0.13759110544945807
driven_lanedir_consec_mean	0.13759110544945807
driven_lanedir_consec_min	0.13759110544945807
driven_lanedir_max	0.13759110544945807
driven_lanedir_mean	0.13759110544945807
driven_lanedir_median	0.13759110544945807
driven_lanedir_min	0.13759110544945807
in-drivable-lane_max	1.2999999999999996
in-drivable-lane_mean	1.2999999999999996
in-drivable-lane_min	1.2999999999999996
per-episodes	details {"autolab-000-ego0": {"driven_any": 0.3395722131527542, "survival_time": 2.3, "driven_lanedir": 0.13759110544945807, "in-drivable-lane": 1.2999999999999996, "deviation-heading": 0.649669285447423, "distance-from-start": 0.33801856285383236, "deviation-center-line": 0.053988895725462005, "driven_lanedir_consec": 0.13759110544945807}}
simulation-passed	1
survival_time_max	2.3
survival_time_mean	2.3
survival_time_min	2.3

No reset possible

14632

982

Bea Baselines 🐤

baseline-duckietown-ml

sim-1of4

success

2022-11-24 02:54:16+00:00

2022-11-24 03:03:37+00:00

0:09:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0
deviation-center-line_median	0.8949116056299469

other stats

deviation-center-line_max	0.8949116056299469
deviation-center-line_mean	0.8949116056299469
deviation-center-line_min	0.8949116056299469
deviation-heading_max	32.249113233675025
deviation-heading_mean	32.249113233675025
deviation-heading_median	32.249113233675025
deviation-heading_min	32.249113233675025
distance-from-start_max	4.577566798522237e-16
distance-from-start_mean	4.577566798522237e-16
distance-from-start_median	4.577566798522237e-16
distance-from-start_min	4.577566798522237e-16
driven_any_max	5.49308015822675e-13
driven_any_mean	5.49308015822675e-13
driven_any_median	5.49308015822675e-13
driven_any_min	5.49308015822675e-13
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop-000-ego0": {"driven_any": 5.49308015822675e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.577566798522237e-16, "deviation-center-line": 0.8949116056299469, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14627

985

Bea Baselines 🐤

template-tensorflow

sim-1of4

failed

2022-11-24 02:51:52+00:00

2022-11-24 02:54:03+00:00

0:02:11

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14626

985

Bea Baselines 🐤

template-tensorflow

sim-0of4

failed

2022-11-24 02:50:17+00:00

2022-11-24 02:51:46+00:00

0:01:29

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14624

985

Bea Baselines 🐤

template-tensorflow

sim-2of4

failed

2022-11-24 02:48:13+00:00

2022-11-24 02:49:53+00:00

0:01:40

The container "solut [...]

The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14619

987

Bea Baselines 🐤

template-ros

sim-0of4

success

2022-11-24 02:46:21+00:00

2022-11-24 02:48:07+00:00

0:01:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.5718820765285733
survival_time_median	10.600000000000016
deviation-center-line_median	0.4409143637289993
in-drivable-lane_median	4.650000000000029

other stats

deviation-center-line_max	0.4409143637289993
deviation-center-line_mean	0.4409143637289993
deviation-center-line_min	0.4409143637289993
deviation-heading_max	1.4985743831464726
deviation-heading_mean	1.4985743831464726
deviation-heading_median	1.4985743831464726
deviation-heading_min	1.4985743831464726
distance-from-start_max	2.6862783971694517
distance-from-start_mean	2.6862783971694517
distance-from-start_median	2.6862783971694517
distance-from-start_min	2.6862783971694517
driven_any_max	2.8707615302496636
driven_any_mean	2.8707615302496636
driven_any_median	2.8707615302496636
driven_any_min	2.8707615302496636
driven_lanedir_consec_max	1.5718820765285733
driven_lanedir_consec_mean	1.5718820765285733
driven_lanedir_consec_min	1.5718820765285733
driven_lanedir_max	1.5718820765285733
driven_lanedir_mean	1.5718820765285733
driven_lanedir_median	1.5718820765285733
driven_lanedir_min	1.5718820765285733
in-drivable-lane_max	4.650000000000029
in-drivable-lane_mean	4.650000000000029
in-drivable-lane_min	4.650000000000029
per-episodes	details {"autolab-000-ego0": {"driven_any": 2.8707615302496636, "survival_time": 10.600000000000016, "driven_lanedir": 1.5718820765285733, "in-drivable-lane": 4.650000000000029, "deviation-heading": 1.4985743831464726, "distance-from-start": 2.6862783971694517, "deviation-center-line": 0.4409143637289993, "driven_lanedir_consec": 1.5718820765285733}}
simulation-passed	1
survival_time_max	10.600000000000016
survival_time_mean	10.600000000000016
survival_time_min	10.600000000000016

No reset possible

14615

989

Bea Baselines 🐤

baseline-RPL-ros

sim-3of4

failed

2022-11-24 02:44:49+00:00

2022-11-24 02:46:01+00:00

0:01:12

The container "solut [...]

The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14609

990

Bea Baselines 🐤

baseline-RPL-ros

sim-0of4

failed

2022-11-24 02:43:21+00:00

2022-11-24 02:44:36+00:00

0:01:15

The container "solut [...]

The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14604

991

Bea Baselines 🐤

baseline-RPL-ros

sim-3of4

failed

2022-11-24 02:42:03+00:00

2022-11-24 02:43:14+00:00

0:01:11

The container "solut [...]

The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14599

992

Bea Baselines 🐤

baseline-RPL-ros

sim-1of4

failed

2022-11-24 02:40:31+00:00

2022-11-24 02:41:28+00:00

0:00:57

The container "solut [...]

The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14595

994

Bea Baselines 🐤

baseline-RPL-ros

sim-3of4

failed

2022-11-24 02:38:57+00:00

2022-11-24 02:40:10+00:00

0:01:13

The container "solut [...]

The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14589

995

Bea Baselines 🐤

baseline-RPL-ros

sim-2of4

failed

2022-11-24 02:37:41+00:00

2022-11-24 02:38:37+00:00

0:00:56

The container "solut [...]

The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14551

1015

Bea Baselines 🐤

baseline-duckietown-ml

sim-1of4

success

2022-11-24 02:20:35+00:00

2022-11-24 02:37:08+00:00

0:16:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	51.499999999998714
driven_lanedir_consec_median	0.9120805976144694
deviation-center-line_median	0.6939994285179009

other stats

deviation-center-line_max	0.6939994285179009
deviation-center-line_mean	0.6939994285179009
deviation-center-line_min	0.6939994285179009
deviation-heading_max	3.6556021344683143
deviation-heading_mean	3.6556021344683143
deviation-heading_median	3.6556021344683143
deviation-heading_min	3.6556021344683143
distance-from-start_max	0.9518551888074036
distance-from-start_mean	0.9518551888074036
distance-from-start_median	0.9518551888074036
distance-from-start_min	0.9518551888074036
driven_any_max	7.909910547716662
driven_any_mean	7.909910547716662
driven_any_median	7.909910547716662
driven_any_min	7.909910547716662
driven_lanedir_consec_max	0.9120805976144694
driven_lanedir_consec_mean	0.9120805976144694
driven_lanedir_consec_min	0.9120805976144694
driven_lanedir_max	0.9120805976144694
driven_lanedir_mean	0.9120805976144694
driven_lanedir_median	0.9120805976144694
driven_lanedir_min	0.9120805976144694
in-drivable-lane_max	51.499999999998714
in-drivable-lane_mean	51.499999999998714
in-drivable-lane_min	51.499999999998714
per-episodes	details {"4way-000-ego0": {"driven_any": 7.909910547716662, "survival_time": 59.99999999999873, "driven_lanedir": 0.9120805976144694, "in-drivable-lane": 51.499999999998714, "deviation-heading": 3.6556021344683143, "distance-from-start": 0.9518551888074036, "deviation-center-line": 0.6939994285179009, "driven_lanedir_consec": 0.9120805976144694}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14544

1017

Bea Baselines 🐤

baseline-duckietown-ml

sim-0of4

success

2022-11-24 02:14:29+00:00

2022-11-24 02:20:27+00:00

0:05:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	6.628087915511438
survival_time_median	59.99999999999873
deviation-center-line_median	3.85923505148356
in-drivable-lane_median	7.999999999999925

other stats

deviation-center-line_max	3.85923505148356
deviation-center-line_mean	3.85923505148356
deviation-center-line_min	3.85923505148356
deviation-heading_max	8.879284869569831
deviation-heading_mean	8.879284869569831
deviation-heading_median	8.879284869569831
deviation-heading_min	8.879284869569831
distance-from-start_max	3.9060573324077414
distance-from-start_mean	3.9060573324077414
distance-from-start_median	3.9060573324077414
distance-from-start_min	3.9060573324077414
driven_any_max	7.907902489988902
driven_any_mean	7.907902489988902
driven_any_median	7.907902489988902
driven_any_min	7.907902489988902
driven_lanedir_consec_max	6.628087915511438
driven_lanedir_consec_mean	6.628087915511438
driven_lanedir_consec_min	6.628087915511438
driven_lanedir_max	6.628087915511438
driven_lanedir_mean	6.628087915511438
driven_lanedir_median	6.628087915511438
driven_lanedir_min	6.628087915511438
in-drivable-lane_max	7.999999999999925
in-drivable-lane_mean	7.999999999999925
in-drivable-lane_min	7.999999999999925
per-episodes	details {"autolab-000-ego0": {"driven_any": 7.907902489988902, "survival_time": 59.99999999999873, "driven_lanedir": 6.628087915511438, "in-drivable-lane": 7.999999999999925, "deviation-heading": 8.879284869569831, "distance-from-start": 3.9060573324077414, "deviation-center-line": 3.85923505148356, "driven_lanedir_consec": 6.628087915511438}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14541

1017

Bea Baselines 🐤

baseline-duckietown-ml

sim-1of4

success

2022-11-24 02:08:53+00:00

2022-11-24 02:14:00+00:00

0:05:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.452743754028736
survival_time_median	59.99999999999873
deviation-center-line_median	2.7674370554548497
in-drivable-lane_median	17.649999999999523

other stats

deviation-center-line_max	2.7674370554548497
deviation-center-line_mean	2.7674370554548497
deviation-center-line_min	2.7674370554548497
deviation-heading_max	8.350172638367484
deviation-heading_mean	8.350172638367484
deviation-heading_median	8.350172638367484
deviation-heading_min	8.350172638367484
distance-from-start_max	2.585946524364086
distance-from-start_mean	2.585946524364086
distance-from-start_median	2.585946524364086
distance-from-start_min	2.585946524364086
driven_any_max	7.907761640238257
driven_any_mean	7.907761640238257
driven_any_median	7.907761640238257
driven_any_min	7.907761640238257
driven_lanedir_consec_max	3.452743754028736
driven_lanedir_consec_mean	3.452743754028736
driven_lanedir_consec_min	3.452743754028736
driven_lanedir_max	5.297318754930874
driven_lanedir_mean	5.297318754930874
driven_lanedir_median	5.297318754930874
driven_lanedir_min	5.297318754930874
in-drivable-lane_max	17.649999999999523
in-drivable-lane_mean	17.649999999999523
in-drivable-lane_min	17.649999999999523
per-episodes	details {"loop-000-ego0": {"driven_any": 7.907761640238257, "survival_time": 59.99999999999873, "driven_lanedir": 5.297318754930874, "in-drivable-lane": 17.649999999999523, "deviation-heading": 8.350172638367484, "distance-from-start": 2.585946524364086, "deviation-center-line": 2.7674370554548497, "driven_lanedir_consec": 3.452743754028736}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14540

1018

Bea Baselines 🐤

baseline-duckietown-ml

sim-2of4

success

2022-11-24 02:06:52+00:00

2022-11-24 02:08:24+00:00

0:01:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

14537

1019

Bea Baselines 🐤

baseline-duckietown-ml

sim-3of4

success

2022-11-24 01:54:35+00:00

2022-11-24 02:06:18+00:00

0:11:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	24.450000000000212
in-drivable-lane_median	3.5750000000000304
driven_lanedir_consec_median	1.1019599200113308
deviation-center-line_median	1.4023710918327217

other stats

deviation-center-line_max	2.777165883779486
deviation-center-line_mean	1.7053947032271115
deviation-center-line_min	1.2396707454635167
deviation-heading_max	21.551515781164593
deviation-heading_mean	11.793932041536069
deviation-heading_median	8.846868473555395
deviation-heading_min	7.930475437868888
distance-from-start_max	1.1492808264272838
distance-from-start_mean	0.932760746596048
distance-from-start_median	1.0841851804014162
distance-from-start_min	0.41339179915407503
driven_any_max	3.101205751335052
driven_any_mean	2.1453482627395717
driven_any_median	2.1453840724468782
driven_any_min	1.1894191547294797
driven_lanedir_consec_max	1.4894861509804105
driven_lanedir_consec_mean	1.047706973165838
driven_lanedir_consec_min	0.4974219016602792
driven_lanedir_max	1.9666172761064096
driven_lanedir_mean	1.4338257609364071
driven_lanedir_median	1.459935607565649
driven_lanedir_min	0.8488145525079209
in-drivable-lane_max	7.7500000000000435
in-drivable-lane_mean	3.725000000000026
in-drivable-lane_min	0.0
per-episodes	details {"zigzag-000-ego0": {"driven_any": 3.101194742300794, "survival_time": 24.450000000000212, "driven_lanedir": 1.812853626602156, "in-drivable-lane": 7.7500000000000435, "deviation-heading": 7.930475437868888, "distance-from-start": 1.1382984831583978, "deviation-center-line": 1.241821026470849, "driven_lanedir_consec": 1.096902251493519}, "zigzag-000-ego1": {"driven_any": 1.1894191547294797, "survival_time": 24.450000000000212, "driven_lanedir": 0.8488145525079209, "in-drivable-lane": 1.3999999999999986, "deviation-heading": 8.831986321327872, "distance-from-start": 0.41339179915407503, "deviation-center-line": 2.777165883779486, "driven_lanedir_consec": 0.4974219016602792}, "zigzag-000-ego2": {"driven_any": 1.1895734025929623, "survival_time": 24.450000000000212, "driven_lanedir": 1.107017588529143, "in-drivable-lane": 0.0, "deviation-heading": 21.551515781164593, "distance-from-start": 1.0300718776444349, "deviation-center-line": 1.2396707454635167, "driven_lanedir_consec": 1.107017588529143}, "zigzag-000-ego3": {"driven_any": 3.101205751335052, "survival_time": 24.450000000000212, "driven_lanedir": 1.9666172761064096, "in-drivable-lane": 5.750000000000062, "deviation-heading": 8.861750625782918, "distance-from-start": 1.1492808264272838, "deviation-center-line": 1.562921157194594, "driven_lanedir_consec": 1.4894861509804105}}
simulation-passed	1
survival_time_max	24.450000000000212
survival_time_mean	24.450000000000212
survival_time_min	24.450000000000212

No reset possible

14532

1020

Bea Baselines 🐤

baseline-duckietown-ml

sim-1of4

success

2022-11-24 01:49:49+00:00

2022-11-24 01:54:23+00:00

0:04:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	37.10000000000003
in-drivable-lane_median	10.949999999999992
driven_lanedir_consec_median	3.206206814929863
deviation-center-line_median	2.5050131895118146

other stats

deviation-center-line_max	2.5050131895118146
deviation-center-line_mean	2.5050131895118146
deviation-center-line_min	2.5050131895118146
deviation-heading_max	5.159933652904862
deviation-heading_mean	5.159933652904862
deviation-heading_median	5.159933652904862
deviation-heading_min	5.159933652904862
distance-from-start_max	2.0955261170674655
distance-from-start_mean	2.0955261170674655
distance-from-start_median	2.0955261170674655
distance-from-start_min	2.0955261170674655
driven_any_max	4.774463151198271
driven_any_mean	4.774463151198271
driven_any_median	4.774463151198271
driven_any_min	4.774463151198271
driven_lanedir_consec_max	3.206206814929863
driven_lanedir_consec_mean	3.206206814929863
driven_lanedir_consec_min	3.206206814929863
driven_lanedir_max	3.206206814929863
driven_lanedir_mean	3.206206814929863
driven_lanedir_median	3.206206814929863
driven_lanedir_min	3.206206814929863
in-drivable-lane_max	10.949999999999992
in-drivable-lane_mean	10.949999999999992
in-drivable-lane_min	10.949999999999992
per-episodes	details {"loop-000-ego0": {"driven_any": 4.774463151198271, "survival_time": 37.10000000000003, "driven_lanedir": 3.206206814929863, "in-drivable-lane": 10.949999999999992, "deviation-heading": 5.159933652904862, "distance-from-start": 2.0955261170674655, "deviation-center-line": 2.5050131895118146, "driven_lanedir_consec": 3.206206814929863}}
simulation-passed	1
survival_time_max	37.10000000000003
survival_time_mean	37.10000000000003
survival_time_min	37.10000000000003

No reset possible

14526

1032

Bea Baselines 🐤

baseline-duckietown-ml

sim-1of4

success

2022-11-24 01:37:09+00:00

2022-11-24 01:49:16+00:00

0:12:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	3.0499999999999083
driven_lanedir_consec_median	7.253366150219401
deviation-center-line_median	3.565957427853091

other stats

deviation-center-line_max	3.565957427853091
deviation-center-line_mean	3.565957427853091
deviation-center-line_min	3.565957427853091
deviation-heading_max	9.87299031458024
deviation-heading_mean	9.87299031458024
deviation-heading_median	9.87299031458024
deviation-heading_min	9.87299031458024
distance-from-start_max	2.8312580304511012
distance-from-start_mean	2.8312580304511012
distance-from-start_median	2.8312580304511012
distance-from-start_min	2.8312580304511012
driven_any_max	7.914415233090033
driven_any_mean	7.914415233090033
driven_any_median	7.914415233090033
driven_any_min	7.914415233090033
driven_lanedir_consec_max	7.253366150219401
driven_lanedir_consec_mean	7.253366150219401
driven_lanedir_consec_min	7.253366150219401
driven_lanedir_max	7.253366150219401
driven_lanedir_mean	7.253366150219401
driven_lanedir_median	7.253366150219401
driven_lanedir_min	7.253366150219401
in-drivable-lane_max	3.0499999999999083
in-drivable-lane_mean	3.0499999999999083
in-drivable-lane_min	3.0499999999999083
per-episodes	details {"loop-000-ego0": {"driven_any": 7.914415233090033, "survival_time": 59.99999999999873, "driven_lanedir": 7.253366150219401, "in-drivable-lane": 3.0499999999999083, "deviation-heading": 9.87299031458024, "distance-from-start": 2.8312580304511012, "deviation-center-line": 3.565957427853091, "driven_lanedir_consec": 7.253366150219401}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14523

1032

Bea Baselines 🐤

baseline-duckietown-ml

sim-2of4

success

2022-11-24 01:33:45+00:00

2022-11-24 01:36:50+00:00

0:03:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	17.400000000000112
in-drivable-lane_median	3.850000000000037
driven_lanedir_consec_median	1.6783258052796062
deviation-center-line_median	1.2129760348360543

other stats

deviation-center-line_max	1.2129760348360543
deviation-center-line_mean	1.2129760348360543
deviation-center-line_min	1.2129760348360543
deviation-heading_max	2.9001858126784597
deviation-heading_mean	2.9001858126784597
deviation-heading_median	2.9001858126784597
deviation-heading_min	2.9001858126784597
distance-from-start_max	1.4593858336802106
distance-from-start_mean	1.4593858336802106
distance-from-start_median	1.4593858336802106
distance-from-start_min	1.4593858336802106
driven_any_max	2.165484975735572
driven_any_mean	2.165484975735572
driven_any_median	2.165484975735572
driven_any_min	2.165484975735572
driven_lanedir_consec_max	1.6783258052796062
driven_lanedir_consec_mean	1.6783258052796062
driven_lanedir_consec_min	1.6783258052796062
driven_lanedir_max	1.6783258052796062
driven_lanedir_mean	1.6783258052796062
driven_lanedir_median	1.6783258052796062
driven_lanedir_min	1.6783258052796062
in-drivable-lane_max	3.850000000000037
in-drivable-lane_mean	3.850000000000037
in-drivable-lane_min	3.850000000000037
per-episodes	details {"loop2-000-ego0": {"driven_any": 2.165484975735572, "survival_time": 17.400000000000112, "driven_lanedir": 1.6783258052796062, "in-drivable-lane": 3.850000000000037, "deviation-heading": 2.9001858126784597, "distance-from-start": 1.4593858336802106, "deviation-center-line": 1.2129760348360543, "driven_lanedir_consec": 1.6783258052796062}}
simulation-passed	1
survival_time_max	17.400000000000112
survival_time_mean	17.400000000000112
survival_time_min	17.400000000000112

No reset possible

14516

1034

Bea Baselines 🐤

baseline-duckietown-ml

sim-0of4

success

2022-11-24 01:29:03+00:00

2022-11-24 01:33:26+00:00

0:04:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	24.500000000000213
in-drivable-lane_median	1.8000000000000114
driven_lanedir_consec_median	2.1105417737233463
deviation-center-line_median	1.8579372459437895

other stats

deviation-center-line_max	1.8579372459437895
deviation-center-line_mean	1.8579372459437895
deviation-center-line_min	1.8579372459437895
deviation-heading_max	4.649830431568753
deviation-heading_mean	4.649830431568753
deviation-heading_median	4.649830431568753
deviation-heading_min	4.649830431568753
distance-from-start_max	1.0968329952082905
distance-from-start_mean	1.0968329952082905
distance-from-start_median	1.0968329952082905
distance-from-start_min	1.0968329952082905
driven_any_max	3.101395729994191
driven_any_mean	3.101395729994191
driven_any_median	3.101395729994191
driven_any_min	3.101395729994191
driven_lanedir_consec_max	2.1105417737233463
driven_lanedir_consec_mean	2.1105417737233463
driven_lanedir_consec_min	2.1105417737233463
driven_lanedir_max	2.781770056028658
driven_lanedir_mean	2.781770056028658
driven_lanedir_median	2.781770056028658
driven_lanedir_min	2.781770056028658
in-drivable-lane_max	1.8000000000000114
in-drivable-lane_mean	1.8000000000000114
in-drivable-lane_min	1.8000000000000114
per-episodes	details {"4way-000-ego0": {"driven_any": 3.101395729994191, "survival_time": 24.500000000000213, "driven_lanedir": 2.781770056028658, "in-drivable-lane": 1.8000000000000114, "deviation-heading": 4.649830431568753, "distance-from-start": 1.0968329952082905, "deviation-center-line": 1.8579372459437895, "driven_lanedir_consec": 2.1105417737233463}}
simulation-passed	1
survival_time_max	24.500000000000213
survival_time_mean	24.500000000000213
survival_time_min	24.500000000000213

No reset possible

14515

1034

Bea Baselines 🐤

baseline-duckietown-ml

sim-1of4

success

2022-11-24 01:25:16+00:00

2022-11-24 01:28:49+00:00

0:03:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	20.15000000000015
in-drivable-lane_median	6.800000000000097
driven_lanedir_consec_median	1.4965698950389543
deviation-center-line_median	0.8608495013110116

other stats

deviation-center-line_max	0.8608495013110116
deviation-center-line_mean	0.8608495013110116
deviation-center-line_min	0.8608495013110116
deviation-heading_max	4.141588688236925
deviation-heading_mean	4.141588688236925
deviation-heading_median	4.141588688236925
deviation-heading_min	4.141588688236925
distance-from-start_max	1.8096110406647177
distance-from-start_mean	1.8096110406647177
distance-from-start_median	1.8096110406647177
distance-from-start_min	1.8096110406647177
driven_any_max	2.5239685400718654
driven_any_mean	2.5239685400718654
driven_any_median	2.5239685400718654
driven_any_min	2.5239685400718654
driven_lanedir_consec_max	1.4965698950389543
driven_lanedir_consec_mean	1.4965698950389543
driven_lanedir_consec_min	1.4965698950389543
driven_lanedir_max	1.4965701525486392
driven_lanedir_mean	1.4965701525486392
driven_lanedir_median	1.4965701525486392
driven_lanedir_min	1.4965701525486392
in-drivable-lane_max	6.800000000000097
in-drivable-lane_mean	6.800000000000097
in-drivable-lane_min	6.800000000000097
per-episodes	details {"udem1-000-ego0": {"driven_any": 2.5239685400718654, "survival_time": 20.15000000000015, "driven_lanedir": 1.4965701525486392, "in-drivable-lane": 6.800000000000097, "deviation-heading": 4.141588688236925, "distance-from-start": 1.8096110406647177, "deviation-center-line": 0.8608495013110116, "driven_lanedir_consec": 1.4965698950389543}}
simulation-passed	1
survival_time_max	20.15000000000015
survival_time_mean	20.15000000000015
survival_time_min	20.15000000000015

No reset possible

14502

1037

Bea Baselines 🐤

baseline-duckietown-ml

sim-0of4

success

2022-11-24 01:05:30+00:00

2022-11-24 01:24:55+00:00

0:19:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	10.22499999999962
driven_lanedir_consec_median	2.6813324566830854
deviation-center-line_median	4.310092002009705

other stats

deviation-center-line_max	9.105500341546978
deviation-center-line_mean	4.5511979552316655
deviation-center-line_min	0.479107475360274
deviation-heading_max	30.276796169125817
deviation-heading_mean	16.458450730915835
deviation-heading_median	16.353604657744622
deviation-heading_min	2.8497974390482708
distance-from-start_max	3.2951852982352188
distance-from-start_mean	2.1678098282731697
distance-from-start_median	2.1835796111883092
distance-from-start_min	1.0088947924808416
driven_any_max	7.913922539641026
driven_any_mean	4.656279163365452
driven_any_median	4.681185235798633
driven_any_min	1.3488236422235158
driven_lanedir_consec_max	5.0880325434484535
driven_lanedir_consec_mean	2.840368891873139
driven_lanedir_consec_min	0.9107781106779322
driven_lanedir_max	6.533168092769837
driven_lanedir_mean	3.5285724498208992
driven_lanedir_median	3.3351717979179147
driven_lanedir_min	0.9107781106779322
in-drivable-lane_max	51.749999999998735
in-drivable-lane_mean	18.337499999999498
in-drivable-lane_min	1.1500000000000163
per-episodes	details {"autolab-000-ego0": {"driven_any": 1.8334667566728533, "survival_time": 59.99999999999873, "driven_lanedir": 1.5823110523873765, "in-drivable-lane": 1.1500000000000163, "deviation-heading": 30.276796169125817, "distance-from-start": 1.724774712790342, "deviation-center-line": 9.105500341546978, "driven_lanedir_consec": 1.5823110523873765}, "autolab-000-ego1": {"driven_any": 7.913922539641026, "survival_time": 59.99999999999873, "driven_lanedir": 6.533168092769837, "in-drivable-lane": 6.549999999999745, "deviation-heading": 14.985779194966852, "distance-from-start": 2.642384509586277, "deviation-center-line": 4.457117938695359, "driven_lanedir_consec": 3.780353860978794}, "autolab-000-ego2": {"driven_any": 1.3488236422235158, "survival_time": 59.99999999999873, "driven_lanedir": 0.9107781106779322, "in-drivable-lane": 51.749999999998735, "deviation-heading": 2.8497974390482708, "distance-from-start": 1.0088947924808416, "deviation-center-line": 0.479107475360274, "driven_lanedir_consec": 0.9107781106779322}, "autolab-000-ego3": {"driven_any": 7.528903714924413, "survival_time": 59.99999999999873, "driven_lanedir": 5.0880325434484535, "in-drivable-lane": 13.899999999999498, "deviation-heading": 17.721430120522392, "distance-from-start": 3.2951852982352188, "deviation-center-line": 4.163066065324051, "driven_lanedir_consec": 5.0880325434484535}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14500

1038

Bea Baselines 🐤

baseline-duckietown-ml

sim-0of4

success

2022-11-24 01:02:28+00:00

2022-11-24 01:05:24+00:00

0:02:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	19.900000000000148
in-drivable-lane_median	1.350000000000013
driven_lanedir_consec_median	2.185898306675539
deviation-center-line_median	1.4193506366674866

other stats

deviation-center-line_max	1.4193506366674866
deviation-center-line_mean	1.4193506366674866
deviation-center-line_min	1.4193506366674866
deviation-heading_max	4.945728429125672
deviation-heading_mean	4.945728429125672
deviation-heading_median	4.945728429125672
deviation-heading_min	4.945728429125672
distance-from-start_max	2.094835377082309
distance-from-start_mean	2.094835377082309
distance-from-start_median	2.094835377082309
distance-from-start_min	2.094835377082309
driven_any_max	2.4907610045830393
driven_any_mean	2.4907610045830393
driven_any_median	2.4907610045830393
driven_any_min	2.4907610045830393
driven_lanedir_consec_max	2.185898306675539
driven_lanedir_consec_mean	2.185898306675539
driven_lanedir_consec_min	2.185898306675539
driven_lanedir_max	2.185898306675539
driven_lanedir_mean	2.185898306675539
driven_lanedir_median	2.185898306675539
driven_lanedir_min	2.185898306675539
in-drivable-lane_max	1.350000000000013
in-drivable-lane_mean	1.350000000000013
in-drivable-lane_min	1.350000000000013
per-episodes	details {"autolab-000-ego0": {"driven_any": 2.4907610045830393, "survival_time": 19.900000000000148, "driven_lanedir": 2.185898306675539, "in-drivable-lane": 1.350000000000013, "deviation-heading": 4.945728429125672, "distance-from-start": 2.094835377082309, "deviation-center-line": 1.4193506366674866, "driven_lanedir_consec": 2.185898306675539}}
simulation-passed	1
survival_time_max	19.900000000000148
survival_time_mean	19.900000000000148
survival_time_min	19.900000000000148

No reset possible

14493

1040

Bea Baselines 🐤

baseline-duckietown

sim-2of4

success

2022-11-24 00:56:14+00:00

2022-11-24 01:02:21+00:00

0:06:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0
deviation-center-line_median	0.8949084199908675

other stats

deviation-center-line_max	0.8949084199908675
deviation-center-line_mean	0.8949084199908675
deviation-center-line_min	0.8949084199908675
deviation-heading_max	32.249113233675025
deviation-heading_mean	32.249113233675025
deviation-heading_median	32.249113233675025
deviation-heading_min	32.249113233675025
distance-from-start_max	4.002966042486721e-16
distance-from-start_mean	4.002966042486721e-16
distance-from-start_median	4.002966042486721e-16
distance-from-start_min	4.002966042486721e-16
driven_any_max	4.803559250983913e-13
driven_any_mean	4.803559250983913e-13
driven_any_median	4.803559250983913e-13
driven_any_min	4.803559250983913e-13
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop2-000-ego0": {"driven_any": 4.803559250983913e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.002966042486721e-16, "deviation-center-line": 0.8949084199908675, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14488

1041

Bea Baselines 🐤

baseline-duckietown

sim-0of4

success

2022-11-24 00:45:00+00:00

2022-11-24 00:55:53+00:00

0:10:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0
deviation-center-line_median	0.8949224973854444

other stats

deviation-center-line_max	0.8949224973854444
deviation-center-line_mean	0.8949224973854444
deviation-center-line_min	0.8949224973854444
deviation-heading_max	32.249113233675025
deviation-heading_mean	32.249113233675025
deviation-heading_median	32.249113233675025
deviation-heading_min	32.249113233675025
distance-from-start_max	0.0
distance-from-start_mean	0.0
distance-from-start_median	0.0
distance-from-start_min	0.0
driven_any_max	0.0
driven_any_mean	0.0
driven_any_median	0.0
driven_any_min	0.0
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"udem-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 0.0, "deviation-center-line": 0.8949224973854444, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14483

1042

Bea Baselines 🐤

baseline-duckietown

sim-0of4

success

2022-11-24 00:39:48+00:00

2022-11-24 00:44:53+00:00

0:05:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0
deviation-center-line_median	0.8949116056299162

other stats

deviation-center-line_max	0.8949116056299162
deviation-center-line_mean	0.8949116056299162
deviation-center-line_min	0.8949116056299162
deviation-heading_max	32.249113233675025
deviation-heading_mean	32.249113233675025
deviation-heading_median	32.249113233675025
deviation-heading_min	32.249113233675025
distance-from-start_max	4.965068306494546e-16
distance-from-start_mean	4.965068306494546e-16
distance-from-start_median	4.965068306494546e-16
distance-from-start_min	4.965068306494546e-16
driven_any_max	5.95808196779335e-13
driven_any_mean	5.95808196779335e-13
driven_any_median	5.95808196779335e-13
driven_any_min	5.95808196779335e-13
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"4way-000-ego0": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.8949116056299162, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14481

1043

Bea Baselines 🐤

baseline-duckietown

sim-2of4

success

2022-11-24 00:37:47+00:00

2022-11-24 00:39:27+00:00

0:01:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

14477

1044

Bea Baselines 🐤

baseline-duckietown

sim-2of4

success

2022-11-24 00:30:17+00:00

2022-11-24 00:37:10+00:00

0:06:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0
deviation-center-line_median	1.5116931584219764

other stats

deviation-center-line_max	2.128491974247649
deviation-center-line_mean	1.5116931584219764
deviation-center-line_min	0.8948943425963037
deviation-heading_max	32.249113233675025
deviation-heading_mean	31.48103999887634
deviation-heading_median	31.48103999887634
deviation-heading_min	30.712966764077652
distance-from-start_max	3.1401849173675503e-16
distance-from-start_mean	2.2639818490744983e-16
distance-from-start_median	2.2639818490744983e-16
distance-from-start_min	1.3877787807814454e-16
driven_any_max	3.7682219008410875e-13
driven_any_mean	2.716778218889411e-13
driven_any_median	2.716778218889411e-13
driven_any_min	1.665334536937735e-13
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop2-000-ego0": {"driven_any": 1.665334536937735e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 1.3877787807814454e-16, "deviation-center-line": 0.8948943425963037, "driven_lanedir_consec": 0.0}, "loop2-000-ego1": {"driven_any": 3.7682219008410875e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 3.1401849173675503e-16, "deviation-center-line": 2.128491974247649, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14473

1045

Bea Baselines 🐤

baseline-duckietown

sim-3of4

success

2022-11-24 00:24:11+00:00

2022-11-24 00:30:10+00:00

0:05:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	-0.0001341007006772088
deviation-center-line_median	0.8948981997384439

other stats

deviation-center-line_max	0.8948981997384439
deviation-center-line_mean	0.8948981997384439
deviation-center-line_min	0.8948981997384439
deviation-heading_max	32.24913278691421
deviation-heading_mean	32.24913278691421
deviation-heading_median	32.24913278691421
deviation-heading_min	32.24913278691421
distance-from-start_max	5.551115123125783e-17
distance-from-start_mean	5.551115123125783e-17
distance-from-start_median	5.551115123125783e-17
distance-from-start_min	5.551115123125783e-17
driven_any_max	6.661338147750939e-14
driven_any_mean	6.661338147750939e-14
driven_any_median	6.661338147750939e-14
driven_any_min	6.661338147750939e-14
driven_lanedir_consec_max	-0.0001341007006772088
driven_lanedir_consec_mean	-0.0001341007006772088
driven_lanedir_consec_min	-0.0001341007006772088
driven_lanedir_max	-0.0001341007006772088
driven_lanedir_mean	-0.0001341007006772088
driven_lanedir_median	-0.0001341007006772088
driven_lanedir_min	-0.0001341007006772088
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"zigzag-000-ego0": {"driven_any": 6.661338147750939e-14, "survival_time": 59.99999999999873, "driven_lanedir": -0.0001341007006772088, "in-drivable-lane": 0.0, "deviation-heading": 32.24913278691421, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.8948981997384439, "driven_lanedir_consec": -0.0001341007006772088}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14467

1057

Bea Baselines 🐤

baseline-duckietown

sim-2of4

success

2022-11-24 00:17:36+00:00

2022-11-24 00:23:43+00:00

0:06:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0
deviation-center-line_median	0.4065134212579011

other stats

deviation-center-line_max	0.4065134212579011
deviation-center-line_mean	0.4065134212579011
deviation-center-line_min	0.4065134212579011
deviation-heading_max	40.967332753486225
deviation-heading_mean	40.967332753486225
deviation-heading_median	40.967332753486225
deviation-heading_min	40.967332753486225
distance-from-start_max	2.7755575615628914e-17
distance-from-start_mean	2.7755575615628914e-17
distance-from-start_median	2.7755575615628914e-17
distance-from-start_min	2.7755575615628914e-17
driven_any_max	3.3306690738754696e-14
driven_any_mean	3.3306690738754696e-14
driven_any_median	3.3306690738754696e-14
driven_any_min	3.3306690738754696e-14
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop2-000-ego0": {"driven_any": 3.3306690738754696e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 2.7755575615628914e-17, "deviation-center-line": 0.4065134212579011, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14462

1058

Bea Baselines 🐤

baseline-duckietown

sim-1of4

success

2022-11-24 00:06:58+00:00

2022-11-24 00:17:22+00:00

0:10:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0
deviation-center-line_median	0.4065243130134252

other stats

deviation-center-line_max	0.4065243130134252
deviation-center-line_mean	0.4065243130134252
deviation-center-line_min	0.4065243130134252
deviation-heading_max	40.967332753486254
deviation-heading_mean	40.967332753486254
deviation-heading_median	40.967332753486254
deviation-heading_min	40.967332753486254
distance-from-start_max	5.551115123125783e-17
distance-from-start_mean	5.551115123125783e-17
distance-from-start_median	5.551115123125783e-17
distance-from-start_min	5.551115123125783e-17
driven_any_max	6.661338147750939e-14
driven_any_mean	6.661338147750939e-14
driven_any_median	6.661338147750939e-14
driven_any_min	6.661338147750939e-14
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"4way-000-ego0": {"driven_any": 6.661338147750939e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.4065243130134252, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14459

1059

Bea Baselines 🐤

baseline-duckietown

sim-2of4

success

2022-11-24 00:04:49+00:00

2022-11-24 00:06:27+00:00

0:01:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

14451

1061

Bea Baselines 🐤

baseline-duckietown

sim-1of4

success

2022-11-23 23:52:08+00:00

2022-11-24 00:04:31+00:00

0:12:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0
deviation-center-line_median	1.5845005055688632

other stats

deviation-center-line_max	3.4684039432595792
deviation-center-line_mean	1.7151303582606574
deviation-center-line_min	0.22311647864532352
deviation-heading_max	40.967332753486254
deviation-heading_mean	25.437951450471505
deviation-heading_median	28.066180210798333
deviation-heading_min	4.652112626803104
distance-from-start_max	6.280369834735102e-16
distance-from-start_mean	4.754249828401435e-16
distance-from-start_median	4.702980202497586e-16
distance-from-start_min	3.3306690738754696e-16
driven_any_max	7.536443801682175e-13
driven_any_mean	5.70509979408171e-13
driven_any_median	5.643576242997049e-13
driven_any_min	3.9968028886505635e-13
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"4way-000-ego0": {"driven_any": 3.9968028886505635e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 3.3306690738754696e-16, "deviation-center-line": 0.40652749865251137, "driven_lanedir_consec": 0.0}, "4way-000-ego1": {"driven_any": 7.536443801682175e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005143, "distance-from-start": 6.280369834735102e-16, "deviation-center-line": 3.4684039432595792, "driven_lanedir_consec": 0.0}, "4way-000-ego2": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 4.652112626803104, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.22311647864532352, "driven_lanedir_consec": 0.0}, "4way-000-ego3": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 2.762473512485215, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14449

1061

Bea Baselines 🐤

baseline-duckietown

sim-3of4

success

2022-11-23 23:50:07+00:00

2022-11-23 23:51:56+00:00

0:01:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

14448

1061

Bea Baselines 🐤

baseline-duckietown

sim-2of4

success

2022-11-23 23:48:18+00:00

2022-11-23 23:49:45+00:00

0:01:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

14443

1063

Bea Baselines 🐤

baseline-duckietown

sim-1of4

success

aido-LFVI-full-sim-validation

2022-11-23 23:41:42+00:00

2022-11-23 23:47:51+00:00

0:06:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0
deviation-center-line_median	0.4065147560962461

other stats

deviation-center-line_max	0.4065147560962461
deviation-center-line_mean	0.4065147560962461
deviation-center-line_min	0.4065147560962461
deviation-heading_max	40.967332753486225
deviation-heading_mean	40.967332753486225
deviation-heading_median	40.967332753486225
deviation-heading_min	40.967332753486225
distance-from-start_max	5.551115123125783e-17
distance-from-start_mean	5.551115123125783e-17
distance-from-start_median	5.551115123125783e-17
distance-from-start_min	5.551115123125783e-17
driven_any_max	6.661338147750939e-14
driven_any_mean	6.661338147750939e-14
driven_any_median	6.661338147750939e-14
driven_any_min	6.661338147750939e-14
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop-000-ego0": {"driven_any": 6.661338147750939e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.4065147560962461, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14423

1207

Bea Baselines 🐤

minimal-agent-full

sim-0of4

success

aido-LFP-full-sim-validation

2022-11-23 23:15:35+00:00

2022-11-23 23:24:40+00:00

0:09:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	49.699999999999314
in-drivable-lane_median	1.1000000000000156
driven_lanedir_consec_median	2.825725124357286
deviation-center-line_median	4.868938294800302

other stats

deviation-center-line_max	4.868938294800302
deviation-center-line_mean	4.868938294800302
deviation-center-line_min	4.868938294800302
deviation-heading_max	2.920667575049727
deviation-heading_mean	2.920667575049727
deviation-heading_median	2.920667575049727
deviation-heading_min	2.920667575049727
distance-from-start_max	2.1386574023523237
distance-from-start_mean	2.1386574023523237
distance-from-start_median	2.1386574023523237
distance-from-start_min	2.1386574023523237
driven_any_max	2.8865963267498715
driven_any_mean	2.8865963267498715
driven_any_median	2.8865963267498715
driven_any_min	2.8865963267498715
driven_lanedir_consec_max	2.825725124357286
driven_lanedir_consec_mean	2.825725124357286
driven_lanedir_consec_min	2.825725124357286
driven_lanedir_max	2.825725124357286
driven_lanedir_mean	2.825725124357286
driven_lanedir_median	2.825725124357286
driven_lanedir_min	2.825725124357286
in-drivable-lane_max	1.1000000000000156
in-drivable-lane_mean	1.1000000000000156
in-drivable-lane_min	1.1000000000000156
per-episodes	details {"udem-000-ego0": {"driven_any": 2.8865963267498715, "survival_time": 49.699999999999314, "driven_lanedir": 2.825725124357286, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.920667575049727, "distance-from-start": 2.1386574023523237, "deviation-center-line": 4.868938294800302, "driven_lanedir_consec": 2.825725124357286}}
simulation-passed	1
survival_time_max	49.699999999999314
survival_time_mean	49.699999999999314
survival_time_min	49.699999999999314

No reset possible

14419

1208

Bea Baselines 🐤

minimal-agent-full

sim-3of4

success

aido-LFV_multi-full-sim-validation

2022-11-23 23:09:42+00:00

2022-11-23 23:15:03+00:00

0:05:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	48.599999999999376
in-drivable-lane_median	3.099999999999902
driven_lanedir_consec_median	2.1822085786120473
deviation-center-line_median	4.281969506383752

other stats

deviation-center-line_max	4.281969506383752
deviation-center-line_mean	4.281969506383752
deviation-center-line_min	4.281969506383752
deviation-heading_max	8.956926170181262
deviation-heading_mean	8.956926170181262
deviation-heading_median	8.956926170181262
deviation-heading_min	8.956926170181262
distance-from-start_max	1.84932503046977
distance-from-start_mean	1.84932503046977
distance-from-start_median	1.84932503046977
distance-from-start_min	1.84932503046977
driven_any_max	2.760582128240964
driven_any_mean	2.760582128240964
driven_any_median	2.760582128240964
driven_any_min	2.760582128240964
driven_lanedir_consec_max	2.1822085786120473
driven_lanedir_consec_mean	2.1822085786120473
driven_lanedir_consec_min	2.1822085786120473
driven_lanedir_max	2.5502818256429407
driven_lanedir_mean	2.5502818256429407
driven_lanedir_median	2.5502818256429407
driven_lanedir_min	2.5502818256429407
in-drivable-lane_max	3.099999999999902
in-drivable-lane_mean	3.099999999999902
in-drivable-lane_min	3.099999999999902
per-episodes	details {"zigzag-000-ego0": {"driven_any": 2.760582128240964, "survival_time": 48.599999999999376, "driven_lanedir": 2.5502818256429407, "in-drivable-lane": 3.099999999999902, "deviation-heading": 8.956926170181262, "distance-from-start": 1.84932503046977, "deviation-center-line": 4.281969506383752, "driven_lanedir_consec": 2.1822085786120473}}
simulation-passed	1
survival_time_max	48.599999999999376
survival_time_mean	48.599999999999376
survival_time_min	48.599999999999376

No reset possible

14410

1211

Bea Baselines 🐤

minimal-agent-full

sim-3of4

success

aido-LFV_multi-full-sim-validation

2022-11-23 22:51:16+00:00

2022-11-23 23:09:09+00:00

0:17:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	4.349999999999863
driven_lanedir_consec_median	2.2674023788849116
deviation-center-line_median	5.536893088323296

other stats

deviation-center-line_max	5.653870952725518
deviation-center-line_mean	5.457974501938994
deviation-center-line_min	5.104240878383868
deviation-heading_max	10.449364417109743
deviation-heading_mean	10.11792868792557
deviation-heading_median	10.098710996708824
deviation-heading_min	9.824928341174887
distance-from-start_max	2.5614095423342453
distance-from-start_mean	2.0332734037963895
distance-from-start_median	2.023972936634097
distance-from-start_min	1.523738199583119
driven_any_max	3.4820813210684833
driven_any_mean	3.4569958269192997
driven_any_median	3.4490866130099316
driven_any_min	3.447728760588852
driven_lanedir_consec_max	3.143458087423762
driven_lanedir_consec_mean	2.322116699583174
driven_lanedir_consec_min	1.610203953139111
driven_lanedir_max	3.2610750728685343
driven_lanedir_mean	3.200371790495466
driven_lanedir_median	3.1833277569609386
driven_lanedir_min	3.173756575191452
in-drivable-lane_max	4.399999999999963
in-drivable-lane_mean	4.0874999999999115
in-drivable-lane_min	3.249999999999958
per-episodes	details {"zigzag-000-ego0": {"driven_any": 3.4490933302185676, "survival_time": 59.99999999999873, "driven_lanedir": 3.182424665546428, "in-drivable-lane": 4.3499999999998415, "deviation-heading": 10.087643041980582, "distance-from-start": 2.5614095423342453, "deviation-center-line": 5.533862530350289, "driven_lanedir_consec": 3.143458087423762}, "zigzag-000-ego1": {"driven_any": 3.447728760588852, "survival_time": 59.99999999999873, "driven_lanedir": 3.173756575191452, "in-drivable-lane": 4.399999999999963, "deviation-heading": 10.449364417109743, "distance-from-start": 1.5342133784714156, "deviation-center-line": 5.653870952725518, "driven_lanedir_consec": 1.6329981415649488}, "zigzag-000-ego2": {"driven_any": 3.4820813210684833, "survival_time": 59.99999999999873, "driven_lanedir": 3.2610750728685343, "in-drivable-lane": 3.249999999999958, "deviation-heading": 10.109778951437065, "distance-from-start": 1.523738199583119, "deviation-center-line": 5.104240878383868, "driven_lanedir_consec": 1.610203953139111}, "zigzag-000-ego3": {"driven_any": 3.4490798958012956, "survival_time": 59.99999999999873, "driven_lanedir": 3.184230848375449, "in-drivable-lane": 4.349999999999884, "deviation-heading": 9.824928341174887, "distance-from-start": 2.5137324947967783, "deviation-center-line": 5.5399236462963035, "driven_lanedir_consec": 2.901806616204875}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14407

1211

Bea Baselines 🐤

minimal-agent-full

sim-2of4

success

aido-LFVI_multi-full-sim-validation

2022-11-23 22:45:19+00:00

2022-11-23 22:51:10+00:00

0:05:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	41.949999999999754
in-drivable-lane_median	2.0999999999999854
driven_lanedir_consec_median	1.6184374408409197
deviation-center-line_median	5.314566823663881

other stats

deviation-center-line_max	5.605898707577726
deviation-center-line_mean	5.314566823663881
deviation-center-line_min	5.0232349397500355
deviation-heading_max	12.492151788067773
deviation-heading_mean	8.7311003580401
deviation-heading_median	8.7311003580401
deviation-heading_min	4.970048928012427
distance-from-start_max	1.619836734308344
distance-from-start_mean	1.309141287354286
distance-from-start_median	1.309141287354286
distance-from-start_min	0.998445840400228
driven_any_max	2.3617420337632864
driven_any_mean	1.724083393442756
driven_any_median	1.724083393442756
driven_any_min	1.0864247531222258
driven_lanedir_consec_max	2.2050573724797125
driven_lanedir_consec_mean	1.6184374408409197
driven_lanedir_consec_min	1.031817509202127
driven_lanedir_max	2.2050573724797125
driven_lanedir_mean	1.6184374408409197
driven_lanedir_median	1.6184374408409197
driven_lanedir_min	1.031817509202127
in-drivable-lane_max	3.0999999999999552
in-drivable-lane_mean	2.0999999999999854
in-drivable-lane_min	1.1000000000000156
per-episodes	details {"loop2-000-ego0": {"driven_any": 1.0864247531222258, "survival_time": 41.949999999999754, "driven_lanedir": 1.031817509202127, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 12.492151788067773, "distance-from-start": 0.998445840400228, "deviation-center-line": 5.605898707577726, "driven_lanedir_consec": 1.031817509202127}, "loop2-000-ego1": {"driven_any": 2.3617420337632864, "survival_time": 41.949999999999754, "driven_lanedir": 2.2050573724797125, "in-drivable-lane": 3.0999999999999552, "deviation-heading": 4.970048928012427, "distance-from-start": 1.619836734308344, "deviation-center-line": 5.0232349397500355, "driven_lanedir_consec": 2.2050573724797125}}
simulation-passed	1
survival_time_max	41.949999999999754
survival_time_mean	41.949999999999754
survival_time_min	41.949999999999754

No reset possible

14404

1212

Bea Baselines 🐤

minimal-agent-full

sim-2of4

success

aido-LF-full-sim-validation

2022-11-23 22:43:31+00:00

2022-11-23 22:44:59+00:00

0:01:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

14399

1213

Bea Baselines 🐤

minimal-agent-full

sim-3of4

success

aido-LFVI-full-sim-testing

2022-11-23 22:37:08+00:00

2022-11-23 22:43:14+00:00

0:06:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	5.099999999999877
driven_lanedir_consec_median	2.89181051149263
deviation-center-line_median	5.68144547559899

other stats

deviation-center-line_max	5.68144547559899
deviation-center-line_mean	5.68144547559899
deviation-center-line_min	5.68144547559899
deviation-heading_max	11.49374085929236
deviation-heading_mean	11.49374085929236
deviation-heading_median	11.49374085929236
deviation-heading_min	11.49374085929236
distance-from-start_max	2.522917038266831
distance-from-start_mean	2.522917038266831
distance-from-start_median	2.522917038266831
distance-from-start_min	2.522917038266831
driven_any_max	3.426575056819777
driven_any_mean	3.426575056819777
driven_any_median	3.426575056819777
driven_any_min	3.426575056819777
driven_lanedir_consec_max	2.89181051149263
driven_lanedir_consec_mean	2.89181051149263
driven_lanedir_consec_min	2.89181051149263
driven_lanedir_max	3.0975603398117015
driven_lanedir_mean	3.0975603398117015
driven_lanedir_median	3.0975603398117015
driven_lanedir_min	3.0975603398117015
in-drivable-lane_max	5.099999999999877
in-drivable-lane_mean	5.099999999999877
in-drivable-lane_min	5.099999999999877
per-episodes	details {"zigzag-000-ego0": {"driven_any": 3.426575056819777, "survival_time": 59.99999999999873, "driven_lanedir": 3.0975603398117015, "in-drivable-lane": 5.099999999999877, "deviation-heading": 11.49374085929236, "distance-from-start": 2.522917038266831, "deviation-center-line": 5.68144547559899, "driven_lanedir_consec": 2.89181051149263}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14397

1214

Bea Baselines 🐤

minimal-agent-full

sim-2of4

success

aido-LFVI-full-sim-testing

2022-11-23 22:35:08+00:00

2022-11-23 22:37:01+00:00

0:01:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

14395

1214

Bea Baselines 🐤

minimal-agent-full

sim-3of4

success

aido-LFV-full-sim-testing

2022-11-23 22:33:13+00:00

2022-11-23 22:34:49+00:00

0:01:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

14390

1216

Bea Baselines 🐤

minimal-agent-full

sim-2of4

success

aido-LFI-full-sim-testing

2022-11-23 22:26:39+00:00

2022-11-23 22:32:59+00:00

0:06:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	4.349999999999895
driven_lanedir_consec_median	2.091626784820886
deviation-center-line_median	5.917240573756968

other stats

deviation-center-line_max	5.917240573756968
deviation-center-line_mean	5.917240573756968
deviation-center-line_min	5.917240573756968
deviation-heading_max	8.389433025698892
deviation-heading_mean	8.389433025698892
deviation-heading_median	8.389433025698892
deviation-heading_min	8.389433025698892
distance-from-start_max	1.0307831250305386
distance-from-start_mean	1.0307831250305386
distance-from-start_median	1.0307831250305386
distance-from-start_min	1.0307831250305386
driven_any_max	3.4490819837243656
driven_any_mean	3.4490819837243656
driven_any_median	3.4490819837243656
driven_any_min	3.4490819837243656
driven_lanedir_consec_max	2.091626784820886
driven_lanedir_consec_mean	2.091626784820886
driven_lanedir_consec_min	2.091626784820886
driven_lanedir_max	3.203992280226659
driven_lanedir_mean	3.203992280226659
driven_lanedir_median	3.203992280226659
driven_lanedir_min	3.203992280226659
in-drivable-lane_max	4.349999999999895
in-drivable-lane_mean	4.349999999999895
in-drivable-lane_min	4.349999999999895
per-episodes	details {"loop2-000-ego0": {"driven_any": 3.4490819837243656, "survival_time": 59.99999999999873, "driven_lanedir": 3.203992280226659, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.389433025698892, "distance-from-start": 1.0307831250305386, "deviation-center-line": 5.917240573756968, "driven_lanedir_consec": 2.091626784820886}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14386

1217

Bea Baselines 🐤

minimal-agent-full

sim-0of4

success

aido-LFV_multi-full-sim-testing

2022-11-23 22:20:21+00:00

2022-11-23 22:26:27+00:00

0:06:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	3.292103748604663
deviation-center-line_median	4.949281369491427

other stats

deviation-center-line_max	4.949281369491427
deviation-center-line_mean	4.949281369491427
deviation-center-line_min	4.949281369491427
deviation-heading_max	5.605546349563034
deviation-heading_mean	5.605546349563034
deviation-heading_median	5.605546349563034
deviation-heading_min	5.605546349563034
distance-from-start_max	2.278496107947562
distance-from-start_mean	2.278496107947562
distance-from-start_median	2.278496107947562
distance-from-start_min	2.278496107947562
driven_any_max	3.5795858026067657
driven_any_mean	3.5795858026067657
driven_any_median	3.5795858026067657
driven_any_min	3.5795858026067657
driven_lanedir_consec_max	3.292103748604663
driven_lanedir_consec_mean	3.292103748604663
driven_lanedir_consec_min	3.292103748604663
driven_lanedir_max	3.53367274833897
driven_lanedir_mean	3.53367274833897
driven_lanedir_median	3.53367274833897
driven_lanedir_min	3.53367274833897
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"4way-000-ego0": {"driven_any": 3.5795858026067657, "survival_time": 59.99999999999873, "driven_lanedir": 3.53367274833897, "in-drivable-lane": 0.0, "deviation-heading": 5.605546349563034, "distance-from-start": 2.278496107947562, "deviation-center-line": 4.949281369491427, "driven_lanedir_consec": 3.292103748604663}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14381

1218

Bea Baselines 🐤

minimal-agent-full

sim-1of4

success

aido-LFVI_multi-full-sim-testing

2022-11-23 22:05:09+00:00

2022-11-23 22:20:07+00:00

0:14:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	1.5250000000000004
driven_lanedir_consec_median	3.406408562624881
deviation-center-line_median	6.266768623971568

other stats

deviation-center-line_max	7.117542782609248
deviation-center-line_mean	6.142154630645523
deviation-center-line_min	4.91753849202971
deviation-heading_max	7.697145560292741
deviation-heading_mean	6.307290167834601
deviation-heading_median	7.224037098686265
deviation-heading_min	3.0839409136731364
distance-from-start_max	2.99468876105913
distance-from-start_mean	2.7483388598984284
distance-from-start_median	2.8894993963916855
distance-from-start_min	2.2196678857512127
driven_any_max	3.579597577109405
driven_any_mean	3.5248411750169293
driven_any_median	3.5338399362754243
driven_any_min	3.4520872504074633
driven_lanedir_consec_max	3.561467582428756
driven_lanedir_consec_mean	3.3987951569791877
driven_lanedir_consec_min	3.220895920238234
driven_lanedir_max	3.561467582428756
driven_lanedir_mean	3.3987951569791877
driven_lanedir_median	3.406408562624881
driven_lanedir_min	3.220895920238234
in-drivable-lane_max	4.249999999999897
in-drivable-lane_mean	1.8249999999999744
in-drivable-lane_min	0.0
per-episodes	details {"loop-000-ego0": {"driven_any": 3.579597577109405, "survival_time": 59.99999999999873, "driven_lanedir": 3.561467582428756, "in-drivable-lane": 0.0, "deviation-heading": 3.0839409136731364, "distance-from-start": 2.99468876105913, "deviation-center-line": 6.841254966965407, "driven_lanedir_consec": 3.561467582428756}, "loop-000-ego1": {"driven_any": 3.4520872504074633, "survival_time": 59.99999999999873, "driven_lanedir": 3.220895920238234, "in-drivable-lane": 4.249999999999897, "deviation-heading": 7.290457220494497, "distance-from-start": 2.2196678857512127, "deviation-center-line": 7.117542782609248, "driven_lanedir_consec": 3.220895920238234}, "loop-000-ego2": {"driven_any": 3.5465917398544935, "survival_time": 59.99999999999873, "driven_lanedir": 3.44715177737184, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 7.1576169768780336, "distance-from-start": 2.7896290117542013, "deviation-center-line": 4.91753849202971, "driven_lanedir_consec": 3.44715177737184}, "loop-000-ego3": {"driven_any": 3.521088132696355, "survival_time": 59.99999999999873, "driven_lanedir": 3.365665347877921, "in-drivable-lane": 1.949999999999985, "deviation-heading": 7.697145560292741, "distance-from-start": 2.98936978102917, "deviation-center-line": 5.692282280977729, "driven_lanedir_consec": 3.365665347877921}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14378

1219

Bea Baselines 🐤

minimal-agent-full

sim-3of4

success

aido-LF-full-sim-testing

2022-11-23 22:03:36+00:00

2022-11-23 22:05:03+00:00

0:01:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

14374

1220

Bea Baselines 🐤

minimal-agent-full

sim-0of4

success

2022-11-23 21:59:20+00:00

2022-11-23 22:03:16+00:00

0:03:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	45.14999999999957
in-drivable-lane_median	0.0
driven_lanedir_consec_median	2.6286605295435175
deviation-center-line_median	4.749421103903259

other stats

deviation-center-line_max	4.749421103903259
deviation-center-line_mean	4.749421103903259
deviation-center-line_min	4.749421103903259
deviation-heading_max	3.0022009770680675
deviation-heading_mean	3.0022009770680675
deviation-heading_median	3.0022009770680675
deviation-heading_min	3.0022009770680675
distance-from-start_max	2.133910144488872
distance-from-start_mean	2.133910144488872
distance-from-start_median	2.133910144488872
distance-from-start_min	2.133910144488872
driven_any_max	2.6465975863112976
driven_any_mean	2.6465975863112976
driven_any_median	2.6465975863112976
driven_any_min	2.6465975863112976
driven_lanedir_consec_max	2.6286605295435175
driven_lanedir_consec_mean	2.6286605295435175
driven_lanedir_consec_min	2.6286605295435175
driven_lanedir_max	2.6286605295435175
driven_lanedir_mean	2.6286605295435175
driven_lanedir_median	2.6286605295435175
driven_lanedir_min	2.6286605295435175
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"autolab-000-ego0": {"driven_any": 2.6465975863112976, "survival_time": 45.14999999999957, "driven_lanedir": 2.6286605295435175, "in-drivable-lane": 0.0, "deviation-heading": 3.0022009770680675, "distance-from-start": 2.133910144488872, "deviation-center-line": 4.749421103903259, "driven_lanedir_consec": 2.6286605295435175}}
simulation-passed	1
survival_time_max	45.14999999999957
survival_time_mean	45.14999999999957
survival_time_min	45.14999999999957

No reset possible

14367

1222

Bea Baselines 🐤

minimal-agent-state

sim-3of4

success

2022-11-23 21:54:32+00:00

2022-11-23 21:58:51+00:00

0:04:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	4.349999999999895
driven_lanedir_consec_median	1.3850760857666788
deviation-center-line_median	5.586765713943565

other stats

deviation-center-line_max	5.586765713943565
deviation-center-line_mean	5.586765713943565
deviation-center-line_min	5.586765713943565
deviation-heading_max	8.627279155437556
deviation-heading_mean	8.627279155437556
deviation-heading_median	8.627279155437556
deviation-heading_min	8.627279155437556
distance-from-start_max	1.0494474660975028
distance-from-start_mean	1.0494474660975028
distance-from-start_median	1.0494474660975028
distance-from-start_min	1.0494474660975028
driven_any_max	3.449081931991406
driven_any_mean	3.449081931991406
driven_any_median	3.449081931991406
driven_any_min	3.449081931991406
driven_lanedir_consec_max	1.3850760857666788
driven_lanedir_consec_mean	1.3850760857666788
driven_lanedir_consec_min	1.3850760857666788
driven_lanedir_max	3.20200785319052
driven_lanedir_mean	3.20200785319052
driven_lanedir_median	3.20200785319052
driven_lanedir_min	3.20200785319052
in-drivable-lane_max	4.349999999999895
in-drivable-lane_mean	4.349999999999895
in-drivable-lane_min	4.349999999999895
per-episodes	details {"zigzag-000-ego0": {"driven_any": 3.449081931991406, "survival_time": 59.99999999999873, "driven_lanedir": 3.20200785319052, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.627279155437556, "distance-from-start": 1.0494474660975028, "deviation-center-line": 5.586765713943565, "driven_lanedir_consec": 1.3850760857666788}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14360

1224

Bea Baselines 🐤

minimal-agent-state

sim-3of4

success

2022-11-23 21:44:33+00:00

2022-11-23 21:54:26+00:00

0:09:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	3.0889200570209905
deviation-center-line_median	4.314589046654948

other stats

deviation-center-line_max	4.8936832240285515
deviation-center-line_mean	4.21123266117369
deviation-center-line_min	3.322069327356314
deviation-heading_max	4.486523530569267
deviation-heading_mean	3.521671102618294
deviation-heading_median	3.585810169469168
deviation-heading_min	2.4285405409655727
distance-from-start_max	2.3451607383802098
distance-from-start_mean	2.0486952679802566
distance-from-start_median	2.129939218686506
distance-from-start_min	1.5897418961678045
driven_any_max	3.5795869614824305
driven_any_mean	3.25109025299247
driven_any_median	3.2660893638644968
driven_any_min	2.8925953227584573
driven_lanedir_consec_max	3.397941501351981
driven_lanedir_consec_mean	3.109352247171395
driven_lanedir_consec_min	2.8616273732916166
driven_lanedir_max	3.5621601978351585
driven_lanedir_mean	3.221959634688333
driven_lanedir_median	3.226336335661105
driven_lanedir_min	2.873005669595961
in-drivable-lane_max	1.0999999999999377
in-drivable-lane_mean	0.27499999999998437
in-drivable-lane_min	0.0
per-episodes	details {"4way-001-ego0": {"driven_any": 2.9525969188333514, "survival_time": 59.99999999999873, "driven_lanedir": 2.895716604572407, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.4285405409655727, "distance-from-start": 2.3451607383802098, "deviation-center-line": 4.511140920492081, "driven_lanedir_consec": 2.895716415698084}, "4way-001-ego1": {"driven_any": 2.8925953227584573, "survival_time": 59.99999999999873, "driven_lanedir": 2.873005669595961, "in-drivable-lane": 0.0, "deviation-heading": 3.9504849161101903, "distance-from-start": 1.5897418961678045, "deviation-center-line": 4.8936832240285515, "driven_lanedir_consec": 2.8616273732916166}, "4way-001-ego2": {"driven_any": 3.5795869614824305, "survival_time": 59.99999999999873, "driven_lanedir": 3.556956066749803, "in-drivable-lane": 0.0, "deviation-heading": 4.486523530569267, "distance-from-start": 2.2859218093052247, "deviation-center-line": 4.1180371728178145, "driven_lanedir_consec": 3.397941501351981}, "4way-001-ego3": {"driven_any": 3.579581808895642, "survival_time": 59.99999999999873, "driven_lanedir": 3.5621601978351585, "in-drivable-lane": 0.0, "deviation-heading": 3.221135422828146, "distance-from-start": 1.9739566280677876, "deviation-center-line": 3.322069327356314, "driven_lanedir_consec": 3.282123698343897}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14354

1225

Bea Baselines 🐤

minimal-agent-state

sim-3of4

success

2022-11-23 21:34:17+00:00

2022-11-23 21:43:58+00:00

0:09:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	3.29523972955995
deviation-center-line_median	3.2365915346637033

other stats

deviation-center-line_max	3.2365915346637033
deviation-center-line_mean	3.2365915346637033
deviation-center-line_min	3.2365915346637033
deviation-heading_max	2.8126081910568588
deviation-heading_mean	2.8126081910568588
deviation-heading_median	2.8126081910568588
deviation-heading_min	2.8126081910568588
distance-from-start_max	2.0188492106698117
distance-from-start_mean	2.0188492106698117
distance-from-start_median	2.0188492106698117
distance-from-start_min	2.0188492106698117
driven_any_max	3.5795821627460884
driven_any_mean	3.5795821627460884
driven_any_median	3.5795821627460884
driven_any_min	3.5795821627460884
driven_lanedir_consec_max	3.29523972955995
driven_lanedir_consec_mean	3.29523972955995
driven_lanedir_consec_min	3.29523972955995
driven_lanedir_max	3.5654143377633662
driven_lanedir_mean	3.5654143377633662
driven_lanedir_median	3.5654143377633662
driven_lanedir_min	3.5654143377633662
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"4way-001-ego0": {"driven_any": 3.5795821627460884, "survival_time": 59.99999999999873, "driven_lanedir": 3.5654143377633662, "in-drivable-lane": 0.0, "deviation-heading": 2.8126081910568588, "distance-from-start": 2.0188492106698117, "deviation-center-line": 3.2365915346637033, "driven_lanedir_consec": 3.29523972955995}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14349

1227

Bea Baselines 🐤

minimal-agent-state

sim-3of4

success

2022-11-23 21:29:34+00:00

2022-11-23 21:34:09+00:00

0:04:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	52.74999999999914
in-drivable-lane_median	0.0
driven_lanedir_consec_median	3.049495028380312
deviation-center-line_median	4.252786905257612

other stats

deviation-center-line_max	4.252786905257612
deviation-center-line_mean	4.252786905257612
deviation-center-line_min	4.252786905257612
deviation-heading_max	7.335832537624176
deviation-heading_mean	7.335832537624176
deviation-heading_median	7.335832537624176
deviation-heading_min	7.335832537624176
distance-from-start_max	2.5590901305577565
distance-from-start_mean	2.5590901305577565
distance-from-start_median	2.5590901305577565
distance-from-start_min	2.5590901305577565
driven_any_max	3.10259355659584
driven_any_mean	3.10259355659584
driven_any_median	3.10259355659584
driven_any_min	3.10259355659584
driven_lanedir_consec_max	3.049495028380312
driven_lanedir_consec_mean	3.049495028380312
driven_lanedir_consec_min	3.049495028380312
driven_lanedir_max	3.049495028380312
driven_lanedir_mean	3.049495028380312
driven_lanedir_median	3.049495028380312
driven_lanedir_min	3.049495028380312
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"zigzag-000-ego0": {"driven_any": 3.10259355659584, "survival_time": 52.74999999999914, "driven_lanedir": 3.049495028380312, "in-drivable-lane": 0.0, "deviation-heading": 7.335832537624176, "distance-from-start": 2.5590901305577565, "deviation-center-line": 4.252786905257612, "driven_lanedir_consec": 3.049495028380312}}
simulation-passed	1
survival_time_max	52.74999999999914
survival_time_mean	52.74999999999914
survival_time_min	52.74999999999914

No reset possible

14344

1228

Bea Baselines 🐤

minimal-agent-state

sim-3of4

success

2022-11-23 21:24:41+00:00

2022-11-23 21:29:06+00:00

0:04:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	3.5026609949387937
deviation-center-line_median	4.00803286999595

other stats

deviation-center-line_max	4.00803286999595
deviation-center-line_mean	4.00803286999595
deviation-center-line_min	4.00803286999595
deviation-heading_max	9.741722574045852
deviation-heading_mean	9.741722574045852
deviation-heading_median	9.741722574045852
deviation-heading_min	9.741722574045852
distance-from-start_max	3.051215295455992
distance-from-start_mean	3.051215295455992
distance-from-start_median	3.051215295455992
distance-from-start_min	3.051215295455992
driven_any_max	3.579590602174237
driven_any_mean	3.579590602174237
driven_any_median	3.579590602174237
driven_any_min	3.579590602174237
driven_lanedir_consec_max	3.5026609949387937
driven_lanedir_consec_mean	3.5026609949387937
driven_lanedir_consec_min	3.5026609949387937
driven_lanedir_max	3.5026609949387937
driven_lanedir_mean	3.5026609949387937
driven_lanedir_median	3.5026609949387937
driven_lanedir_min	3.5026609949387937
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"zigzag-000-ego0": {"driven_any": 3.579590602174237, "survival_time": 59.99999999999873, "driven_lanedir": 3.5026609949387937, "in-drivable-lane": 0.0, "deviation-heading": 9.741722574045852, "distance-from-start": 3.051215295455992, "deviation-center-line": 4.00803286999595, "driven_lanedir_consec": 3.5026609949387937}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14336

1230

Bea Baselines 🐤

minimal-agent-state

sim-1of4

success

aido-LFVI-state-sim-testing

2022-11-23 21:14:23+00:00

2022-11-23 21:24:10+00:00

0:09:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.04999999999999716
driven_lanedir_consec_median	3.105242381638413
deviation-center-line_median	4.2838554583648385

other stats

deviation-center-line_max	6.480635029684861
deviation-center-line_mean	4.233458533023654
deviation-center-line_min	1.8854881856800791
deviation-heading_max	6.074433982916035
deviation-heading_mean	4.437287043141697
deviation-heading_median	4.190213879538641
deviation-heading_min	3.2942864305734707
distance-from-start_max	2.6219633070118125
distance-from-start_mean	2.3834433501492436
distance-from-start_median	2.3769915028957085
distance-from-start_min	2.157827087793745
driven_any_max	3.5765946322989515
driven_any_mean	3.229717557359504
driven_any_median	3.2158432856394445
driven_any_min	2.9105890258601756
driven_lanedir_consec_max	3.4606351955763963
driven_lanedir_consec_mean	3.0987684797264516
driven_lanedir_consec_min	2.723953960052584
driven_lanedir_max	3.5302995839808413
driven_lanedir_mean	3.1848735445261127
driven_lanedir_median	3.161506104690779
driven_lanedir_min	2.8861823847420505
in-drivable-lane_max	1.9499999999998892
in-drivable-lane_mean	0.5124999999999709
in-drivable-lane_min	0.0
per-episodes	details {"udem-000-ego0": {"driven_any": 2.9105890258601756, "survival_time": 59.99999999999873, "driven_lanedir": 2.8861823847420505, "in-drivable-lane": 0.0, "deviation-heading": 6.074433982916035, "distance-from-start": 2.157827087793745, "deviation-center-line": 3.0576160910267776, "driven_lanedir_consec": 2.723953960052584}, "udem-000-ego1": {"driven_any": 3.521095053928605, "survival_time": 59.99999999999873, "driven_lanedir": 3.4216564650122128, "in-drivable-lane": 1.9499999999998892, "deviation-heading": 3.2942864305734707, "distance-from-start": 2.6219633070118125, "deviation-center-line": 6.480635029684861, "driven_lanedir_consec": 3.4216564650122128}, "udem-000-ego2": {"driven_any": 2.9105915173502845, "survival_time": 59.99999999999873, "driven_lanedir": 2.9013557443693445, "in-drivable-lane": 0.0, "deviation-heading": 3.947864180395224, "distance-from-start": 2.395368409966694, "deviation-center-line": 1.8854881856800791, "driven_lanedir_consec": 2.7888282982646126}, "udem-000-ego3": {"driven_any": 3.5765946322989515, "survival_time": 59.99999999999873, "driven_lanedir": 3.5302995839808413, "in-drivable-lane": 0.09999999999999432, "deviation-heading": 4.432563578682058, "distance-from-start": 2.3586145958247235, "deviation-center-line": 5.5100948257029, "driven_lanedir_consec": 3.4606351955763963}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14333

1231

Bea Baselines 🐤

minimal-agent-state

sim-1of4

success

2022-11-23 21:09:37+00:00

2022-11-23 21:13:56+00:00

0:04:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	19.95000000000015
in-drivable-lane_median	0.0
driven_lanedir_consec_median	1.1174902161570546
deviation-center-line_median	1.2140705885565546

other stats

deviation-center-line_max	1.2140705885565546
deviation-center-line_mean	1.2140705885565546
deviation-center-line_min	1.2140705885565546
deviation-heading_max	2.8854089656463153
deviation-heading_mean	2.8854089656463153
deviation-heading_median	2.8854089656463153
deviation-heading_min	2.8854089656463153
distance-from-start_max	1.0329580261748834
distance-from-start_mean	1.0329580261748834
distance-from-start_median	1.0329580261748834
distance-from-start_min	1.0329580261748834
driven_any_max	1.134597717566756
driven_any_mean	1.134597717566756
driven_any_median	1.134597717566756
driven_any_min	1.134597717566756
driven_lanedir_consec_max	1.1174902161570546
driven_lanedir_consec_mean	1.1174902161570546
driven_lanedir_consec_min	1.1174902161570546
driven_lanedir_max	1.1174902161570546
driven_lanedir_mean	1.1174902161570546
driven_lanedir_median	1.1174902161570546
driven_lanedir_min	1.1174902161570546
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"udem-000-ego0": {"driven_any": 1.134597717566756, "survival_time": 19.95000000000015, "driven_lanedir": 1.1174902161570546, "in-drivable-lane": 0.0, "deviation-heading": 2.8854089656463153, "distance-from-start": 1.0329580261748834, "deviation-center-line": 1.2140705885565546, "driven_lanedir_consec": 1.1174902161570546}}
simulation-passed	1
survival_time_max	19.95000000000015
survival_time_mean	19.95000000000015
survival_time_min	19.95000000000015

No reset possible

14328

1232

Bea Baselines 🐤

minimal-agent-state

sim-1of4

success

2022-11-23 21:01:47+00:00

2022-11-23 21:09:22+00:00

0:07:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	1.7499999999999003
driven_lanedir_consec_median	3.413654775946143
deviation-center-line_median	5.825136539085346

other stats

deviation-center-line_max	7.271389663591529
deviation-center-line_mean	5.643680285819743
deviation-center-line_min	3.653058401516753
deviation-heading_max	7.874648432322972
deviation-heading_mean	6.124556829055049
deviation-heading_median	6.375210937656442
deviation-heading_min	3.873157008584335
distance-from-start_max	2.9910037406399708
distance-from-start_mean	2.647919639528748
distance-from-start_median	2.691628549092109
distance-from-start_min	2.2174177192908053
driven_any_max	3.546591928181605
driven_any_mean	3.512845634385255
driven_any_median	3.527100534458862
driven_any_min	3.4505895404416917
driven_lanedir_consec_max	3.4489608990054887
driven_lanedir_consec_mean	3.3789582924454376
driven_lanedir_consec_min	3.2395627188839757
driven_lanedir_max	3.4489608990054887
driven_lanedir_mean	3.3789582924454376
driven_lanedir_median	3.413654775946143
driven_lanedir_min	3.2395627188839757
in-drivable-lane_max	4.299999999999894
in-drivable-lane_mean	2.2249999999999277
in-drivable-lane_min	1.1000000000000156
per-episodes	details {"loop-000-ego0": {"driven_any": 3.543607782867822, "survival_time": 59.99999999999873, "driven_lanedir": 3.4359237462525183, "in-drivable-lane": 1.1999999999999318, "deviation-heading": 7.874648432322972, "distance-from-start": 2.7860421196308716, "deviation-center-line": 4.889961247945737, "driven_lanedir_consec": 3.4359237462525183}, "loop-000-ego1": {"driven_any": 3.4505895404416917, "survival_time": 59.99999999999873, "driven_lanedir": 3.2395627188839757, "in-drivable-lane": 4.299999999999894, "deviation-heading": 6.05385337048463, "distance-from-start": 2.2174177192908053, "deviation-center-line": 7.271389663591529, "driven_lanedir_consec": 3.2395627188839757}, "loop-000-ego2": {"driven_any": 3.546591928181605, "survival_time": 59.99999999999873, "driven_lanedir": 3.4489608990054887, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 6.696568504828256, "distance-from-start": 2.9910037406399708, "deviation-center-line": 3.653058401516753, "driven_lanedir_consec": 3.4489608990054887}, "loop-000-ego3": {"driven_any": 3.5105932860499025, "survival_time": 59.99999999999873, "driven_lanedir": 3.391385805639767, "in-drivable-lane": 2.2999999999998693, "deviation-heading": 3.873157008584335, "distance-from-start": 2.597214978553346, "deviation-center-line": 6.760311830224953, "driven_lanedir_consec": 3.391385805639767}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14324

1232

Bea Baselines 🐤

minimal-agent-state

sim-2of4

success

aido-LFV-state-sim-testing

2022-11-23 20:57:19+00:00

2022-11-23 21:01:40+00:00

0:04:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	3.3499999999998806
driven_lanedir_consec_median	2.380746158820441
deviation-center-line_median	6.07518739971563

other stats

deviation-center-line_max	6.5629821214913955
deviation-center-line_mean	6.07518739971563
deviation-center-line_min	5.587392677939865
deviation-heading_max	8.266160603781476
deviation-heading_mean	7.316254408081507
deviation-heading_median	7.316254408081507
deviation-heading_min	6.3663482123815385
distance-from-start_max	1.6314589686392718
distance-from-start_mean	1.433307130896814
distance-from-start_median	1.433307130896814
distance-from-start_min	1.235155293154356
driven_any_max	3.4865836169069464
driven_any_mean	3.479150653763286
driven_any_median	3.479150653763286
driven_any_min	3.471717690619625
driven_lanedir_consec_max	3.2882116374610164
driven_lanedir_consec_mean	2.380746158820441
driven_lanedir_consec_min	1.4732806801798657
driven_lanedir_max	3.2882116374610164
driven_lanedir_mean	3.2881134223745017
driven_lanedir_median	3.2881134223745017
driven_lanedir_min	3.2880152072879874
in-drivable-lane_max	3.5999999999997954
in-drivable-lane_mean	3.3499999999998806
in-drivable-lane_min	3.099999999999966
per-episodes	details {"loop2-000-ego0": {"driven_any": 3.471717690619625, "survival_time": 59.99999999999873, "driven_lanedir": 3.2882116374610164, "in-drivable-lane": 3.5999999999997954, "deviation-heading": 6.3663482123815385, "distance-from-start": 1.6314589686392718, "deviation-center-line": 6.5629821214913955, "driven_lanedir_consec": 3.2882116374610164}, "loop2-000-ego1": {"driven_any": 3.4865836169069464, "survival_time": 59.99999999999873, "driven_lanedir": 3.2880152072879874, "in-drivable-lane": 3.099999999999966, "deviation-heading": 8.266160603781476, "distance-from-start": 1.235155293154356, "deviation-center-line": 5.587392677939865, "driven_lanedir_consec": 1.4732806801798657}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14318

1234

Bea Baselines 🐤

minimal-agent-state

sim-1of4

success

2022-11-23 20:48:33+00:00

2022-11-23 20:57:13+00:00

0:08:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	1.249999999999929
driven_lanedir_consec_median	3.4642921416450347
deviation-center-line_median	6.136200161902763

other stats

deviation-center-line_max	6.136200161902763
deviation-center-line_mean	6.136200161902763
deviation-center-line_min	6.136200161902763
deviation-heading_max	4.680365944406787
deviation-heading_mean	4.680365944406787
deviation-heading_median	4.680365944406787
deviation-heading_min	4.680365944406787
distance-from-start_max	2.417373767628198
distance-from-start_mean	2.417373767628198
distance-from-start_median	2.417373767628198
distance-from-start_min	2.417373767628198
driven_any_max	3.542094542339661
driven_any_mean	3.542094542339661
driven_any_median	3.542094542339661
driven_any_min	3.542094542339661
driven_lanedir_consec_max	3.4642921416450347
driven_lanedir_consec_mean	3.4642921416450347
driven_lanedir_consec_min	3.4642921416450347
driven_lanedir_max	3.4642921416450347
driven_lanedir_mean	3.4642921416450347
driven_lanedir_median	3.4642921416450347
driven_lanedir_min	3.4642921416450347
in-drivable-lane_max	1.249999999999929
in-drivable-lane_mean	1.249999999999929
in-drivable-lane_min	1.249999999999929
per-episodes	details {"loop-000-ego0": {"driven_any": 3.542094542339661, "survival_time": 59.99999999999873, "driven_lanedir": 3.4642921416450347, "in-drivable-lane": 1.249999999999929, "deviation-heading": 4.680365944406787, "distance-from-start": 2.417373767628198, "deviation-center-line": 6.136200161902763, "driven_lanedir_consec": 3.4642921416450347}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14313

1237

Bea Baselines 🐤

minimal-agent

sim-1of4

success

2022-11-23 20:44:51+00:00

2022-11-23 20:48:13+00:00

0:03:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	12.700000000000044
in-drivable-lane_median	10.950000000000044
driven_lanedir_consec_median	0.19955171937759708
deviation-center-line_median	0.12567511082985278

other stats

deviation-center-line_max	0.12567511082985278
deviation-center-line_mean	0.12567511082985278
deviation-center-line_min	0.12567511082985278
deviation-heading_max	0.9488219555580464
deviation-heading_mean	0.9488219555580464
deviation-heading_median	0.9488219555580464
deviation-heading_min	0.9488219555580464
distance-from-start_max	1.924049384083022
distance-from-start_mean	1.924049384083022
distance-from-start_median	1.924049384083022
distance-from-start_min	1.924049384083022
driven_any_max	1.924195440713655
driven_any_mean	1.924195440713655
driven_any_median	1.924195440713655
driven_any_min	1.924195440713655
driven_lanedir_consec_max	0.19955171937759708
driven_lanedir_consec_mean	0.19955171937759708
driven_lanedir_consec_min	0.19955171937759708
driven_lanedir_max	0.19955171937759708
driven_lanedir_mean	0.19955171937759708
driven_lanedir_median	0.19955171937759708
driven_lanedir_min	0.19955171937759708
in-drivable-lane_max	10.950000000000044
in-drivable-lane_mean	10.950000000000044
in-drivable-lane_min	10.950000000000044
per-episodes	details {"loop-000-ego0": {"driven_any": 1.924195440713655, "survival_time": 12.700000000000044, "driven_lanedir": 0.19955171937759708, "in-drivable-lane": 10.950000000000044, "deviation-heading": 0.9488219555580464, "distance-from-start": 1.924049384083022, "deviation-center-line": 0.12567511082985278, "driven_lanedir_consec": 0.19955171937759708}}
simulation-passed	1
survival_time_max	12.700000000000044
survival_time_mean	12.700000000000044
survival_time_min	12.700000000000044

No reset possible

14307

1238

Bea Baselines 🐤

minimal-agent

sim-1of4

success

2022-11-23 20:41:34+00:00

2022-11-23 20:44:33+00:00

0:02:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	8.04999999999998
in-drivable-lane_median	4.749999999999984
driven_lanedir_consec_median	0.331229062365487
deviation-center-line_median	0.26973530940385876

other stats

deviation-center-line_max	0.26973530940385876
deviation-center-line_mean	0.26973530940385876
deviation-center-line_min	0.26973530940385876
deviation-heading_max	2.5383505748046193
deviation-heading_mean	2.5383505748046193
deviation-heading_median	2.5383505748046193
deviation-heading_min	2.5383505748046193
distance-from-start_max	1.1587848457868677
distance-from-start_mean	1.1587848457868677
distance-from-start_median	1.1587848457868677
distance-from-start_min	1.1587848457868677
driven_any_max	1.158841900114123
driven_any_mean	1.158841900114123
driven_any_median	1.158841900114123
driven_any_min	1.158841900114123
driven_lanedir_consec_max	0.331229062365487
driven_lanedir_consec_mean	0.331229062365487
driven_lanedir_consec_min	0.331229062365487
driven_lanedir_max	0.331229062365487
driven_lanedir_mean	0.331229062365487
driven_lanedir_median	0.331229062365487
driven_lanedir_min	0.331229062365487
in-drivable-lane_max	4.749999999999984
in-drivable-lane_mean	4.749999999999984
in-drivable-lane_min	4.749999999999984
per-episodes	details {"4way-000-ego0": {"driven_any": 1.158841900114123, "survival_time": 8.04999999999998, "driven_lanedir": 0.331229062365487, "in-drivable-lane": 4.749999999999984, "deviation-heading": 2.5383505748046193, "distance-from-start": 1.1587848457868677, "deviation-center-line": 0.26973530940385876, "driven_lanedir_consec": 0.331229062365487}}
simulation-passed	1
survival_time_max	8.04999999999998
survival_time_mean	8.04999999999998
survival_time_min	8.04999999999998

No reset possible

14296

1241

Bea Baselines 🐤

minimal-agent

sim-0of4

success

2022-11-23 20:35:43+00:00

2022-11-23 20:41:03+00:00

0:05:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	19.95000000000015
in-drivable-lane_median	15.575000000000143
driven_lanedir_consec_median	0.3010218083101922
deviation-center-line_median	0.3970118868681207

other stats

deviation-center-line_max	2.2346112831306932
deviation-center-line_mean	0.7885775545340169
deviation-center-line_min	0.12567516126913286
deviation-heading_max	4.797258948144445
deviation-heading_mean	2.707299691495644
deviation-heading_median	2.642065173445396
deviation-heading_min	0.7478094709473367
distance-from-start_max	3.129125828735781
distance-from-start_mean	1.1662292771696292
distance-from-start_median	0.5771403828427081
distance-from-start_min	0.3815105142573194
driven_any_max	3.129843909463842
driven_any_mean	1.166415544369201
driven_any_median	0.5771503990770468
driven_any_min	0.3815174698588687
driven_lanedir_consec_max	0.7928447585809935
driven_lanedir_consec_mean	0.3886457893287136
driven_lanedir_consec_min	0.15969478211347665
driven_lanedir_max	0.8014890585195535
driven_lanedir_mean	0.39080686431335365
driven_lanedir_median	0.3010218083101922
driven_lanedir_min	0.15969478211347665
in-drivable-lane_max	18.50000000000015
in-drivable-lane_mean	12.412500000000112
in-drivable-lane_min	0.0
per-episodes	details {"udem-000-ego0": {"driven_any": 0.3815174698588687, "survival_time": 19.95000000000015, "driven_lanedir": 0.199551480959018, "in-drivable-lane": 18.20000000000015, "deviation-heading": 0.9488219555580458, "distance-from-start": 0.3815105142573194, "deviation-center-line": 0.12567516126913286, "driven_lanedir_consec": 0.199551480959018}, "udem-000-ego1": {"driven_any": 0.7395025092531806, "survival_time": 19.95000000000015, "driven_lanedir": 0.15969478211347665, "in-drivable-lane": 18.50000000000015, "deviation-heading": 0.7478094709473367, "distance-from-start": 0.7394902813305423, "deviation-center-line": 0.13562525098197173, "driven_lanedir_consec": 0.15969478211347665}, "udem-000-ego2": {"driven_any": 0.41479828890091297, "survival_time": 19.95000000000015, "driven_lanedir": 0.4024921356613664, "in-drivable-lane": 0.0, "deviation-heading": 4.797258948144445, "distance-from-start": 0.4147904843548739, "deviation-center-line": 2.2346112831306932, "driven_lanedir_consec": 0.4024921356613664}, "udem-000-ego3": {"driven_any": 3.129843909463842, "survival_time": 19.95000000000015, "driven_lanedir": 0.8014890585195535, "in-drivable-lane": 12.95000000000014, "deviation-heading": 4.335308391332746, "distance-from-start": 3.129125828735781, "deviation-center-line": 0.6583985227542697, "driven_lanedir_consec": 0.7928447585809935}}
simulation-passed	1
survival_time_max	19.95000000000015
survival_time_mean	19.95000000000015
survival_time_min	19.95000000000015

No reset possible

14289

1242

Bea Baselines 🐤

minimal-agent

sim-1of4

success

2022-11-23 20:30:49+00:00

2022-11-23 20:35:35+00:00

0:04:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	18.500000000000128
in-drivable-lane_median	16.02500000000013
driven_lanedir_consec_median	0.33013236525205236
deviation-center-line_median	0.20320251005949427

other stats

deviation-center-line_max	0.2757414134419884
deviation-center-line_mean	0.20195540399126405
deviation-center-line_min	0.1256751824040792
deviation-heading_max	0.9488219555580464
deviation-heading_mean	0.8390919152844039
deviation-heading_median	0.8356409085548375
deviation-heading_min	0.7362638884698943
distance-from-start_max	2.887473103882224
distance-from-start_mean	1.46815084792022
distance-from-start_median	1.392449957467867
distance-from-start_min	0.20023037286292217
driven_any_max	2.8881823443375616
driven_any_mean	1.4683701164599607
driven_any_median	1.3925323730139962
driven_any_min	0.20023337547428863
driven_lanedir_consec_max	0.5392562706966588
driven_lanedir_consec_mean	0.33980394582856005
driven_lanedir_consec_min	0.15969478211347665
driven_lanedir_max	0.5392562706966588
driven_lanedir_mean	0.33980394582856005
driven_lanedir_median	0.33013236525205236
driven_lanedir_min	0.15969478211347665
in-drivable-lane_max	17.05000000000013
in-drivable-lane_mean	15.97500000000013
in-drivable-lane_min	14.800000000000132
per-episodes	details {"loop-000-ego0": {"driven_any": 1.092910469671116, "survival_time": 18.500000000000128, "driven_lanedir": 0.199555653284208, "in-drivable-lane": 16.750000000000128, "deviation-heading": 0.9488219555580464, "distance-from-start": 1.0928555098331485, "deviation-center-line": 0.1256751824040792, "driven_lanedir_consec": 0.199555653284208}, "loop-000-ego1": {"driven_any": 0.20023337547428863, "survival_time": 18.500000000000128, "driven_lanedir": 0.15969478211347665, "in-drivable-lane": 17.05000000000013, "deviation-heading": 0.7478094709473367, "distance-from-start": 0.20023037286292217, "deviation-center-line": 0.1356249107782697, "driven_lanedir_consec": 0.15969478211347665}, "loop-000-ego2": {"driven_any": 1.6921542763568764, "survival_time": 18.500000000000128, "driven_lanedir": 0.5392562706966588, "in-drivable-lane": 14.800000000000132, "deviation-heading": 0.9234723461623382, "distance-from-start": 1.6920444051025856, "deviation-center-line": 0.27078010934071883, "driven_lanedir_consec": 0.5392562706966588}, "loop-000-ego3": {"driven_any": 2.8881823443375616, "survival_time": 18.500000000000128, "driven_lanedir": 0.46070907721989673, "in-drivable-lane": 15.300000000000132, "deviation-heading": 0.7362638884698943, "distance-from-start": 2.887473103882224, "deviation-center-line": 0.2757414134419884, "driven_lanedir_consec": 0.46070907721989673}}
simulation-passed	1
survival_time_max	18.500000000000128
survival_time_mean	18.500000000000128
survival_time_min	18.500000000000128

No reset possible

14286

1243

Bea Baselines 🐤

minimal-agent

sim-2of4

success

2022-11-23 20:29:10+00:00

2022-11-23 20:30:36+00:00

0:01:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	4.499999999999992
in-drivable-lane_median	2.749999999999991
driven_lanedir_consec_median	0.19955231542409924
deviation-center-line_median	0.12567511082985364

other stats

deviation-center-line_max	0.12567511082985364
deviation-center-line_mean	0.12567511082985364
deviation-center-line_min	0.12567511082985364
deviation-heading_max	0.9488219555580458
deviation-heading_mean	0.9488219555580458
deviation-heading_median	0.9488219555580458
deviation-heading_min	0.9488219555580458
distance-from-start_max	0.5733789333527137
distance-from-start_mean	0.5733789333527137
distance-from-start_median	0.5733789333527137
distance-from-start_min	0.5733789333527137
driven_any_max	0.5733903362648751
driven_any_mean	0.5733903362648751
driven_any_median	0.5733903362648751
driven_any_min	0.5733903362648751
driven_lanedir_consec_max	0.19955231542409924
driven_lanedir_consec_mean	0.19955231542409924
driven_lanedir_consec_min	0.19955231542409924
driven_lanedir_max	0.19955231542409924
driven_lanedir_mean	0.19955231542409924
driven_lanedir_median	0.19955231542409924
driven_lanedir_min	0.19955231542409924
in-drivable-lane_max	2.749999999999991
in-drivable-lane_mean	2.749999999999991
in-drivable-lane_min	2.749999999999991
per-episodes	details {"loop2-000-ego0": {"driven_any": 0.5733903362648751, "survival_time": 4.499999999999992, "driven_lanedir": 0.19955231542409924, "in-drivable-lane": 2.749999999999991, "deviation-heading": 0.9488219555580458, "distance-from-start": 0.5733789333527137, "deviation-center-line": 0.12567511082985364, "driven_lanedir_consec": 0.19955231542409924}}
simulation-passed	1
survival_time_max	4.499999999999992
survival_time_mean	4.499999999999992
survival_time_min	4.499999999999992

No reset possible

14283

1246

Bea Baselines 🐤

minimal-agent

lx22-visservoing

sim

success

yes

2022-11-23 20:26:31+00:00

2022-11-23 20:28:31+00:00

0:02:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

in-drivable-lane_median	2.6499999999999924
deviation-center-line_median	0.17493349275674216
driven_lanedir_consec_median	0.8221776345283069
survival_time_median	8.14999999999998

other stats

deviation-center-line_max	0.17647811751212122
deviation-center-line_mean	0.17493349275674216
deviation-center-line_min	0.1733888680013631
deviation-heading_max	0.7383278077616701
deviation-heading_mean	0.7099934263375745
deviation-heading_median	0.7099934263375745
deviation-heading_min	0.681659044913479
distance-from-start_max	1.175276406473093
distance-from-start_mean	1.175237634650054
distance-from-start_median	1.175237634650054
distance-from-start_min	1.1751988628270151
driven_any_max	1.1755804280577309
driven_any_mean	1.175457669946736
driven_any_median	1.175457669946736
driven_any_min	1.175334911835741
driven_lanedir_consec_max	0.8828170026503562
driven_lanedir_consec_mean	0.8221776345283069
driven_lanedir_consec_min	0.7615382664062577
driven_lanedir_max	0.8828170026503562
driven_lanedir_mean	0.8221776345283069
driven_lanedir_median	0.8221776345283069
driven_lanedir_min	0.7615382664062577
in-drivable-lane_max	2.999999999999991
in-drivable-lane_mean	2.6499999999999924
in-drivable-lane_min	2.2999999999999936
per-episodes	details {"LF-small-loop-000-ego0": {"driven_any": 1.1755804280577309, "survival_time": 8.14999999999998, "driven_lanedir": 0.7615382664062577, "in-drivable-lane": 2.999999999999991, "deviation-heading": 0.681659044913479, "distance-from-start": 1.1751988628270151, "deviation-center-line": 0.1733888680013631, "driven_lanedir_consec": 0.7615382664062577}, "LF-small-loop-001-ego0": {"driven_any": 1.175334911835741, "survival_time": 8.14999999999998, "driven_lanedir": 0.8828170026503562, "in-drivable-lane": 2.2999999999999936, "deviation-heading": 0.7383278077616701, "distance-from-start": 1.175276406473093, "deviation-center-line": 0.17647811751212122, "driven_lanedir_consec": 0.8828170026503562}}
simulation-passed	1
survival_time_max	8.14999999999998
survival_time_mean	8.14999999999998
survival_time_min	8.14999999999998

No reset possible

14280

1255

Bea Baselines 🐤

minimal-agent

sanity-check

success

2022-11-23 20:25:06+00:00

2022-11-23 20:26:16+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	0.49999999999999994
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.027182527438338155
deviation-center-line_median	0.005231420846612685

other stats

deviation-center-line_max	0.005231420846612685
deviation-center-line_mean	0.005231420846612685
deviation-center-line_min	0.005231420846612685
deviation-heading_max	0.26820132194453994
deviation-heading_mean	0.26820132194453994
deviation-heading_median	0.26820132194453994
deviation-heading_min	0.26820132194453994
distance-from-start_max	0.03160072536398472
distance-from-start_mean	0.03160072536398472
distance-from-start_median	0.03160072536398472
distance-from-start_min	0.03160072536398472
driven_any_max	0.03160074670807487
driven_any_mean	0.03160074670807487
driven_any_median	0.03160074670807487
driven_any_min	0.03160074670807487
driven_lanedir_consec_max	0.027182527438338155
driven_lanedir_consec_mean	0.027182527438338155
driven_lanedir_consec_min	0.027182527438338155
driven_lanedir_max	0.027182527438338155
driven_lanedir_mean	0.027182527438338155
driven_lanedir_median	0.027182527438338155
driven_lanedir_min	0.027182527438338155
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"scenarios-ego0": {"driven_any": 0.03160074670807487, "survival_time": 0.49999999999999994, "driven_lanedir": 0.027182527438338155, "in-drivable-lane": 0.0, "deviation-heading": 0.26820132194453994, "distance-from-start": 0.03160072536398472, "deviation-center-line": 0.005231420846612685, "driven_lanedir_consec": 0.027182527438338155}}
simulation-passed	1
survival_time_max	0.49999999999999994
survival_time_mean	0.49999999999999994
survival_time_min	0.49999999999999994

No reset possible

14274

1260

Bea Baselines 🐤

minimal-agent

sim-1of4

success

2022-11-23 20:21:04+00:00

2022-11-23 20:24:47+00:00

0:03:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	10.85000000000002
in-drivable-lane_median	9.45000000000002
driven_lanedir_consec_median	0.13666480491623645
deviation-center-line_median	0.1078383533310603

other stats

deviation-center-line_max	0.1078383533310603
deviation-center-line_mean	0.1078383533310603
deviation-center-line_min	0.1078383533310603
deviation-heading_max	0.9508048428349388
deviation-heading_mean	0.9508048428349388
deviation-heading_median	0.9508048428349388
deviation-heading_min	0.9508048428349388
distance-from-start_max	1.6182798682575184
distance-from-start_mean	1.6182798682575184
distance-from-start_median	1.6182798682575184
distance-from-start_min	1.6182798682575184
driven_any_max	1.6183892771013868
driven_any_mean	1.6183892771013868
driven_any_median	1.6183892771013868
driven_any_min	1.6183892771013868
driven_lanedir_consec_max	0.13666480491623645
driven_lanedir_consec_mean	0.13666480491623645
driven_lanedir_consec_min	0.13666480491623645
driven_lanedir_max	0.13666480491623645
driven_lanedir_mean	0.13666480491623645
driven_lanedir_median	0.13666480491623645
driven_lanedir_min	0.13666480491623645
in-drivable-lane_max	9.45000000000002
in-drivable-lane_mean	9.45000000000002
in-drivable-lane_min	9.45000000000002
per-episodes	details {"4way-000-ego0": {"driven_any": 1.6183892771013868, "survival_time": 10.85000000000002, "driven_lanedir": 0.13666480491623645, "in-drivable-lane": 9.45000000000002, "deviation-heading": 0.9508048428349388, "distance-from-start": 1.6182798682575184, "deviation-center-line": 0.1078383533310603, "driven_lanedir_consec": 0.13666480491623645}}
simulation-passed	1
survival_time_max	10.85000000000002
survival_time_mean	10.85000000000002
survival_time_min	10.85000000000002

No reset possible

14268

1261

Bea Baselines 🐤

minimal-agent

sim-1of4

success

2022-11-23 20:18:41+00:00

2022-11-23 20:20:51+00:00

0:02:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	9.850000000000003
in-drivable-lane_median	8.450000000000005
driven_lanedir_consec_median	0.13666265914899656
deviation-center-line_median	0.10783777071756002

other stats

deviation-center-line_max	0.10783777071756002
deviation-center-line_mean	0.10783777071756002
deviation-center-line_min	0.10783777071756002
deviation-heading_max	0.9508048428349386
deviation-heading_mean	0.9508048428349386
deviation-heading_median	0.9508048428349386
deviation-heading_min	0.9508048428349386
distance-from-start_max	1.4547842507789357
distance-from-start_mean	1.4547842507789357
distance-from-start_median	1.4547842507789357
distance-from-start_min	1.4547842507789357
driven_any_max	1.454891323746283
driven_any_mean	1.454891323746283
driven_any_median	1.454891323746283
driven_any_min	1.454891323746283
driven_lanedir_consec_max	0.13666265914899656
driven_lanedir_consec_mean	0.13666265914899656
driven_lanedir_consec_min	0.13666265914899656
driven_lanedir_max	0.13666265914899656
driven_lanedir_mean	0.13666265914899656
driven_lanedir_median	0.13666265914899656
driven_lanedir_min	0.13666265914899656
in-drivable-lane_max	8.450000000000005
in-drivable-lane_mean	8.450000000000005
in-drivable-lane_min	8.450000000000005
per-episodes	details {"udem1-000-ego0": {"driven_any": 1.454891323746283, "survival_time": 9.850000000000003, "driven_lanedir": 0.13666265914899656, "in-drivable-lane": 8.450000000000005, "deviation-heading": 0.9508048428349386, "distance-from-start": 1.4547842507789357, "deviation-center-line": 0.10783777071756002, "driven_lanedir_consec": 0.13666265914899656}}
simulation-passed	1
survival_time_max	9.850000000000003
survival_time_mean	9.850000000000003
survival_time_min	9.850000000000003

No reset possible

14264

1262

Bea Baselines 🐤

minimal-agent

sim-1of4

success

2022-11-23 20:16:50+00:00

2022-11-23 20:18:21+00:00

0:01:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.1366657585905522
survival_time_median	7.549999999999981
deviation-center-line_median	0.10783809919009872
in-drivable-lane_median	6.149999999999981

other stats

deviation-center-line_max	0.10783809919009872
deviation-center-line_mean	0.10783809919009872
deviation-center-line_min	0.10783809919009872
deviation-heading_max	0.9508048428349384
deviation-heading_mean	0.9508048428349384
deviation-heading_median	0.9508048428349384
deviation-heading_min	0.9508048428349384
distance-from-start_max	1.076322287151137
distance-from-start_mean	1.076322287151137
distance-from-start_median	1.076322287151137
distance-from-start_min	1.076322287151137
driven_any_max	1.0763767010128955
driven_any_mean	1.0763767010128955
driven_any_median	1.0763767010128955
driven_any_min	1.0763767010128955
driven_lanedir_consec_max	0.1366657585905522
driven_lanedir_consec_mean	0.1366657585905522
driven_lanedir_consec_min	0.1366657585905522
driven_lanedir_max	0.1366657585905522
driven_lanedir_mean	0.1366657585905522
driven_lanedir_median	0.1366657585905522
driven_lanedir_min	0.1366657585905522
in-drivable-lane_max	6.149999999999981
in-drivable-lane_mean	6.149999999999981
in-drivable-lane_min	6.149999999999981
per-episodes	details {"loop-000-ego0": {"driven_any": 1.0763767010128955, "survival_time": 7.549999999999981, "driven_lanedir": 0.1366657585905522, "in-drivable-lane": 6.149999999999981, "deviation-heading": 0.9508048428349384, "distance-from-start": 1.076322287151137, "deviation-center-line": 0.10783809919009872, "driven_lanedir_consec": 0.1366657585905522}}
simulation-passed	1
survival_time_max	7.549999999999981
survival_time_mean	7.549999999999981
survival_time_min	7.549999999999981

No reset possible

14259

1264

Bea Baselines 🐤

minimal-agent

sim-0of4

success

2022-11-23 20:11:50+00:00

2022-11-23 20:16:15+00:00

0:04:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	14.800000000000075
in-drivable-lane_median	10.375000000000036
driven_lanedir_consec_median	0.2917316817322182
deviation-center-line_median	0.3629004861869609

other stats

deviation-center-line_max	0.8581383651069324
deviation-center-line_mean	0.42294435916773776
deviation-center-line_min	0.1078380991900969
deviation-heading_max	2.3443591222660065
deviation-heading_mean	1.288863217377771
deviation-heading_median	1.0259544132050231
deviation-heading_min	0.7591849208350303
distance-from-start_max	2.2726748388714895
distance-from-start_mean	0.9481278044889968
distance-from-start_median	0.535788907847825
distance-from-start_min	0.4482585633888487
driven_any_max	2.2731784865558287
driven_any_mean	0.9482607511676968
driven_any_median	0.5357988542299352
driven_any_min	0.4482668096550876
driven_lanedir_consec_max	1.1053767537677208
driven_lanedir_consec_mean	0.4508020778201367
driven_lanedir_consec_min	0.1143681940483896
driven_lanedir_max	1.1053767537677208
driven_lanedir_mean	0.4508020778201367
driven_lanedir_median	0.2917316817322182
driven_lanedir_min	0.1143681940483896
in-drivable-lane_max	13.600000000000076
in-drivable-lane_mean	8.587500000000038
in-drivable-lane_min	0.0
per-episodes	details {"autolab-000-ego0": {"driven_any": 0.4482668096550913, "survival_time": 14.800000000000075, "driven_lanedir": 0.13665955970746824, "in-drivable-lane": 13.400000000000077, "deviation-heading": 0.9508048428349386, "distance-from-start": 0.4482585633888487, "deviation-center-line": 0.1078380991900969, "driven_lanedir_consec": 0.13665955970746824}, "autolab-000-ego1": {"driven_any": 2.2731784865558287, "survival_time": 14.800000000000075, "driven_lanedir": 1.1053767537677208, "in-drivable-lane": 7.349999999999999, "deviation-heading": 2.3443591222660065, "distance-from-start": 2.2726748388714895, "deviation-center-line": 0.6095492402054283, "driven_lanedir_consec": 1.1053767537677208}, "autolab-000-ego2": {"driven_any": 0.4482668096550876, "survival_time": 14.800000000000075, "driven_lanedir": 0.44680380375696815, "in-drivable-lane": 0.0, "deviation-heading": 1.1011039835751082, "distance-from-start": 0.44825856338885, "deviation-center-line": 0.8581383651069324, "driven_lanedir_consec": 0.44680380375696815}, "autolab-000-ego3": {"driven_any": 0.6233308988047791, "survival_time": 14.800000000000075, "driven_lanedir": 0.1143681940483896, "in-drivable-lane": 13.600000000000076, "deviation-heading": 0.7591849208350303, "distance-from-start": 0.6233192523068, "deviation-center-line": 0.11625173216849344, "driven_lanedir_consec": 0.1143681940483896}}
simulation-passed	1
survival_time_max	14.800000000000075
survival_time_mean	14.800000000000075
survival_time_min	14.800000000000075

No reset possible

14248

1285

Bea Baselines 🐤

template-random

sanity-check

success

2022-11-23 19:56:56+00:00

2022-11-23 19:58:06+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	0.49999999999999994
in-drivable-lane_median	0.0
driven_lanedir_consec_median	1.1920928955078125e-06
deviation-center-line_median	0.007457559042937448

other stats

deviation-center-line_max	0.007457559042937448
deviation-center-line_mean	0.007457559042937448
deviation-center-line_min	0.007457559042937448
deviation-heading_max	0.1966171946901932
deviation-heading_mean	0.1966171946901932
deviation-heading_median	0.1966171946901932
deviation-heading_min	0.1966171946901932
distance-from-start_max	6.280369834735102e-16
distance-from-start_mean	6.280369834735102e-16
distance-from-start_median	6.280369834735102e-16
distance-from-start_min	6.280369834735102e-16
driven_any_max	4.1538810900383696e-15
driven_any_mean	4.1538810900383696e-15
driven_any_median	4.1538810900383696e-15
driven_any_min	4.1538810900383696e-15
driven_lanedir_consec_max	1.1920928955078125e-06
driven_lanedir_consec_mean	1.1920928955078125e-06
driven_lanedir_consec_min	1.1920928955078125e-06
driven_lanedir_max	1.1920928955078125e-06
driven_lanedir_mean	1.1920928955078125e-06
driven_lanedir_median	1.1920928955078125e-06
driven_lanedir_min	1.1920928955078125e-06
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"scenarios-ego0": {"driven_any": 4.1538810900383696e-15, "survival_time": 0.49999999999999994, "driven_lanedir": 1.1920928955078125e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.1966171946901932, "distance-from-start": 6.280369834735102e-16, "deviation-center-line": 0.007457559042937448, "driven_lanedir_consec": 1.1920928955078125e-06}}
simulation-passed	1
survival_time_max	0.49999999999999994
survival_time_mean	0.49999999999999994
survival_time_min	0.49999999999999994

No reset possible

14244

1289

Bea Baselines 🐤

template-random

sim-0of4

success

2022-11-23 19:52:19+00:00

2022-11-23 19:56:49+00:00

0:04:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	11.55000000000003
in-drivable-lane_median	8.100000000000017
driven_lanedir_consec_median	0.02948471913916273
deviation-center-line_median	0.3268414821574099

other stats

deviation-center-line_max	0.3268414821574099
deviation-center-line_mean	0.3268414821574099
deviation-center-line_min	0.3268414821574099
deviation-heading_max	2.5488725860510586
deviation-heading_mean	2.5488725860510586
deviation-heading_median	2.5488725860510586
deviation-heading_min	2.5488725860510586
distance-from-start_max	0.5461575079396525
distance-from-start_mean	0.5461575079396525
distance-from-start_median	0.5461575079396525
distance-from-start_min	0.5461575079396525
driven_any_max	2.4097437221936646
driven_any_mean	2.4097437221936646
driven_any_median	2.4097437221936646
driven_any_min	2.4097437221936646
driven_lanedir_consec_max	0.02948471913916273
driven_lanedir_consec_mean	0.02948471913916273
driven_lanedir_consec_min	0.02948471913916273
driven_lanedir_max	0.032830942028507115
driven_lanedir_mean	0.032830942028507115
driven_lanedir_median	0.032830942028507115
driven_lanedir_min	0.032830942028507115
in-drivable-lane_max	8.100000000000017
in-drivable-lane_mean	8.100000000000017
in-drivable-lane_min	8.100000000000017
per-episodes	details {"autolab-000-ego0": {"driven_any": 2.4097437221936646, "survival_time": 11.55000000000003, "driven_lanedir": 0.032830942028507115, "in-drivable-lane": 8.100000000000017, "deviation-heading": 2.5488725860510586, "distance-from-start": 0.5461575079396525, "deviation-center-line": 0.3268414821574099, "driven_lanedir_consec": 0.02948471913916273}}
simulation-passed	1
survival_time_max	11.55000000000003
survival_time_mean	11.55000000000003
survival_time_min	11.55000000000003

No reset possible

14241

1290

Bea Baselines 🐤

template-random

sim-2of4

success

2022-11-23 19:50:27+00:00

2022-11-23 19:51:59+00:00

0:01:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

14235

1292

Bea Baselines 🐤

template-random

sim-1of4

success

2022-11-23 19:45:41+00:00

2022-11-23 19:50:20+00:00

0:04:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.24555746228952957
survival_time_median	39.24999999999991
deviation-center-line_median	1.3919847015555789
in-drivable-lane_median	25.24999999999981

other stats

deviation-center-line_max	1.3919847015555789
deviation-center-line_mean	1.3919847015555789
deviation-center-line_min	1.3919847015555789
deviation-heading_max	9.906601177812297
deviation-heading_mean	9.906601177812297
deviation-heading_median	9.906601177812297
deviation-heading_min	9.906601177812297
distance-from-start_max	1.0093404360059268
distance-from-start_mean	1.0093404360059268
distance-from-start_median	1.0093404360059268
distance-from-start_min	1.0093404360059268
driven_any_max	9.462416332537492
driven_any_mean	9.462416332537492
driven_any_median	9.462416332537492
driven_any_min	9.462416332537492
driven_lanedir_consec_max	0.24555746228952957
driven_lanedir_consec_mean	0.24555746228952957
driven_lanedir_consec_min	0.24555746228952957
driven_lanedir_max	0.2358197494342854
driven_lanedir_mean	0.2358197494342854
driven_lanedir_median	0.2358197494342854
driven_lanedir_min	0.2358197494342854
in-drivable-lane_max	25.24999999999981
in-drivable-lane_mean	25.24999999999981
in-drivable-lane_min	25.24999999999981
per-episodes	details {"loop-000-ego0": {"driven_any": 9.462416332537492, "survival_time": 39.24999999999991, "driven_lanedir": 0.2358197494342854, "in-drivable-lane": 25.24999999999981, "deviation-heading": 9.906601177812297, "distance-from-start": 1.0093404360059268, "deviation-center-line": 1.3919847015555789, "driven_lanedir_consec": 0.24555746228952957}}
simulation-passed	1
survival_time_max	39.24999999999991
survival_time_mean	39.24999999999991
survival_time_min	39.24999999999991

No reset possible

14234

1292

Bea Baselines 🐤

template-random

sim-2of4

success

2022-11-23 19:42:37+00:00

2022-11-23 19:45:28+00:00

0:02:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.15869649764514326
survival_time_median	15.900000000000093
deviation-center-line_median	0.4544941711289141
in-drivable-lane_median	11.05000000000006

other stats

deviation-center-line_max	0.4544941711289141
deviation-center-line_mean	0.4544941711289141
deviation-center-line_min	0.4544941711289141
deviation-heading_max	3.664036561158003
deviation-heading_mean	3.664036561158003
deviation-heading_median	3.664036561158003
deviation-heading_min	3.664036561158003
distance-from-start_max	0.6653201232297334
distance-from-start_mean	0.6653201232297334
distance-from-start_median	0.6653201232297334
distance-from-start_min	0.6653201232297334
driven_any_max	3.642720741594881
driven_any_mean	3.642720741594881
driven_any_median	3.642720741594881
driven_any_min	3.642720741594881
driven_lanedir_consec_max	0.15869649764514326
driven_lanedir_consec_mean	0.15869649764514326
driven_lanedir_consec_min	0.15869649764514326
driven_lanedir_max	0.1620428397437772
driven_lanedir_mean	0.1620428397437772
driven_lanedir_median	0.1620428397437772
driven_lanedir_min	0.1620428397437772
in-drivable-lane_max	11.05000000000006
in-drivable-lane_mean	11.05000000000006
in-drivable-lane_min	11.05000000000006
per-episodes	details {"loop2-000-ego0": {"driven_any": 3.642720741594881, "survival_time": 15.900000000000093, "driven_lanedir": 0.1620428397437772, "in-drivable-lane": 11.05000000000006, "deviation-heading": 3.664036561158003, "distance-from-start": 0.6653201232297334, "deviation-center-line": 0.4544941711289141, "driven_lanedir_consec": 0.15869649764514326}}
simulation-passed	1
survival_time_max	15.900000000000093
survival_time_mean	15.900000000000093
survival_time_min	15.900000000000093

No reset possible

14226

1294

Bea Baselines 🐤

template-random

sim-0of4

success

2022-11-23 19:25:53+00:00

2022-11-23 19:42:24+00:00

0:16:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	44.399999999999615
in-drivable-lane_median	36.89999999999958
driven_lanedir_consec_median	0.16636007500288152
deviation-center-line_median	0.6465381124900755

other stats

deviation-center-line_max	3.843921290582837
deviation-center-line_mean	1.365959723489658
deviation-center-line_min	0.3268413783956437
deviation-heading_max	34.73068339720075
deviation-heading_mean	11.863967459268938
deviation-heading_median	5.088156815887916
deviation-heading_min	2.548872808099167
distance-from-start_max	1.0442247976691943
distance-from-start_mean	0.7726084491662092
distance-from-start_median	0.7348495479070991
distance-from-start_min	0.5765099031814445
driven_any_max	11.02110496898546
driven_any_mean	5.960730691438496
driven_any_median	5.132220528138905
driven_any_min	2.5573767404907164
driven_lanedir_consec_max	0.2424977297667874
driven_lanedir_consec_mean	0.1511732098444039
driven_lanedir_consec_min	0.029474959605065187
driven_lanedir_max	0.22840118579828728
driven_lanedir_mean	0.13782421614551926
driven_lanedir_median	0.14503534079604596
driven_lanedir_min	0.03282499719169785
in-drivable-lane_max	40.949999999999605
in-drivable-lane_mean	31.049999999999716
in-drivable-lane_min	9.450000000000106
per-episodes	details {"autolab-000-ego0": {"driven_any": 2.5573767404907164, "survival_time": 44.399999999999615, "driven_lanedir": 0.03282499719169785, "in-drivable-lane": 40.949999999999605, "deviation-heading": 2.548872808099167, "distance-from-start": 0.5765099031814445, "deviation-center-line": 0.3268413783956437, "driven_lanedir_consec": 0.029474959605065187}, "autolab-000-ego1": {"driven_any": 4.1683236267102375, "survival_time": 44.399999999999615, "driven_lanedir": 0.22840118579828728, "in-drivable-lane": 9.450000000000106, "deviation-heading": 34.73068339720075, "distance-from-start": 0.6736010379604851, "deviation-center-line": 3.843921290582837, "driven_lanedir_consec": 0.2424977297667874}, "autolab-000-ego2": {"driven_any": 11.02110496898546, "survival_time": 44.399999999999615, "driven_lanedir": 0.13091508050074063, "in-drivable-lane": 37.59999999999958, "deviation-heading": 3.900775995746317, "distance-from-start": 1.0442247976691943, "deviation-center-line": 0.686307068420695, "driven_lanedir_consec": 0.15293047772426194}, "autolab-000-ego3": {"driven_any": 6.096117429567572, "survival_time": 44.399999999999615, "driven_lanedir": 0.1591556010913513, "in-drivable-lane": 36.19999999999958, "deviation-heading": 6.275537636029516, "distance-from-start": 0.7960980578537132, "deviation-center-line": 0.6067691565594562, "driven_lanedir_consec": 0.1797896722815011}}
simulation-passed	1
survival_time_max	44.399999999999615
survival_time_mean	44.399999999999615
survival_time_min	44.399999999999615

No reset possible

14221

1295

Bea Baselines 🐤

template-random

sim-1of4

success

2022-11-23 19:19:52+00:00

2022-11-23 19:25:34+00:00

0:05:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	43.29999999999968
in-drivable-lane_median	35.7499999999996
driven_lanedir_consec_median	0.054336775833862205
deviation-center-line_median	0.6346586353316823

other stats

deviation-center-line_max	0.6346586353316823
deviation-center-line_mean	0.6346586353316823
deviation-center-line_min	0.6346586353316823
deviation-heading_max	5.904235246936354
deviation-heading_mean	5.904235246936354
deviation-heading_median	5.904235246936354
deviation-heading_min	5.904235246936354
distance-from-start_max	1.009340436005913
distance-from-start_mean	1.009340436005913
distance-from-start_median	1.009340436005913
distance-from-start_min	1.009340436005913
driven_any_max	10.522906217249686
driven_any_mean	10.522906217249686
driven_any_median	10.522906217249686
driven_any_min	10.522906217249686
driven_lanedir_consec_max	0.054336775833862205
driven_lanedir_consec_mean	0.054336775833862205
driven_lanedir_consec_min	0.054336775833862205
driven_lanedir_max	0.05768311793249614
driven_lanedir_mean	0.05768311793249614
driven_lanedir_median	0.05768311793249614
driven_lanedir_min	0.05768311793249614
in-drivable-lane_max	35.7499999999996
in-drivable-lane_mean	35.7499999999996
in-drivable-lane_min	35.7499999999996
per-episodes	details {"loop-000-ego0": {"driven_any": 10.522906217249686, "survival_time": 43.29999999999968, "driven_lanedir": 0.05768311793249614, "in-drivable-lane": 35.7499999999996, "deviation-heading": 5.904235246936354, "distance-from-start": 1.009340436005913, "deviation-center-line": 0.6346586353316823, "driven_lanedir_consec": 0.054336775833862205}}
simulation-passed	1
survival_time_max	43.29999999999968
survival_time_mean	43.29999999999968
survival_time_min	43.29999999999968

No reset possible

14218

1267

Bea Baselines 🐤

template-random

sim-1of4

success

2022-11-23 19:13:11+00:00

2022-11-23 19:19:24+00:00

0:06:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	23.7000000000002
in-drivable-lane_median	14.450000000000168
driven_lanedir_consec_median	0.2737854971621658
deviation-center-line_median	0.899035755764141

other stats

deviation-center-line_max	0.899035755764141
deviation-center-line_mean	0.899035755764141
deviation-center-line_min	0.899035755764141
deviation-heading_max	6.757937307021479
deviation-heading_mean	6.757937307021479
deviation-heading_median	6.757937307021479
deviation-heading_min	6.757937307021479
distance-from-start_max	0.7357883576773867
distance-from-start_mean	0.7357883576773867
distance-from-start_median	0.7357883576773867
distance-from-start_min	0.7357883576773867
driven_any_max	5.6000766802176365
driven_any_mean	5.6000766802176365
driven_any_median	5.6000766802176365
driven_any_min	5.6000766802176365
driven_lanedir_consec_max	0.2737854971621658
driven_lanedir_consec_mean	0.2737854971621658
driven_lanedir_consec_min	0.2737854971621658
driven_lanedir_max	0.2557752979619581
driven_lanedir_mean	0.2557752979619581
driven_lanedir_median	0.2557752979619581
driven_lanedir_min	0.2557752979619581
in-drivable-lane_max	14.450000000000168
in-drivable-lane_mean	14.450000000000168
in-drivable-lane_min	14.450000000000168
per-episodes	details {"loop-000-ego0": {"driven_any": 5.6000766802176365, "survival_time": 23.7000000000002, "driven_lanedir": 0.2557752979619581, "in-drivable-lane": 14.450000000000168, "deviation-heading": 6.757937307021479, "distance-from-start": 0.7357883576773867, "deviation-center-line": 0.899035755764141, "driven_lanedir_consec": 0.2737854971621658}}
simulation-passed	1
survival_time_max	23.7000000000002
survival_time_mean	23.7000000000002
survival_time_min	23.7000000000002

No reset possible

14214

1268

Bea Baselines 🐤

template-random

sim-3of4

success

2022-11-23 19:11:32+00:00

2022-11-23 19:13:05+00:00

0:01:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

14206

1270

Bea Baselines 🐤

template-random

sim-1of4

success

2022-11-23 19:05:25+00:00

2022-11-23 19:11:11+00:00

0:05:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2701303550718044
survival_time_median	49.74999999999931
deviation-center-line_median	0.8041846674982114
in-drivable-lane_median	40.59999999999928

other stats

deviation-center-line_max	0.8041846674982114
deviation-center-line_mean	0.8041846674982114
deviation-center-line_min	0.8041846674982114
deviation-heading_max	6.675380463416964
deviation-heading_mean	6.675380463416964
deviation-heading_median	6.675380463416964
deviation-heading_min	6.675380463416964
distance-from-start_max	1.137627771926658
distance-from-start_mean	1.137627771926658
distance-from-start_median	1.137627771926658
distance-from-start_min	1.137627771926658
driven_any_max	12.45015338279087
driven_any_mean	12.45015338279087
driven_any_median	12.45015338279087
driven_any_min	12.45015338279087
driven_lanedir_consec_max	0.2701303550718044
driven_lanedir_consec_mean	0.2701303550718044
driven_lanedir_consec_min	0.2701303550718044
driven_lanedir_max	0.2521152682910448
driven_lanedir_mean	0.2521152682910448
driven_lanedir_median	0.2521152682910448
driven_lanedir_min	0.2521152682910448
in-drivable-lane_max	40.59999999999928
in-drivable-lane_mean	40.59999999999928
in-drivable-lane_min	40.59999999999928
per-episodes	details {"loop-000-ego0": {"driven_any": 12.45015338279087, "survival_time": 49.74999999999931, "driven_lanedir": 0.2521152682910448, "in-drivable-lane": 40.59999999999928, "deviation-heading": 6.675380463416964, "distance-from-start": 1.137627771926658, "deviation-center-line": 0.8041846674982114, "driven_lanedir_consec": 0.2701303550718044}}
simulation-passed	1
survival_time_max	49.74999999999931
survival_time_mean	49.74999999999931
survival_time_min	49.74999999999931

No reset possible

14198

1272

Bea Baselines 🐤

template-random

sim-1of4

success

2022-11-23 18:46:42+00:00

2022-11-23 19:05:11+00:00

0:18:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.64999999999875
in-drivable-lane_median	52.39999999999873
driven_lanedir_consec_median	0.20841941457351276
deviation-center-line_median	0.6235918393283303

other stats

deviation-center-line_max	3.9618906351925345
deviation-center-line_mean	1.3480922472158894
deviation-center-line_min	0.18329467501436195
deviation-heading_max	29.06091202107619
deviation-heading_mean	10.086526110865954
deviation-heading_median	4.852439390352202
deviation-heading_min	1.5803136416832215
distance-from-start_max	1.390232809724702
distance-from-start_mean	0.8610879612709739
distance-from-start_median	0.7658648678412762
distance-from-start_min	0.5223892996766412
driven_any_max	14.859731274916312
driven_any_mean	6.788261723046844
driven_any_median	5.402007576921902
driven_any_min	1.4893004634272606
driven_lanedir_consec_max	0.4727232702196713
driven_lanedir_consec_mean	0.24835079061387844
driven_lanedir_consec_min	0.10384106308881692
driven_lanedir_max	0.4727232702196713
driven_lanedir_mean	0.2405349726449092
driven_lanedir_median	0.19278777863557428
driven_lanedir_min	0.10384106308881692
in-drivable-lane_max	57.149999999998755
in-drivable-lane_mean	41.13749999999905
in-drivable-lane_min	2.599999999999994
per-episodes	details {"loop-000-ego0": {"driven_any": 14.859731274916312, "survival_time": 59.64999999999875, "driven_lanedir": 0.2521152682910448, "in-drivable-lane": 50.49999999999872, "deviation-heading": 6.675380463416964, "distance-from-start": 1.390232809724702, "deviation-center-line": 0.8041846674982114, "driven_lanedir_consec": 0.2701303550718044}, "loop-000-ego1": {"driven_any": 1.4893004634272606, "survival_time": 59.64999999999875, "driven_lanedir": 0.4727232702196713, "in-drivable-lane": 2.599999999999994, "deviation-heading": 29.06091202107619, "distance-from-start": 0.5223892996766412, "deviation-center-line": 3.9618906351925345, "driven_lanedir_consec": 0.4727232702196713}, "loop-000-ego2": {"driven_any": 9.314714690416322, "survival_time": 59.64999999999875, "driven_lanedir": 0.13346028898010376, "in-drivable-lane": 54.29999999999873, "deviation-heading": 3.0294983172874397, "distance-from-start": 1.0093404360059108, "deviation-center-line": 0.4429990111584493, "driven_lanedir_consec": 0.14670847407522114}, "loop-000-ego3": {"driven_any": 1.4893004634274822, "survival_time": 59.64999999999875, "driven_lanedir": 0.10384106308881692, "in-drivable-lane": 57.149999999998755, "deviation-heading": 1.5803136416832215, "distance-from-start": 0.5223892996766415, "deviation-center-line": 0.18329467501436195, "driven_lanedir_consec": 0.10384106308881692}}
simulation-passed	1
survival_time_max	59.64999999999875
survival_time_mean	59.64999999999875
survival_time_min	59.64999999999875

No reset possible

14195

1273

Bea Baselines 🐤

template-random

sim-1of4

success

2022-11-23 18:43:26+00:00

2022-11-23 18:46:36+00:00

0:03:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	19.150000000000137
in-drivable-lane_median	10.600000000000112
driven_lanedir_consec_median	0.2737818968396458
deviation-center-line_median	0.7687309631535428

other stats

deviation-center-line_max	0.7687309631535428
deviation-center-line_mean	0.7687309631535428
deviation-center-line_min	0.7687309631535428
deviation-heading_max	5.758343079064915
deviation-heading_mean	5.758343079064915
deviation-heading_median	5.758343079064915
deviation-heading_min	5.758343079064915
distance-from-start_max	0.6736010379604951
distance-from-start_mean	0.6736010379604951
distance-from-start_median	0.6736010379604951
distance-from-start_min	0.6736010379604951
driven_any_max	4.258760700432588
driven_any_mean	4.258760700432588
driven_any_median	4.258760700432588
driven_any_min	4.258760700432588
driven_lanedir_consec_max	0.2737818968396458
driven_lanedir_consec_mean	0.2737818968396458
driven_lanedir_consec_min	0.2737818968396458
driven_lanedir_max	0.25577241289552777
driven_lanedir_mean	0.25577241289552777
driven_lanedir_median	0.25577241289552777
driven_lanedir_min	0.25577241289552777
in-drivable-lane_max	10.600000000000112
in-drivable-lane_mean	10.600000000000112
in-drivable-lane_min	10.600000000000112
per-episodes	details {"loop-000-ego0": {"driven_any": 4.258760700432588, "survival_time": 19.150000000000137, "driven_lanedir": 0.25577241289552777, "in-drivable-lane": 10.600000000000112, "deviation-heading": 5.758343079064915, "distance-from-start": 0.6736010379604951, "deviation-center-line": 0.7687309631535428, "driven_lanedir_consec": 0.2737818968396458}}
simulation-passed	1
survival_time_max	19.150000000000137
survival_time_mean	19.150000000000137
survival_time_min	19.150000000000137

No reset possible

14190

1274

Bea Baselines 🐤

template-random

lx22-modcon

sim

success

yes

2022-11-23 18:40:24+00:00

2022-11-23 18:43:05+00:00

0:02:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

in-drivable-lane_median	5.975000000000012
deviation-center-line_median	0.11301514542099378
driven_lanedir_consec_median	-0.0018954959261547888
survival_time_median	7.35000000000001

other stats

deviation-center-line_max	0.1446772460243307
deviation-center-line_mean	0.11301514542099378
deviation-center-line_min	0.08135304481765684
deviation-heading_max	1.386814265924231
deviation-heading_mean	1.07792007492562
deviation-heading_median	1.07792007492562
deviation-heading_min	0.7690258839270088
distance-from-start_max	0.5461575079396507
distance-from-start_mean	0.4044333226818525
distance-from-start_median	0.4044333226818525
distance-from-start_min	0.2627091374240543
driven_any_max	2.2158554268274218
driven_any_mean	1.246529558046526
driven_any_median	1.246529558046526
driven_any_min	0.2772036892656306
driven_lanedir_consec_max	0.003586872133226393
driven_lanedir_consec_mean	-0.0018954959261547888
driven_lanedir_consec_min	-0.007377863985535971
driven_lanedir_max	0.003586872133226393
driven_lanedir_mean	-0.0018954959261547888
driven_lanedir_median	-0.0018954959261547888
driven_lanedir_min	-0.007377863985535971
in-drivable-lane_max	9.400000000000029
in-drivable-lane_mean	5.975000000000012
in-drivable-lane_min	2.5499999999999963
per-episodes	details {"LF-full-loop-000-ego0": {"driven_any": 2.2158554268274218, "survival_time": 11.200000000000024, "driven_lanedir": -0.007377863985535971, "in-drivable-lane": 9.400000000000029, "deviation-heading": 1.386814265924231, "distance-from-start": 0.5461575079396507, "deviation-center-line": 0.1446772460243307, "driven_lanedir_consec": -0.007377863985535971}, "LF-full-loop-001-ego0": {"driven_any": 0.2772036892656306, "survival_time": 3.4999999999999956, "driven_lanedir": 0.003586872133226393, "in-drivable-lane": 2.5499999999999963, "deviation-heading": 0.7690258839270088, "distance-from-start": 0.2627091374240543, "deviation-center-line": 0.08135304481765684, "driven_lanedir_consec": 0.003586872133226393}}
simulation-passed	1
survival_time_max	11.200000000000024
survival_time_mean	7.35000000000001
survival_time_min	3.4999999999999956

No reset possible

14175

1122

Bea Baselines 🐤

template-random

sim-1of4

aborted

2022-11-23 18:20:35+00:00

2022-11-23 18:37:25+00:00

0:16:50

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1302, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 749, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14165

1125

Bea Baselines 🐤

template-ros

sim-3of4

success

2022-11-23 18:15:12+00:00

2022-11-23 18:17:27+00:00

0:02:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	2.25
in-drivable-lane_median	1.4
driven_lanedir_consec_median	0.09136748502784808
deviation-center-line_median	0.05206458587729257

other stats

deviation-center-line_max	0.05206458587729257
deviation-center-line_mean	0.05206458587729257
deviation-center-line_min	0.05206458587729257
deviation-heading_max	0.6972159525493732
deviation-heading_mean	0.6972159525493732
deviation-heading_median	0.6972159525493732
deviation-heading_min	0.6972159525493732
distance-from-start_max	0.3431762132924978
distance-from-start_mean	0.3431762132924978
distance-from-start_median	0.3431762132924978
distance-from-start_min	0.3431762132924978
driven_any_max	0.3680100723179618
driven_any_mean	0.3680100723179618
driven_any_median	0.3680100723179618
driven_any_min	0.3680100723179618
driven_lanedir_consec_max	0.09136748502784808
driven_lanedir_consec_mean	0.09136748502784808
driven_lanedir_consec_min	0.09136748502784808
driven_lanedir_max	0.09136748502784808
driven_lanedir_mean	0.09136748502784808
driven_lanedir_median	0.09136748502784808
driven_lanedir_min	0.09136748502784808
in-drivable-lane_max	1.4
in-drivable-lane_mean	1.4
in-drivable-lane_min	1.4
per-episodes	details {"zigzag-000-ego0": {"driven_any": 0.3680100723179618, "survival_time": 2.25, "driven_lanedir": 0.09136748502784808, "in-drivable-lane": 1.4, "deviation-heading": 0.6972159525493732, "distance-from-start": 0.3431762132924978, "deviation-center-line": 0.05206458587729257, "driven_lanedir_consec": 0.09136748502784808}}
simulation-passed	1
survival_time_max	2.25
survival_time_mean	2.25
survival_time_min	2.25

No reset possible

14161

1126

Bea Baselines 🐤

template-ros

sim-2of4

success

2022-11-23 18:13:16+00:00

2022-11-23 18:14:46+00:00

0:01:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

14151

1128

Bea Baselines 🐤

template-ros

sim-0of4

success

2022-11-23 18:08:32+00:00

2022-11-23 18:13:08+00:00

0:04:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	12.700000000000044
in-drivable-lane_median	10.500000000000048
driven_lanedir_consec_median	0.4632570327781048
deviation-center-line_median	0.11604090879422166

other stats

deviation-center-line_max	0.5953570477235984
deviation-center-line_mean	0.22377429048549335
deviation-center-line_min	0.06765829662993175
deviation-heading_max	1.5105437202267404
deviation-heading_mean	0.9876597784339184
deviation-heading_median	0.9281054340514228
deviation-heading_min	0.5838845254060879
distance-from-start_max	3.195179178559561
distance-from-start_mean	1.2053221034877852
distance-from-start_median	0.7163974933469706
distance-from-start_min	0.19331424869763889
driven_any_max	3.423619106575359
driven_any_mean	1.2709642293314274
driven_any_median	0.7325651974086334
driven_any_min	0.19510741593308384
driven_lanedir_consec_max	1.8917264454823677
driven_lanedir_consec_mean	0.7285397377570153
driven_lanedir_consec_min	0.09591843998948368
driven_lanedir_max	1.8924446978813765
driven_lanedir_mean	0.7287193008567674
driven_lanedir_median	0.4632570327781048
driven_lanedir_min	0.09591843998948368
in-drivable-lane_max	11.850000000000044
in-drivable-lane_mean	9.55000000000005
in-drivable-lane_min	5.350000000000064
per-episodes	details {"udem-000-ego0": {"driven_any": 0.38910556337412616, "survival_time": 12.700000000000044, "driven_lanedir": 0.22715430556841287, "in-drivable-lane": 11.500000000000046, "deviation-heading": 0.5863451269558692, "distance-from-start": 0.3855596773788631, "deviation-center-line": 0.07205946590833744, "driven_lanedir_consec": 0.22715430556841287}, "udem-000-ego1": {"driven_any": 0.19510741593308384, "survival_time": 12.700000000000044, "driven_lanedir": 0.09591843998948368, "in-drivable-lane": 11.850000000000044, "deviation-heading": 0.5838845254060879, "distance-from-start": 0.19331424869763889, "deviation-center-line": 0.06765829662993175, "driven_lanedir_consec": 0.09591843998948368}, "udem-000-ego2": {"driven_any": 3.423619106575359, "survival_time": 12.700000000000044, "driven_lanedir": 1.8924446978813765, "in-drivable-lane": 5.350000000000064, "deviation-heading": 1.5105437202267404, "distance-from-start": 3.195179178559561, "deviation-center-line": 0.5953570477235984, "driven_lanedir_consec": 1.8917264454823677}, "udem-000-ego3": {"driven_any": 1.0760248314431409, "survival_time": 12.700000000000044, "driven_lanedir": 0.6993597599877968, "in-drivable-lane": 9.50000000000005, "deviation-heading": 1.2698657411469765, "distance-from-start": 1.047235309315078, "deviation-center-line": 0.1600223516801059, "driven_lanedir_consec": 0.6993597599877968}}
simulation-passed	1
survival_time_max	12.700000000000044
survival_time_mean	12.700000000000044
survival_time_min	12.700000000000044

No reset possible

14148

1129

Bea Baselines 🐤

template-ros

sim-2of4

success

2022-11-23 18:05:43+00:00

2022-11-23 18:08:18+00:00

0:02:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	8.499999999999986
in-drivable-lane_median	6.924999999999987
driven_lanedir_consec_median	0.2438717213509355
deviation-center-line_median	0.13051633297285337

other stats

deviation-center-line_max	0.15917095556183186
deviation-center-line_mean	0.13051633297285337
deviation-center-line_min	0.10186171038387486
deviation-heading_max	1.9902658117288263
deviation-heading_mean	1.2332086098616797
deviation-heading_median	1.2332086098616797
deviation-heading_min	0.47615140799453265
distance-from-start_max	1.737005074909585
distance-from-start_mean	1.0757535087289924
distance-from-start_median	1.0757535087289924
distance-from-start_min	0.4145019425483998
driven_any_max	2.329355647717616
driven_any_mean	1.3729960905774177
driven_any_median	1.3729960905774177
driven_any_min	0.4166365334372192
driven_lanedir_consec_max	0.2700200827181509
driven_lanedir_consec_mean	0.2438717213509355
driven_lanedir_consec_min	0.21772335998372008
driven_lanedir_max	0.27669241600045225
driven_lanedir_mean	0.24720788799208615
driven_lanedir_median	0.24720788799208615
driven_lanedir_min	0.21772335998372008
in-drivable-lane_max	7.399999999999985
in-drivable-lane_mean	6.924999999999987
in-drivable-lane_min	6.4499999999999895
per-episodes	details {"loop2-000-ego0": {"driven_any": 2.329355647717616, "survival_time": 8.499999999999986, "driven_lanedir": 0.27669241600045225, "in-drivable-lane": 6.4499999999999895, "deviation-heading": 1.9902658117288263, "distance-from-start": 1.737005074909585, "deviation-center-line": 0.15917095556183186, "driven_lanedir_consec": 0.2700200827181509}, "loop2-000-ego1": {"driven_any": 0.4166365334372192, "survival_time": 8.499999999999986, "driven_lanedir": 0.21772335998372008, "in-drivable-lane": 7.399999999999985, "deviation-heading": 0.47615140799453265, "distance-from-start": 0.4145019425483998, "deviation-center-line": 0.10186171038387486, "driven_lanedir_consec": 0.21772335998372008}}
simulation-passed	1
survival_time_max	8.499999999999986
survival_time_mean	8.499999999999986
survival_time_min	8.499999999999986

No reset possible

14132

1142

Bea Baselines 🐤

template-ros

sim-2of4

success

2022-11-23 17:56:23+00:00

2022-11-23 17:58:43+00:00

0:02:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	6.999999999999983
in-drivable-lane_median	5.199999999999986
driven_lanedir_consec_median	0.1999887701268268
deviation-center-line_median	0.1417355194072206

other stats

deviation-center-line_max	0.1417355194072206
deviation-center-line_mean	0.1417355194072206
deviation-center-line_min	0.1417355194072206
deviation-heading_max	1.709848157965496
deviation-heading_mean	1.709848157965496
deviation-heading_median	1.709848157965496
deviation-heading_min	1.709848157965496
distance-from-start_max	1.7161752689553968
distance-from-start_mean	1.7161752689553968
distance-from-start_median	1.7161752689553968
distance-from-start_min	1.7161752689553968
driven_any_max	1.7475846157041115
driven_any_mean	1.7475846157041115
driven_any_median	1.7475846157041115
driven_any_min	1.7475846157041115
driven_lanedir_consec_max	0.1999887701268268
driven_lanedir_consec_mean	0.1999887701268268
driven_lanedir_consec_min	0.1999887701268268
driven_lanedir_max	0.1999887701268268
driven_lanedir_mean	0.1999887701268268
driven_lanedir_median	0.1999887701268268
driven_lanedir_min	0.1999887701268268
in-drivable-lane_max	5.199999999999986
in-drivable-lane_mean	5.199999999999986
in-drivable-lane_min	5.199999999999986
per-episodes	details {"loop2-000-ego0": {"driven_any": 1.7475846157041115, "survival_time": 6.999999999999983, "driven_lanedir": 0.1999887701268268, "in-drivable-lane": 5.199999999999986, "deviation-heading": 1.709848157965496, "distance-from-start": 1.7161752689553968, "deviation-center-line": 0.1417355194072206, "driven_lanedir_consec": 0.1999887701268268}}
simulation-passed	1
survival_time_max	6.999999999999983
survival_time_mean	6.999999999999983
survival_time_min	6.999999999999983

No reset possible

14127

1144

Bea Baselines 🐤

template-ros

sim-3of4

success

2022-11-23 17:54:19+00:00

2022-11-23 17:55:50+00:00

0:01:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

14125

1145

Bea Baselines 🐤

template-ros

sim-2of4

success

2022-11-23 17:52:50+00:00

2022-11-23 17:54:14+00:00

0:01:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.24923698059222077
survival_time_median	6.8999999999999835
deviation-center-line_median	0.13705875305495946
in-drivable-lane_median	5.199999999999986

other stats

deviation-center-line_max	0.13705875305495946
deviation-center-line_mean	0.13705875305495946
deviation-center-line_min	0.13705875305495946
deviation-heading_max	1.4704527359205015
deviation-heading_mean	1.4704527359205015
deviation-heading_median	1.4704527359205015
deviation-heading_min	1.4704527359205015
distance-from-start_max	1.6477651891957774
distance-from-start_mean	1.6477651891957774
distance-from-start_median	1.6477651891957774
distance-from-start_min	1.6477651891957774
driven_any_max	1.7478565597399998
driven_any_mean	1.7478565597399998
driven_any_median	1.7478565597399998
driven_any_min	1.7478565597399998
driven_lanedir_consec_max	0.24923698059222077
driven_lanedir_consec_mean	0.24923698059222077
driven_lanedir_consec_min	0.24923698059222077
driven_lanedir_max	0.24923698059222077
driven_lanedir_mean	0.24923698059222077
driven_lanedir_median	0.24923698059222077
driven_lanedir_min	0.24923698059222077
in-drivable-lane_max	5.199999999999986
in-drivable-lane_mean	5.199999999999986
in-drivable-lane_min	5.199999999999986
per-episodes	details {"loop2-000-ego0": {"driven_any": 1.7478565597399998, "survival_time": 6.8999999999999835, "driven_lanedir": 0.24923698059222077, "in-drivable-lane": 5.199999999999986, "deviation-heading": 1.4704527359205015, "distance-from-start": 1.6477651891957774, "deviation-center-line": 0.13705875305495946, "driven_lanedir_consec": 0.24923698059222077}}
simulation-passed	1
survival_time_max	6.8999999999999835
survival_time_mean	6.8999999999999835
survival_time_min	6.8999999999999835

No reset possible

14121

1145

Bea Baselines 🐤

template-ros

sim-0of4

success

2022-11-23 17:51:05+00:00

2022-11-23 17:52:32+00:00

0:01:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.09249887510542631
survival_time_median	4.849999999999991
deviation-center-line_median	0.04982257486831945
in-drivable-lane_median	4.049999999999991

other stats

deviation-center-line_max	0.04982257486831945
deviation-center-line_mean	0.04982257486831945
deviation-center-line_min	0.04982257486831945
deviation-heading_max	0.6460500432276708
deviation-heading_mean	0.6460500432276708
deviation-heading_median	0.6460500432276708
deviation-heading_min	0.6460500432276708
distance-from-start_max	1.138508552485713
distance-from-start_mean	1.138508552485713
distance-from-start_median	1.138508552485713
distance-from-start_min	1.138508552485713
driven_any_max	1.1671562875984356
driven_any_mean	1.1671562875984356
driven_any_median	1.1671562875984356
driven_any_min	1.1671562875984356
driven_lanedir_consec_max	0.09249887510542631
driven_lanedir_consec_mean	0.09249887510542631
driven_lanedir_consec_min	0.09249887510542631
driven_lanedir_max	0.09249887510542631
driven_lanedir_mean	0.09249887510542631
driven_lanedir_median	0.09249887510542631
driven_lanedir_min	0.09249887510542631
in-drivable-lane_max	4.049999999999991
in-drivable-lane_mean	4.049999999999991
in-drivable-lane_min	4.049999999999991
per-episodes	details {"autolab-000-ego0": {"driven_any": 1.1671562875984356, "survival_time": 4.849999999999991, "driven_lanedir": 0.09249887510542631, "in-drivable-lane": 4.049999999999991, "deviation-heading": 0.6460500432276708, "distance-from-start": 1.138508552485713, "deviation-center-line": 0.04982257486831945, "driven_lanedir_consec": 0.09249887510542631}}
simulation-passed	1
survival_time_max	4.849999999999991
survival_time_mean	4.849999999999991
survival_time_min	4.849999999999991

No reset possible

14115

1146

Bea Baselines 🐤

template-ros

sim-1of4

success

2022-11-23 17:47:54+00:00

2022-11-23 17:50:52+00:00

0:02:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	5.04999999999999
in-drivable-lane_median	3.4249999999999923
driven_lanedir_consec_median	0.1876722105866182
deviation-center-line_median	0.14586844830236131

other stats

deviation-center-line_max	0.2810859576345415
deviation-center-line_mean	0.1624500582187466
deviation-center-line_min	0.0769773786357223
deviation-heading_max	2.1403805469798955
deviation-heading_mean	0.8860564907890532
deviation-heading_median	0.5259417022071453
deviation-heading_min	0.3519620117620266
distance-from-start_max	1.1016375678597
distance-from-start_mean	0.7059973136726385
distance-from-start_median	0.6833760268791894
distance-from-start_min	0.35559963307247505
driven_any_max	1.1268128303498697
driven_any_mean	0.7399640393767525
driven_any_median	0.7384870665802588
driven_any_min	0.35606919399662296
driven_lanedir_consec_max	0.7512181091585031
driven_lanedir_consec_mean	0.31628738618984636
driven_lanedir_consec_min	0.13858701442764598
driven_lanedir_max	0.7512181091585031
driven_lanedir_mean	0.341192085120401
driven_lanedir_median	0.23748160844772753
driven_lanedir_min	0.13858701442764598
in-drivable-lane_max	4.1999999999999895
in-drivable-lane_mean	3.312499999999991
in-drivable-lane_min	2.199999999999992
per-episodes	details {"4way-000-ego0": {"driven_any": 1.1025751735999951, "survival_time": 5.04999999999999, "driven_lanedir": 0.30188599702766916, "in-drivable-lane": 2.699999999999995, "deviation-heading": 2.1403805469798955, "distance-from-start": 0.9937620651015164, "deviation-center-line": 0.20617909212454613, "driven_lanedir_consec": 0.2022672013054505}, "4way-000-ego1": {"driven_any": 0.3743989595605224, "survival_time": 5.04999999999999, "driven_lanedir": 0.1730772198677859, "in-drivable-lane": 4.14999999999999, "deviation-heading": 0.3519620117620266, "distance-from-start": 0.3729899886568625, "deviation-center-line": 0.08555780448017648, "driven_lanedir_consec": 0.1730772198677859}, "4way-000-ego2": {"driven_any": 1.1268128303498697, "survival_time": 5.04999999999999, "driven_lanedir": 0.7512181091585031, "in-drivable-lane": 2.199999999999992, "deviation-heading": 0.5577241161295707, "distance-from-start": 1.1016375678597, "deviation-center-line": 0.2810859576345415, "driven_lanedir_consec": 0.7512181091585031}, "4way-000-ego3": {"driven_any": 0.35606919399662296, "survival_time": 5.04999999999999, "driven_lanedir": 0.13858701442764598, "in-drivable-lane": 4.1999999999999895, "deviation-heading": 0.49415928828471994, "distance-from-start": 0.35559963307247505, "deviation-center-line": 0.0769773786357223, "driven_lanedir_consec": 0.13858701442764598}}
simulation-passed	1
survival_time_max	5.04999999999999
survival_time_mean	5.04999999999999
survival_time_min	5.04999999999999

No reset possible

14110

1148

Bea Baselines 🐤

template-ros

sim-2of4

success

2022-11-23 17:46:12+00:00

2022-11-23 17:47:48+00:00

0:01:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	8.74999999999999
in-drivable-lane_median	7.1499999999999915
driven_lanedir_consec_median	0.18117965192589364
deviation-center-line_median	0.1310155300800333

other stats

deviation-center-line_max	0.1310155300800333
deviation-center-line_mean	0.1310155300800333
deviation-center-line_min	0.1310155300800333
deviation-heading_max	1.5890338723326227
deviation-heading_mean	1.5890338723326227
deviation-heading_median	1.5890338723326227
deviation-heading_min	1.5890338723326227
distance-from-start_max	2.432891954000633
distance-from-start_mean	2.432891954000633
distance-from-start_median	2.432891954000633
distance-from-start_min	2.432891954000633
driven_any_max	2.4885941742323543
driven_any_mean	2.4885941742323543
driven_any_median	2.4885941742323543
driven_any_min	2.4885941742323543
driven_lanedir_consec_max	0.18117965192589364
driven_lanedir_consec_mean	0.18117965192589364
driven_lanedir_consec_min	0.18117965192589364
driven_lanedir_max	0.18117965192589364
driven_lanedir_mean	0.18117965192589364
driven_lanedir_median	0.18117965192589364
driven_lanedir_min	0.18117965192589364
in-drivable-lane_max	7.1499999999999915
in-drivable-lane_mean	7.1499999999999915
in-drivable-lane_min	7.1499999999999915
per-episodes	details {"loop2-000-ego0": {"driven_any": 2.4885941742323543, "survival_time": 8.74999999999999, "driven_lanedir": 0.18117965192589364, "in-drivable-lane": 7.1499999999999915, "deviation-heading": 1.5890338723326227, "distance-from-start": 2.432891954000633, "deviation-center-line": 0.1310155300800333, "driven_lanedir_consec": 0.18117965192589364}}
simulation-passed	1
survival_time_max	8.74999999999999
survival_time_mean	8.74999999999999
survival_time_min	8.74999999999999

No reset possible

14106

1148

Bea Baselines 🐤

template-ros

sim-3of4

success

2022-11-23 17:44:06+00:00

2022-11-23 17:45:44+00:00

0:01:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	6.199999999999986
in-drivable-lane_median	4.299999999999989
driven_lanedir_consec_median	0.36088392404773906
deviation-center-line_median	0.15955961054912549

other stats

deviation-center-line_max	0.15955961054912549
deviation-center-line_mean	0.15955961054912549
deviation-center-line_min	0.15955961054912549
deviation-heading_max	1.4067216980394563
deviation-heading_mean	1.4067216980394563
deviation-heading_median	1.4067216980394563
deviation-heading_min	1.4067216980394563
distance-from-start_max	1.4504392524908565
distance-from-start_mean	1.4504392524908565
distance-from-start_median	1.4504392524908565
distance-from-start_min	1.4504392524908565
driven_any_max	1.4641528709168892
driven_any_mean	1.4641528709168892
driven_any_median	1.4641528709168892
driven_any_min	1.4641528709168892
driven_lanedir_consec_max	0.36088392404773906
driven_lanedir_consec_mean	0.36088392404773906
driven_lanedir_consec_min	0.36088392404773906
driven_lanedir_max	0.36088392404773906
driven_lanedir_mean	0.36088392404773906
driven_lanedir_median	0.36088392404773906
driven_lanedir_min	0.36088392404773906
in-drivable-lane_max	4.299999999999989
in-drivable-lane_mean	4.299999999999989
in-drivable-lane_min	4.299999999999989
per-episodes	details {"zigzag-000-ego0": {"driven_any": 1.4641528709168892, "survival_time": 6.199999999999986, "driven_lanedir": 0.36088392404773906, "in-drivable-lane": 4.299999999999989, "deviation-heading": 1.4067216980394563, "distance-from-start": 1.4504392524908565, "deviation-center-line": 0.15955961054912549, "driven_lanedir_consec": 0.36088392404773906}}
simulation-passed	1
survival_time_max	6.199999999999986
survival_time_mean	6.199999999999986
survival_time_min	6.199999999999986

No reset possible

14097

1151

Bea Baselines 🐤

template-tensorflow

sim-3of4

success

2022-11-23 17:39:49+00:00

2022-11-23 17:41:21+00:00

0:01:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

14093

1152

Bea Baselines 🐤

template-tensorflow

sim-2of4

failed

2022-11-23 17:38:16+00:00

2022-11-23 17:39:15+00:00

0:00:59

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14088

1153

Bea Baselines 🐤

template-tensorflow

sim-1of4

failed

2022-11-23 17:36:22+00:00

2022-11-23 17:37:50+00:00

0:01:28

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14079

1154

Bea Baselines 🐤

template-tensorflow

sim-3of4

failed

2022-11-23 17:34:27+00:00

2022-11-23 17:35:55+00:00

0:01:28

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14077

1155

Bea Baselines 🐤

template-tensorflow

sim-0of4

failed

2022-11-23 17:33:02+00:00

2022-11-23 17:34:14+00:00

0:01:12

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14070

1167

Bea Baselines 🐤

template-tensorflow

sim-2of4

failed

2022-11-23 17:31:00+00:00

2022-11-23 17:32:41+00:00

0:01:41

The container "solut [...]

The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14066

1168

Bea Baselines 🐤

template-tensorflow

sim-0of4

failed

2022-11-23 17:29:04+00:00

2022-11-23 17:30:45+00:00

0:01:41

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14059

1169

Bea Baselines 🐤

template-tensorflow

sim-1of4

failed

2022-11-23 17:27:28+00:00

2022-11-23 17:28:58+00:00

0:01:30

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14055

1171

Bea Baselines 🐤

template-tensorflow

sim-2of4

success

2022-11-23 17:25:32+00:00

2022-11-23 17:26:59+00:00

0:01:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

14051

1172

Bea Baselines 🐤

template-tensorflow

sim-0of4

failed

2022-11-23 17:23:53+00:00

2022-11-23 17:25:17+00:00

0:01:24

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14046

1173

Bea Baselines 🐤

template-tensorflow

sim-2of4

failed

2022-11-23 17:22:22+00:00

2022-11-23 17:23:25+00:00

0:01:03

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14033

1180

Bea Baselines 🐤

baseline-duckietown-ml

lx22-objdet

sim

success

yes

2022-11-23 17:10:34+00:00

2022-11-23 17:22:15+00:00

0:11:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	56.07499999999895
driven_lanedir_consec_median	5.684295474815756

other stats

deviation-center-line_max	2.243388126606608
deviation-center-line_mean	2.091390723585355
deviation-center-line_median	2.091390723585355
deviation-center-line_min	1.9393933205641016
deviation-heading_max	3.5592274424666552
deviation-heading_mean	2.740925632278871
deviation-heading_median	2.740925632278871
deviation-heading_min	1.9226238220910867
distance-from-start_max	7.656191068384238
distance-from-start_mean	7.211029066489681
distance-from-start_median	7.211029066489681
distance-from-start_min	6.765867064595124
driven_any_max	7.921245861179667
driven_any_mean	7.347027985635108
driven_any_median	7.347027985635108
driven_any_min	6.772810110090549
driven_lanedir_consec_max	6.765989633353028
driven_lanedir_consec_mean	5.684295474815756
driven_lanedir_consec_min	4.602601316278484
driven_lanedir_max	6.765989633353028
driven_lanedir_mean	5.684295474815756
driven_lanedir_median	5.684295474815756
driven_lanedir_min	4.602601316278484
in-drivable-lane_max	24.59999999999938
in-drivable-lane_mean	12.29999999999969
in-drivable-lane_median	12.29999999999969
in-drivable-lane_min	0.0
per-episodes	details {"LF-long-loop-with-duckies-000-ego0": {"driven_any": 6.772810110090549, "survival_time": 52.149999999999174, "driven_lanedir": 6.765989633353028, "in-drivable-lane": 0.0, "deviation-heading": 1.9226238220910867, "distance-from-start": 6.765867064595124, "deviation-center-line": 1.9393933205641016, "driven_lanedir_consec": 6.765989633353028}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 7.921245861179667, "survival_time": 59.99999999999873, "driven_lanedir": 4.602601316278484, "in-drivable-lane": 24.59999999999938, "deviation-heading": 3.5592274424666552, "distance-from-start": 7.656191068384238, "deviation-center-line": 2.243388126606608, "driven_lanedir_consec": 4.602601316278484}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	56.07499999999895
survival_time_min	52.149999999999174

No reset possible

14026

1186

Bea Baselines 🐤

baseline-duckietown

lx22-state-estimation

sim

success

yes

2022-11-23 16:55:51+00:00

2022-11-23 17:10:22+00:00

0:14:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0
survival_time_median	59.99999999999873
deviation-center-line_median	1.218352815298077
in-drivable-lane_median	0.0

other stats

deviation-center-line_max	2.510227052706017
deviation-center-line_mean	1.2556911097991184
deviation-center-line_min	0.03849346139326115
deviation-heading_max	13.13020219115658
deviation-heading_mean	10.183598661533924
deviation-heading_median	11.981267076309448
deviation-heading_min	5.439326717135747
distance-from-start_max	0.0
distance-from-start_mean	0.0
distance-from-start_median	0.0
distance-from-start_min	0.0
driven_any_max	0.0
driven_any_mean	0.0
driven_any_median	0.0
driven_any_min	0.0
driven_lanedir_consec_max	0.000286102294921875
driven_lanedir_consec_mean	9.5367431640625e-05
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.000286102294921875
driven_lanedir_mean	9.5367431640625e-05
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"LF-zig-zag-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 5.439326717135747, "distance-from-start": 0.0, "deviation-center-line": 0.03849346139326115, "driven_lanedir_consec": 0.0}, "LF-zig-zag-001-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 13.13020219115658, "distance-from-start": 0.0, "deviation-center-line": 1.218352815298077, "driven_lanedir_consec": 0.0}, "LF-zig-zag-002-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 11.981267076309448, "distance-from-start": 0.0, "deviation-center-line": 2.510227052706017, "driven_lanedir_consec": 0.000286102294921875}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14019

1194

Bea Baselines 🐤

template-pytorch

lx22-state-estimation

sim

success

yes

2022-11-23 16:41:24+00:00

2022-11-23 16:55:25+00:00

0:14:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.8996363288114566
survival_time_median	59.99999999999873
deviation-center-line_median	2.413898583237193
in-drivable-lane_median	30.54999999999935

other stats

deviation-center-line_max	2.9464694805413347
deviation-center-line_mean	2.369512405299016
deviation-center-line_min	1.7481691521185196
deviation-heading_max	23.45436651455817
deviation-heading_mean	22.01261573525966
deviation-heading_median	22.92786869746967
deviation-heading_min	19.65561199375114
distance-from-start_max	0.5740194709025452
distance-from-start_mean	0.43010835527186414
distance-from-start_median	0.4407443906995591
distance-from-start_min	0.27556120421348806
driven_any_max	3.493918949192832
driven_any_mean	3.373476645877671
driven_any_median	3.492067968553798
driven_any_min	3.1344430198863833
driven_lanedir_consec_max	0.9645933638962844
driven_lanedir_consec_mean	0.841143393952056
driven_lanedir_consec_min	0.6592004891484264
driven_lanedir_max	0.9645933638962844
driven_lanedir_mean	0.841143393952056
driven_lanedir_median	0.8996363288114566
driven_lanedir_min	0.6592004891484264
in-drivable-lane_max	34.699999999999115
in-drivable-lane_mean	31.633333333332597
in-drivable-lane_min	29.649999999999324
per-episodes	details {"LF-zig-zag-000-ego0": {"driven_any": 3.1344430198863833, "survival_time": 59.99999999999873, "driven_lanedir": 0.6592004891484264, "in-drivable-lane": 34.699999999999115, "deviation-heading": 19.65561199375114, "distance-from-start": 0.4407443906995591, "deviation-center-line": 1.7481691521185196, "driven_lanedir_consec": 0.6592004891484264}, "LF-zig-zag-001-ego0": {"driven_any": 3.493918949192832, "survival_time": 59.99999999999873, "driven_lanedir": 0.9645933638962844, "in-drivable-lane": 30.54999999999935, "deviation-heading": 22.92786869746967, "distance-from-start": 0.27556120421348806, "deviation-center-line": 2.413898583237193, "driven_lanedir_consec": 0.9645933638962844}, "LF-zig-zag-002-ego0": {"driven_any": 3.492067968553798, "survival_time": 59.99999999999873, "driven_lanedir": 0.8996363288114566, "in-drivable-lane": 29.649999999999324, "deviation-heading": 23.45436651455817, "distance-from-start": 0.5740194709025452, "deviation-center-line": 2.9464694805413347, "driven_lanedir_consec": 0.8996363288114566}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

14012

783

template-random

sim-2of4

success

2022-11-23 16:37:28+00:00

2022-11-23 16:41:09+00:00

0:03:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.27378584101885495
survival_time_median	20.550000000000157
deviation-center-line_median	0.7687309613328539
in-drivable-lane_median	12.000000000000131

other stats

deviation-center-line_max	0.7687309613328539
deviation-center-line_mean	0.7687309613328539
deviation-center-line_min	0.7687309613328539
deviation-heading_max	5.7583430601860695
deviation-heading_mean	5.7583430601860695
deviation-heading_median	5.7583430601860695
deviation-heading_min	5.7583430601860695
distance-from-start_max	0.7357883576773772
distance-from-start_mean	0.7357883576773772
distance-from-start_median	0.7357883576773772
distance-from-start_min	0.7357883576773772
driven_any_max	4.915576034387011
driven_any_mean	4.915576034387011
driven_any_median	4.915576034387011
driven_any_min	4.915576034387011
driven_lanedir_consec_max	0.27378584101885495
driven_lanedir_consec_mean	0.27378584101885495
driven_lanedir_consec_min	0.27378584101885495
driven_lanedir_max	0.2557751649818414
driven_lanedir_mean	0.2557751649818414
driven_lanedir_median	0.2557751649818414
driven_lanedir_min	0.2557751649818414
in-drivable-lane_max	12.000000000000131
in-drivable-lane_mean	12.000000000000131
in-drivable-lane_min	12.000000000000131
per-episodes	details {"loop2-000-ego0": {"driven_any": 4.915576034387011, "survival_time": 20.550000000000157, "driven_lanedir": 0.2557751649818414, "in-drivable-lane": 12.000000000000131, "deviation-heading": 5.7583430601860695, "distance-from-start": 0.7357883576773772, "deviation-center-line": 0.7687309613328539, "driven_lanedir_consec": 0.27378584101885495}}
simulation-passed	1
survival_time_max	20.550000000000157
survival_time_mean	20.550000000000157
survival_time_min	20.550000000000157

No reset possible

14006 1193 Bea Baselines 🐤 template-pytorch lx22-visservoing sim timeout yes davinci-stage-05-6.2.50 2022-11-23 16:13:09+00:00 - - - - No reset possible

13978

783

template-random

sim-0of4

host-error

2022-11-23 15:06:32+00:00

2022-11-23 16:12:54+00:00

1:06:22

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 60, in check_docker_environment
    client = docker.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1107, in run_single
    cr = run_one(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1197, in run_one
    client = check_docker_environment()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 69, in check_docker_environment
    raise InvalidEnvironment(msg)
duckietown_challenges.exceptions.InvalidEnvironment: I cannot communicate with Docker:
Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Make sure the docker service is running.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13969

672

Bea Baselines 🐤

template-tensorflow

sim-1of4

host-error

2022-11-23 13:58:11+00:00

2022-11-23 15:06:13+00:00

1:08:02

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 60, in check_docker_environment
    client = docker.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1107, in run_single
    cr = run_one(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1197, in run_one
    client = check_docker_environment()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 69, in check_docker_environment
    raise InvalidEnvironment(msg)
duckietown_challenges.exceptions.InvalidEnvironment: I cannot communicate with Docker:
Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Make sure the docker service is running.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13968

789

template-pytorch

sim-2of4

host-error

2022-11-23 13:57:02+00:00

2022-11-23 13:58:05+00:00

0:01:03

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1097, in run_single
    client = DockerClient.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13967

789

template-pytorch

sim-0of4

host-error

2022-11-23 13:55:37+00:00

2022-11-23 13:56:40+00:00

0:01:03

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1097, in run_single
    client = DockerClient.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13958

785

template-ros

sim-2of4

host-error

2022-11-23 12:40:16+00:00

2022-11-23 13:55:22+00:00

1:15:06

Error while running [...]

Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-stage-05-6.2.50-job13958-587203, up, --no-start,
│          --renew-anon-volumes]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-stage-05-6.2.50-job13958-587203', 'up', '--no-start', '--renew-anon-volumes']' returned non-zero exit status 1.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13957

785

template-ros

sim-0of4

host-error

2022-11-23 12:38:00+00:00

2022-11-23 12:39:53+00:00

0:01:53

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1097, in run_single
    client = DockerClient.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13951

698

Bea Baselines 🐤

minimal-agent

sim-3of4

host-error

2022-11-23 10:10:36+00:00

2022-11-23 12:37:42+00:00

2:27:06

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 60, in check_docker_environment
    client = docker.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1107, in run_single
    cr = run_one(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1197, in run_one
    client = check_docker_environment()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 69, in check_docker_environment
    raise InvalidEnvironment(msg)
duckietown_challenges.exceptions.InvalidEnvironment: I cannot communicate with Docker:
Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Make sure the docker service is running.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13945

697

Bea Baselines 🐤

minimal-agent

sim-3of4

host-error

2022-11-23 10:09:05+00:00

2022-11-23 10:10:07+00:00

0:01:02

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1097, in run_single
    client = DockerClient.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13941

698

Bea Baselines 🐤

minimal-agent

sim-2of4

host-error

2022-11-23 10:07:49+00:00

2022-11-23 10:08:51+00:00

0:01:02

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1097, in run_single
    client = DockerClient.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13935

700

Bea Baselines 🐤

minimal-agent

sim-1of4

success

2022-11-23 10:04:27+00:00

2022-11-23 10:07:23+00:00

0:02:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	9.850000000000003
in-drivable-lane_median	8.450000000000005
driven_lanedir_consec_median	0.13666265914899656
deviation-center-line_median	0.10783777071756002

other stats

deviation-center-line_max	0.10783777071756002
deviation-center-line_mean	0.10783777071756002
deviation-center-line_min	0.10783777071756002
deviation-heading_max	0.9508048428349386
deviation-heading_mean	0.9508048428349386
deviation-heading_median	0.9508048428349386
deviation-heading_min	0.9508048428349386
distance-from-start_max	1.4547842507789357
distance-from-start_mean	1.4547842507789357
distance-from-start_median	1.4547842507789357
distance-from-start_min	1.4547842507789357
driven_any_max	1.454891323746283
driven_any_mean	1.454891323746283
driven_any_median	1.454891323746283
driven_any_min	1.454891323746283
driven_lanedir_consec_max	0.13666265914899656
driven_lanedir_consec_mean	0.13666265914899656
driven_lanedir_consec_min	0.13666265914899656
driven_lanedir_max	0.13666265914899656
driven_lanedir_mean	0.13666265914899656
driven_lanedir_median	0.13666265914899656
driven_lanedir_min	0.13666265914899656
in-drivable-lane_max	8.450000000000005
in-drivable-lane_mean	8.450000000000005
in-drivable-lane_min	8.450000000000005
per-episodes	details {"udem1-000-ego0": {"driven_any": 1.454891323746283, "survival_time": 9.850000000000003, "driven_lanedir": 0.13666265914899656, "in-drivable-lane": 8.450000000000005, "deviation-heading": 0.9508048428349386, "distance-from-start": 1.4547842507789357, "deviation-center-line": 0.10783777071756002, "driven_lanedir_consec": 0.13666265914899656}}
simulation-passed	1
survival_time_max	9.850000000000003
survival_time_mean	9.850000000000003
survival_time_min	9.850000000000003

No reset possible

13928

702

Bea Baselines 🐤

minimal-agent

sim-0of4

success

2022-11-23 10:00:11+00:00

2022-11-23 10:04:06+00:00

0:03:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	11.050000000000022
in-drivable-lane_median	9.425000000000022
driven_lanedir_consec_median	0.18712269938788828
deviation-center-line_median	0.15973050554702342

other stats

deviation-center-line_max	0.21472209870657577
deviation-center-line_mean	0.16050533162691244
deviation-center-line_min	0.10783821670702712
deviation-heading_max	1.3047652579244493
deviation-heading_mean	0.8970980849375731
deviation-heading_median	0.8549948818349844
deviation-heading_min	0.5736373181558745
distance-from-start_max	1.6510147598674252
distance-from-start_mean	0.6888645402096076
distance-from-start_median	0.439724395200456
distance-from-start_min	0.2249946105700932
driven_any_max	1.6511245063698194
driven_any_mean	0.6888969972348484
driven_any_median	0.43973285777181176
driven_any_min	0.2249977670259511
driven_lanedir_consec_max	0.6611934212369679
driven_lanedir_consec_mean	0.2874529754105062
driven_lanedir_consec_min	0.11437308162928028
driven_lanedir_max	0.6611934212369679
driven_lanedir_mean	0.2874529754105062
driven_lanedir_median	0.18712269938788828
driven_lanedir_min	0.11437308162928028
in-drivable-lane_max	9.850000000000025
in-drivable-lane_mean	8.750000000000025
in-drivable-lane_min	6.300000000000031
per-episodes	details {"udem-000-ego0": {"driven_any": 0.5146585239873331, "survival_time": 11.050000000000022, "driven_lanedir": 0.13666480491620847, "in-drivable-lane": 9.650000000000022, "deviation-heading": 0.9508048428349388, "distance-from-start": 0.5146479428595168, "deviation-center-line": 0.10783821670702712, "driven_lanedir_consec": 0.13666480491620847}, "udem-000-ego1": {"driven_any": 0.3648071915562904, "survival_time": 11.050000000000022, "driven_lanedir": 0.2375805938595681, "in-drivable-lane": 9.20000000000002, "deviation-heading": 0.5736373181558745, "distance-from-start": 0.3648008475413953, "deviation-center-line": 0.20320962418622543, "driven_lanedir_consec": 0.2375805938595681}, "udem-000-ego2": {"driven_any": 1.6511245063698194, "survival_time": 11.050000000000022, "driven_lanedir": 0.6611934212369679, "in-drivable-lane": 6.300000000000031, "deviation-heading": 1.3047652579244493, "distance-from-start": 1.6510147598674252, "deviation-center-line": 0.21472209870657577, "driven_lanedir_consec": 0.6611934212369679}, "udem-000-ego3": {"driven_any": 0.2249977670259511, "survival_time": 11.050000000000022, "driven_lanedir": 0.11437308162928028, "in-drivable-lane": 9.850000000000025, "deviation-heading": 0.7591849208350301, "distance-from-start": 0.2249946105700932, "deviation-center-line": 0.1162513869078214, "driven_lanedir_consec": 0.11437308162928028}}
simulation-passed	1
survival_time_max	11.050000000000022
survival_time_mean	11.050000000000022
survival_time_min	11.050000000000022

No reset possible

13922

397

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-2of4

success

2022-11-23 09:53:35+00:00

2022-11-23 09:59:58+00:00

0:06:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-2.786512069783048
survival_time_median	59.99999999999873
deviation-center-line_median	3.654358251014594
in-drivable-lane_median	20.39999999999942

other stats

deviation-center-line_max	3.654358251014594
deviation-center-line_mean	3.654358251014594
deviation-center-line_min	3.654358251014594
deviation-heading_max	29.011011122926273
deviation-heading_mean	29.011011122926273
deviation-heading_median	29.011011122926273
deviation-heading_min	29.011011122926273
distance-from-start_max	0.13622954990538025
distance-from-start_mean	0.13622954990538025
distance-from-start_median	0.13622954990538025
distance-from-start_min	0.13622954990538025
driven_any_max	10.843643836576865
driven_any_mean	10.843643836576865
driven_any_median	10.843643836576865
driven_any_min	10.843643836576865
driven_lanedir_consec_max	-2.786512069783048
driven_lanedir_consec_mean	-2.786512069783048
driven_lanedir_consec_min	-2.786512069783048
driven_lanedir_max	-2.786512069783048
driven_lanedir_mean	-2.786512069783048
driven_lanedir_median	-2.786512069783048
driven_lanedir_min	-2.786512069783048
in-drivable-lane_max	20.39999999999942
in-drivable-lane_mean	20.39999999999942
in-drivable-lane_min	20.39999999999942
per-episodes	details {"loop2-000-ego0": {"driven_any": 10.843643836576865, "survival_time": 59.99999999999873, "driven_lanedir": -2.786512069783048, "in-drivable-lane": 20.39999999999942, "deviation-heading": 29.011011122926273, "distance-from-start": 0.13622954990538025, "deviation-center-line": 3.654358251014594, "driven_lanedir_consec": -2.786512069783048}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

13918

526

Bea Baselines 🐤

baseline-behavior-cloning

sim-0of4

failed

2022-11-23 09:52:31+00:00

2022-11-23 09:53:27+00:00

0:00:56

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13914

672

Bea Baselines 🐤

template-tensorflow

sim-3of4

failed

2022-11-23 09:51:00+00:00

2022-11-23 09:51:56+00:00

0:00:56

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13908

783

template-random

sim-3of4

success

2022-11-23 09:46:59+00:00

2022-11-23 09:50:37+00:00

0:03:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2676465159268615
survival_time_median	25.00000000000022
deviation-center-line_median	0.7555297758130887
in-drivable-lane_median	16.4500000000002

other stats

deviation-center-line_max	0.7555297758130887
deviation-center-line_mean	0.7555297758130887
deviation-center-line_min	0.7555297758130887
deviation-heading_max	5.523299068383883
deviation-heading_mean	5.523299068383883
deviation-heading_median	5.523299068383883
deviation-heading_min	5.523299068383883
distance-from-start_max	0.796098057853727
distance-from-start_mean	0.796098057853727
distance-from-start_median	0.796098057853727
distance-from-start_min	0.796098057853727
driven_any_max	6.187140538312911
driven_any_mean	6.187140538312911
driven_any_median	6.187140538312911
driven_any_min	6.187140538312911
driven_lanedir_consec_max	0.2676465159268615
driven_lanedir_consec_mean	0.2676465159268615
driven_lanedir_consec_min	0.2676465159268615
driven_lanedir_max	0.24963703198272744
driven_lanedir_mean	0.24963703198272744
driven_lanedir_median	0.24963703198272744
driven_lanedir_min	0.24963703198272744
in-drivable-lane_max	16.4500000000002
in-drivable-lane_mean	16.4500000000002
in-drivable-lane_min	16.4500000000002
per-episodes	details {"zigzag-000-ego0": {"driven_any": 6.187140538312911, "survival_time": 25.00000000000022, "driven_lanedir": 0.24963703198272744, "in-drivable-lane": 16.4500000000002, "deviation-heading": 5.523299068383883, "distance-from-start": 0.796098057853727, "deviation-center-line": 0.7555297758130887, "driven_lanedir_consec": 0.2676465159268615}}
simulation-passed	1
survival_time_max	25.00000000000022
survival_time_mean	25.00000000000022
survival_time_min	25.00000000000022

No reset possible

13898

789

template-pytorch

sim-0of4

success

2022-11-23 09:37:48+00:00

2022-11-23 09:46:47+00:00

0:08:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.8218023337113296
survival_time_median	59.99999999999873
deviation-center-line_median	2.647166374701749
in-drivable-lane_median	35.149999999999395

other stats

deviation-center-line_max	2.647166374701749
deviation-center-line_mean	2.647166374701749
deviation-center-line_min	2.647166374701749
deviation-heading_max	19.887216107693796
deviation-heading_mean	19.887216107693796
deviation-heading_median	19.887216107693796
deviation-heading_min	19.887216107693796
distance-from-start_max	0.7658338005223344
distance-from-start_mean	0.7658338005223344
distance-from-start_median	0.7658338005223344
distance-from-start_min	0.7658338005223344
driven_any_max	5.884652217838766
driven_any_mean	5.884652217838766
driven_any_median	5.884652217838766
driven_any_min	5.884652217838766
driven_lanedir_consec_max	0.8218023337113296
driven_lanedir_consec_mean	0.8218023337113296
driven_lanedir_consec_min	0.8218023337113296
driven_lanedir_max	1.525261460749498
driven_lanedir_mean	1.525261460749498
driven_lanedir_median	1.525261460749498
driven_lanedir_min	1.525261460749498
in-drivable-lane_max	35.149999999999395
in-drivable-lane_mean	35.149999999999395
in-drivable-lane_min	35.149999999999395
per-episodes	details {"autolab-000-ego0": {"driven_any": 5.884652217838766, "survival_time": 59.99999999999873, "driven_lanedir": 1.525261460749498, "in-drivable-lane": 35.149999999999395, "deviation-heading": 19.887216107693796, "distance-from-start": 0.7658338005223344, "deviation-center-line": 2.647166374701749, "driven_lanedir_consec": 0.8218023337113296}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

13893

310

minimal-agent

sim-1of4

error

2022-11-23 01:35:37+00:00

2022-11-23 01:37:26+00:00

0:01:49

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13886

311

minimal-agent

sim-2of4

error

2022-11-23 01:33:25+00:00

2022-11-23 01:35:03+00:00

0:01:38

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13879

341

template-ros

sim-0of4

failed

2022-11-23 01:30:05+00:00

2022-11-23 01:33:04+00:00

0:02:59

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 243, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13874

356

template-ros

sim-0of4

error

2022-11-23 01:28:50+00:00

2022-11-23 01:29:58+00:00

0:01:08

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13869

385

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-2of4

error

2022-11-23 01:27:08+00:00

2022-11-23 01:28:38+00:00

0:01:30

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13864

386

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-2of4

error

2022-11-23 01:25:37+00:00

2022-11-23 01:26:35+00:00

0:00:58

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13859

387

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-1of4

error

2022-11-23 01:23:46+00:00

2022-11-23 01:25:23+00:00

0:01:37

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13854

388

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-2of4

success

2022-11-23 01:21:57+00:00

2022-11-23 01:23:26+00:00

0:01:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13848

389

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-3of4

success

2022-11-23 01:20:08+00:00

2022-11-23 01:21:36+00:00

0:01:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13844

390

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-3of4

error

2022-11-23 01:18:58+00:00

2022-11-23 01:19:53+00:00

0:00:55

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13839

391

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-3of4

success

2022-11-23 01:17:22+00:00

2022-11-23 01:18:39+00:00

0:01:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13837

393

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-3of4

error

2022-11-23 01:16:19+00:00

2022-11-23 01:17:15+00:00

0:00:56

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13830

394

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-1of4

error

2022-11-23 01:14:25+00:00

2022-11-23 01:16:04+00:00

0:01:39

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13825

395

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-2of4

success

2022-11-23 01:12:22+00:00

2022-11-23 01:13:50+00:00

0:01:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13821

396

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-3of4

success

2022-11-23 01:10:48+00:00

2022-11-23 01:12:15+00:00

0:01:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13816

398

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-3of4

success

2022-11-23 01:09:25+00:00

2022-11-23 01:10:41+00:00

0:01:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13812

514

Bea Baselines 🐤

baseline-behavior-cloning

sim-0of4

failed

2022-11-23 01:08:02+00:00

2022-11-23 01:09:14+00:00

0:01:12

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13808

515

Bea Baselines 🐤

baseline-behavior-cloning

sim-0of4

failed

2022-11-23 01:06:46+00:00

2022-11-23 01:07:42+00:00

0:00:56

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13803

517

Bea Baselines 🐤

baseline-behavior-cloning

sim-3of4

success

2022-11-23 01:05:00+00:00

2022-11-23 01:06:31+00:00

0:01:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13798

518

Bea Baselines 🐤

baseline-behavior-cloning

sim-1of4

failed

2022-11-23 01:03:09+00:00

2022-11-23 01:04:33+00:00

0:01:24

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13793

519

Bea Baselines 🐤

baseline-behavior-cloning

sim-0of4

failed

2022-11-23 01:01:49+00:00

2022-11-23 01:02:43+00:00

0:00:54

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13788

520

Bea Baselines 🐤

baseline-behavior-cloning

sim-1of4

failed

2022-11-23 01:00:09+00:00

2022-11-23 01:01:21+00:00

0:01:12

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13783

522

Bea Baselines 🐤

baseline-behavior-cloning

sim-2of4

failed

2022-11-23 00:58:57+00:00

2022-11-23 00:59:54+00:00

0:00:57

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13780

522

Bea Baselines 🐤

baseline-behavior-cloning

sim-3of4

failed

2022-11-23 00:57:56+00:00

2022-11-23 00:58:51+00:00

0:00:55

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13777

524

Bea Baselines 🐤

baseline-behavior-cloning

sim-2of4

success

2022-11-23 00:56:05+00:00

2022-11-23 00:57:35+00:00

0:01:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13772

525

Bea Baselines 🐤

baseline-behavior-cloning

sim-3of4

success

2022-11-23 00:54:27+00:00

2022-11-23 00:55:58+00:00

0:01:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13766

527

Bea Baselines 🐤

baseline-behavior-cloning

sim-2of4

success

2022-11-23 00:52:44+00:00

2022-11-23 00:53:58+00:00

0:01:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13760

528

Bea Baselines 🐤

baseline-dagger-pytorch

sim-1of4

error

2022-11-23 00:51:04+00:00

2022-11-23 00:52:19+00:00

0:01:15

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13755

529

Bea Baselines 🐤

baseline-dagger-pytorch

sim-1of4

error

2022-11-23 00:49:55+00:00

2022-11-23 00:50:49+00:00

0:00:54

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13751

530

Bea Baselines 🐤

baseline-dagger-pytorch

sim-0of4

error

2022-11-23 00:47:55+00:00

2022-11-23 00:49:22+00:00

0:01:27

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13745

532

Bea Baselines 🐤

baseline-dagger-pytorch

sim-3of4

success

2022-11-23 00:46:10+00:00

2022-11-23 00:47:43+00:00

0:01:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13741

533

Bea Baselines 🐤

baseline-dagger-pytorch

sim-2of4

error

2022-11-23 00:45:09+00:00

2022-11-23 00:46:04+00:00

0:00:55

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13736

534

Bea Baselines 🐤

baseline-dagger-pytorch

sim-3of4

success

2022-11-23 00:43:20+00:00

2022-11-23 00:44:36+00:00

0:01:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13730

535

Bea Baselines 🐤

baseline-dagger-pytorch

sim-2of4

error

2022-11-23 00:41:46+00:00

2022-11-23 00:43:13+00:00

0:01:27

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13726

536

Bea Baselines 🐤

baseline-dagger-pytorch

sim-3of4

error

2022-11-23 00:40:36+00:00

2022-11-23 00:41:32+00:00

0:00:56

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13721

538

Bea Baselines 🐤

baseline-dagger-pytorch

sim-3of4

success

2022-11-23 00:38:40+00:00

2022-11-23 00:40:08+00:00

0:01:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13716

539

Bea Baselines 🐤

baseline-dagger-pytorch

sim-2of4

success

2022-11-23 00:36:55+00:00

2022-11-23 00:38:25+00:00

0:01:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13711

541

Bea Baselines 🐤

baseline-dagger-pytorch

sim-1of4

error

2022-11-23 00:35:44+00:00

2022-11-23 00:36:41+00:00

0:00:57

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13706

544

Bea Baselines 🐤

baseline-dagger-pytorch

sanity-check

error

2022-11-23 00:34:19+00:00

2022-11-23 00:35:17+00:00

0:00:58

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13702

600

template-tensorflow

sim-2of4

failed

2022-11-23 00:33:11+00:00

2022-11-23 00:34:08+00:00

0:00:57

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13696

603

Bea Baselines 🐤

template-ros

sim-1of4

error

2022-11-23 00:31:28+00:00

2022-11-23 00:32:51+00:00

0:01:23

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13690

605

Bea Baselines 🐤

template-ros

sim-1of4

error

2022-11-23 00:29:44+00:00

2022-11-23 00:31:22+00:00

0:01:38

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13684

606

Bea Baselines 🐤

template-ros

sim-1of4

error

2022-11-23 00:27:50+00:00

2022-11-23 00:29:31+00:00

0:01:41

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13680

607

Bea Baselines 🐤

template-ros

sim-3of4

success

2022-11-23 00:26:08+00:00

2022-11-23 00:27:37+00:00

0:01:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13673

610

Bea Baselines 🐤

template-ros

sim-1of4

error

2022-11-23 00:24:27+00:00

2022-11-23 00:25:47+00:00

0:01:20

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13668

610

Bea Baselines 🐤

template-ros

sim-3of4

error

2022-11-23 00:22:56+00:00

2022-11-23 00:24:16+00:00

0:01:20

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13665

612

Bea Baselines 🐤

template-ros

sim-0of4

error

2022-11-23 00:21:15+00:00

2022-11-23 00:22:43+00:00

0:01:28

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13660

613

Bea Baselines 🐤

template-ros

sim-2of4

success

2022-11-23 00:19:38+00:00

2022-11-23 00:21:06+00:00

0:01:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13655

614

Bea Baselines 🐤

template-ros

sim-1of4

error

2022-11-23 00:18:07+00:00

2022-11-23 00:19:31+00:00

0:01:24

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13650

615

Bea Baselines 🐤

template-ros

sim-2of4

error

2022-11-23 00:17:00+00:00

2022-11-23 00:17:56+00:00

0:00:56

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13646

616

Bea Baselines 🐤

template-ros

sim-3of4

success

2022-11-23 00:15:23+00:00

2022-11-23 00:16:40+00:00

0:01:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13639

618

Bea Baselines 🐤

baseline-duckietown

sim-0of4

error

2022-11-23 00:13:50+00:00

2022-11-23 00:15:14+00:00

0:01:24

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13636

619

Bea Baselines 🐤

baseline-duckietown

sim-1of4

error

2022-11-23 00:12:27+00:00

2022-11-23 00:13:29+00:00

0:01:02

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13631

621

Bea Baselines 🐤

baseline-duckietown

sim-0of4

error

2022-11-23 00:10:26+00:00

2022-11-23 00:12:05+00:00

0:01:39

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13626

622

Bea Baselines 🐤

baseline-duckietown

sim-2of4

success

2022-11-23 00:08:41+00:00

2022-11-23 00:10:14+00:00

0:01:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13621

624

Bea Baselines 🐤

baseline-duckietown

sim-0of4

error

2022-11-23 00:07:02+00:00

2022-11-23 00:08:22+00:00

0:01:20

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13616

626

Bea Baselines 🐤

baseline-duckietown

sim-1of4

error

2022-11-23 00:05:41+00:00

2022-11-23 00:06:41+00:00

0:01:00

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13610

627

Bea Baselines 🐤

baseline-duckietown

sim-0of4

error

2022-11-23 00:03:49+00:00

2022-11-23 00:05:20+00:00

0:01:31

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13604

628

Bea Baselines 🐤

baseline-duckietown

sim-1of4

error

2022-11-23 00:01:33+00:00

2022-11-23 00:03:15+00:00

0:01:42

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13600

630

Bea Baselines 🐤

baseline-duckietown

sim-1of4

error

2022-11-23 00:00:04+00:00

2022-11-23 00:01:06+00:00

0:01:02

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13596

631

Bea Baselines 🐤

baseline-duckietown

sim-2of4

success

2022-11-22 23:58:40+00:00

2022-11-22 23:59:57+00:00

0:01:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13589

660

Bea Baselines 🐤

template-tensorflow

sim-2of4

failed

2022-11-22 23:56:40+00:00

2022-11-22 23:58:05+00:00

0:01:25

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13584

661

Bea Baselines 🐤

template-tensorflow

sim-3of4

failed

2022-11-22 23:55:35+00:00

2022-11-22 23:56:29+00:00

0:00:54

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13579

663

Bea Baselines 🐤

template-tensorflow

sim-3of4

success

2022-11-22 23:53:36+00:00

2022-11-22 23:55:03+00:00

0:01:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13576

665

Bea Baselines 🐤

template-tensorflow

sim-2of4

failed

2022-11-22 23:52:31+00:00

2022-11-22 23:53:29+00:00

0:00:58

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13572

665

Bea Baselines 🐤

template-tensorflow

sim-3of4

failed

2022-11-22 23:51:09+00:00

2022-11-22 23:52:05+00:00

0:00:56

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13568

666

Bea Baselines 🐤

template-tensorflow

sim-1of4

failed

2022-11-22 23:49:37+00:00

2022-11-22 23:50:53+00:00

0:01:16

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13562

668

Bea Baselines 🐤

template-tensorflow

sim-0of4

failed

2022-11-22 23:48:21+00:00

2022-11-22 23:49:16+00:00

0:00:55

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13558

668

Bea Baselines 🐤

template-tensorflow

sim-1of4

failed

2022-11-22 23:47:10+00:00

2022-11-22 23:48:07+00:00

0:00:57

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13553

670

Bea Baselines 🐤

template-tensorflow

sim-1of4

failed

2022-11-22 23:45:08+00:00

2022-11-22 23:46:48+00:00

0:01:40

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13548

671

Bea Baselines 🐤

template-tensorflow

sim-0of4

failed

2022-11-22 23:43:07+00:00

2022-11-22 23:44:47+00:00

0:01:40

The container "solut [...]

The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13544

673

Bea Baselines 🐤

template-tensorflow

sim-1of4

failed

2022-11-22 23:41:44+00:00

2022-11-22 23:43:00+00:00

0:01:16

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13538

704

Bea Baselines 🐤

template-random

sim-0of4

error

2022-11-22 23:40:23+00:00

2022-11-22 23:41:19+00:00

0:00:56

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13534

706

Bea Baselines 🐤

template-random

sim-2of4

success

2022-11-22 23:38:44+00:00

2022-11-22 23:40:17+00:00

0:01:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13528

707

Bea Baselines 🐤

template-random

sim-2of4

success

2022-11-22 23:37:07+00:00

2022-11-22 23:38:37+00:00

0:01:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13524

708

Bea Baselines 🐤

template-random

sim-3of4

error

2022-11-22 23:36:07+00:00

2022-11-22 23:37:00+00:00

0:00:53

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13519

710

Bea Baselines 🐤

template-random

sim-2of4

error

2022-11-22 23:34:33+00:00

2022-11-22 23:36:00+00:00

0:01:27

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13515

711

Bea Baselines 🐤

template-random

sim-1of4

error

2022-11-22 23:33:28+00:00

2022-11-22 23:34:26+00:00

0:00:58

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13510

712

Bea Baselines 🐤

template-random

sim-2of4

error

2022-11-22 23:31:32+00:00

2022-11-22 23:33:10+00:00

0:01:38

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13506

713

Bea Baselines 🐤

template-random

sim-0of4

error

2022-11-22 23:29:30+00:00

2022-11-22 23:31:06+00:00

0:01:36

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13501

714

Bea Baselines 🐤

template-random

sim-1of4

error

2022-11-22 23:27:49+00:00

2022-11-22 23:29:17+00:00

0:01:28

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13492

716

Bea Baselines 🐤

template-random

sim-3of4

success

2022-11-22 23:26:09+00:00

2022-11-22 23:27:27+00:00

0:01:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13489

733

Bea Baselines 🐤

baseline-duckietown-ml

sim-0of4

error

2022-11-22 23:24:39+00:00

2022-11-22 23:25:41+00:00

0:01:02

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13485

735

Bea Baselines 🐤

baseline-duckietown-ml

sim-0of4

error

2022-11-22 23:22:51+00:00

2022-11-22 23:24:34+00:00

0:01:43

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13479

736

Bea Baselines 🐤

baseline-duckietown-ml

sim-3of4

success

2022-11-22 23:21:02+00:00

2022-11-22 23:22:32+00:00

0:01:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13472

738

Bea Baselines 🐤

baseline-duckietown-ml

sim-2of4

success

2022-11-22 23:19:17+00:00

2022-11-22 23:20:35+00:00

0:01:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13468

739

Bea Baselines 🐤

baseline-duckietown-ml

sim-0of4

error

2022-11-22 23:17:50+00:00

2022-11-22 23:19:11+00:00

0:01:21

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13463

740

Bea Baselines 🐤

baseline-duckietown-ml

sim-0of4

error

2022-11-22 23:16:28+00:00

2022-11-22 23:17:29+00:00

0:01:01

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13458

741

Bea Baselines 🐤

baseline-duckietown-ml

sim-3of4

error

2022-11-22 23:14:36+00:00

2022-11-22 23:16:08+00:00

0:01:32

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13453

743

Bea Baselines 🐤

baseline-duckietown-ml

sim-0of4

error

2022-11-22 23:12:45+00:00

2022-11-22 23:14:13+00:00

0:01:28

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13448

745

Bea Baselines 🐤

baseline-duckietown-ml

sim-3of4

error

2022-11-22 23:11:26+00:00

2022-11-22 23:12:25+00:00

0:00:59

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13444

746

Bea Baselines 🐤

baseline-duckietown-ml

sim-2of4

success

2022-11-22 23:09:45+00:00

2022-11-22 23:11:06+00:00

0:01:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13437

763

Bea Baselines 🐤

challenge-aido_LF-template-ros:daffy:e107400fd98b91bb7c02b7b24d7be5f5d7623035

sanity-check

error

2022-11-22 23:08:33+00:00

2022-11-22 23:09:31+00:00

0:00:58

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13432

769

Bea Baselines 🐤

baseline-RPL-ros

sim-1of4

error

2022-11-22 23:06:49+00:00

2022-11-22 23:08:12+00:00

0:01:23

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13428

770

Bea Baselines 🐤

baseline-RPL-ros

sim-3of4

error

2022-11-22 23:05:41+00:00

2022-11-22 23:06:42+00:00

0:01:01

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13424

771

Bea Baselines 🐤

baseline-RPL-ros

sim-2of4

error

2022-11-22 23:03:44+00:00

2022-11-22 23:05:15+00:00

0:01:31

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13420

772

Bea Baselines 🐤

baseline-RPL-ros

sim-3of4

success

2022-11-22 23:02:05+00:00

2022-11-22 23:03:37+00:00

0:01:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13415

775

Bea Baselines 🐤

baseline-RPL-ros

sim-2of4

success

2022-11-22 23:00:27+00:00

2022-11-22 23:01:45+00:00

0:01:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13410

776

Bea Baselines 🐤

baseline-RPL-ros

sim-1of4

error

2022-11-22 22:58:51+00:00

2022-11-22 23:00:15+00:00

0:01:24

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13406

778

Bea Baselines 🐤

baseline-RPL-ros

sim-1of4

error

2022-11-22 22:57:01+00:00

2022-11-22 22:58:42+00:00

0:01:41

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13400

779

Bea Baselines 🐤

baseline-RPL-ros

sim-2of4

success

2022-11-22 22:55:00+00:00

2022-11-22 22:56:52+00:00

0:01:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13395

780

Bea Baselines 🐤

baseline-RPL-ros

sim-2of4

success

2022-11-22 22:53:14+00:00

2022-11-22 22:54:46+00:00

0:01:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13391

781

Bea Baselines 🐤

baseline-RPL-ros

sim-0of4

error

2022-11-22 22:52:06+00:00

2022-11-22 22:53:07+00:00

0:01:01

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13387

782

Bea Baselines 🐤

baseline-RPL-ros

sim-3of4

success

2022-11-22 22:50:43+00:00

2022-11-22 22:52:00+00:00

0:01:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13382

796

Bea Baselines 🐤

challenge-aido_LF-template-tensorflow:daffy-staging:4f78c63aa6d3b56db61748d0875daf8a08ba14a1

sanity-check

failed

2022-11-22 22:49:31+00:00

2022-11-22 22:50:28+00:00

0:00:57

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13377

800

template-tensorflow

sim-0of4

failed

2022-11-22 22:48:29+00:00

2022-11-22 22:49:25+00:00

0:00:56

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13372

802

Bea Baselines 🐤

challenge-aido_LF-template-pytorch:daffy-staging:3ee0deff6949110710f97b6d814764f4be1d4551

sanity-check

error

2022-11-22 22:47:21+00:00

2022-11-22 22:48:17+00:00

0:00:56

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13367

804

Bea Baselines 🐤

challenge-aido_LF-template-ros:daffy-staging:3d125842a05be049b6ee6fe0059908c18c57ebb2

sanity-check

error

2022-11-22 22:46:08+00:00

2022-11-22 22:47:09+00:00

0:01:01

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13361

808

template-random

sim-2of4

error

2022-11-22 22:44:09+00:00

2022-11-22 22:45:47+00:00

0:01:38

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13358

809

template-random

sim-0of4

error

2022-11-22 22:42:29+00:00

2022-11-22 22:44:01+00:00

0:01:32

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13353

810

Bea Baselines 🐤

baseline-RPL-ros

sim-2of4

failed

2022-11-22 22:41:04+00:00

2022-11-22 22:42:02+00:00

0:00:58

The container "solut [...]

The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13348

811

Bea Baselines 🐤

baseline-duckietown-ml

sim-2of4

error

2022-11-22 22:39:08+00:00

2022-11-22 22:40:39+00:00

0:01:31

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13344

813

Bea Baselines 🐤

baseline-RPL-ros

sim-3of4

error

2022-11-22 22:37:47+00:00

2022-11-22 22:38:47+00:00

0:01:00

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13340

814

Bea Baselines 🐤

baseline-duckietown

sim-1of4

error

2022-11-22 22:36:37+00:00

2022-11-22 22:37:41+00:00

0:01:04

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13336

815

Bea Baselines 🐤

baseline-simple-yield

sim-2of4

error

aido-LFI-state-sim-validation

2022-11-22 22:35:16+00:00

2022-11-22 22:36:15+00:00

0:00:59

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13331

816

Bea Baselines 🐤

baseline-simple-yield

sim-0of4

error

2022-11-22 22:33:28+00:00

2022-11-22 22:35:03+00:00

0:01:35

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13326

817

Bea Baselines 🐤

baseline-simple-yield

sim-1of4

error

2022-11-22 22:31:57+00:00

2022-11-22 22:33:21+00:00

0:01:24

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13321

818

Bea Baselines 🐤

baseline-simple-yield

sim-0of4

error

aido-LFV_multi-state-sim-validation

2022-11-22 22:30:05+00:00

2022-11-22 22:31:51+00:00

0:01:46

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13314

819

Bea Baselines 🐤

baseline-simple-yield

446

error

2022-11-22 22:28:34+00:00

2022-11-22 22:29:59+00:00

0:01:25

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13311

821

Bea Baselines 🐤

baseline-simple-yield

sim-0of4

error

aido-LFI-state-sim-testing

2022-11-22 22:27:21+00:00

2022-11-22 22:28:20+00:00

0:00:59

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13306

822

Bea Baselines 🐤

baseline-simple-yield

sim-1of4

error

2022-11-22 22:25:41+00:00

2022-11-22 22:27:14+00:00

0:01:33

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13301

823

Bea Baselines 🐤

baseline-simple-yield

sim-3of4

error

2022-11-22 22:23:53+00:00

2022-11-22 22:25:18+00:00

0:01:25

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13296

825

Bea Baselines 🐤

baseline-simple-yield

sim-0of4

error

2022-11-22 22:21:52+00:00

2022-11-22 22:23:18+00:00

0:01:26

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13290

825

Bea Baselines 🐤

baseline-simple-yield

sim-3of4

error

aido-LFV-state-sim-testing

2022-11-22 22:20:08+00:00

2022-11-22 22:21:32+00:00

0:01:24

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13285

827

Bea Baselines 🐤

baseline-simple-yield

sim-3of4

error

aido-LFVI-full-sim-validation

2022-11-22 22:18:04+00:00

2022-11-22 22:19:39+00:00

0:01:35

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13279

829

Bea Baselines 🐤

minimal-agent-full

sim-2of4

success

aido-LFP-full-sim-validation

2022-11-22 22:16:25+00:00

2022-11-22 22:17:57+00:00

0:01:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13275

830

Bea Baselines 🐤

minimal-agent-full

sim-3of4

error

aido-LFV-full-sim-validation

2022-11-22 22:15:12+00:00

2022-11-22 22:16:11+00:00

0:00:59

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13270

831

Bea Baselines 🐤

minimal-agent-full

sim-3of4

error

aido-LFI-full-sim-validation

2022-11-22 22:13:23+00:00

2022-11-22 22:14:52+00:00

0:01:29

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13265

832

Bea Baselines 🐤

minimal-agent-full

sim-0of4

error

aido-LFV_multi-full-sim-validation

2022-11-22 22:11:27+00:00

2022-11-22 22:12:54+00:00

0:01:27

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13260

833

Bea Baselines 🐤

minimal-agent-full

sim-1of4

error

aido-LF-full-sim-validation

2022-11-22 22:09:39+00:00

2022-11-22 22:11:06+00:00

0:01:27

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13257

835

Bea Baselines 🐤

minimal-agent-full

sim-3of4

error

aido-LF-full-sim-validation

2022-11-22 22:08:11+00:00

2022-11-22 22:09:11+00:00

0:01:00

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13252

835

Bea Baselines 🐤

minimal-agent-full

sim-0of4

error

aido-LFP-full-sim-testing

2022-11-22 22:06:55+00:00

2022-11-22 22:07:56+00:00

0:01:01

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13247

837

Bea Baselines 🐤

minimal-agent-full

sim-3of4

error

aido-LFP-full-sim-testing

2022-11-22 22:05:36+00:00

2022-11-22 22:06:35+00:00

0:00:59

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13244

837

Bea Baselines 🐤

minimal-agent-full

sim-1of4

error

aido-LFI-full-sim-testing

2022-11-22 22:04:29+00:00

2022-11-22 22:05:29+00:00

0:01:00

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13240

839

Bea Baselines 🐤

minimal-agent-full

sim-3of4

success

aido-LFI-full-sim-testing

2022-11-22 22:02:44+00:00

2022-11-22 22:04:16+00:00

0:01:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13236

839

Bea Baselines 🐤

minimal-agent-full

sim-0of4

host-error

aido-LFV_multi-full-sim-testing

2022-11-22 22:02:14+00:00

2022-11-22 22:02:31+00:00

0:00:17

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: Get https://registry-stage2.duckietown.org/v2/token?account=duckietowndaemon&client_id=docker&offline_token=true&service=registry-stage2.duckietown.org: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13232

840

Bea Baselines 🐤

minimal-agent-full

sim-1of4

error

aido-LFV_multi-full-sim-testing

2022-11-22 22:00:32+00:00

2022-11-22 22:02:06+00:00

0:01:34

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13229

840

Bea Baselines 🐤

minimal-agent-full

sim-3of4

error

aido-LF-full-sim-testing

2022-11-22 21:58:48+00:00

2022-11-22 22:00:09+00:00

0:01:21

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13224

842

Bea Baselines 🐤

minimal-agent-full

sim-2of4

error

2022-11-22 21:57:37+00:00

2022-11-22 21:58:34+00:00

0:00:57

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13220

843

Bea Baselines 🐤

minimal-agent-state

sim-2of4

error

2022-11-22 21:56:24+00:00

2022-11-22 21:57:23+00:00

0:00:59

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13215

845

Bea Baselines 🐤

minimal-agent-state

sim-1of4

error

2022-11-22 21:54:51+00:00

2022-11-22 21:56:17+00:00

0:01:26

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13209

846

Bea Baselines 🐤

minimal-agent-state

sim-0of4

error

2022-11-22 21:52:44+00:00

2022-11-22 21:54:23+00:00

0:01:39

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13204

848

Bea Baselines 🐤

minimal-agent-state

sim-1of4

error

aido-LFI-state-sim-testing

2022-11-22 21:51:29+00:00

2022-11-22 21:52:28+00:00

0:00:59

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13197

850

Bea Baselines 🐤

minimal-agent-state

sim-0of4

error

2022-11-22 21:49:07+00:00

2022-11-22 21:51:21+00:00

0:02:14

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13192

853

Bea Baselines 🐤

minimal-agent-state

sim-2of4

error

aido-LFV-state-sim-validation

2022-11-22 21:47:05+00:00

2022-11-22 21:48:42+00:00

0:01:37

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13186

854

Bea Baselines 🐤

minimal-agent-state

sim-2of4

error

aido-LFV-state-sim-testing

2022-11-22 21:45:04+00:00

2022-11-22 21:46:46+00:00

0:01:42

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13181

855

Bea Baselines 🐤

minimal-agent-state

sim-1of4

error

2022-11-22 21:43:07+00:00

2022-11-22 21:44:51+00:00

0:01:44

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13174

857

Bea Baselines 🐤

minimal-agent

sim-2of4

error

2022-11-22 21:41:06+00:00

2022-11-22 21:42:34+00:00

0:01:28

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13169

858

Bea Baselines 🐤

minimal-agent

sim-1of4

error

2022-11-22 21:39:11+00:00

2022-11-22 21:40:50+00:00

0:01:39

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13164

859

Bea Baselines 🐤

baseline-duckietown

sim-2of4

error

2022-11-22 21:37:29+00:00

2022-11-22 21:38:32+00:00

0:01:03

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13159

861

Bea Baselines 🐤

template-pytorch

sim-3of4

success

2022-11-22 21:35:41+00:00

2022-11-22 21:37:16+00:00

0:01:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13151

862

Bea Baselines 🐤

template-pytorch

sim-1of4

error

2022-11-22 21:33:22+00:00

2022-11-22 21:35:07+00:00

0:01:45

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13146

864

Bea Baselines 🐤

template-pytorch

sim-2of4

success

2022-11-22 21:31:22+00:00

2022-11-22 21:32:49+00:00

0:01:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13141

866

Bea Baselines 🐤

template-pytorch

sim-1of4

error

2022-11-22 21:30:05+00:00

2022-11-22 21:31:03+00:00

0:00:58

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13137

872

Bea Baselines 🐤

template-pytorch

sim-3of4

error

2022-11-22 21:28:20+00:00

2022-11-22 21:29:51+00:00

0:01:31

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13132

873

Bea Baselines 🐤

template-pytorch

sim-0of4

error

2022-11-22 21:26:09+00:00

2022-11-22 21:27:48+00:00

0:01:39

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13127

874

Bea Baselines 🐤

template-pytorch

sim-2of4

success

2022-11-22 21:24:17+00:00

2022-11-22 21:25:50+00:00

0:01:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13119

876

Bea Baselines 🐤

template-pytorch

sim-1of4

error

2022-11-22 21:21:22+00:00

2022-11-22 21:23:43+00:00

0:02:21

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13116

878

Bea Baselines 🐤

template-pytorch

sim-1of4

error

2022-11-22 21:20:11+00:00

2022-11-22 21:21:11+00:00

0:01:00

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13108

879

Bea Baselines 🐤

template-random

sim-1of4

error

2022-11-22 21:17:54+00:00

2022-11-22 21:19:33+00:00

0:01:39

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13102

881

Bea Baselines 🐤

template-tensorflow

sim-2of4

failed

2022-11-22 21:15:51+00:00

2022-11-22 21:17:31+00:00

0:01:40

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13098

882

Bea Baselines 🐤

template-random

sim-0of4

error

2022-11-22 21:14:06+00:00

2022-11-22 21:15:32+00:00

0:01:26

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13094

883

Bea Baselines 🐤

template-tensorflow

sim-3of4

failed

2022-11-22 21:12:31+00:00

2022-11-22 21:14:00+00:00

0:01:29

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13088

689

Bea Baselines 🐤

minimal-agent

sim-1of4

error

2022-11-22 21:10:47+00:00

2022-11-22 21:12:01+00:00

0:01:14

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13085

690

Bea Baselines 🐤

minimal-agent

sim-0of4

error

2022-11-22 21:09:44+00:00

2022-11-22 21:10:40+00:00

0:00:56

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13080

690

Bea Baselines 🐤

minimal-agent

sim-3of4

error

2022-11-22 21:08:09+00:00

2022-11-22 21:09:10+00:00

0:01:01

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13075

693

Bea Baselines 🐤

minimal-agent

sim-3of4

success

2022-11-22 21:06:34+00:00

2022-11-22 21:08:02+00:00

0:01:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13070

694

Bea Baselines 🐤

minimal-agent

sim-3of4

error

2022-11-22 21:05:25+00:00

2022-11-22 21:06:22+00:00

0:00:57

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13065

696

Bea Baselines 🐤

minimal-agent

sim-2of4

error

2022-11-22 21:03:25+00:00

2022-11-22 21:04:51+00:00

0:01:26

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13060

697

Bea Baselines 🐤

minimal-agent

sim-2of4

error

2022-11-22 21:02:22+00:00

2022-11-22 21:03:18+00:00

0:00:56

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13055

698

Bea Baselines 🐤

minimal-agent

sim-0of4

error

2022-11-22 21:00:21+00:00

2022-11-22 21:01:47+00:00

0:01:26

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13050

699

Bea Baselines 🐤

minimal-agent

sim-2of4

success

2022-11-22 20:58:29+00:00

2022-11-22 21:00:00+00:00

0:01:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13046

701

Bea Baselines 🐤

minimal-agent

sim-3of4

error

2022-11-22 20:57:13+00:00

2022-11-22 20:58:08+00:00

0:00:55

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13040

701

Bea Baselines 🐤

minimal-agent

sim-2of4

error

2022-11-22 20:55:53+00:00

2022-11-22 20:56:51+00:00

0:00:58

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13036

526

Bea Baselines 🐤

baseline-behavior-cloning

sim-0of4

failed

2022-11-22 20:54:44+00:00

2022-11-22 20:55:40+00:00

0:00:56

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13032

672

Bea Baselines 🐤

template-tensorflow

sim-0of4

failed

2022-11-22 20:53:33+00:00

2022-11-22 20:54:30+00:00

0:00:57

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13027

715

Bea Baselines 🐤

template-random

sim-2of4

error

2022-11-22 20:52:18+00:00

2022-11-22 20:53:15+00:00

0:00:57

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13022

785

template-ros

sim-0of4

error

2022-11-22 20:51:05+00:00

2022-11-22 20:52:03+00:00

0:00:58

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13015

789

template-pytorch

sim-0of4

error

aido-LFI-state-sim-validation

2022-11-22 20:49:43+00:00

2022-11-22 20:50:39+00:00

0:00:56

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13010

844

Bea Baselines 🐤

minimal-agent-state

sim-2of4

success

2022-11-22 20:47:50+00:00

2022-11-22 20:49:24+00:00

0:01:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

13005

845

Bea Baselines 🐤

minimal-agent-state

sim-2of4

error

2022-11-22 20:46:18+00:00

2022-11-22 20:47:43+00:00

0:01:25

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13000

846

Bea Baselines 🐤

minimal-agent-state

sim-2of4

error

2022-11-22 20:44:33+00:00

2022-11-22 20:46:12+00:00

0:01:39

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12997

848

Bea Baselines 🐤

minimal-agent-state

sim-0of4

error

2022-11-22 20:43:23+00:00

2022-11-22 20:44:19+00:00

0:00:56

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12993

848

Bea Baselines 🐤

minimal-agent-state

sim-2of4

error

2022-11-22 20:42:13+00:00

2022-11-22 20:43:10+00:00

0:00:57

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12988

849

Bea Baselines 🐤

minimal-agent-state

sim-2of4

error

2022-11-22 20:40:59+00:00

2022-11-22 20:41:59+00:00

0:01:00

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12983

851

Bea Baselines 🐤

minimal-agent-state

sim-1of4

error

aido-LFVI-state-sim-testing

2022-11-22 20:39:20+00:00

2022-11-22 20:40:45+00:00

0:01:25

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12978

852

Bea Baselines 🐤

minimal-agent-state

sim-0of4

error

2022-11-22 20:37:28+00:00

2022-11-22 20:39:07+00:00

0:01:39

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12973

853

Bea Baselines 🐤

minimal-agent-state

sim-1of4

error

aido-LFV-state-sim-validation

2022-11-22 20:35:48+00:00

2022-11-22 20:37:15+00:00

0:01:27

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12968

854

Bea Baselines 🐤

minimal-agent-state

sim-0of4

error

aido-LFP-state-sim-testing

2022-11-22 20:33:45+00:00

2022-11-22 20:35:16+00:00

0:01:31

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12966

856

Bea Baselines 🐤

minimal-agent-state

sim-1of4

error

aido-LFP-state-sim-testing

2022-11-22 20:32:35+00:00

2022-11-22 20:33:32+00:00

0:00:57

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12960

856

Bea Baselines 🐤

minimal-agent-state

sim-0of4

error

2022-11-22 20:31:03+00:00

2022-11-22 20:32:15+00:00

0:01:12

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12956

857

Bea Baselines 🐤

minimal-agent

sim-0of4

error

2022-11-22 20:29:14+00:00

2022-11-22 20:30:51+00:00

0:01:37

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12950

859

Bea Baselines 🐤

baseline-duckietown

sim-3of4

error

2022-11-22 20:28:07+00:00

2022-11-22 20:29:06+00:00

0:00:59

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12947

859

Bea Baselines 🐤

baseline-duckietown

sim-2of4

error

2022-11-22 20:26:32+00:00

2022-11-22 20:27:34+00:00

0:01:02

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12942

861

Bea Baselines 🐤

template-pytorch

sim-1of4

error

2022-11-22 20:24:36+00:00

2022-11-22 20:26:17+00:00

0:01:41

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12938

862

Bea Baselines 🐤

template-pytorch

sim-3of4

success

2022-11-22 20:22:56+00:00

2022-11-22 20:24:29+00:00

0:01:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

12933

864

Bea Baselines 🐤

template-pytorch

sim-3of4

success

2022-11-22 20:21:15+00:00

2022-11-22 20:22:42+00:00

0:01:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

12927

876

Bea Baselines 🐤

template-pytorch

sim-2of4

success

2022-11-22 20:19:29+00:00

2022-11-22 20:21:00+00:00

0:01:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

12922

702

Bea Baselines 🐤

minimal-agent

sim-1of4

error

2022-11-22 20:17:53+00:00

2022-11-22 20:19:14+00:00

0:01:21

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12915

874

Bea Baselines 🐤

template-pytorch

sim-1of4

error

2022-11-22 20:15:56+00:00

2022-11-22 20:17:39+00:00

0:01:43

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12910

700

Bea Baselines 🐤

minimal-agent

sim-1of4

error

2022-11-22 20:14:00+00:00

2022-11-22 20:15:28+00:00

0:01:28

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12905

693

Bea Baselines 🐤

minimal-agent

sim-2of4

success

2022-11-22 20:12:15+00:00

2022-11-22 20:13:46+00:00

0:01:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

12900

863

Bea Baselines 🐤

template-pytorch

sim-1of4

error

2022-11-22 20:11:04+00:00

2022-11-22 20:12:07+00:00

0:01:03

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12895

864

Bea Baselines 🐤

template-pytorch

sim-3of4

success

2022-11-22 20:09:06+00:00

2022-11-22 20:10:37+00:00

0:01:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

12890

865

Bea Baselines 🐤

template-pytorch

sim-2of4

error

2022-11-22 20:06:53+00:00

2022-11-22 20:08:32+00:00

0:01:39

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12885

866

Bea Baselines 🐤

template-pytorch

sim-3of4

error

2022-11-22 20:05:33+00:00

2022-11-22 20:06:33+00:00

0:01:00

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12881

866

Bea Baselines 🐤

template-pytorch

sim-2of4

error

2022-11-22 20:04:20+00:00

2022-11-22 20:05:19+00:00

0:00:59

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12878

878

Bea Baselines 🐤

template-pytorch

sim-0of4

error

2022-11-22 20:03:10+00:00

2022-11-22 20:04:06+00:00

0:00:56

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12874

884

Bea Baselines 🐤

template-ros

sim-2of4

error

2022-11-22 20:01:52+00:00

2022-11-22 20:02:48+00:00

0:00:56

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12869

701

Bea Baselines 🐤

minimal-agent

sim-3of4

error

2022-11-22 20:00:49+00:00

2022-11-22 20:01:44+00:00

0:00:55

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12864

526

Bea Baselines 🐤

baseline-behavior-cloning

sim-0of4

failed

2022-11-22 19:59:32+00:00

2022-11-22 20:00:28+00:00

0:00:56

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12858

672

Bea Baselines 🐤

template-tensorflow

sim-0of4

failed

2022-11-22 19:58:16+00:00

2022-11-22 19:59:11+00:00

0:00:55

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12854

789

template-pytorch

sim-2of4

error

2022-11-22 19:57:12+00:00

2022-11-22 19:58:10+00:00

0:00:58

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12851

715

Bea Baselines 🐤

template-random

sim-3of4

error

2022-11-22 19:56:01+00:00

2022-11-22 19:57:00+00:00

0:00:59

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12846

873

Bea Baselines 🐤

template-pytorch

sim-3of4

success

2022-11-22 19:54:03+00:00

2022-11-22 19:55:36+00:00

0:01:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

12839

874

Bea Baselines 🐤

template-pytorch

sim-0of4

error

2022-11-22 19:52:08+00:00

2022-11-22 19:53:52+00:00

0:01:44

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12833

876

Bea Baselines 🐤

template-pytorch

sim-0of4

error

2022-11-22 19:50:04+00:00

2022-11-22 19:51:40+00:00

0:01:36

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12829

877

Bea Baselines 🐤

template-pytorch

sim-0of4

error

2022-11-22 19:48:24+00:00

2022-11-22 19:49:58+00:00

0:01:34

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12822

878

Bea Baselines 🐤

template-pytorch

sim-2of4

error

2022-11-22 19:46:21+00:00

2022-11-22 19:48:11+00:00

0:01:50

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12818

880

Bea Baselines 🐤

template-ros

sim-2of4

error

2022-11-22 19:44:52+00:00

2022-11-22 19:45:51+00:00

0:00:59

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12812

881

Bea Baselines 🐤

template-tensorflow

sim-3of4

failed

2022-11-22 19:41:48+00:00

2022-11-22 19:44:42+00:00

0:02:54

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12807

882

Bea Baselines 🐤

template-random

sim-1of4

error

2022-11-22 19:39:51+00:00

2022-11-22 19:41:29+00:00

0:01:38

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12790

689

Bea Baselines 🐤

minimal-agent

sim-2of4

error

2022-11-22 19:28:33+00:00

2022-11-22 19:29:57+00:00

0:01:24

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12787

690

Bea Baselines 🐤

minimal-agent

sim-2of4

error

2022-11-22 19:27:21+00:00

2022-11-22 19:28:18+00:00

0:00:57

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12782

692

Bea Baselines 🐤

minimal-agent

sim-1of4

error

2022-11-22 19:25:30+00:00

2022-11-22 19:27:06+00:00

0:01:36

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12775

693

Bea Baselines 🐤

minimal-agent

sim-0of4

host-error

2022-11-22 19:23:34+00:00

2022-11-22 19:25:08+00:00

0:01:34

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12770

695

Bea Baselines 🐤

minimal-agent

sim-3of4

success

2022-11-22 19:21:43+00:00

2022-11-22 19:22:59+00:00

0:01:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

12765

696

Bea Baselines 🐤

minimal-agent

sim-0of4

error

2022-11-22 19:20:09+00:00

2022-11-22 19:21:22+00:00

0:01:13

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12760

698

Bea Baselines 🐤

minimal-agent

sim-3of4

error

2022-11-22 19:18:25+00:00

2022-11-22 19:19:52+00:00

0:01:27

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12754

699

Bea Baselines 🐤

minimal-agent

sim-2of4

success

2022-11-22 19:16:34+00:00

2022-11-22 19:18:05+00:00

0:01:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

12750

701

Bea Baselines 🐤

minimal-agent

sim-0of4

error

2022-11-22 19:15:10+00:00

2022-11-22 19:16:06+00:00

0:00:56

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12745

526

Bea Baselines 🐤

baseline-behavior-cloning

sim-2of4

failed

2022-11-22 19:13:48+00:00

2022-11-22 19:14:43+00:00

0:00:55

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12739

672

Bea Baselines 🐤

template-tensorflow

sim-1of4

failed

2022-11-22 19:12:38+00:00

2022-11-22 19:13:34+00:00

0:00:56

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12732

672

Bea Baselines 🐤

template-tensorflow

sim-0of4

failed

2022-11-22 19:11:25+00:00

2022-11-22 19:12:23+00:00

0:00:58

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12728

785

template-ros

sim-3of4

error

2022-11-22 19:09:52+00:00

2022-11-22 19:10:50+00:00

0:00:58

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12721

789

template-pytorch

sim-3of4

error

2022-11-22 19:08:35+00:00

2022-11-22 19:09:32+00:00

0:00:57

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12717

698

Bea Baselines 🐤

minimal-agent

sim-1of4

error

2022-11-22 19:06:50+00:00

2022-11-22 19:08:28+00:00

0:01:38

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12712

699

Bea Baselines 🐤

minimal-agent

sim-2of4

success

2022-11-22 19:05:14+00:00

2022-11-22 19:06:44+00:00

0:01:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

12708

700

Bea Baselines 🐤

minimal-agent

sim-0of4

error

2022-11-22 19:03:30+00:00

2022-11-22 19:04:55+00:00

0:01:25

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12701

701

Bea Baselines 🐤

minimal-agent

sim-3of4

error

2022-11-22 19:02:01+00:00

2022-11-22 19:02:57+00:00

0:00:56

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12697

397

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-3of4

error

2022-11-22 19:00:39+00:00

2022-11-22 19:01:35+00:00

0:00:56

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12694

783

template-random

sim-3of4

error

2022-11-22 18:59:17+00:00

2022-11-22 19:00:11+00:00

0:00:54

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12685

783

template-random

sim-2of4

error

2022-11-22 18:57:52+00:00

2022-11-22 18:58:50+00:00

0:00:58

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12683

785

template-ros

sim-1of4

error

2022-11-22 18:56:39+00:00

2022-11-22 18:57:39+00:00

0:01:00

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12678

526

Bea Baselines 🐤

baseline-behavior-cloning

sim-0of4

failed

2022-11-22 18:55:29+00:00

2022-11-22 18:56:25+00:00

0:00:56

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12674

672

Bea Baselines 🐤

template-tensorflow

sim-2of4

failed

aido-hello-sim-state-validation

2022-11-22 18:54:28+00:00

2022-11-22 18:55:22+00:00

0:00:54

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12667

688

Bea Baselines 🐤

baseline-simple-yield

sanity-check

error

2022-11-22 18:52:03+00:00

2022-11-22 18:53:56+00:00

0:01:53

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12611

910

Bea Baselines 🐤

baseline-solution

step1-0of4

error

2022-11-22 14:05:16+00:00

2022-11-22 14:22:23+00:00

0:17:07

Waited 1003 seconds [...]

Waited 1003 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12609

910

Bea Baselines 🐤

baseline-solution

step1-3of4

success

lx22-planning-dd-dynamic-test

2022-11-22 14:04:20+00:00

2022-11-22 14:05:08+00:00

0:00:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

mistakes	0.0
success_ratio	0.0
duration	1000.0
complexity	1000.0
avg_min_distance	0.0

other stats

nfeasible	0
nsamples	0

No reset possible

12595

916

Bea Baselines 🐤

baseline-solution

step1-0of4

success

lx22-planning-dd-empty-test

2022-11-22 13:49:48+00:00

2022-11-22 14:04:06+00:00

0:14:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

mistakes	0.6666666666666666
success_ratio	1.0
duration	41.94762152671762
complexity	93.33333333333331
avg_min_distance	0.01236624008597755

other stats

nfeasible	3
nsamples	3

No reset possible

12585

918

Bea Baselines 🐤

baseline-solution

step1

success

lx22-planning-cc-dynamic-test

2022-11-22 13:37:45+00:00

2022-11-22 13:49:41+00:00

0:11:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

mistakes	0.0
success_ratio	1.0
duration	11.168187248703934
complexity	15.925925925925926
avg_min_distance	0.8746658000716123

other stats

nfeasible	27
nsamples	27

No reset possible

12581

919

Bea Baselines 🐤

baseline-solution

step1-1of4

success

lx22-collision-check-test

2022-11-22 13:36:42+00:00

2022-11-22 13:37:25+00:00

0:00:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

mistakes	0.0
success_ratio	0.0
duration	1000.0
complexity	1000.0
avg_min_distance	0.0

other stats

nfeasible	0
nsamples	0

No reset possible

12576

923

Bea Baselines 🐤

baseline-solution

step1

success

lx22-collision-check-test

2022-11-22 13:35:00+00:00

2022-11-22 13:36:09+00:00

0:01:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

false_negative_rate	0.0
false_positive_rate	0.0

other stats

nsamples

200

No reset possible

12573

907

Bea Baselines 🐤

baseline-solution

step1

success

2022-11-22 13:21:30+00:00

2022-11-22 13:23:44+00:00

0:02:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

false_negative_rate	0.0
false_positive_rate	0.0

other stats

nsamples

200

No reset possible

12557

309

minimal-agent

sim-2of4

success

2022-11-19 07:22:48+00:00

2022-11-19 07:25:09+00:00

0:02:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	9.900000000000006
in-drivable-lane_median	6.60000000000001
driven_lanedir_consec_median	0.33122941999330235
deviation-center-line_median	0.2697354465605155

other stats

deviation-center-line_max	0.2697354465605155
deviation-center-line_mean	0.2697354465605155
deviation-center-line_min	0.2697354465605155
deviation-heading_max	2.53835057480462
deviation-heading_mean	2.53835057480462
deviation-heading_median	2.53835057480462
deviation-heading_min	2.53835057480462
distance-from-start_max	1.4631057991302543
distance-from-start_mean	1.4631057991302543
distance-from-start_median	1.4631057991302543
distance-from-start_min	1.4631057991302543
driven_any_max	1.4632129547419284
driven_any_mean	1.4632129547419284
driven_any_median	1.4632129547419284
driven_any_min	1.4632129547419284
driven_lanedir_consec_max	0.33122941999330235
driven_lanedir_consec_mean	0.33122941999330235
driven_lanedir_consec_min	0.33122941999330235
driven_lanedir_max	0.33122941999330235
driven_lanedir_mean	0.33122941999330235
driven_lanedir_median	0.33122941999330235
driven_lanedir_min	0.33122941999330235
in-drivable-lane_max	6.60000000000001
in-drivable-lane_mean	6.60000000000001
in-drivable-lane_min	6.60000000000001
per-episodes	details {"loop2-000-ego0": {"driven_any": 1.4632129547419284, "survival_time": 9.900000000000006, "driven_lanedir": 0.33122941999330235, "in-drivable-lane": 6.60000000000001, "deviation-heading": 2.53835057480462, "distance-from-start": 1.4631057991302543, "deviation-center-line": 0.2697354465605155, "driven_lanedir_consec": 0.33122941999330235}}
simulation-passed	1
survival_time_max	9.900000000000006
survival_time_mean	9.900000000000006
survival_time_min	9.900000000000006

No reset possible

12551

310

minimal-agent

sim-2of4

success

2022-11-19 07:19:29+00:00

2022-11-19 07:22:32+00:00

0:03:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	9.900000000000006
in-drivable-lane_median	6.60000000000001
driven_lanedir_consec_median	0.33122941999330235
deviation-center-line_median	0.2697354465605155

other stats

deviation-center-line_max	0.2697354465605155
deviation-center-line_mean	0.2697354465605155
deviation-center-line_min	0.2697354465605155
deviation-heading_max	2.53835057480462
deviation-heading_mean	2.53835057480462
deviation-heading_median	2.53835057480462
deviation-heading_min	2.53835057480462
distance-from-start_max	1.4631057991302543
distance-from-start_mean	1.4631057991302543
distance-from-start_median	1.4631057991302543
distance-from-start_min	1.4631057991302543
driven_any_max	1.4632129547419284
driven_any_mean	1.4632129547419284
driven_any_median	1.4632129547419284
driven_any_min	1.4632129547419284
driven_lanedir_consec_max	0.33122941999330235
driven_lanedir_consec_mean	0.33122941999330235
driven_lanedir_consec_min	0.33122941999330235
driven_lanedir_max	0.33122941999330235
driven_lanedir_mean	0.33122941999330235
driven_lanedir_median	0.33122941999330235
driven_lanedir_min	0.33122941999330235
in-drivable-lane_max	6.60000000000001
in-drivable-lane_mean	6.60000000000001
in-drivable-lane_min	6.60000000000001
per-episodes	details {"loop2-000-ego0": {"driven_any": 1.4632129547419284, "survival_time": 9.900000000000006, "driven_lanedir": 0.33122941999330235, "in-drivable-lane": 6.60000000000001, "deviation-heading": 2.53835057480462, "distance-from-start": 1.4631057991302543, "deviation-center-line": 0.2697354465605155, "driven_lanedir_consec": 0.33122941999330235}}
simulation-passed	1
survival_time_max	9.900000000000006
survival_time_mean	9.900000000000006
survival_time_min	9.900000000000006

No reset possible

12527

385

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-3of4

success

2022-11-19 06:41:30+00:00

2022-11-19 07:19:09+00:00

0:37:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	25.074999999999346
driven_lanedir_consec_median	-3.2682762366893146
deviation-center-line_median	3.2395999943373326

other stats

deviation-center-line_max	4.030724396862522
deviation-center-line_mean	3.0221806598599494
deviation-center-line_min	1.5787982539026115
deviation-heading_max	29.49616390117
deviation-heading_mean	24.20614991612702
deviation-heading_median	25.46518861848917
deviation-heading_min	16.39805852635975
distance-from-start_max	0.22117686637660905
distance-from-start_mean	0.19331552177680977
distance-from-start_median	0.1937834854647108
distance-from-start_min	0.16451824980120838
driven_any_max	15.64226495504342
driven_any_mean	13.82110258625788
driven_any_median	13.957859510511607
driven_any_min	11.726426368964884
driven_lanedir_consec_max	-2.7127213685769673
driven_lanedir_consec_mean	-3.387375868058189
driven_lanedir_consec_min	-4.300229630277158
driven_lanedir_max	-2.726277333208496
driven_lanedir_mean	-4.901741241374875
driven_lanedir_median	-4.840578559180667
driven_lanedir_min	-7.1995305139296715
in-drivable-lane_max	41.54999999999909
in-drivable-lane_mean	27.74999999999926
in-drivable-lane_min	19.29999999999928
per-episodes	details {"zigzag-000-ego0": {"driven_any": 11.726426368964884, "survival_time": 59.99999999999873, "driven_lanedir": -3.0333958199890994, "in-drivable-lane": 29.899999999999196, "deviation-heading": 25.57559597026926, "distance-from-start": 0.22117686637660905, "deviation-center-line": 2.9293042035311387, "driven_lanedir_consec": -2.8770850154242273}, "zigzag-000-ego1": {"driven_any": 13.897983085421316, "survival_time": 59.99999999999873, "driven_lanedir": -2.726277333208496, "in-drivable-lane": 41.54999999999909, "deviation-heading": 16.39805852635975, "distance-from-start": 0.16451824980120838, "deviation-center-line": 1.5787982539026115, "driven_lanedir_consec": -2.7127213685769673}, "zigzag-000-ego2": {"driven_any": 14.017735935601896, "survival_time": 59.99999999999873, "driven_lanedir": -6.6477612983722345, "in-drivable-lane": 19.29999999999928, "deviation-heading": 29.49616390117, "distance-from-start": 0.2196046464136915, "deviation-center-line": 4.030724396862522, "driven_lanedir_consec": -4.300229630277158}, "zigzag-000-ego3": {"driven_any": 15.64226495504342, "survival_time": 59.99999999999873, "driven_lanedir": -7.1995305139296715, "in-drivable-lane": 20.24999999999949, "deviation-heading": 25.35478126670908, "distance-from-start": 0.1679623245157301, "deviation-center-line": 3.549895785143527, "driven_lanedir_consec": -3.659467457954402}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

12521

386

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-3of4

success

2022-11-19 06:30:45+00:00

2022-11-19 06:41:24+00:00

0:10:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	12.749999999999758
driven_lanedir_consec_median	-5.909123773483703
deviation-center-line_median	4.137737048728726

other stats

deviation-center-line_max	4.137737048728726
deviation-center-line_mean	4.137737048728726
deviation-center-line_min	4.137737048728726
deviation-heading_max	30.66075748478302
deviation-heading_mean	30.66075748478302
deviation-heading_median	30.66075748478302
deviation-heading_min	30.66075748478302
distance-from-start_max	0.16655978473215127
distance-from-start_mean	0.16655978473215127
distance-from-start_median	0.16655978473215127
distance-from-start_min	0.16655978473215127
driven_any_max	15.66450237979004
driven_any_mean	15.66450237979004
driven_any_median	15.66450237979004
driven_any_min	15.66450237979004
driven_lanedir_consec_max	-5.909123773483703
driven_lanedir_consec_mean	-5.909123773483703
driven_lanedir_consec_min	-5.909123773483703
driven_lanedir_max	-8.6361478561999
driven_lanedir_mean	-8.6361478561999
driven_lanedir_median	-8.6361478561999
driven_lanedir_min	-8.6361478561999
in-drivable-lane_max	12.749999999999758
in-drivable-lane_mean	12.749999999999758
in-drivable-lane_min	12.749999999999758
per-episodes	details {"zigzag-000-ego0": {"driven_any": 15.66450237979004, "survival_time": 59.99999999999873, "driven_lanedir": -8.6361478561999, "in-drivable-lane": 12.749999999999758, "deviation-heading": 30.66075748478302, "distance-from-start": 0.16655978473215127, "deviation-center-line": 4.137737048728726, "driven_lanedir_consec": -5.909123773483703}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

12513

388

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-0of4

success

2022-11-19 06:12:38+00:00

2022-11-19 06:30:38+00:00

0:18:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	28.699999999999363
driven_lanedir_consec_median	-4.283497521731873
deviation-center-line_median	2.3298495864084092

other stats

deviation-center-line_max	2.3298495864084092
deviation-center-line_mean	2.3298495864084092
deviation-center-line_min	2.3298495864084092
deviation-heading_max	25.223979020281032
deviation-heading_mean	25.223979020281032
deviation-heading_median	25.223979020281032
deviation-heading_min	25.223979020281032
distance-from-start_max	0.16690218569050908
distance-from-start_mean	0.16690218569050908
distance-from-start_median	0.16690218569050908
distance-from-start_min	0.16690218569050908
driven_any_max	13.603749300485228
driven_any_mean	13.603749300485228
driven_any_median	13.603749300485228
driven_any_min	13.603749300485228
driven_lanedir_consec_max	-4.283497521731873
driven_lanedir_consec_mean	-4.283497521731873
driven_lanedir_consec_min	-4.283497521731873
driven_lanedir_max	-4.810824012549067
driven_lanedir_mean	-4.810824012549067
driven_lanedir_median	-4.810824012549067
driven_lanedir_min	-4.810824012549067
in-drivable-lane_max	28.699999999999363
in-drivable-lane_mean	28.699999999999363
in-drivable-lane_min	28.699999999999363
per-episodes	details {"udem-000-ego0": {"driven_any": 13.603749300485228, "survival_time": 59.99999999999873, "driven_lanedir": -4.810824012549067, "in-drivable-lane": 28.699999999999363, "deviation-heading": 25.223979020281032, "distance-from-start": 0.16690218569050908, "deviation-center-line": 2.3298495864084092, "driven_lanedir_consec": -4.283497521731873}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

12507

389

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-0of4

success

2022-11-19 06:02:15+00:00

2022-11-19 06:12:13+00:00

0:09:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	14.849999999999588
driven_lanedir_consec_median	-4.758546290960542
deviation-center-line_median	4.635747053642812

other stats

deviation-center-line_max	4.635747053642812
deviation-center-line_mean	4.635747053642812
deviation-center-line_min	4.635747053642812
deviation-heading_max	29.897168977331912
deviation-heading_mean	29.897168977331912
deviation-heading_median	29.897168977331912
deviation-heading_min	29.897168977331912
distance-from-start_max	0.19469344068449532
distance-from-start_mean	0.19469344068449532
distance-from-start_median	0.19469344068449532
distance-from-start_min	0.19469344068449532
driven_any_max	15.305250678601222
driven_any_mean	15.305250678601222
driven_any_median	15.305250678601222
driven_any_min	15.305250678601222
driven_lanedir_consec_max	-4.758546290960542
driven_lanedir_consec_mean	-4.758546290960542
driven_lanedir_consec_min	-4.758546290960542
driven_lanedir_max	-8.187806459479546
driven_lanedir_mean	-8.187806459479546
driven_lanedir_median	-8.187806459479546
driven_lanedir_min	-8.187806459479546
in-drivable-lane_max	14.849999999999588
in-drivable-lane_mean	14.849999999999588
in-drivable-lane_min	14.849999999999588
per-episodes	details {"4way-000-ego0": {"driven_any": 15.305250678601222, "survival_time": 59.99999999999873, "driven_lanedir": -8.187806459479546, "in-drivable-lane": 14.849999999999588, "deviation-heading": 29.897168977331912, "distance-from-start": 0.19469344068449532, "deviation-center-line": 4.635747053642812, "driven_lanedir_consec": -4.758546290960542}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

12506

390

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-1of4

success

2022-11-19 05:54:08+00:00

2022-11-19 06:01:44+00:00

0:07:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-2.4642879856595816
survival_time_median	52.89999999999913
deviation-center-line_median	2.3664333900425585
in-drivable-lane_median	23.149999999999473

other stats

deviation-center-line_max	2.3664333900425585
deviation-center-line_mean	2.3664333900425585
deviation-center-line_min	2.3664333900425585
deviation-heading_max	23.354359902594517
deviation-heading_mean	23.354359902594517
deviation-heading_median	23.354359902594517
deviation-heading_min	23.354359902594517
distance-from-start_max	0.1499214231775539
distance-from-start_mean	0.1499214231775539
distance-from-start_median	0.1499214231775539
distance-from-start_min	0.1499214231775539
driven_any_max	9.622578702056297
driven_any_mean	9.622578702056297
driven_any_median	9.622578702056297
driven_any_min	9.622578702056297
driven_lanedir_consec_max	-2.4642879856595816
driven_lanedir_consec_mean	-2.4642879856595816
driven_lanedir_consec_min	-2.4642879856595816
driven_lanedir_max	-2.5206032529610867
driven_lanedir_mean	-2.5206032529610867
driven_lanedir_median	-2.5206032529610867
driven_lanedir_min	-2.5206032529610867
in-drivable-lane_max	23.149999999999473
in-drivable-lane_mean	23.149999999999473
in-drivable-lane_min	23.149999999999473
per-episodes	details {"loop-000-ego0": {"driven_any": 9.622578702056297, "survival_time": 52.89999999999913, "driven_lanedir": -2.5206032529610867, "in-drivable-lane": 23.149999999999473, "deviation-heading": 23.354359902594517, "distance-from-start": 0.1499214231775539, "deviation-center-line": 2.3664333900425585, "driven_lanedir_consec": -2.4642879856595816}}
simulation-passed	1
survival_time_max	52.89999999999913
survival_time_mean	52.89999999999913
survival_time_min	52.89999999999913

No reset possible

12505

390

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-2of4

success

2022-11-19 05:47:02+00:00

2022-11-19 05:53:47+00:00

0:06:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-2.5277906129443233
survival_time_median	59.99999999999873
deviation-center-line_median	2.767603778045449
in-drivable-lane_median	28.999999999999197

other stats

deviation-center-line_max	2.767603778045449
deviation-center-line_mean	2.767603778045449
deviation-center-line_min	2.767603778045449
deviation-heading_max	27.55080853040573
deviation-heading_mean	27.55080853040573
deviation-heading_median	27.55080853040573
deviation-heading_min	27.55080853040573
distance-from-start_max	0.1637169872908778
distance-from-start_mean	0.1637169872908778
distance-from-start_median	0.1637169872908778
distance-from-start_min	0.1637169872908778
driven_any_max	10.924636955954131
driven_any_mean	10.924636955954131
driven_any_median	10.924636955954131
driven_any_min	10.924636955954131
driven_lanedir_consec_max	-2.5277906129443233
driven_lanedir_consec_mean	-2.5277906129443233
driven_lanedir_consec_min	-2.5277906129443233
driven_lanedir_max	-2.690896186034158
driven_lanedir_mean	-2.690896186034158
driven_lanedir_median	-2.690896186034158
driven_lanedir_min	-2.690896186034158
in-drivable-lane_max	28.999999999999197
in-drivable-lane_mean	28.999999999999197
in-drivable-lane_min	28.999999999999197
per-episodes	details {"loop2-000-ego0": {"driven_any": 10.924636955954131, "survival_time": 59.99999999999873, "driven_lanedir": -2.690896186034158, "in-drivable-lane": 28.999999999999197, "deviation-heading": 27.55080853040573, "distance-from-start": 0.1637169872908778, "deviation-center-line": 2.767603778045449, "driven_lanedir_consec": -2.5277906129443233}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

12502

390

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-3of4

success

2022-11-19 05:37:50+00:00

2022-11-19 05:46:36+00:00

0:08:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-3.9883555153105497
survival_time_median	59.99999999999873
deviation-center-line_median	3.2481085759488084
in-drivable-lane_median	22.199999999999285

other stats

deviation-center-line_max	3.2481085759488084
deviation-center-line_mean	3.2481085759488084
deviation-center-line_min	3.2481085759488084
deviation-heading_max	27.408738941837576
deviation-heading_mean	27.408738941837576
deviation-heading_median	27.408738941837576
deviation-heading_min	27.408738941837576
distance-from-start_max	0.16757110991167276
distance-from-start_mean	0.16757110991167276
distance-from-start_median	0.16757110991167276
distance-from-start_min	0.16757110991167276
driven_any_max	11.960383800305614
driven_any_mean	11.960383800305614
driven_any_median	11.960383800305614
driven_any_min	11.960383800305614
driven_lanedir_consec_max	-3.9883555153105497
driven_lanedir_consec_mean	-3.9883555153105497
driven_lanedir_consec_min	-3.9883555153105497
driven_lanedir_max	-4.853981847776726
driven_lanedir_mean	-4.853981847776726
driven_lanedir_median	-4.853981847776726
driven_lanedir_min	-4.853981847776726
in-drivable-lane_max	22.199999999999285
in-drivable-lane_mean	22.199999999999285
in-drivable-lane_min	22.199999999999285
per-episodes	details {"zigzag-000-ego0": {"driven_any": 11.960383800305614, "survival_time": 59.99999999999873, "driven_lanedir": -4.853981847776726, "in-drivable-lane": 22.199999999999285, "deviation-heading": 27.408738941837576, "distance-from-start": 0.16757110991167276, "deviation-center-line": 3.2481085759488084, "driven_lanedir_consec": -3.9883555153105497}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

12500

390

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-0of4

success

2022-11-19 05:29:45+00:00

2022-11-19 05:37:42+00:00

0:07:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-3.277710131207971
survival_time_median	59.99999999999873
deviation-center-line_median	2.909125324025323
in-drivable-lane_median	24.499999999999435

other stats

deviation-center-line_max	2.909125324025323
deviation-center-line_mean	2.909125324025323
deviation-center-line_min	2.909125324025323
deviation-heading_max	26.85861248420369
deviation-heading_mean	26.85861248420369
deviation-heading_median	26.85861248420369
deviation-heading_min	26.85861248420369
distance-from-start_max	0.28154888830656444
distance-from-start_mean	0.28154888830656444
distance-from-start_median	0.28154888830656444
distance-from-start_min	0.28154888830656444
driven_any_max	11.4827854857329
driven_any_mean	11.4827854857329
driven_any_median	11.4827854857329
driven_any_min	11.4827854857329
driven_lanedir_consec_max	-3.277710131207971
driven_lanedir_consec_mean	-3.277710131207971
driven_lanedir_consec_min	-3.277710131207971
driven_lanedir_max	-3.7586283876364655
driven_lanedir_mean	-3.7586283876364655
driven_lanedir_median	-3.7586283876364655
driven_lanedir_min	-3.7586283876364655
in-drivable-lane_max	24.499999999999435
in-drivable-lane_mean	24.499999999999435
in-drivable-lane_min	24.499999999999435
per-episodes	details {"autolab-000-ego0": {"driven_any": 11.4827854857329, "survival_time": 59.99999999999873, "driven_lanedir": -3.7586283876364655, "in-drivable-lane": 24.499999999999435, "deviation-heading": 26.85861248420369, "distance-from-start": 0.28154888830656444, "deviation-center-line": 2.909125324025323, "driven_lanedir_consec": -3.277710131207971}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

12499

391

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-1of4

host-error

2022-11-19 05:27:41+00:00

2022-11-19 05:29:13+00:00

0:01:32

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12497

391

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-3of4

success

2022-11-19 05:25:48+00:00

2022-11-19 05:27:32+00:00

0:01:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

12496

391

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-0of4

host-error

2022-11-19 05:24:25+00:00

2022-11-19 05:25:42+00:00

0:01:17

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12495

392

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-3of4

host-error

2022-11-19 05:22:35+00:00

2022-11-19 05:23:57+00:00

0:01:22

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12494

392

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-0of4

host-error

2022-11-19 05:19:42+00:00

2022-11-19 05:22:09+00:00

0:02:27

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12493

391

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-2of4

host-error

2022-11-19 05:18:12+00:00

2022-11-19 05:19:11+00:00

0:00:59

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12492

392

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-1of4

host-error

2022-11-19 05:15:21+00:00

2022-11-19 05:17:37+00:00

0:02:16

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12488

392

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-2of4

success

2022-11-19 05:01:36+00:00

2022-11-19 05:15:15+00:00

0:13:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	28.574999999999086
driven_lanedir_consec_median	-2.075396453519706
deviation-center-line_median	3.157852925447183

other stats

deviation-center-line_max	3.5383908200468244
deviation-center-line_mean	3.157852925447183
deviation-center-line_min	2.777315030847542
deviation-heading_max	27.872903038339093
deviation-heading_mean	26.13365875795051
deviation-heading_median	26.13365875795051
deviation-heading_min	24.394414477561927
distance-from-start_max	0.14795201969739935
distance-from-start_mean	0.1444597786704531
distance-from-start_median	0.1444597786704531
distance-from-start_min	0.14096753764350675
driven_any_max	11.03139820710607
driven_any_mean	10.954076766453856
driven_any_median	10.954076766453856
driven_any_min	10.876755325801645
driven_lanedir_consec_max	-1.985523038711024
driven_lanedir_consec_mean	-2.075396453519706
driven_lanedir_consec_min	-2.1652698683283873
driven_lanedir_max	-1.985523038711024
driven_lanedir_mean	-2.075396453519706
driven_lanedir_median	-2.075396453519706
driven_lanedir_min	-2.1652698683283873
in-drivable-lane_max	32.44999999999901
in-drivable-lane_mean	28.574999999999086
in-drivable-lane_min	24.699999999999164
per-episodes	details {"loop2-000-ego0": {"driven_any": 10.876755325801645, "survival_time": 59.99999999999873, "driven_lanedir": -1.985523038711024, "in-drivable-lane": 24.699999999999164, "deviation-heading": 27.872903038339093, "distance-from-start": 0.14096753764350675, "deviation-center-line": 3.5383908200468244, "driven_lanedir_consec": -1.985523038711024}, "loop2-000-ego1": {"driven_any": 11.03139820710607, "survival_time": 59.99999999999873, "driven_lanedir": -2.1652698683283873, "in-drivable-lane": 32.44999999999901, "deviation-heading": 24.394414477561927, "distance-from-start": 0.14795201969739935, "deviation-center-line": 2.777315030847542, "driven_lanedir_consec": -2.1652698683283873}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

12470

398

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-0of4

success

2022-11-19 04:29:01+00:00

2022-11-19 05:01:26+00:00

0:32:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	24.0749999999993
driven_lanedir_consec_median	-2.3859525852468795
deviation-center-line_median	2.966206082356957

other stats

deviation-center-line_max	4.418599181539396
deviation-center-line_mean	3.1465025086303084
deviation-center-line_min	2.234998688267923
deviation-heading_max	28.3485606191354
deviation-heading_mean	25.913476686841705
deviation-heading_median	27.625763940925907
deviation-heading_min	20.053818246379603
distance-from-start_max	0.21187898219053555
distance-from-start_mean	0.17529350897563348
distance-from-start_median	0.16462267037281242
distance-from-start_min	0.16004971296637358
driven_any_max	11.777937422768888
driven_any_mean	9.245209816991146
driven_any_median	11.297126943136565
driven_any_min	2.6086479589225684
driven_lanedir_consec_max	-0.8251255453836521
driven_lanedir_consec_mean	-2.1214530097835613
driven_lanedir_consec_min	-2.8887813232568336
driven_lanedir_max	-0.8122274005184003
driven_lanedir_mean	-2.153387233544812
driven_lanedir_median	-2.4562701052020066
driven_lanedir_min	-2.8887813232568336
in-drivable-lane_max	38.74999999999905
in-drivable-lane_mean	23.174999999999415
in-drivable-lane_min	5.8000000000000185
per-episodes	details {"udem-000-ego0": {"driven_any": 2.6086479589225684, "survival_time": 59.99999999999873, "driven_lanedir": -0.8122274005184003, "in-drivable-lane": 5.8000000000000185, "deviation-heading": 26.994720091805235, "distance-from-start": 0.16004971296637358, "deviation-center-line": 3.124573834461106, "driven_lanedir_consec": -0.8251255453836521}, "udem-000-ego1": {"driven_any": 11.57360270444634, "survival_time": 59.99999999999873, "driven_lanedir": -2.8887813232568336, "in-drivable-lane": 20.999999999999392, "deviation-heading": 28.256807790046576, "distance-from-start": 0.16630847633796433, "deviation-center-line": 4.418599181539396, "driven_lanedir_consec": -2.8887813232568336}, "udem-000-ego2": {"driven_any": 11.02065118182679, "survival_time": 59.99999999999873, "driven_lanedir": -2.3600481360461933, "in-drivable-lane": 38.74999999999905, "deviation-heading": 20.053818246379603, "distance-from-start": 0.16293686440766048, "deviation-center-line": 2.234998688267923, "driven_lanedir_consec": -2.219413096135939}, "udem-000-ego3": {"driven_any": 11.777937422768888, "survival_time": 59.99999999999873, "driven_lanedir": -2.55249207435782, "in-drivable-lane": 27.149999999999203, "deviation-heading": 28.3485606191354, "distance-from-start": 0.21187898219053555, "deviation-center-line": 2.8078383302528085, "driven_lanedir_consec": -2.55249207435782}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

12465

514

Bea Baselines 🐤

baseline-behavior-cloning

sim-2of4

failed

2022-11-19 04:27:23+00:00

2022-11-19 04:28:37+00:00

0:01:14

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12461

515

Bea Baselines 🐤

baseline-behavior-cloning

sim-1of4

failed

2022-11-19 04:26:05+00:00

2022-11-19 04:27:00+00:00

0:00:55

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12456

516

Bea Baselines 🐤

baseline-behavior-cloning

sim-1of4

failed

2022-11-19 04:24:06+00:00

2022-11-19 04:25:43+00:00

0:01:37

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12450

517

Bea Baselines 🐤

baseline-behavior-cloning

sim-3of4

success

2022-11-19 04:22:13+00:00

2022-11-19 04:23:43+00:00

0:01:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

12445

519

Bea Baselines 🐤

baseline-behavior-cloning

sim-0of4

failed

2022-11-19 04:21:11+00:00

2022-11-19 04:22:06+00:00

0:00:55

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12440

520

Bea Baselines 🐤

baseline-behavior-cloning

sim-2of4

success

2022-11-19 04:19:49+00:00

2022-11-19 04:21:05+00:00

0:01:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

12435

521

Bea Baselines 🐤

baseline-behavior-cloning

sim-0of4

failed

2022-11-19 04:18:15+00:00

2022-11-19 04:19:29+00:00

0:01:14

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12432

522

Bea Baselines 🐤

baseline-behavior-cloning

sim-1of4

failed

2022-11-19 04:17:07+00:00

2022-11-19 04:18:01+00:00

0:00:54

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12430

522

Bea Baselines 🐤

baseline-behavior-cloning

sim-0of4

failed

2022-11-19 04:15:18+00:00

2022-11-19 04:17:01+00:00

0:01:43

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12412

528

Bea Baselines 🐤

baseline-dagger-pytorch

sim-1of4

success

2022-11-19 03:54:18+00:00

2022-11-19 04:15:05+00:00

0:20:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	2.1249999999999623
driven_lanedir_consec_median	9.819639409218698
deviation-center-line_median	2.8710871761931545

other stats

deviation-center-line_max	3.068032004588689
deviation-center-line_mean	2.825153982963688
deviation-center-line_min	2.4904095748797546
deviation-heading_max	15.521929614223843
deviation-heading_mean	13.999330742562687
deviation-heading_median	13.933791051750784
deviation-heading_min	12.607811252525336
distance-from-start_max	3.28113247768239
distance-from-start_mean	2.786222121733241
distance-from-start_median	2.942952941999305
distance-from-start_min	1.9778501252519631
driven_any_max	11.06514386387378
driven_any_mean	10.758507628455233
driven_any_median	10.858350090004222
driven_any_min	10.252186469938708
driven_lanedir_consec_max	10.338506732597082
driven_lanedir_consec_mean	9.788239444896403
driven_lanedir_consec_min	9.175172228551132
driven_lanedir_max	10.338506732597082
driven_lanedir_mean	9.788239444896403
driven_lanedir_median	9.819639409218698
driven_lanedir_min	9.175172228551132
in-drivable-lane_max	2.7000000000000224
in-drivable-lane_mean	2.074999999999979
in-drivable-lane_min	1.3499999999999694
per-episodes	details {"loop-000-ego0": {"driven_any": 10.987062986856795, "survival_time": 59.99999999999873, "driven_lanedir": 10.338506732597082, "in-drivable-lane": 1.3499999999999694, "deviation-heading": 12.607811252525336, "distance-from-start": 1.9778501252519631, "deviation-center-line": 2.4904095748797546, "driven_lanedir_consec": 10.338506732597082}, "loop-000-ego1": {"driven_any": 11.06514386387378, "survival_time": 59.99999999999873, "driven_lanedir": 9.84934420531266, "in-drivable-lane": 2.7000000000000224, "deviation-heading": 15.521929614223843, "distance-from-start": 3.28113247768239, "deviation-center-line": 3.068032004588689, "driven_lanedir_consec": 9.84934420531266}, "loop-000-ego2": {"driven_any": 10.252186469938708, "survival_time": 59.99999999999873, "driven_lanedir": 9.175172228551132, "in-drivable-lane": 2.3499999999998975, "deviation-heading": 14.493732918310064, "distance-from-start": 3.266241826114072, "deviation-center-line": 2.7162556303065237, "driven_lanedir_consec": 9.175172228551132}, "loop-000-ego3": {"driven_any": 10.729637193151646, "survival_time": 59.99999999999873, "driven_lanedir": 9.789934613124736, "in-drivable-lane": 1.900000000000027, "deviation-heading": 13.373849185191505, "distance-from-start": 2.6196640578845374, "deviation-center-line": 3.0259187220797856, "driven_lanedir_consec": 9.789934613124736}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

12410

529

Bea Baselines 🐤

baseline-dagger-pytorch

sim-0of4

success

2022-11-19 03:52:02+00:00

2022-11-19 03:54:12+00:00

0:02:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	11.950000000000037
in-drivable-lane_median	0.0
driven_lanedir_consec_median	1.208443917862657
deviation-center-line_median	0.33227324699576843

other stats

deviation-center-line_max	0.33227324699576843
deviation-center-line_mean	0.33227324699576843
deviation-center-line_min	0.33227324699576843
deviation-heading_max	2.1722860094519296
deviation-heading_mean	2.1722860094519296
deviation-heading_median	2.1722860094519296
deviation-heading_min	2.1722860094519296
distance-from-start_max	1.0870111149955042
distance-from-start_mean	1.0870111149955042
distance-from-start_median	1.0870111149955042
distance-from-start_min	1.0870111149955042
driven_any_max	1.2361460133533455
driven_any_mean	1.2361460133533455
driven_any_median	1.2361460133533455
driven_any_min	1.2361460133533455
driven_lanedir_consec_max	1.208443917862657
driven_lanedir_consec_mean	1.208443917862657
driven_lanedir_consec_min	1.208443917862657
driven_lanedir_max	1.208443917862657
driven_lanedir_mean	1.208443917862657
driven_lanedir_median	1.208443917862657
driven_lanedir_min	1.208443917862657
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"autolab-000-ego0": {"driven_any": 1.2361460133533455, "survival_time": 11.950000000000037, "driven_lanedir": 1.208443917862657, "in-drivable-lane": 0.0, "deviation-heading": 2.1722860094519296, "distance-from-start": 1.0870111149955042, "deviation-center-line": 0.33227324699576843, "driven_lanedir_consec": 1.208443917862657}}
simulation-passed	1
survival_time_max	11.950000000000037
survival_time_mean	11.950000000000037
survival_time_min	11.950000000000037

No reset possible

12403

530

Bea Baselines 🐤

baseline-dagger-pytorch

sim-0of4

success

2022-11-19 03:39:35+00:00

2022-11-19 03:51:42+00:00

0:12:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	43.04999999999969
in-drivable-lane_median	0.0
driven_lanedir_consec_median	6.581056984392537
deviation-center-line_median	2.249805917012829

other stats

deviation-center-line_max	2.249805917012829
deviation-center-line_mean	2.249805917012829
deviation-center-line_min	2.249805917012829
deviation-heading_max	9.980552479329264
deviation-heading_mean	9.980552479329264
deviation-heading_median	9.980552479329264
deviation-heading_min	9.980552479329264
distance-from-start_max	2.729159517493689
distance-from-start_mean	2.729159517493689
distance-from-start_median	2.729159517493689
distance-from-start_min	2.729159517493689
driven_any_max	6.836215494129633
driven_any_mean	6.836215494129633
driven_any_median	6.836215494129633
driven_any_min	6.836215494129633
driven_lanedir_consec_max	6.581056984392537
driven_lanedir_consec_mean	6.581056984392537
driven_lanedir_consec_min	6.581056984392537
driven_lanedir_max	6.581056984392537
driven_lanedir_mean	6.581056984392537
driven_lanedir_median	6.581056984392537
driven_lanedir_min	6.581056984392537
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"autolab-000-ego0": {"driven_any": 6.836215494129633, "survival_time": 43.04999999999969, "driven_lanedir": 6.581056984392537, "in-drivable-lane": 0.0, "deviation-heading": 9.980552479329264, "distance-from-start": 2.729159517493689, "deviation-center-line": 2.249805917012829, "driven_lanedir_consec": 6.581056984392537}}
simulation-passed	1
survival_time_max	43.04999999999969
survival_time_mean	43.04999999999969
survival_time_min	43.04999999999969

No reset possible

12396

532

Bea Baselines 🐤

baseline-dagger-pytorch

sim-1of4

success

2022-11-19 03:34:12+00:00

2022-11-19 03:39:15+00:00

0:05:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	36.55000000000006
in-drivable-lane_median	0.70000000000001
driven_lanedir_consec_median	5.418000216130337
deviation-center-line_median	1.5829088309969883

other stats

deviation-center-line_max	1.5829088309969883
deviation-center-line_mean	1.5829088309969883
deviation-center-line_min	1.5829088309969883
deviation-heading_max	8.845382195238306
deviation-heading_mean	8.845382195238306
deviation-heading_median	8.845382195238306
deviation-heading_min	8.845382195238306
distance-from-start_max	2.2049091250681214
distance-from-start_mean	2.2049091250681214
distance-from-start_median	2.2049091250681214
distance-from-start_min	2.2049091250681214
driven_any_max	5.778636866281303
driven_any_mean	5.778636866281303
driven_any_median	5.778636866281303
driven_any_min	5.778636866281303
driven_lanedir_consec_max	5.418000216130337
driven_lanedir_consec_mean	5.418000216130337
driven_lanedir_consec_min	5.418000216130337
driven_lanedir_max	5.418702751061665
driven_lanedir_mean	5.418702751061665
driven_lanedir_median	5.418702751061665
driven_lanedir_min	5.418702751061665
in-drivable-lane_max	0.70000000000001
in-drivable-lane_mean	0.70000000000001
in-drivable-lane_min	0.70000000000001
per-episodes	details {"udem1-000-ego0": {"driven_any": 5.778636866281303, "survival_time": 36.55000000000006, "driven_lanedir": 5.418702751061665, "in-drivable-lane": 0.70000000000001, "deviation-heading": 8.845382195238306, "distance-from-start": 2.2049091250681214, "deviation-center-line": 1.5829088309969883, "driven_lanedir_consec": 5.418000216130337}}
simulation-passed	1
survival_time_max	36.55000000000006
survival_time_mean	36.55000000000006
survival_time_min	36.55000000000006

No reset possible

12395

532

Bea Baselines 🐤

baseline-dagger-pytorch

sim-3of4

success

2022-11-19 03:32:15+00:00

2022-11-19 03:33:58+00:00

0:01:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

12391

533

Bea Baselines 🐤

baseline-dagger-pytorch

sim-1of4

success

2022-11-19 03:26:22+00:00

2022-11-19 03:32:07+00:00

0:05:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	10.659423837719912
survival_time_median	59.99999999999873
deviation-center-line_median	2.7386583107797744
in-drivable-lane_median	0.0

other stats

deviation-center-line_max	2.7386583107797744
deviation-center-line_mean	2.7386583107797744
deviation-center-line_min	2.7386583107797744
deviation-heading_max	11.201298004824103
deviation-heading_mean	11.201298004824103
deviation-heading_median	11.201298004824103
deviation-heading_min	11.201298004824103
distance-from-start_max	2.454275471055337
distance-from-start_mean	2.454275471055337
distance-from-start_median	2.454275471055337
distance-from-start_min	2.454275471055337
driven_any_max	10.91574684776375
driven_any_mean	10.91574684776375
driven_any_median	10.91574684776375
driven_any_min	10.91574684776375
driven_lanedir_consec_max	10.659423837719912
driven_lanedir_consec_mean	10.659423837719912
driven_lanedir_consec_min	10.659423837719912
driven_lanedir_max	10.659423837719912
driven_lanedir_mean	10.659423837719912
driven_lanedir_median	10.659423837719912
driven_lanedir_min	10.659423837719912
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop-000-ego0": {"driven_any": 10.91574684776375, "survival_time": 59.99999999999873, "driven_lanedir": 10.659423837719912, "in-drivable-lane": 0.0, "deviation-heading": 11.201298004824103, "distance-from-start": 2.454275471055337, "deviation-center-line": 2.7386583107797744, "driven_lanedir_consec": 10.659423837719912}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

12390

533

Bea Baselines 🐤

baseline-dagger-pytorch

sim-3of4

failed

2022-11-19 03:25:19+00:00

2022-11-19 03:26:14+00:00

0:00:55

The container "solut [...]

The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12389

534

Bea Baselines 🐤

baseline-dagger-pytorch

sim-1of4

failed

2022-11-19 03:23:44+00:00

2022-11-19 03:24:45+00:00

0:01:01

The container "solut [...]

The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12387

534

Bea Baselines 🐤

baseline-dagger-pytorch

sim-2of4

success

2022-11-19 03:22:19+00:00

2022-11-19 03:23:37+00:00

0:01:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

12386

535

Bea Baselines 🐤

baseline-dagger-pytorch

sim-3of4

host-error

2022-11-19 03:21:38+00:00

2022-11-19 03:22:06+00:00

0:00:28

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12380

536

Bea Baselines 🐤

baseline-dagger-pytorch

sim-0of4

success

2022-11-19 03:13:50+00:00

2022-11-19 03:21:23+00:00

0:07:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	43.699999999999655
in-drivable-lane_median	1.6000000000000227
driven_lanedir_consec_median	6.8993207442206
deviation-center-line_median	2.3152298779698164

other stats

deviation-center-line_max	2.3152298779698164
deviation-center-line_mean	2.3152298779698164
deviation-center-line_min	2.3152298779698164
deviation-heading_max	10.329382066983428
deviation-heading_mean	10.329382066983428
deviation-heading_median	10.329382066983428
deviation-heading_min	10.329382066983428
distance-from-start_max	3.634685079391762
distance-from-start_mean	3.634685079391762
distance-from-start_median	3.634685079391762
distance-from-start_min	3.634685079391762
driven_any_max	7.527660751613864
driven_any_mean	7.527660751613864
driven_any_median	7.527660751613864
driven_any_min	7.527660751613864
driven_lanedir_consec_max	6.8993207442206
driven_lanedir_consec_mean	6.8993207442206
driven_lanedir_consec_min	6.8993207442206
driven_lanedir_max	6.8993207442206
driven_lanedir_mean	6.8993207442206
driven_lanedir_median	6.8993207442206
driven_lanedir_min	6.8993207442206
in-drivable-lane_max	1.6000000000000227
in-drivable-lane_mean	1.6000000000000227
in-drivable-lane_min	1.6000000000000227
per-episodes	details {"autolab-000-ego0": {"driven_any": 7.527660751613864, "survival_time": 43.699999999999655, "driven_lanedir": 6.8993207442206, "in-drivable-lane": 1.6000000000000227, "deviation-heading": 10.329382066983428, "distance-from-start": 3.634685079391762, "deviation-center-line": 2.3152298779698164, "driven_lanedir_consec": 6.8993207442206}}
simulation-passed	1
survival_time_max	43.699999999999655
survival_time_mean	43.699999999999655
survival_time_min	43.699999999999655

No reset possible

12377

537

Bea Baselines 🐤

baseline-dagger-pytorch

sim-2of4

success

2022-11-19 03:09:34+00:00

2022-11-19 03:13:35+00:00

0:04:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	26.00000000000023
in-drivable-lane_median	0.0
driven_lanedir_consec_median	4.03140338034297
deviation-center-line_median	1.348107498540673

other stats

deviation-center-line_max	1.348107498540673
deviation-center-line_mean	1.348107498540673
deviation-center-line_min	1.348107498540673
deviation-heading_max	5.999925362732592
deviation-heading_mean	5.999925362732592
deviation-heading_median	5.999925362732592
deviation-heading_min	5.999925362732592
distance-from-start_max	1.062944228460983
distance-from-start_mean	1.062944228460983
distance-from-start_median	1.062944228460983
distance-from-start_min	1.062944228460983
driven_any_max	4.1870546489696485
driven_any_mean	4.1870546489696485
driven_any_median	4.1870546489696485
driven_any_min	4.1870546489696485
driven_lanedir_consec_max	4.03140338034297
driven_lanedir_consec_mean	4.03140338034297
driven_lanedir_consec_min	4.03140338034297
driven_lanedir_max	4.03140338034297
driven_lanedir_mean	4.03140338034297
driven_lanedir_median	4.03140338034297
driven_lanedir_min	4.03140338034297
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop2-000-ego0": {"driven_any": 4.1870546489696485, "survival_time": 26.00000000000023, "driven_lanedir": 4.03140338034297, "in-drivable-lane": 0.0, "deviation-heading": 5.999925362732592, "distance-from-start": 1.062944228460983, "deviation-center-line": 1.348107498540673, "driven_lanedir_consec": 4.03140338034297}}
simulation-passed	1
survival_time_max	26.00000000000023
survival_time_mean	26.00000000000023
survival_time_min	26.00000000000023

No reset possible

12374

536

Bea Baselines 🐤

baseline-dagger-pytorch

sim-3of4

success

2022-11-19 03:07:51+00:00

2022-11-19 03:09:28+00:00

0:01:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	5.399999999999989
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.5651135308565016
deviation-center-line_median	0.3877154337472588

other stats

deviation-center-line_max	0.3877154337472588
deviation-center-line_mean	0.3877154337472588
deviation-center-line_min	0.3877154337472588
deviation-heading_max	2.408042734289899
deviation-heading_mean	2.408042734289899
deviation-heading_median	2.408042734289899
deviation-heading_min	2.408042734289899
distance-from-start_max	0.5326946793509415
distance-from-start_mean	0.5326946793509415
distance-from-start_median	0.5326946793509415
distance-from-start_min	0.5326946793509415
driven_any_max	0.6354705393495231
driven_any_mean	0.6354705393495231
driven_any_median	0.6354705393495231
driven_any_min	0.6354705393495231
driven_lanedir_consec_max	0.5651135308565016
driven_lanedir_consec_mean	0.5651135308565016
driven_lanedir_consec_min	0.5651135308565016
driven_lanedir_max	0.5651135308565016
driven_lanedir_mean	0.5651135308565016
driven_lanedir_median	0.5651135308565016
driven_lanedir_min	0.5651135308565016
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"zigzag-000-ego0": {"driven_any": 0.6354705393495231, "survival_time": 5.399999999999989, "driven_lanedir": 0.5651135308565016, "in-drivable-lane": 0.0, "deviation-heading": 2.408042734289899, "distance-from-start": 0.5326946793509415, "deviation-center-line": 0.3877154337472588, "driven_lanedir_consec": 0.5651135308565016}}
simulation-passed	1
survival_time_max	5.399999999999989
survival_time_mean	5.399999999999989
survival_time_min	5.399999999999989

No reset possible

12373

537

Bea Baselines 🐤

baseline-dagger-pytorch

sim-1of4

host-error

2022-11-19 03:07:08+00:00

2022-11-19 03:07:37+00:00

0:00:29

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12365

538

Bea Baselines 🐤

baseline-dagger-pytorch

sim-1of4

success

2022-11-19 03:03:48+00:00

2022-11-19 03:07:00+00:00

0:03:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	6.799999999999984
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.8121123933625466
deviation-center-line_median	0.42750863905430786

other stats

deviation-center-line_max	0.42750863905430786
deviation-center-line_mean	0.42750863905430786
deviation-center-line_min	0.42750863905430786
deviation-heading_max	2.261390047813713
deviation-heading_mean	2.261390047813713
deviation-heading_median	2.261390047813713
deviation-heading_min	2.261390047813713
distance-from-start_max	0.7629782251826956
distance-from-start_mean	0.7629782251826956
distance-from-start_median	0.7629782251826956
distance-from-start_min	0.7629782251826956
driven_any_max	0.8698869078154743
driven_any_mean	0.8698869078154743
driven_any_median	0.8698869078154743
driven_any_min	0.8698869078154743
driven_lanedir_consec_max	0.8121123933625466
driven_lanedir_consec_mean	0.8121123933625466
driven_lanedir_consec_min	0.8121123933625466
driven_lanedir_max	0.8121123933625466
driven_lanedir_mean	0.8121123933625466
driven_lanedir_median	0.8121123933625466
driven_lanedir_min	0.8121123933625466
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"4way-000-ego0": {"driven_any": 0.8698869078154743, "survival_time": 6.799999999999984, "driven_lanedir": 0.8121123933625466, "in-drivable-lane": 0.0, "deviation-heading": 2.261390047813713, "distance-from-start": 0.7629782251826956, "deviation-center-line": 0.42750863905430786, "driven_lanedir_consec": 0.8121123933625466}}
simulation-passed	1
survival_time_max	6.799999999999984
survival_time_mean	6.799999999999984
survival_time_min	6.799999999999984

No reset possible

12362

538

Bea Baselines 🐤

baseline-dagger-pytorch

sim-3of4

success

2022-11-19 03:02:12+00:00

2022-11-19 03:03:41+00:00

0:01:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

12349

541

Bea Baselines 🐤

baseline-dagger-pytorch

sim-3of4

success

2022-11-19 02:43:44+00:00

2022-11-19 02:51:05+00:00

0:07:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	8.783674341186227
survival_time_median	59.99999999999873
deviation-center-line_median	3.639070726017131
in-drivable-lane_median	0.9500000000000072

other stats

deviation-center-line_max	3.639070726017131
deviation-center-line_mean	3.639070726017131
deviation-center-line_min	3.639070726017131
deviation-heading_max	17.40381377739687
deviation-heading_mean	17.40381377739687
deviation-heading_median	17.40381377739687
deviation-heading_min	17.40381377739687
distance-from-start_max	3.2848159862378257
distance-from-start_mean	3.2848159862378257
distance-from-start_median	3.2848159862378257
distance-from-start_min	3.2848159862378257
driven_any_max	9.53396795040978
driven_any_mean	9.53396795040978
driven_any_median	9.53396795040978
driven_any_min	9.53396795040978
driven_lanedir_consec_max	8.783674341186227
driven_lanedir_consec_mean	8.783674341186227
driven_lanedir_consec_min	8.783674341186227
driven_lanedir_max	8.783674341186227
driven_lanedir_mean	8.783674341186227
driven_lanedir_median	8.783674341186227
driven_lanedir_min	8.783674341186227
in-drivable-lane_max	0.9500000000000072
in-drivable-lane_mean	0.9500000000000072
in-drivable-lane_min	0.9500000000000072
per-episodes	details {"zigzag-000-ego0": {"driven_any": 9.53396795040978, "survival_time": 59.99999999999873, "driven_lanedir": 8.783674341186227, "in-drivable-lane": 0.9500000000000072, "deviation-heading": 17.40381377739687, "distance-from-start": 3.2848159862378257, "deviation-center-line": 3.639070726017131, "driven_lanedir_consec": 8.783674341186227}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

12346

542

Bea Baselines 🐤

baseline-dagger-pytorch

sim-3of4

success

2022-11-19 02:41:43+00:00

2022-11-19 02:43:39+00:00

0:01:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

12343

595

baseline-duckietown

sim-1of4

failed

2022-11-19 02:40:28+00:00

2022-11-19 02:41:24+00:00

0:00:56

The container "solut [...]

The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12340

600

template-tensorflow

sim-2of4

failed

2022-11-19 02:39:11+00:00

2022-11-19 02:40:06+00:00

0:00:55

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12335

600

template-tensorflow

sim-3of4

failed

2022-11-19 02:37:24+00:00

2022-11-19 02:38:59+00:00

0:01:35

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12333

600

template-tensorflow

sim-0of4

failed

2022-11-19 02:35:35+00:00

2022-11-19 02:37:17+00:00

0:01:42

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12328

603

Bea Baselines 🐤

template-ros

sim-2of4

success

2022-11-19 02:32:47+00:00

2022-11-19 02:35:19+00:00

0:02:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	4.199999999999993
in-drivable-lane_median	3.224999999999993
driven_lanedir_consec_median	0.14227587817318432
deviation-center-line_median	0.07301038238977153

other stats

deviation-center-line_max	0.08432834622573421
deviation-center-line_mean	0.07301038238977153
deviation-center-line_min	0.06169241855380887
deviation-heading_max	0.6964913203579629
deviation-heading_mean	0.6114537287383371
deviation-heading_median	0.6114537287383371
deviation-heading_min	0.5264161371187114
distance-from-start_max	0.8672133037180261
distance-from-start_mean	0.8319507832988484
distance-from-start_median	0.8319507832988484
distance-from-start_min	0.7966882628796707
driven_any_max	0.8748211542266706
driven_any_mean	0.8397038802847463
driven_any_median	0.8397038802847463
driven_any_min	0.8045866063428219
driven_lanedir_consec_max	0.15199033375239268
driven_lanedir_consec_mean	0.14227587817318432
driven_lanedir_consec_min	0.13256142259397596
driven_lanedir_max	0.15199033375239268
driven_lanedir_mean	0.14227587817318432
driven_lanedir_median	0.14227587817318432
driven_lanedir_min	0.13256142259397596
in-drivable-lane_max	3.249999999999993
in-drivable-lane_mean	3.224999999999993
in-drivable-lane_min	3.199999999999993
per-episodes	details {"loop2-000-ego0": {"driven_any": 0.8748211542266706, "survival_time": 4.199999999999993, "driven_lanedir": 0.13256142259397596, "in-drivable-lane": 3.199999999999993, "deviation-heading": 0.6964913203579629, "distance-from-start": 0.8672133037180261, "deviation-center-line": 0.06169241855380887, "driven_lanedir_consec": 0.13256142259397596}, "loop2-000-ego1": {"driven_any": 0.8045866063428219, "survival_time": 4.199999999999993, "driven_lanedir": 0.15199033375239268, "in-drivable-lane": 3.249999999999993, "deviation-heading": 0.5264161371187114, "distance-from-start": 0.7966882628796707, "deviation-center-line": 0.08432834622573421, "driven_lanedir_consec": 0.15199033375239268}}
simulation-passed	1
survival_time_max	4.199999999999993
survival_time_mean	4.199999999999993
survival_time_min	4.199999999999993

No reset possible

12323

605

Bea Baselines 🐤

template-ros

sim-0of4

success

2022-11-19 02:29:14+00:00

2022-11-19 02:32:32+00:00

0:03:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	7.249999999999982
in-drivable-lane_median	6.349999999999982
driven_lanedir_consec_median	0.13038293325922967
deviation-center-line_median	0.05000192890472313

other stats

deviation-center-line_max	0.05000192890472313
deviation-center-line_mean	0.05000192890472313
deviation-center-line_min	0.05000192890472313
deviation-heading_max	0.6149179203733337
deviation-heading_mean	0.6149179203733337
deviation-heading_median	0.6149179203733337
deviation-heading_min	0.6149179203733337
distance-from-start_max	1.736974874343439
distance-from-start_mean	1.736974874343439
distance-from-start_median	1.736974874343439
distance-from-start_min	1.736974874343439
driven_any_max	1.8802361869581288
driven_any_mean	1.8802361869581288
driven_any_median	1.8802361869581288
driven_any_min	1.8802361869581288
driven_lanedir_consec_max	0.13038293325922967
driven_lanedir_consec_mean	0.13038293325922967
driven_lanedir_consec_min	0.13038293325922967
driven_lanedir_max	0.13038293325922967
driven_lanedir_mean	0.13038293325922967
driven_lanedir_median	0.13038293325922967
driven_lanedir_min	0.13038293325922967
in-drivable-lane_max	6.349999999999982
in-drivable-lane_mean	6.349999999999982
in-drivable-lane_min	6.349999999999982
per-episodes	details {"autolab-000-ego0": {"driven_any": 1.8802361869581288, "survival_time": 7.249999999999982, "driven_lanedir": 0.13038293325922967, "in-drivable-lane": 6.349999999999982, "deviation-heading": 0.6149179203733337, "distance-from-start": 1.736974874343439, "deviation-center-line": 0.05000192890472313, "driven_lanedir_consec": 0.13038293325922967}}
simulation-passed	1
survival_time_max	7.249999999999982
survival_time_mean	7.249999999999982
survival_time_min	7.249999999999982

No reset possible

12318

605

Bea Baselines 🐤

template-ros

sim-3of4

host-error

2022-11-19 02:27:17+00:00

2022-11-19 02:28:52+00:00

0:01:35

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12315

605

Bea Baselines 🐤

template-ros

sim-2of4

success

2022-11-19 02:24:38+00:00

2022-11-19 02:27:02+00:00

0:02:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	3.699999999999995
in-drivable-lane_median	1.6499999999999977
driven_lanedir_consec_median	0.41640732149004367
deviation-center-line_median	0.17253654928960688

other stats

deviation-center-line_max	0.17253654928960688
deviation-center-line_mean	0.17253654928960688
deviation-center-line_min	0.17253654928960688
deviation-heading_max	1.3532939141277966
deviation-heading_mean	1.3532939141277966
deviation-heading_median	1.3532939141277966
deviation-heading_min	1.3532939141277966
distance-from-start_max	0.8431095628324953
distance-from-start_mean	0.8431095628324953
distance-from-start_median	0.8431095628324953
distance-from-start_min	0.8431095628324953
driven_any_max	0.8528728262543596
driven_any_mean	0.8528728262543596
driven_any_median	0.8528728262543596
driven_any_min	0.8528728262543596
driven_lanedir_consec_max	0.41640732149004367
driven_lanedir_consec_mean	0.41640732149004367
driven_lanedir_consec_min	0.41640732149004367
driven_lanedir_max	0.41640732149004367
driven_lanedir_mean	0.41640732149004367
driven_lanedir_median	0.41640732149004367
driven_lanedir_min	0.41640732149004367
in-drivable-lane_max	1.6499999999999977
in-drivable-lane_mean	1.6499999999999977
in-drivable-lane_min	1.6499999999999977
per-episodes	details {"loop2-000-ego0": {"driven_any": 0.8528728262543596, "survival_time": 3.699999999999995, "driven_lanedir": 0.41640732149004367, "in-drivable-lane": 1.6499999999999977, "deviation-heading": 1.3532939141277966, "distance-from-start": 0.8431095628324953, "deviation-center-line": 0.17253654928960688, "driven_lanedir_consec": 0.41640732149004367}}
simulation-passed	1
survival_time_max	3.699999999999995
survival_time_mean	3.699999999999995
survival_time_min	3.699999999999995

No reset possible

12306

607

Bea Baselines 🐤

template-ros

sim-3of4

success

2022-11-19 02:20:34+00:00

2022-11-19 02:22:52+00:00

0:02:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

12300

607

Bea Baselines 🐤

template-ros

sim-0of4

success

2022-11-19 02:18:22+00:00

2022-11-19 02:20:28+00:00

0:02:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	2.3499999999999996
in-drivable-lane_median	1.2499999999999991
driven_lanedir_consec_median	0.17947196516897024
deviation-center-line_median	0.06521003357829844

other stats

deviation-center-line_max	0.06521003357829844
deviation-center-line_mean	0.06521003357829844
deviation-center-line_min	0.06521003357829844
deviation-heading_max	0.6305145705571145
deviation-heading_mean	0.6305145705571145
deviation-heading_median	0.6305145705571145
deviation-heading_min	0.6305145705571145
distance-from-start_max	0.3771008166947647
distance-from-start_mean	0.3771008166947647
distance-from-start_median	0.3771008166947647
distance-from-start_min	0.3771008166947647
driven_any_max	0.37759710402446545
driven_any_mean	0.37759710402446545
driven_any_median	0.37759710402446545
driven_any_min	0.37759710402446545
driven_lanedir_consec_max	0.17947196516897024
driven_lanedir_consec_mean	0.17947196516897024
driven_lanedir_consec_min	0.17947196516897024
driven_lanedir_max	0.17947196516897024
driven_lanedir_mean	0.17947196516897024
driven_lanedir_median	0.17947196516897024
driven_lanedir_min	0.17947196516897024
in-drivable-lane_max	1.2499999999999991
in-drivable-lane_mean	1.2499999999999991
in-drivable-lane_min	1.2499999999999991
per-episodes	details {"4way-000-ego0": {"driven_any": 0.37759710402446545, "survival_time": 2.3499999999999996, "driven_lanedir": 0.17947196516897024, "in-drivable-lane": 1.2499999999999991, "deviation-heading": 0.6305145705571145, "distance-from-start": 0.3771008166947647, "deviation-center-line": 0.06521003357829844, "driven_lanedir_consec": 0.17947196516897024}}
simulation-passed	1
survival_time_max	2.3499999999999996
survival_time_mean	2.3499999999999996
survival_time_min	2.3499999999999996

No reset possible

12295

610

Bea Baselines 🐤

template-ros

sim-3of4

success

2022-11-19 02:14:37+00:00

2022-11-19 02:18:16+00:00

0:03:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	6.249999999999986
in-drivable-lane_median	3.699999999999988
driven_lanedir_consec_median	0.3830589156176803
deviation-center-line_median	0.19668091735018065

other stats

deviation-center-line_max	0.4136285297528245
deviation-center-line_mean	0.23359944101884825
deviation-center-line_min	0.12740739962220726
deviation-heading_max	4.23366192922124
deviation-heading_mean	1.8784074119962109
deviation-heading_median	1.3352057177188088
deviation-heading_min	0.6095562833259861
distance-from-start_max	1.4809758710007448
distance-from-start_mean	0.9373506952475792
distance-from-start_median	1.124037317176972
distance-from-start_min	0.020352275635628445
driven_any_max	1.4937179346368654
driven_any_mean	0.9455074577133372
driven_any_median	1.133978776159342
driven_any_min	0.020354343897799596
driven_lanedir_consec_max	0.6012519784222206
driven_lanedir_consec_mean	0.34589006055812616
driven_lanedir_consec_min	0.016190432574923364
driven_lanedir_max	0.6012519784222206
driven_lanedir_mean	0.34589006055812616
driven_lanedir_median	0.3830589156176803
driven_lanedir_min	0.016190432574923364
in-drivable-lane_max	4.799999999999986
in-drivable-lane_mean	3.049999999999991
in-drivable-lane_min	0.0
per-episodes	details {"zigzag-000-ego0": {"driven_any": 1.4937179346368654, "survival_time": 6.249999999999986, "driven_lanedir": 0.3118018535831484, "in-drivable-lane": 4.799999999999986, "deviation-heading": 0.6095562833259861, "distance-from-start": 1.4809758710007448, "deviation-center-line": 0.12740739962220726, "driven_lanedir_consec": 0.3118018535831484}, "zigzag-000-ego1": {"driven_any": 1.153466002808682, "survival_time": 6.249999999999986, "driven_lanedir": 0.6012519784222206, "in-drivable-lane": 3.399999999999988, "deviation-heading": 1.433239620828364, "distance-from-start": 1.135509755871761, "deviation-center-line": 0.22986562821603276, "driven_lanedir_consec": 0.6012519784222206}, "zigzag-000-ego2": {"driven_any": 1.1144915495100018, "survival_time": 6.249999999999986, "driven_lanedir": 0.4543159776522123, "in-drivable-lane": 3.999999999999989, "deviation-heading": 1.2371718146092536, "distance-from-start": 1.1125648784821829, "deviation-center-line": 0.16349620648432847, "driven_lanedir_consec": 0.4543159776522123}, "zigzag-000-ego3": {"driven_any": 0.020354343897799596, "survival_time": 6.249999999999986, "driven_lanedir": 0.016190432574923364, "in-drivable-lane": 0.0, "deviation-heading": 4.23366192922124, "distance-from-start": 0.020352275635628445, "deviation-center-line": 0.4136285297528245, "driven_lanedir_consec": 0.016190432574923364}}
simulation-passed	1
survival_time_max	6.249999999999986
survival_time_mean	6.249999999999986
survival_time_min	6.249999999999986

No reset possible

12290

611

Bea Baselines 🐤

template-ros

sim-3of4

success

2022-11-19 02:12:49+00:00

2022-11-19 02:14:16+00:00

0:01:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	3.2999999999999963
in-drivable-lane_median	2.4999999999999964
driven_lanedir_consec_median	0.08164785221505833
deviation-center-line_median	0.04977513737389441

other stats

deviation-center-line_max	0.04977513737389441
deviation-center-line_mean	0.04977513737389441
deviation-center-line_min	0.04977513737389441
deviation-heading_max	0.68638384635542
deviation-heading_mean	0.68638384635542
deviation-heading_median	0.68638384635542
deviation-heading_min	0.68638384635542
distance-from-start_max	0.6656647783407884
distance-from-start_mean	0.6656647783407884
distance-from-start_median	0.6656647783407884
distance-from-start_min	0.6656647783407884
driven_any_max	0.6719320814776863
driven_any_mean	0.6719320814776863
driven_any_median	0.6719320814776863
driven_any_min	0.6719320814776863
driven_lanedir_consec_max	0.08164785221505833
driven_lanedir_consec_mean	0.08164785221505833
driven_lanedir_consec_min	0.08164785221505833
driven_lanedir_max	0.08164785221505833
driven_lanedir_mean	0.08164785221505833
driven_lanedir_median	0.08164785221505833
driven_lanedir_min	0.08164785221505833
in-drivable-lane_max	2.4999999999999964
in-drivable-lane_mean	2.4999999999999964
in-drivable-lane_min	2.4999999999999964
per-episodes	details {"zigzag-000-ego0": {"driven_any": 0.6719320814776863, "survival_time": 3.2999999999999963, "driven_lanedir": 0.08164785221505833, "in-drivable-lane": 2.4999999999999964, "deviation-heading": 0.68638384635542, "distance-from-start": 0.6656647783407884, "deviation-center-line": 0.04977513737389441, "driven_lanedir_consec": 0.08164785221505833}}
simulation-passed	1
survival_time_max	3.2999999999999963
survival_time_mean	3.2999999999999963
survival_time_min	3.2999999999999963

No reset possible

12284

613

Bea Baselines 🐤

template-ros

sim-0of4

success

2022-11-19 02:09:22+00:00

2022-11-19 02:12:30+00:00

0:03:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	6.799999999999984
in-drivable-lane_median	5.499999999999985
driven_lanedir_consec_median	0.12989293964379067
deviation-center-line_median	0.1085318050218122

other stats

deviation-center-line_max	0.1085318050218122
deviation-center-line_mean	0.1085318050218122
deviation-center-line_min	0.1085318050218122
deviation-heading_max	1.2682048029284418
deviation-heading_mean	1.2682048029284418
deviation-heading_median	1.2682048029284418
deviation-heading_min	1.2682048029284418
distance-from-start_max	1.5107996520302125
distance-from-start_mean	1.5107996520302125
distance-from-start_median	1.5107996520302125
distance-from-start_min	1.5107996520302125
driven_any_max	1.7486948880769324
driven_any_mean	1.7486948880769324
driven_any_median	1.7486948880769324
driven_any_min	1.7486948880769324
driven_lanedir_consec_max	0.12989293964379067
driven_lanedir_consec_mean	0.12989293964379067
driven_lanedir_consec_min	0.12989293964379067
driven_lanedir_max	0.12989293964379067
driven_lanedir_mean	0.12989293964379067
driven_lanedir_median	0.12989293964379067
driven_lanedir_min	0.12989293964379067
in-drivable-lane_max	5.499999999999985
in-drivable-lane_mean	5.499999999999985
in-drivable-lane_min	5.499999999999985
per-episodes	details {"udem-000-ego0": {"driven_any": 1.7486948880769324, "survival_time": 6.799999999999984, "driven_lanedir": 0.12989293964379067, "in-drivable-lane": 5.499999999999985, "deviation-heading": 1.2682048029284418, "distance-from-start": 1.5107996520302125, "deviation-center-line": 0.1085318050218122, "driven_lanedir_consec": 0.12989293964379067}}
simulation-passed	1
survival_time_max	6.799999999999984
survival_time_mean	6.799999999999984
survival_time_min	6.799999999999984

No reset possible

12265

618

Bea Baselines 🐤

baseline-duckietown

sim-3of4

success

2022-11-19 01:46:58+00:00

2022-11-19 02:08:47+00:00

0:21:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	57.99999999999884
in-drivable-lane_median	22.82499999999925
driven_lanedir_consec_median	1.1933321281456224
deviation-center-line_median	2.304998261076029

other stats

deviation-center-line_max	3.213760442441191
deviation-center-line_mean	2.182030741120946
deviation-center-line_min	0.9043659998905348
deviation-heading_max	44.587104120749494
deviation-heading_mean	20.22337159422363
deviation-heading_median	16.905101841115336
deviation-heading_min	2.4961785739143387
distance-from-start_max	1.4323847914055667
distance-from-start_mean	0.9694545420839116
distance-from-start_median	0.8631802080004444
distance-from-start_min	0.719072960929191
driven_any_max	7.554851566944747
driven_any_mean	4.3571253693990615
driven_any_median	4.229235163723905
driven_any_min	1.4151795832036893
driven_lanedir_consec_max	2.797222085391377
driven_lanedir_consec_mean	1.508933448430499
driven_lanedir_consec_min	0.8518474520393742
driven_lanedir_max	4.551352304641414
driven_lanedir_mean	2.4583816987205394
driven_lanedir_median	2.080666119049817
driven_lanedir_min	1.1208422521411106
in-drivable-lane_max	48.49999999999883
in-drivable-lane_mean	23.624999999999332
in-drivable-lane_min	0.34999999999999876
per-episodes	details {"zigzag-000-ego0": {"driven_any": 1.4152352146618734, "survival_time": 57.99999999999884, "driven_lanedir": 1.20025818026608, "in-drivable-lane": 0.34999999999999876, "deviation-heading": 44.587104120749494, "distance-from-start": 0.7646956524563799, "deviation-center-line": 3.213760442441191, "driven_lanedir_consec": 0.8518474520393742}, "zigzag-000-ego1": {"driven_any": 1.4151795832036893, "survival_time": 57.99999999999884, "driven_lanedir": 1.1208422521411106, "in-drivable-lane": 48.49999999999883, "deviation-heading": 2.4961785739143387, "distance-from-start": 0.9616647635445088, "deviation-center-line": 0.9043659998905348, "driven_lanedir_consec": 1.1208422521411106}, "zigzag-000-ego2": {"driven_any": 7.043235112785935, "survival_time": 57.99999999999884, "driven_lanedir": 2.961074057833553, "in-drivable-lane": 29.199999999999136, "deviation-heading": 15.299995220516386, "distance-from-start": 0.719072960929191, "deviation-center-line": 1.9591153212555712, "driven_lanedir_consec": 1.2658220041501342}, "zigzag-000-ego3": {"driven_any": 7.554851566944747, "survival_time": 57.99999999999884, "driven_lanedir": 4.551352304641414, "in-drivable-lane": 16.449999999999356, "deviation-heading": 18.510208461714285, "distance-from-start": 1.4323847914055667, "deviation-center-line": 2.6508812008964866, "driven_lanedir_consec": 2.797222085391377}}
simulation-passed	1
survival_time_max	57.99999999999884
survival_time_mean	57.99999999999884
survival_time_min	57.99999999999884

No reset possible

12255

620

Bea Baselines 🐤

baseline-duckietown

sim-0of4

success

2022-11-19 01:32:03+00:00

2022-11-19 01:46:51+00:00

0:14:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	54.54999999999904
in-drivable-lane_median	9.549999999999727
driven_lanedir_consec_median	5.485228931575548
deviation-center-line_median	3.207482547730599

other stats

deviation-center-line_max	3.207482547730599
deviation-center-line_mean	3.207482547730599
deviation-center-line_min	3.207482547730599
deviation-heading_max	11.806924924162184
deviation-heading_mean	11.806924924162184
deviation-heading_median	11.806924924162184
deviation-heading_min	11.806924924162184
distance-from-start_max	2.607267134815649
distance-from-start_mean	2.607267134815649
distance-from-start_median	2.607267134815649
distance-from-start_min	2.607267134815649
driven_any_max	7.097378296814693
driven_any_mean	7.097378296814693
driven_any_median	7.097378296814693
driven_any_min	7.097378296814693
driven_lanedir_consec_max	5.485228931575548
driven_lanedir_consec_mean	5.485228931575548
driven_lanedir_consec_min	5.485228931575548
driven_lanedir_max	5.485228931575548
driven_lanedir_mean	5.485228931575548
driven_lanedir_median	5.485228931575548
driven_lanedir_min	5.485228931575548
in-drivable-lane_max	9.549999999999727
in-drivable-lane_mean	9.549999999999727
in-drivable-lane_min	9.549999999999727
per-episodes	details {"autolab-000-ego0": {"driven_any": 7.097378296814693, "survival_time": 54.54999999999904, "driven_lanedir": 5.485228931575548, "in-drivable-lane": 9.549999999999727, "deviation-heading": 11.806924924162184, "distance-from-start": 2.607267134815649, "deviation-center-line": 3.207482547730599, "driven_lanedir_consec": 5.485228931575548}}
simulation-passed	1
survival_time_max	54.54999999999904
survival_time_mean	54.54999999999904
survival_time_min	54.54999999999904

No reset possible

12246

622

Bea Baselines 🐤

baseline-duckietown

sim-0of4

success

2022-11-19 01:25:19+00:00

2022-11-19 01:31:31+00:00

0:06:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0
deviation-center-line_median	0.8949116056299468

other stats

deviation-center-line_max	0.8949116056299468
deviation-center-line_mean	0.8949116056299468
deviation-center-line_min	0.8949116056299468
deviation-heading_max	32.249113233675025
deviation-heading_mean	32.249113233675025
deviation-heading_median	32.249113233675025
deviation-heading_min	32.249113233675025
distance-from-start_max	4.440892098500626e-16
distance-from-start_mean	4.440892098500626e-16
distance-from-start_median	4.440892098500626e-16
distance-from-start_min	4.440892098500626e-16
driven_any_max	5.329070518200751e-13
driven_any_mean	5.329070518200751e-13
driven_any_median	5.329070518200751e-13
driven_any_min	5.329070518200751e-13
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"4way-000-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.8949116056299468, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

12243

624

Bea Baselines 🐤

baseline-duckietown

sim-0of4

success

2022-11-19 01:16:28+00:00

2022-11-19 01:25:05+00:00

0:08:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	21.40000000000017
in-drivable-lane_median	5.700000000000081
driven_lanedir_consec_median	0.4873222006277226
deviation-center-line_median	1.3083732907244288

other stats

deviation-center-line_max	2.505291795122019
deviation-center-line_mean	1.3343035093830846
deviation-center-line_min	0.21517566096146207
deviation-heading_max	7.213611259951829
deviation-heading_mean	3.9939547499764503
deviation-heading_median	3.4338576990799874
deviation-heading_min	1.8944923417939967
distance-from-start_max	1.1437337597801671
distance-from-start_mean	0.6307759546908778
distance-from-start_median	0.48958670117049646
distance-from-start_min	0.4001966566423511
driven_any_max	2.69641085310444
driven_any_mean	1.066744359838753
driven_any_median	0.5721969224179887
driven_any_min	0.42617274141459327
driven_lanedir_consec_max	1.2111120178892671
driven_lanedir_consec_mean	0.6456134788938281
driven_lanedir_consec_min	0.39669749643060026
driven_lanedir_max	1.2111120178892671
driven_lanedir_mean	0.6456134788938281
driven_lanedir_median	0.4873222006277226
driven_lanedir_min	0.39669749643060026
in-drivable-lane_max	16.55000000000018
in-drivable-lane_mean	6.987500000000085
in-drivable-lane_min	0.0
per-episodes	details {"udem-000-ego0": {"driven_any": 2.69641085310444, "survival_time": 21.40000000000017, "driven_lanedir": 1.2111120178892671, "in-drivable-lane": 11.400000000000162, "deviation-heading": 1.8944923417939967, "distance-from-start": 1.1437337597801671, "deviation-center-line": 0.21517566096146207, "driven_lanedir_consec": 1.2111120178892671}, "udem-000-ego1": {"driven_any": 0.42617274141459327, "survival_time": 21.40000000000017, "driven_lanedir": 0.39669749643060026, "in-drivable-lane": 0.0, "deviation-heading": 4.583080817144942, "distance-from-start": 0.4001966566423511, "deviation-center-line": 2.505291795122019, "driven_lanedir_consec": 0.39669749643060026}, "udem-000-ego2": {"driven_any": 0.6518095494726983, "survival_time": 21.40000000000017, "driven_lanedir": 0.49566959268755584, "in-drivable-lane": 16.55000000000018, "deviation-heading": 2.284634581015033, "distance-from-start": 0.49390327922451854, "deviation-center-line": 0.2468124390780133, "driven_lanedir_consec": 0.49566959268755584}, "udem-000-ego3": {"driven_any": 0.49258429536327913, "survival_time": 21.40000000000017, "driven_lanedir": 0.4789748085678893, "in-drivable-lane": 0.0, "deviation-heading": 7.213611259951829, "distance-from-start": 0.4852701231164744, "deviation-center-line": 2.369934142370844, "driven_lanedir_consec": 0.4789748085678893}}
simulation-passed	1
survival_time_max	21.40000000000017
survival_time_mean	21.40000000000017
survival_time_min	21.40000000000017

No reset possible

12231

627

Bea Baselines 🐤

baseline-duckietown

sim-3of4

success

2022-11-19 00:59:39+00:00

2022-11-19 01:16:21+00:00

0:16:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	5.0999999999999925
driven_lanedir_consec_median	3.823555170252603
deviation-center-line_median	3.712430418433113

other stats

deviation-center-line_max	3.712430418433113
deviation-center-line_mean	3.712430418433113
deviation-center-line_min	3.712430418433113
deviation-heading_max	18.556833115071715
deviation-heading_mean	18.556833115071715
deviation-heading_median	18.556833115071715
deviation-heading_min	18.556833115071715
distance-from-start_max	2.1153755167375228
distance-from-start_mean	2.1153755167375228
distance-from-start_median	2.1153755167375228
distance-from-start_min	2.1153755167375228
driven_any_max	7.913790983943946
driven_any_mean	7.913790983943946
driven_any_median	7.913790983943946
driven_any_min	7.913790983943946
driven_lanedir_consec_max	3.823555170252603
driven_lanedir_consec_mean	3.823555170252603
driven_lanedir_consec_min	3.823555170252603
driven_lanedir_max	6.437734110048602
driven_lanedir_mean	6.437734110048602
driven_lanedir_median	6.437734110048602
driven_lanedir_min	6.437734110048602
in-drivable-lane_max	5.0999999999999925
in-drivable-lane_mean	5.0999999999999925
in-drivable-lane_min	5.0999999999999925
per-episodes	details {"zigzag-000-ego0": {"driven_any": 7.913790983943946, "survival_time": 59.99999999999873, "driven_lanedir": 6.437734110048602, "in-drivable-lane": 5.0999999999999925, "deviation-heading": 18.556833115071715, "distance-from-start": 2.1153755167375228, "deviation-center-line": 3.712430418433113, "driven_lanedir_consec": 3.823555170252603}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

12215

631

Bea Baselines 🐤

baseline-duckietown

sim-1of4

success

2022-11-19 00:44:56+00:00

2022-11-19 00:59:13+00:00

0:14:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	43.74999999999965
in-drivable-lane_median	1.6249999999999942
driven_lanedir_consec_median	0.5956101254893702
deviation-center-line_median	2.8698492917215703

other stats

deviation-center-line_max	6.51558986800687
deviation-center-line_mean	3.4436377921991577
deviation-center-line_min	1.5192627173466196
deviation-heading_max	47.3874579285358
deviation-heading_mean	25.267167341127365
deviation-heading_median	20.539176882577337
deviation-heading_min	12.602857670818986
distance-from-start_max	1.5069794839776898
distance-from-start_mean	0.6684009815568802
distance-from-start_median	0.4881999886937244
distance-from-start_min	0.19022446486238231
driven_any_max	5.6626476860887465
driven_any_mean	1.9509217565270351
driven_any_median	0.966965260874485
driven_any_min	0.20710881827042385
driven_lanedir_consec_max	2.1756721809466915
driven_lanedir_consec_mean	0.8871587693009289
driven_lanedir_consec_min	0.18174264527828332
driven_lanedir_max	2.3596748760783863
driven_lanedir_mean	0.9658335820804064
driven_lanedir_median	0.6609584034824776
driven_lanedir_min	0.18174264527828332
in-drivable-lane_max	18.450000000000063
in-drivable-lane_mean	5.425000000000013
in-drivable-lane_min	0.0
per-episodes	details {"4way-000-ego0": {"driven_any": 0.20710881827042385, "survival_time": 43.74999999999965, "driven_lanedir": 0.18174264527828332, "in-drivable-lane": 0.0, "deviation-heading": 25.35234178946044, "distance-from-start": 0.19022446486238231, "deviation-center-line": 3.7816958034654857, "driven_lanedir_consec": 0.18174264527828332}, "4way-000-ego1": {"driven_any": 1.0963798310653528, "survival_time": 43.74999999999965, "driven_lanedir": 0.7938340430264295, "in-drivable-lane": 1.499999999999995, "deviation-heading": 12.602857670818986, "distance-from-start": 0.5477737993477626, "deviation-center-line": 6.51558986800687, "driven_lanedir_consec": 0.6631374870402148}, "4way-000-ego2": {"driven_any": 0.8375506906836173, "survival_time": 43.74999999999965, "driven_lanedir": 0.5280827639385257, "in-drivable-lane": 1.7499999999999938, "deviation-heading": 47.3874579285358, "distance-from-start": 0.4286261780396861, "deviation-center-line": 1.5192627173466196, "driven_lanedir_consec": 0.5280827639385257}, "4way-000-ego3": {"driven_any": 5.6626476860887465, "survival_time": 43.74999999999965, "driven_lanedir": 2.3596748760783863, "in-drivable-lane": 18.450000000000063, "deviation-heading": 15.726011975694234, "distance-from-start": 1.5069794839776898, "deviation-center-line": 1.9580027799776552, "driven_lanedir_consec": 2.1756721809466915}}
simulation-passed	1
survival_time_max	43.74999999999965
survival_time_mean	43.74999999999965
survival_time_min	43.74999999999965

No reset possible

12211

660

Bea Baselines 🐤

template-tensorflow

sim-1of4

failed

2022-11-19 00:43:33+00:00

2022-11-19 00:44:49+00:00

0:01:16

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12207

661

Bea Baselines 🐤

template-tensorflow

sim-1of4

failed

2022-11-19 00:42:17+00:00

2022-11-19 00:43:19+00:00

0:01:02

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12201

663

Bea Baselines 🐤

template-tensorflow

sim-1of4

failed

2022-11-19 00:40:09+00:00

2022-11-19 00:42:02+00:00

0:01:53

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12197

664

Bea Baselines 🐤

template-tensorflow

sim-2of4

success

2022-11-19 00:38:09+00:00

2022-11-19 00:39:40+00:00

0:01:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

12193

665

Bea Baselines 🐤

template-tensorflow

sim-0of4

failed

2022-11-19 00:36:53+00:00

2022-11-19 00:37:48+00:00

0:00:55

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12192

666

Bea Baselines 🐤

template-tensorflow

sim-1of4

failed

2022-11-19 00:35:31+00:00

2022-11-19 00:36:48+00:00

0:01:17

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12188

667

Bea Baselines 🐤

template-tensorflow

sim-0of4

failed

2022-11-19 00:33:49+00:00

2022-11-19 00:35:09+00:00

0:01:20

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12183

668

Bea Baselines 🐤

template-tensorflow

sim-3of4

failed

2022-11-19 00:32:20+00:00

2022-11-19 00:33:14+00:00

0:00:54

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12181

668

Bea Baselines 🐤

template-tensorflow

sim-1of4

failed

2022-11-19 00:31:03+00:00

2022-11-19 00:31:59+00:00

0:00:56

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12176

670

Bea Baselines 🐤

template-tensorflow

sim-1of4

failed

2022-11-19 00:29:06+00:00

2022-11-19 00:30:48+00:00

0:01:42

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12174

670

Bea Baselines 🐤

template-tensorflow

sim-0of4

failed

2022-11-19 00:27:22+00:00

2022-11-19 00:29:00+00:00

0:01:38

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12171

671

Bea Baselines 🐤

template-tensorflow

sim-1of4

host-error

2022-11-19 00:25:07+00:00

2022-11-19 00:27:08+00:00

0:02:01

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12168

671

Bea Baselines 🐤

template-tensorflow

sim-2of4

success

2022-11-19 00:23:11+00:00

2022-11-19 00:24:41+00:00

0:01:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

12166

673

Bea Baselines 🐤

template-tensorflow

sim-0of4

failed

2022-11-19 00:21:11+00:00

2022-11-19 00:22:38+00:00

0:01:27

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12164

673

Bea Baselines 🐤

template-tensorflow

sim-2of4

success

2022-11-19 00:19:41+00:00

2022-11-19 00:20:56+00:00

0:01:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

12158

704

Bea Baselines 🐤

template-random

sim-2of4

success

2022-11-19 00:13:39+00:00

2022-11-19 00:19:07+00:00

0:05:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	45.099999999999575
in-drivable-lane_median	36.54999999999956
driven_lanedir_consec_median	0.26764947507969805
deviation-center-line_median	0.7555292890833561

other stats

deviation-center-line_max	0.7555292890833561
deviation-center-line_mean	0.7555292890833561
deviation-center-line_min	0.7555292890833561
deviation-heading_max	5.523299123594233
deviation-heading_mean	5.523299123594233
deviation-heading_median	5.523299123594233
deviation-heading_min	5.523299123594233
distance-from-start_max	1.0442247976691843
distance-from-start_mean	1.0442247976691843
distance-from-start_median	1.0442247976691843
distance-from-start_min	1.0442247976691843
driven_any_max	11.376062002465083
driven_any_mean	11.376062002465083
driven_any_median	11.376062002465083
driven_any_min	11.376062002465083
driven_lanedir_consec_max	0.26764947507969805
driven_lanedir_consec_mean	0.26764947507969805
driven_lanedir_consec_min	0.26764947507969805
driven_lanedir_max	0.2496387990426845
driven_lanedir_mean	0.2496387990426845
driven_lanedir_median	0.2496387990426845
driven_lanedir_min	0.2496387990426845
in-drivable-lane_max	36.54999999999956
in-drivable-lane_mean	36.54999999999956
in-drivable-lane_min	36.54999999999956
per-episodes	details {"loop2-000-ego0": {"driven_any": 11.376062002465083, "survival_time": 45.099999999999575, "driven_lanedir": 0.2496387990426845, "in-drivable-lane": 36.54999999999956, "deviation-heading": 5.523299123594233, "distance-from-start": 1.0442247976691843, "deviation-center-line": 0.7555292890833561, "driven_lanedir_consec": 0.26764947507969805}}
simulation-passed	1
survival_time_max	45.099999999999575
survival_time_mean	45.099999999999575
survival_time_min	45.099999999999575

No reset possible

12155

706

Bea Baselines 🐤

template-random

sim-3of4

success

2022-11-19 00:11:17+00:00

2022-11-19 00:13:18+00:00

0:02:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

12141

710

Bea Baselines 🐤

template-random

sim-1of4

success

2022-11-18 23:50:27+00:00

2022-11-19 00:11:04+00:00

0:20:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	46.824999999998994
driven_lanedir_consec_median	0.19888958841261967
deviation-center-line_median	1.2302307544380242

other stats

deviation-center-line_max	2.7624626207296523
deviation-center-line_mean	1.4614842694980663
deviation-center-line_min	0.6230129483865658
deviation-heading_max	37.82293240559152
deviation-heading_mean	14.895649917871705
deviation-heading_median	8.929445635074492
deviation-heading_min	3.900775995746316
distance-from-start_max	1.4108418329399008
distance-from-start_mean	0.7424833694964633
distance-from-start_median	0.7795458225229759
distance-from-start_min	2.482534153247273e-16
driven_any_max	15.326310847370593
driven_any_mean	6.8063963066798205
driven_any_median	5.949637189674196
driven_any_min	2.9790409838966753e-13
driven_lanedir_consec_max	0.29723254612384026
driven_lanedir_consec_mean	0.17375293073726988
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.2967938965440506
driven_lanedir_mean	0.16460716406936743
driven_lanedir_median	0.1808173798667096
driven_lanedir_min	0.0
in-drivable-lane_max	53.199999999998695
in-drivable-lane_mean	36.71249999999917
in-drivable-lane_min	0.0
per-episodes	details {"loop-000-ego0": {"driven_any": 15.326310847370593, "survival_time": 59.99999999999873, "driven_lanedir": 0.2967938965440506, "in-drivable-lane": 41.699999999999264, "deviation-heading": 13.4239573807347, "distance-from-start": 1.4108418329399008, "deviation-center-line": 1.7741548227320476, "driven_lanedir_consec": 0.29723254612384026}, "loop-000-ego1": {"driven_any": 6.69482709059637, "survival_time": 59.99999999999873, "driven_lanedir": 0.2307195600231423, "in-drivable-lane": 51.94999999999872, "deviation-heading": 4.434933889414283, "distance-from-start": 0.82330328736858, "deviation-center-line": 0.6230129483865658, "driven_lanedir_consec": 0.24485358668177015}, "loop-000-ego2": {"driven_any": 5.204447288752023, "survival_time": 59.99999999999873, "driven_lanedir": 0.13091519971027687, "in-drivable-lane": 53.199999999998695, "deviation-heading": 3.900775995746316, "distance-from-start": 0.7357883576773718, "deviation-center-line": 0.6863066861440009, "driven_lanedir_consec": 0.15292559014346918}, "loop-000-ego3": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 2.7624626207296523, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

12139

710

Bea Baselines 🐤

template-random

sim-2of4

success

2022-11-18 23:40:33+00:00

2022-11-18 23:50:07+00:00

0:09:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	44.99999999999958
in-drivable-lane_median	33.97499999999953
driven_lanedir_consec_median	0.24267935143511904
deviation-center-line_median	1.0095663665177188

other stats

deviation-center-line_max	1.3919846551429198
deviation-center-line_mean	1.0095663665177188
deviation-center-line_min	0.627148077892518
deviation-heading_max	9.906601266560886
deviation-heading_mean	7.039929062391657
deviation-heading_median	7.039929062391657
deviation-heading_min	4.173256858222429
distance-from-start_max	1.0442247976691823
distance-from-start_mean	1.0267826168375516
distance-from-start_median	1.0267826168375516
distance-from-start_min	1.0093404360059206
driven_any_max	11.349124250612952
driven_any_mean	10.84517670046137
driven_any_median	10.84517670046137
driven_any_min	10.341229150309788
driven_lanedir_consec_max	0.24556462619118857
driven_lanedir_consec_mean	0.24267935143511904
driven_lanedir_consec_min	0.2397940766790495
driven_lanedir_max	0.2358258971661935
driven_lanedir_mean	0.2307429735933076
driven_lanedir_median	0.2307429735933076
driven_lanedir_min	0.2256600500204217
in-drivable-lane_max	36.94999999999958
in-drivable-lane_mean	33.97499999999953
in-drivable-lane_min	30.999999999999485
per-episodes	details {"loop2-000-ego0": {"driven_any": 10.341229150309788, "survival_time": 44.99999999999958, "driven_lanedir": 0.2358258971661935, "in-drivable-lane": 30.999999999999485, "deviation-heading": 9.906601266560886, "distance-from-start": 1.0093404360059206, "deviation-center-line": 1.3919846551429198, "driven_lanedir_consec": 0.24556462619118857}, "loop2-000-ego1": {"driven_any": 11.349124250612952, "survival_time": 44.99999999999958, "driven_lanedir": 0.2256600500204217, "in-drivable-lane": 36.94999999999958, "deviation-heading": 4.173256858222429, "distance-from-start": 1.0442247976691823, "deviation-center-line": 0.627148077892518, "driven_lanedir_consec": 0.2397940766790495}}
simulation-passed	1
survival_time_max	44.99999999999958
survival_time_mean	44.99999999999958
survival_time_min	44.99999999999958

No reset possible

12132

710

Bea Baselines 🐤

template-random

sim-3of4

host-error

2022-11-18 23:34:29+00:00

2022-11-18 23:40:12+00:00

0:05:43

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1312, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 423, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1156, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12129

711

Bea Baselines 🐤

template-random

sim-1of4

success

2022-11-18 23:30:50+00:00

2022-11-18 23:34:22+00:00

0:03:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	16.850000000000104
in-drivable-lane_median	12.350000000000078
driven_lanedir_consec_median	0.03297699806626109
deviation-center-line_median	0.4050305988545377

other stats

deviation-center-line_max	0.4050305988545377
deviation-center-line_mean	0.4050305988545377
deviation-center-line_min	0.4050305988545377
deviation-heading_max	3.4318871778555886
deviation-heading_mean	3.4318871778555886
deviation-heading_median	3.4318871778555886
deviation-heading_min	3.4318871778555886
distance-from-start_max	0.673601037960496
distance-from-start_mean	0.673601037960496
distance-from-start_median	0.673601037960496
distance-from-start_min	0.673601037960496
driven_any_max	4.0578227584594435
driven_any_mean	4.0578227584594435
driven_any_median	4.0578227584594435
driven_any_min	4.0578227584594435
driven_lanedir_consec_max	0.03297699806626109
driven_lanedir_consec_mean	0.03297699806626109
driven_lanedir_consec_min	0.03297699806626109
driven_lanedir_max	0.036323340164895024
driven_lanedir_mean	0.036323340164895024
driven_lanedir_median	0.036323340164895024
driven_lanedir_min	0.036323340164895024
in-drivable-lane_max	12.350000000000078
in-drivable-lane_mean	12.350000000000078
in-drivable-lane_min	12.350000000000078
per-episodes	details {"loop-000-ego0": {"driven_any": 4.0578227584594435, "survival_time": 16.850000000000104, "driven_lanedir": 0.036323340164895024, "in-drivable-lane": 12.350000000000078, "deviation-heading": 3.4318871778555886, "distance-from-start": 0.673601037960496, "deviation-center-line": 0.4050305988545377, "driven_lanedir_consec": 0.03297699806626109}}
simulation-passed	1
survival_time_max	16.850000000000104
survival_time_mean	16.850000000000104
survival_time_min	16.850000000000104

No reset possible

12126

712

Bea Baselines 🐤

template-random

sim-0of4

success

2022-11-18 23:25:57+00:00

2022-11-18 23:30:29+00:00

0:04:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	12.650000000000045
in-drivable-lane_median	9.200000000000031
driven_lanedir_consec_median	0.027296054749769816
deviation-center-line_median	0.3268219516832444

other stats

deviation-center-line_max	0.3268219516832444
deviation-center-line_mean	0.3268219516832444
deviation-center-line_min	0.3268219516832444
deviation-heading_max	2.554024904051201
deviation-heading_mean	2.554024904051201
deviation-heading_median	2.554024904051201
deviation-heading_min	2.554024904051201
distance-from-start_max	0.6297514211538974
distance-from-start_mean	0.6297514211538974
distance-from-start_median	0.6297514211538974
distance-from-start_min	0.6297514211538974
driven_any_max	2.9055858596809983
driven_any_mean	2.9055858596809983
driven_any_median	2.9055858596809983
driven_any_min	2.9055858596809983
driven_lanedir_consec_max	0.027296054749769816
driven_lanedir_consec_mean	0.027296054749769816
driven_lanedir_consec_min	0.027296054749769816
driven_lanedir_max	0.030642992894805765
driven_lanedir_mean	0.030642992894805765
driven_lanedir_median	0.030642992894805765
driven_lanedir_min	0.030642992894805765
in-drivable-lane_max	9.200000000000031
in-drivable-lane_mean	9.200000000000031
in-drivable-lane_min	9.200000000000031
per-episodes	details {"autolab-000-ego0": {"driven_any": 2.9055858596809983, "survival_time": 12.650000000000045, "driven_lanedir": 0.030642992894805765, "in-drivable-lane": 9.200000000000031, "deviation-heading": 2.554024904051201, "distance-from-start": 0.6297514211538974, "deviation-center-line": 0.3268219516832444, "driven_lanedir_consec": 0.027296054749769816}}
simulation-passed	1
survival_time_max	12.650000000000045
survival_time_mean	12.650000000000045
survival_time_min	12.650000000000045

No reset possible

12121

713

Bea Baselines 🐤

template-random

sim-0of4

success

2022-11-18 23:21:38+00:00

2022-11-18 23:25:44+00:00

0:04:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	11.350000000000026
in-drivable-lane_median	7.900000000000015
driven_lanedir_consec_median	0.02948511522371433
deviation-center-line_median	0.3268413798803088

other stats

deviation-center-line_max	0.3268413798803088
deviation-center-line_mean	0.3268413798803088
deviation-center-line_min	0.3268413798803088
deviation-heading_max	2.54887264951439
deviation-heading_mean	2.54887264951439
deviation-heading_median	2.54887264951439
deviation-heading_min	2.54887264951439
distance-from-start_max	0.5461575079396541
distance-from-start_mean	0.5461575079396541
distance-from-start_median	0.5461575079396541
distance-from-start_min	0.5461575079396541
driven_any_max	2.2955250818765145
driven_any_mean	2.2955250818765145
driven_any_median	2.2955250818765145
driven_any_min	2.2955250818765145
driven_lanedir_consec_max	0.02948511522371433
driven_lanedir_consec_mean	0.02948511522371433
driven_lanedir_consec_min	0.02948511522371433
driven_lanedir_max	0.03283062285727567
driven_lanedir_mean	0.03283062285727567
driven_lanedir_median	0.03283062285727567
driven_lanedir_min	0.03283062285727567
in-drivable-lane_max	7.900000000000015
in-drivable-lane_mean	7.900000000000015
in-drivable-lane_min	7.900000000000015
per-episodes	details {"udem-000-ego0": {"driven_any": 2.2955250818765145, "survival_time": 11.350000000000026, "driven_lanedir": 0.03283062285727567, "in-drivable-lane": 7.900000000000015, "deviation-heading": 2.54887264951439, "distance-from-start": 0.5461575079396541, "deviation-center-line": 0.3268413798803088, "driven_lanedir_consec": 0.02948511522371433}}
simulation-passed	1
survival_time_max	11.350000000000026
survival_time_mean	11.350000000000026
survival_time_min	11.350000000000026

No reset possible

12117

714

Bea Baselines 🐤

template-random

sim-2of4

success

2022-11-18 23:19:56+00:00

2022-11-18 23:21:31+00:00

0:01:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

12109

732

Bea Baselines 🐤

baseline-duckietown-ml

sim-3of4

success

2022-11-18 23:05:56+00:00

2022-11-18 23:19:48+00:00

0:13:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	-4.299721525491407e-05
deviation-center-line_median	1.511718550059415

other stats

deviation-center-line_max	2.9467617678498437
deviation-center-line_mean	1.5769838576829665
deviation-center-line_min	0.33773656276319197
deviation-heading_max	32.249113233675025
deviation-heading_mean	22.839465954359294
deviation-heading_median	22.597238933513907
deviation-heading_min	13.91427271673436
distance-from-start_max	9.155133597044477e-16
distance-from-start_mean	5.3805908476715e-16
distance-from-start_median	6.183614896820762e-16
distance-from-start_min	0.0
driven_any_max	1.0986160316453499e-12
driven_any_mean	6.456709017205911e-13
driven_any_median	7.420337876185071e-13
driven_any_min	0.0
driven_lanedir_consec_max	4.4323372971888375e-06
driven_lanedir_consec_mean	-9.191609703362856e-05
driven_lanedir_consec_min	-0.000286102294921875
driven_lanedir_max	4.4323372971888375e-06
driven_lanedir_mean	-9.191609703362856e-05
driven_lanedir_median	-4.299721525491407e-05
driven_lanedir_min	-0.000286102294921875
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"zigzag-000-ego0": {"driven_any": 3.9968028886505635e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 3.3306690738754696e-16, "deviation-center-line": 0.8949424300958599, "driven_lanedir_consec": 0.0}, "zigzag-000-ego1": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": -8.599443050982813e-05, "in-drivable-lane": 0.0, "deviation-heading": 30.71291327085948, "distance-from-start": 0.0, "deviation-center-line": 2.1284946700229703, "driven_lanedir_consec": -8.599443050982813e-05}, "zigzag-000-ego2": {"driven_any": 1.084387286371958e-12, "survival_time": 59.99999999999873, "driven_lanedir": -0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 14.481564596168331, "distance-from-start": 9.036560719766057e-16, "deviation-center-line": 2.9467617678498437, "driven_lanedir_consec": -0.000286102294921875}, "zigzag-000-ego3": {"driven_any": 1.0986160316453499e-12, "survival_time": 59.99999999999873, "driven_lanedir": 4.4323372971888375e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.91427271673436, "distance-from-start": 9.155133597044477e-16, "deviation-center-line": 0.33773656276319197, "driven_lanedir_consec": 4.4323372971888375e-06}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

12099

735

Bea Baselines 🐤

baseline-duckietown-ml

sim-0of4

success

2022-11-18 22:53:44+00:00

2022-11-18 23:05:34+00:00

0:11:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0
deviation-center-line_median	0.8948943425963037

other stats

deviation-center-line_max	0.8948943425963037
deviation-center-line_mean	0.8948943425963037
deviation-center-line_min	0.8948943425963037
deviation-heading_max	32.249113233675025
deviation-heading_mean	32.249113233675025
deviation-heading_median	32.249113233675025
deviation-heading_min	32.249113233675025
distance-from-start_max	1.3877787807814454e-16
distance-from-start_mean	1.3877787807814454e-16
distance-from-start_median	1.3877787807814454e-16
distance-from-start_min	1.3877787807814454e-16
driven_any_max	1.665334536937735e-13
driven_any_mean	1.665334536937735e-13
driven_any_median	1.665334536937735e-13
driven_any_min	1.665334536937735e-13
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"udem-000-ego0": {"driven_any": 1.665334536937735e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 1.3877787807814454e-16, "deviation-center-line": 0.8948943425963037, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

12089

738

Bea Baselines 🐤

baseline-duckietown-ml

sim-0of4

success

2022-11-18 22:38:41+00:00

2022-11-18 22:53:30+00:00

0:14:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0
deviation-center-line_median	1.511694751241496

other stats

deviation-center-line_max	2.9467758452445567
deviation-center-line_mean	1.5769739939981144
deviation-center-line_min	0.3377306282649093
deviation-heading_max	32.249113233675025
deviation-heading_mean	22.83949643715976
deviation-heading_median	22.597265680122995
deviation-heading_min	13.914341154718024
distance-from-start_max	9.155133597044477e-16
distance-from-start_mean	2.566339155417408e-16
distance-from-start_median	5.551115123125783e-17
distance-from-start_min	0.0
driven_any_max	1.0986160316453499e-12
driven_any_mean	3.079606986500922e-13
driven_any_median	6.661338147750939e-14
driven_any_min	0.0
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"udem-000-ego0": {"driven_any": 1.0986160316453499e-12, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 9.155133597044477e-16, "deviation-center-line": 0.894883450840673, "driven_lanedir_consec": 0.0}, "udem-000-ego1": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 2.128506051642319, "driven_lanedir_consec": 0.0}, "udem-000-ego2": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 14.481564596168331, "distance-from-start": 0.0, "deviation-center-line": 2.9467758452445567, "driven_lanedir_consec": 0.0}, "udem-000-ego3": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 13.914341154718024, "distance-from-start": 0.0, "deviation-center-line": 0.3377306282649093, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

12088

738

Bea Baselines 🐤

baseline-duckietown-ml

sim-3of4

success

2022-11-18 22:36:50+00:00

2022-11-18 22:38:09+00:00

0:01:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

12084

739

Bea Baselines 🐤

baseline-duckietown-ml

sim-2of4

success

2022-11-18 22:29:11+00:00

2022-11-18 22:36:28+00:00

0:07:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0
deviation-center-line_median	1.9374516435613804

other stats

deviation-center-line_max	3.4683898658648995
deviation-center-line_mean	1.9374516435613804
deviation-center-line_min	0.4065134212578614
deviation-heading_max	40.967332753486225
deviation-heading_mean	29.638380384745684
deviation-heading_median	29.638380384745684
deviation-heading_min	18.309428016005143
distance-from-start_max	1.1102230246251563e-16
distance-from-start_mean	5.551115123125783e-17
distance-from-start_median	5.551115123125783e-17
distance-from-start_min	0.0
driven_any_max	1.3322676295501878e-13
driven_any_mean	6.661338147750939e-14
driven_any_median	6.661338147750939e-14
driven_any_min	0.0
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop2-000-ego0": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 0.4065134212578614, "driven_lanedir_consec": 0.0}, "loop2-000-ego1": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005143, "distance-from-start": 0.0, "deviation-center-line": 3.4683898658648995, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

12077

741

Bea Baselines 🐤

baseline-duckietown-ml

sim-3of4

success

2022-11-18 22:14:26+00:00

2022-11-18 22:28:36+00:00

0:14:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	-1.5805760034126592e-07
deviation-center-line_median	0.4065262312424091

other stats

deviation-center-line_max	0.4065262312424091
deviation-center-line_mean	0.4065262312424091
deviation-center-line_min	0.4065262312424091
deviation-heading_max	40.967334973173536
deviation-heading_mean	40.967334973173536
deviation-heading_median	40.967334973173536
deviation-heading_min	40.967334973173536
distance-from-start_max	0.0
distance-from-start_mean	0.0
distance-from-start_median	0.0
distance-from-start_min	0.0
driven_any_max	0.0
driven_any_mean	0.0
driven_any_median	0.0
driven_any_min	0.0
driven_lanedir_consec_max	-1.5805760034126592e-07
driven_lanedir_consec_mean	-1.5805760034126592e-07
driven_lanedir_consec_min	-1.5805760034126592e-07
driven_lanedir_max	-1.5805760034126592e-07
driven_lanedir_mean	-1.5805760034126592e-07
driven_lanedir_median	-1.5805760034126592e-07
driven_lanedir_min	-1.5805760034126592e-07
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"zigzag-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": -1.5805760034126592e-07, "in-drivable-lane": 0.0, "deviation-heading": 40.967334973173536, "distance-from-start": 0.0, "deviation-center-line": 0.4065262312424091, "driven_lanedir_consec": -1.5805760034126592e-07}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

12074

742

Bea Baselines 🐤

baseline-duckietown-ml

sim-2of4

success

2022-11-18 22:12:42+00:00

2022-11-18 22:14:13+00:00

0:01:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

12051

745

Bea Baselines 🐤

baseline-duckietown-ml

sim-0of4

success