Duckietown Challenges Home Challenges Submissions

Submission 658

Submission658
Competinguser retired
Challengeaido-LF-sim-testing
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 7935 sim-1of4: 7936 sim-2of4: 7918 sim-3of4: 7925
Next
User labeltemplate-pytorch
Admin priority60
Blessingn/a
User priority60

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
7936sim-1of4successno0:12:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.169350910966185
survival_time_median59.99999999999873
deviation-center-line_median2.7343580259477145
in-drivable-lane_median27.14999999999946


other stats
deviation-center-line_max2.7343580259477145
deviation-center-line_mean2.7343580259477145
deviation-center-line_min2.7343580259477145
deviation-heading_max24.84734322970778
deviation-heading_mean24.84734322970778
deviation-heading_median24.84734322970778
deviation-heading_min24.84734322970778
distance-from-start_max0.34630028866539586
distance-from-start_mean0.34630028866539586
distance-from-start_median0.34630028866539586
distance-from-start_min0.34630028866539586
driven_any_max6.5174535732542855
driven_any_mean6.5174535732542855
driven_any_median6.5174535732542855
driven_any_min6.5174535732542855
driven_lanedir_consec_max2.169350910966185
driven_lanedir_consec_mean2.169350910966185
driven_lanedir_consec_min2.169350910966185
driven_lanedir_max2.169350910966185
driven_lanedir_mean2.169350910966185
driven_lanedir_median2.169350910966185
driven_lanedir_min2.169350910966185
in-drivable-lane_max27.14999999999946
in-drivable-lane_mean27.14999999999946
in-drivable-lane_min27.14999999999946
per-episodes
details{"loop2-000-ego0": {"driven_any": 6.5174535732542855, "survival_time": 59.99999999999873, "driven_lanedir": 2.169350910966185, "in-drivable-lane": 27.14999999999946, "deviation-heading": 24.84734322970778, "distance-from-start": 0.34630028866539586, "deviation-center-line": 2.7343580259477145, "driven_lanedir_consec": 2.169350910966185}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7935sim-0of4successno0:15:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.2026837871886924
survival_time_median59.99999999999873
deviation-center-line_median1.7060335831576343
in-drivable-lane_median40.74999999999857


other stats
deviation-center-line_max1.7060335831576343
deviation-center-line_mean1.7060335831576343
deviation-center-line_min1.7060335831576343
deviation-heading_max13.252143447660943
deviation-heading_mean13.252143447660943
deviation-heading_median13.252143447660943
deviation-heading_min13.252143447660943
distance-from-start_max0.4730522844017011
distance-from-start_mean0.4730522844017011
distance-from-start_median0.4730522844017011
distance-from-start_min0.4730522844017011
driven_any_max9.517951389382842
driven_any_mean9.517951389382842
driven_any_median9.517951389382842
driven_any_min9.517951389382842
driven_lanedir_consec_max2.2026837871886924
driven_lanedir_consec_mean2.2026837871886924
driven_lanedir_consec_min2.2026837871886924
driven_lanedir_max2.2026837871886924
driven_lanedir_mean2.2026837871886924
driven_lanedir_median2.2026837871886924
driven_lanedir_min2.2026837871886924
in-drivable-lane_max40.74999999999857
in-drivable-lane_mean40.74999999999857
in-drivable-lane_min40.74999999999857
per-episodes
details{"zigzag-000-ego0": {"driven_any": 9.517951389382842, "survival_time": 59.99999999999873, "driven_lanedir": 2.2026837871886924, "in-drivable-lane": 40.74999999999857, "deviation-heading": 13.252143447660943, "distance-from-start": 0.4730522844017011, "deviation-center-line": 1.7060335831576343, "driven_lanedir_consec": 2.2026837871886924}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7927sim-1of4timeoutno----No reset possible
7926sim-0of4timeoutno----No reset possible
7925sim-3of4successno0:05:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8724808544643783
survival_time_median23.300000000000196
deviation-center-line_median0.4305016267821178
in-drivable-lane_median18.650000000000176


other stats
deviation-center-line_max0.4305016267821178
deviation-center-line_mean0.4305016267821178
deviation-center-line_min0.4305016267821178
deviation-heading_max2.123438787321369
deviation-heading_mean2.123438787321369
deviation-heading_median2.123438787321369
deviation-heading_min2.123438787321369
distance-from-start_max0.7348309202471706
distance-from-start_mean0.7348309202471706
distance-from-start_median0.7348309202471706
distance-from-start_min0.7348309202471706
driven_any_max5.1907218116173555
driven_any_mean5.1907218116173555
driven_any_median5.1907218116173555
driven_any_min5.1907218116173555
driven_lanedir_consec_max0.8724808544643783
driven_lanedir_consec_mean0.8724808544643783
driven_lanedir_consec_min0.8724808544643783
driven_lanedir_max0.8724808544643783
driven_lanedir_mean0.8724808544643783
driven_lanedir_median0.8724808544643783
driven_lanedir_min0.8724808544643783
in-drivable-lane_max18.650000000000176
in-drivable-lane_mean18.650000000000176
in-drivable-lane_min18.650000000000176
per-episodes
details{"autolab-000-ego0": {"driven_any": 5.1907218116173555, "survival_time": 23.300000000000196, "driven_lanedir": 0.8724808544643783, "in-drivable-lane": 18.650000000000176, "deviation-heading": 2.123438787321369, "distance-from-start": 0.7348309202471706, "deviation-center-line": 0.4305016267821178, "driven_lanedir_consec": 0.8724808544643783}}
simulation-passed1
survival_time_max23.300000000000196
survival_time_mean23.300000000000196
survival_time_min23.300000000000196
No reset possible
7918sim-2of4successno0:13:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.220662067510931
survival_time_median59.99999999999873
deviation-center-line_median2.125084445369512
in-drivable-lane_median31.149999999999206


other stats
deviation-center-line_max2.125084445369512
deviation-center-line_mean2.125084445369512
deviation-center-line_min2.125084445369512
deviation-heading_max22.556685205274864
deviation-heading_mean22.556685205274864
deviation-heading_median22.556685205274864
deviation-heading_min22.556685205274864
distance-from-start_max0.3543982170259767
distance-from-start_mean0.3543982170259767
distance-from-start_median0.3543982170259767
distance-from-start_min0.3543982170259767
driven_any_max8.34101223394159
driven_any_mean8.34101223394159
driven_any_median8.34101223394159
driven_any_min8.34101223394159
driven_lanedir_consec_max2.220662067510931
driven_lanedir_consec_mean2.220662067510931
driven_lanedir_consec_min2.220662067510931
driven_lanedir_max2.3516898481938826
driven_lanedir_mean2.3516898481938826
driven_lanedir_median2.3516898481938826
driven_lanedir_min2.3516898481938826
in-drivable-lane_max31.149999999999206
in-drivable-lane_mean31.149999999999206
in-drivable-lane_min31.149999999999206
per-episodes
details{"loop-000-ego0": {"driven_any": 8.34101223394159, "survival_time": 59.99999999999873, "driven_lanedir": 2.3516898481938826, "in-drivable-lane": 31.149999999999206, "deviation-heading": 22.556685205274864, "distance-from-start": 0.3543982170259767, "deviation-center-line": 2.125084445369512, "driven_lanedir_consec": 2.220662067510931}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7688sim-1of4host-errorno0:00:24
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davincistage-04-job7688-416505, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davincistage-04-job7688-416505', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7681sim-0of4host-errorno0:00:24
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davincistage-04-job7681-526355, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davincistage-04-job7681-526355', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7676sim-3of4host-errorno0:00:24
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davincistage-04-job7676-734842, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davincistage-04-job7676-734842', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7675sim-2of4host-errorno0:01:07
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davincistage-04-job7675-34787, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davincistage-04-job7675-34787', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7673sim-1of4host-errorno0:01:07
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davincistage-01-job7673-641339, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davincistage-01-job7673-641339', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7668sim-0of4host-errorno0:00:24
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davincistage-02-job7668-866555, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davincistage-02-job7668-866555', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7667sim-1of4host-errorno0:00:23
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davincistage-05-job7667-193413, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davincistage-05-job7667-193413', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7665sim-3of4host-errorno0:00:23
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davincistage-02-job7665-424406, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davincistage-02-job7665-424406', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7663sim-0of4host-errorno0:00:24
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davincistage-05-job7663-120570, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davincistage-05-job7663-120570', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7662sim-1of4host-errorno0:00:23
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davincistage-03-job7662-112636, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davincistage-03-job7662-112636', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7661sim-2of4host-errorno0:00:24
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davincistage-02-job7661-754403, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davincistage-02-job7661-754403', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7658sim-3of4host-errorno0:00:23
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davincistage-05-job7658-141054, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davincistage-05-job7658-141054', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7657sim-0of4host-errorno0:00:23
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davincistage-03-job7657-271888, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davincistage-03-job7657-271888', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7656sim-1of4host-errorno0:00:23
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davincistage-02-job7656-55357, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davincistage-02-job7656-55357', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7654sim-3of4host-errorno0:00:24
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davincistage-03-job7654-771248, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davincistage-03-job7654-771248', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7653sim-0of4host-errorno0:00:23
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davincistage-01-job7653-122868, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davincistage-01-job7653-122868', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7652sim-2of4host-errorno0:00:23
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davincistage-05-job7652-363404, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davincistage-05-job7652-363404', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7647sim-3of4host-errorno0:00:23
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davincistage-01-job7647-916656, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davincistage-01-job7647-916656', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7644sim-2of4host-errorno0:00:23
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davincistage-01-job7644-284931, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davincistage-01-job7644-284931', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7559sim-2of4host-errorno0:00:48
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davincistage-03-job7559-768761, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davincistage-03-job7559-768761', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7529sim-0of4timeoutno----No reset possible
7528sim-2of4failedno0:01:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6290sim-2of4successno0:05:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6289sim-3of4successno0:03:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6288sim-0of4successno0:04:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6287sim-1of4successno0:02:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5548sim-3of4successno0:06:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5547sim-1of4successno0:02:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5546sim-0of4successno0:04:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5545sim-2of4successno0:05:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible