Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 8082882Bea Baselines template-random aido-LFV-sim-validationsim-2of4 timeout no Archimede-stage-052022-11-16 16:26:09+00:00 - - - - No reset possible 8078883Bea Baselines template-tensorflow aido-LFV-sim-validationsim-0of4 failed no Archimede-stage-052022-11-16 16:23:31+00:00 2022-11-16 16:25:54+00:00 0:02:23 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 8077884Bea Baselines template-ros aido-LF-sim-validationsim-0of4 success no Archimede-stage-052022-11-16 16:21:32+00:00 2022-11-16 16:23:25+00:00 0:01:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.1222585525136548 survival_time_median 2.849999999999998 deviation-center-line_median 0.05363302581302847 in-drivable-lane_median 1.7999999999999976
other stats deviation-center-line_max 0.05363302581302847 deviation-center-line_mean 0.05363302581302847 deviation-center-line_min 0.05363302581302847 deviation-heading_max 0.7208702634839985 deviation-heading_mean 0.7208702634839985 deviation-heading_median 0.7208702634839985 deviation-heading_min 0.7208702634839985 distance-from-start_max 0.538024471859989 distance-from-start_mean 0.538024471859989 distance-from-start_median 0.538024471859989 distance-from-start_min 0.538024471859989 driven_any_max 0.5504996489360943 driven_any_mean 0.5504996489360943 driven_any_median 0.5504996489360943 driven_any_min 0.5504996489360943 driven_lanedir_consec_max 0.1222585525136548 driven_lanedir_consec_mean 0.1222585525136548 driven_lanedir_consec_min 0.1222585525136548 driven_lanedir_max 0.1222585525136548 driven_lanedir_mean 0.1222585525136548 driven_lanedir_median 0.1222585525136548 driven_lanedir_min 0.1222585525136548 in-drivable-lane_max 1.7999999999999976 in-drivable-lane_mean 1.7999999999999976 in-drivable-lane_min 1.7999999999999976 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.5504996489360943, "survival_time": 2.849999999999998, "driven_lanedir": 0.1222585525136548, "in-drivable-lane": 1.7999999999999976, "deviation-heading": 0.7208702634839985, "distance-from-start": 0.538024471859989, "deviation-center-line": 0.05363302581302847, "driven_lanedir_consec": 0.1222585525136548}}simulation-passed 1 survival_time_max 2.849999999999998 survival_time_mean 2.849999999999998 survival_time_min 2.849999999999998
No reset possible 8072859Bea Baselines baseline-duckietown aido-LF-sim-validationsim-1of4 failed no Archimede-stage-052022-11-16 16:20:09+00:00 2022-11-16 16:21:19+00:00 0:01:10 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 8069684Bea Baselines baseline-simple-yield aido-LFV_multi-state-sim-testingsim-3of4 aborted no Archimede-stage-052022-11-16 16:18:53+00:00 2022-11-16 16:20:03+00:00 0:01:10 KeyboardInterrupt:
T [...] KeyboardInterrupt:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1264, in run_one
heartbeat()
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 711, in heartbeat
raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 8065685Bea Baselines baseline-simple-yield aido-LFV-state-sim-validationsim-3of4 aborted no Archimede-stage-052022-11-16 16:16:30+00:00 2022-11-16 16:18:28+00:00 0:01:58 KeyboardInterrupt:
T [...] KeyboardInterrupt:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1264, in run_one
heartbeat()
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 711, in heartbeat
raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 8059686Bea Baselines baseline-simple-yield aido-LFV-state-sim-testingsim-1of4 success no Archimede-stage-052022-11-16 16:07:32+00:00 2022-11-16 16:16:12+00:00 0:08:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.430697445349635 deviation-center-line_median 1.3632212017460543
other stats deviation-center-line_max 1.3632212017460543 deviation-center-line_mean 1.3632212017460543 deviation-center-line_min 1.3632212017460543 deviation-heading_max 3.4674916384002348 deviation-heading_mean 3.4674916384002348 deviation-heading_median 3.4674916384002348 deviation-heading_min 3.4674916384002348 distance-from-start_max 1.056278903546915 distance-from-start_mean 1.056278903546915 distance-from-start_median 1.056278903546915 distance-from-start_min 1.056278903546915 driven_any_max 1.4438891656636457 driven_any_mean 1.4438891656636457 driven_any_median 1.4438891656636457 driven_any_min 1.4438891656636457 driven_lanedir_consec_max 1.430697445349635 driven_lanedir_consec_mean 1.430697445349635 driven_lanedir_consec_min 1.430697445349635 driven_lanedir_max 1.430697445349635 driven_lanedir_mean 1.430697445349635 driven_lanedir_median 1.430697445349635 driven_lanedir_min 1.430697445349635 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 1.4438891656636457, "survival_time": 59.99999999999873, "driven_lanedir": 1.430697445349635, "in-drivable-lane": 0.0, "deviation-heading": 3.4674916384002348, "distance-from-start": 1.056278903546915, "deviation-center-line": 1.3632212017460543, "driven_lanedir_consec": 1.430697445349635}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 8053717Bea Baselines minimal-agent-state aido-LF-state-sim-validationsim-3of4 success no Archimede-stage-052022-11-16 16:00:30+00:00 2022-11-16 16:07:14+00:00 0:06:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.449999999999882 driven_lanedir_consec_median 3.2733415499402216 deviation-center-line_median 5.928861946292094
other stats deviation-center-line_max 5.928861946292094 deviation-center-line_mean 5.928861946292094 deviation-center-line_min 5.928861946292094 deviation-heading_max 8.566643949098404 deviation-heading_mean 8.566643949098404 deviation-heading_median 8.566643949098404 deviation-heading_min 8.566643949098404 distance-from-start_max 2.0613975346450584 distance-from-start_mean 2.0613975346450584 distance-from-start_median 2.0613975346450584 distance-from-start_min 2.0613975346450584 driven_any_max 3.476087222739478 driven_any_mean 3.476087222739478 driven_any_median 3.476087222739478 driven_any_min 3.476087222739478 driven_lanedir_consec_max 3.2733415499402216 driven_lanedir_consec_mean 3.2733415499402216 driven_lanedir_consec_min 3.2733415499402216 driven_lanedir_max 3.2733415499402216 driven_lanedir_mean 3.2733415499402216 driven_lanedir_median 3.2733415499402216 driven_lanedir_min 3.2733415499402216 in-drivable-lane_max 3.449999999999882 in-drivable-lane_mean 3.449999999999882 in-drivable-lane_min 3.449999999999882 per-episodes details {"autolab-000-ego0": {"driven_any": 3.476087222739478, "survival_time": 59.99999999999873, "driven_lanedir": 3.2733415499402216, "in-drivable-lane": 3.449999999999882, "deviation-heading": 8.566643949098404, "distance-from-start": 2.0613975346450584, "deviation-center-line": 5.928861946292094, "driven_lanedir_consec": 3.2733415499402216}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 8047718Bea Baselines minimal-agent-state aido-LFI-state-sim-validationsim-0of4 success no Archimede-stage-052022-11-16 15:53:26+00:00 2022-11-16 15:59:59+00:00 0:06:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 49.9999999999993 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.896613480343736 deviation-center-line_median 3.803331835325445
other stats deviation-center-line_max 3.803331835325445 deviation-center-line_mean 3.803331835325445 deviation-center-line_min 3.803331835325445 deviation-heading_max 4.074858735633439 deviation-heading_mean 4.074858735633439 deviation-heading_median 4.074858735633439 deviation-heading_min 4.074858735633439 distance-from-start_max 1.5745533994883223 distance-from-start_mean 1.5745533994883223 distance-from-start_median 1.5745533994883223 distance-from-start_min 1.5745533994883223 driven_any_max 2.9375948144938064 driven_any_mean 2.9375948144938064 driven_any_median 2.9375948144938064 driven_any_min 2.9375948144938064 driven_lanedir_consec_max 2.896613480343736 driven_lanedir_consec_mean 2.896613480343736 driven_lanedir_consec_min 2.896613480343736 driven_lanedir_max 2.916242248729218 driven_lanedir_mean 2.916242248729218 driven_lanedir_median 2.916242248729218 driven_lanedir_min 2.916242248729218 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem1-000-ego0": {"driven_any": 2.9375948144938064, "survival_time": 49.9999999999993, "driven_lanedir": 2.916242248729218, "in-drivable-lane": 0.0, "deviation-heading": 4.074858735633439, "distance-from-start": 1.5745533994883223, "deviation-center-line": 3.803331835325445, "driven_lanedir_consec": 2.896613480343736}}simulation-passed 1 survival_time_max 49.9999999999993 survival_time_mean 49.9999999999993 survival_time_min 49.9999999999993
No reset possible 8046718Bea Baselines minimal-agent-state aido-LFI-state-sim-validationsim-2of4 success no Archimede-stage-052022-11-16 15:51:27+00:00 2022-11-16 15:53:12+00:00 0:01:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 8041720Bea Baselines minimal-agent-state aido-LFVI-state-sim-validationsim-2of4 success no Archimede-stage-052022-11-16 15:36:27+00:00 2022-11-16 15:51:21+00:00 0:14:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.2000000000000313 driven_lanedir_consec_median 3.071963528587166 deviation-center-line_median 2.512752254009333
other stats deviation-center-line_max 2.512752254009333 deviation-center-line_mean 2.512752254009333 deviation-center-line_min 2.512752254009333 deviation-heading_max 5.806435104216709 deviation-heading_mean 5.806435104216709 deviation-heading_median 5.806435104216709 deviation-heading_min 5.806435104216709 distance-from-start_max 2.5580188445183163 distance-from-start_mean 2.5580188445183163 distance-from-start_median 2.5580188445183163 distance-from-start_min 2.5580188445183163 driven_any_max 3.5135741911347673 driven_any_mean 3.5135741911347673 driven_any_median 3.5135741911347673 driven_any_min 3.5135741911347673 driven_lanedir_consec_max 3.071963528587166 driven_lanedir_consec_mean 3.071963528587166 driven_lanedir_consec_min 3.071963528587166 driven_lanedir_max 3.377198685996822 driven_lanedir_mean 3.377198685996822 driven_lanedir_median 3.377198685996822 driven_lanedir_min 3.377198685996822 in-drivable-lane_max 2.2000000000000313 in-drivable-lane_mean 2.2000000000000313 in-drivable-lane_min 2.2000000000000313 per-episodes details {"4way-001-ego0": {"driven_any": 3.5135741911347673, "survival_time": 59.99999999999873, "driven_lanedir": 3.377198685996822, "in-drivable-lane": 2.2000000000000313, "deviation-heading": 5.806435104216709, "distance-from-start": 2.5580188445183163, "deviation-center-line": 2.512752254009333, "driven_lanedir_consec": 3.071963528587166}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 8035721Bea Baselines minimal-agent-state aido-LFV_multi-state-sim-validation347 success yes Archimede-stage-052022-11-16 15:25:27+00:00 2022-11-16 15:35:57+00:00 0:10:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.2749999999998938 driven_lanedir_consec_median 2.7120051214998897 deviation-center-line_median 6.830233665514818
other stats deviation-center-line_max 7.154226729483074 deviation-center-line_mean 6.80468016793723 deviation-center-line_min 6.404026611236209 deviation-heading_max 8.100880505602532 deviation-heading_mean 5.9731680892918515 deviation-heading_median 5.501308317705954 deviation-heading_min 4.789175216152964 distance-from-start_max 2.4160153980396744 distance-from-start_mean 1.6093143701035804 distance-from-start_median 1.5660334941622691 distance-from-start_min 0.8891750940501092 driven_any_max 3.519587859797628 driven_any_mean 3.4828384673822983 driven_any_median 3.481341572069042 driven_any_min 3.4490828655934807 driven_lanedir_consec_max 3.3303389838909694 driven_lanedir_consec_mean 2.6711178717712896 driven_lanedir_consec_min 1.9301222601944088 driven_lanedir_max 3.3876166768750724 driven_lanedir_mean 3.3082911459990787 driven_lanedir_median 3.318066301460249 driven_lanedir_min 3.2094153042007436 in-drivable-lane_max 4.349999999999898 in-drivable-lane_mean 3.2249999999999286 in-drivable-lane_min 2.0000000000000284 per-episodes details {"loop-000-ego0": {"driven_any": 3.476091095800351, "survival_time": 59.99999999999873, "driven_lanedir": 3.305793619029529, "in-drivable-lane": 3.449999999999882, "deviation-heading": 5.348097215753208, "distance-from-start": 1.6303675548965662, "deviation-center-line": 7.154226729483074, "driven_lanedir_consec": 3.305793619029529}, "loop-000-ego1": {"driven_any": 3.486592048337733, "survival_time": 59.99999999999873, "driven_lanedir": 3.3303389838909694, "in-drivable-lane": 3.0999999999999055, "deviation-heading": 4.789175216152964, "distance-from-start": 2.4160153980396744, "deviation-center-line": 6.918889908889863, "driven_lanedir_consec": 3.3303389838909694}, "loop-000-ego2": {"driven_any": 3.4490828655934807, "survival_time": 59.99999999999873, "driven_lanedir": 3.2094153042007436, "in-drivable-lane": 4.349999999999898, "deviation-heading": 8.100880505602532, "distance-from-start": 0.8891750940501092, "deviation-center-line": 6.404026611236209, "driven_lanedir_consec": 1.9301222601944088}, "loop-000-ego3": {"driven_any": 3.519587859797628, "survival_time": 59.99999999999873, "driven_lanedir": 3.3876166768750724, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.6545194196587, "distance-from-start": 1.501699433427972, "deviation-center-line": 6.741577422139774, "driven_lanedir_consec": 2.118216623970251}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 8030723Bea Baselines minimal-agent-state aido-LF-state-sim-testingsim-2of4 success no Archimede-stage-052022-11-16 15:19:01+00:00 2022-11-16 15:25:00+00:00 0:05:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.9999999999998863 driven_lanedir_consec_median 2.473415461150899 deviation-center-line_median 4.480730090517859
other stats deviation-center-line_max 4.480730090517859 deviation-center-line_mean 4.480730090517859 deviation-center-line_min 4.480730090517859 deviation-heading_max 5.392506205579318 deviation-heading_mean 5.392506205579318 deviation-heading_median 5.392506205579318 deviation-heading_min 5.392506205579318 distance-from-start_max 2.560788584180152 distance-from-start_mean 2.560788584180152 distance-from-start_median 2.560788584180152 distance-from-start_min 2.560788584180152 driven_any_max 3.5195876711084515 driven_any_mean 3.5195876711084515 driven_any_median 3.5195876711084515 driven_any_min 3.5195876711084515 driven_lanedir_consec_max 2.473415461150899 driven_lanedir_consec_mean 2.473415461150899 driven_lanedir_consec_min 2.473415461150899 driven_lanedir_max 3.3877310799883045 driven_lanedir_mean 3.3877310799883045 driven_lanedir_median 3.3877310799883045 driven_lanedir_min 3.3877310799883045 in-drivable-lane_max 1.9999999999998863 in-drivable-lane_mean 1.9999999999998863 in-drivable-lane_min 1.9999999999998863 per-episodes details {"loop-000-ego0": {"driven_any": 3.5195876711084515, "survival_time": 59.99999999999873, "driven_lanedir": 3.3877310799883045, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 5.392506205579318, "distance-from-start": 2.560788584180152, "deviation-center-line": 4.480730090517859, "driven_lanedir_consec": 2.473415461150899}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 8021725Bea Baselines minimal-agent-state aido-LFVI_multi-state-sim-testingsim-0of4 success no Archimede-stage-052022-11-16 15:05:27+00:00 2022-11-16 15:18:48+00:00 0:13:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.2750000000000039 driven_lanedir_consec_median 2.262131919675945 deviation-center-line_median 5.455124522615245
other stats deviation-center-line_max 6.7300715437478855 deviation-center-line_mean 5.3635565360613775 deviation-center-line_min 3.813905555267136 deviation-heading_max 5.3983743853383945 deviation-heading_mean 3.4911759425984905 deviation-heading_median 3.07767800196266 deviation-heading_min 2.410973381130247 distance-from-start_max 2.360894719860589 distance-from-start_mean 1.8716522432553409 distance-from-start_median 1.8806284295076048 distance-from-start_min 1.3644573941455638 driven_any_max 3.5795955917544093 driven_any_mean 2.9138699780921904 driven_any_median 3.1653932899370343 driven_any_min 1.7450977407402837 driven_lanedir_consec_max 3.541618605157515 driven_lanedir_consec_mean 2.4016269078719064 driven_lanedir_consec_min 1.5406251869782224 driven_lanedir_max 3.563713641222294 driven_lanedir_mean 2.855153952462502 driven_lanedir_median 3.07574944121028 driven_lanedir_min 1.705403286207151 in-drivable-lane_max 2.9499999999999744 in-drivable-lane_mean 0.8749999999999956 in-drivable-lane_min 0.0 per-episodes details {"udem-001-ego0": {"driven_any": 3.5795955917544093, "survival_time": 59.99999999999873, "driven_lanedir": 3.563713641222294, "in-drivable-lane": 0.0, "deviation-heading": 3.273156332509081, "distance-from-start": 2.360894719860589, "deviation-center-line": 3.813905555267136, "driven_lanedir_consec": 3.541618605157515}, "udem-001-ego1": {"driven_any": 1.7450977407402837, "survival_time": 59.99999999999873, "driven_lanedir": 1.705403286207151, "in-drivable-lane": 0.5500000000000078, "deviation-heading": 2.8821996714162395, "distance-from-start": 1.3644573941455638, "deviation-center-line": 6.7300715437478855, "driven_lanedir_consec": 1.705403286207151}, "udem-001-ego2": {"driven_any": 2.8295986786832685, "survival_time": 59.99999999999873, "driven_lanedir": 2.8188609314796964, "in-drivable-lane": 0.0, "deviation-heading": 2.410973381130247, "distance-from-start": 2.339528240955182, "deviation-center-line": 5.461686105791655, "driven_lanedir_consec": 2.8188605531447384}, "udem-001-ego3": {"driven_any": 3.5011879011907996, "survival_time": 59.99999999999873, "driven_lanedir": 3.332637950940863, "in-drivable-lane": 2.9499999999999744, "deviation-heading": 5.3983743853383945, "distance-from-start": 1.4217286180600277, "deviation-center-line": 5.448562939438835, "driven_lanedir_consec": 1.5406251869782224}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 8014726Bea Baselines minimal-agent-state aido-LFVI-state-sim-testingsim-1of4 success no Archimede-stage-052022-11-16 14:49:06+00:00 2022-11-16 15:05:07+00:00 0:16:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.249999999999958 driven_lanedir_consec_median 2.1867953802193223 deviation-center-line_median 5.754559345397287
other stats deviation-center-line_max 5.754559345397287 deviation-center-line_mean 5.754559345397287 deviation-center-line_min 5.754559345397287 deviation-heading_max 6.230350249067265 deviation-heading_mean 6.230350249067265 deviation-heading_median 6.230350249067265 deviation-heading_min 6.230350249067265 distance-from-start_max 1.6297927598005355 distance-from-start_mean 1.6297927598005355 distance-from-start_median 1.6297927598005355 distance-from-start_min 1.6297927598005355 driven_any_max 3.483691022689803 driven_any_mean 3.483691022689803 driven_any_median 3.483691022689803 driven_any_min 3.483691022689803 driven_lanedir_consec_max 2.1867953802193223 driven_lanedir_consec_mean 2.1867953802193223 driven_lanedir_consec_min 2.1867953802193223 driven_lanedir_max 3.299171294544686 driven_lanedir_mean 3.299171294544686 driven_lanedir_median 3.299171294544686 driven_lanedir_min 3.299171294544686 in-drivable-lane_max 3.249999999999958 in-drivable-lane_mean 3.249999999999958 in-drivable-lane_min 3.249999999999958 per-episodes details {"4way-000-ego0": {"driven_any": 3.483691022689803, "survival_time": 59.99999999999873, "driven_lanedir": 3.299171294544686, "in-drivable-lane": 3.249999999999958, "deviation-heading": 6.230350249067265, "distance-from-start": 1.6297927598005355, "deviation-center-line": 5.754559345397287, "driven_lanedir_consec": 2.1867953802193223}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 8008728Bea Baselines minimal-agent-state aido-LFV-state-sim-validationsim-3of4 success no Archimede-stage-052022-11-16 14:31:40+00:00 2022-11-16 14:48:46+00:00 0:17:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.1000000000000156 driven_lanedir_consec_median 3.4856553667756276 deviation-center-line_median 7.514935459300193
other stats deviation-center-line_max 7.514935459300193 deviation-center-line_mean 7.514935459300193 deviation-center-line_min 7.514935459300193 deviation-heading_max 2.919831925964245 deviation-heading_mean 2.919831925964245 deviation-heading_median 2.919831925964245 deviation-heading_min 2.919831925964245 distance-from-start_max 2.8766441843859063 distance-from-start_mean 2.8766441843859063 distance-from-start_median 2.8766441843859063 distance-from-start_min 2.8766441843859063 driven_any_max 3.5465963271066645 driven_any_mean 3.5465963271066645 driven_any_median 3.5465963271066645 driven_any_min 3.5465963271066645 driven_lanedir_consec_max 3.4856553667756276 driven_lanedir_consec_mean 3.4856553667756276 driven_lanedir_consec_min 3.4856553667756276 driven_lanedir_max 3.4856553667756276 driven_lanedir_mean 3.4856553667756276 driven_lanedir_median 3.4856553667756276 driven_lanedir_min 3.4856553667756276 in-drivable-lane_max 1.1000000000000156 in-drivable-lane_mean 1.1000000000000156 in-drivable-lane_min 1.1000000000000156 per-episodes details {"autolab-000-ego0": {"driven_any": 3.5465963271066645, "survival_time": 59.99999999999873, "driven_lanedir": 3.4856553667756276, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.919831925964245, "distance-from-start": 2.8766441843859063, "deviation-center-line": 7.514935459300193, "driven_lanedir_consec": 3.4856553667756276}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 8006728Bea Baselines minimal-agent-state aido-LFV-state-sim-validationsim-0of4 success no Archimede-stage-052022-11-16 14:27:04+00:00 2022-11-16 14:31:28+00:00 0:04:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 21.600000000000172 in-drivable-lane_median 1.0000000000000142 driven_lanedir_consec_median 1.099034250610479 deviation-center-line_median 1.828958616897794
other stats deviation-center-line_max 1.828958616897794 deviation-center-line_mean 1.828958616897794 deviation-center-line_min 1.828958616897794 deviation-heading_max 5.113647296393216 deviation-heading_mean 5.113647296393216 deviation-heading_median 5.113647296393216 deviation-heading_min 5.113647296393216 distance-from-start_max 1.0166726694302697 distance-from-start_mean 1.0166726694302697 distance-from-start_median 1.0166726694302697 distance-from-start_min 1.0166726694302697 driven_any_max 1.203590732794792 driven_any_mean 1.203590732794792 driven_any_median 1.203590732794792 driven_any_min 1.203590732794792 driven_lanedir_consec_max 1.099034250610479 driven_lanedir_consec_mean 1.099034250610479 driven_lanedir_consec_min 1.099034250610479 driven_lanedir_max 1.099034250610479 driven_lanedir_mean 1.099034250610479 driven_lanedir_median 1.099034250610479 driven_lanedir_min 1.099034250610479 in-drivable-lane_max 1.0000000000000142 in-drivable-lane_mean 1.0000000000000142 in-drivable-lane_min 1.0000000000000142 per-episodes details {"zigzag-000-ego0": {"driven_any": 1.203590732794792, "survival_time": 21.600000000000172, "driven_lanedir": 1.099034250610479, "in-drivable-lane": 1.0000000000000142, "deviation-heading": 5.113647296393216, "distance-from-start": 1.0166726694302697, "deviation-center-line": 1.828958616897794, "driven_lanedir_consec": 1.099034250610479}}simulation-passed 1 survival_time_max 21.600000000000172 survival_time_mean 21.600000000000172 survival_time_min 21.600000000000172
No reset possible 8000730Bea Baselines minimal-agent-state aido-LFP-state-sim-testingsim-2of4 success no Archimede-stage-052022-11-16 14:19:03+00:00 2022-11-16 14:26:34+00:00 0:07:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.561518622663447 deviation-center-line_median 5.531013187213146
other stats deviation-center-line_max 5.531013187213146 deviation-center-line_mean 5.531013187213146 deviation-center-line_min 5.531013187213146 deviation-heading_max 3.0854172892341407 deviation-heading_mean 3.0854172892341407 deviation-heading_median 3.0854172892341407 deviation-heading_min 3.0854172892341407 distance-from-start_max 2.710829099159626 distance-from-start_mean 2.710829099159626 distance-from-start_median 2.710829099159626 distance-from-start_min 2.710829099159626 driven_any_max 3.579597577249643 driven_any_mean 3.579597577249643 driven_any_median 3.579597577249643 driven_any_min 3.579597577249643 driven_lanedir_consec_max 3.561518622663447 driven_lanedir_consec_mean 3.561518622663447 driven_lanedir_consec_min 3.561518622663447 driven_lanedir_max 3.561518622663447 driven_lanedir_mean 3.561518622663447 driven_lanedir_median 3.561518622663447 driven_lanedir_min 3.561518622663447 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 3.579597577249643, "survival_time": 59.99999999999873, "driven_lanedir": 3.561518622663447, "in-drivable-lane": 0.0, "deviation-heading": 3.0854172892341407, "distance-from-start": 2.710829099159626, "deviation-center-line": 5.531013187213146, "driven_lanedir_consec": 3.561518622663447}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7995689Bea Baselines minimal-agent aido-LFV_multi-sim-validationsim-2of4 success no Archimede-stage-052022-11-16 14:14:04+00:00 2022-11-16 14:18:49+00:00 0:04:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.699999999999989 in-drivable-lane_median 5.124999999999994 driven_lanedir_consec_median 0.35349804731099377 deviation-center-line_median 0.31473998602887027
other stats deviation-center-line_max 1.1167880744605874 deviation-center-line_mean 0.4679858397762912 deviation-center-line_min 0.1256753125868369 deviation-heading_max 2.483401077484429 deviation-heading_mean 1.5968641802865526 deviation-heading_median 1.5781230863572222 deviation-heading_min 0.7478094709473373 distance-from-start_max 1.2661028531770373 distance-from-start_mean 0.9500582944506708 distance-from-start_median 1.005518330603856 distance-from-start_min 0.5230936634179336 driven_any_max 1.2661876874339204 driven_any_mean 0.9501035001353008 driven_any_median 1.005560934651159 driven_any_min 0.5231044438049649 driven_lanedir_consec_max 0.7375228777212411 driven_lanedir_consec_mean 0.401053826044482 driven_lanedir_consec_min 0.1596963318346993 driven_lanedir_max 0.7375228777212411 driven_lanedir_mean 0.401053826044482 driven_lanedir_median 0.35349804731099377 driven_lanedir_min 0.1596963318346993 in-drivable-lane_max 7.2499999999999885 in-drivable-lane_mean 4.374999999999994 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 0.934745168289438, "survival_time": 8.699999999999989, "driven_lanedir": 0.19955005044909324, "in-drivable-lane": 6.949999999999988, "deviation-heading": 0.948821955558047, "distance-from-start": 0.9347143740565927, "deviation-center-line": 0.1256753125868369, "driven_lanedir_consec": 0.19955005044909324}, "loop-000-ego1": {"driven_any": 1.2661876874339204, "survival_time": 8.699999999999989, "driven_lanedir": 0.1596963318346993, "in-drivable-lane": 7.2499999999999885, "deviation-heading": 0.7478094709473373, "distance-from-start": 1.2661028531770373, "deviation-center-line": 0.13562491077820027, "driven_lanedir_consec": 0.1596963318346993}, "loop-000-ego2": {"driven_any": 0.5231044438049649, "survival_time": 8.699999999999989, "driven_lanedir": 0.5074460441728943, "in-drivable-lane": 0.0, "deviation-heading": 2.483401077484429, "distance-from-start": 0.5230936634179336, "deviation-center-line": 1.1167880744605874, "driven_lanedir_consec": 0.5074460441728943}, "loop-000-ego3": {"driven_any": 1.0763767010128795, "survival_time": 8.699999999999989, "driven_lanedir": 0.7375228777212411, "in-drivable-lane": 3.3, "deviation-heading": 2.207424217156398, "distance-from-start": 1.076322287151119, "deviation-center-line": 0.49385506127954026, "driven_lanedir_consec": 0.7375228777212411}}simulation-passed 1 survival_time_max 8.699999999999989 survival_time_mean 8.699999999999989 survival_time_min 8.699999999999989
No reset possible 7988691Bea Baselines minimal-agent aido-LFV-sim-validationsim-2of4 success no Archimede-stage-052022-11-16 14:10:43+00:00 2022-11-16 14:13:50+00:00 0:03:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.1999999999999895 in-drivable-lane_median 3.4499999999999886 driven_lanedir_consec_median 0.19955005044909324 deviation-center-line_median 0.1256751612689787
other stats deviation-center-line_max 0.1256751612689787 deviation-center-line_mean 0.1256751612689787 deviation-center-line_min 0.1256751612689787 deviation-heading_max 0.9488219555580464 deviation-heading_mean 0.9488219555580464 deviation-heading_median 0.9488219555580464 deviation-heading_min 0.9488219555580464 distance-from-start_max 0.6897423373168144 distance-from-start_mean 0.6897423373168144 distance-from-start_median 0.6897423373168144 distance-from-start_min 0.6897423373168144 driven_any_max 0.6897540728183473 driven_any_mean 0.6897540728183473 driven_any_median 0.6897540728183473 driven_any_min 0.6897540728183473 driven_lanedir_consec_max 0.19955005044909324 driven_lanedir_consec_mean 0.19955005044909324 driven_lanedir_consec_min 0.19955005044909324 driven_lanedir_max 0.19955005044909324 driven_lanedir_mean 0.19955005044909324 driven_lanedir_median 0.19955005044909324 driven_lanedir_min 0.19955005044909324 in-drivable-lane_max 3.4499999999999886 in-drivable-lane_mean 3.4499999999999886 in-drivable-lane_min 3.4499999999999886 per-episodes details {"loop-000-ego0": {"driven_any": 0.6897540728183473, "survival_time": 5.1999999999999895, "driven_lanedir": 0.19955005044909324, "in-drivable-lane": 3.4499999999999886, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.6897423373168144, "deviation-center-line": 0.1256751612689787, "driven_lanedir_consec": 0.19955005044909324}}simulation-passed 1 survival_time_max 5.1999999999999895 survival_time_mean 5.1999999999999895 survival_time_min 5.1999999999999895
No reset possible 7983692Bea Baselines minimal-agent aido-LFVI-sim-validationsim-1of4 success no Archimede-stage-052022-11-16 14:07:31+00:00 2022-11-16 14:10:17+00:00 0:02:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.8999999999999977 in-drivable-lane_median 1.1499999999999968 driven_lanedir_consec_median 0.1995526730534967 deviation-center-line_median 0.12567538416105967
other stats deviation-center-line_max 0.12567538416105967 deviation-center-line_mean 0.12567538416105967 deviation-center-line_min 0.12567538416105967 deviation-heading_max 0.9488219555580472 deviation-heading_mean 0.9488219555580472 deviation-heading_median 0.9488219555580472 deviation-heading_min 0.9488219555580472 distance-from-start_max 0.30742487448707223 distance-from-start_mean 0.30742487448707223 distance-from-start_median 0.30742487448707223 distance-from-start_min 0.30742487448707223 driven_any_max 0.3074291281738757 driven_any_mean 0.3074291281738757 driven_any_median 0.3074291281738757 driven_any_min 0.3074291281738757 driven_lanedir_consec_max 0.1995526730534967 driven_lanedir_consec_mean 0.1995526730534967 driven_lanedir_consec_min 0.1995526730534967 driven_lanedir_max 0.1995526730534967 driven_lanedir_mean 0.1995526730534967 driven_lanedir_median 0.1995526730534967 driven_lanedir_min 0.1995526730534967 in-drivable-lane_max 1.1499999999999968 in-drivable-lane_mean 1.1499999999999968 in-drivable-lane_min 1.1499999999999968 per-episodes details {"udem-000-ego0": {"driven_any": 0.3074291281738757, "survival_time": 2.8999999999999977, "driven_lanedir": 0.1995526730534967, "in-drivable-lane": 1.1499999999999968, "deviation-heading": 0.9488219555580472, "distance-from-start": 0.30742487448707223, "deviation-center-line": 0.12567538416105967, "driven_lanedir_consec": 0.1995526730534967}}simulation-passed 1 survival_time_max 2.8999999999999977 survival_time_mean 2.8999999999999977 survival_time_min 2.8999999999999977
No reset possible 7979693Bea Baselines minimal-agent aido-LFI-sim-validationsim-3of4 success no Archimede-stage-052022-11-16 14:05:27+00:00 2022-11-16 14:07:17+00:00 0:01:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 7975694Bea Baselines minimal-agent aido-LF-sim-validationsim-2of4 success no Archimede-stage-052022-11-16 14:03:15+00:00 2022-11-16 14:05:06+00:00 0:01:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.1969461716091996 survival_time_median 6.199999999999986 deviation-center-line_median 0.1253905569777337 in-drivable-lane_median 4.449999999999985
other stats deviation-center-line_max 0.1253905569777337 deviation-center-line_mean 0.1253905569777337 deviation-center-line_min 0.1253905569777337 deviation-heading_max 0.9520924629376066 deviation-heading_mean 0.9520924629376066 deviation-heading_median 0.9520924629376066 deviation-heading_min 0.9520924629376066 distance-from-start_max 0.8501561575907521 distance-from-start_mean 0.8501561575907521 distance-from-start_median 0.8501561575907521 distance-from-start_min 0.8501561575907521 driven_any_max 0.850290234272033 driven_any_mean 0.850290234272033 driven_any_median 0.850290234272033 driven_any_min 0.850290234272033 driven_lanedir_consec_max 0.1969461716091996 driven_lanedir_consec_mean 0.1969461716091996 driven_lanedir_consec_min 0.1969461716091996 driven_lanedir_max 0.1969461716091996 driven_lanedir_mean 0.1969461716091996 driven_lanedir_median 0.1969461716091996 driven_lanedir_min 0.1969461716091996 in-drivable-lane_max 4.449999999999985 in-drivable-lane_mean 4.449999999999985 in-drivable-lane_min 4.449999999999985 per-episodes details {"loop-000-ego0": {"driven_any": 0.850290234272033, "survival_time": 6.199999999999986, "driven_lanedir": 0.1969461716091996, "in-drivable-lane": 4.449999999999985, "deviation-heading": 0.9520924629376066, "distance-from-start": 0.8501561575907521, "deviation-center-line": 0.1253905569777337, "driven_lanedir_consec": 0.1969461716091996}}simulation-passed 1 survival_time_max 6.199999999999986 survival_time_mean 6.199999999999986 survival_time_min 6.199999999999986
No reset possible 7966696Bea Baselines minimal-agent aido-LFV_multi-sim-testingsim-3of4 success no Archimede-stage-052022-11-16 13:55:46+00:00 2022-11-16 14:02:49+00:00 0:07:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 18.10000000000012 in-drivable-lane_median 16.475000000000122 driven_lanedir_consec_median 0.18712591803917977 deviation-center-line_median 0.1597304482461443
other stats deviation-center-line_max 0.8154371900073211 deviation-center-line_mean 0.31068410995768186 deviation-center-line_min 0.10783835333111774 deviation-heading_max 2.657388407335729 deviation-heading_mean 1.235253872290393 deviation-heading_median 0.8549948818349845 deviation-heading_min 0.5736373181558743 distance-from-start_max 2.821509840856546 distance-from-start_mean 1.6015737965532668 distance-from-start_median 1.6717195029470897 distance-from-start_min 0.241346339462342 driven_any_max 2.822213654469497 driven_any_mean 1.6018053790051838 driven_any_median 1.6718291481738723 driven_any_min 0.2413495652034941 driven_lanedir_consec_max 1.268286535833032 driven_lanedir_consec_mean 0.4392278633852571 driven_lanedir_consec_min 0.11437308162963712 driven_lanedir_max 1.268286535833032 driven_lanedir_mean 0.4392278633852571 driven_lanedir_median 0.18712591803917977 driven_lanedir_min 0.11437308162963712 in-drivable-lane_max 16.900000000000123 in-drivable-lane_mean 14.675000000000122 in-drivable-lane_min 8.850000000000122 per-episodes details {"autolab-000-ego0": {"driven_any": 1.618389277101445, "survival_time": 18.10000000000012, "driven_lanedir": 0.13667124221726512, "in-drivable-lane": 16.700000000000124, "deviation-heading": 0.9508048428349396, "distance-from-start": 1.6182798682574715, "deviation-center-line": 0.10783835333111774, "driven_lanedir_consec": 0.13667124221726512}, "autolab-000-ego1": {"driven_any": 1.7252690192462996, "survival_time": 18.10000000000012, "driven_lanedir": 0.2375805938610944, "in-drivable-lane": 16.25000000000012, "deviation-heading": 0.5736373181558743, "distance-from-start": 1.725159137636708, "deviation-center-line": 0.2032095259620319, "driven_lanedir_consec": 0.2375805938610944}, "autolab-000-ego2": {"driven_any": 2.822213654469497, "survival_time": 18.10000000000012, "driven_lanedir": 1.268286535833032, "in-drivable-lane": 8.850000000000122, "deviation-heading": 2.657388407335729, "distance-from-start": 2.821509840856546, "deviation-center-line": 0.8154371900073211, "driven_lanedir_consec": 1.268286535833032}, "autolab-000-ego3": {"driven_any": 0.2413495652034941, "survival_time": 18.10000000000012, "driven_lanedir": 0.11437308162963712, "in-drivable-lane": 16.900000000000123, "deviation-heading": 0.7591849208350294, "distance-from-start": 0.241346339462342, "deviation-center-line": 0.1162513705302567, "driven_lanedir_consec": 0.11437308162963712}}simulation-passed 1 survival_time_max 18.10000000000012 survival_time_mean 18.10000000000012 survival_time_min 18.10000000000012
No reset possible 7961697Bea Baselines minimal-agent aido-LFP-sim-testingsim-2of4 success no Archimede-stage-052022-11-16 13:52:42+00:00 2022-11-16 13:55:39+00:00 0:02:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 13.80000000000006 in-drivable-lane_median 10.700000000000069 driven_lanedir_consec_median 0.30902436497808483 deviation-center-line_median 0.2686153603672394
other stats deviation-center-line_max 0.2686153603672394 deviation-center-line_mean 0.2686153603672394 deviation-center-line_min 0.2686153603672394 deviation-heading_max 2.499533756017494 deviation-heading_mean 2.499533756017494 deviation-heading_median 2.499533756017494 deviation-heading_min 2.499533756017494 distance-from-start_max 2.107081087129602 distance-from-start_mean 2.107081087129602 distance-from-start_median 2.107081087129602 distance-from-start_min 2.107081087129602 driven_any_max 2.107326449228898 driven_any_mean 2.107326449228898 driven_any_median 2.107326449228898 driven_any_min 2.107326449228898 driven_lanedir_consec_max 0.30902436497808483 driven_lanedir_consec_mean 0.30902436497808483 driven_lanedir_consec_min 0.30902436497808483 driven_lanedir_max 0.30902436497808483 driven_lanedir_mean 0.30902436497808483 driven_lanedir_median 0.30902436497808483 driven_lanedir_min 0.30902436497808483 in-drivable-lane_max 10.700000000000069 in-drivable-lane_mean 10.700000000000069 in-drivable-lane_min 10.700000000000069 per-episodes details {"loop-000-ego0": {"driven_any": 2.107326449228898, "survival_time": 13.80000000000006, "driven_lanedir": 0.30902436497808483, "in-drivable-lane": 10.700000000000069, "deviation-heading": 2.499533756017494, "distance-from-start": 2.107081087129602, "deviation-center-line": 0.2686153603672394, "driven_lanedir_consec": 0.30902436497808483}}simulation-passed 1 survival_time_max 13.80000000000006 survival_time_mean 13.80000000000006 survival_time_min 13.80000000000006
No reset possible 7956698Bea Baselines minimal-agent aido-LFV-sim-testingsim-2of4 success no Archimede-stage-052022-11-16 13:47:52+00:00 2022-11-16 13:52:24+00:00 0:04:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 10.85000000000002 in-drivable-lane_median 9.45000000000002 driven_lanedir_consec_median 0.13666265914841746 deviation-center-line_median 0.10783813033638397
other stats deviation-center-line_max 0.10783813033638397 deviation-center-line_mean 0.10783813033638397 deviation-center-line_min 0.10783813033638397 deviation-heading_max 0.9508048428349384 deviation-heading_mean 0.9508048428349384 deviation-heading_median 0.9508048428349384 deviation-heading_min 0.9508048428349384 distance-from-start_max 1.618279868257482 distance-from-start_mean 1.618279868257482 distance-from-start_median 1.618279868257482 distance-from-start_min 1.618279868257482 driven_any_max 1.6183892771013608 driven_any_mean 1.6183892771013608 driven_any_median 1.6183892771013608 driven_any_min 1.6183892771013608 driven_lanedir_consec_max 0.13666265914841746 driven_lanedir_consec_mean 0.13666265914841746 driven_lanedir_consec_min 0.13666265914841746 driven_lanedir_max 0.13666265914841746 driven_lanedir_mean 0.13666265914841746 driven_lanedir_median 0.13666265914841746 driven_lanedir_min 0.13666265914841746 in-drivable-lane_max 9.45000000000002 in-drivable-lane_mean 9.45000000000002 in-drivable-lane_min 9.45000000000002 per-episodes details {"loop-000-ego0": {"driven_any": 1.6183892771013608, "survival_time": 10.85000000000002, "driven_lanedir": 0.13666265914841746, "in-drivable-lane": 9.45000000000002, "deviation-heading": 0.9508048428349384, "distance-from-start": 1.618279868257482, "deviation-center-line": 0.10783813033638397, "driven_lanedir_consec": 0.13666265914841746}}simulation-passed 1 survival_time_max 10.85000000000002 survival_time_mean 10.85000000000002 survival_time_min 10.85000000000002
No reset possible 7951700Bea Baselines minimal-agent aido-LFI-sim-testingsim-2of4 success no Archimede-stage-052022-11-16 13:45:48+00:00 2022-11-16 13:47:40+00:00 0:01:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 7948701Bea Baselines minimal-agent aido-LF-sim-testingsim-3of4 success no Archimede-stage-052022-11-16 13:43:28+00:00 2022-11-16 13:45:42+00:00 0:02:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.13666552017136668 survival_time_median 7.349999999999982 deviation-center-line_median 0.10783809919015176 in-drivable-lane_median 5.9499999999999815
other stats deviation-center-line_max 0.10783809919015176 deviation-center-line_mean 0.10783809919015176 deviation-center-line_min 0.10783809919015176 deviation-heading_max 0.9508048428349384 deviation-heading_mean 0.9508048428349384 deviation-heading_median 0.9508048428349384 deviation-heading_min 0.9508048428349384 distance-from-start_max 1.0431443246128056 distance-from-start_mean 1.0431443246128056 distance-from-start_median 1.0431443246128056 distance-from-start_min 1.0431443246128056 driven_any_max 1.0431971841733667 driven_any_mean 1.0431971841733667 driven_any_median 1.0431971841733667 driven_any_min 1.0431971841733667 driven_lanedir_consec_max 0.13666552017136668 driven_lanedir_consec_mean 0.13666552017136668 driven_lanedir_consec_min 0.13666552017136668 driven_lanedir_max 0.13666552017136668 driven_lanedir_mean 0.13666552017136668 driven_lanedir_median 0.13666552017136668 driven_lanedir_min 0.13666552017136668 in-drivable-lane_max 5.9499999999999815 in-drivable-lane_mean 5.9499999999999815 in-drivable-lane_min 5.9499999999999815 per-episodes details {"autolab-000-ego0": {"driven_any": 1.0431971841733667, "survival_time": 7.349999999999982, "driven_lanedir": 0.13666552017136668, "in-drivable-lane": 5.9499999999999815, "deviation-heading": 0.9508048428349384, "distance-from-start": 1.0431443246128056, "deviation-center-line": 0.10783809919015176, "driven_lanedir_consec": 0.13666552017136668}}simulation-passed 1 survival_time_max 7.349999999999982 survival_time_mean 7.349999999999982 survival_time_min 7.349999999999982
No reset possible 7943702Bea Baselines minimal-agent aido-LFVI_multi-sim-testingsim-1of4 success no Archimede-stage-052022-11-16 13:37:50+00:00 2022-11-16 13:43:07+00:00 0:05:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 10.85000000000002 in-drivable-lane_median 8.475000000000021 driven_lanedir_consec_median 0.25930844757355953 deviation-center-line_median 0.2403440978559498
other stats deviation-center-line_max 1.0829845574737078 deviation-center-line_mean 0.4178777766291809 deviation-center-line_min 0.1078383533311162 deviation-heading_max 2.3391888095273012 deviation-heading_mean 1.2123531062097812 deviation-heading_median 0.9682931485779748 deviation-heading_min 0.5736373181558739 distance-from-start_max 1.6182798682574877 distance-from-start_mean 1.2278394198954414 distance-from-start_median 1.2281617924848915 distance-from-start_min 0.8367542263544953 driven_any_max 1.6183892771013546 driven_any_mean 1.2279094330503972 driven_any_median 1.228238860573719 driven_any_min 0.8367707339527964 driven_lanedir_consec_max 0.6611857977617436 driven_lanedir_consec_mean 0.3291168744561301 driven_lanedir_consec_min 0.1366648049156578 driven_lanedir_max 0.9897803868656267 driven_lanedir_mean 0.4112655217321009 driven_lanedir_median 0.25930844757355953 driven_lanedir_min 0.1366648049156578 in-drivable-lane_max 9.45000000000002 in-drivable-lane_mean 6.600000000000016 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 1.6183892771013546, "survival_time": 10.85000000000002, "driven_lanedir": 0.1366648049156578, "in-drivable-lane": 9.45000000000002, "deviation-heading": 0.9508048428349392, "distance-from-start": 1.6182798682574877, "deviation-center-line": 0.1078383533311162, "driven_lanedir_consec": 0.1366648049156578}, "udem-000-ego1": {"driven_any": 0.8367707339527964, "survival_time": 10.85000000000002, "driven_lanedir": 0.2375805938610944, "in-drivable-lane": 9.000000000000018, "deviation-heading": 0.5736373181558739, "distance-from-start": 0.8367542263544953, "deviation-center-line": 0.20320937067180136, "driven_lanedir_consec": 0.2375805938610944}, "udem-000-ego2": {"driven_any": 0.9932647664055236, "survival_time": 10.85000000000002, "driven_lanedir": 0.9897803868656267, "in-drivable-lane": 0.0, "deviation-heading": 0.9857814543210104, "distance-from-start": 0.993217785839554, "deviation-center-line": 1.0829845574737078, "driven_lanedir_consec": 0.6611857977617436}, "udem-000-ego3": {"driven_any": 1.4632129547419142, "survival_time": 10.85000000000002, "driven_lanedir": 0.28103630128602464, "in-drivable-lane": 7.950000000000025, "deviation-heading": 2.3391888095273012, "distance-from-start": 1.4631057991302292, "deviation-center-line": 0.27747882504009824, "driven_lanedir_consec": 0.28103630128602464}}simulation-passed 1 survival_time_max 10.85000000000002 survival_time_mean 10.85000000000002 survival_time_min 10.85000000000002
No reset possible 7935658Bea Baselines template-pytorch aido-LF-sim-testingsim-0of4 success no Archimede-stage-052022-11-16 13:22:01+00:00 2022-11-16 13:37:29+00:00 0:15:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.2026837871886924 survival_time_median 59.99999999999873 deviation-center-line_median 1.7060335831576343 in-drivable-lane_median 40.74999999999857
other stats deviation-center-line_max 1.7060335831576343 deviation-center-line_mean 1.7060335831576343 deviation-center-line_min 1.7060335831576343 deviation-heading_max 13.252143447660943 deviation-heading_mean 13.252143447660943 deviation-heading_median 13.252143447660943 deviation-heading_min 13.252143447660943 distance-from-start_max 0.4730522844017011 distance-from-start_mean 0.4730522844017011 distance-from-start_median 0.4730522844017011 distance-from-start_min 0.4730522844017011 driven_any_max 9.517951389382842 driven_any_mean 9.517951389382842 driven_any_median 9.517951389382842 driven_any_min 9.517951389382842 driven_lanedir_consec_max 2.2026837871886924 driven_lanedir_consec_mean 2.2026837871886924 driven_lanedir_consec_min 2.2026837871886924 driven_lanedir_max 2.2026837871886924 driven_lanedir_mean 2.2026837871886924 driven_lanedir_median 2.2026837871886924 driven_lanedir_min 2.2026837871886924 in-drivable-lane_max 40.74999999999857 in-drivable-lane_mean 40.74999999999857 in-drivable-lane_min 40.74999999999857 per-episodes details {"zigzag-000-ego0": {"driven_any": 9.517951389382842, "survival_time": 59.99999999999873, "driven_lanedir": 2.2026837871886924, "in-drivable-lane": 40.74999999999857, "deviation-heading": 13.252143447660943, "distance-from-start": 0.4730522844017011, "deviation-center-line": 1.7060335831576343, "driven_lanedir_consec": 2.2026837871886924}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7931526Bea Baselines baseline-behavior-cloning aido-LF-sim-testingsim-1of4 failed no Archimede-stage-052022-11-16 13:18:58+00:00 2022-11-16 13:21:36+00:00 0:02:38 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
Bea Baselines 🐤