Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 17279
1859
Kathryn Hite exercises_braitenberg lx22-BV1
sim-2of5 success yes davinci-stage-11-6.2.53
2022-11-30 12:59:07+00:00 2022-11-30 13:06:10+00:00 0:07:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d40-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 17247
387
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFV-sim-validation
sim-1of4 success yes davinci-stage-11-6.2.53
2022-11-29 14:34:52+00:00 2022-11-29 14:50:39+00:00 0:15:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 22.09999999999943 driven_lanedir_consec_median -2.969341770370051 deviation-center-line_median 2.5374840186308054
other stats deviation-center-line_max 2.5374840186308054 deviation-center-line_mean 2.5374840186308054 deviation-center-line_min 2.5374840186308054 deviation-heading_max 28.621554599827196 deviation-heading_mean 28.621554599827196 deviation-heading_median 28.621554599827196 deviation-heading_min 28.621554599827196 distance-from-start_max 0.27298518426220825 distance-from-start_mean 0.27298518426220825 distance-from-start_median 0.27298518426220825 distance-from-start_min 0.27298518426220825 driven_any_max 10.993307343638932 driven_any_mean 10.993307343638932 driven_any_median 10.993307343638932 driven_any_min 10.993307343638932 driven_lanedir_consec_max -2.969341770370051 driven_lanedir_consec_mean -2.969341770370051 driven_lanedir_consec_min -2.969341770370051 driven_lanedir_max -3.2185377228675134 driven_lanedir_mean -3.2185377228675134 driven_lanedir_median -3.2185377228675134 driven_lanedir_min -3.2185377228675134 in-drivable-lane_max 22.09999999999943 in-drivable-lane_mean 22.09999999999943 in-drivable-lane_min 22.09999999999943 per-episodes details {"loop-000-ego0": {"driven_any": 10.993307343638932, "survival_time": 59.99999999999873, "driven_lanedir": -3.2185377228675134, "in-drivable-lane": 22.09999999999943, "deviation-heading": 28.621554599827196, "distance-from-start": 0.27298518426220825, "deviation-center-line": 2.5374840186308054, "driven_lanedir_consec": -2.969341770370051}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 17243
392
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFV_multi-sim-testing
sim-3of4 failed yes davinci-stage-11-6.2.53
2022-11-29 14:32:55+00:00 2022-11-29 14:34:26+00:00 0:01:31 The container "solut [...] The container "solution-ego1" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17168
398
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFVI_multi-sim-testing
sim-0of4 success yes davinci-stage-11-6.2.53
2022-11-29 13:55:35+00:00 2022-11-29 14:32:34+00:00 0:36:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 26.67499999999936 driven_lanedir_consec_median -3.302064229661129 deviation-center-line_median 2.773960414552408
other stats deviation-center-line_max 7.497764103349187 deviation-center-line_mean 3.776091470660392 deviation-center-line_min 2.058680950187566 deviation-heading_max 30.672324569221225 deviation-heading_mean 22.570758873765136 deviation-heading_median 26.486417545942533 deviation-heading_min 6.637875833954247 distance-from-start_max 0.2650720368240896 distance-from-start_mean 0.1824183138007309 distance-from-start_median 0.17104423455583095 distance-from-start_min 0.1225127492671721 driven_any_max 12.643642130986928 driven_any_mean 9.414060914730172 driven_any_median 12.114605091938252 driven_any_min 0.7833913440572575 driven_lanedir_consec_max -0.13986650270625778 driven_lanedir_consec_mean -2.600121999524806 driven_lanedir_consec_min -3.6564930360707097 driven_lanedir_max -0.13986650270625778 driven_lanedir_mean -2.600121999524806 driven_lanedir_median -3.302064229661129 driven_lanedir_min -3.6564930360707097 in-drivable-lane_max 29.89999999999928 in-drivable-lane_mean 21.1999999999995 in-drivable-lane_min 1.5499999999999945 per-episodes details {"udem-000-ego0": {"driven_any": 11.879515626026524, "survival_time": 59.99999999999873, "driven_lanedir": -3.0971569809914508, "in-drivable-lane": 28.34999999999925, "deviation-heading": 26.81414532371177, "distance-from-start": 0.14499833539102558, "deviation-center-line": 2.7851128942395453, "driven_lanedir_consec": -3.0971569809914508}, "udem-000-ego1": {"driven_any": 0.7833913440572575, "survival_time": 59.99999999999873, "driven_lanedir": -0.13986650270625778, "in-drivable-lane": 1.5499999999999945, "deviation-heading": 6.637875833954247, "distance-from-start": 0.1225127492671721, "deviation-center-line": 7.497764103349187, "driven_lanedir_consec": -0.13986650270625778}, "udem-000-ego2": {"driven_any": 12.643642130986928, "survival_time": 59.99999999999873, "driven_lanedir": -3.6564930360707097, "in-drivable-lane": 24.99999999999947, "deviation-heading": 30.672324569221225, "distance-from-start": 0.2650720368240896, "deviation-center-line": 2.058680950187566, "driven_lanedir_consec": -3.6564930360707097}, "udem-000-ego3": {"driven_any": 12.349694557849984, "survival_time": 59.99999999999873, "driven_lanedir": -3.5069714783308066, "in-drivable-lane": 29.89999999999928, "deviation-heading": 26.158689768173296, "distance-from-start": 0.1970901337206363, "deviation-center-line": 2.7628079348652705, "driven_lanedir_consec": -3.5069714783308066}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 17158
516
Bea Baselines 🐤baseline-behavior-cloning aido-LFV-sim-validation
sim-3of4 failed yes davinci-stage-11-6.2.53
2022-11-29 13:53:45+00:00 2022-11-29 13:55:13+00:00 0:01:28 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17151
518
Bea Baselines 🐤baseline-behavior-cloning aido-LFI-sim-validation
sim-3of4 success yes davinci-stage-11-6.2.53
2022-11-29 13:52:00+00:00 2022-11-29 13:53:38+00:00 0:01:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 17142
519
Bea Baselines 🐤baseline-behavior-cloning aido-LF-sim-validation
sim-3of4 failed yes davinci-stage-11-6.2.53
2022-11-29 13:50:39+00:00 2022-11-29 13:51:33+00:00 0:00:54 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17135
521
Bea Baselines 🐤baseline-behavior-cloning aido-LFV_multi-sim-testing
sim-3of4 failed yes davinci-stage-11-6.2.53
2022-11-29 13:49:17+00:00 2022-11-29 13:50:28+00:00 0:01:11 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17126
523
Bea Baselines 🐤baseline-behavior-cloning aido-LFV-sim-testing
sim-2of4 failed yes davinci-stage-11-6.2.53
2022-11-29 13:47:32+00:00 2022-11-29 13:49:10+00:00 0:01:38 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17117
525
Bea Baselines 🐤baseline-behavior-cloning aido-LFI-sim-testing
sim-0of4 failed yes davinci-stage-11-6.2.53
2022-11-29 13:45:40+00:00 2022-11-29 13:47:06+00:00 0:01:26 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17113
528
Bea Baselines 🐤baseline-dagger-pytorch aido-LFV_multi-sim-validation
sim-0of4 failed yes davinci-stage-11-6.2.53
2022-11-29 13:44:14+00:00 2022-11-29 13:45:35+00:00 0:01:21 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17074
537
Bea Baselines 🐤baseline-dagger-pytorch aido-LFV-sim-testing
sim-3of4 success yes davinci-stage-11-6.2.53
2022-11-29 13:24:30+00:00 2022-11-29 13:43:43+00:00 0:19:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 8.852265885466997 deviation-center-line_median 2.8657256530990565
other stats deviation-center-line_max 2.8657256530990565 deviation-center-line_mean 2.8657256530990565 deviation-center-line_min 2.8657256530990565 deviation-heading_max 12.725800400349376 deviation-heading_mean 12.725800400349376 deviation-heading_median 12.725800400349376 deviation-heading_min 12.725800400349376 distance-from-start_max 2.3659751672862273 distance-from-start_mean 2.3659751672862273 distance-from-start_median 2.3659751672862273 distance-from-start_min 2.3659751672862273 driven_any_max 9.180523743176527 driven_any_mean 9.180523743176527 driven_any_median 9.180523743176527 driven_any_min 9.180523743176527 driven_lanedir_consec_max 8.852265885466997 driven_lanedir_consec_mean 8.852265885466997 driven_lanedir_consec_min 8.852265885466997 driven_lanedir_max 8.852265885466997 driven_lanedir_mean 8.852265885466997 driven_lanedir_median 8.852265885466997 driven_lanedir_min 8.852265885466997 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 9.180523743176527, "survival_time": 59.99999999999873, "driven_lanedir": 8.852265885466997, "in-drivable-lane": 0.0, "deviation-heading": 12.725800400349376, "distance-from-start": 2.3659751672862273, "deviation-center-line": 2.8657256530990565, "driven_lanedir_consec": 8.852265885466997}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 17061
541
Bea Baselines 🐤baseline-dagger-pytorch aido-LF-sim-testing
sim-2of4 success yes davinci-stage-11-6.2.53
2022-11-29 13:20:45+00:00 2022-11-29 13:24:04+00:00 0:03:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.2345125869984837 survival_time_median 18.00000000000012 deviation-center-line_median 0.5377327590901083 in-drivable-lane_median 9.250000000000124
other stats deviation-center-line_max 0.5377327590901083 deviation-center-line_mean 0.5377327590901083 deviation-center-line_min 0.5377327590901083 deviation-heading_max 3.8276106247929023 deviation-heading_mean 3.8276106247929023 deviation-heading_median 3.8276106247929023 deviation-heading_min 3.8276106247929023 distance-from-start_max 1.6836505396487214 distance-from-start_mean 1.6836505396487214 distance-from-start_median 1.6836505396487214 distance-from-start_min 1.6836505396487214 driven_any_max 3.0202360125560412 driven_any_mean 3.0202360125560412 driven_any_median 3.0202360125560412 driven_any_min 3.0202360125560412 driven_lanedir_consec_max 1.2345125869984837 driven_lanedir_consec_mean 1.2345125869984837 driven_lanedir_consec_min 1.2345125869984837 driven_lanedir_max 1.2345125869984837 driven_lanedir_mean 1.2345125869984837 driven_lanedir_median 1.2345125869984837 driven_lanedir_min 1.2345125869984837 in-drivable-lane_max 9.250000000000124 in-drivable-lane_mean 9.250000000000124 in-drivable-lane_min 9.250000000000124 per-episodes details {"loop2-000-ego0": {"driven_any": 3.0202360125560412, "survival_time": 18.00000000000012, "driven_lanedir": 1.2345125869984837, "in-drivable-lane": 9.250000000000124, "deviation-heading": 3.8276106247929023, "distance-from-start": 1.6836505396487214, "deviation-center-line": 0.5377327590901083, "driven_lanedir_consec": 1.2345125869984837}}simulation-passed 1 survival_time_max 18.00000000000012 survival_time_mean 18.00000000000012 survival_time_min 18.00000000000012
No reset possible 17052
764
Bea Baselines 🐤challenge-aido_LF-baseline-duckietown:daffy:d0c3b9f200e160334a96bdb0f91745327be57194 aido-hello-sim-validation
sanity-check success yes davinci-stage-11-6.2.53
2022-11-29 13:18:25+00:00 2022-11-29 13:20:18+00:00 0:01:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.01321925883757702 deviation-center-line_median 0.006547555220619863
other stats deviation-center-line_max 0.006547555220619863 deviation-center-line_mean 0.006547555220619863 deviation-center-line_min 0.006547555220619863 deviation-heading_max 0.26438221729272254 deviation-heading_mean 0.26438221729272254 deviation-heading_median 0.26438221729272254 deviation-heading_min 0.26438221729272254 distance-from-start_max 0.015079702740142396 distance-from-start_mean 0.015079702740142396 distance-from-start_median 0.015079702740142396 distance-from-start_min 0.015079702740142396 driven_any_max 0.0150845296061755 driven_any_mean 0.0150845296061755 driven_any_median 0.0150845296061755 driven_any_min 0.0150845296061755 driven_lanedir_consec_max 0.01321925883757702 driven_lanedir_consec_mean 0.01321925883757702 driven_lanedir_consec_min 0.01321925883757702 driven_lanedir_max 0.01321925883757702 driven_lanedir_mean 0.01321925883757702 driven_lanedir_median 0.01321925883757702 driven_lanedir_min 0.01321925883757702 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.0150845296061755, "survival_time": 0.49999999999999994, "driven_lanedir": 0.01321925883757702, "in-drivable-lane": 0.0, "deviation-heading": 0.26438221729272254, "distance-from-start": 0.015079702740142396, "deviation-center-line": 0.006547555220619863, "driven_lanedir_consec": 0.01321925883757702}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 17045
803
Bea Baselines 🐤challenge-aido_LF-template-ros:daffy-staging:3b1546b6959e8affea32711104eb83074ec984ea aido-hello-sim-validation
sanity-check success yes davinci-stage-11-6.2.53
2022-11-29 13:16:13+00:00 2022-11-29 13:18:18+00:00 0:02:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.05305156472117312 deviation-center-line_median 0.006408563471858657
other stats deviation-center-line_max 0.006408563471858657 deviation-center-line_mean 0.006408563471858657 deviation-center-line_min 0.006408563471858657 deviation-heading_max 0.26053979126284427 deviation-heading_mean 0.26053979126284427 deviation-heading_median 0.26053979126284427 deviation-heading_min 0.26053979126284427 distance-from-start_max 0.06060612435746503 distance-from-start_mean 0.06060612435746503 distance-from-start_median 0.06060612435746503 distance-from-start_min 0.06060612435746503 driven_any_max 0.06061019352416028 driven_any_mean 0.06061019352416028 driven_any_median 0.06061019352416028 driven_any_min 0.06061019352416028 driven_lanedir_consec_max 0.05305156472117312 driven_lanedir_consec_mean 0.05305156472117312 driven_lanedir_consec_min 0.05305156472117312 driven_lanedir_max 0.05305156472117312 driven_lanedir_mean 0.05305156472117312 driven_lanedir_median 0.05305156472117312 driven_lanedir_min 0.05305156472117312 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.06061019352416028, "survival_time": 0.49999999999999994, "driven_lanedir": 0.05305156472117312, "in-drivable-lane": 0.0, "deviation-heading": 0.26053979126284427, "distance-from-start": 0.06060612435746503, "deviation-center-line": 0.006408563471858657, "driven_lanedir_consec": 0.05305156472117312}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 17032
1555
Andrea Daniele exercises_braitenberg lx22-BV1
sim-4of5 success yes davinci-stage-11-6.2.53
2022-11-29 13:06:40+00:00 2022-11-29 13:15:58+00:00 0:09:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d60-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 17022
1557
Andrea Daniele exercises_braitenberg lx22-BV1
sim-1of5 success yes davinci-stage-11-6.2.53
2022-11-29 12:58:12+00:00 2022-11-29 13:06:26+00:00 0:08:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d45-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 17012
1602
Andrea Daniele exercises_braitenberg lx22-BV1
sim-3of5 success yes davinci-stage-11-6.2.53
2022-11-29 12:53:07+00:00 2022-11-29 12:58:06+00:00 0:04:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 6.341760000000476
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 6.341760000000476 distance-from-start_median 6.341760000000476 distance-from-start_min 6.341760000000476 driven_any_max 6.3417600000005665 driven_any_mean 6.3417600000005665 driven_any_median 6.3417600000005665 driven_any_min 6.3417600000005665 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 30.400000000000297 in-drivable-lane_mean 30.400000000000297 in-drivable-lane_median 30.400000000000297 in-drivable-lane_min 30.400000000000297 per-episodes details {"d50-ego0": {"driven_any": 6.3417600000005665, "survival_time": 30.400000000000297, "driven_lanedir": 0.0, "in-drivable-lane": 30.400000000000297, "deviation-heading": 0.0, "distance-from-start": 6.341760000000476, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 30.400000000000297 survival_time_mean 30.400000000000297 survival_time_median 30.400000000000297 survival_time_min 30.400000000000297
No reset possible 16998
1605
Bea Baselines 🐤baseline-RPL-ros aido-LFI-sim-validation
sim-3of4 failed yes davinci-stage-11-6.2.53
2022-11-29 12:51:19+00:00 2022-11-29 12:52:35+00:00 0:01:16 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16989
1606
Bea Baselines 🐤baseline-RPL-ros aido-LF-sim-validation
sim-1of4 failed yes davinci-stage-11-6.2.53
2022-11-29 12:50:01+00:00 2022-11-29 12:51:00+00:00 0:00:59 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16980
1609
Bea Baselines 🐤baseline-RPL-ros aido-LFP-sim-validation
sim-3of4 failed yes davinci-stage-11-6.2.53
2022-11-29 12:48:17+00:00 2022-11-29 12:49:28+00:00 0:01:11 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16971
1614
Bea Baselines 🐤baseline-RPL-ros lx22-BV1
sim-1of5 failed yes davinci-stage-11-6.2.53
2022-11-29 12:46:53+00:00 2022-11-29 12:48:08+00:00 0:01:15 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16963
1622
Bea Baselines 🐤baseline-RPL-ros aido-LFVI-sim-testing
sim-3of4 failed yes davinci-stage-11-6.2.53
2022-11-29 12:45:35+00:00 2022-11-29 12:46:47+00:00 0:01:12 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16956
1624
Bea Baselines 🐤baseline-RPL-ros aido-LF-sim-testing
sim-2of4 failed yes davinci-stage-11-6.2.53
2022-11-29 12:43:54+00:00 2022-11-29 12:45:11+00:00 0:01:17 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16936
1628
Bea Baselines 🐤baseline-duckietown-ml aido-LFV-sim-validation
sim-2of4 success yes davinci-stage-11-6.2.53
2022-11-29 12:36:00+00:00 2022-11-29 12:43:39+00:00 0:07:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 0.8949084199908675
other stats deviation-center-line_max 0.8949084199908675 deviation-center-line_mean 0.8949084199908675 deviation-center-line_min 0.8949084199908675 deviation-heading_max 32.249113233675025 deviation-heading_mean 32.249113233675025 deviation-heading_median 32.249113233675025 deviation-heading_min 32.249113233675025 distance-from-start_max 4.002966042486721e-16 distance-from-start_mean 4.002966042486721e-16 distance-from-start_median 4.002966042486721e-16 distance-from-start_min 4.002966042486721e-16 driven_any_max 4.803559250983913e-13 driven_any_mean 4.803559250983913e-13 driven_any_median 4.803559250983913e-13 driven_any_min 4.803559250983913e-13 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 4.803559250983913e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.002966042486721e-16, "deviation-center-line": 0.8949084199908675, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16917
1633
Bea Baselines 🐤baseline-duckietown-ml aido-LFV_multi-sim-validation
sim-3of4 success yes davinci-stage-11-6.2.53
2022-11-29 12:20:08+00:00 2022-11-29 12:35:40+00:00 0:15:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.939287230801057e-07 deviation-center-line_median 1.5116956155527117
other stats deviation-center-line_max 2.9467746047984105 deviation-center-line_mean 1.5769755996667565 deviation-center-line_min 0.33773656276319197 deviation-heading_max 32.24910212696788 deviation-heading_mean 22.839461787379523 deviation-heading_median 22.597236152907925 deviation-heading_min 13.91427271673436 distance-from-start_max 9.155133597044477e-16 distance-from-start_mean 3.073829628603006e-16 distance-from-start_median 1.5700924586837752e-16 distance-from-start_min 0.0 driven_any_max 1.0986160316453499e-12 driven_any_mean 3.6885955543236473e-13 driven_any_median 1.8841109504205443e-13 driven_any_min 0.0 driven_lanedir_consec_max 4.4323372971888375e-06 driven_lanedir_consec_mean -6.959346956214585e-05 driven_lanedir_consec_min -0.00028319407299193244 driven_lanedir_max 4.4323372971888375e-06 driven_lanedir_mean -6.959346956214585e-05 driven_lanedir_median 1.939287230801057e-07 driven_lanedir_min -0.00028319407299193244 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": -2.089142725480997e-06, "in-drivable-lane": 0.0, "deviation-heading": 32.24910212696788, "distance-from-start": 0.0, "deviation-center-line": 0.8948982095947005, "driven_lanedir_consec": -2.089142725480997e-06}, "zigzag-000-ego1": {"driven_any": 3.7682219008410875e-13, "survival_time": 59.99999999999873, "driven_lanedir": -0.00028319407299193244, "in-drivable-lane": 0.0, "deviation-heading": 30.71290207135603, "distance-from-start": 3.1401849173675503e-16, "deviation-center-line": 2.1284930215107223, "driven_lanedir_consec": -0.00028319407299193244}, "zigzag-000-ego2": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 2.477000171641208e-06, "in-drivable-lane": 0.0, "deviation-heading": 14.481570234459818, "distance-from-start": 0.0, "deviation-center-line": 2.9467746047984105, "driven_lanedir_consec": 2.477000171641208e-06}, "zigzag-000-ego3": {"driven_any": 1.0986160316453499e-12, "survival_time": 59.99999999999873, "driven_lanedir": 4.4323372971888375e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.91427271673436, "distance-from-start": 9.155133597044477e-16, "deviation-center-line": 0.33773656276319197, "driven_lanedir_consec": 4.4323372971888375e-06}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16907
1639
Bea Baselines 🐤baseline-duckietown-ml lx22-BV1
sim-1of5 success yes davinci-stage-11-6.2.53
2022-11-29 12:11:19+00:00 2022-11-29 12:19:34+00:00 0:08:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d45-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16890
1647
Bea Baselines 🐤baseline-duckietown-ml aido-LFVI-sim-testing
sim-1of4 success yes davinci-stage-11-6.2.53
2022-11-29 11:57:22+00:00 2022-11-29 12:11:06+00:00 0:13:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 0.4065243130134252
other stats deviation-center-line_max 0.4065243130134252 deviation-center-line_mean 0.4065243130134252 deviation-center-line_min 0.4065243130134252 deviation-heading_max 40.967332753486254 deviation-heading_mean 40.967332753486254 deviation-heading_median 40.967332753486254 deviation-heading_min 40.967332753486254 distance-from-start_max 5.551115123125783e-17 distance-from-start_mean 5.551115123125783e-17 distance-from-start_median 5.551115123125783e-17 distance-from-start_min 5.551115123125783e-17 driven_any_max 6.661338147750939e-14 driven_any_mean 6.661338147750939e-14 driven_any_median 6.661338147750939e-14 driven_any_min 6.661338147750939e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 6.661338147750939e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.4065243130134252, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16880
1646
Bea Baselines 🐤baseline-duckietown-ml aido-LFV-sim-testing
sim-2of4 timeout yes davinci-stage-11-6.2.53
2022-11-28 21:40:41+00:00 - - - - No reset possible 16854
1650
Bea Baselines 🐤baseline-duckietown-ml aido-LFVI_multi-sim-testing
sim-1of4 timeout yes davinci-stage-11-6.2.53
2022-11-28 19:28:30+00:00 - - - - No reset possible 16849
1652
Bea Baselines 🐤baseline-duckietown-ml aido-LFP-sim-testing
sim-0of4 success yes davinci-stage-11-6.2.53
2022-11-28 19:20:35+00:00 2022-11-28 19:27:55+00:00 0:07:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median -0.000286102294921875 deviation-center-line_median 0.4065102356187871
other stats deviation-center-line_max 0.4065102356187871 deviation-center-line_mean 0.4065102356187871 deviation-center-line_min 0.4065102356187871 deviation-heading_max 40.967332753486225 deviation-heading_mean 40.967332753486225 deviation-heading_median 40.967332753486225 deviation-heading_min 40.967332753486225 distance-from-start_max 6.661338147750939e-16 distance-from-start_mean 6.661338147750939e-16 distance-from-start_median 6.661338147750939e-16 distance-from-start_min 6.661338147750939e-16 driven_any_max 7.993605777301127e-13 driven_any_mean 7.993605777301127e-13 driven_any_median 7.993605777301127e-13 driven_any_min 7.993605777301127e-13 driven_lanedir_consec_max -0.000286102294921875 driven_lanedir_consec_mean -0.000286102294921875 driven_lanedir_consec_min -0.000286102294921875 driven_lanedir_max -0.000286102294921875 driven_lanedir_mean -0.000286102294921875 driven_lanedir_median -0.000286102294921875 driven_lanedir_min -0.000286102294921875 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 7.993605777301127e-13, "survival_time": 59.99999999999873, "driven_lanedir": -0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 6.661338147750939e-16, "deviation-center-line": 0.4065102356187871, "driven_lanedir_consec": -0.000286102294921875}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16841
1653
Bea Baselines 🐤baseline-duckietown aido-LFV-sim-validation
sim-2of4 success yes davinci-stage-11-6.2.53
2022-11-28 19:15:22+00:00 2022-11-28 19:20:21+00:00 0:04:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 33.300000000000246 in-drivable-lane_median 2.9999999999999503 driven_lanedir_consec_median 3.8519961738795256 deviation-center-line_median 1.4316271366482227
other stats deviation-center-line_max 1.4316271366482227 deviation-center-line_mean 1.4316271366482227 deviation-center-line_min 1.4316271366482227 deviation-heading_max 5.539519677502758 deviation-heading_mean 5.539519677502758 deviation-heading_median 5.539519677502758 deviation-heading_min 5.539519677502758 distance-from-start_max 1.0722219641546544 distance-from-start_mean 1.0722219641546544 distance-from-start_median 1.0722219641546544 distance-from-start_min 1.0722219641546544 driven_any_max 4.276571161358181 driven_any_mean 4.276571161358181 driven_any_median 4.276571161358181 driven_any_min 4.276571161358181 driven_lanedir_consec_max 3.8519961738795256 driven_lanedir_consec_mean 3.8519961738795256 driven_lanedir_consec_min 3.8519961738795256 driven_lanedir_max 3.8519961738795256 driven_lanedir_mean 3.8519961738795256 driven_lanedir_median 3.8519961738795256 driven_lanedir_min 3.8519961738795256 in-drivable-lane_max 2.9999999999999503 in-drivable-lane_mean 2.9999999999999503 in-drivable-lane_min 2.9999999999999503 per-episodes details {"loop2-000-ego0": {"driven_any": 4.276571161358181, "survival_time": 33.300000000000246, "driven_lanedir": 3.8519961738795256, "in-drivable-lane": 2.9999999999999503, "deviation-heading": 5.539519677502758, "distance-from-start": 1.0722219641546544, "deviation-center-line": 1.4316271366482227, "driven_lanedir_consec": 3.8519961738795256}}simulation-passed 1 survival_time_max 33.300000000000246 survival_time_mean 33.300000000000246 survival_time_min 33.300000000000246
No reset possible 16827
1657
Bea Baselines 🐤baseline-duckietown aido-LFVI_multi-sim-validation
sim-0of4 success yes davinci-stage-11-6.2.53
2022-11-28 19:05:39+00:00 2022-11-28 19:15:15+00:00 0:09:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 18.35000000000013 in-drivable-lane_median 0.4250000000000061 driven_lanedir_consec_median 1.193734238677942 deviation-center-line_median 1.524047937701548
other stats deviation-center-line_max 2.6785506976807785 deviation-center-line_mean 1.5912953130315692 deviation-center-line_min 0.6385346790424031 deviation-heading_max 17.067417601876016 deviation-heading_mean 8.395529266507197 deviation-heading_median 5.83281420418189 deviation-heading_min 4.849071055788991 distance-from-start_max 1.888879224689187 distance-from-start_mean 1.169138838028896 distance-from-start_median 1.170335916142549 distance-from-start_min 0.4470042951412987 driven_any_max 2.2914272033922005 driven_any_mean 1.4102350566611594 driven_any_median 1.4218437800147092 driven_any_min 0.5058254632230188 driven_lanedir_consec_max 1.9440506571778895 driven_lanedir_consec_mean 1.1928712220073057 driven_lanedir_consec_min 0.4399657534954491 driven_lanedir_max 1.957122412810113 driven_lanedir_mean 1.2196198958440865 driven_lanedir_median 1.240695708535391 driven_lanedir_min 0.4399657534954491 in-drivable-lane_max 1.8000000000000256 in-drivable-lane_mean 0.6625000000000094 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 0.5058254632230188, "survival_time": 18.35000000000013, "driven_lanedir": 0.4399657534954491, "in-drivable-lane": 0.0, "deviation-heading": 17.067417601876016, "distance-from-start": 0.4470042951412987, "deviation-center-line": 1.8813381296035177, "driven_lanedir_consec": 0.4399657534954491}, "udem-000-ego1": {"driven_any": 2.291390208285492, "survival_time": 18.35000000000013, "driven_lanedir": 1.9440506571778895, "in-drivable-lane": 0.8500000000000121, "deviation-heading": 5.6246439954300955, "distance-from-start": 1.888879224689187, "deviation-center-line": 1.1667577457995784, "driven_lanedir_consec": 1.9440506571778895}, "udem-000-ego2": {"driven_any": 2.2914272033922005, "survival_time": 18.35000000000013, "driven_lanedir": 1.957122412810113, "in-drivable-lane": 1.8000000000000256, "deviation-heading": 4.849071055788991, "distance-from-start": 1.8077561528676656, "deviation-center-line": 0.6385346790424031, "driven_lanedir_consec": 1.850587190861148}, "udem-000-ego3": {"driven_any": 0.5522973517439266, "survival_time": 18.35000000000013, "driven_lanedir": 0.5373407598928925, "in-drivable-lane": 0.0, "deviation-heading": 6.040984412933684, "distance-from-start": 0.5329156794174328, "deviation-center-line": 2.6785506976807785, "driven_lanedir_consec": 0.5368812864947367}}simulation-passed 1 survival_time_max 18.35000000000013 survival_time_mean 18.35000000000013 survival_time_min 18.35000000000013
No reset possible 16816
1660
Bea Baselines 🐤baseline-duckietown lx22-modcon
sim success yes davinci-stage-11-6.2.53
2022-11-28 18:56:36+00:00 2022-11-28 19:05:17+00:00 0:08:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median 3.374999999999996 deviation-center-line_median 0.9542300387206606 driven_lanedir_consec_median 3.763218968311666 survival_time_median 31.79999999999936
other stats deviation-center-line_max 1.9084600774413212 deviation-center-line_mean 0.9542300387206606 deviation-center-line_min 0.0 deviation-heading_max 3.4098845679201584 deviation-heading_mean 1.7049422839600792 deviation-heading_median 1.7049422839600792 deviation-heading_min 0.0 distance-from-start_max 7.88713496844066 distance-from-start_mean 4.102340992466439 distance-from-start_median 4.102340992466439 distance-from-start_min 0.3175470164922176 driven_any_max 7.9212924252144115 driven_any_mean 4.12727003709658 driven_any_median 4.12727003709658 driven_any_min 0.3332476489787491 driven_lanedir_consec_max 7.526437936623332 driven_lanedir_consec_mean 3.763218968311666 driven_lanedir_consec_min 0.0 driven_lanedir_max 7.526437936623332 driven_lanedir_mean 3.763218968311666 driven_lanedir_median 3.763218968311666 driven_lanedir_min 0.0 in-drivable-lane_max 3.599999999999995 in-drivable-lane_mean 3.374999999999996 in-drivable-lane_min 3.149999999999997 per-episodes details {"LF-full-loop-000-ego0": {"driven_any": 7.9212924252144115, "survival_time": 59.99999999999873, "driven_lanedir": 7.526437936623332, "in-drivable-lane": 3.149999999999997, "deviation-heading": 3.4098845679201584, "distance-from-start": 7.88713496844066, "deviation-center-line": 1.9084600774413212, "driven_lanedir_consec": 7.526437936623332}, "LF-full-loop-001-ego0": {"driven_any": 0.3332476489787491, "survival_time": 3.599999999999995, "driven_lanedir": 0.0, "in-drivable-lane": 3.599999999999995, "deviation-heading": 0.0, "distance-from-start": 0.3175470164922176, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 31.79999999999936 survival_time_min 3.599999999999995
No reset possible 16811
1664
Bea Baselines 🐤baseline-duckietown lx22-BV1
sim-4of5 success yes davinci-stage-11-6.2.53
2022-11-28 18:53:15+00:00 2022-11-28 18:56:04+00:00 0:02:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 1.1011127650145074
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 1.1011127650145074 distance-from-start_median 1.1011127650145074 distance-from-start_min 1.1011127650145074 driven_any_max 1.2692975600414949 driven_any_mean 1.2692975600414949 driven_any_median 1.2692975600414949 driven_any_min 1.2692975600414949 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 10.650000000000016 in-drivable-lane_mean 10.650000000000016 in-drivable-lane_median 10.650000000000016 in-drivable-lane_min 10.650000000000016 per-episodes details {"d60-ego0": {"driven_any": 1.2692975600414949, "survival_time": 10.650000000000016, "driven_lanedir": 0.0, "in-drivable-lane": 10.650000000000016, "deviation-heading": 0.0, "distance-from-start": 1.1011127650145074, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 10.650000000000016 survival_time_mean 10.650000000000016 survival_time_median 10.650000000000016 survival_time_min 10.650000000000016
No reset possible 16789
1675
Bea Baselines 🐤baseline-duckietown aido-LFVI_multi-sim-testing
sim-1of4 success yes davinci-stage-11-6.2.53
2022-11-28 18:40:35+00:00 2022-11-28 18:52:38+00:00 0:12:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 23.4500000000002 in-drivable-lane_median 3.400000000000026 driven_lanedir_consec_median 0.9464191820405348 deviation-center-line_median 1.3566814392693884
other stats deviation-center-line_max 3.7021023832548376 deviation-center-line_mean 1.8547898404951708 deviation-center-line_min 1.0036941001870687 deviation-heading_max 11.10869404245297 deviation-heading_mean 7.003981410646224 deviation-heading_median 7.268608852422105 deviation-heading_min 2.3700138952877143 distance-from-start_max 1.7754685715905605 distance-from-start_mean 0.8128815647883674 distance-from-start_median 0.5655652385624733 distance-from-start_min 0.3449272104379627 driven_any_max 2.9684060506043712 driven_any_mean 1.9676648078805103 driven_any_median 2.277859423970088 driven_any_min 0.3465343329774949 driven_lanedir_consec_max 1.5385445194754055 driven_lanedir_consec_mean 0.942615024919589 driven_lanedir_consec_min 0.3390772161218809 driven_lanedir_max 2.450487730676218 driven_lanedir_mean 1.3952041501625696 driven_lanedir_median 1.3956258269260895 driven_lanedir_min 0.3390772161218809 in-drivable-lane_max 9.6000000000001 in-drivable-lane_mean 4.100000000000039 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 2.2313292952334076, "survival_time": 23.4500000000002, "driven_lanedir": 1.300502661882942, "in-drivable-lane": 4.8500000000000245, "deviation-heading": 11.10869404245297, "distance-from-start": 0.49320359612896897, "deviation-center-line": 1.3037890787979718, "driven_lanedir_consec": 1.116415820138334}, "4way-000-ego1": {"driven_any": 0.3465343329774949, "survival_time": 23.4500000000002, "driven_lanedir": 0.3390772161218809, "in-drivable-lane": 0.0, "deviation-heading": 2.3700138952877143, "distance-from-start": 0.3449272104379627, "deviation-center-line": 3.7021023832548376, "driven_lanedir_consec": 0.3390772161218809}, "4way-000-ego2": {"driven_any": 2.3243895527067684, "survival_time": 23.4500000000002, "driven_lanedir": 1.4907489919692376, "in-drivable-lane": 9.6000000000001, "deviation-heading": 6.4208075058109335, "distance-from-start": 0.6379268809959776, "deviation-center-line": 1.0036941001870687, "driven_lanedir_consec": 0.7764225439427352}, "4way-000-ego3": {"driven_any": 2.9684060506043712, "survival_time": 23.4500000000002, "driven_lanedir": 2.450487730676218, "in-drivable-lane": 1.9500000000000275, "deviation-heading": 8.116410199033277, "distance-from-start": 1.7754685715905605, "deviation-center-line": 1.409573799740805, "driven_lanedir_consec": 1.5385445194754055}}simulation-passed 1 survival_time_max 23.4500000000002 survival_time_mean 23.4500000000002 survival_time_min 23.4500000000002
No reset possible 16780
1677
Bea Baselines 🐤baseline-duckietown aido-LFP-sim-testing
sim-0of4 success yes davinci-stage-11-6.2.53
2022-11-28 18:36:17+00:00 2022-11-28 18:39:58+00:00 0:03:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 19.45000000000014 in-drivable-lane_median 0.7500000000000009 driven_lanedir_consec_median 2.2453404455361428 deviation-center-line_median 1.2974241759942502
other stats deviation-center-line_max 1.2974241759942502 deviation-center-line_mean 1.2974241759942502 deviation-center-line_min 1.2974241759942502 deviation-heading_max 4.0775515271275244 deviation-heading_mean 4.0775515271275244 deviation-heading_median 4.0775515271275244 deviation-heading_min 4.0775515271275244 distance-from-start_max 2.081567463928559 distance-from-start_mean 2.081567463928559 distance-from-start_median 2.081567463928559 distance-from-start_min 2.081567463928559 driven_any_max 2.437668580208346 driven_any_mean 2.437668580208346 driven_any_median 2.437668580208346 driven_any_min 2.437668580208346 driven_lanedir_consec_max 2.2453404455361428 driven_lanedir_consec_mean 2.2453404455361428 driven_lanedir_consec_min 2.2453404455361428 driven_lanedir_max 2.2453404455361428 driven_lanedir_mean 2.2453404455361428 driven_lanedir_median 2.2453404455361428 driven_lanedir_min 2.2453404455361428 in-drivable-lane_max 0.7500000000000009 in-drivable-lane_mean 0.7500000000000009 in-drivable-lane_min 0.7500000000000009 per-episodes details {"autolab-000-ego0": {"driven_any": 2.437668580208346, "survival_time": 19.45000000000014, "driven_lanedir": 2.2453404455361428, "in-drivable-lane": 0.7500000000000009, "deviation-heading": 4.0775515271275244, "distance-from-start": 2.081567463928559, "deviation-center-line": 1.2974241759942502, "driven_lanedir_consec": 2.2453404455361428}}simulation-passed 1 survival_time_max 19.45000000000014 survival_time_mean 19.45000000000014 survival_time_min 19.45000000000014
No reset possible 16774
1679
Bea Baselines 🐤baseline-simple-yield aido-LFI-state-sim-validation
sim-3of4 success yes davinci-stage-11-6.2.53
2022-11-28 18:30:50+00:00 2022-11-28 18:34:03+00:00 0:03:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16761
1681
Bea Baselines 🐤baseline-simple-yield aido-LFVI-state-sim-validation
sim-3of4 success yes davinci-stage-11-6.2.53
2022-11-28 18:18:44+00:00 2022-11-28 18:30:42+00:00 0:11:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 57.84999999999885 in-drivable-lane_median 0.0 driven_lanedir_consec_median 4.884807237005287 deviation-center-line_median 0.15072920516156368
other stats deviation-center-line_max 0.15072920516156368 deviation-center-line_mean 0.15072920516156368 deviation-center-line_min 0.15072920516156368 deviation-heading_max 1.1475940808640654 deviation-heading_mean 1.1475940808640654 deviation-heading_median 1.1475940808640654 deviation-heading_min 1.1475940808640654 distance-from-start_max 2.6948612403356473 distance-from-start_mean 2.6948612403356473 distance-from-start_median 2.6948612403356473 distance-from-start_min 2.6948612403356473 driven_any_max 5.697171922964183 driven_any_mean 5.697171922964183 driven_any_median 5.697171922964183 driven_any_min 5.697171922964183 driven_lanedir_consec_max 4.884807237005287 driven_lanedir_consec_mean 4.884807237005287 driven_lanedir_consec_min 4.884807237005287 driven_lanedir_max 5.693381869716076 driven_lanedir_mean 5.693381869716076 driven_lanedir_median 5.693381869716076 driven_lanedir_min 5.693381869716076 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-001-ego0": {"driven_any": 5.697171922964183, "survival_time": 57.84999999999885, "driven_lanedir": 5.693381869716076, "in-drivable-lane": 0.0, "deviation-heading": 1.1475940808640654, "distance-from-start": 2.6948612403356473, "deviation-center-line": 0.15072920516156368, "driven_lanedir_consec": 4.884807237005287}}simulation-passed 1 survival_time_max 57.84999999999885 survival_time_mean 57.84999999999885 survival_time_min 57.84999999999885
No reset possible 16755
1682
Bea Baselines 🐤baseline-simple-yield aido-LFV_multi-state-sim-validation
sim-0of3 error yes davinci-stage-11-6.2.53
2022-11-28 18:16:41+00:00 2022-11-28 18:18:11+00:00 0:01:30 Unexpected exception [...] Unexpected exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 177, in object_from_ipce_
return object_from_ipce_dict(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 461, in object_from_ipce_dict
attrs[k] = object_from_ipce_(v, et_V, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 391, in object_from_ipce_dataclass_instance
raise ZValueError(msg, anns=anns, T=T, known=sorted(mj), f=f)
zuper_commons.types.exceptions.ZValueError: Cannot find field 'dynamics' in data for class ScenarioRobotSpec and no default available
│ anns: dict[7]
│ │ configuration : RobotConfiguration
│ │ color : str
│ │ description : str
│ │ controllable : bool
│ │ protocol : Optional[ProtocolDesc ]
│ │ dynamics : str
│ │ dynamics_params : Dict[str,Any ]
│ T: str
│ known: [color, configuration, controllable, description, protocol]
│ f: Field(name='dynamics',type=<class 'str'>,default=<dataclasses._MISSING_TYPE object at 0x7f1a15f1ee20>,default_factory=<dataclasses._MISSING_TYPE object at 0x7f1a15f1ee20>,init=True,repr=True,hash=None,compare=True,metadata=mappingproxy({}),_field_type=_FIELD)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 74, in object_from_ipce
res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'robots' of Scenario.
│ K_annotations: dict[6]
│ │ scenario_name : str
│ │ environment : Any
│ │ player_robots : List[str]
│ │ robots : Dict[str,ScenarioRobotSpec]
│ │ duckies : Dict[str,ScenarioDuckieSpec]
│ │ payload_yaml : str
│ expect_type: Dict[str,ScenarioRobotSpec]
│ ann_K: Dict[str,ScenarioRobotSpec]
│ K_name: Scenario
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 167, in main
episodes0 = get_episodes_from_dirs(config.scenarios)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 833, in get_episodes_from_dirs
scenario = cast(Scenario, object_from_ipce(config_, Scenario))
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 93, in object_from_ipce
raise ZValueError(msg, expect_type=expect_type, mj=mj) from e
zuper_commons.types.exceptions.ZValueError: Cannot deserialize object
│ expect_type: Scenario
│ mj: dict[6]
│ │ payload_yaml : ''
│ │ player_robots : [ego0, ego1, ego2, ego3]
│ │ scenario_name : LFV_multi-state-4way-000
│ │ robots :
│ │ dict[4]
│ │ │ ego0 :
│ │ │ dict[5]
│ │ │ │ color : red
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego0
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 3.19, y : 1.276, theta_deg : 180.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego1 :
│ │ │ dict[5]
│ │ │ │ color : green
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego1
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 2.75, y : 2.175, theta_deg : 90.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego2 :
│ │ │ dict[5]
│ │ │ │ color : blue
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego2
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 2.75, y : 3.074, theta_deg : 90.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego3 :
│ │ │ dict[5]
│ │ │ │ color : red
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego3
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 1.914, y : 2.7492, theta_deg : 0.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ duckies : {}
│ │ environment :
│ │ |# 5x5 counter-clockwise loop with a 4-way intersection in the middle
│ │ |# Designed to test the 4-way intersection tile and traffic light
│ │ |tiles:
│ │ |- [floor, floor, floor, floor, floor, floor, floor]
│ │ |- [floor, curve_left/W , straight/W, 3way_left/W , straight/W, curve_left/N, floor]
│ │ |- [floor, straight/S , asphalt , straight/N , asphalt , straight/N, floor]
│ │ |- [floor, 3way_left/S , straight/W, 4way , straight/E, 3way_left/N, floor]
│ │ |- [floor, straight/S , asphalt , straight/S , asphalt , straight/N, floor]
│ │ |- [floor, curve_left/S , straight/E, 3way_left/E , straight/E, curve_left/E, floor]
│ │ |- [floor, floor, floor, floor, floor, floor, floor]
│ │ |
│ │ |objects:
│ │ | trafficlight:
│ │ | kind: trafficlight
│ │ | place:
│ │ | tile: [3,3]
│ │ | relative:
│ │ | ~SE2Transform:
│ │ | p: [-0.18,-0.18]
│ │ | theta_deg: 135
│ │ | height: 0.4
│ │ | optional: true
│ │ |
│ │ |tile_size: 0.585
│ │ |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16739
1686
Bea Baselines 🐤baseline-simple-yield aido-LFVI_multi-state-sim-testing
sim-0of4 success yes davinci-stage-11-6.2.53
2022-11-28 18:04:13+00:00 2022-11-28 18:16:20+00:00 0:12:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.237107191226386 deviation-center-line_median 0.23759334910349403
other stats deviation-center-line_max 2.1326977700633005 deviation-center-line_mean 0.6838879528223635 deviation-center-line_min 0.1276673430191657 deviation-heading_max 13.12196147454032 deviation-heading_mean 4.364557637939925 deviation-heading_median 1.584486276774531 deviation-heading_min 1.1672965236703177 distance-from-start_max 3.1342802968590027 distance-from-start_mean 1.8729192379232904 distance-from-start_median 2.1786983274170795 distance-from-start_min 4.440892098500626e-16 driven_any_max 5.758579747198662 driven_any_mean 4.134329883566824 driven_any_median 5.389369893534051 driven_any_min 5.329070518200751e-13 driven_lanedir_consec_max 5.458898880219736 driven_lanedir_consec_mean 3.983314078454992 driven_lanedir_consec_min 0.0001430511474609375 driven_lanedir_max 5.755160319127538 driven_lanedir_mean 4.130829489397701 driven_lanedir_median 5.384007293657903 driven_lanedir_min 0.0001430511474609375 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-001-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "in-drivable-lane": 0.0, "deviation-heading": 13.12196147454032, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 2.1326977700633005, "driven_lanedir_consec": 0.0001430511474609375}, "udem-001-ego1": {"driven_any": 5.250523118831771, "survival_time": 59.99999999999873, "driven_lanedir": 5.244914558422043, "in-drivable-lane": 0.0, "deviation-heading": 1.5492135672194798, "distance-from-start": 2.858024790062626, "deviation-center-line": 0.24799702258050904, "driven_lanedir_consec": 5.244914558422043}, "udem-001-ego2": {"driven_any": 5.758579747198662, "survival_time": 59.99999999999873, "driven_lanedir": 5.755160319127538, "in-drivable-lane": 0.0, "deviation-heading": 1.1672965236703177, "distance-from-start": 3.1342802968590027, "deviation-center-line": 0.1276673430191657, "driven_lanedir_consec": 5.458898880219736}, "udem-001-ego3": {"driven_any": 5.52821666823633, "survival_time": 59.99999999999873, "driven_lanedir": 5.523100028893762, "in-drivable-lane": 0.0, "deviation-heading": 1.6197589863295825, "distance-from-start": 1.4993718647715328, "deviation-center-line": 0.22718967562647904, "driven_lanedir_consec": 5.229299824030728}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16733
1688
Bea Baselines 🐤baseline-simple-yield aido-LFV_multi-state-sim-testing
sim-2of4 success yes davinci-stage-11-6.2.53
2022-11-28 17:59:25+00:00 2022-11-28 18:04:07+00:00 0:04:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.007019068997936 deviation-center-line_median 0.38011035127619336
other stats deviation-center-line_max 0.4837985399042229 deviation-center-line_mean 0.38011035127619336 deviation-center-line_min 0.2764221626481639 deviation-heading_max 3.0253232596119735 deviation-heading_mean 2.714016045259945 deviation-heading_median 2.714016045259945 deviation-heading_min 2.4027088309079163 distance-from-start_max 1.521674143069448 distance-from-start_mean 1.2769944684334753 distance-from-start_median 1.2769944684334753 distance-from-start_min 1.0323147937975024 driven_any_max 5.08623281214027 driven_any_mean 5.021228797880976 driven_any_median 5.021228797880976 driven_any_min 4.956224783621684 driven_lanedir_consec_max 5.0705723110226515 driven_lanedir_consec_mean 5.007019068997936 driven_lanedir_consec_min 4.94346582697322 driven_lanedir_max 5.0705723110226515 driven_lanedir_mean 5.007019068997936 driven_lanedir_median 5.007019068997936 driven_lanedir_min 4.94346582697322 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 4.956224783621684, "survival_time": 59.99999999999873, "driven_lanedir": 4.94346582697322, "in-drivable-lane": 0.0, "deviation-heading": 2.4027088309079163, "distance-from-start": 1.521674143069448, "deviation-center-line": 0.2764221626481639, "driven_lanedir_consec": 4.94346582697322}, "loop2-000-ego1": {"driven_any": 5.08623281214027, "survival_time": 59.99999999999873, "driven_lanedir": 5.0705723110226515, "in-drivable-lane": 0.0, "deviation-heading": 3.0253232596119735, "distance-from-start": 1.0323147937975024, "deviation-center-line": 0.4837985399042229, "driven_lanedir_consec": 5.0705723110226515}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16709
1697
Bea Baselines 🐤minimal-agent-full aido-LFV_multi-full-sim-validation
sim-0of4 success yes davinci-stage-11-6.2.53
2022-11-28 17:41:03+00:00 2022-11-28 17:59:18+00:00 0:18:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.024999999999956 driven_lanedir_consec_median 2.7186759709641253 deviation-center-line_median 5.862131942992704
other stats deviation-center-line_max 6.8926428573142395 deviation-center-line_mean 5.678345665140167 deviation-center-line_min 4.0964759172610234 deviation-heading_max 8.918457822311643 deviation-heading_mean 7.081123884150349 deviation-heading_median 7.087670971017298 deviation-heading_min 5.2306957722551575 distance-from-start_max 2.8296782642090292 distance-from-start_mean 1.888864829800502 distance-from-start_median 1.639347737745438 distance-from-start_min 1.4470855795021027 driven_any_max 3.524090671773667 driven_any_mean 3.5147133774298376 driven_any_median 3.518834998148701 driven_any_min 3.4970928416482807 driven_lanedir_consec_max 3.391077995430446 driven_lanedir_consec_mean 2.708466243383813 driven_lanedir_consec_min 2.0054350361765554 driven_lanedir_max 3.391077995430446 driven_lanedir_mean 3.3679532290440797 driven_lanedir_median 3.3641150341728117 driven_lanedir_min 3.3525048524002488 in-drivable-lane_max 2.749999999999872 in-drivable-lane_mean 2.162499999999953 in-drivable-lane_min 1.8500000000000263 per-episodes details {"autolab-000-ego0": {"driven_any": 3.5180863448801456, "survival_time": 59.99999999999873, "driven_lanedir": 3.373947912234794, "in-drivable-lane": 2.0499999999998835, "deviation-heading": 6.8453385018692146, "distance-from-start": 1.6666260059194336, "deviation-center-line": 4.0964759172610234, "driven_lanedir_consec": 2.0054350361765554}, "autolab-000-ego1": {"driven_any": 3.524090671773667, "survival_time": 59.99999999999873, "driven_lanedir": 3.391077995430446, "in-drivable-lane": 1.8500000000000263, "deviation-heading": 7.33000344016538, "distance-from-start": 2.8296782642090292, "deviation-center-line": 6.250381576789261, "driven_lanedir_consec": 3.391077995430446}, "autolab-000-ego2": {"driven_any": 3.4970928416482807, "survival_time": 59.99999999999873, "driven_lanedir": 3.354282156110829, "in-drivable-lane": 2.749999999999872, "deviation-heading": 5.2306957722551575, "distance-from-start": 1.612069469571442, "deviation-center-line": 6.8926428573142395, "driven_lanedir_consec": 3.354282156110829}, "autolab-000-ego3": {"driven_any": 3.5195836514172565, "survival_time": 59.99999999999873, "driven_lanedir": 3.3525048524002488, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 8.918457822311643, "distance-from-start": 1.4470855795021027, "deviation-center-line": 5.4738823091961475, "driven_lanedir_consec": 2.0830697858174214}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16698
1694
Bea Baselines 🐤minimal-agent-full aido-LFP-full-sim-validation
sim-2of4 success yes davinci-stage-11-6.2.53
2022-11-28 17:35:08+00:00 2022-11-28 17:40:56+00:00 0:05:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.1499999999999666 driven_lanedir_consec_median 1.4203998040440715 deviation-center-line_median 4.904463356399461
other stats deviation-center-line_max 4.904463356399461 deviation-center-line_mean 4.904463356399461 deviation-center-line_min 4.904463356399461 deviation-heading_max 7.745124858723169 deviation-heading_mean 7.745124858723169 deviation-heading_median 7.745124858723169 deviation-heading_min 7.745124858723169 distance-from-start_max 1.2059816832534165 distance-from-start_mean 1.2059816832534165 distance-from-start_median 1.2059816832534165 distance-from-start_min 1.2059816832534165 driven_any_max 3.485084016236962 driven_any_mean 3.485084016236962 driven_any_median 3.485084016236962 driven_any_min 3.485084016236962 driven_lanedir_consec_max 1.4203998040440715 driven_lanedir_consec_mean 1.4203998040440715 driven_lanedir_consec_min 1.4203998040440715 driven_lanedir_max 3.2905050472289954 driven_lanedir_mean 3.2905050472289954 driven_lanedir_median 3.2905050472289954 driven_lanedir_min 3.2905050472289954 in-drivable-lane_max 3.1499999999999666 in-drivable-lane_mean 3.1499999999999666 in-drivable-lane_min 3.1499999999999666 per-episodes details {"loop2-000-ego0": {"driven_any": 3.485084016236962, "survival_time": 59.99999999999873, "driven_lanedir": 3.2905050472289954, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.745124858723169, "distance-from-start": 1.2059816832534165, "deviation-center-line": 4.904463356399461, "driven_lanedir_consec": 1.4203998040440715}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible