Duckietown Challenges Home Challenges Submissions

Evaluator 121

ID121
evaluatordavinci-stage-04-6.2.51
owneruser1000001
machinedavinci-stage
processdavinci-stage-04-6.2.51
version6.2.51
first heard
last heard
statusinactive
# evaluating
# success240 15125
# timeout2 16209
# failed50 15145
# error1 15885
# aborted3 15182
# host-error6 15044
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)2.8 GHz
Free % of processors99%
RAM total (MB)251.6 GB
RAM free (MB)244.2 GB
Disk (MB)491.1 GB
Disk available (MB)174.6 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, ETH_small_intersect
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
166561712Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-validationsim-0of3host-erroryesdavinci-stage-04-6.2.510:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  [Previous line repeated 2 more times]
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
166511701Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-testingsim-2of4host-erroryesdavinci-stage-04-6.2.510:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  [Previous line repeated 2 more times]
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
166491700Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-testingsim-1of4timeoutyesdavinci-stage-04-6.2.51----No reset possible
166471700Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-testingsim-2of4successyesdavinci-stage-04-6.2.510:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
166441701Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-testingsim-0of4successyesdavinci-stage-04-6.2.510:03:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median25.200000000000223
in-drivable-lane_median1.1000000000000156
driven_lanedir_consec_median1.3557424143249113
deviation-center-line_median2.2764052687353016


other stats
deviation-center-line_max2.2764052687353016
deviation-center-line_mean2.2764052687353016
deviation-center-line_min2.2764052687353016
deviation-heading_max2.9201829757406066
deviation-heading_mean2.9201829757406066
deviation-heading_median2.9201829757406066
deviation-heading_min2.9201829757406066
distance-from-start_max1.1340032910142968
distance-from-start_mean1.1340032910142968
distance-from-start_median1.1340032910142968
distance-from-start_min1.1340032910142968
driven_any_max1.4165963270662665
driven_any_mean1.4165963270662665
driven_any_median1.4165963270662665
driven_any_min1.4165963270662665
driven_lanedir_consec_max1.3557424143249113
driven_lanedir_consec_mean1.3557424143249113
driven_lanedir_consec_min1.3557424143249113
driven_lanedir_max1.3557424143249113
driven_lanedir_mean1.3557424143249113
driven_lanedir_median1.3557424143249113
driven_lanedir_min1.3557424143249113
in-drivable-lane_max1.1000000000000156
in-drivable-lane_mean1.1000000000000156
in-drivable-lane_min1.1000000000000156
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.4165963270662665, "survival_time": 25.200000000000223, "driven_lanedir": 1.3557424143249113, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.9201829757406066, "distance-from-start": 1.1340032910142968, "deviation-center-line": 2.2764052687353016, "driven_lanedir_consec": 1.3557424143249113}}
simulation-passed1
survival_time_max25.200000000000223
survival_time_mean25.200000000000223
survival_time_min25.200000000000223
No reset possible
166401702Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-testingsim-3of4successyesdavinci-stage-04-6.2.510:07:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.349999999999895
driven_lanedir_consec_median2.0916627020116696
deviation-center-line_median5.917247386091067


other stats
deviation-center-line_max5.917247386091067
deviation-center-line_mean5.917247386091067
deviation-center-line_min5.917247386091067
deviation-heading_max8.389432171221175
deviation-heading_mean8.389432171221175
deviation-heading_median8.389432171221175
deviation-heading_min8.389432171221175
distance-from-start_max1.030783298044124
distance-from-start_mean1.030783298044124
distance-from-start_median1.030783298044124
distance-from-start_min1.030783298044124
driven_any_max3.449081983725078
driven_any_mean3.449081983725078
driven_any_median3.449081983725078
driven_any_min3.449081983725078
driven_lanedir_consec_max2.0916627020116696
driven_lanedir_consec_mean2.0916627020116696
driven_lanedir_consec_min2.0916627020116696
driven_lanedir_max3.204014012014441
driven_lanedir_mean3.204014012014441
driven_lanedir_median3.204014012014441
driven_lanedir_min3.204014012014441
in-drivable-lane_max4.349999999999895
in-drivable-lane_mean4.349999999999895
in-drivable-lane_min4.349999999999895
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.449081983725078, "survival_time": 59.99999999999873, "driven_lanedir": 3.204014012014441, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.389432171221175, "distance-from-start": 1.030783298044124, "deviation-center-line": 5.917247386091067, "driven_lanedir_consec": 2.0916627020116696}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
166311704Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-testingsim-3of4successyesdavinci-stage-04-6.2.510:19:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.749999999999955
driven_lanedir_consec_median2.967583630098515
deviation-center-line_median4.936499581762261


other stats
deviation-center-line_max5.730573072686608
deviation-center-line_mean4.869852167143673
deviation-center-line_min3.875836432363564
deviation-heading_max12.742085043936966
deviation-heading_mean11.755117428407974
deviation-heading_median12.00130779644692
deviation-heading_min10.275769076801083
distance-from-start_max2.7363667230349455
distance-from-start_mean2.401179119880523
distance-from-start_median2.61282418444398
distance-from-start_min1.6427013875991858
driven_any_max3.5075798773472937
driven_any_mean3.403608315922737
driven_any_median3.4775792335299394
driven_any_min3.151694919283776
driven_lanedir_consec_max3.096555837247597
driven_lanedir_consec_mean2.687260211745085
driven_lanedir_consec_min1.7173177495357104
driven_lanedir_max3.302520401483574
driven_lanedir_mean3.1893582258787174
driven_lanedir_median3.236776064167141
driven_lanedir_min2.9813603736970133
in-drivable-lane_max3.6999999999998785
in-drivable-lane_mean2.762499999999936
in-drivable-lane_min1.8499999999999537
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.4685801016173095, "survival_time": 59.99999999999873, "driven_lanedir": 3.2300333077609547, "in-drivable-lane": 3.6999999999998785, "deviation-heading": 10.275769076801083, "distance-from-start": 2.544064021687348, "deviation-center-line": 4.350076895892649, "driven_lanedir_consec": 2.9538068865000175}, "zigzag-000-ego1": {"driven_any": 3.4865783654425693, "survival_time": 59.99999999999873, "driven_lanedir": 3.2435188205733265, "in-drivable-lane": 3.099999999999887, "deviation-heading": 11.389215220096572, "distance-from-start": 2.681584347200612, "deviation-center-line": 5.5229222676318726, "driven_lanedir_consec": 3.096555837247597}, "zigzag-000-ego2": {"driven_any": 3.5075798773472937, "survival_time": 59.99999999999873, "driven_lanedir": 3.302520401483574, "in-drivable-lane": 2.400000000000023, "deviation-heading": 12.61340037279727, "distance-from-start": 1.6427013875991858, "deviation-center-line": 3.875836432363564, "driven_lanedir_consec": 1.7173177495357104}, "zigzag-000-ego3": {"driven_any": 3.151694919283776, "survival_time": 59.99999999999873, "driven_lanedir": 2.9813603736970133, "in-drivable-lane": 1.8499999999999537, "deviation-heading": 12.742085043936966, "distance-from-start": 2.7363667230349455, "deviation-center-line": 5.730573072686608, "driven_lanedir_consec": 2.9813603736970133}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
166281705Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-testingsim-3of4successyesdavinci-stage-04-6.2.510:01:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
166231706Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-testingsim-3of4successyesdavinci-stage-04-6.2.510:06:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.849999999999876
driven_lanedir_consec_median2.226136954518312
deviation-center-line_median6.024694972149957


other stats
deviation-center-line_max6.024694972149957
deviation-center-line_mean6.024694972149957
deviation-center-line_min6.024694972149957
deviation-heading_max10.118703616800987
deviation-heading_mean10.118703616800987
deviation-heading_median10.118703616800987
deviation-heading_min10.118703616800987
distance-from-start_max1.7127730347184449
distance-from-start_mean1.7127730347184449
distance-from-start_median1.7127730347184449
distance-from-start_min1.7127730347184449
driven_any_max3.434377949467938
driven_any_mean3.434377949467938
driven_any_median3.434377949467938
driven_any_min3.434377949467938
driven_lanedir_consec_max2.226136954518312
driven_lanedir_consec_mean2.226136954518312
driven_lanedir_consec_min2.226136954518312
driven_lanedir_max3.149126612551262
driven_lanedir_mean3.149126612551262
driven_lanedir_median3.149126612551262
driven_lanedir_min3.149126612551262
in-drivable-lane_max4.849999999999876
in-drivable-lane_mean4.849999999999876
in-drivable-lane_min4.849999999999876
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.434377949467938, "survival_time": 59.99999999999873, "driven_lanedir": 3.149126612551262, "in-drivable-lane": 4.849999999999876, "deviation-heading": 10.118703616800987, "distance-from-start": 1.7127730347184449, "deviation-center-line": 6.024694972149957, "driven_lanedir_consec": 2.226136954518312}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
166171708Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-validationsim-1of4successyesdavinci-stage-04-6.2.510:03:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.449999999999882
driven_lanedir_consec_median3.3057932853077427
deviation-center-line_median7.154226688493768


other stats
deviation-center-line_max7.154226688493768
deviation-center-line_mean7.154226688493768
deviation-center-line_min7.154226688493768
deviation-heading_max5.348097201635609
deviation-heading_mean5.348097201635609
deviation-heading_median5.348097201635609
deviation-heading_min5.348097201635609
distance-from-start_max1.6303675543068192
distance-from-start_mean1.6303675543068192
distance-from-start_median1.6303675543068192
distance-from-start_min1.6303675543068192
driven_any_max3.47609109580057
driven_any_mean3.47609109580057
driven_any_median3.47609109580057
driven_any_min3.47609109580057
driven_lanedir_consec_max3.3057932853077427
driven_lanedir_consec_mean3.3057932853077427
driven_lanedir_consec_min3.3057932853077427
driven_lanedir_max3.3057932853077427
driven_lanedir_mean3.3057932853077427
driven_lanedir_median3.3057932853077427
driven_lanedir_min3.3057932853077427
in-drivable-lane_max3.449999999999882
in-drivable-lane_mean3.449999999999882
in-drivable-lane_min3.449999999999882
per-episodes
details{"loop-000-ego0": {"driven_any": 3.47609109580057, "survival_time": 59.99999999999873, "driven_lanedir": 3.3057932853077427, "in-drivable-lane": 3.449999999999882, "deviation-heading": 5.348097201635609, "distance-from-start": 1.6303675543068192, "deviation-center-line": 7.154226688493768, "driven_lanedir_consec": 3.3057932853077427}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
166141709Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-validationsim-0of4successyesdavinci-stage-04-6.2.510:05:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.4226928398281333
deviation-center-line_median4.174748477462163


other stats
deviation-center-line_max4.174748477462163
deviation-center-line_mean4.174748477462163
deviation-center-line_min4.174748477462163
deviation-heading_max4.533756317111154
deviation-heading_mean4.533756317111154
deviation-heading_median4.533756317111154
deviation-heading_min4.533756317111154
distance-from-start_max2.2784552815665835
distance-from-start_mean2.2784552815665835
distance-from-start_median2.2784552815665835
distance-from-start_min2.2784552815665835
driven_any_max3.579587154113982
driven_any_mean3.579587154113982
driven_any_median3.579587154113982
driven_any_min3.579587154113982
driven_lanedir_consec_max3.4226928398281333
driven_lanedir_consec_mean3.4226928398281333
driven_lanedir_consec_min3.4226928398281333
driven_lanedir_max3.55610753301965
driven_lanedir_mean3.55610753301965
driven_lanedir_median3.55610753301965
driven_lanedir_min3.55610753301965
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 3.579587154113982, "survival_time": 59.99999999999873, "driven_lanedir": 3.55610753301965, "in-drivable-lane": 0.0, "deviation-heading": 4.533756317111154, "distance-from-start": 2.2784552815665835, "deviation-center-line": 4.174748477462163, "driven_lanedir_consec": 3.4226928398281333}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
166121709Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-validationsim-2of4successyesdavinci-stage-04-6.2.510:01:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
166071711Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-validationsim-2of4successyesdavinci-stage-04-6.2.510:09:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.499999999999858
driven_lanedir_consec_median2.073568167625771
deviation-center-line_median5.586339009536689


other stats
deviation-center-line_max5.586339009536689
deviation-center-line_mean5.586339009536689
deviation-center-line_min5.586339009536689
deviation-heading_max4.940364769457971
deviation-heading_mean4.940364769457971
deviation-heading_median4.940364769457971
deviation-heading_min4.940364769457971
distance-from-start_max1.7409270883034778
distance-from-start_mean1.7409270883034778
distance-from-start_median1.7409270883034778
distance-from-start_min1.7409270883034778
driven_any_max3.504586985619137
driven_any_mean3.504586985619137
driven_any_median3.504586985619137
driven_any_min3.504586985619137
driven_lanedir_consec_max2.073568167625771
driven_lanedir_consec_mean2.073568167625771
driven_lanedir_consec_min2.073568167625771
driven_lanedir_max3.360909384451456
driven_lanedir_mean3.360909384451456
driven_lanedir_median3.360909384451456
driven_lanedir_min3.360909384451456
in-drivable-lane_max2.499999999999858
in-drivable-lane_mean2.499999999999858
in-drivable-lane_min2.499999999999858
per-episodes
details{"4way-000-ego0": {"driven_any": 3.504586985619137, "survival_time": 59.99999999999873, "driven_lanedir": 3.360909384451456, "in-drivable-lane": 2.499999999999858, "deviation-heading": 4.940364769457971, "distance-from-start": 1.7409270883034778, "deviation-center-line": 5.586339009536689, "driven_lanedir_consec": 2.073568167625771}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
166021712Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-validationsim-0of3abortedyesdavinci-stage-04-6.2.510:01:27
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 177, in object_from_ipce_
    return object_from_ipce_dict(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 461, in object_from_ipce_dict
    attrs[k] = object_from_ipce_(v, et_V, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 391, in object_from_ipce_dataclass_instance
    raise ZValueError(msg, anns=anns, T=T, known=sorted(mj), f=f)
zuper_commons.types.exceptions.ZValueError: Cannot find field 'dynamics' in data for class ScenarioRobotSpec and no default available
│  anns: dict[7]
│        │ configuration: RobotConfiguration
│        │ color: str
│        │ description: str
│        │ controllable: bool
│        │ protocol: Optional[ProtocolDesc ]
│        │ dynamics: str
│        │ dynamics_params: Dict[str,Any ]
│     T: str
│ known: [color, configuration, controllable, description, protocol]
│     f: Field(name='dynamics',type=<class 'str'>,default=<dataclasses._MISSING_TYPE object at 0x7fc83dfc0e20>,default_factory=<dataclasses._MISSING_TYPE object at 0x7fc83dfc0e20>,init=True,repr=True,hash=None,compare=True,metadata=mappingproxy({}),_field_type=_FIELD)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 74, in object_from_ipce
    res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'robots' of Scenario.
│ K_annotations: dict[6]
│                │ scenario_name: str
│                │ environment: Any
│                │ player_robots: List[str]
│                │ robots: Dict[str,ScenarioRobotSpec]
│                │ duckies: Dict[str,ScenarioDuckieSpec]
│                │ payload_yaml: str
│   expect_type: Dict[str,ScenarioRobotSpec]
│         ann_K: Dict[str,ScenarioRobotSpec]
│        K_name: Scenario

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 167, in main
    episodes0 = get_episodes_from_dirs(config.scenarios)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 833, in get_episodes_from_dirs
    scenario = cast(Scenario, object_from_ipce(config_, Scenario))
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 93, in object_from_ipce
    raise ZValueError(msg, expect_type=expect_type, mj=mj) from e
zuper_commons.types.exceptions.ZValueError: Cannot deserialize object
│ expect_type: Scenario
│          mj: dict[6]
│              │ payload_yaml: ''
│              │ player_robots: [ego0, ego1, ego2, ego3]
│              │ scenario_name: LFV_multi-state-4way-000
│              │ robots:
│              │ dict[4]
│              │ │ ego0:
│              │ │ dict[5]
│              │ │ │ color: red
│              │ │ │ protocol: PROTOCOL_STATE
│              │ │ │ description: Playable robot ego0
│              │ │ │ controllable: True
│              │ │ │ configuration: {pose: {x: 3.19, y: 1.276, theta_deg: 180.0} , velocity: {x: 0.0, y: 0.0, theta_deg: 0.0} }
│              │ │ ego1:
│              │ │ dict[5]
│              │ │ │ color: green
│              │ │ │ protocol: PROTOCOL_STATE
│              │ │ │ description: Playable robot ego1
│              │ │ │ controllable: True
│              │ │ │ configuration: {pose: {x: 2.75, y: 2.175, theta_deg: 90.0} , velocity: {x: 0.0, y: 0.0, theta_deg: 0.0} }
│              │ │ ego2:
│              │ │ dict[5]
│              │ │ │ color: blue
│              │ │ │ protocol: PROTOCOL_STATE
│              │ │ │ description: Playable robot ego2
│              │ │ │ controllable: True
│              │ │ │ configuration: {pose: {x: 2.75, y: 3.074, theta_deg: 90.0} , velocity: {x: 0.0, y: 0.0, theta_deg: 0.0} }
│              │ │ ego3:
│              │ │ dict[5]
│              │ │ │ color: red
│              │ │ │ protocol: PROTOCOL_STATE
│              │ │ │ description: Playable robot ego3
│              │ │ │ controllable: True
│              │ │ │ configuration: {pose: {x: 1.914, y: 2.7492, theta_deg: 0.0} , velocity: {x: 0.0, y: 0.0, theta_deg: 0.0} }
│              │ duckies: {}
│              │ environment:
│              │ |# 5x5 counter-clockwise loop with a 4-way intersection in the middle
│              │ |# Designed to test the 4-way intersection tile and traffic light
│              │ |tiles:
│              │ |- [floor, floor, floor, floor, floor, floor, floor]
│              │ |- [floor, curve_left/W , straight/W, 3way_left/W   , straight/W, curve_left/N, floor]
│              │ |- [floor, straight/S   , asphalt   , straight/N    , asphalt   , straight/N, floor]
│              │ |- [floor, 3way_left/S  , straight/W, 4way          , straight/E, 3way_left/N, floor]
│              │ |- [floor, straight/S   , asphalt   , straight/S    , asphalt   , straight/N, floor]
│              │ |- [floor, curve_left/S , straight/E, 3way_left/E   , straight/E, curve_left/E, floor]
│              │ |- [floor, floor, floor, floor, floor, floor, floor]
│              │ |
│              │ |objects:
│              │ |  trafficlight:
│              │ |    kind: trafficlight
│              │ |    place:
│              │ |      tile: [3,3]
│              │ |      relative:
│              │ |        ~SE2Transform:
│              │ |          p: [-0.18,-0.18]
│              │ |          theta_deg: 135
│              │ |    height: 0.4
│              │ |    optional: true
│              │ |
│              │ |tile_size: 0.585
│              │ |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
165971713Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-validationsim-0of4successyesdavinci-stage-04-6.2.510:03:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median38.69999999999994
in-drivable-lane_median1.1000000000000156
driven_lanedir_consec_median2.128702834048944
deviation-center-line_median2.983588623443892


other stats
deviation-center-line_max2.983588623443892
deviation-center-line_mean2.983588623443892
deviation-center-line_min2.983588623443892
deviation-heading_max7.04246757923185
deviation-heading_mean7.04246757923185
deviation-heading_median7.04246757923185
deviation-heading_min7.04246757923185
distance-from-start_max1.8921505020832197
distance-from-start_mean1.8921505020832197
distance-from-start_median1.8921505020832197
distance-from-start_min1.8921505020832197
driven_any_max2.2265921855085775
driven_any_mean2.2265921855085775
driven_any_median2.2265921855085775
driven_any_min2.2265921855085775
driven_lanedir_consec_max2.128702834048944
driven_lanedir_consec_mean2.128702834048944
driven_lanedir_consec_min2.128702834048944
driven_lanedir_max2.128702834048944
driven_lanedir_mean2.128702834048944
driven_lanedir_median2.128702834048944
driven_lanedir_min2.128702834048944
in-drivable-lane_max1.1000000000000156
in-drivable-lane_mean1.1000000000000156
in-drivable-lane_min1.1000000000000156
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.2265921855085775, "survival_time": 38.69999999999994, "driven_lanedir": 2.128702834048944, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 7.04246757923185, "distance-from-start": 1.8921505020832197, "deviation-center-line": 2.983588623443892, "driven_lanedir_consec": 2.128702834048944}}
simulation-passed1
survival_time_max38.69999999999994
survival_time_mean38.69999999999994
survival_time_min38.69999999999994
No reset possible
165901715Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-testingsim-1of4successyesdavinci-stage-04-6.2.510:05:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.548280526093551
deviation-center-line_median3.9116147681867446


other stats
deviation-center-line_max3.9116147681867446
deviation-center-line_mean3.9116147681867446
deviation-center-line_min3.9116147681867446
deviation-heading_max4.21820918012117
deviation-heading_mean4.21820918012117
deviation-heading_median4.21820918012117
deviation-heading_min4.21820918012117
distance-from-start_max2.3398538209611455
distance-from-start_mean2.3398538209611455
distance-from-start_median2.3398538209611455
distance-from-start_min2.3398538209611455
driven_any_max3.579594786375953
driven_any_mean3.579594786375953
driven_any_median3.579594786375953
driven_any_min3.579594786375953
driven_lanedir_consec_max3.548280526093551
driven_lanedir_consec_mean3.548280526093551
driven_lanedir_consec_min3.548280526093551
driven_lanedir_max3.5551990211644577
driven_lanedir_mean3.5551990211644577
driven_lanedir_median3.5551990211644577
driven_lanedir_min3.5551990211644577
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-000-ego0": {"driven_any": 3.579594786375953, "survival_time": 59.99999999999873, "driven_lanedir": 3.5551990211644577, "in-drivable-lane": 0.0, "deviation-heading": 4.21820918012117, "distance-from-start": 2.3398538209611455, "deviation-center-line": 3.9116147681867446, "driven_lanedir_consec": 3.548280526093551}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
165851716Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-testingsim-2of4successyesdavinci-stage-04-6.2.510:09:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.0050106271821506
deviation-center-line_median4.908963644722344


other stats
deviation-center-line_max6.01198792060873
deviation-center-line_mean4.593358939184355
deviation-center-line_min2.5435205466839994
deviation-heading_max5.727471290631747
deviation-heading_mean4.526175130231045
deviation-heading_median4.686700534848095
deviation-heading_min3.003828160596244
distance-from-start_max2.5613241003039633
distance-from-start_mean1.914912599777095
distance-from-start_median1.98188247541307
distance-from-start_min1.134561347978277
driven_any_max3.579580754957026
driven_any_mean3.2360870781772753
driven_any_median3.2450849856660264
driven_any_min2.8745975864200206
driven_lanedir_consec_max3.211958001358496
driven_lanedir_consec_mean3.019665595541482
driven_lanedir_consec_min2.856683126443131
driven_lanedir_max3.5310621633486874
driven_lanedir_mean3.181338396476557
driven_lanedir_median3.1688041281752737
driven_lanedir_min2.856683166206994
in-drivable-lane_max2.2000000000000313
in-drivable-lane_mean0.5500000000000078
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 2.8745975864200206, "survival_time": 59.99999999999873, "driven_lanedir": 2.856683166206994, "in-drivable-lane": 0.0, "deviation-heading": 3.003828160596244, "distance-from-start": 2.345983319386262, "deviation-center-line": 5.525958630071963, "driven_lanedir_consec": 2.856683126443131}, "4way-000-ego1": {"driven_any": 2.9765951859105204, "survival_time": 59.99999999999873, "driven_lanedir": 2.9585702681138724, "in-drivable-lane": 0.0, "deviation-heading": 3.74577370363053, "distance-from-start": 1.6177816314398783, "deviation-center-line": 6.01198792060873, "driven_lanedir_consec": 2.9318251947402816}, "4way-000-ego2": {"driven_any": 3.513574785421533, "survival_time": 59.99999999999873, "driven_lanedir": 3.379037988236675, "in-drivable-lane": 2.2000000000000313, "deviation-heading": 5.62762736606566, "distance-from-start": 2.5613241003039633, "deviation-center-line": 2.5435205466839994, "driven_lanedir_consec": 3.0781960596240197}, "4way-000-ego3": {"driven_any": 3.579580754957026, "survival_time": 59.99999999999873, "driven_lanedir": 3.5310621633486874, "in-drivable-lane": 0.0, "deviation-heading": 5.727471290631747, "distance-from-start": 1.134561347978277, "deviation-center-line": 4.291968659372725, "driven_lanedir_consec": 3.211958001358496}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
165801718Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-testingsim-2of4successyesdavinci-stage-04-6.2.510:04:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.3499999999998806
driven_lanedir_consec_median2.380746158820441
deviation-center-line_median6.07518739971563


other stats
deviation-center-line_max6.5629821214913955
deviation-center-line_mean6.07518739971563
deviation-center-line_min5.587392677939865
deviation-heading_max8.266160603781476
deviation-heading_mean7.316254408081507
deviation-heading_median7.316254408081507
deviation-heading_min6.3663482123815385
distance-from-start_max1.6314589686392718
distance-from-start_mean1.433307130896814
distance-from-start_median1.433307130896814
distance-from-start_min1.235155293154356
driven_any_max3.4865836169069464
driven_any_mean3.479150653763286
driven_any_median3.479150653763286
driven_any_min3.471717690619625
driven_lanedir_consec_max3.2882116374610164
driven_lanedir_consec_mean2.380746158820441
driven_lanedir_consec_min1.4732806801798657
driven_lanedir_max3.2882116374610164
driven_lanedir_mean3.2881134223745017
driven_lanedir_median3.2881134223745017
driven_lanedir_min3.2880152072879874
in-drivable-lane_max3.5999999999997954
in-drivable-lane_mean3.3499999999998806
in-drivable-lane_min3.099999999999966
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.471717690619625, "survival_time": 59.99999999999873, "driven_lanedir": 3.2882116374610164, "in-drivable-lane": 3.5999999999997954, "deviation-heading": 6.3663482123815385, "distance-from-start": 1.6314589686392718, "deviation-center-line": 6.5629821214913955, "driven_lanedir_consec": 3.2882116374610164}, "loop2-000-ego1": {"driven_any": 3.4865836169069464, "survival_time": 59.99999999999873, "driven_lanedir": 3.2880152072879874, "in-drivable-lane": 3.099999999999966, "deviation-heading": 8.266160603781476, "distance-from-start": 1.235155293154356, "deviation-center-line": 5.587392677939865, "driven_lanedir_consec": 1.4732806801798657}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
165751719Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-1of4successyesdavinci-stage-04-6.2.510:09:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.1499999999999666
driven_lanedir_consec_median1.4204229695892396
deviation-center-line_median4.903602912090087


other stats
deviation-center-line_max4.903602912090087
deviation-center-line_mean4.903602912090087
deviation-center-line_min4.903602912090087
deviation-heading_max7.744574187082735
deviation-heading_mean7.744574187082735
deviation-heading_median7.744574187082735
deviation-heading_min7.744574187082735
distance-from-start_max1.206000814743228
distance-from-start_mean1.206000814743228
distance-from-start_median1.206000814743228
distance-from-start_min1.206000814743228
driven_any_max3.4850840176979623
driven_any_mean3.4850840176979623
driven_any_median3.4850840176979623
driven_any_min3.4850840176979623
driven_lanedir_consec_max1.4204229695892396
driven_lanedir_consec_mean1.4204229695892396
driven_lanedir_consec_min1.4204229695892396
driven_lanedir_max3.2904978754707774
driven_lanedir_mean3.2904978754707774
driven_lanedir_median3.2904978754707774
driven_lanedir_min3.2904978754707774
in-drivable-lane_max3.1499999999999666
in-drivable-lane_mean3.1499999999999666
in-drivable-lane_min3.1499999999999666
per-episodes
details{"loop-000-ego0": {"driven_any": 3.4850840176979623, "survival_time": 59.99999999999873, "driven_lanedir": 3.2904978754707774, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.744574187082735, "distance-from-start": 1.206000814743228, "deviation-center-line": 4.903602912090087, "driven_lanedir_consec": 1.4204229695892396}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
165701720Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-testingsim-3of4successyesdavinci-stage-04-6.2.510:06:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.099999999999824
driven_lanedir_consec_median3.094905429410056
deviation-center-line_median4.472617520975966


other stats
deviation-center-line_max4.472617520975966
deviation-center-line_mean4.472617520975966
deviation-center-line_min4.472617520975966
deviation-heading_max11.268842029535884
deviation-heading_mean11.268842029535884
deviation-heading_median11.268842029535884
deviation-heading_min11.268842029535884
distance-from-start_max2.5739500581986148
distance-from-start_mean2.5739500581986148
distance-from-start_median2.5739500581986148
distance-from-start_min2.5739500581986148
driven_any_max3.486579242992935
driven_any_mean3.486579242992935
driven_any_median3.486579242992935
driven_any_min3.486579242992935
driven_lanedir_consec_max3.094905429410056
driven_lanedir_consec_mean3.094905429410056
driven_lanedir_consec_min3.094905429410056
driven_lanedir_max3.2535717731810343
driven_lanedir_mean3.2535717731810343
driven_lanedir_median3.2535717731810343
driven_lanedir_min3.2535717731810343
in-drivable-lane_max3.099999999999824
in-drivable-lane_mean3.099999999999824
in-drivable-lane_min3.099999999999824
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.486579242992935, "survival_time": 59.99999999999873, "driven_lanedir": 3.2535717731810343, "in-drivable-lane": 3.099999999999824, "deviation-heading": 11.268842029535884, "distance-from-start": 2.5739500581986148, "deviation-center-line": 4.472617520975966, "driven_lanedir_consec": 3.094905429410056}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
165651721Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-testingsim-3of4successyesdavinci-stage-04-6.2.510:05:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.489526926942431
deviation-center-line_median5.459978779188341


other stats
deviation-center-line_max5.459978779188341
deviation-center-line_mean5.459978779188341
deviation-center-line_min5.459978779188341
deviation-heading_max11.314241959835243
deviation-heading_mean11.314241959835243
deviation-heading_median11.314241959835243
deviation-heading_min11.314241959835243
distance-from-start_max3.0851207054617977
distance-from-start_mean3.0851207054617977
distance-from-start_median3.0851207054617977
distance-from-start_min3.0851207054617977
driven_any_max3.57958884925181
driven_any_mean3.57958884925181
driven_any_median3.57958884925181
driven_any_min3.57958884925181
driven_lanedir_consec_max3.489526926942431
driven_lanedir_consec_mean3.489526926942431
driven_lanedir_consec_min3.489526926942431
driven_lanedir_max3.489526926942431
driven_lanedir_mean3.489526926942431
driven_lanedir_median3.489526926942431
driven_lanedir_min3.489526926942431
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.57958884925181, "survival_time": 59.99999999999873, "driven_lanedir": 3.489526926942431, "in-drivable-lane": 0.0, "deviation-heading": 11.314241959835243, "distance-from-start": 3.0851207054617977, "deviation-center-line": 5.459978779188341, "driven_lanedir_consec": 3.489526926942431}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
165571724Bea Baselines 🐤minimal-agentaido-LFVI-sim-validationsim-1of4successyesdavinci-stage-04-6.2.510:02:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.04999999999998
in-drivable-lane_median4.749999999999984
driven_lanedir_consec_median0.331229062365487
deviation-center-line_median0.26973530940385876


other stats
deviation-center-line_max0.26973530940385876
deviation-center-line_mean0.26973530940385876
deviation-center-line_min0.26973530940385876
deviation-heading_max2.5383505748046193
deviation-heading_mean2.5383505748046193
deviation-heading_median2.5383505748046193
deviation-heading_min2.5383505748046193
distance-from-start_max1.1587848457868677
distance-from-start_mean1.1587848457868677
distance-from-start_median1.1587848457868677
distance-from-start_min1.1587848457868677
driven_any_max1.158841900114123
driven_any_mean1.158841900114123
driven_any_median1.158841900114123
driven_any_min1.158841900114123
driven_lanedir_consec_max0.331229062365487
driven_lanedir_consec_mean0.331229062365487
driven_lanedir_consec_min0.331229062365487
driven_lanedir_max0.331229062365487
driven_lanedir_mean0.331229062365487
driven_lanedir_median0.331229062365487
driven_lanedir_min0.331229062365487
in-drivable-lane_max4.749999999999984
in-drivable-lane_mean4.749999999999984
in-drivable-lane_min4.749999999999984
per-episodes
details{"4way-000-ego0": {"driven_any": 1.158841900114123, "survival_time": 8.04999999999998, "driven_lanedir": 0.331229062365487, "in-drivable-lane": 4.749999999999984, "deviation-heading": 2.5383505748046193, "distance-from-start": 1.1587848457868677, "deviation-center-line": 0.26973530940385876, "driven_lanedir_consec": 0.331229062365487}}
simulation-passed1
survival_time_max8.04999999999998
survival_time_mean8.04999999999998
survival_time_min8.04999999999998
No reset possible
165531725Bea Baselines 🐤minimal-agentaido-LFI-sim-validationsim-2of4successyesdavinci-stage-04-6.2.510:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
165511726Bea Baselines 🐤minimal-agentaido-LF-sim-validationsim-2of4successyesdavinci-stage-04-6.2.510:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.19694617160956465
survival_time_median10.450000000000014
deviation-center-line_median0.1253907294304808
in-drivable-lane_median8.700000000000014


other stats
deviation-center-line_max0.1253907294304808
deviation-center-line_mean0.1253907294304808
deviation-center-line_min0.1253907294304808
deviation-heading_max0.9520924629376074
deviation-heading_mean0.9520924629376074
deviation-heading_median0.9520924629376074
deviation-heading_min0.9520924629376074
distance-from-start_max1.5508236376562086
distance-from-start_mean1.5508236376562086
distance-from-start_median1.5508236376562086
distance-from-start_min1.5508236376562086
driven_any_max1.5511368313112877
driven_any_mean1.5511368313112877
driven_any_median1.5511368313112877
driven_any_min1.5511368313112877
driven_lanedir_consec_max0.19694617160956465
driven_lanedir_consec_mean0.19694617160956465
driven_lanedir_consec_min0.19694617160956465
driven_lanedir_max0.19694617160956465
driven_lanedir_mean0.19694617160956465
driven_lanedir_median0.19694617160956465
driven_lanedir_min0.19694617160956465
in-drivable-lane_max8.700000000000014
in-drivable-lane_mean8.700000000000014
in-drivable-lane_min8.700000000000014
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.5511368313112877, "survival_time": 10.450000000000014, "driven_lanedir": 0.19694617160956465, "in-drivable-lane": 8.700000000000014, "deviation-heading": 0.9520924629376074, "distance-from-start": 1.5508236376562086, "deviation-center-line": 0.1253907294304808, "driven_lanedir_consec": 0.19694617160956465}}
simulation-passed1
survival_time_max10.450000000000014
survival_time_mean10.450000000000014
survival_time_min10.450000000000014
No reset possible
165441727Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-validationsim-1of4successyesdavinci-stage-04-6.2.510:03:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.250000000000025
in-drivable-lane_median8.525000000000027
driven_lanedir_consec_median0.3694034459669367
deviation-center-line_median0.2032026824105824


other stats
deviation-center-line_max0.49385537805641655
deviation-center-line_mean0.2564840317596989
deviation-center-line_min0.1256753841612143
deviation-heading_max2.207424396094566
deviation-heading_mean1.2068820169473446
deviation-heading_median0.9361471003737372
deviation-heading_min0.7478094709473372
distance-from-start_max1.6837476731392336
distance-from-start_mean0.85867246141252
distance-from-start_median0.688920693167693
distance-from-start_min0.3731007861754605
driven_any_max1.6838575324025151
driven_any_mean0.8587081494464717
driven_any_median0.6889338157826281
driven_any_min0.3731074338181155
driven_lanedir_consec_max0.737521974955665
driven_lanedir_consec_mean0.40900650829720153
driven_lanedir_consec_min0.15969716629926767
driven_lanedir_max0.737521974955665
driven_lanedir_mean0.40900650829720153
driven_lanedir_median0.3694034459669367
driven_lanedir_min0.15969716629926767
in-drivable-lane_max9.800000000000026
in-drivable-lane_mean8.17500000000003
in-drivable-lane_min5.850000000000036
per-episodes
details{"4way-000-ego0": {"driven_any": 0.3731074338181155, "survival_time": 11.250000000000025, "driven_lanedir": 0.1995526730519679, "in-drivable-lane": 9.500000000000025, "deviation-heading": 0.9488219555580462, "distance-from-start": 0.3731007861754605, "deviation-center-line": 0.1256753841612143, "driven_lanedir_consec": 0.1995526730519679}, "4way-000-ego1": {"driven_any": 0.5816642445221152, "survival_time": 11.250000000000025, "driven_lanedir": 0.15969716629926767, "in-drivable-lane": 9.800000000000026, "deviation-heading": 0.7478094709473372, "distance-from-start": 0.5816528382740916, "deviation-center-line": 0.1356249107782691, "driven_lanedir_consec": 0.15969716629926767}, "4way-000-ego2": {"driven_any": 0.7962033870431411, "survival_time": 11.250000000000025, "driven_lanedir": 0.5392542188819056, "in-drivable-lane": 7.55000000000003, "deviation-heading": 0.9234722451894284, "distance-from-start": 0.7961885480612942, "deviation-center-line": 0.27078045404289575, "driven_lanedir_consec": 0.5392542188819056}, "4way-000-ego3": {"driven_any": 1.6838575324025151, "survival_time": 11.250000000000025, "driven_lanedir": 0.737521974955665, "in-drivable-lane": 5.850000000000036, "deviation-heading": 2.207424396094566, "distance-from-start": 1.6837476731392336, "deviation-center-line": 0.49385537805641655, "driven_lanedir_consec": 0.737521974955665}}
simulation-passed1
survival_time_max11.250000000000025
survival_time_mean11.250000000000025
survival_time_min11.250000000000025
No reset possible
165421728Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-validationsim-2of4successyesdavinci-stage-04-6.2.510:02:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.700000000000044
in-drivable-lane_median10.325000000000047
driven_lanedir_consec_median0.2454627567044649
deviation-center-line_median0.20268004628951308


other stats
deviation-center-line_max0.2697354450181819
deviation-center-line_mean0.20268004628951308
deviation-center-line_min0.13562464756084422
deviation-heading_max2.5383505748046193
deviation-heading_mean1.643080022875978
deviation-heading_median1.643080022875978
deviation-heading_min0.7478094709473364
distance-from-start_max1.9240493840830373
distance-from-start_mean1.152779949170181
distance-from-start_median1.152779949170181
distance-from-start_min0.3815105142573241
driven_any_max1.9241954407136783
driven_any_mean1.1528564552862215
driven_any_median1.1528564552862215
driven_any_min0.38151746985876434
driven_lanedir_consec_max0.33122977762117056
driven_lanedir_consec_mean0.2454627567044649
driven_lanedir_consec_min0.1596957357877593
driven_lanedir_max0.33122977762117056
driven_lanedir_mean0.2454627567044649
driven_lanedir_median0.2454627567044649
driven_lanedir_min0.1596957357877593
in-drivable-lane_max11.250000000000046
in-drivable-lane_mean10.325000000000047
in-drivable-lane_min9.40000000000005
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.9241954407136783, "survival_time": 12.700000000000044, "driven_lanedir": 0.33122977762117056, "in-drivable-lane": 9.40000000000005, "deviation-heading": 2.5383505748046193, "distance-from-start": 1.9240493840830373, "deviation-center-line": 0.2697354450181819, "driven_lanedir_consec": 0.33122977762117056}, "loop2-000-ego1": {"driven_any": 0.38151746985876434, "survival_time": 12.700000000000044, "driven_lanedir": 0.1596957357877593, "in-drivable-lane": 11.250000000000046, "deviation-heading": 0.7478094709473364, "distance-from-start": 0.3815105142573241, "deviation-center-line": 0.13562464756084422, "driven_lanedir_consec": 0.1596957357877593}}
simulation-passed1
survival_time_max12.700000000000044
survival_time_mean12.700000000000044
survival_time_min12.700000000000044
No reset possible
165351730Bea Baselines 🐤minimal-agentlx22-modconsimsuccessyesdavinci-stage-04-6.2.510:04:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median15.200000000000092
deviation-center-line_median0.0
driven_lanedir_consec_median0.0
survival_time_median15.200000000000092


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.705646613157915
distance-from-start_mean2.336800784178124
distance-from-start_median2.336800784178124
distance-from-start_min0.9679549551983332
driven_any_max3.707570013404081
driven_any_mean2.33778303094729
driven_any_median2.33778303094729
driven_any_min0.9679960484904996
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max23.5000000000002
in-drivable-lane_mean15.200000000000092
in-drivable-lane_min6.8999999999999835
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 3.707570013404081, "survival_time": 23.5000000000002, "driven_lanedir": 0.0, "in-drivable-lane": 23.5000000000002, "deviation-heading": 0.0, "distance-from-start": 3.705646613157915, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}, "LF-full-loop-001-ego0": {"driven_any": 0.9679960484904996, "survival_time": 6.8999999999999835, "driven_lanedir": 0.0, "in-drivable-lane": 6.8999999999999835, "deviation-heading": 0.0, "distance-from-start": 0.9679549551983332, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max23.5000000000002
survival_time_mean15.200000000000092
survival_time_min6.8999999999999835
No reset possible
165311734Bea Baselines 🐤minimal-agentlx22-BV1sim-0of5successyesdavinci-stage-04-6.2.510:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.38992181148908706


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.38992181148908706
distance-from-start_median0.38992181148908706
distance-from-start_min0.38992181148908706
driven_any_max0.3899290723045018
driven_any_mean0.3899290723045018
driven_any_median0.3899290723045018
driven_any_min0.3899290723045018
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max3.399999999999996
in-drivable-lane_mean3.399999999999996
in-drivable-lane_median3.399999999999996
in-drivable-lane_min3.399999999999996
per-episodes
details{"d30-ego0": {"driven_any": 0.3899290723045018, "survival_time": 3.399999999999996, "driven_lanedir": 0.0, "in-drivable-lane": 3.399999999999996, "deviation-heading": 0.0, "distance-from-start": 0.38992181148908706, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean3.399999999999996
survival_time_median3.399999999999996
survival_time_min3.399999999999996
No reset possible
165251741Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-0of4successyesdavinci-stage-04-6.2.510:02:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.549999999999988
in-drivable-lane_median4.149999999999988
driven_lanedir_consec_median0.1366657585905482
deviation-center-line_median0.10783820466790534


other stats
deviation-center-line_max0.10783820466790534
deviation-center-line_mean0.10783820466790534
deviation-center-line_min0.10783820466790534
deviation-heading_max0.9508048428349386
deviation-heading_mean0.9508048428349386
deviation-heading_median0.9508048428349386
deviation-heading_min0.9508048428349386
distance-from-start_max0.7476573144701085
distance-from-start_mean0.7476573144701085
distance-from-start_median0.7476573144701085
distance-from-start_min0.7476573144701085
driven_any_max0.7476698075499906
driven_any_mean0.7476698075499906
driven_any_median0.7476698075499906
driven_any_min0.7476698075499906
driven_lanedir_consec_max0.1366657585905482
driven_lanedir_consec_mean0.1366657585905482
driven_lanedir_consec_min0.1366657585905482
driven_lanedir_max0.1366657585905482
driven_lanedir_mean0.1366657585905482
driven_lanedir_median0.1366657585905482
driven_lanedir_min0.1366657585905482
in-drivable-lane_max4.149999999999988
in-drivable-lane_mean4.149999999999988
in-drivable-lane_min4.149999999999988
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.7476698075499906, "survival_time": 5.549999999999988, "driven_lanedir": 0.1366657585905482, "in-drivable-lane": 4.149999999999988, "deviation-heading": 0.9508048428349386, "distance-from-start": 0.7476573144701085, "deviation-center-line": 0.10783820466790534, "driven_lanedir_consec": 0.1366657585905482}}
simulation-passed1
survival_time_max5.549999999999988
survival_time_mean5.549999999999988
survival_time_min5.549999999999988
No reset possible
165181742Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-1of4successyesdavinci-stage-04-6.2.510:03:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.85000000000002
in-drivable-lane_median9.45000000000002
driven_lanedir_consec_median0.13666480491623645
deviation-center-line_median0.1078383533310603


other stats
deviation-center-line_max0.1078383533310603
deviation-center-line_mean0.1078383533310603
deviation-center-line_min0.1078383533310603
deviation-heading_max0.9508048428349388
deviation-heading_mean0.9508048428349388
deviation-heading_median0.9508048428349388
deviation-heading_min0.9508048428349388
distance-from-start_max1.6182798682575184
distance-from-start_mean1.6182798682575184
distance-from-start_median1.6182798682575184
distance-from-start_min1.6182798682575184
driven_any_max1.6183892771013868
driven_any_mean1.6183892771013868
driven_any_median1.6183892771013868
driven_any_min1.6183892771013868
driven_lanedir_consec_max0.13666480491623645
driven_lanedir_consec_mean0.13666480491623645
driven_lanedir_consec_min0.13666480491623645
driven_lanedir_max0.13666480491623645
driven_lanedir_mean0.13666480491623645
driven_lanedir_median0.13666480491623645
driven_lanedir_min0.13666480491623645
in-drivable-lane_max9.45000000000002
in-drivable-lane_mean9.45000000000002
in-drivable-lane_min9.45000000000002
per-episodes
details{"4way-000-ego0": {"driven_any": 1.6183892771013868, "survival_time": 10.85000000000002, "driven_lanedir": 0.13666480491623645, "in-drivable-lane": 9.45000000000002, "deviation-heading": 0.9508048428349388, "distance-from-start": 1.6182798682575184, "deviation-center-line": 0.1078383533310603, "driven_lanedir_consec": 0.13666480491623645}}
simulation-passed1
survival_time_max10.85000000000002
survival_time_mean10.85000000000002
survival_time_min10.85000000000002
No reset possible
165131744Bea Baselines 🐤minimal-agentaido-LF-sim-testingsim-2of4successyesdavinci-stage-04-6.2.510:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.30902388815479953
survival_time_median13.80000000000006
deviation-center-line_median0.26861568883973136
in-drivable-lane_median10.700000000000069


other stats
deviation-center-line_max0.26861568883973136
deviation-center-line_mean0.26861568883973136
deviation-center-line_min0.26861568883973136
deviation-heading_max2.499533756017491
deviation-heading_mean2.499533756017491
deviation-heading_median2.499533756017491
deviation-heading_min2.499533756017491
distance-from-start_max2.107081087129661
distance-from-start_mean2.107081087129661
distance-from-start_median2.107081087129661
distance-from-start_min2.107081087129661
driven_any_max2.107326449228953
driven_any_mean2.107326449228953
driven_any_median2.107326449228953
driven_any_min2.107326449228953
driven_lanedir_consec_max0.30902388815479953
driven_lanedir_consec_mean0.30902388815479953
driven_lanedir_consec_min0.30902388815479953
driven_lanedir_max0.30902388815479953
driven_lanedir_mean0.30902388815479953
driven_lanedir_median0.30902388815479953
driven_lanedir_min0.30902388815479953
in-drivable-lane_max10.700000000000069
in-drivable-lane_mean10.700000000000069
in-drivable-lane_min10.700000000000069
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.107326449228953, "survival_time": 13.80000000000006, "driven_lanedir": 0.30902388815479953, "in-drivable-lane": 10.700000000000069, "deviation-heading": 2.499533756017491, "distance-from-start": 2.107081087129661, "deviation-center-line": 0.26861568883973136, "driven_lanedir_consec": 0.30902388815479953}}
simulation-passed1
survival_time_max13.80000000000006
survival_time_mean13.80000000000006
survival_time_min13.80000000000006
No reset possible
165091745Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-testingsim-3of4successyesdavinci-stage-04-6.2.510:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
164911749Bea Baselines 🐤template-pytorchaido-LFVI-sim-validationsim-0of4successyesdavinci-stage-04-6.2.510:16:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median57.54999999999873
driven_lanedir_consec_median0.13850466408158146
deviation-center-line_median0.2282727912767089


other stats
deviation-center-line_max0.2282727912767089
deviation-center-line_mean0.2282727912767089
deviation-center-line_min0.2282727912767089
deviation-heading_max1.99431637293007
deviation-heading_mean1.99431637293007
deviation-heading_median1.99431637293007
deviation-heading_min1.99431637293007
distance-from-start_max0.4855951064113119
distance-from-start_mean0.4855951064113119
distance-from-start_median0.4855951064113119
distance-from-start_min0.4855951064113119
driven_any_max5.774620130700305
driven_any_mean5.774620130700305
driven_any_median5.774620130700305
driven_any_min5.774620130700305
driven_lanedir_consec_max0.13850466408158146
driven_lanedir_consec_mean0.13850466408158146
driven_lanedir_consec_min0.13850466408158146
driven_lanedir_max0.13850466408158146
driven_lanedir_mean0.13850466408158146
driven_lanedir_median0.13850466408158146
driven_lanedir_min0.13850466408158146
in-drivable-lane_max57.54999999999873
in-drivable-lane_mean57.54999999999873
in-drivable-lane_min57.54999999999873
per-episodes
details{"udem-000-ego0": {"driven_any": 5.774620130700305, "survival_time": 59.99999999999873, "driven_lanedir": 0.13850466408158146, "in-drivable-lane": 57.54999999999873, "deviation-heading": 1.99431637293007, "distance-from-start": 0.4855951064113119, "deviation-center-line": 0.2282727912767089, "driven_lanedir_consec": 0.13850466408158146}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
164891750Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-0of4successyesdavinci-stage-04-6.2.510:01:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.7000000000000008
in-drivable-lane_median0.7500000000000006
driven_lanedir_consec_median0.040834068069312446
deviation-center-line_median0.03542858991865786


other stats
deviation-center-line_max0.03542858991865786
deviation-center-line_mean0.03542858991865786
deviation-center-line_min0.03542858991865786
deviation-heading_max0.8725982788012543
deviation-heading_mean0.8725982788012543
deviation-heading_median0.8725982788012543
deviation-heading_min0.8725982788012543
distance-from-start_max0.11359508318984854
distance-from-start_mean0.11359508318984854
distance-from-start_median0.11359508318984854
distance-from-start_min0.11359508318984854
driven_any_max0.12001321877729045
driven_any_mean0.12001321877729045
driven_any_median0.12001321877729045
driven_any_min0.12001321877729045
driven_lanedir_consec_max0.040834068069312446
driven_lanedir_consec_mean0.040834068069312446
driven_lanedir_consec_min0.040834068069312446
driven_lanedir_max0.040834068069312446
driven_lanedir_mean0.040834068069312446
driven_lanedir_median0.040834068069312446
driven_lanedir_min0.040834068069312446
in-drivable-lane_max0.7500000000000006
in-drivable-lane_mean0.7500000000000006
in-drivable-lane_min0.7500000000000006
per-episodes
details{"4way-000-ego0": {"driven_any": 0.12001321877729045, "survival_time": 1.7000000000000008, "driven_lanedir": 0.040834068069312446, "in-drivable-lane": 0.7500000000000006, "deviation-heading": 0.8725982788012543, "distance-from-start": 0.11359508318984854, "deviation-center-line": 0.03542858991865786, "driven_lanedir_consec": 0.040834068069312446}}
simulation-passed1
survival_time_max1.7000000000000008
survival_time_mean1.7000000000000008
survival_time_min1.7000000000000008
No reset possible
164871750Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-3of4successyesdavinci-stage-04-6.2.510:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
164831751Bea Baselines 🐤template-pytorchaido-LF-sim-validationsim-1of4successyesdavinci-stage-04-6.2.510:07:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3759100499808201
survival_time_median59.99999999999873
deviation-center-line_median1.3612175094933507
in-drivable-lane_median44.74999999999909


other stats
deviation-center-line_max1.3612175094933507
deviation-center-line_mean1.3612175094933507
deviation-center-line_min1.3612175094933507
deviation-heading_max12.039735619937924
deviation-heading_mean12.039735619937924
deviation-heading_median12.039735619937924
deviation-heading_min12.039735619937924
distance-from-start_max0.5639573919867205
distance-from-start_mean0.5639573919867205
distance-from-start_median0.5639573919867205
distance-from-start_min0.5639573919867205
driven_any_max6.220141812160496
driven_any_mean6.220141812160496
driven_any_median6.220141812160496
driven_any_min6.220141812160496
driven_lanedir_consec_max0.3759100499808201
driven_lanedir_consec_mean0.3759100499808201
driven_lanedir_consec_min0.3759100499808201
driven_lanedir_max0.954096014173058
driven_lanedir_mean0.954096014173058
driven_lanedir_median0.954096014173058
driven_lanedir_min0.954096014173058
in-drivable-lane_max44.74999999999909
in-drivable-lane_mean44.74999999999909
in-drivable-lane_min44.74999999999909
per-episodes
details{"loop-000-ego0": {"driven_any": 6.220141812160496, "survival_time": 59.99999999999873, "driven_lanedir": 0.954096014173058, "in-drivable-lane": 44.74999999999909, "deviation-heading": 12.039735619937924, "distance-from-start": 0.5639573919867205, "deviation-center-line": 1.3612175094933507, "driven_lanedir_consec": 0.3759100499808201}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
164721753Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-validationsim-1of4successyesdavinci-stage-04-6.2.510:26:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median54.2249999999987
driven_lanedir_consec_median0.3053281893062856
deviation-center-line_median0.5833203374448451


other stats
deviation-center-line_max1.046541693404034
deviation-center-line_mean0.6029077032362445
deviation-center-line_min0.19844844465125416
deviation-heading_max12.050504548220994
deviation-heading_mean5.876284719758338
deviation-heading_median5.084688243255883
deviation-heading_min1.285257844300597
distance-from-start_max1.2570244316015116
distance-from-start_mean0.9264781001751844
distance-from-start_median0.9151802800017148
distance-from-start_min0.6185274090957956
driven_any_max12.930780982328082
driven_any_mean8.053519647393623
driven_any_median7.995416417071243
driven_any_min3.292464773103923
driven_lanedir_consec_max1.0173813169393
driven_lanedir_consec_mean0.4664860626318458
driven_lanedir_consec_min0.2379065549755119
driven_lanedir_max1.1185401924107965
driven_lanedir_mean0.4917757814997199
driven_lanedir_median0.3053281893062856
driven_lanedir_min0.2379065549755119
in-drivable-lane_max57.59999999999873
in-drivable-lane_mean53.57499999999875
in-drivable-lane_min48.249999999998906
per-episodes
details{"loop-000-ego0": {"driven_any": 12.930780982328082, "survival_time": 59.99999999999873, "driven_lanedir": 1.1185401924107965, "in-drivable-lane": 48.249999999998906, "deviation-heading": 12.050504548220994, "distance-from-start": 1.2570244316015116, "deviation-center-line": 1.046541693404034, "driven_lanedir_consec": 1.0173813169393}, "loop-000-ego1": {"driven_any": 3.292464773103923, "survival_time": 59.99999999999873, "driven_lanedir": 0.2379065549755119, "in-drivable-lane": 53.3499999999987, "deviation-heading": 4.855841736500814, "distance-from-start": 0.6605505669628424, "deviation-center-line": 0.7344782160864097, "driven_lanedir_consec": 0.2379065549755119}, "loop-000-ego2": {"driven_any": 5.447717796478859, "survival_time": 59.99999999999873, "driven_lanedir": 0.35754590689344695, "in-drivable-lane": 55.099999999998694, "deviation-heading": 5.313534750010952, "distance-from-start": 0.6185274090957956, "deviation-center-line": 0.4321624588032806, "driven_lanedir_consec": 0.35754590689344695}, "loop-000-ego3": {"driven_any": 10.543115037663627, "survival_time": 59.99999999999873, "driven_lanedir": 0.25311047171912415, "in-drivable-lane": 57.59999999999873, "deviation-heading": 1.285257844300597, "distance-from-start": 1.1698099930405872, "deviation-center-line": 0.19844844465125416, "driven_lanedir_consec": 0.25311047171912415}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
164671756Bea Baselines 🐤template-pytorchlx22-objdetsimsuccessyesdavinci-stage-04-6.2.510:13:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
driven_lanedir_consec_median1.7435238113133125


other stats
deviation-center-line_max2.4222718364286577
deviation-center-line_mean1.9712673980056732
deviation-center-line_median1.9712673980056732
deviation-center-line_min1.5202629595826886
deviation-heading_max22.11881496779818
deviation-heading_mean21.081253069221955
deviation-heading_median21.081253069221955
deviation-heading_min20.04369117064573
distance-from-start_max0.5858599121362782
distance-from-start_mean0.4228666845049779
distance-from-start_median0.4228666845049779
distance-from-start_min0.25987345687367763
driven_any_max8.815495265488497
driven_any_mean8.655062665644362
driven_any_median8.655062665644362
driven_any_min8.494630065800227
driven_lanedir_consec_max2.586792353968929
driven_lanedir_consec_mean1.7435238113133125
driven_lanedir_consec_min0.9002552686576961
driven_lanedir_max2.586792353968929
driven_lanedir_mean2.392016086917392
driven_lanedir_median2.392016086917392
driven_lanedir_min2.197239819865855
in-drivable-lane_max35.49999999999945
in-drivable-lane_mean33.39999999999937
in-drivable-lane_median33.39999999999937
in-drivable-lane_min31.29999999999929
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 8.815495265488497, "survival_time": 59.99999999999873, "driven_lanedir": 2.197239819865855, "in-drivable-lane": 35.49999999999945, "deviation-heading": 20.04369117064573, "distance-from-start": 0.5858599121362782, "deviation-center-line": 1.5202629595826886, "driven_lanedir_consec": 0.9002552686576961}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 8.494630065800227, "survival_time": 59.99999999999873, "driven_lanedir": 2.586792353968929, "in-drivable-lane": 31.29999999999929, "deviation-heading": 22.11881496779818, "distance-from-start": 0.25987345687367763, "deviation-center-line": 2.4222718364286577, "driven_lanedir_consec": 2.586792353968929}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
164631759Bea Baselines 🐤template-pytorchlx22-BV1sim-3of5successyesdavinci-stage-04-6.2.510:03:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.7564012057001293


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.7564012057001293
distance-from-start_median0.7564012057001293
distance-from-start_min0.7564012057001293
driven_any_max3.5372611728592696
driven_any_mean3.5372611728592696
driven_any_median3.5372611728592696
driven_any_min3.5372611728592696
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max16.4500000000001
in-drivable-lane_mean16.4500000000001
in-drivable-lane_median16.4500000000001
in-drivable-lane_min16.4500000000001
per-episodes
details{"d50-ego0": {"driven_any": 3.5372611728592696, "survival_time": 16.4500000000001, "driven_lanedir": 0.0, "in-drivable-lane": 16.4500000000001, "deviation-heading": 0.0, "distance-from-start": 0.7564012057001293, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max16.4500000000001
survival_time_mean16.4500000000001
survival_time_median16.4500000000001
survival_time_min16.4500000000001
No reset possible
164601759Bea Baselines 🐤template-pytorchlx22-BV1sim-4of5successyesdavinci-stage-04-6.2.510:05:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.3734060491711336


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.3734060491711336
distance-from-start_median0.3734060491711336
distance-from-start_min0.3734060491711336
driven_any_max3.741734431333521
driven_any_mean3.741734431333521
driven_any_median3.741734431333521
driven_any_min3.741734431333521
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max32.20000000000031
in-drivable-lane_mean32.20000000000031
in-drivable-lane_median32.20000000000031
in-drivable-lane_min32.20000000000031
per-episodes
details{"d60-ego0": {"driven_any": 3.741734431333521, "survival_time": 32.20000000000031, "driven_lanedir": 0.0, "in-drivable-lane": 32.20000000000031, "deviation-heading": 0.0, "distance-from-start": 0.3734060491711336, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max32.20000000000031
survival_time_mean32.20000000000031
survival_time_median32.20000000000031
survival_time_min32.20000000000031
No reset possible
164591762Bea Baselines 🐤template-pytorchaido-hello-sim-validationsanity-checksuccessyesdavinci-stage-04-6.2.510:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.027632425770637292
deviation-center-line_median0.005650493442286594


other stats
deviation-center-line_max0.005650493442286594
deviation-center-line_mean0.005650493442286594
deviation-center-line_min0.005650493442286594
deviation-heading_max0.28899819294510243
deviation-heading_mean0.28899819294510243
deviation-heading_median0.28899819294510243
deviation-heading_min0.28899819294510243
distance-from-start_max0.0342140910227398
distance-from-start_mean0.0342140910227398
distance-from-start_median0.0342140910227398
distance-from-start_min0.0342140910227398
driven_any_max0.03424516593237718
driven_any_mean0.03424516593237718
driven_any_median0.03424516593237718
driven_any_min0.03424516593237718
driven_lanedir_consec_max0.027632425770637292
driven_lanedir_consec_mean0.027632425770637292
driven_lanedir_consec_min0.027632425770637292
driven_lanedir_max0.027632425770637292
driven_lanedir_mean0.027632425770637292
driven_lanedir_median0.027632425770637292
driven_lanedir_min0.027632425770637292
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.03424516593237718, "survival_time": 0.49999999999999994, "driven_lanedir": 0.027632425770637292, "in-drivable-lane": 0.0, "deviation-heading": 0.28899819294510243, "distance-from-start": 0.0342140910227398, "deviation-center-line": 0.005650493442286594, "driven_lanedir_consec": 0.027632425770637292}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
164541767Bea Baselines 🐤template-pytorchaido-LFVI-sim-testingsim-0of4successyesdavinci-stage-04-6.2.510:02:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.1999999999999966
in-drivable-lane_median0.0
driven_lanedir_consec_median0.5202098026681854
deviation-center-line_median0.28469869321332153


other stats
deviation-center-line_max0.28469869321332153
deviation-center-line_mean0.28469869321332153
deviation-center-line_min0.28469869321332153
deviation-heading_max1.4713384599492132
deviation-heading_mean1.4713384599492132
deviation-heading_median1.4713384599492132
deviation-heading_min1.4713384599492132
distance-from-start_max0.5314842199830379
distance-from-start_mean0.5314842199830379
distance-from-start_median0.5314842199830379
distance-from-start_min0.5314842199830379
driven_any_max0.5746204195748775
driven_any_mean0.5746204195748775
driven_any_median0.5746204195748775
driven_any_min0.5746204195748775
driven_lanedir_consec_max0.5202098026681854
driven_lanedir_consec_mean0.5202098026681854
driven_lanedir_consec_min0.5202098026681854
driven_lanedir_max0.5202098026681854
driven_lanedir_mean0.5202098026681854
driven_lanedir_median0.5202098026681854
driven_lanedir_min0.5202098026681854
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 0.5746204195748775, "survival_time": 3.1999999999999966, "driven_lanedir": 0.5202098026681854, "in-drivable-lane": 0.0, "deviation-heading": 1.4713384599492132, "distance-from-start": 0.5314842199830379, "deviation-center-line": 0.28469869321332153, "driven_lanedir_consec": 0.5202098026681854}}
simulation-passed1
survival_time_max3.1999999999999966
survival_time_mean3.1999999999999966
survival_time_min3.1999999999999966
No reset possible
164491768Bea Baselines 🐤template-pytorchaido-LFI-sim-testingsim-0of4successyesdavinci-stage-04-6.2.510:02:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.049999999999997
in-drivable-lane_median1.7999999999999967
driven_lanedir_consec_median0.005965002245357454
deviation-center-line_median0.009862871605744509


other stats
deviation-center-line_max0.009862871605744509
deviation-center-line_mean0.009862871605744509
deviation-center-line_min0.009862871605744509
deviation-heading_max0.7798878959299526
deviation-heading_mean0.7798878959299526
deviation-heading_median0.7798878959299526
deviation-heading_min0.7798878959299526
distance-from-start_max0.04161536257062826
distance-from-start_mean0.04161536257062826
distance-from-start_median0.04161536257062826
distance-from-start_min0.04161536257062826
driven_any_max0.0701048942955869
driven_any_mean0.0701048942955869
driven_any_median0.0701048942955869
driven_any_min0.0701048942955869
driven_lanedir_consec_max0.005965002245357454
driven_lanedir_consec_mean0.005965002245357454
driven_lanedir_consec_min0.005965002245357454
driven_lanedir_max0.005965002245357454
driven_lanedir_mean0.005965002245357454
driven_lanedir_median0.005965002245357454
driven_lanedir_min0.005965002245357454
in-drivable-lane_max1.7999999999999967
in-drivable-lane_mean1.7999999999999967
in-drivable-lane_min1.7999999999999967
per-episodes
details{"4way-000-ego0": {"driven_any": 0.0701048942955869, "survival_time": 3.049999999999997, "driven_lanedir": 0.005965002245357454, "in-drivable-lane": 1.7999999999999967, "deviation-heading": 0.7798878959299526, "distance-from-start": 0.04161536257062826, "deviation-center-line": 0.009862871605744509, "driven_lanedir_consec": 0.005965002245357454}}
simulation-passed1
survival_time_max3.049999999999997
survival_time_mean3.049999999999997
survival_time_min3.049999999999997
No reset possible
164451769Bea Baselines 🐤template-pytorchaido-LF-sim-testingsim-2of4successyesdavinci-stage-04-6.2.510:07:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.541275569409125
survival_time_median59.99999999999873
deviation-center-line_median1.0652602177813295
in-drivable-lane_median29.19999999999934


other stats
deviation-center-line_max1.0652602177813295
deviation-center-line_mean1.0652602177813295
deviation-center-line_min1.0652602177813295
deviation-heading_max24.074288606407627
deviation-heading_mean24.074288606407627
deviation-heading_median24.074288606407627
deviation-heading_min24.074288606407627
distance-from-start_max0.36189997153209463
distance-from-start_mean0.36189997153209463
distance-from-start_median0.36189997153209463
distance-from-start_min0.36189997153209463
driven_any_max4.47876371612375
driven_any_mean4.47876371612375
driven_any_median4.47876371612375
driven_any_min4.47876371612375
driven_lanedir_consec_max1.541275569409125
driven_lanedir_consec_mean1.541275569409125
driven_lanedir_consec_min1.541275569409125
driven_lanedir_max1.541275569409125
driven_lanedir_mean1.541275569409125
driven_lanedir_median1.541275569409125
driven_lanedir_min1.541275569409125
in-drivable-lane_max29.19999999999934
in-drivable-lane_mean29.19999999999934
in-drivable-lane_min29.19999999999934
per-episodes
details{"loop2-000-ego0": {"driven_any": 4.47876371612375, "survival_time": 59.99999999999873, "driven_lanedir": 1.541275569409125, "in-drivable-lane": 29.19999999999934, "deviation-heading": 24.074288606407627, "distance-from-start": 0.36189997153209463, "deviation-center-line": 1.0652602177813295, "driven_lanedir_consec": 1.541275569409125}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
164421769Bea Baselines 🐤template-pytorchaido-LF-sim-testingsim-0of4successyesdavinci-stage-04-6.2.510:08:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5774082287249656
survival_time_median59.99999999999873
deviation-center-line_median1.716249036203565
in-drivable-lane_median43.49999999999906


other stats
deviation-center-line_max1.716249036203565
deviation-center-line_mean1.716249036203565
deviation-center-line_min1.716249036203565
deviation-heading_max16.54844533244037
deviation-heading_mean16.54844533244037
deviation-heading_median16.54844533244037
deviation-heading_min16.54844533244037
distance-from-start_max0.44484250921734575
distance-from-start_mean0.44484250921734575
distance-from-start_median0.44484250921734575
distance-from-start_min0.44484250921734575
driven_any_max11.582157211871303
driven_any_mean11.582157211871303
driven_any_median11.582157211871303
driven_any_min11.582157211871303
driven_lanedir_consec_max1.5774082287249656
driven_lanedir_consec_mean1.5774082287249656
driven_lanedir_consec_min1.5774082287249656
driven_lanedir_max1.5774082287249656
driven_lanedir_mean1.5774082287249656
driven_lanedir_median1.5774082287249656
driven_lanedir_min1.5774082287249656
in-drivable-lane_max43.49999999999906
in-drivable-lane_mean43.49999999999906
in-drivable-lane_min43.49999999999906
per-episodes
details{"autolab-000-ego0": {"driven_any": 11.582157211871303, "survival_time": 59.99999999999873, "driven_lanedir": 1.5774082287249656, "in-drivable-lane": 43.49999999999906, "deviation-heading": 16.54844533244037, "distance-from-start": 0.44484250921734575, "deviation-center-line": 1.716249036203565, "driven_lanedir_consec": 1.5774082287249656}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
164391770Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-testingsim-1of4successyesdavinci-stage-04-6.2.510:08:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median20.950000000000163
in-drivable-lane_median16.17500000000014
driven_lanedir_consec_median0.11275702091353024
deviation-center-line_median0.362249451981345


other stats
deviation-center-line_max3.0586900082527166
deviation-center-line_mean0.9576386305673004
deviation-center-line_min0.04736561005379428
deviation-heading_max29.45850995232479
deviation-heading_mean9.138712873759442
deviation-heading_median3.198053287805372
deviation-heading_min0.7002349671022325
distance-from-start_max0.31482459861015655
distance-from-start_mean0.17255392774736517
distance-from-start_median0.15365818433276085
distance-from-start_min0.06807474371378244
driven_any_max3.4337232432599385
driven_any_mean0.983107940532419
driven_any_median0.21310865116881025
driven_any_min0.07249121653211703
driven_lanedir_consec_max0.9744013979618352
driven_lanedir_consec_mean0.31061258087773
driven_lanedir_consec_min0.0425348837220243
driven_lanedir_max0.9744013979618352
driven_lanedir_mean0.31061258087773
driven_lanedir_median0.11275702091353024
driven_lanedir_min0.0425348837220243
in-drivable-lane_max19.750000000000163
in-drivable-lane_mean13.025000000000112
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 0.25570033909579337, "survival_time": 20.950000000000163, "driven_lanedir": 0.13087467281823528, "in-drivable-lane": 19.25000000000016, "deviation-heading": 1.0383016659938158, "distance-from-start": 0.1569554957382056, "deviation-center-line": 0.04736561005379428, "driven_lanedir_consec": 0.13087467281823528}, "4way-000-ego1": {"driven_any": 0.07249121653211703, "survival_time": 20.950000000000163, "driven_lanedir": 0.0425348837220243, "in-drivable-lane": 0.0, "deviation-heading": 29.45850995232479, "distance-from-start": 0.06807474371378244, "deviation-center-line": 3.0586900082527166, "driven_lanedir_consec": 0.0425348837220243}, "4way-000-ego2": {"driven_any": 0.1705169632418271, "survival_time": 20.950000000000163, "driven_lanedir": 0.0946393690088252, "in-drivable-lane": 19.750000000000163, "deviation-heading": 0.7002349671022325, "distance-from-start": 0.1503608729273161, "deviation-center-line": 0.055653251025076185, "driven_lanedir_consec": 0.0946393690088252}, "4way-000-ego3": {"driven_any": 3.4337232432599385, "survival_time": 20.950000000000163, "driven_lanedir": 0.9744013979618352, "in-drivable-lane": 13.100000000000122, "deviation-heading": 5.357804909616929, "distance-from-start": 0.31482459861015655, "deviation-center-line": 0.6688456529376138, "driven_lanedir_consec": 0.9744013979618352}}
simulation-passed1
survival_time_max20.950000000000163
survival_time_mean20.950000000000163
survival_time_min20.950000000000163
No reset possible
164381770Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-testingsim-2of4successyesdavinci-stage-04-6.2.510:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
164311772Bea Baselines 🐤template-pytorchaido-LFP-sim-testingsim-3of4successyesdavinci-stage-04-6.2.510:10:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median47.19999999999862
driven_lanedir_consec_median0.2424667470483679
deviation-center-line_median1.20006250218645


other stats
deviation-center-line_max1.20006250218645
deviation-center-line_mean1.20006250218645
deviation-center-line_min1.20006250218645
deviation-heading_max9.810706055072206
deviation-heading_mean9.810706055072206
deviation-heading_median9.810706055072206
deviation-heading_min9.810706055072206
distance-from-start_max0.8561109436877137
distance-from-start_mean0.8561109436877137
distance-from-start_median0.8561109436877137
distance-from-start_min0.8561109436877137
driven_any_max5.990013537123189
driven_any_mean5.990013537123189
driven_any_median5.990013537123189
driven_any_min5.990013537123189
driven_lanedir_consec_max0.2424667470483679
driven_lanedir_consec_mean0.2424667470483679
driven_lanedir_consec_min0.2424667470483679
driven_lanedir_max0.7347319034741755
driven_lanedir_mean0.7347319034741755
driven_lanedir_median0.7347319034741755
driven_lanedir_min0.7347319034741755
in-drivable-lane_max47.19999999999862
in-drivable-lane_mean47.19999999999862
in-drivable-lane_min47.19999999999862
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.990013537123189, "survival_time": 59.99999999999873, "driven_lanedir": 0.7347319034741755, "in-drivable-lane": 47.19999999999862, "deviation-heading": 9.810706055072206, "distance-from-start": 0.8561109436877137, "deviation-center-line": 1.20006250218645, "driven_lanedir_consec": 0.2424667470483679}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
164221774Bea Baselines 🐤template-randomaido-LFVI-sim-validationsim-0of4successyesdavinci-stage-04-6.2.510:08:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median28.850000000000275
in-drivable-lane_median18.900000000000233
driven_lanedir_consec_median0.25774306587044116
deviation-center-line_median0.8659891122281899


other stats
deviation-center-line_max0.8659891122281899
deviation-center-line_mean0.8659891122281899
deviation-center-line_min0.8659891122281899
deviation-heading_max7.706889663126838
deviation-heading_mean7.706889663126838
deviation-heading_median7.706889663126838
deviation-heading_min7.706889663126838
distance-from-start_max0.8626308120701125
distance-from-start_mean0.8626308120701125
distance-from-start_median0.8626308120701125
distance-from-start_min0.8626308120701125
driven_any_max7.161071358405415
driven_any_mean7.161071358405415
driven_any_median7.161071358405415
driven_any_min7.161071358405415
driven_lanedir_consec_max0.25774306587044116
driven_lanedir_consec_mean0.25774306587044116
driven_lanedir_consec_min0.25774306587044116
driven_lanedir_max0.2397300056472842
driven_lanedir_mean0.2397300056472842
driven_lanedir_median0.2397300056472842
driven_lanedir_min0.2397300056472842
in-drivable-lane_max18.900000000000233
in-drivable-lane_mean18.900000000000233
in-drivable-lane_min18.900000000000233
per-episodes
details{"udem-000-ego0": {"driven_any": 7.161071358405415, "survival_time": 28.850000000000275, "driven_lanedir": 0.2397300056472842, "in-drivable-lane": 18.900000000000233, "deviation-heading": 7.706889663126838, "distance-from-start": 0.8626308120701125, "deviation-center-line": 0.8659891122281899, "driven_lanedir_consec": 0.25774306587044116}}
simulation-passed1
survival_time_max28.850000000000275
survival_time_mean28.850000000000275
survival_time_min28.850000000000275
No reset possible
164201775Bea Baselines 🐤template-randomaido-LFI-sim-validationsim-3of4successyesdavinci-stage-04-6.2.510:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
164161776Bea Baselines 🐤template-randomaido-LF-sim-validationsim-2of4successyesdavinci-stage-04-6.2.510:03:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.27378584101885495
survival_time_median20.550000000000157
deviation-center-line_median0.7687309613328539
in-drivable-lane_median12.000000000000131


other stats
deviation-center-line_max0.7687309613328539
deviation-center-line_mean0.7687309613328539
deviation-center-line_min0.7687309613328539
deviation-heading_max5.7583430601860695
deviation-heading_mean5.7583430601860695
deviation-heading_median5.7583430601860695
deviation-heading_min5.7583430601860695
distance-from-start_max0.7357883576773772
distance-from-start_mean0.7357883576773772
distance-from-start_median0.7357883576773772
distance-from-start_min0.7357883576773772
driven_any_max4.915576034387011
driven_any_mean4.915576034387011
driven_any_median4.915576034387011
driven_any_min4.915576034387011
driven_lanedir_consec_max0.27378584101885495
driven_lanedir_consec_mean0.27378584101885495
driven_lanedir_consec_min0.27378584101885495
driven_lanedir_max0.2557751649818414
driven_lanedir_mean0.2557751649818414
driven_lanedir_median0.2557751649818414
driven_lanedir_min0.2557751649818414
in-drivable-lane_max12.000000000000131
in-drivable-lane_mean12.000000000000131
in-drivable-lane_min12.000000000000131
per-episodes
details{"loop2-000-ego0": {"driven_any": 4.915576034387011, "survival_time": 20.550000000000157, "driven_lanedir": 0.2557751649818414, "in-drivable-lane": 12.000000000000131, "deviation-heading": 5.7583430601860695, "distance-from-start": 0.7357883576773772, "deviation-center-line": 0.7687309613328539, "driven_lanedir_consec": 0.27378584101885495}}
simulation-passed1
survival_time_max20.550000000000157
survival_time_mean20.550000000000157
survival_time_min20.550000000000157
No reset possible
164071778Bea Baselines 🐤template-randomaido-LFV_multi-sim-validationsim-1of4successyesdavinci-stage-04-6.2.510:19:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.64999999999875
in-drivable-lane_median52.39999999999873
driven_lanedir_consec_median0.20841941457351276
deviation-center-line_median0.6235918393283303


other stats
deviation-center-line_max3.9618906351925345
deviation-center-line_mean1.3480922472158894
deviation-center-line_min0.18329467501436195
deviation-heading_max29.06091202107619
deviation-heading_mean10.086526110865954
deviation-heading_median4.852439390352202
deviation-heading_min1.5803136416832215
distance-from-start_max1.390232809724702
distance-from-start_mean0.8610879612709739
distance-from-start_median0.7658648678412762
distance-from-start_min0.5223892996766412
driven_any_max14.859731274916312
driven_any_mean6.788261723046844
driven_any_median5.402007576921902
driven_any_min1.4893004634272606
driven_lanedir_consec_max0.4727232702196713
driven_lanedir_consec_mean0.24835079061387844
driven_lanedir_consec_min0.10384106308881692
driven_lanedir_max0.4727232702196713
driven_lanedir_mean0.2405349726449092
driven_lanedir_median0.19278777863557428
driven_lanedir_min0.10384106308881692
in-drivable-lane_max57.149999999998755
in-drivable-lane_mean41.13749999999905
in-drivable-lane_min2.599999999999994
per-episodes
details{"loop-000-ego0": {"driven_any": 14.859731274916312, "survival_time": 59.64999999999875, "driven_lanedir": 0.2521152682910448, "in-drivable-lane": 50.49999999999872, "deviation-heading": 6.675380463416964, "distance-from-start": 1.390232809724702, "deviation-center-line": 0.8041846674982114, "driven_lanedir_consec": 0.2701303550718044}, "loop-000-ego1": {"driven_any": 1.4893004634272606, "survival_time": 59.64999999999875, "driven_lanedir": 0.4727232702196713, "in-drivable-lane": 2.599999999999994, "deviation-heading": 29.06091202107619, "distance-from-start": 0.5223892996766412, "deviation-center-line": 3.9618906351925345, "driven_lanedir_consec": 0.4727232702196713}, "loop-000-ego2": {"driven_any": 9.314714690416322, "survival_time": 59.64999999999875, "driven_lanedir": 0.13346028898010376, "in-drivable-lane": 54.29999999999873, "deviation-heading": 3.0294983172874397, "distance-from-start": 1.0093404360059108, "deviation-center-line": 0.4429990111584493, "driven_lanedir_consec": 0.14670847407522114}, "loop-000-ego3": {"driven_any": 1.4893004634274822, "survival_time": 59.64999999999875, "driven_lanedir": 0.10384106308881692, "in-drivable-lane": 57.149999999998755, "deviation-heading": 1.5803136416832215, "distance-from-start": 0.5223892996766415, "deviation-center-line": 0.18329467501436195, "driven_lanedir_consec": 0.10384106308881692}}
simulation-passed1
survival_time_max59.64999999999875
survival_time_mean59.64999999999875
survival_time_min59.64999999999875
No reset possible
163981783Bea Baselines 🐤template-randomlx22-state-estimationsimsuccessyesdavinci-stage-04-6.2.510:13:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.07536801496639489
survival_time_median59.99999999999873
deviation-center-line_median0.6735665136853142
in-drivable-lane_median49.44999999999911


other stats
deviation-center-line_max0.8579388817399466
deviation-center-line_mean0.6660984451379334
deviation-center-line_min0.4667899399885391
deviation-heading_max5.582370303572385
deviation-heading_mean4.330594699634891
deviation-heading_median3.851668979994983
deviation-heading_min3.5577448153373066
distance-from-start_max1.4108418329399044
distance-from-start_mean1.2749217352766675
distance-from-start_median1.4108418329398824
distance-from-start_min1.0030815399502164
driven_any_max15.32631084737068
driven_any_mean13.156722223767504
driven_any_median15.326310847370546
driven_any_min8.81754497656128
driven_lanedir_consec_max0.15436172858886033
driven_lanedir_consec_mean0.06086423316366729
driven_lanedir_consec_min-0.04713704406425334
driven_lanedir_max0.13361915084339548
driven_lanedir_mean0.04596436275685415
driven_lanedir_median0.06382708081740152
driven_lanedir_min-0.05955314339023454
in-drivable-lane_max53.2499999999987
in-drivable-lane_mean44.49999999999929
in-drivable-lane_min30.80000000000006
per-episodes
details{"LF-zig-zag-000-ego0": {"driven_any": 15.326310847370546, "survival_time": 59.99999999999873, "driven_lanedir": 0.13361915084339548, "in-drivable-lane": 53.2499999999987, "deviation-heading": 3.851668979994983, "distance-from-start": 1.4108418329398824, "deviation-center-line": 0.6735665136853142, "driven_lanedir_consec": 0.15436172858886033}, "LF-zig-zag-001-ego0": {"driven_any": 8.81754497656128, "survival_time": 35.9000000000001, "driven_lanedir": 0.06382708081740152, "in-drivable-lane": 30.80000000000006, "deviation-heading": 3.5577448153373066, "distance-from-start": 1.0030815399502164, "deviation-center-line": 0.4667899399885391, "driven_lanedir_consec": 0.07536801496639489}, "LF-zig-zag-002-ego0": {"driven_any": 15.32631084737068, "survival_time": 59.99999999999873, "driven_lanedir": -0.05955314339023454, "in-drivable-lane": 49.44999999999911, "deviation-heading": 5.582370303572385, "distance-from-start": 1.4108418329399044, "deviation-center-line": 0.8579388817399466, "driven_lanedir_consec": -0.04713704406425334}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean51.96666666666585
survival_time_min35.9000000000001
No reset possible
163841792Bea Baselines 🐤template-randomaido-LFVI-sim-testingsim-0of4successyesdavinci-stage-04-6.2.510:14:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median55.54999999999898
in-drivable-lane_median33.999999999999304
driven_lanedir_consec_median0.23486935510848683
deviation-center-line_median1.9152361710618249


other stats
deviation-center-line_max1.9152361710618249
deviation-center-line_mean1.9152361710618249
deviation-center-line_min1.9152361710618249
deviation-heading_max18.76264857218657
deviation-heading_mean18.76264857218657
deviation-heading_median18.76264857218657
deviation-heading_min18.76264857218657
distance-from-start_max1.290574960120657
distance-from-start_mean1.290574960120657
distance-from-start_median1.290574960120657
distance-from-start_min1.290574960120657
driven_any_max13.766585811745278
driven_any_mean13.766585811745278
driven_any_median13.766585811745278
driven_any_min13.766585811745278
driven_lanedir_consec_max0.23486935510848683
driven_lanedir_consec_mean0.23486935510848683
driven_lanedir_consec_min0.23486935510848683
driven_lanedir_max0.22765090740773952
driven_lanedir_mean0.22765090740773952
driven_lanedir_median0.22765090740773952
driven_lanedir_min0.22765090740773952
in-drivable-lane_max33.999999999999304
in-drivable-lane_mean33.999999999999304
in-drivable-lane_min33.999999999999304
per-episodes
details{"udem-000-ego0": {"driven_any": 13.766585811745278, "survival_time": 55.54999999999898, "driven_lanedir": 0.22765090740773952, "in-drivable-lane": 33.999999999999304, "deviation-heading": 18.76264857218657, "distance-from-start": 1.290574960120657, "deviation-center-line": 1.9152361710618249, "driven_lanedir_consec": 0.23486935510848683}}
simulation-passed1
survival_time_max55.54999999999898
survival_time_mean55.54999999999898
survival_time_min55.54999999999898
No reset possible
163771794Bea Baselines 🐤template-randomaido-LF-sim-testingsim-3of4successyesdavinci-stage-04-6.2.510:08:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.012435476414101476
survival_time_median59.99999999999873
deviation-center-line_median0.5849703750508038
in-drivable-lane_median53.74999999999868


other stats
deviation-center-line_max0.5849703750508038
deviation-center-line_mean0.5849703750508038
deviation-center-line_min0.5849703750508038
deviation-heading_max4.775258785640045
deviation-heading_mean4.775258785640045
deviation-heading_median4.775258785640045
deviation-heading_min4.775258785640045
distance-from-start_max1.4108418329398955
distance-from-start_mean1.4108418329398955
distance-from-start_median1.4108418329398955
distance-from-start_min1.4108418329398955
driven_any_max15.326310847370571
driven_any_mean15.326310847370571
driven_any_median15.326310847370571
driven_any_min15.326310847370571
driven_lanedir_consec_max0.012435476414101476
driven_lanedir_consec_mean0.012435476414101476
driven_lanedir_consec_min0.012435476414101476
driven_lanedir_max0.01578217614057431
driven_lanedir_mean0.01578217614057431
driven_lanedir_median0.01578217614057431
driven_lanedir_min0.01578217614057431
in-drivable-lane_max53.74999999999868
in-drivable-lane_mean53.74999999999868
in-drivable-lane_min53.74999999999868
per-episodes
details{"zigzag-000-ego0": {"driven_any": 15.326310847370571, "survival_time": 59.99999999999873, "driven_lanedir": 0.01578217614057431, "in-drivable-lane": 53.74999999999868, "deviation-heading": 4.775258785640045, "distance-from-start": 1.4108418329398955, "deviation-center-line": 0.5849703750508038, "driven_lanedir_consec": 0.012435476414101476}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
163741795Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-1of4successyesdavinci-stage-04-6.2.510:08:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.850000000000104
in-drivable-lane_median12.125000000000089
driven_lanedir_consec_median0.0914085509908058
deviation-center-line_median0.43295730670036126


other stats
deviation-center-line_max0.9740434407320936
deviation-center-line_mean0.4859958968604682
deviation-center-line_min0.10402553330905678
deviation-heading_max11.275693531416076
deviation-heading_mean4.654809102682379
deviation-heading_median2.965682219224468
deviation-heading_min1.412178440864505
distance-from-start_max0.6736010379604943
distance-from-start_mean0.3985347917343786
distance-from-start_median0.4602690644885098
distance-from-start_min6.280369834735102e-16
driven_any_max4.057822758459427
driven_any_mean1.6869445200555797
driven_any_median1.3449776608814374
driven_any_min1.6723002649096045e-14
driven_lanedir_consec_max0.3062479141509611
driven_lanedir_consec_mean0.12226625403314316
driven_lanedir_consec_min0.0
driven_lanedir_max0.3062479141509611
driven_lanedir_mean0.11925650183156368
driven_lanedir_median0.08538904658764679
driven_lanedir_min0.0
in-drivable-lane_max14.800000000000107
in-drivable-lane_mean9.76250000000007
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 2.295525081876566, "survival_time": 16.850000000000104, "driven_lanedir": 0.03283062049203522, "in-drivable-lane": 13.400000000000093, "deviation-heading": 2.548872644626666, "distance-from-start": 0.5461575079396546, "deviation-center-line": 0.3268416966298657, "driven_lanedir_consec": 0.029485112858473883}, "4way-000-ego1": {"driven_any": 1.6723002649096045e-14, "survival_time": 16.850000000000104, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 11.275693531416076, "distance-from-start": 6.280369834735102e-16, "deviation-center-line": 0.9740434407320936, "driven_lanedir_consec": 0.0}, "4way-000-ego2": {"driven_any": 4.057822758459427, "survival_time": 16.850000000000104, "driven_lanedir": 0.13794747268325835, "in-drivable-lane": 10.850000000000088, "deviation-heading": 3.3824917938222696, "distance-from-start": 0.6736010379604943, "deviation-center-line": 0.5390729167708568, "driven_lanedir_consec": 0.15333198912313772}, "4way-000-ego3": {"driven_any": 0.3944302398863089, "survival_time": 16.850000000000104, "driven_lanedir": 0.3062479141509611, "in-drivable-lane": 14.800000000000107, "deviation-heading": 1.412178440864505, "distance-from-start": 0.37438062103736497, "deviation-center-line": 0.10402553330905678, "driven_lanedir_consec": 0.3062479141509611}}
simulation-passed1
survival_time_max16.850000000000104
survival_time_mean16.850000000000104
survival_time_min16.850000000000104
No reset possible
163731795Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-2of4successyesdavinci-stage-04-6.2.510:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
163721795Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-3of4successyesdavinci-stage-04-6.2.510:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
163691796Bea Baselines 🐤template-randomaido-LFV_multi-sim-testingsim-2of4successyesdavinci-stage-04-6.2.510:07:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median44.99999999999958
in-drivable-lane_median39.249999999999574
driven_lanedir_consec_median0.1329316137267978
deviation-center-line_median0.4769519451920501


other stats
deviation-center-line_max0.627148077892518
deviation-center-line_mean0.4769519451920501
deviation-center-line_min0.3267558124915822
deviation-heading_max4.173256858222429
deviation-heading_mean3.3650961945019375
deviation-heading_median3.3650961945019375
deviation-heading_min2.5569355307814456
distance-from-start_max1.0442247976691823
distance-from-start_mean0.7951911528044138
distance-from-start_median0.7951911528044138
distance-from-start_min0.5461575079396452
driven_any_max11.349124250612952
driven_any_mean6.923556868843365
driven_any_median6.923556868843365
driven_any_min2.497989487073778
driven_lanedir_consec_max0.2397940766790495
driven_lanedir_consec_mean0.1329316137267978
driven_lanedir_consec_min0.02606915077454608
driven_lanedir_max0.2256600500204217
driven_lanedir_mean0.1275377118421561
driven_lanedir_median0.1275377118421561
driven_lanedir_min0.029415373663890465
in-drivable-lane_max41.54999999999957
in-drivable-lane_mean39.249999999999574
in-drivable-lane_min36.94999999999958
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.497989487073778, "survival_time": 44.99999999999958, "driven_lanedir": 0.029415373663890465, "in-drivable-lane": 41.54999999999957, "deviation-heading": 2.5569355307814456, "distance-from-start": 0.5461575079396452, "deviation-center-line": 0.3267558124915822, "driven_lanedir_consec": 0.02606915077454608}, "loop2-000-ego1": {"driven_any": 11.349124250612952, "survival_time": 44.99999999999958, "driven_lanedir": 0.2256600500204217, "in-drivable-lane": 36.94999999999958, "deviation-heading": 4.173256858222429, "distance-from-start": 1.0442247976691823, "deviation-center-line": 0.627148077892518, "driven_lanedir_consec": 0.2397940766790495}}
simulation-passed1
survival_time_max44.99999999999958
survival_time_mean44.99999999999958
survival_time_min44.99999999999958
No reset possible
163661797Bea Baselines 🐤template-randomaido-LFP-sim-testingsim-2of4successyesdavinci-stage-04-6.2.510:02:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.300000000000026
in-drivable-lane_median7.850000000000014
driven_lanedir_consec_median0.02948472541340319
deviation-center-line_median0.3268416970813497


other stats
deviation-center-line_max0.3268416970813497
deviation-center-line_mean0.3268416970813497
deviation-center-line_min0.3268416970813497
deviation-heading_max2.548872596322993
deviation-heading_mean2.548872596322993
deviation-heading_median2.548872596322993
deviation-heading_min2.548872596322993
distance-from-start_max0.5461575079396523
distance-from-start_mean0.5461575079396523
distance-from-start_median0.5461575079396523
distance-from-start_min0.5461575079396523
driven_any_max2.2681416551684617
driven_any_mean2.2681416551684617
driven_any_median2.2681416551684617
driven_any_min2.2681416551684617
driven_lanedir_consec_max0.02948472541340319
driven_lanedir_consec_mean0.02948472541340319
driven_lanedir_consec_min0.02948472541340319
driven_lanedir_max0.032831067512037126
driven_lanedir_mean0.032831067512037126
driven_lanedir_median0.032831067512037126
driven_lanedir_min0.032831067512037126
in-drivable-lane_max7.850000000000014
in-drivable-lane_mean7.850000000000014
in-drivable-lane_min7.850000000000014
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.2681416551684617, "survival_time": 11.300000000000026, "driven_lanedir": 0.032831067512037126, "in-drivable-lane": 7.850000000000014, "deviation-heading": 2.548872596322993, "distance-from-start": 0.5461575079396523, "deviation-center-line": 0.3268416970813497, "driven_lanedir_consec": 0.02948472541340319}}
simulation-passed1
survival_time_max11.300000000000026
survival_time_mean11.300000000000026
survival_time_min11.300000000000026
No reset possible
163621798Bea Baselines 🐤template-rosaido-LFV-sim-validationsim-0of4successyesdavinci-stage-04-6.2.510:02:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.999999999999994
in-drivable-lane_median1.1999999999999955
driven_lanedir_consec_median0.6695598998842298
deviation-center-line_median0.19945788807203577


other stats
deviation-center-line_max0.19945788807203577
deviation-center-line_mean0.19945788807203577
deviation-center-line_min0.19945788807203577
deviation-heading_max1.107372140691835
deviation-heading_mean1.107372140691835
deviation-heading_median1.107372140691835
deviation-heading_min1.107372140691835
distance-from-start_max0.9002875127689235
distance-from-start_mean0.9002875127689235
distance-from-start_median0.9002875127689235
distance-from-start_min0.9002875127689235
driven_any_max0.9092438226794856
driven_any_mean0.9092438226794856
driven_any_median0.9092438226794856
driven_any_min0.9092438226794856
driven_lanedir_consec_max0.6695598998842298
driven_lanedir_consec_mean0.6695598998842298
driven_lanedir_consec_min0.6695598998842298
driven_lanedir_max0.6695598998842298
driven_lanedir_mean0.6695598998842298
driven_lanedir_median0.6695598998842298
driven_lanedir_min0.6695598998842298
in-drivable-lane_max1.1999999999999955
in-drivable-lane_mean1.1999999999999955
in-drivable-lane_min1.1999999999999955
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.9092438226794856, "survival_time": 3.999999999999994, "driven_lanedir": 0.6695598998842298, "in-drivable-lane": 1.1999999999999955, "deviation-heading": 1.107372140691835, "distance-from-start": 0.9002875127689235, "deviation-center-line": 0.19945788807203577, "driven_lanedir_consec": 0.6695598998842298}}
simulation-passed1
survival_time_max3.999999999999994
survival_time_mean3.999999999999994
survival_time_min3.999999999999994
No reset possible
163551799Bea Baselines 🐤template-rosaido-LFVI-sim-validationsim-1of4successyesdavinci-stage-04-6.2.510:02:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.999999999999994
in-drivable-lane_median2.8999999999999932
driven_lanedir_consec_median0.17004292724378578
deviation-center-line_median0.0659023145062551


other stats
deviation-center-line_max0.0659023145062551
deviation-center-line_mean0.0659023145062551
deviation-center-line_min0.0659023145062551
deviation-heading_max0.6552066076710106
deviation-heading_mean0.6552066076710106
deviation-heading_median0.6552066076710106
deviation-heading_min0.6552066076710106
distance-from-start_max0.7559946611355708
distance-from-start_mean0.7559946611355708
distance-from-start_median0.7559946611355708
distance-from-start_min0.7559946611355708
driven_any_max0.8113082770236631
driven_any_mean0.8113082770236631
driven_any_median0.8113082770236631
driven_any_min0.8113082770236631
driven_lanedir_consec_max0.17004292724378578
driven_lanedir_consec_mean0.17004292724378578
driven_lanedir_consec_min0.17004292724378578
driven_lanedir_max0.17004292724378578
driven_lanedir_mean0.17004292724378578
driven_lanedir_median0.17004292724378578
driven_lanedir_min0.17004292724378578
in-drivable-lane_max2.8999999999999932
in-drivable-lane_mean2.8999999999999932
in-drivable-lane_min2.8999999999999932
per-episodes
details{"4way-000-ego0": {"driven_any": 0.8113082770236631, "survival_time": 3.999999999999994, "driven_lanedir": 0.17004292724378578, "in-drivable-lane": 2.8999999999999932, "deviation-heading": 0.6552066076710106, "distance-from-start": 0.7559946611355708, "deviation-center-line": 0.0659023145062551, "driven_lanedir_consec": 0.17004292724378578}}
simulation-passed1
survival_time_max3.999999999999994
survival_time_mean3.999999999999994
survival_time_min3.999999999999994
No reset possible
163511801Bea Baselines 🐤template-rosaido-LF-sim-validationsim-2of4successyesdavinci-stage-04-6.2.510:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.44613995367332704
survival_time_median7.049999999999983
deviation-center-line_median0.1699269997744388
in-drivable-lane_median4.999999999999982


other stats
deviation-center-line_max0.1699269997744388
deviation-center-line_mean0.1699269997744388
deviation-center-line_min0.1699269997744388
deviation-heading_max0.6567485247910277
deviation-heading_mean0.6567485247910277
deviation-heading_median0.6567485247910277
deviation-heading_min0.6567485247910277
distance-from-start_max1.656505296040372
distance-from-start_mean1.656505296040372
distance-from-start_median1.656505296040372
distance-from-start_min1.656505296040372
driven_any_max1.7239821406966729
driven_any_mean1.7239821406966729
driven_any_median1.7239821406966729
driven_any_min1.7239821406966729
driven_lanedir_consec_max0.44613995367332704
driven_lanedir_consec_mean0.44613995367332704
driven_lanedir_consec_min0.44613995367332704
driven_lanedir_max0.44613995367332704
driven_lanedir_mean0.44613995367332704
driven_lanedir_median0.44613995367332704
driven_lanedir_min0.44613995367332704
in-drivable-lane_max4.999999999999982
in-drivable-lane_mean4.999999999999982
in-drivable-lane_min4.999999999999982
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.7239821406966729, "survival_time": 7.049999999999983, "driven_lanedir": 0.44613995367332704, "in-drivable-lane": 4.999999999999982, "deviation-heading": 0.6567485247910277, "distance-from-start": 1.656505296040372, "deviation-center-line": 0.1699269997744388, "driven_lanedir_consec": 0.44613995367332704}}
simulation-passed1
survival_time_max7.049999999999983
survival_time_mean7.049999999999983
survival_time_min7.049999999999983
No reset possible
163461801Bea Baselines 🐤template-rosaido-LF-sim-validationsim-0of4successyesdavinci-stage-04-6.2.510:02:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4561671741612208
survival_time_median8.09999999999998
deviation-center-line_median0.1338585147256049
in-drivable-lane_median6.199999999999979


other stats
deviation-center-line_max0.1338585147256049
deviation-center-line_mean0.1338585147256049
deviation-center-line_min0.1338585147256049
deviation-heading_max0.5884678904052963
deviation-heading_mean0.5884678904052963
deviation-heading_median0.5884678904052963
deviation-heading_min0.5884678904052963
distance-from-start_max2.136969138574603
distance-from-start_mean2.136969138574603
distance-from-start_median2.136969138574603
distance-from-start_min2.136969138574603
driven_any_max2.181508362671926
driven_any_mean2.181508362671926
driven_any_median2.181508362671926
driven_any_min2.181508362671926
driven_lanedir_consec_max0.4561671741612208
driven_lanedir_consec_mean0.4561671741612208
driven_lanedir_consec_min0.4561671741612208
driven_lanedir_max0.4561671741612208
driven_lanedir_mean0.4561671741612208
driven_lanedir_median0.4561671741612208
driven_lanedir_min0.4561671741612208
in-drivable-lane_max6.199999999999979
in-drivable-lane_mean6.199999999999979
in-drivable-lane_min6.199999999999979
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.181508362671926, "survival_time": 8.09999999999998, "driven_lanedir": 0.4561671741612208, "in-drivable-lane": 6.199999999999979, "deviation-heading": 0.5884678904052963, "distance-from-start": 2.136969138574603, "deviation-center-line": 0.1338585147256049, "driven_lanedir_consec": 0.4561671741612208}}
simulation-passed1
survival_time_max8.09999999999998
survival_time_mean8.09999999999998
survival_time_min8.09999999999998
No reset possible
163441802Bea Baselines 🐤template-rosaido-LFVI_multi-sim-validationsim-3of4successyesdavinci-stage-04-6.2.510:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
163401803Bea Baselines 🐤template-rosaido-LFV_multi-sim-validationsim-2of4successyesdavinci-stage-04-6.2.510:02:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.79999999999998
in-drivable-lane_median5.199999999999982
driven_lanedir_consec_median0.3930648638698691
deviation-center-line_median0.2413572809444457


other stats
deviation-center-line_max0.28431432527840433
deviation-center-line_mean0.2413572809444457
deviation-center-line_min0.19840023661048703
deviation-heading_max1.9115662010849035
deviation-heading_mean1.7404572542948566
deviation-heading_median1.7404572542948566
deviation-heading_min1.5693483075048096
distance-from-start_max1.6785243001369958
distance-from-start_mean1.6640185579953417
distance-from-start_median1.6640185579953417
distance-from-start_min1.649512815853687
driven_any_max1.823537943982713
driven_any_mean1.7558757256869757
driven_any_median1.7558757256869757
driven_any_min1.688213507391238
driven_lanedir_consec_max0.4680280919627047
driven_lanedir_consec_mean0.3930648638698691
driven_lanedir_consec_min0.31810163577703354
driven_lanedir_max0.4680280919627047
driven_lanedir_mean0.3930648638698691
driven_lanedir_median0.3930648638698691
driven_lanedir_min0.31810163577703354
in-drivable-lane_max5.449999999999982
in-drivable-lane_mean5.199999999999982
in-drivable-lane_min4.949999999999982
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.688213507391238, "survival_time": 7.79999999999998, "driven_lanedir": 0.31810163577703354, "in-drivable-lane": 5.449999999999982, "deviation-heading": 1.9115662010849035, "distance-from-start": 1.649512815853687, "deviation-center-line": 0.19840023661048703, "driven_lanedir_consec": 0.31810163577703354}, "loop2-000-ego1": {"driven_any": 1.823537943982713, "survival_time": 7.79999999999998, "driven_lanedir": 0.4680280919627047, "in-drivable-lane": 4.949999999999982, "deviation-heading": 1.5693483075048096, "distance-from-start": 1.6785243001369958, "deviation-center-line": 0.28431432527840433, "driven_lanedir_consec": 0.4680280919627047}}
simulation-passed1
survival_time_max7.79999999999998
survival_time_mean7.79999999999998
survival_time_min7.79999999999998
No reset possible
163371804Bea Baselines 🐤template-rosaido-LFP-sim-validationsim-0of4successyesdavinci-stage-04-6.2.510:01:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.5499999999999954
in-drivable-lane_median2.2499999999999947
driven_lanedir_consec_median0.2316361480231559
deviation-center-line_median0.08139079724041116


other stats
deviation-center-line_max0.08139079724041116
deviation-center-line_mean0.08139079724041116
deviation-center-line_min0.08139079724041116
deviation-heading_max0.645295327763397
deviation-heading_mean0.645295327763397
deviation-heading_median0.645295327763397
deviation-heading_min0.645295327763397
distance-from-start_max0.7141117327806646
distance-from-start_mean0.7141117327806646
distance-from-start_median0.7141117327806646
distance-from-start_min0.7141117327806646
driven_any_max0.7164767392507335
driven_any_mean0.7164767392507335
driven_any_median0.7164767392507335
driven_any_min0.7164767392507335
driven_lanedir_consec_max0.2316361480231559
driven_lanedir_consec_mean0.2316361480231559
driven_lanedir_consec_min0.2316361480231559
driven_lanedir_max0.2316361480231559
driven_lanedir_mean0.2316361480231559
driven_lanedir_median0.2316361480231559
driven_lanedir_min0.2316361480231559
in-drivable-lane_max2.2499999999999947
in-drivable-lane_mean2.2499999999999947
in-drivable-lane_min2.2499999999999947
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.7164767392507335, "survival_time": 3.5499999999999954, "driven_lanedir": 0.2316361480231559, "in-drivable-lane": 2.2499999999999947, "deviation-heading": 0.645295327763397, "distance-from-start": 0.7141117327806646, "deviation-center-line": 0.08139079724041116, "driven_lanedir_consec": 0.2316361480231559}}
simulation-passed1
survival_time_max3.5499999999999954
survival_time_mean3.5499999999999954
survival_time_min3.5499999999999954
No reset possible
163311808Bea Baselines 🐤template-roslx22-state-estimationsimsuccessyesdavinci-stage-04-6.2.510:03:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6952804045478427
survival_time_median10.600000000000016
deviation-center-line_median0.25658356828260853
in-drivable-lane_median7.450000000000021


other stats
deviation-center-line_max0.27631522967548794
deviation-center-line_mean0.2568708817414622
deviation-center-line_min0.2377138472662902
deviation-heading_max1.2881811423320058
deviation-heading_mean0.9360239012900669
deviation-heading_median1.0821707286159763
deviation-heading_min0.4377198329222184
distance-from-start_max2.84026417844585
distance-from-start_mean2.5282896352690147
distance-from-start_median2.6983327245954194
distance-from-start_min2.0462720027657753
driven_any_max2.866682289234733
driven_any_mean2.6219247497288714
driven_any_median2.8128166860655925
driven_any_min2.186275273886288
driven_lanedir_consec_max0.8216817833801773
driven_lanedir_consec_mean0.6990956217668512
driven_lanedir_consec_min0.5803246773725339
driven_lanedir_max0.8216817833801773
driven_lanedir_mean0.6990956217668512
driven_lanedir_median0.6952804045478427
driven_lanedir_min0.5803246773725339
in-drivable-lane_max7.850000000000019
in-drivable-lane_mean7.00000000000001
in-drivable-lane_min5.699999999999988
per-episodes
details{"LF-zig-zag-000-ego0": {"driven_any": 2.186275273886288, "survival_time": 8.499999999999986, "driven_lanedir": 0.5803246773725339, "in-drivable-lane": 5.699999999999988, "deviation-heading": 1.2881811423320058, "distance-from-start": 2.0462720027657753, "deviation-center-line": 0.2377138472662902, "driven_lanedir_consec": 0.5803246773725339}, "LF-zig-zag-001-ego0": {"driven_any": 2.866682289234733, "survival_time": 10.700000000000015, "driven_lanedir": 0.6952804045478427, "in-drivable-lane": 7.850000000000019, "deviation-heading": 0.4377198329222184, "distance-from-start": 2.84026417844585, "deviation-center-line": 0.25658356828260853, "driven_lanedir_consec": 0.6952804045478427}, "LF-zig-zag-002-ego0": {"driven_any": 2.8128166860655925, "survival_time": 10.600000000000016, "driven_lanedir": 0.8216817833801773, "in-drivable-lane": 7.450000000000021, "deviation-heading": 1.0821707286159763, "distance-from-start": 2.6983327245954194, "deviation-center-line": 0.27631522967548794, "driven_lanedir_consec": 0.8216817833801773}}
simulation-passed1
survival_time_max10.700000000000015
survival_time_mean9.93333333333334
survival_time_min8.499999999999986
No reset possible
163261809Bea Baselines 🐤template-roslx22-BV1sim-3of5successyesdavinci-stage-04-6.2.510:02:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.1062248674716675


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.1062248674716675
distance-from-start_median2.1062248674716675
distance-from-start_min2.1062248674716675
driven_any_max2.1282200935834776
driven_any_mean2.1282200935834776
driven_any_median2.1282200935834776
driven_any_min2.1282200935834776
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max8.14999999999998
in-drivable-lane_mean8.14999999999998
in-drivable-lane_median8.14999999999998
in-drivable-lane_min8.14999999999998
per-episodes
details{"d50-ego0": {"driven_any": 2.1282200935834776, "survival_time": 8.14999999999998, "driven_lanedir": 0.0, "in-drivable-lane": 8.14999999999998, "deviation-heading": 0.0, "distance-from-start": 2.1062248674716675, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max8.14999999999998
survival_time_mean8.14999999999998
survival_time_median8.14999999999998
survival_time_min8.14999999999998
No reset possible
163211816Bea Baselines 🐤template-rosaido-LFV-sim-testingsim-2of4successyesdavinci-stage-04-6.2.510:02:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.5999999999999845
in-drivable-lane_median5.699999999999985
driven_lanedir_consec_median0.1032158683617388
deviation-center-line_median0.06555060179133754


other stats
deviation-center-line_max0.06555060179133754
deviation-center-line_mean0.06555060179133754
deviation-center-line_min0.06555060179133754
deviation-heading_max0.7727039152203754
deviation-heading_mean0.7727039152203754
deviation-heading_median0.7727039152203754
deviation-heading_min0.7727039152203754
distance-from-start_max1.176164090862445
distance-from-start_mean1.176164090862445
distance-from-start_median1.176164090862445
distance-from-start_min1.176164090862445
driven_any_max1.608711254137817
driven_any_mean1.608711254137817
driven_any_median1.608711254137817
driven_any_min1.608711254137817
driven_lanedir_consec_max0.1032158683617388
driven_lanedir_consec_mean0.1032158683617388
driven_lanedir_consec_min0.1032158683617388
driven_lanedir_max0.1032158683617388
driven_lanedir_mean0.1032158683617388
driven_lanedir_median0.1032158683617388
driven_lanedir_min0.1032158683617388
in-drivable-lane_max5.699999999999985
in-drivable-lane_mean5.699999999999985
in-drivable-lane_min5.699999999999985
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.608711254137817, "survival_time": 6.5999999999999845, "driven_lanedir": 0.1032158683617388, "in-drivable-lane": 5.699999999999985, "deviation-heading": 0.7727039152203754, "distance-from-start": 1.176164090862445, "deviation-center-line": 0.06555060179133754, "driven_lanedir_consec": 0.1032158683617388}}
simulation-passed1
survival_time_max6.5999999999999845
survival_time_mean6.5999999999999845
survival_time_min6.5999999999999845
No reset possible
163171818Bea Baselines 🐤template-rosaido-LFI-sim-testingsim-2of4successyesdavinci-stage-04-6.2.510:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
163081820Bea Baselines 🐤template-rosaido-LFVI_multi-sim-testingsim-0of4successyesdavinci-stage-04-6.2.510:04:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.550000000000017
in-drivable-lane_median8.250000000000016
driven_lanedir_consec_median0.4042599814166285
deviation-center-line_median0.20507521794457512


other stats
deviation-center-line_max0.6502333567562001
deviation-center-line_mean0.2823702193960691
deviation-center-line_min0.06909708493892609
deviation-heading_max2.1161299442668566
deviation-heading_mean1.2728648924543309
deviation-heading_median1.3000525052218384
deviation-heading_min0.3752246151067888
distance-from-start_max2.81607039452988
distance-from-start_mean1.195394920572585
distance-from-start_median0.8683401729060856
distance-from-start_min0.22882894194828757
driven_any_max2.8617835812516614
driven_any_mean1.2251924847848392
driven_any_median0.9050480015291836
driven_any_min0.22889035482932815
driven_lanedir_consec_max1.3000909886838572
driven_lanedir_consec_mean0.5563388817592885
driven_lanedir_consec_min0.1167445755200398
driven_lanedir_max1.4937992448503312
driven_lanedir_mean0.6064579907004579
driven_lanedir_median0.4076440712157303
driven_lanedir_min0.1167445755200398
in-drivable-lane_max9.750000000000014
in-drivable-lane_mean7.737500000000019
in-drivable-lane_min4.700000000000031
per-episodes
details{"udem-000-ego0": {"driven_any": 2.8617835812516614, "survival_time": 10.550000000000017, "driven_lanedir": 1.4937992448503312, "in-drivable-lane": 4.700000000000031, "deviation-heading": 2.095140118777754, "distance-from-start": 2.81607039452988, "deviation-center-line": 0.6502333567562001, "driven_lanedir_consec": 1.3000909886838572}, "udem-000-ego1": {"driven_any": 0.3746646358315487, "survival_time": 10.550000000000017, "driven_lanedir": 0.22013985605158193, "in-drivable-lane": 9.450000000000014, "deviation-heading": 0.3752246151067888, "distance-from-start": 0.3742691700002918, "deviation-center-line": 0.11686538193944718, "driven_lanedir_consec": 0.22013985605158193}, "udem-000-ego2": {"driven_any": 1.4354313672268186, "survival_time": 10.550000000000017, "driven_lanedir": 0.5951482863798787, "in-drivable-lane": 7.050000000000019, "deviation-heading": 2.1161299442668566, "distance-from-start": 1.362411175811879, "deviation-center-line": 0.2932850539497031, "driven_lanedir_consec": 0.588380106781675}, "udem-000-ego3": {"driven_any": 0.22889035482932815, "survival_time": 10.550000000000017, "driven_lanedir": 0.1167445755200398, "in-drivable-lane": 9.750000000000014, "deviation-heading": 0.5049648916659226, "distance-from-start": 0.22882894194828757, "deviation-center-line": 0.06909708493892609, "driven_lanedir_consec": 0.1167445755200398}}
simulation-passed1
survival_time_max10.550000000000017
survival_time_mean10.550000000000017
survival_time_min10.550000000000017
No reset possible
163011821Bea Baselines 🐤template-rosaido-LFV_multi-sim-testingsim-3of4successyesdavinci-stage-04-6.2.510:04:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.45
in-drivable-lane_median8.149999999999999
driven_lanedir_consec_median0.2449519642908477
deviation-center-line_median0.08822375344516808


other stats
deviation-center-line_max0.10289004926430632
deviation-center-line_mean0.08262950943623143
deviation-center-line_min0.05118048159028321
deviation-heading_max0.9693285480781386
deviation-heading_mean0.5667337334212621
deviation-heading_median0.49056964003700854
deviation-heading_min0.3164671055328928
distance-from-start_max2.5274428298285487
distance-from-start_mean1.2702726490111025
distance-from-start_median1.1101910556286885
distance-from-start_min0.33326565495848437
driven_any_max2.5682968028317537
driven_any_mean1.4343005859629756
driven_any_median1.4130623563729168
driven_any_min0.34278082827431494
driven_lanedir_consec_max0.39334036558251784
driven_lanedir_consec_mean0.23885807677720292
driven_lanedir_consec_min0.07218801294459842
driven_lanedir_max0.39334036558251784
driven_lanedir_mean0.23885807677720292
driven_lanedir_median0.2449519642908477
driven_lanedir_min0.07218801294459842
in-drivable-lane_max8.8
in-drivable-lane_mean8.149999999999999
in-drivable-lane_min7.499999999999998
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.5822927473407549, "survival_time": 9.45, "driven_lanedir": 0.39334036558251784, "in-drivable-lane": 7.499999999999998, "deviation-heading": 0.9693285480781386, "distance-from-start": 0.5710308222316614, "deviation-center-line": 0.10289004926430632, "driven_lanedir_consec": 0.39334036558251784}, "zigzag-000-ego1": {"driven_any": 2.2438319654050787, "survival_time": 9.45, "driven_lanedir": 0.19237345976291653, "in-drivable-lane": 8.5, "deviation-heading": 0.3164671055328928, "distance-from-start": 1.6493512890257152, "deviation-center-line": 0.08791702667684381, "driven_lanedir_consec": 0.19237345976291653}, "zigzag-000-ego2": {"driven_any": 2.5682968028317537, "survival_time": 9.45, "driven_lanedir": 0.29753046881877887, "in-drivable-lane": 7.799999999999998, "deviation-heading": 0.5017957820200564, "distance-from-start": 2.5274428298285487, "deviation-center-line": 0.08853048021349237, "driven_lanedir_consec": 0.29753046881877887}, "zigzag-000-ego3": {"driven_any": 0.34278082827431494, "survival_time": 9.45, "driven_lanedir": 0.07218801294459842, "in-drivable-lane": 8.8, "deviation-heading": 0.47934349805396065, "distance-from-start": 0.33326565495848437, "deviation-center-line": 0.05118048159028321, "driven_lanedir_consec": 0.07218801294459842}}
simulation-passed1
survival_time_max9.45
survival_time_mean9.45
survival_time_min9.45
No reset possible
162951848Andrea Danieleexercises_braitenberglx22-BV1sim-4of5successyesdavinci-stage-04-6.2.510:05:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.670206873031539


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.670206873031539
distance-from-start_median4.670206873031539
distance-from-start_min4.670206873031539
driven_any_max4.723037721295593
driven_any_mean4.723037721295593
driven_any_median4.723037721295593
driven_any_min4.723037721295593
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max38.09999999999997
in-drivable-lane_mean38.09999999999997
in-drivable-lane_median38.09999999999997
in-drivable-lane_min38.09999999999997
per-episodes
details{"d60-ego0": {"driven_any": 4.723037721295593, "survival_time": 38.09999999999997, "driven_lanedir": 0.0, "in-drivable-lane": 38.09999999999997, "deviation-heading": 0.0, "distance-from-start": 4.670206873031539, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max38.09999999999997
survival_time_mean38.09999999999997
survival_time_median38.09999999999997
survival_time_min38.09999999999997
No reset possible
162901845Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-testingsim-1of4failedyesdavinci-stage-04-6.2.510:02:05
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
162841844Bea Baselines 🐤template-tensorflowaido-LF-sim-testingsim-2of4failedyesdavinci-stage-04-6.2.510:01:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
162791845Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-testingsim-0of4failedyesdavinci-stage-04-6.2.510:02:19
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
162731846Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-testingsim-3of4failedyesdavinci-stage-04-6.2.510:01:55
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
162721847Bea Baselines 🐤template-tensorflowaido-LFP-sim-testingsim-2of4failedyesdavinci-stage-04-6.2.510:01:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
162681602Andrea Danieleexercises_braitenberglx22-BV1sim-0of5successyesdavinci-stage-04-6.2.510:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.39096164187185295


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.39096164187185295
distance-from-start_median0.39096164187185295
distance-from-start_min0.39096164187185295
driven_any_max0.3909616418718541
driven_any_mean0.3909616418718541
driven_any_median0.3909616418718541
driven_any_min0.3909616418718541
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max2.849999999999998
in-drivable-lane_mean2.849999999999998
in-drivable-lane_median2.849999999999998
in-drivable-lane_min2.849999999999998
per-episodes
details{"d30-ego0": {"driven_any": 0.3909616418718541, "survival_time": 2.849999999999998, "driven_lanedir": 0.0, "in-drivable-lane": 2.849999999999998, "deviation-heading": 0.0, "distance-from-start": 0.39096164187185295, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max2.849999999999998
survival_time_mean2.849999999999998
survival_time_median2.849999999999998
survival_time_min2.849999999999998
No reset possible
162641599Andrea Danieleexercises_braitenberglx22-BV1sim-0of5successyesdavinci-stage-04-6.2.510:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.5428113441927771


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.5428113441927771
distance-from-start_median0.5428113441927771
distance-from-start_min0.5428113441927771
driven_any_max0.5795602301345484
driven_any_mean0.5795602301345484
driven_any_median0.5795602301345484
driven_any_min0.5795602301345484
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max2.6499999999999986
in-drivable-lane_mean2.6499999999999986
in-drivable-lane_median2.6499999999999986
in-drivable-lane_min2.6499999999999986
per-episodes
details{"d30-ego0": {"driven_any": 0.5795602301345484, "survival_time": 2.6499999999999986, "driven_lanedir": 0.0, "in-drivable-lane": 2.6499999999999986, "deviation-heading": 0.0, "distance-from-start": 0.5428113441927771, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max2.6499999999999986
survival_time_mean2.6499999999999986
survival_time_median2.6499999999999986
survival_time_min2.6499999999999986
No reset possible
162621601Andrea Danieleexercises_braitenberglx22-BV1sim-0of5successyesdavinci-stage-04-6.2.510:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.39096164187185295


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.39096164187185295
distance-from-start_median0.39096164187185295
distance-from-start_min0.39096164187185295
driven_any_max0.3909616418718541
driven_any_mean0.3909616418718541
driven_any_median0.3909616418718541
driven_any_min0.3909616418718541
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max2.849999999999998
in-drivable-lane_mean2.849999999999998
in-drivable-lane_median2.849999999999998
in-drivable-lane_min2.849999999999998
per-episodes
details{"d30-ego0": {"driven_any": 0.3909616418718541, "survival_time": 2.849999999999998, "driven_lanedir": 0.0, "in-drivable-lane": 2.849999999999998, "deviation-heading": 0.0, "distance-from-start": 0.39096164187185295, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max2.849999999999998
survival_time_mean2.849999999999998
survival_time_median2.849999999999998
survival_time_min2.849999999999998
No reset possible
162561601Andrea Danieleexercises_braitenberglx22-BV1sim-0of5abortednodavinci-stage-04-6.2.510:00:44
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1302, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 749, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
162531534Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-validationsim-0of4failedyesdavinci-stage-04-6.2.510:01:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
162461549Bea Baselines 🐤template-tensorflowaido-LFI-sim-testingsim-1of4failedyesdavinci-stage-04-6.2.510:01:31
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
162381548Bea Baselines 🐤template-tensorflowaido-LFVI-sim-testingsim-1of4failedyesdavinci-stage-04-6.2.510:01:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
162341547Bea Baselines 🐤template-tensorflowaido-LFV-sim-testingsim-1of4failedyesdavinci-stage-04-6.2.510:02:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
162281550Bea Baselines 🐤template-tensorflowaido-LF-sim-testingsim-3of4failedyesdavinci-stage-04-6.2.510:01:00
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16217397Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-testingsim-3of4successyesdavinci-stage-04-6.2.510:08:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-3.2480955863996375
survival_time_median59.99999999999873
deviation-center-line_median2.589145887976697
in-drivable-lane_median32.2999999999992


other stats
deviation-center-line_max2.589145887976697
deviation-center-line_mean2.589145887976697
deviation-center-line_min2.589145887976697
deviation-heading_max24.553982361842948
deviation-heading_mean24.553982361842948
deviation-heading_median24.553982361842948
deviation-heading_min24.553982361842948
distance-from-start_max0.16126163061008195
distance-from-start_mean0.16126163061008195
distance-from-start_median0.16126163061008195
distance-from-start_min0.16126163061008195
driven_any_max12.002247888898491
driven_any_mean12.002247888898491
driven_any_median12.002247888898491
driven_any_min12.002247888898491
driven_lanedir_consec_max-3.2480955863996375
driven_lanedir_consec_mean-3.2480955863996375
driven_lanedir_consec_min-3.2480955863996375
driven_lanedir_max-3.2480955863996375
driven_lanedir_mean-3.2480955863996375
driven_lanedir_median-3.2480955863996375
driven_lanedir_min-3.2480955863996375
in-drivable-lane_max32.2999999999992
in-drivable-lane_mean32.2999999999992
in-drivable-lane_min32.2999999999992
per-episodes
details{"zigzag-000-ego0": {"driven_any": 12.002247888898491, "survival_time": 59.99999999999873, "driven_lanedir": -3.2480955863996375, "in-drivable-lane": 32.2999999999992, "deviation-heading": 24.553982361842948, "distance-from-start": 0.16126163061008195, "deviation-center-line": 2.589145887976697, "driven_lanedir_consec": -3.2480955863996375}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16213526Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-testingsim-2of4failedyesdavinci-stage-04-6.2.510:00:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
162091532Bea Baselines 🐤template-tensorflowaido-LF-sim-validationsim-0of4timeoutyesdavinci-stage-04-6.2.510:01:36
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
162061600Andrea Danielelx22-modconlx22-modconsimsuccessyesdavinci-stage-04-6.2.510:09:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median2.3
deviation-center-line_median1.838403160954605
driven_lanedir_consec_median5.8051412472252055
survival_time_median44.474999999999504


other stats
deviation-center-line_max2.060305946057066
deviation-center-line_mean1.838403160954605
deviation-center-line_min1.616500375852144
deviation-heading_max1.8138826601983544
deviation-heading_mean1.5100884058812278
deviation-heading_median1.5100884058812278
deviation-heading_min1.206294151564101
distance-from-start_max8.274760282260477
distance-from-start_mean6.034238552107428
distance-from-start_median6.034238552107428
distance-from-start_min3.793716821954381
driven_any_max8.338214336778261
driven_any_mean6.1159830758563745
driven_any_median6.1159830758563745
driven_any_min3.893751814934488
driven_lanedir_consec_max8.07209949250169
driven_lanedir_consec_mean5.8051412472252055
driven_lanedir_consec_min3.53818300194872
driven_lanedir_max8.07209949250169
driven_lanedir_mean5.8051412472252055
driven_lanedir_median5.8051412472252055
driven_lanedir_min3.53818300194872
in-drivable-lane_max2.5999999999999988
in-drivable-lane_mean2.3
in-drivable-lane_min2.000000000000001
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 8.338214336778261, "survival_time": 59.99999999999873, "driven_lanedir": 8.07209949250169, "in-drivable-lane": 2.000000000000001, "deviation-heading": 1.206294151564101, "distance-from-start": 8.274760282260477, "deviation-center-line": 1.616500375852144, "driven_lanedir_consec": 8.07209949250169}, "LF-full-loop-001-ego0": {"driven_any": 3.893751814934488, "survival_time": 28.950000000000276, "driven_lanedir": 3.53818300194872, "in-drivable-lane": 2.5999999999999988, "deviation-heading": 1.8138826601983544, "distance-from-start": 3.793716821954381, "deviation-center-line": 2.060305946057066, "driven_lanedir_consec": 3.53818300194872}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean44.474999999999504
survival_time_min28.950000000000276
No reset possible
162051599Andrea Danieleexercises_braitenberglx22-BV1sim-4of5successnodavinci-stage-04-6.2.510:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.4128048065357282


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.4128048065357282
distance-from-start_median1.4128048065357282
distance-from-start_min1.4128048065357282
driven_any_max1.6235365894136486
driven_any_mean1.6235365894136486
driven_any_median1.6235365894136486
driven_any_min1.6235365894136486
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max5.549999999999988
in-drivable-lane_mean5.549999999999988
in-drivable-lane_median5.549999999999988
in-drivable-lane_min5.549999999999988
per-episodes
details{"d60-ego0": {"driven_any": 1.6235365894136486, "survival_time": 5.549999999999988, "driven_lanedir": 0.0, "in-drivable-lane": 5.549999999999988, "deviation-heading": 0.0, "distance-from-start": 1.4128048065357282, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max5.549999999999988
survival_time_mean5.549999999999988
survival_time_median5.549999999999988
survival_time_min5.549999999999988
No reset possible
162011599Andrea Danieleexercises_braitenberglx22-BV1sim-2of5successnodavinci-stage-04-6.2.510:01:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.874680474434121


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.874680474434121
distance-from-start_median0.874680474434121
distance-from-start_min0.874680474434121
driven_any_max0.9755424830705652
driven_any_mean0.9755424830705652
driven_any_median0.9755424830705652
driven_any_min0.9755424830705652
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max3.7499999999999942
in-drivable-lane_mean3.7499999999999942
in-drivable-lane_median3.7499999999999942
in-drivable-lane_min3.7499999999999942
per-episodes
details{"d40-ego0": {"driven_any": 0.9755424830705652, "survival_time": 3.7499999999999942, "driven_lanedir": 0.0, "in-drivable-lane": 3.7499999999999942, "deviation-heading": 0.0, "distance-from-start": 0.874680474434121, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max3.7499999999999942
survival_time_mean3.7499999999999942
survival_time_median3.7499999999999942
survival_time_min3.7499999999999942
No reset possible
161971597Andrea Danieleexercises_braitenberglx22-BV1sim-4of5successnodavinci-stage-04-6.2.510:09:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d60-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
161861592Andrea Danieleplanning-exerciselx22-planning-dd-static-teststep1-1of4successyesdavinci-stage-04-6.2.510:04:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible6
nsamples6
No reset possible
161631590Andrea Danieleplanning-exerciselx22-planning-cc-empty-valistep1successyesdavinci-stage-04-6.2.510:16:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.2626749063171028


other stats
nfeasible27
nsamples27
No reset possible
161571584Andrea Censiexercises_braitenberglx22-BV1sim-0of5successnodavinci-stage-04-6.2.510:08:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d30-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
161411581Andrea Censiplanning-exerciselx22-planning-cc-empty-teststep1successyesdavinci-stage-04-6.2.510:16:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.2626749063171028


other stats
nfeasible27
nsamples27
No reset possible
161401570Andrea Censiplanning-exerciselx22-planning-dd-dynamic-valistep1-3of4successyesdavinci-stage-04-6.2.510:00:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
161201575Andrea Censiplanning-exerciselx22-planning-cc-empty-valistep1successyesdavinci-stage-04-6.2.510:18:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.2626749063171028


other stats
nfeasible27
nsamples27
No reset possible
161121559Andrea Censiplanning-exerciselx22-planning-dd-static-valistep1-0of4failedyesdavinci-stage-04-6.2.510:00:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 64, in run_checker
    agent_ci._get_node_protocol()
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 101, in _get_node_protocol
    msgs = read_reply(
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "checker" aborted with the following error:

error in checker |list[1]
                 |#0 tuple[2]
                 |   #0 Cannot import the node class
                 |   #1 dict[2]
                 |      │ node_symbol: planner.Planner
                 |      │ tb:
                 |      │ |Traceback (most recent call last):
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |    return __import__(name, fromlist=["dummy"])
                 |      │ |ModuleNotFoundError: No module named 'planner'
                 |      │ |
                 |      │ |During handling of the above exception, another exception occurred:
                 |      │ |
                 |      │ |Traceback (most recent call last):
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |    return __import__(name, fromlist=["dummy"])
                 |      │ |ModuleNotFoundError: No module named 'planner'
                 |      │ |
                 |      │ |During handling of the above exception, another exception occurred:
                 |      │ |
                 |      │ |Traceback (most recent call last):
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/launcher.py", line 93, in launcher_main
                 |      │ |    node_type = import_name(config.node)
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 46, in import_name
                 |      │ |    module = import_name(module_name)
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 76, in import_name
                 |      │ |    raise ValueError(msg)
                 |      │ |ValueError: Cannot import name 'planner'.> Traceback (most recent call last):
                 |      │ |>   File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |>     return __import__(name, fromlist=["dummy"])
                 |      │ |> ModuleNotFoundError: No module named 'planner'
                 |      │ |>
                 |      │ |> During handling of the above exception, another exception occurred:
                 |      │ |>
                 |      │ |> Traceback (most recent call last):
                 |      │ |>   File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |>     return __import__(name, fromlist=["dummy"])
                 |      │ |> ModuleNotFoundError: No module named 'planner'
                 |      │ |>
                 |      │ |

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/dt_planning/planning_checker.py", line 102, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 115, in run_checker
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
161061561Andrea Censiplanning-exerciselx22-planning-cc-dynamic-valistep1-1of4failedyesdavinci-stage-04-6.2.510:00:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 64, in run_checker
    agent_ci._get_node_protocol()
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 101, in _get_node_protocol
    msgs = read_reply(
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "checker" aborted with the following error:

error in checker |list[1]
                 |#0 tuple[2]
                 |   #0 Cannot import the node class
                 |   #1 dict[2]
                 |      │ node_symbol: planner.Planner
                 |      │ tb:
                 |      │ |Traceback (most recent call last):
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |    return __import__(name, fromlist=["dummy"])
                 |      │ |ModuleNotFoundError: No module named 'planner'
                 |      │ |
                 |      │ |During handling of the above exception, another exception occurred:
                 |      │ |
                 |      │ |Traceback (most recent call last):
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |    return __import__(name, fromlist=["dummy"])
                 |      │ |ModuleNotFoundError: No module named 'planner'
                 |      │ |
                 |      │ |During handling of the above exception, another exception occurred:
                 |      │ |
                 |      │ |Traceback (most recent call last):
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/launcher.py", line 93, in launcher_main
                 |      │ |    node_type = import_name(config.node)
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 46, in import_name
                 |      │ |    module = import_name(module_name)
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 76, in import_name
                 |      │ |    raise ValueError(msg)
                 |      │ |ValueError: Cannot import name 'planner'.> Traceback (most recent call last):
                 |      │ |>   File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |>     return __import__(name, fromlist=["dummy"])
                 |      │ |> ModuleNotFoundError: No module named 'planner'
                 |      │ |>
                 |      │ |> During handling of the above exception, another exception occurred:
                 |      │ |>
                 |      │ |> Traceback (most recent call last):
                 |      │ |>   File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |>     return __import__(name, fromlist=["dummy"])
                 |      │ |> ModuleNotFoundError: No module named 'planner'
                 |      │ |>
                 |      │ |

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/dt_planning/planning_checker.py", line 102, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 115, in run_checker
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
161031561Andrea Censiplanning-exerciselx22-planning-cc-dynamic-valistep1-1of4failedyesdavinci-stage-04-6.2.510:00:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 64, in run_checker
    agent_ci._get_node_protocol()
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 101, in _get_node_protocol
    msgs = read_reply(
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "checker" aborted with the following error:

error in checker |list[1]
                 |#0 tuple[2]
                 |   #0 Cannot import the node class
                 |   #1 dict[2]
                 |      │ node_symbol: planner.Planner
                 |      │ tb:
                 |      │ |Traceback (most recent call last):
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |    return __import__(name, fromlist=["dummy"])
                 |      │ |ModuleNotFoundError: No module named 'planner'
                 |      │ |
                 |      │ |During handling of the above exception, another exception occurred:
                 |      │ |
                 |      │ |Traceback (most recent call last):
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |    return __import__(name, fromlist=["dummy"])
                 |      │ |ModuleNotFoundError: No module named 'planner'
                 |      │ |
                 |      │ |During handling of the above exception, another exception occurred:
                 |      │ |
                 |      │ |Traceback (most recent call last):
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/launcher.py", line 93, in launcher_main
                 |      │ |    node_type = import_name(config.node)
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 46, in import_name
                 |      │ |    module = import_name(module_name)
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 76, in import_name
                 |      │ |    raise ValueError(msg)
                 |      │ |ValueError: Cannot import name 'planner'.> Traceback (most recent call last):
                 |      │ |>   File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |>     return __import__(name, fromlist=["dummy"])
                 |      │ |> ModuleNotFoundError: No module named 'planner'
                 |      │ |>
                 |      │ |> During handling of the above exception, another exception occurred:
                 |      │ |>
                 |      │ |> Traceback (most recent call last):
                 |      │ |>   File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |>     return __import__(name, fromlist=["dummy"])
                 |      │ |> ModuleNotFoundError: No module named 'planner'
                 |      │ |>
                 |      │ |

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/dt_planning/planning_checker.py", line 102, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 115, in run_checker
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
160941562Andrea Censiplanning-exerciselx22-planning-cc-static-valistep1-1of4failedyesdavinci-stage-04-6.2.510:03:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 64, in run_checker
    agent_ci._get_node_protocol()
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 101, in _get_node_protocol
    msgs = read_reply(
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "checker" aborted with the following error:

error in checker |list[1]
                 |#0 tuple[2]
                 |   #0 Cannot import the node class
                 |   #1 dict[2]
                 |      │ node_symbol: planner.Planner
                 |      │ tb:
                 |      │ |Traceback (most recent call last):
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |    return __import__(name, fromlist=["dummy"])
                 |      │ |ModuleNotFoundError: No module named 'planner'
                 |      │ |
                 |      │ |During handling of the above exception, another exception occurred:
                 |      │ |
                 |      │ |Traceback (most recent call last):
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |    return __import__(name, fromlist=["dummy"])
                 |      │ |ModuleNotFoundError: No module named 'planner'
                 |      │ |
                 |      │ |During handling of the above exception, another exception occurred:
                 |      │ |
                 |      │ |Traceback (most recent call last):
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/launcher.py", line 93, in launcher_main
                 |      │ |    node_type = import_name(config.node)
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 46, in import_name
                 |      │ |    module = import_name(module_name)
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 76, in import_name
                 |      │ |    raise ValueError(msg)
                 |      │ |ValueError: Cannot import name 'planner'.> Traceback (most recent call last):
                 |      │ |>   File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |>     return __import__(name, fromlist=["dummy"])
                 |      │ |> ModuleNotFoundError: No module named 'planner'
                 |      │ |>
                 |      │ |> During handling of the above exception, another exception occurred:
                 |      │ |>
                 |      │ |> Traceback (most recent call last):
                 |      │ |>   File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |>     return __import__(name, fromlist=["dummy"])
                 |      │ |> ModuleNotFoundError: No module named 'planner'
                 |      │ |>
                 |      │ |

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/dt_planning/planning_checker.py", line 102, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 115, in run_checker
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
160901557Andrea Danieleexercises_braitenberglx22-BV1sim-2of5successnodavinci-stage-04-6.2.510:09:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d40-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
160881556Frank (Chude) Qianexercises_braitenberglx22-BV1sim-3of5successnodavinci-stage-04-6.2.510:09:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d50-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
16079385Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-validationsim-3of4host-errornodavinci-stage-04-6.2.510:04:25
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-stage-04-6.2.51-job16079-30767, up, --no-start,
│          --renew-anon-volumes]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-stage-04-6.2.51-job16079-30767', 'up', '--no-start', '--renew-anon-volumes']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16074386Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-validationsim-0of4successnodavinci-stage-04-6.2.510:09:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median26.29999999999934
driven_lanedir_consec_median-3.5382007511568494
deviation-center-line_median2.155534895328876


other stats
deviation-center-line_max2.155534895328876
deviation-center-line_mean2.155534895328876
deviation-center-line_min2.155534895328876
deviation-heading_max28.109177971221634
deviation-heading_mean28.109177971221634
deviation-heading_median28.109177971221634
deviation-heading_min28.109177971221634
distance-from-start_max0.16699493954499697
distance-from-start_mean0.16699493954499697
distance-from-start_median0.16699493954499697
distance-from-start_min0.16699493954499697
driven_any_max11.770966723064996
driven_any_mean11.770966723064996
driven_any_median11.770966723064996
driven_any_min11.770966723064996
driven_lanedir_consec_max-3.5382007511568494
driven_lanedir_consec_mean-3.5382007511568494
driven_lanedir_consec_min-3.5382007511568494
driven_lanedir_max-3.8860437315980407
driven_lanedir_mean-3.8860437315980407
driven_lanedir_median-3.8860437315980407
driven_lanedir_min-3.8860437315980407
in-drivable-lane_max26.29999999999934
in-drivable-lane_mean26.29999999999934
in-drivable-lane_min26.29999999999934
per-episodes
details{"autolab-000-ego0": {"driven_any": 11.770966723064996, "survival_time": 59.99999999999873, "driven_lanedir": -3.8860437315980407, "in-drivable-lane": 26.29999999999934, "deviation-heading": 28.109177971221634, "distance-from-start": 0.16699493954499697, "deviation-center-line": 2.155534895328876, "driven_lanedir_consec": -3.5382007511568494}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16068387Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-validationsim-0of4successnodavinci-stage-04-6.2.510:18:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median26.899999999999384
driven_lanedir_consec_median-3.813561694412012
deviation-center-line_median2.5259055294374924


other stats
deviation-center-line_max2.5259055294374924
deviation-center-line_mean2.5259055294374924
deviation-center-line_min2.5259055294374924
deviation-heading_max27.692125463694325
deviation-heading_mean27.692125463694325
deviation-heading_median27.692125463694325
deviation-heading_min27.692125463694325
distance-from-start_max0.16954551527564377
distance-from-start_mean0.16954551527564377
distance-from-start_median0.16954551527564377
distance-from-start_min0.16954551527564377
driven_any_max12.78563073005655
driven_any_mean12.78563073005655
driven_any_median12.78563073005655
driven_any_min12.78563073005655
driven_lanedir_consec_max-3.813561694412012
driven_lanedir_consec_mean-3.813561694412012
driven_lanedir_consec_min-3.813561694412012
driven_lanedir_max-4.019571243187794
driven_lanedir_mean-4.019571243187794
driven_lanedir_median-4.019571243187794
driven_lanedir_min-4.019571243187794
in-drivable-lane_max26.899999999999384
in-drivable-lane_mean26.899999999999384
in-drivable-lane_min26.899999999999384
per-episodes
details{"autolab-000-ego0": {"driven_any": 12.78563073005655, "survival_time": 59.99999999999873, "driven_lanedir": -4.019571243187794, "in-drivable-lane": 26.899999999999384, "deviation-heading": 27.692125463694325, "distance-from-start": 0.16954551527564377, "deviation-center-line": 2.5259055294374924, "driven_lanedir_consec": -3.813561694412012}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16061389Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-validationsim-0of4successnodavinci-stage-04-6.2.510:09:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median24.749999999999403
driven_lanedir_consec_median-3.533513270570616
deviation-center-line_median2.4505069108760154


other stats
deviation-center-line_max2.4505069108760154
deviation-center-line_mean2.4505069108760154
deviation-center-line_min2.4505069108760154
deviation-heading_max28.678454441635605
deviation-heading_mean28.678454441635605
deviation-heading_median28.678454441635605
deviation-heading_min28.678454441635605
distance-from-start_max0.2714976624613749
distance-from-start_mean0.2714976624613749
distance-from-start_median0.2714976624613749
distance-from-start_min0.2714976624613749
driven_any_max12.49280460939561
driven_any_mean12.49280460939561
driven_any_median12.49280460939561
driven_any_min12.49280460939561
driven_lanedir_consec_max-3.533513270570616
driven_lanedir_consec_mean-3.533513270570616
driven_lanedir_consec_min-3.533513270570616
driven_lanedir_max-3.9388829893592865
driven_lanedir_mean-3.9388829893592865
driven_lanedir_median-3.9388829893592865
driven_lanedir_min-3.9388829893592865
in-drivable-lane_max24.749999999999403
in-drivable-lane_mean24.749999999999403
in-drivable-lane_min24.749999999999403
per-episodes
details{"4way-000-ego0": {"driven_any": 12.49280460939561, "survival_time": 59.99999999999873, "driven_lanedir": -3.9388829893592865, "in-drivable-lane": 24.749999999999403, "deviation-heading": 28.678454441635605, "distance-from-start": 0.2714976624613749, "deviation-center-line": 2.4505069108760154, "driven_lanedir_consec": -3.533513270570616}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16057390Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-validationsim-3of4successnodavinci-stage-04-6.2.510:09:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-4.004889580442478
survival_time_median59.99999999999873
deviation-center-line_median2.022729808935561
in-drivable-lane_median26.69999999999947


other stats
deviation-center-line_max2.022729808935561
deviation-center-line_mean2.022729808935561
deviation-center-line_min2.022729808935561
deviation-heading_max28.80814199361772
deviation-heading_mean28.80814199361772
deviation-heading_median28.80814199361772
deviation-heading_min28.80814199361772
distance-from-start_max0.2200731373728858
distance-from-start_mean0.2200731373728858
distance-from-start_median0.2200731373728858
distance-from-start_min0.2200731373728858
driven_any_max12.999355216889962
driven_any_mean12.999355216889962
driven_any_median12.999355216889962
driven_any_min12.999355216889962
driven_lanedir_consec_max-4.004889580442478
driven_lanedir_consec_mean-4.004889580442478
driven_lanedir_consec_min-4.004889580442478
driven_lanedir_max-4.322026598602476
driven_lanedir_mean-4.322026598602476
driven_lanedir_median-4.322026598602476
driven_lanedir_min-4.322026598602476
in-drivable-lane_max26.69999999999947
in-drivable-lane_mean26.69999999999947
in-drivable-lane_min26.69999999999947
per-episodes
details{"zigzag-000-ego0": {"driven_any": 12.999355216889962, "survival_time": 59.99999999999873, "driven_lanedir": -4.322026598602476, "in-drivable-lane": 26.69999999999947, "deviation-heading": 28.80814199361772, "distance-from-start": 0.2200731373728858, "deviation-center-line": 2.022729808935561, "driven_lanedir_consec": -4.004889580442478}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16055390Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-validationsim-2of4successnodavinci-stage-04-6.2.510:06:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-2.9877060037993703
survival_time_median59.99999999999873
deviation-center-line_median2.766794410562123
in-drivable-lane_median22.29999999999947


other stats
deviation-center-line_max2.766794410562123
deviation-center-line_mean2.766794410562123
deviation-center-line_min2.766794410562123
deviation-heading_max28.38818315002097
deviation-heading_mean28.38818315002097
deviation-heading_median28.38818315002097
deviation-heading_min28.38818315002097
distance-from-start_max0.22426651685453056
distance-from-start_mean0.22426651685453056
distance-from-start_median0.22426651685453056
distance-from-start_min0.22426651685453056
driven_any_max11.235466745096788
driven_any_mean11.235466745096788
driven_any_median11.235466745096788
driven_any_min11.235466745096788
driven_lanedir_consec_max-2.9877060037993703
driven_lanedir_consec_mean-2.9877060037993703
driven_lanedir_consec_min-2.9877060037993703
driven_lanedir_max-3.4130081922122497
driven_lanedir_mean-3.4130081922122497
driven_lanedir_median-3.4130081922122497
driven_lanedir_min-3.4130081922122497
in-drivable-lane_max22.29999999999947
in-drivable-lane_mean22.29999999999947
in-drivable-lane_min22.29999999999947
per-episodes
details{"loop2-000-ego0": {"driven_any": 11.235466745096788, "survival_time": 59.99999999999873, "driven_lanedir": -3.4130081922122497, "in-drivable-lane": 22.29999999999947, "deviation-heading": 28.38818315002097, "distance-from-start": 0.22426651685453056, "deviation-center-line": 2.766794410562123, "driven_lanedir_consec": -2.9877060037993703}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16054390Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-validationsim-1of4successnodavinci-stage-04-6.2.510:06:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-2.7071766570970626
survival_time_median59.99999999999873
deviation-center-line_median2.6481625513847233
in-drivable-lane_median22.649999999999476


other stats
deviation-center-line_max2.6481625513847233
deviation-center-line_mean2.6481625513847233
deviation-center-line_min2.6481625513847233
deviation-heading_max30.502624840896836
deviation-heading_mean30.502624840896836
deviation-heading_median30.502624840896836
deviation-heading_min30.502624840896836
distance-from-start_max0.1847722320018317
distance-from-start_mean0.1847722320018317
distance-from-start_median0.1847722320018317
distance-from-start_min0.1847722320018317
driven_any_max10.550205936760433
driven_any_mean10.550205936760433
driven_any_median10.550205936760433
driven_any_min10.550205936760433
driven_lanedir_consec_max-2.7071766570970626
driven_lanedir_consec_mean-2.7071766570970626
driven_lanedir_consec_min-2.7071766570970626
driven_lanedir_max-2.7071766570970626
driven_lanedir_mean-2.7071766570970626
driven_lanedir_median-2.7071766570970626
driven_lanedir_min-2.7071766570970626
in-drivable-lane_max22.649999999999476
in-drivable-lane_mean22.649999999999476
in-drivable-lane_min22.649999999999476
per-episodes
details{"loop-000-ego0": {"driven_any": 10.550205936760433, "survival_time": 59.99999999999873, "driven_lanedir": -2.7071766570970626, "in-drivable-lane": 22.649999999999476, "deviation-heading": 30.502624840896836, "distance-from-start": 0.1847722320018317, "deviation-center-line": 2.6481625513847233, "driven_lanedir_consec": -2.7071766570970626}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16053391Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-validationsim-1of4host-errornodavinci-stage-04-6.2.510:01:25
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16052391Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-validationsim-2of4successnodavinci-stage-04-6.2.510:01:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
16051391Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-validationsim-3of4successnodavinci-stage-04-6.2.510:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
16047392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-2of4successnodavinci-stage-04-6.2.510:13:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median36.67499999999905
driven_lanedir_consec_median-2.3437703768645712
deviation-center-line_median2.245086618341837


other stats
deviation-center-line_max2.54185955311821
deviation-center-line_mean2.245086618341837
deviation-center-line_min1.9483136835654635
deviation-heading_max22.96893577405584
deviation-heading_mean21.59921939887888
deviation-heading_median21.59921939887888
deviation-heading_min20.229503023701923
distance-from-start_max0.1513155133735528
distance-from-start_mean0.14981604892829598
distance-from-start_median0.14981604892829598
distance-from-start_min0.14831658448303917
driven_any_max11.334956981115536
driven_any_mean11.08718357283836
driven_any_median11.08718357283836
driven_any_min10.839410164561183
driven_lanedir_consec_max-1.7707950714591445
driven_lanedir_consec_mean-2.3437703768645712
driven_lanedir_consec_min-2.916745682269998
driven_lanedir_max-1.7707950714591445
driven_lanedir_mean-2.3437703768645712
driven_lanedir_median-2.3437703768645712
driven_lanedir_min-2.916745682269998
in-drivable-lane_max39.19999999999889
in-drivable-lane_mean36.67499999999905
in-drivable-lane_min34.14999999999922
per-episodes
details{"loop2-000-ego0": {"driven_any": 11.334956981115536, "survival_time": 59.99999999999873, "driven_lanedir": -2.916745682269998, "in-drivable-lane": 34.14999999999922, "deviation-heading": 22.96893577405584, "distance-from-start": 0.1513155133735528, "deviation-center-line": 2.54185955311821, "driven_lanedir_consec": -2.916745682269998}, "loop2-000-ego1": {"driven_any": 10.839410164561183, "survival_time": 59.99999999999873, "driven_lanedir": -1.7707950714591445, "in-drivable-lane": 39.19999999999889, "deviation-heading": 20.229503023701923, "distance-from-start": 0.14831658448303917, "deviation-center-line": 1.9483136835654635, "driven_lanedir_consec": -1.7707950714591445}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16044393Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-testingsim-0of4successnodavinci-stage-04-6.2.510:09:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median36.949999999998994
driven_lanedir_consec_median-2.223836286705292
deviation-center-line_median2.314096232029231


other stats
deviation-center-line_max2.314096232029231
deviation-center-line_mean2.314096232029231
deviation-center-line_min2.314096232029231
deviation-heading_max21.30526083074812
deviation-heading_mean21.30526083074812
deviation-heading_median21.30526083074812
deviation-heading_min21.30526083074812
distance-from-start_max0.14859232677453646
distance-from-start_mean0.14859232677453646
distance-from-start_median0.14859232677453646
distance-from-start_min0.14859232677453646
driven_any_max10.766044515319376
driven_any_mean10.766044515319376
driven_any_median10.766044515319376
driven_any_min10.766044515319376
driven_lanedir_consec_max-2.223836286705292
driven_lanedir_consec_mean-2.223836286705292
driven_lanedir_consec_min-2.223836286705292
driven_lanedir_max-2.223836286705292
driven_lanedir_mean-2.223836286705292
driven_lanedir_median-2.223836286705292
driven_lanedir_min-2.223836286705292
in-drivable-lane_max36.949999999998994
in-drivable-lane_mean36.949999999998994
in-drivable-lane_min36.949999999998994
per-episodes
details{"autolab-000-ego0": {"driven_any": 10.766044515319376, "survival_time": 59.99999999999873, "driven_lanedir": -2.223836286705292, "in-drivable-lane": 36.949999999998994, "deviation-heading": 21.30526083074812, "distance-from-start": 0.14859232677453646, "deviation-center-line": 2.314096232029231, "driven_lanedir_consec": -2.223836286705292}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16026398Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-testingsim-0of4successnodavinci-stage-04-6.2.510:28:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median18.57499999999969
driven_lanedir_consec_median-1.846010658314547
deviation-center-line_median3.980032371532205


other stats
deviation-center-line_max6.98929575680385
deviation-center-line_mean4.314705914457902
deviation-center-line_min2.30946315796335
deviation-heading_max25.808163393699424
deviation-heading_mean19.864809961825628
deviation-heading_median22.29330309384092
deviation-heading_min9.06447026592125
distance-from-start_max0.1843889262411763
distance-from-start_mean0.1673067540243908
distance-from-start_median0.16455785894457442
distance-from-start_min0.155722371967238
driven_any_max12.659056632044766
driven_any_mean7.925184224753106
driven_any_median8.457849072487003
driven_any_min2.125982121993652
driven_lanedir_consec_max-0.6086913386374655
driven_lanedir_consec_mean-2.0097432301360243
driven_lanedir_consec_min-3.738260265277538
driven_lanedir_max-0.6086913386374655
driven_lanedir_mean-2.0816357086011905
driven_lanedir_median-1.989795615244879
driven_lanedir_min-3.738260265277538
in-drivable-lane_max32.1999999999991
in-drivable-lane_mean18.712499999999626
in-drivable-lane_min5.50000000000001
per-episodes
details{"udem-000-ego0": {"driven_any": 11.72236347122637, "survival_time": 59.99999999999873, "driven_lanedir": -2.276121646445824, "in-drivable-lane": 32.1999999999991, "deviation-heading": 25.29363575331457, "distance-from-start": 0.155722371967238, "deviation-center-line": 2.8205794439178775, "driven_lanedir_consec": -2.276121646445824}, "udem-000-ego1": {"driven_any": 2.125982121993652, "survival_time": 59.99999999999873, "driven_lanedir": -0.6086913386374655, "in-drivable-lane": 5.50000000000001, "deviation-heading": 9.06447026592125, "distance-from-start": 0.1629232008828155, "deviation-center-line": 6.98929575680385, "driven_lanedir_consec": -0.6086913386374655}, "udem-000-ego2": {"driven_any": 5.193334673747636, "survival_time": 59.99999999999873, "driven_lanedir": -1.7034695840439342, "in-drivable-lane": 8.55000000000007, "deviation-heading": 19.292970434367273, "distance-from-start": 0.16619251700633336, "deviation-center-line": 5.139485299146532, "driven_lanedir_consec": -1.4158996701832702}, "udem-000-ego3": {"driven_any": 12.659056632044766, "survival_time": 59.99999999999873, "driven_lanedir": -3.738260265277538, "in-drivable-lane": 28.59999999999931, "deviation-heading": 25.808163393699424, "distance-from-start": 0.1843889262411763, "deviation-center-line": 2.30946315796335, "driven_lanedir_consec": -3.738260265277538}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16021515Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-validationsim-2of4failednodavinci-stage-04-6.2.510:00:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16016516Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-validationsim-2of4failednodavinci-stage-04-6.2.510:01:36
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16011517Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-validationsim-3of4successnodavinci-stage-04-6.2.510:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
16006518Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-validationsim-2of4successnodavinci-stage-04-6.2.510:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
16000520Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-validationsim-2of4successnodavinci-stage-04-6.2.510:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
15996521Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-testingsim-0of4failednodavinci-stage-04-6.2.510:01:12
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15992522Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-testingsim-1of4failednodavinci-stage-04-6.2.510:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15988523Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-testingsim-3of4failednodavinci-stage-04-6.2.510:01:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15985524Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-testingsim-3of4successnodavinci-stage-04-6.2.510:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
15982524Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-testingsim-0of4failednodavinci-stage-04-6.2.510:01:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15979525Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-testingsim-2of4successnodavinci-stage-04-6.2.510:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
15977527Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-testingsim-1of4failednodavinci-stage-04-6.2.510:01:12
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15964530Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-validationsim-3of4successnodavinci-stage-04-6.2.510:15:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.5500000000000078
driven_lanedir_consec_median8.929048316088497
deviation-center-line_median2.7796329733903673


other stats
deviation-center-line_max2.7796329733903673
deviation-center-line_mean2.7796329733903673
deviation-center-line_min2.7796329733903673
deviation-heading_max14.007235626813827
deviation-heading_mean14.007235626813827
deviation-heading_median14.007235626813827
deviation-heading_min14.007235626813827
distance-from-start_max4.500191330320018
distance-from-start_mean4.500191330320018
distance-from-start_median4.500191330320018
distance-from-start_min4.500191330320018
driven_any_max9.517197729862044
driven_any_mean9.517197729862044
driven_any_median9.517197729862044
driven_any_min9.517197729862044
driven_lanedir_consec_max8.929048316088497
driven_lanedir_consec_mean8.929048316088497
driven_lanedir_consec_min8.929048316088497
driven_lanedir_max8.929048316088497
driven_lanedir_mean8.929048316088497
driven_lanedir_median8.929048316088497
driven_lanedir_min8.929048316088497
in-drivable-lane_max0.5500000000000078
in-drivable-lane_mean0.5500000000000078
in-drivable-lane_min0.5500000000000078
per-episodes
details{"zigzag-000-ego0": {"driven_any": 9.517197729862044, "survival_time": 59.99999999999873, "driven_lanedir": 8.929048316088497, "in-drivable-lane": 0.5500000000000078, "deviation-heading": 14.007235626813827, "distance-from-start": 4.500191330320018, "deviation-center-line": 2.7796329733903673, "driven_lanedir_consec": 8.929048316088497}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
15956532Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-validationsim-1of4successnodavinci-stage-04-6.2.510:07:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median8.78963752297264
deviation-center-line_median2.3963798821505833


other stats
deviation-center-line_max2.3963798821505833
deviation-center-line_mean2.3963798821505833
deviation-center-line_min2.3963798821505833
deviation-heading_max11.52395206526296
deviation-heading_mean11.52395206526296
deviation-heading_median11.52395206526296
deviation-heading_min11.52395206526296
distance-from-start_max3.4416673581184667
distance-from-start_mean3.4416673581184667
distance-from-start_median3.4416673581184667
distance-from-start_min3.4416673581184667
driven_any_max9.979959837369176
driven_any_mean9.979959837369176
driven_any_median9.979959837369176
driven_any_min9.979959837369176
driven_lanedir_consec_max8.78963752297264
driven_lanedir_consec_mean8.78963752297264
driven_lanedir_consec_min8.78963752297264
driven_lanedir_max9.640632820885903
driven_lanedir_mean9.640632820885903
driven_lanedir_median9.640632820885903
driven_lanedir_min9.640632820885903
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-000-ego0": {"driven_any": 9.979959837369176, "survival_time": 59.99999999999873, "driven_lanedir": 9.640632820885903, "in-drivable-lane": 0.0, "deviation-heading": 11.52395206526296, "distance-from-start": 3.4416673581184667, "deviation-center-line": 2.3963798821505833, "driven_lanedir_consec": 8.78963752297264}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
15954532Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-validationsim-2of4successnodavinci-stage-04-6.2.510:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
15952533Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-validationsim-2of4successnodavinci-stage-04-6.2.510:05:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.710555738960784
survival_time_median59.99999999999873
deviation-center-line_median4.0921095459761485
in-drivable-lane_median4.799999999999964


other stats
deviation-center-line_max4.0921095459761485
deviation-center-line_mean4.0921095459761485
deviation-center-line_min4.0921095459761485
deviation-heading_max19.79429971045774
deviation-heading_mean19.79429971045774
deviation-heading_median19.79429971045774
deviation-heading_min19.79429971045774
distance-from-start_max1.6021697366101249
distance-from-start_mean1.6021697366101249
distance-from-start_median1.6021697366101249
distance-from-start_min1.6021697366101249
driven_any_max11.701847268688164
driven_any_mean11.701847268688164
driven_any_median11.701847268688164
driven_any_min11.701847268688164
driven_lanedir_consec_max9.710555738960784
driven_lanedir_consec_mean9.710555738960784
driven_lanedir_consec_min9.710555738960784
driven_lanedir_max9.710555738960784
driven_lanedir_mean9.710555738960784
driven_lanedir_median9.710555738960784
driven_lanedir_min9.710555738960784
in-drivable-lane_max4.799999999999964
in-drivable-lane_mean4.799999999999964
in-drivable-lane_min4.799999999999964
per-episodes
details{"loop2-000-ego0": {"driven_any": 11.701847268688164, "survival_time": 59.99999999999873, "driven_lanedir": 9.710555738960784, "in-drivable-lane": 4.799999999999964, "deviation-heading": 19.79429971045774, "distance-from-start": 1.6021697366101249, "deviation-center-line": 4.0921095459761485, "driven_lanedir_consec": 9.710555738960784}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
15938537Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-testingsim-3of4successnodavinci-stage-04-6.2.510:15:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.70000000000001
driven_lanedir_consec_median9.289090525581344
deviation-center-line_median3.4869586555251275


other stats
deviation-center-line_max3.4869586555251275
deviation-center-line_mean3.4869586555251275
deviation-center-line_min3.4869586555251275
deviation-heading_max14.297385270107092
deviation-heading_mean14.297385270107092
deviation-heading_median14.297385270107092
deviation-heading_min14.297385270107092
distance-from-start_max2.6556166181330827
distance-from-start_mean2.6556166181330827
distance-from-start_median2.6556166181330827
distance-from-start_min2.6556166181330827
driven_any_max9.87103566844523
driven_any_mean9.87103566844523
driven_any_median9.87103566844523
driven_any_min9.87103566844523
driven_lanedir_consec_max9.289090525581344
driven_lanedir_consec_mean9.289090525581344
driven_lanedir_consec_min9.289090525581344
driven_lanedir_max9.289090525581344
driven_lanedir_mean9.289090525581344
driven_lanedir_median9.289090525581344
driven_lanedir_min9.289090525581344
in-drivable-lane_max0.70000000000001
in-drivable-lane_mean0.70000000000001
in-drivable-lane_min0.70000000000001
per-episodes
details{"zigzag-000-ego0": {"driven_any": 9.87103566844523, "survival_time": 59.99999999999873, "driven_lanedir": 9.289090525581344, "in-drivable-lane": 0.70000000000001, "deviation-heading": 14.297385270107092, "distance-from-start": 2.6556166181330827, "deviation-center-line": 3.4869586555251275, "driven_lanedir_consec": 9.289090525581344}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
15931538Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-testingsim-1of4successnodavinci-stage-04-6.2.510:09:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median37.45000000000001
in-drivable-lane_median3.049999999999826
driven_lanedir_consec_median5.6931851014896715
deviation-center-line_median2.0132525021202374


other stats
deviation-center-line_max2.0132525021202374
deviation-center-line_mean2.0132525021202374
deviation-center-line_min2.0132525021202374
deviation-heading_max10.802312532113078
deviation-heading_mean10.802312532113078
deviation-heading_median10.802312532113078
deviation-heading_min10.802312532113078
distance-from-start_max1.0948509439279033
distance-from-start_mean1.0948509439279033
distance-from-start_median1.0948509439279033
distance-from-start_min1.0948509439279033
driven_any_max6.746540874430199
driven_any_mean6.746540874430199
driven_any_median6.746540874430199
driven_any_min6.746540874430199
driven_lanedir_consec_max5.6931851014896715
driven_lanedir_consec_mean5.6931851014896715
driven_lanedir_consec_min5.6931851014896715
driven_lanedir_max5.713999449258763
driven_lanedir_mean5.713999449258763
driven_lanedir_median5.713999449258763
driven_lanedir_min5.713999449258763
in-drivable-lane_max3.049999999999826
in-drivable-lane_mean3.049999999999826
in-drivable-lane_min3.049999999999826
per-episodes
details{"4way-000-ego0": {"driven_any": 6.746540874430199, "survival_time": 37.45000000000001, "driven_lanedir": 5.713999449258763, "in-drivable-lane": 3.049999999999826, "deviation-heading": 10.802312532113078, "distance-from-start": 1.0948509439279033, "deviation-center-line": 2.0132525021202374, "driven_lanedir_consec": 5.6931851014896715}}
simulation-passed1
survival_time_max37.45000000000001
survival_time_mean37.45000000000001
survival_time_min37.45000000000001
No reset possible
15929538Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-testingsim-3of4successnodavinci-stage-04-6.2.510:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
15925541Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-testingsim-0of4successnodavinci-stage-04-6.2.510:06:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.261250808767954
survival_time_median59.99999999999873
deviation-center-line_median2.3986084448572713
in-drivable-lane_median5.399999999999693


other stats
deviation-center-line_max2.3986084448572713
deviation-center-line_mean2.3986084448572713
deviation-center-line_min2.3986084448572713
deviation-heading_max12.192953082773586
deviation-heading_mean12.192953082773586
deviation-heading_median12.192953082773586
deviation-heading_min12.192953082773586
distance-from-start_max2.8616040637709887
distance-from-start_mean2.8616040637709887
distance-from-start_median2.8616040637709887
distance-from-start_min2.8616040637709887
driven_any_max9.657806896801176
driven_any_mean9.657806896801176
driven_any_median9.657806896801176
driven_any_min9.657806896801176
driven_lanedir_consec_max8.261250808767954
driven_lanedir_consec_mean8.261250808767954
driven_lanedir_consec_min8.261250808767954
driven_lanedir_max8.261250808767954
driven_lanedir_mean8.261250808767954
driven_lanedir_median8.261250808767954
driven_lanedir_min8.261250808767954
in-drivable-lane_max5.399999999999693
in-drivable-lane_mean5.399999999999693
in-drivable-lane_min5.399999999999693
per-episodes
details{"autolab-000-ego0": {"driven_any": 9.657806896801176, "survival_time": 59.99999999999873, "driven_lanedir": 8.261250808767954, "in-drivable-lane": 5.399999999999693, "deviation-heading": 12.192953082773586, "distance-from-start": 2.8616040637709887, "deviation-center-line": 2.3986084448572713, "driven_lanedir_consec": 8.261250808767954}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
15924541Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-testingsim-2of4successnodavinci-stage-04-6.2.510:02:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2424219138112758
survival_time_median16.6000000000001
deviation-center-line_median0.5953213139665653
in-drivable-lane_median7.650000000000103


other stats
deviation-center-line_max0.5953213139665653
deviation-center-line_mean0.5953213139665653
deviation-center-line_min0.5953213139665653
deviation-heading_max3.859102214000461
deviation-heading_mean3.859102214000461
deviation-heading_median3.859102214000461
deviation-heading_min3.859102214000461
distance-from-start_max1.8705053486241523
distance-from-start_mean1.8705053486241523
distance-from-start_median1.8705053486241523
distance-from-start_min1.8705053486241523
driven_any_max2.7655113828585036
driven_any_mean2.7655113828585036
driven_any_median2.7655113828585036
driven_any_min2.7655113828585036
driven_lanedir_consec_max1.2424219138112758
driven_lanedir_consec_mean1.2424219138112758
driven_lanedir_consec_min1.2424219138112758
driven_lanedir_max1.2424219138112758
driven_lanedir_mean1.2424219138112758
driven_lanedir_median1.2424219138112758
driven_lanedir_min1.2424219138112758
in-drivable-lane_max7.650000000000103
in-drivable-lane_mean7.650000000000103
in-drivable-lane_min7.650000000000103
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.7655113828585036, "survival_time": 16.6000000000001, "driven_lanedir": 1.2424219138112758, "in-drivable-lane": 7.650000000000103, "deviation-heading": 3.859102214000461, "distance-from-start": 1.8705053486241523, "deviation-center-line": 0.5953213139665653, "driven_lanedir_consec": 1.2424219138112758}}
simulation-passed1
survival_time_max16.6000000000001
survival_time_mean16.6000000000001
survival_time_min16.6000000000001
No reset possible
15919542Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-04-6.2.510:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
15915764Bea Baselines 🐤challenge-aido_LF-baseline-duckietown:daffy:d0c3b9f200e160334a96bdb0f91745327be57194aido-hello-sim-validationsanity-checksuccessnodavinci-stage-04-6.2.510:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0130360795954223
deviation-center-line_median0.006539152591967747


other stats
deviation-center-line_max0.006539152591967747
deviation-center-line_mean0.006539152591967747
deviation-center-line_min0.006539152591967747
deviation-heading_max0.2668726751162729
deviation-heading_mean0.2668726751162729
deviation-heading_median0.2668726751162729
deviation-heading_min0.2668726751162729
distance-from-start_max0.01508483835506872
distance-from-start_mean0.01508483835506872
distance-from-start_median0.01508483835506872
distance-from-start_min0.01508483835506872
driven_any_max0.015084877256219438
driven_any_mean0.015084877256219438
driven_any_median0.015084877256219438
driven_any_min0.015084877256219438
driven_lanedir_consec_max0.0130360795954223
driven_lanedir_consec_mean0.0130360795954223
driven_lanedir_consec_min0.0130360795954223
driven_lanedir_max0.0130360795954223
driven_lanedir_mean0.0130360795954223
driven_lanedir_median0.0130360795954223
driven_lanedir_min0.0130360795954223
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.015084877256219438, "survival_time": 0.49999999999999994, "driven_lanedir": 0.0130360795954223, "in-drivable-lane": 0.0, "deviation-heading": 0.2668726751162729, "distance-from-start": 0.01508483835506872, "deviation-center-line": 0.006539152591967747, "driven_lanedir_consec": 0.0130360795954223}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
15909795Bea Baselines 🐤challenge-aido_LF-template-pytorch:daffy-staging:c5eb3df1f1017464ea091cbc60ac41b043b03a95aido-hello-sim-validationsanity-checksuccessnodavinci-stage-04-6.2.510:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.016432428091082807
deviation-center-line_median0.005188766970509084


other stats
deviation-center-line_max0.005188766970509084
deviation-center-line_mean0.005188766970509084
deviation-center-line_min0.005188766970509084
deviation-heading_max0.30429452108429295
deviation-heading_mean0.30429452108429295
deviation-heading_median0.30429452108429295
deviation-heading_min0.30429452108429295
distance-from-start_max0.021318990718837787
distance-from-start_mean0.021318990718837787
distance-from-start_median0.021318990718837787
distance-from-start_min0.021318990718837787
driven_any_max0.02143997831354508
driven_any_mean0.02143997831354508
driven_any_median0.02143997831354508
driven_any_min0.02143997831354508
driven_lanedir_consec_max0.016432428091082807
driven_lanedir_consec_mean0.016432428091082807
driven_lanedir_consec_min0.016432428091082807
driven_lanedir_max0.016432428091082807
driven_lanedir_mean0.016432428091082807
driven_lanedir_median0.016432428091082807
driven_lanedir_min0.016432428091082807
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.02143997831354508, "survival_time": 0.49999999999999994, "driven_lanedir": 0.016432428091082807, "in-drivable-lane": 0.0, "deviation-heading": 0.30429452108429295, "distance-from-start": 0.021318990718837787, "deviation-center-line": 0.005188766970509084, "driven_lanedir_consec": 0.016432428091082807}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
15905803Bea Baselines 🐤challenge-aido_LF-template-ros:daffy-staging:3b1546b6959e8affea32711104eb83074ec984eaaido-hello-sim-validationsanity-checksuccessnodavinci-stage-04-6.2.510:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.051142281746290985
deviation-center-line_median0.006003447377005382


other stats
deviation-center-line_max0.006003447377005382
deviation-center-line_mean0.006003447377005382
deviation-center-line_min0.006003447377005382
deviation-heading_max0.2524906803112451
deviation-heading_mean0.2524906803112451
deviation-heading_median0.2524906803112451
deviation-heading_min0.2524906803112451
distance-from-start_max0.05737765608663879
distance-from-start_mean0.05737765608663879
distance-from-start_median0.05737765608663879
distance-from-start_min0.05737765608663879
driven_any_max0.05740384545920925
driven_any_mean0.05740384545920925
driven_any_median0.05740384545920925
driven_any_min0.05740384545920925
driven_lanedir_consec_max0.051142281746290985
driven_lanedir_consec_mean0.051142281746290985
driven_lanedir_consec_min0.051142281746290985
driven_lanedir_max0.051142281746290985
driven_lanedir_mean0.051142281746290985
driven_lanedir_median0.051142281746290985
driven_lanedir_min0.051142281746290985
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.05740384545920925, "survival_time": 0.49999999999999994, "driven_lanedir": 0.051142281746290985, "in-drivable-lane": 0.0, "deviation-heading": 0.2524906803112451, "distance-from-start": 0.05737765608663879, "deviation-center-line": 0.006003447377005382, "driven_lanedir_consec": 0.051142281746290985}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
15903805Bea Baselines 🐤challenge-aido_LF-baseline-duckietown:daffy-staging:06423b9f834b346c04889a28f919db3673a8d2c1aido-hello-sim-validationsanity-checksuccessnodavinci-stage-04-6.2.510:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.01335556380902947
deviation-center-line_median0.006569755557796278


other stats
deviation-center-line_max0.006569755557796278
deviation-center-line_mean0.006569755557796278
deviation-center-line_min0.006569755557796278
deviation-heading_max0.261068361442008
deviation-heading_mean0.261068361442008
deviation-heading_median0.261068361442008
deviation-heading_min0.261068361442008
distance-from-start_max0.01507707865478589
distance-from-start_mean0.01507707865478589
distance-from-start_median0.01507707865478589
distance-from-start_min0.01507707865478589
driven_any_max0.01508440329948094
driven_any_mean0.01508440329948094
driven_any_median0.01508440329948094
driven_any_min0.01508440329948094
driven_lanedir_consec_max0.01335556380902947
driven_lanedir_consec_mean0.01335556380902947
driven_lanedir_consec_min0.01335556380902947
driven_lanedir_max0.01335556380902947
driven_lanedir_mean0.01335556380902947
driven_lanedir_median0.01335556380902947
driven_lanedir_min0.01335556380902947
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.01508440329948094, "survival_time": 0.49999999999999994, "driven_lanedir": 0.01335556380902947, "in-drivable-lane": 0.0, "deviation-heading": 0.261068361442008, "distance-from-start": 0.01507707865478589, "deviation-center-line": 0.006569755557796278, "driven_lanedir_consec": 0.01335556380902947}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
15894817Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-validationsim-0of4successnodavinci-stage-04-6.2.510:10:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median4.304249926437537
deviation-center-line_median0.1825026183725989


other stats
deviation-center-line_max0.34104251013325637
deviation-center-line_mean0.20912268674780385
deviation-center-line_min0.13044300011276103
deviation-heading_max2.994295582077131
deviation-heading_mean2.5147400523068573
deviation-heading_median2.5090088664494945
deviation-heading_min2.0466468942513076
distance-from-start_max3.0928237060834363
distance-from-start_mean2.645965341319192
distance-from-start_median2.580815039187992
distance-from-start_min2.329407580817348
driven_any_max5.8241864351349815
driven_any_mean4.627603360938423
driven_any_median4.714304114852396
driven_any_min3.25761877891392
driven_lanedir_consec_max5.808142217564284
driven_lanedir_consec_mean4.417823696659784
driven_lanedir_consec_min3.254652716199778
driven_lanedir_max5.808142217564284
driven_lanedir_mean4.6194454357816355
driven_lanedir_median4.70749340468124
driven_lanedir_min3.254652716199778
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-001-ego0": {"driven_any": 3.25761877891392, "survival_time": 59.99999999999873, "driven_lanedir": 3.254652716199778, "in-drivable-lane": 0.0, "deviation-heading": 2.4432266696129785, "distance-from-start": 2.7016200695021144, "deviation-center-line": 0.1633304587519851, "driven_lanedir_consec": 3.254652716199778}, "udem-001-ego1": {"driven_any": 4.275772003750879, "survival_time": 59.99999999999873, "driven_lanedir": 4.270214821719897, "in-drivable-lane": 0.0, "deviation-heading": 2.994295582077131, "distance-from-start": 3.0928237060834363, "deviation-center-line": 0.13044300011276103, "driven_lanedir_consec": 3.867286559394435}, "udem-001-ego2": {"driven_any": 5.152836225953913, "survival_time": 59.99999999999873, "driven_lanedir": 5.144771987642583, "in-drivable-lane": 0.0, "deviation-heading": 2.0466468942513076, "distance-from-start": 2.329407580817348, "deviation-center-line": 0.20167477799321273, "driven_lanedir_consec": 4.741213293480639}, "udem-001-ego3": {"driven_any": 5.8241864351349815, "survival_time": 59.99999999999873, "driven_lanedir": 5.808142217564284, "in-drivable-lane": 0.0, "deviation-heading": 2.5747910632860105, "distance-from-start": 2.460010008873869, "deviation-center-line": 0.34104251013325637, "driven_lanedir_consec": 5.808142217564284}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
15891818Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-validationsim-3of4successnodavinci-stage-04-6.2.510:09:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median57.84999999999885
in-drivable-lane_median0.0
driven_lanedir_consec_median4.884807237005287
deviation-center-line_median0.15072920516156368


other stats
deviation-center-line_max0.15072920516156368
deviation-center-line_mean0.15072920516156368
deviation-center-line_min0.15072920516156368
deviation-heading_max1.1475940808640654
deviation-heading_mean1.1475940808640654
deviation-heading_median1.1475940808640654
deviation-heading_min1.1475940808640654
distance-from-start_max2.6948612403356473
distance-from-start_mean2.6948612403356473
distance-from-start_median2.6948612403356473
distance-from-start_min2.6948612403356473
driven_any_max5.697171922964183
driven_any_mean5.697171922964183
driven_any_median5.697171922964183
driven_any_min5.697171922964183
driven_lanedir_consec_max4.884807237005287
driven_lanedir_consec_mean4.884807237005287
driven_lanedir_consec_min4.884807237005287
driven_lanedir_max5.693381869716076
driven_lanedir_mean5.693381869716076
driven_lanedir_median5.693381869716076
driven_lanedir_min5.693381869716076
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-001-ego0": {"driven_any": 5.697171922964183, "survival_time": 57.84999999999885, "driven_lanedir": 5.693381869716076, "in-drivable-lane": 0.0, "deviation-heading": 1.1475940808640654, "distance-from-start": 2.6948612403356473, "deviation-center-line": 0.15072920516156368, "driven_lanedir_consec": 4.884807237005287}}
simulation-passed1
survival_time_max57.84999999999885
survival_time_mean57.84999999999885
survival_time_min57.84999999999885
No reset possible
15885819Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-validation466erroryesdavinci-stage-04-6.2.510:01:30
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 177, in object_from_ipce_
    return object_from_ipce_dict(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 461, in object_from_ipce_dict
    attrs[k] = object_from_ipce_(v, et_V, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 391, in object_from_ipce_dataclass_instance
    raise ZValueError(msg, anns=anns, T=T, known=sorted(mj), f=f)
zuper_commons.types.exceptions.ZValueError: Cannot find field 'dynamics' in data for class ScenarioRobotSpec and no default available
│  anns: dict[7]
│        │ configuration: RobotConfiguration
│        │ color: str
│        │ description: str
│        │ controllable: bool
│        │ protocol: Optional[ProtocolDesc ]
│        │ dynamics: str
│        │ dynamics_params: Dict[str,Any ]
│     T: str
│ known: [color, configuration, controllable, description, protocol]
│     f: Field(name='dynamics',type=<class 'str'>,default=<dataclasses._MISSING_TYPE object at 0x7fadb86b6e50>,default_factory=<dataclasses._MISSING_TYPE object at 0x7fadb86b6e50>,init=True,repr=True,hash=None,compare=True,metadata=mappingproxy({}),_field_type=_FIELD)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 74, in object_from_ipce
    res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'robots' of Scenario.
│ K_annotations: dict[6]
│                │ scenario_name: str
│                │ environment: Any
│                │ player_robots: List[str]
│                │ robots: Dict[str,ScenarioRobotSpec]
│                │ duckies: Dict[str,ScenarioDuckieSpec]
│                │ payload_yaml: str
│   expect_type: Dict[str,ScenarioRobotSpec]
│         ann_K: Dict[str,ScenarioRobotSpec]
│        K_name: Scenario

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 167, in main
    episodes0 = get_episodes_from_dirs(config.scenarios)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 833, in get_episodes_from_dirs
    scenario = cast(Scenario, object_from_ipce(config_, Scenario))
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 93, in object_from_ipce
    raise ZValueError(msg, expect_type=expect_type, mj=mj) from e
zuper_commons.types.exceptions.ZValueError: Cannot deserialize object
│ expect_type: Scenario
│          mj: dict[6]
│              │ payload_yaml: ''
│              │ player_robots: [ego0, ego1, ego2, ego3]
│              │ scenario_name: LFV_multi-state-4way-000
│              │ robots:
│              │ dict[4]
│              │ │ ego0:
│              │ │ dict[5]
│              │ │ │ color: red
│              │ │ │ protocol: PROTOCOL_STATE
│              │ │ │ description: Playable robot ego0
│              │ │ │ controllable: True
│              │ │ │ configuration: {pose: {x: 3.19, y: 1.276, theta_deg: 180.0} , velocity: {x: 0.0, y: 0.0, theta_deg: 0.0} }
│              │ │ ego1:
│              │ │ dict[5]
│              │ │ │ color: green
│              │ │ │ protocol: PROTOCOL_STATE
│              │ │ │ description: Playable robot ego1
│              │ │ │ controllable: True
│              │ │ │ configuration: {pose: {x: 2.75, y: 2.175, theta_deg: 90.0} , velocity: {x: 0.0, y: 0.0, theta_deg: 0.0} }
│              │ │ ego2:
│              │ │ dict[5]
│              │ │ │ color: blue
│              │ │ │ protocol: PROTOCOL_STATE
│              │ │ │ description: Playable robot ego2
│              │ │ │ controllable: True
│              │ │ │ configuration: {pose: {x: 2.75, y: 3.074, theta_deg: 90.0} , velocity: {x: 0.0, y: 0.0, theta_deg: 0.0} }
│              │ │ ego3:
│              │ │ dict[5]
│              │ │ │ color: red
│              │ │ │ protocol: PROTOCOL_STATE
│              │ │ │ description: Playable robot ego3
│              │ │ │ controllable: True
│              │ │ │ configuration: {pose: {x: 1.914, y: 2.7492, theta_deg: 0.0} , velocity: {x: 0.0, y: 0.0, theta_deg: 0.0} }
│              │ duckies: {}
│              │ environment:
│              │ |# 5x5 counter-clockwise loop with a 4-way intersection in the middle
│              │ |# Designed to test the 4-way intersection tile and traffic light
│              │ |tiles:
│              │ |- [floor, floor, floor, floor, floor, floor, floor]
│              │ |- [floor, curve_left/W , straight/W, 3way_left/W   , straight/W, curve_left/N, floor]
│              │ |- [floor, straight/S   , asphalt   , straight/N    , asphalt   , straight/N, floor]
│              │ |- [floor, 3way_left/S  , straight/W, 4way          , straight/E, 3way_left/N, floor]
│              │ |- [floor, straight/S   , asphalt   , straight/S    , asphalt   , straight/N, floor]
│              │ |- [floor, curve_left/S , straight/E, 3way_left/E   , straight/E, curve_left/E, floor]
│              │ |- [floor, floor, floor, floor, floor, floor, floor]
│              │ |
│              │ |objects:
│              │ |  trafficlight:
│              │ |    kind: trafficlight
│              │ |    place:
│              │ |      tile: [3,3]
│              │ |      relative:
│              │ |        ~SE2Transform:
│              │ |          p: [-0.18,-0.18]
│              │ |          theta_deg: 135
│              │ |    height: 0.4
│              │ |    optional: true
│              │ |
│              │ |tile_size: 0.585
│              │ |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15880820Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-validationsim-1of4successnodavinci-stage-04-6.2.510:05:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8948975282353535


other stats
deviation-center-line_max0.8948975282353535
deviation-center-line_mean0.8948975282353535
deviation-center-line_min0.8948975282353535
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max2.482534153247273e-16
distance-from-start_mean2.482534153247273e-16
distance-from-start_median2.482534153247273e-16
distance-from-start_min2.482534153247273e-16
driven_any_max2.9790409838966753e-13
driven_any_mean2.9790409838966753e-13
driven_any_median2.9790409838966753e-13
driven_any_min2.9790409838966753e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 0.8948975282353535, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
15871823Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-testingsim-1of4successnodavinci-stage-04-6.2.510:10:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median1.527134503811414


other stats
deviation-center-line_max3.468395721180941
deviation-center-line_mean1.6864438380333175
deviation-center-line_min0.22311062332950052
deviation-heading_max37.82293240559152
deviation-heading_mean15.742347894422767
deviation-heading_median11.480770321404124
deviation-heading_min2.184918529291301
distance-from-start_max3.177442392514494
distance-from-start_mean0.7943605981286238
distance-from-start_median7.447602459741819e-16
distance-from-start_min0.0
driven_any_max6.082579575597374
driven_any_mean1.5206448938997903
driven_any_median8.937122951690024e-13
driven_any_min0.0
driven_lanedir_consec_max6.065368636558107
driven_lanedir_consec_mean1.5163421591395267
driven_lanedir_consec_min0.0
driven_lanedir_max6.065368636558107
driven_lanedir_mean1.5163421591395267
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 6.082579575597374, "survival_time": 59.99999999999873, "driven_lanedir": 6.065368636558107, "in-drivable-lane": 0.0, "deviation-heading": 2.184918529291301, "distance-from-start": 3.177442392514494, "deviation-center-line": 0.2918095725321498, "driven_lanedir_consec": 6.065368636558107}, "udem-000-ego1": {"driven_any": 1.19161639355867e-12, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005143, "distance-from-start": 9.930136612989092e-16, "deviation-center-line": 3.468395721180941, "driven_lanedir_consec": 0.0}, "udem-000-ego2": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 4.652112626803104, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.22311062332950052, "driven_lanedir_consec": 0.0}, "udem-000-ego3": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 0.0, "deviation-center-line": 2.7624594350906784, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
15866824Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-testingsim-1of4successnodavinci-stage-04-6.2.510:09:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.40653839040804857


other stats
deviation-center-line_max0.40653839040804857
deviation-center-line_mean0.40653839040804857
deviation-center-line_min0.40653839040804857
deviation-heading_max40.967332753486254
deviation-heading_mean40.967332753486254
deviation-heading_median40.967332753486254
deviation-heading_min40.967332753486254
distance-from-start_max1.1102230246251563e-16
distance-from-start_mean1.1102230246251563e-16
distance-from-start_median1.1102230246251563e-16
distance-from-start_min1.1102230246251563e-16
driven_any_max1.3322676295501878e-13
driven_any_mean1.3322676295501878e-13
driven_any_median1.3322676295501878e-13
driven_any_min1.3322676295501878e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 0.40653839040804857, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
15861825Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-testingsim-1of4successnodavinci-stage-04-6.2.510:09:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.432891091920204
deviation-center-line_median0.289208824985897


other stats
deviation-center-line_max0.3421554544578389
deviation-center-line_mean0.28103246849939895
deviation-center-line_min0.20355676956796287
deviation-heading_max2.532090128626256
deviation-heading_mean2.1233379748915846
deviation-heading_median2.091598288393426
deviation-heading_min1.77806519415323
distance-from-start_max3.1537593976013736
distance-from-start_mean2.7244723642293835
distance-from-start_median2.704318718385367
distance-from-start_min2.3354926225454276
driven_any_max5.681727317187617
driven_any_mean5.356790518866223
driven_any_median5.444463301686621
driven_any_min4.856508154904032
driven_lanedir_consec_max5.66768880982045
driven_lanedir_consec_mean5.346200743455493
driven_lanedir_consec_min4.851331980161115
driven_lanedir_max5.66768880982045
driven_lanedir_mean5.346200743455493
driven_lanedir_median5.432891091920204
driven_lanedir_min4.851331980161115
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 5.292009447895602, "survival_time": 59.99999999999873, "driven_lanedir": 5.278658727024759, "in-drivable-lane": 0.0, "deviation-heading": 2.532090128626256, "distance-from-start": 2.693777297091483, "deviation-center-line": 0.295448770789397, "driven_lanedir_consec": 5.278658727024759}, "loop-000-ego1": {"driven_any": 5.596917155477642, "survival_time": 59.99999999999873, "driven_lanedir": 5.5871234568156485, "in-drivable-lane": 0.0, "deviation-heading": 2.16404711059614, "distance-from-start": 2.3354926225454276, "deviation-center-line": 0.3421554544578389, "driven_lanedir_consec": 5.5871234568156485}, "loop-000-ego2": {"driven_any": 4.856508154904032, "survival_time": 59.99999999999873, "driven_lanedir": 4.851331980161115, "in-drivable-lane": 0.0, "deviation-heading": 1.77806519415323, "distance-from-start": 3.1537593976013736, "deviation-center-line": 0.20355676956796287, "driven_lanedir_consec": 4.851331980161115}, "loop-000-ego3": {"driven_any": 5.681727317187617, "survival_time": 59.99999999999873, "driven_lanedir": 5.66768880982045, "in-drivable-lane": 0.0, "deviation-heading": 2.0191494661907115, "distance-from-start": 2.7148601396792507, "deviation-center-line": 0.282968879182397, "driven_lanedir_consec": 5.66768880982045}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
15859826Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-validationsim-3of4successnodavinci-stage-04-6.2.510:02:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.899999999999991
in-drivable-lane_median0.0
driven_lanedir_consec_median0.3608923653025524
deviation-center-line_median0.051213017209835086


other stats
deviation-center-line_max0.051213017209835086
deviation-center-line_mean0.051213017209835086
deviation-center-line_min0.051213017209835086
deviation-heading_max0.6136512740909245
deviation-heading_mean0.6136512740909245
deviation-heading_median0.6136512740909245
deviation-heading_min0.6136512740909245
distance-from-start_max0.3609304026851721
distance-from-start_mean0.3609304026851721
distance-from-start_median0.3609304026851721
distance-from-start_min0.3609304026851721
driven_any_max0.3664829367467816
driven_any_mean0.3664829367467816
driven_any_median0.3664829367467816
driven_any_min0.3664829367467816
driven_lanedir_consec_max0.3608923653025524
driven_lanedir_consec_mean0.3608923653025524
driven_lanedir_consec_min0.3608923653025524
driven_lanedir_max0.3608923653025524
driven_lanedir_mean0.3608923653025524
driven_lanedir_median0.3608923653025524
driven_lanedir_min0.3608923653025524
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.3664829367467816, "survival_time": 4.899999999999991, "driven_lanedir": 0.3608923653025524, "in-drivable-lane": 0.0, "deviation-heading": 0.6136512740909245, "distance-from-start": 0.3609304026851721, "deviation-center-line": 0.051213017209835086, "driven_lanedir_consec": 0.3608923653025524}}
simulation-passed1
survival_time_max4.899999999999991
survival_time_mean4.899999999999991
survival_time_min4.899999999999991
No reset possible
15856826Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-validationsim-2of4successnodavinci-stage-04-6.2.510:06:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8948975282353535


other stats
deviation-center-line_max0.8948975282353535
deviation-center-line_mean0.8948975282353535
deviation-center-line_min0.8948975282353535
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max2.482534153247273e-16
distance-from-start_mean2.482534153247273e-16
distance-from-start_median2.482534153247273e-16
distance-from-start_min2.482534153247273e-16
driven_any_max2.9790409838966753e-13
driven_any_mean2.9790409838966753e-13
driven_any_median2.9790409838966753e-13
driven_any_min2.9790409838966753e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 0.8948975282353535, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
15852827Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-testingsim-2of4successnodavinci-stage-04-6.2.510:02:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median15.650000000000087
in-drivable-lane_median0.0
driven_lanedir_consec_median1.3397922837799834
deviation-center-line_median0.17577830426095897


other stats
deviation-center-line_max0.17577830426095897
deviation-center-line_mean0.17577830426095897
deviation-center-line_min0.17577830426095897
deviation-heading_max1.414000512850352
deviation-heading_mean1.414000512850352
deviation-heading_median1.414000512850352
deviation-heading_min1.414000512850352
distance-from-start_max0.9953946201002636
distance-from-start_mean0.9953946201002636
distance-from-start_median0.9953946201002636
distance-from-start_min0.9953946201002636
driven_any_max1.3507304582476738
driven_any_mean1.3507304582476738
driven_any_median1.3507304582476738
driven_any_min1.3507304582476738
driven_lanedir_consec_max1.3397922837799834
driven_lanedir_consec_mean1.3397922837799834
driven_lanedir_consec_min1.3397922837799834
driven_lanedir_max1.3397922837799834
driven_lanedir_mean1.3397922837799834
driven_lanedir_median1.3397922837799834
driven_lanedir_min1.3397922837799834
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.3507304582476738, "survival_time": 15.650000000000087, "driven_lanedir": 1.3397922837799834, "in-drivable-lane": 0.0, "deviation-heading": 1.414000512850352, "distance-from-start": 0.9953946201002636, "deviation-center-line": 0.17577830426095897, "driven_lanedir_consec": 1.3397922837799834}}
simulation-passed1
survival_time_max15.650000000000087
survival_time_mean15.650000000000087
survival_time_min15.650000000000087
No reset possible
158471065Bea Baselines 🐤baseline-simple-yieldaido-hello-sim-state-validationsanity-checksuccessnodavinci-stage-04-6.2.510:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.02249654394867484
deviation-center-line_median0.0052536287874529785


other stats
deviation-center-line_max0.0052536287874529785
deviation-center-line_mean0.0052536287874529785
deviation-center-line_min0.0052536287874529785
deviation-heading_max0.2537079422480557
deviation-heading_mean0.2537079422480557
deviation-heading_median0.2537079422480557
deviation-heading_min0.2537079422480557
distance-from-start_max0.025223546623389756
distance-from-start_mean0.025223546623389756
distance-from-start_median0.025223546623389756
distance-from-start_min0.025223546623389756
driven_any_max0.025243366614066683
driven_any_mean0.025243366614066683
driven_any_median0.025243366614066683
driven_any_min0.025243366614066683
driven_lanedir_consec_max0.02249654394867484
driven_lanedir_consec_mean0.02249654394867484
driven_lanedir_consec_min0.02249654394867484
driven_lanedir_max0.02249654394867484
driven_lanedir_mean0.02249654394867484
driven_lanedir_median0.02249654394867484
driven_lanedir_min0.02249654394867484
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.025243366614066683, "survival_time": 0.49999999999999994, "driven_lanedir": 0.02249654394867484, "in-drivable-lane": 0.0, "deviation-heading": 0.2537079422480557, "distance-from-start": 0.025223546623389756, "deviation-center-line": 0.0052536287874529785, "driven_lanedir_consec": 0.02249654394867484}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
158421325Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-validationsim-1of4failednodavinci-stage-04-6.2.510:01:13
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
158371326Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-validationsim-2of4failednodavinci-stage-04-6.2.510:01:13
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
158311328Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-validationsim-1of4failednodavinci-stage-04-6.2.510:01:15
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
158271329Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-validationsim-0of4failednodavinci-stage-04-6.2.510:01:12
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
158201330Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-validationsim-1of4failednodavinci-stage-04-6.2.510:00:58
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
158171334Bea Baselines 🐤baseline-RPL-roslx22-state-estimationsimfailedyesdavinci-stage-04-6.2.510:01:00
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
158111335Bea Baselines 🐤baseline-RPL-roslx22-BV1sim-4of5failednodavinci-stage-04-6.2.510:00:58
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
158061342Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-testingsim-2of4failednodavinci-stage-04-6.2.510:01:28
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
158021343Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-testingsim-1of4failednodavinci-stage-04-6.2.510:01:12
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
157981344Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-testingsim-3of4failednodavinci-stage-04-6.2.510:01:14
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
157971345Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-testingsim-1of4failednodavinci-stage-04-6.2.510:01:00
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
157901346Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-testingsim-3of4failednodavinci-stage-04-6.2.510:01:13
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
157871347Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-testingsim-2of4failednodavinci-stage-04-6.2.510:01:15
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
157831348Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-testingsim-1of4failednodavinci-stage-04-6.2.510:01:08
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
157821348Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-testingsim-2of4failednodavinci-stage-04-6.2.510:01:00
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
157811348Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-testingsim-3of4failednodavinci-stage-04-6.2.510:01:58
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
157791349Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-0of4successnodavinci-stage-04-6.2.510:02:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.799999999999987
in-drivable-lane_median0.9499999999999966
driven_lanedir_consec_median0.5373631508961925
deviation-center-line_median0.13670263913490427


other stats
deviation-center-line_max0.13670263913490427
deviation-center-line_mean0.13670263913490427
deviation-center-line_min0.13670263913490427
deviation-heading_max1.4879411280714254
deviation-heading_mean1.4879411280714254
deviation-heading_median1.4879411280714254
deviation-heading_min1.4879411280714254
distance-from-start_max0.5198873028094598
distance-from-start_mean0.5198873028094598
distance-from-start_median0.5198873028094598
distance-from-start_min0.5198873028094598
driven_any_max0.6253220588730269
driven_any_mean0.6253220588730269
driven_any_median0.6253220588730269
driven_any_min0.6253220588730269
driven_lanedir_consec_max0.5373631508961925
driven_lanedir_consec_mean0.5373631508961925
driven_lanedir_consec_min0.5373631508961925
driven_lanedir_max0.5373631508961925
driven_lanedir_mean0.5373631508961925
driven_lanedir_median0.5373631508961925
driven_lanedir_min0.5373631508961925
in-drivable-lane_max0.9499999999999966
in-drivable-lane_mean0.9499999999999966
in-drivable-lane_min0.9499999999999966
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.6253220588730269, "survival_time": 5.799999999999987, "driven_lanedir": 0.5373631508961925, "in-drivable-lane": 0.9499999999999966, "deviation-heading": 1.4879411280714254, "distance-from-start": 0.5198873028094598, "deviation-center-line": 0.13670263913490427, "driven_lanedir_consec": 0.5373631508961925}}
simulation-passed1
survival_time_max5.799999999999987
survival_time_mean5.799999999999987
survival_time_min5.799999999999987
No reset possible
157701351Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-validationsim-1of4successnodavinci-stage-04-6.2.510:07:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.599999999999767
driven_lanedir_consec_median3.736452016264485
deviation-center-line_median2.865889286665662


other stats
deviation-center-line_max2.865889286665662
deviation-center-line_mean2.865889286665662
deviation-center-line_min2.865889286665662
deviation-heading_max11.571788977657269
deviation-heading_mean11.571788977657269
deviation-heading_median11.571788977657269
deviation-heading_min11.571788977657269
distance-from-start_max2.0174319242438776
distance-from-start_mean2.0174319242438776
distance-from-start_median2.0174319242438776
distance-from-start_min2.0174319242438776
driven_any_max7.90780597050609
driven_any_mean7.90780597050609
driven_any_median7.90780597050609
driven_any_min7.90780597050609
driven_lanedir_consec_max3.736452016264485
driven_lanedir_consec_mean3.736452016264485
driven_lanedir_consec_min3.736452016264485
driven_lanedir_max6.912930753847737
driven_lanedir_mean6.912930753847737
driven_lanedir_median6.912930753847737
driven_lanedir_min6.912930753847737
in-drivable-lane_max4.599999999999767
in-drivable-lane_mean4.599999999999767
in-drivable-lane_min4.599999999999767
per-episodes
details{"udem1-000-ego0": {"driven_any": 7.90780597050609, "survival_time": 59.99999999999873, "driven_lanedir": 6.912930753847737, "in-drivable-lane": 4.599999999999767, "deviation-heading": 11.571788977657269, "distance-from-start": 2.0174319242438776, "deviation-center-line": 2.865889286665662, "driven_lanedir_consec": 3.736452016264485}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
157671352Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-validationsim-1of4successnodavinci-stage-04-6.2.510:05:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.9452977435718175
survival_time_median59.99999999999873
deviation-center-line_median4.1924071986336795
in-drivable-lane_median5.799999999999889


other stats
deviation-center-line_max4.1924071986336795
deviation-center-line_mean4.1924071986336795
deviation-center-line_min4.1924071986336795
deviation-heading_max10.325245906120262
deviation-heading_mean10.325245906120262
deviation-heading_median10.325245906120262
deviation-heading_min10.325245906120262
distance-from-start_max2.048822654619136
distance-from-start_mean2.048822654619136
distance-from-start_median2.048822654619136
distance-from-start_min2.048822654619136
driven_any_max7.907828813381925
driven_any_mean7.907828813381925
driven_any_median7.907828813381925
driven_any_min7.907828813381925
driven_lanedir_consec_max4.9452977435718175
driven_lanedir_consec_mean4.9452977435718175
driven_lanedir_consec_min4.9452977435718175
driven_lanedir_max6.792808692986124
driven_lanedir_mean6.792808692986124
driven_lanedir_median6.792808692986124
driven_lanedir_min6.792808692986124
in-drivable-lane_max5.799999999999889
in-drivable-lane_mean5.799999999999889
in-drivable-lane_min5.799999999999889
per-episodes
details{"loop-000-ego0": {"driven_any": 7.907828813381925, "survival_time": 59.99999999999873, "driven_lanedir": 6.792808692986124, "in-drivable-lane": 5.799999999999889, "deviation-heading": 10.325245906120262, "distance-from-start": 2.048822654619136, "deviation-center-line": 4.1924071986336795, "driven_lanedir_consec": 4.9452977435718175}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
157601354Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-validationsim-1of4successnodavinci-stage-04-6.2.510:09:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median32.4000000000003
in-drivable-lane_median13.800000000000166
driven_lanedir_consec_median1.044896098623329
deviation-center-line_median0.9091209922301569


other stats
deviation-center-line_max2.9040672869129205
deviation-center-line_mean1.2179683667621382
deviation-center-line_min0.14956419567531865
deviation-heading_max20.74511778740683
deviation-heading_mean8.062494676122725
deviation-heading_median5.2919975697353605
deviation-heading_min0.9208657776133492
distance-from-start_max2.4348019211038214
distance-from-start_mean1.0895472147396723
distance-from-start_median0.8583161916493439
distance-from-start_min0.20675455455617991
driven_any_max4.156812362233148
driven_any_mean1.987739367077879
driven_any_median1.7935071259214077
driven_any_min0.20713085423555164
driven_lanedir_consec_max1.978078754386608
driven_lanedir_consec_mean1.051978559784601
driven_lanedir_consec_min0.1400432875051374
driven_lanedir_max2.750975322874313
driven_lanedir_mean1.4424479711409188
driven_lanedir_median1.439386637092113
driven_lanedir_min0.1400432875051374
in-drivable-lane_max30.750000000000295
in-drivable-lane_mean15.137500000000164
in-drivable-lane_min2.200000000000019
per-episodes
details{"loop-000-ego0": {"driven_any": 1.793374252012068, "survival_time": 32.4000000000003, "driven_lanedir": 1.2388671772601965, "in-drivable-lane": 2.200000000000019, "deviation-heading": 20.74511778740683, "distance-from-start": 1.0474981414311515, "deviation-center-line": 2.9040672869129205, "driven_lanedir_consec": 1.169899257888998}, "loop-000-ego1": {"driven_any": 0.20713085423555164, "survival_time": 32.4000000000003, "driven_lanedir": 0.1400432875051374, "in-drivable-lane": 30.750000000000295, "deviation-heading": 0.9208657776133492, "distance-from-start": 0.20675455455617991, "deviation-center-line": 0.14956419567531865, "driven_lanedir_consec": 0.1400432875051374}, "loop-000-ego2": {"driven_any": 1.793639999830747, "survival_time": 32.4000000000003, "driven_lanedir": 1.639906096924029, "in-drivable-lane": 18.800000000000235, "deviation-heading": 2.919708198844249, "distance-from-start": 0.6691342418675363, "deviation-center-line": 0.6665308580354611, "driven_lanedir_consec": 0.9198929393576608}, "loop-000-ego3": {"driven_any": 4.156812362233148, "survival_time": 32.4000000000003, "driven_lanedir": 2.750975322874313, "in-drivable-lane": 8.800000000000097, "deviation-heading": 7.664286940626472, "distance-from-start": 2.4348019211038214, "deviation-center-line": 1.1517111264248527, "driven_lanedir_consec": 1.978078754386608}}
simulation-passed1
survival_time_max32.4000000000003
survival_time_mean32.4000000000003
survival_time_min32.4000000000003
No reset possible
157521356Bea Baselines 🐤baseline-duckietown-mllx22-modconsimsuccessyesdavinci-stage-04-6.2.510:15:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median4.99999999999999
deviation-center-line_median2.315936478823729
driven_lanedir_consec_median7.277389687713625
survival_time_median59.99999999999873


other stats
deviation-center-line_max2.861159512720237
deviation-center-line_mean2.315936478823729
deviation-center-line_min1.7707134449272208
deviation-heading_max4.466259032761755
deviation-heading_mean3.368683114380585
deviation-heading_median3.368683114380585
deviation-heading_min2.2711071959994147
distance-from-start_max7.879734903586813
distance-from-start_mean7.875929837722931
distance-from-start_median7.875929837722931
distance-from-start_min7.872124771859049
driven_any_max7.92126811992993
driven_any_mean7.914645722824824
driven_any_median7.914645722824824
driven_any_min7.908023325719719
driven_lanedir_consec_max7.394501639469369
driven_lanedir_consec_mean7.277389687713625
driven_lanedir_consec_min7.160277735957881
driven_lanedir_max7.394501639469369
driven_lanedir_mean7.277389687713625
driven_lanedir_median7.277389687713625
driven_lanedir_min7.160277735957881
in-drivable-lane_max5.999999999999987
in-drivable-lane_mean4.99999999999999
in-drivable-lane_min3.999999999999994
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 7.92126811992993, "survival_time": 59.99999999999873, "driven_lanedir": 7.394501639469369, "in-drivable-lane": 3.999999999999994, "deviation-heading": 4.466259032761755, "distance-from-start": 7.872124771859049, "deviation-center-line": 1.7707134449272208, "driven_lanedir_consec": 7.394501639469369}, "LF-full-loop-001-ego0": {"driven_any": 7.908023325719719, "survival_time": 59.99999999999873, "driven_lanedir": 7.160277735957881, "in-drivable-lane": 5.999999999999987, "deviation-heading": 2.2711071959994147, "distance-from-start": 7.879734903586813, "deviation-center-line": 2.861159512720237, "driven_lanedir_consec": 7.160277735957881}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
157381367Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-testingsim-3of4successnodavinci-stage-04-6.2.510:17:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median10.799999999999692
driven_lanedir_consec_median5.692374017206179
deviation-center-line_median4.525583813402954


other stats
deviation-center-line_max4.525583813402954
deviation-center-line_mean4.525583813402954
deviation-center-line_min4.525583813402954
deviation-heading_max19.406298407990548
deviation-heading_mean19.406298407990548
deviation-heading_median19.406298407990548
deviation-heading_min19.406298407990548
distance-from-start_max2.272990798573481
distance-from-start_mean2.272990798573481
distance-from-start_median2.272990798573481
distance-from-start_min2.272990798573481
driven_any_max7.913583934285994
driven_any_mean7.913583934285994
driven_any_median7.913583934285994
driven_any_min7.913583934285994
driven_lanedir_consec_max5.692374017206179
driven_lanedir_consec_mean5.692374017206179
driven_lanedir_consec_min5.692374017206179
driven_lanedir_max5.692374017206179
driven_lanedir_mean5.692374017206179
driven_lanedir_median5.692374017206179
driven_lanedir_min5.692374017206179
in-drivable-lane_max10.799999999999692
in-drivable-lane_mean10.799999999999692
in-drivable-lane_min10.799999999999692
per-episodes
details{"zigzag-000-ego0": {"driven_any": 7.913583934285994, "survival_time": 59.99999999999873, "driven_lanedir": 5.692374017206179, "in-drivable-lane": 10.799999999999692, "deviation-heading": 19.406298407990548, "distance-from-start": 2.272990798573481, "deviation-center-line": 4.525583813402954, "driven_lanedir_consec": 5.692374017206179}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
157351370Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-testingsim-0of4successnodavinci-stage-04-6.2.510:05:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.422656146457873
survival_time_median59.99999999999873
deviation-center-line_median3.888669435709433
in-drivable-lane_median7.099999999999703


other stats
deviation-center-line_max3.888669435709433
deviation-center-line_mean3.888669435709433
deviation-center-line_min3.888669435709433
deviation-heading_max13.613656712589906
deviation-heading_mean13.613656712589906
deviation-heading_median13.613656712589906
deviation-heading_min13.613656712589906
distance-from-start_max2.785481540401922
distance-from-start_mean2.785481540401922
distance-from-start_median2.785481540401922
distance-from-start_min2.785481540401922
driven_any_max7.9078039410101955
driven_any_mean7.9078039410101955
driven_any_median7.9078039410101955
driven_any_min7.9078039410101955
driven_lanedir_consec_max6.422656146457873
driven_lanedir_consec_mean6.422656146457873
driven_lanedir_consec_min6.422656146457873
driven_lanedir_max6.422656146457873
driven_lanedir_mean6.422656146457873
driven_lanedir_median6.422656146457873
driven_lanedir_min6.422656146457873
in-drivable-lane_max7.099999999999703
in-drivable-lane_mean7.099999999999703
in-drivable-lane_min7.099999999999703
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.9078039410101955, "survival_time": 59.99999999999873, "driven_lanedir": 6.422656146457873, "in-drivable-lane": 7.099999999999703, "deviation-heading": 13.613656712589906, "distance-from-start": 2.785481540401922, "deviation-center-line": 3.888669435709433, "driven_lanedir_consec": 6.422656146457873}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
157321370Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-testingsim-2of4successnodavinci-stage-04-6.2.510:02:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2145833337610057
survival_time_median11.100000000000025
deviation-center-line_median0.2210201506566556
in-drivable-lane_median8.650000000000023


other stats
deviation-center-line_max0.2210201506566556
deviation-center-line_mean0.2210201506566556
deviation-center-line_min0.2210201506566556
deviation-heading_max1.443039038914398
deviation-heading_mean1.443039038914398
deviation-heading_median1.443039038914398
deviation-heading_min1.443039038914398
distance-from-start_max0.9381672670770348
distance-from-start_mean0.9381672670770348
distance-from-start_median0.9381672670770348
distance-from-start_min0.9381672670770348
driven_any_max1.3223765749040983
driven_any_mean1.3223765749040983
driven_any_median1.3223765749040983
driven_any_min1.3223765749040983
driven_lanedir_consec_max0.2145833337610057
driven_lanedir_consec_mean0.2145833337610057
driven_lanedir_consec_min0.2145833337610057
driven_lanedir_max0.2152492969369124
driven_lanedir_mean0.2152492969369124
driven_lanedir_median0.2152492969369124
driven_lanedir_min0.2152492969369124
in-drivable-lane_max8.650000000000023
in-drivable-lane_mean8.650000000000023
in-drivable-lane_min8.650000000000023
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.3223765749040983, "survival_time": 11.100000000000025, "driven_lanedir": 0.2152492969369124, "in-drivable-lane": 8.650000000000023, "deviation-heading": 1.443039038914398, "distance-from-start": 0.9381672670770348, "deviation-center-line": 0.2210201506566556, "driven_lanedir_consec": 0.2145833337610057}}
simulation-passed1
survival_time_max11.100000000000025
survival_time_mean11.100000000000025
survival_time_min11.100000000000025
No reset possible
157311371Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-testingsim-3of4successnodavinci-stage-04-6.2.510:02:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
157301371Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-04-6.2.510:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
157281371Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-testingsim-1of4successnodavinci-stage-04-6.2.510:08:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median19.550000000000143
in-drivable-lane_median1.4000000000000146
driven_lanedir_consec_median0.49321604950767406
deviation-center-line_median1.98953082591548


other stats
deviation-center-line_max2.6938253664709917
deviation-center-line_mean1.9926198692355923
deviation-center-line_min1.297592458640416
deviation-heading_max24.159371536653165
deviation-heading_mean12.77961871867726
deviation-heading_median10.35868407132048
deviation-heading_min6.241735195414919
distance-from-start_max1.8293867571337352
distance-from-start_mean0.7949306146984769
distance-from-start_median0.4874264737083894
distance-from-start_min0.3754827542433936
driven_any_max2.450728116897978
driven_any_mean1.2110508396397557
driven_any_median0.990295150586912
driven_any_min0.41288494048722024
driven_lanedir_consec_max1.5642843770949415
driven_lanedir_consec_mean0.7308432716544218
driven_lanedir_consec_min0.3726566105073972
driven_lanedir_max1.81769189871418
driven_lanedir_mean0.8782995828944057
driven_lanedir_median0.6614249111780228
driven_lanedir_min0.3726566105073972
in-drivable-lane_max3.0500000000000025
in-drivable-lane_mean1.462500000000008
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 1.381877772311545, "survival_time": 19.550000000000143, "driven_lanedir": 0.7889960550485018, "in-drivable-lane": 3.0500000000000025, "deviation-heading": 13.83029838585822, "distance-from-start": 0.45999168472118457, "deviation-center-line": 1.69585692034152, "driven_lanedir_consec": 0.45257833170780426}, "4way-000-ego1": {"driven_any": 0.5987125288622789, "survival_time": 19.550000000000143, "driven_lanedir": 0.5338537673075439, "in-drivable-lane": 0.0, "deviation-heading": 24.159371536653165, "distance-from-start": 0.5148612626955942, "deviation-center-line": 2.6938253664709917, "driven_lanedir_consec": 0.5338537673075439}, "4way-000-ego2": {"driven_any": 2.450728116897978, "survival_time": 19.550000000000143, "driven_lanedir": 1.81769189871418, "in-drivable-lane": 2.800000000000029, "deviation-heading": 6.887069756782737, "distance-from-start": 1.8293867571337352, "deviation-center-line": 1.297592458640416, "driven_lanedir_consec": 1.5642843770949415}, "4way-000-ego3": {"driven_any": 0.41288494048722024, "survival_time": 19.550000000000143, "driven_lanedir": 0.3726566105073972, "in-drivable-lane": 0.0, "deviation-heading": 6.241735195414919, "distance-from-start": 0.3754827542433936, "deviation-center-line": 2.2832047314894406, "driven_lanedir_consec": 0.3726566105073972}}
simulation-passed1
survival_time_max19.550000000000143
survival_time_mean19.550000000000143
survival_time_min19.550000000000143
No reset possible
157231373Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-testingsim-2of4successnodavinci-stage-04-6.2.510:05:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median22.149999999999498
driven_lanedir_consec_median4.838274527944493
deviation-center-line_median4.879168208768855


other stats
deviation-center-line_max4.879168208768855
deviation-center-line_mean4.879168208768855
deviation-center-line_min4.879168208768855
deviation-heading_max6.334513307631242
deviation-heading_mean6.334513307631242
deviation-heading_median6.334513307631242
deviation-heading_min6.334513307631242
distance-from-start_max1.4310595619001365
distance-from-start_mean1.4310595619001365
distance-from-start_median1.4310595619001365
distance-from-start_min1.4310595619001365
driven_any_max7.907804844645208
driven_any_mean7.907804844645208
driven_any_median7.907804844645208
driven_any_min7.907804844645208
driven_lanedir_consec_max4.838274527944493
driven_lanedir_consec_mean4.838274527944493
driven_lanedir_consec_min4.838274527944493
driven_lanedir_max4.838274527944493
driven_lanedir_mean4.838274527944493
driven_lanedir_median4.838274527944493
driven_lanedir_min4.838274527944493
in-drivable-lane_max22.149999999999498
in-drivable-lane_mean22.149999999999498
in-drivable-lane_min22.149999999999498
per-episodes
details{"loop2-000-ego0": {"driven_any": 7.907804844645208, "survival_time": 59.99999999999873, "driven_lanedir": 4.838274527944493, "in-drivable-lane": 22.149999999999498, "deviation-heading": 6.334513307631242, "distance-from-start": 1.4310595619001365, "deviation-center-line": 4.879168208768855, "driven_lanedir_consec": 4.838274527944493}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
157161374Bea Baselines 🐤baseline-duckietownaido-LFV-sim-validationsim-2of4successnodavinci-stage-04-6.2.510:07:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median5.149999999999931
driven_lanedir_consec_median6.870968164766345
deviation-center-line_median2.673979697362703


other stats
deviation-center-line_max2.673979697362703
deviation-center-line_mean2.673979697362703
deviation-center-line_min2.673979697362703
deviation-heading_max10.815547872618202
deviation-heading_mean10.815547872618202
deviation-heading_median10.815547872618202
deviation-heading_min10.815547872618202
distance-from-start_max1.180846277516737
distance-from-start_mean1.180846277516737
distance-from-start_median1.180846277516737
distance-from-start_min1.180846277516737
driven_any_max7.90079643283709
driven_any_mean7.90079643283709
driven_any_median7.90079643283709
driven_any_min7.90079643283709
driven_lanedir_consec_max6.870968164766345
driven_lanedir_consec_mean6.870968164766345
driven_lanedir_consec_min6.870968164766345
driven_lanedir_max6.870968164766345
driven_lanedir_mean6.870968164766345
driven_lanedir_median6.870968164766345
driven_lanedir_min6.870968164766345
in-drivable-lane_max5.149999999999931
in-drivable-lane_mean5.149999999999931
in-drivable-lane_min5.149999999999931
per-episodes
details{"loop2-000-ego0": {"driven_any": 7.90079643283709, "survival_time": 59.99999999999873, "driven_lanedir": 6.870968164766345, "in-drivable-lane": 5.149999999999931, "deviation-heading": 10.815547872618202, "distance-from-start": 1.180846277516737, "deviation-center-line": 2.673979697362703, "driven_lanedir_consec": 6.870968164766345}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
157131376Bea Baselines 🐤baseline-duckietownaido-LFI-sim-validationsim-1of4successnodavinci-stage-04-6.2.510:02:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.14999999999998
in-drivable-lane_median5.9999999999999805
driven_lanedir_consec_median0.1922115719302815
deviation-center-line_median0.14802419712751816


other stats
deviation-center-line_max0.14802419712751816
deviation-center-line_mean0.14802419712751816
deviation-center-line_min0.14802419712751816
deviation-heading_max1.1854137271414749
deviation-heading_mean1.1854137271414749
deviation-heading_median1.1854137271414749
deviation-heading_min1.1854137271414749
distance-from-start_max0.8357934176898612
distance-from-start_mean0.8357934176898612
distance-from-start_median0.8357934176898612
distance-from-start_min0.8357934176898612
driven_any_max0.9307278770111248
driven_any_mean0.9307278770111248
driven_any_median0.9307278770111248
driven_any_min0.9307278770111248
driven_lanedir_consec_max0.1922115719302815
driven_lanedir_consec_mean0.1922115719302815
driven_lanedir_consec_min0.1922115719302815
driven_lanedir_max0.1922115719302815
driven_lanedir_mean0.1922115719302815
driven_lanedir_median0.1922115719302815
driven_lanedir_min0.1922115719302815
in-drivable-lane_max5.9999999999999805
in-drivable-lane_mean5.9999999999999805
in-drivable-lane_min5.9999999999999805
per-episodes
details{"udem1-000-ego0": {"driven_any": 0.9307278770111248, "survival_time": 8.14999999999998, "driven_lanedir": 0.1922115719302815, "in-drivable-lane": 5.9999999999999805, "deviation-heading": 1.1854137271414749, "distance-from-start": 0.8357934176898612, "deviation-center-line": 0.14802419712751816, "driven_lanedir_consec": 0.1922115719302815}}
simulation-passed1
survival_time_max8.14999999999998
survival_time_mean8.14999999999998
survival_time_min8.14999999999998
No reset possible
157071377Bea Baselines 🐤baseline-duckietownaido-LF-sim-validationsim-2of4successnodavinci-stage-04-6.2.510:05:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.1776247561754163
survival_time_median59.99999999999873
deviation-center-line_median2.1521448786391084
in-drivable-lane_median40.79999999999904


other stats
deviation-center-line_max2.1521448786391084
deviation-center-line_mean2.1521448786391084
deviation-center-line_min2.1521448786391084
deviation-heading_max6.052157566574608
deviation-heading_mean6.052157566574608
deviation-heading_median6.052157566574608
deviation-heading_min6.052157566574608
distance-from-start_max1.425063891762866
distance-from-start_mean1.425063891762866
distance-from-start_median1.425063891762866
distance-from-start_min1.425063891762866
driven_any_max7.907611696681576
driven_any_mean7.907611696681576
driven_any_median7.907611696681576
driven_any_min7.907611696681576
driven_lanedir_consec_max2.1776247561754163
driven_lanedir_consec_mean2.1776247561754163
driven_lanedir_consec_min2.1776247561754163
driven_lanedir_max2.277966587672002
driven_lanedir_mean2.277966587672002
driven_lanedir_median2.277966587672002
driven_lanedir_min2.277966587672002
in-drivable-lane_max40.79999999999904
in-drivable-lane_mean40.79999999999904
in-drivable-lane_min40.79999999999904
per-episodes
details{"loop2-000-ego0": {"driven_any": 7.907611696681576, "survival_time": 59.99999999999873, "driven_lanedir": 2.277966587672002, "in-drivable-lane": 40.79999999999904, "deviation-heading": 6.052157566574608, "distance-from-start": 1.425063891762866, "deviation-center-line": 2.1521448786391084, "driven_lanedir_consec": 2.1776247561754163}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
157051377Bea Baselines 🐤baseline-duckietownaido-LF-sim-validationsim-0of4successnodavinci-stage-04-6.2.510:05:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.768777157280126
survival_time_median59.99999999999873
deviation-center-line_median2.647912281093039
in-drivable-lane_median19.14999999999956


other stats
deviation-center-line_max2.647912281093039
deviation-center-line_mean2.647912281093039
deviation-center-line_min2.647912281093039
deviation-heading_max8.6728251800287
deviation-heading_mean8.6728251800287
deviation-heading_median8.6728251800287
deviation-heading_min8.6728251800287
distance-from-start_max3.151523682643045
distance-from-start_mean3.151523682643045
distance-from-start_median3.151523682643045
distance-from-start_min3.151523682643045
driven_any_max7.907782937625951
driven_any_mean7.907782937625951
driven_any_median7.907782937625951
driven_any_min7.907782937625951
driven_lanedir_consec_max3.768777157280126
driven_lanedir_consec_mean3.768777157280126
driven_lanedir_consec_min3.768777157280126
driven_lanedir_max5.062420051355356
driven_lanedir_mean5.062420051355356
driven_lanedir_median5.062420051355356
driven_lanedir_min5.062420051355356
in-drivable-lane_max19.14999999999956
in-drivable-lane_mean19.14999999999956
in-drivable-lane_min19.14999999999956
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.907782937625951, "survival_time": 59.99999999999873, "driven_lanedir": 5.062420051355356, "in-drivable-lane": 19.14999999999956, "deviation-heading": 8.6728251800287, "distance-from-start": 3.151523682643045, "deviation-center-line": 2.647912281093039, "driven_lanedir_consec": 3.768777157280126}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
157001378Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-validationsim-1of4successnodavinci-stage-04-6.2.510:07:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median20.400000000000155
in-drivable-lane_median8.650000000000087
driven_lanedir_consec_median0.6056086339112295
deviation-center-line_median0.6803396064296651


other stats
deviation-center-line_max2.2807467289463914
deviation-center-line_mean0.9475717200780776
deviation-center-line_min0.1488609385065893
deviation-heading_max16.745747123059083
deviation-heading_mean5.841115792233381
deviation-heading_median2.8436672532229683
deviation-heading_min0.9313815394285084
distance-from-start_max1.959629942959358
distance-from-start_mean0.851730852225229
distance-from-start_median0.6404083061878002
distance-from-start_min0.16647685356595787
driven_any_max2.5637053899081135
driven_any_mean1.1281677458582262
driven_any_median0.8908314645181137
driven_any_min0.1673026644885641
driven_lanedir_consec_max2.0476083921171617
driven_lanedir_consec_mean0.8478162797623865
driven_lanedir_consec_min0.13243945910992494
driven_lanedir_max2.3028769503347495
driven_lanedir_mean0.964434828493124
driven_lanedir_median0.7112114522639109
driven_lanedir_min0.13243945910992494
in-drivable-lane_max18.800000000000153
in-drivable-lane_mean9.225000000000083
in-drivable-lane_min0.8000000000000114
per-episodes
details{"4way-000-ego0": {"driven_any": 1.176236897233896, "survival_time": 20.400000000000155, "driven_lanedir": 0.90040039539358, "in-drivable-lane": 1.4000000000000137, "deviation-heading": 16.745747123059083, "distance-from-start": 0.687464803476208, "deviation-center-line": 2.2807467289463914, "driven_lanedir_consec": 0.6891947586882172}, "4way-000-ego1": {"driven_any": 0.1673026644885641, "survival_time": 20.400000000000155, "driven_lanedir": 0.13243945910992494, "in-drivable-lane": 18.800000000000153, "deviation-heading": 0.9313815394285084, "distance-from-start": 0.16647685356595787, "deviation-center-line": 0.1488609385065893, "driven_lanedir_consec": 0.13243945910992494}, "4way-000-ego2": {"driven_any": 2.5637053899081135, "survival_time": 20.400000000000155, "driven_lanedir": 2.3028769503347495, "in-drivable-lane": 0.8000000000000114, "deviation-heading": 4.510485207702659, "distance-from-start": 1.959629942959358, "deviation-center-line": 1.1099298488050018, "driven_lanedir_consec": 2.0476083921171617}, "4way-000-ego3": {"driven_any": 0.6054260318023315, "survival_time": 20.400000000000155, "driven_lanedir": 0.5220225091342419, "in-drivable-lane": 15.900000000000162, "deviation-heading": 1.176849298743278, "distance-from-start": 0.5933518088993924, "deviation-center-line": 0.2507493640543284, "driven_lanedir_consec": 0.5220225091342419}}
simulation-passed1
survival_time_max20.400000000000155
survival_time_mean20.400000000000155
survival_time_min20.400000000000155
No reset possible
156911381Bea Baselines 🐤baseline-duckietownlx22-modconsimsuccessyesdavinci-stage-04-6.2.510:14:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median4.749999999999991
deviation-center-line_median2.222437505730171
driven_lanedir_consec_median7.315921407382271
survival_time_median59.99999999999873


other stats
deviation-center-line_max2.6094797108772356
deviation-center-line_mean2.222437505730171
deviation-center-line_min1.8353953005831063
deviation-heading_max3.837517169677545
deviation-heading_mean3.1307461843068554
deviation-heading_median3.1307461843068554
deviation-heading_min2.423975198936166
distance-from-start_max7.883577522261388
distance-from-start_mean7.877530319053169
distance-from-start_median7.877530319053169
distance-from-start_min7.87148311584495
driven_any_max7.921281467790121
driven_any_mean7.914648825189893
driven_any_median7.914648825189893
driven_any_min7.908016182589666
driven_lanedir_consec_max7.43263352348804
driven_lanedir_consec_mean7.315921407382271
driven_lanedir_consec_min7.199209291276502
driven_lanedir_max7.43263352348804
driven_lanedir_mean7.315921407382271
driven_lanedir_median7.315921407382271
driven_lanedir_min7.199209291276502
in-drivable-lane_max5.699999999999988
in-drivable-lane_mean4.749999999999991
in-drivable-lane_min3.7999999999999945
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 7.921281467790121, "survival_time": 59.99999999999873, "driven_lanedir": 7.43263352348804, "in-drivable-lane": 3.7999999999999945, "deviation-heading": 3.837517169677545, "distance-from-start": 7.883577522261388, "deviation-center-line": 1.8353953005831063, "driven_lanedir_consec": 7.43263352348804}, "LF-full-loop-001-ego0": {"driven_any": 7.908016182589666, "survival_time": 59.99999999999873, "driven_lanedir": 7.199209291276502, "in-drivable-lane": 5.699999999999988, "deviation-heading": 2.423975198936166, "distance-from-start": 7.87148311584495, "deviation-center-line": 2.6094797108772356, "driven_lanedir_consec": 7.199209291276502}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
156871385Bea Baselines 🐤baseline-duckietownlx22-BV1sim-1of5successnodavinci-stage-04-6.2.510:08:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d45-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
156841385Bea Baselines 🐤baseline-duckietownlx22-BV1sim-0of5successnodavinci-stage-04-6.2.510:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.3911136884406331


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.3911136884406331
distance-from-start_median0.3911136884406331
distance-from-start_min0.3911136884406331
driven_any_max0.3930075002402671
driven_any_mean0.3930075002402671
driven_any_median0.3930075002402671
driven_any_min0.3930075002402671
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max4.049999999999994
in-drivable-lane_mean4.049999999999994
in-drivable-lane_median4.049999999999994
in-drivable-lane_min4.049999999999994
per-episodes
details{"d30-ego0": {"driven_any": 0.3930075002402671, "survival_time": 4.049999999999994, "driven_lanedir": 0.0, "in-drivable-lane": 4.049999999999994, "deviation-heading": 0.0, "distance-from-start": 0.3911136884406331, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max4.049999999999994
survival_time_mean4.049999999999994
survival_time_median4.049999999999994
survival_time_min4.049999999999994
No reset possible
156821388Bea Baselines 🐤baseline-duckietownaido-hello-sim-validationsanity-checksuccessnodavinci-stage-04-6.2.510:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.013189187289113002
deviation-center-line_median0.0065397922395124125


other stats
deviation-center-line_max0.0065397922395124125
deviation-center-line_mean0.0065397922395124125
deviation-center-line_min0.0065397922395124125
deviation-heading_max0.2653584735777632
deviation-heading_mean0.2653584735777632
deviation-heading_median0.2653584735777632
deviation-heading_min0.2653584735777632
distance-from-start_max0.01507900477346035
distance-from-start_mean0.01507900477346035
distance-from-start_median0.01507900477346035
distance-from-start_min0.01507900477346035
driven_any_max0.01508444032884055
driven_any_mean0.01508444032884055
driven_any_median0.01508444032884055
driven_any_min0.01508444032884055
driven_lanedir_consec_max0.013189187289113002
driven_lanedir_consec_mean0.013189187289113002
driven_lanedir_consec_min0.013189187289113002
driven_lanedir_max0.013189187289113002
driven_lanedir_mean0.013189187289113002
driven_lanedir_median0.013189187289113002
driven_lanedir_min0.013189187289113002
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.01508444032884055, "survival_time": 0.49999999999999994, "driven_lanedir": 0.013189187289113002, "in-drivable-lane": 0.0, "deviation-heading": 0.2653584735777632, "distance-from-start": 0.01507900477346035, "deviation-center-line": 0.0065397922395124125, "driven_lanedir_consec": 0.013189187289113002}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
156801392Bea Baselines 🐤baseline-duckietownaido-LFV-sim-testingsim-2of4successnodavinci-stage-04-6.2.510:05:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median34.700000000000166
in-drivable-lane_median12.449999999999973
driven_lanedir_consec_median1.7921387222841
deviation-center-line_median2.0967507404864416


other stats
deviation-center-line_max2.0967507404864416
deviation-center-line_mean2.0967507404864416
deviation-center-line_min2.0967507404864416
deviation-heading_max6.59730246859112
deviation-heading_mean6.59730246859112
deviation-heading_median6.59730246859112
deviation-heading_min6.59730246859112
distance-from-start_max1.350915628114586
distance-from-start_mean1.350915628114586
distance-from-start_median1.350915628114586
distance-from-start_min1.350915628114586
driven_any_max4.462270237373044
driven_any_mean4.462270237373044
driven_any_median4.462270237373044
driven_any_min4.462270237373044
driven_lanedir_consec_max1.7921387222841
driven_lanedir_consec_mean1.7921387222841
driven_lanedir_consec_min1.7921387222841
driven_lanedir_max2.6494479742902364
driven_lanedir_mean2.6494479742902364
driven_lanedir_median2.6494479742902364
driven_lanedir_min2.6494479742902364
in-drivable-lane_max12.449999999999973
in-drivable-lane_mean12.449999999999973
in-drivable-lane_min12.449999999999973
per-episodes
details{"loop2-000-ego0": {"driven_any": 4.462270237373044, "survival_time": 34.700000000000166, "driven_lanedir": 2.6494479742902364, "in-drivable-lane": 12.449999999999973, "deviation-heading": 6.59730246859112, "distance-from-start": 1.350915628114586, "deviation-center-line": 2.0967507404864416, "driven_lanedir_consec": 1.7921387222841}}
simulation-passed1
survival_time_max34.700000000000166
survival_time_mean34.700000000000166
survival_time_min34.700000000000166
No reset possible
156731394Bea Baselines 🐤baseline-duckietownaido-LFI-sim-testingsim-1of4successnodavinci-stage-04-6.2.510:06:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.649999999999793
driven_lanedir_consec_median4.119626063193319
deviation-center-line_median4.088480724584503


other stats
deviation-center-line_max4.088480724584503
deviation-center-line_mean4.088480724584503
deviation-center-line_min4.088480724584503
deviation-heading_max12.450413648484306
deviation-heading_mean12.450413648484306
deviation-heading_median12.450413648484306
deviation-heading_min12.450413648484306
distance-from-start_max2.227242807906669
distance-from-start_mean2.227242807906669
distance-from-start_median2.227242807906669
distance-from-start_min2.227242807906669
driven_any_max7.90782655210273
driven_any_mean7.90782655210273
driven_any_median7.90782655210273
driven_any_min7.90782655210273
driven_lanedir_consec_max4.119626063193319
driven_lanedir_consec_mean4.119626063193319
driven_lanedir_consec_min4.119626063193319
driven_lanedir_max7.0636271381418805
driven_lanedir_mean7.0636271381418805
driven_lanedir_median7.0636271381418805
driven_lanedir_min7.0636271381418805
in-drivable-lane_max3.649999999999793
in-drivable-lane_mean3.649999999999793
in-drivable-lane_min3.649999999999793
per-episodes
details{"udem1-000-ego0": {"driven_any": 7.90782655210273, "survival_time": 59.99999999999873, "driven_lanedir": 7.0636271381418805, "in-drivable-lane": 3.649999999999793, "deviation-heading": 12.450413648484306, "distance-from-start": 2.227242807906669, "deviation-center-line": 4.088480724584503, "driven_lanedir_consec": 4.119626063193319}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
156691395Bea Baselines 🐤baseline-duckietownaido-LF-sim-testingsim-3of4successnodavinci-stage-04-6.2.510:05:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.10024741485305856
survival_time_median45.799999999999535
deviation-center-line_median0.10449348900605386
in-drivable-lane_median44.199999999999534


other stats
deviation-center-line_max0.10449348900605386
deviation-center-line_mean0.10449348900605386
deviation-center-line_min0.10449348900605386
deviation-heading_max1.2438627835416582
deviation-heading_mean1.2438627835416582
deviation-heading_median1.2438627835416582
deviation-heading_min1.2438627835416582
distance-from-start_max3.3749973878675075
distance-from-start_mean3.3749973878675075
distance-from-start_median3.3749973878675075
distance-from-start_min3.3749973878675075
driven_any_max5.929553914059976
driven_any_mean5.929553914059976
driven_any_median5.929553914059976
driven_any_min5.929553914059976
driven_lanedir_consec_max0.10024741485305856
driven_lanedir_consec_mean0.10024741485305856
driven_lanedir_consec_min0.10024741485305856
driven_lanedir_max0.10024741485305856
driven_lanedir_mean0.10024741485305856
driven_lanedir_median0.10024741485305856
driven_lanedir_min0.10024741485305856
in-drivable-lane_max44.199999999999534
in-drivable-lane_mean44.199999999999534
in-drivable-lane_min44.199999999999534
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.929553914059976, "survival_time": 45.799999999999535, "driven_lanedir": 0.10024741485305856, "in-drivable-lane": 44.199999999999534, "deviation-heading": 1.2438627835416582, "distance-from-start": 3.3749973878675075, "deviation-center-line": 0.10449348900605386, "driven_lanedir_consec": 0.10024741485305856}}
simulation-passed1
survival_time_max45.799999999999535
survival_time_mean45.799999999999535
survival_time_min45.799999999999535
No reset possible
156671395Bea Baselines 🐤baseline-duckietownaido-LF-sim-testingsim-0of4successnodavinci-stage-04-6.2.510:05:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.797015960902462
survival_time_median59.99999999999873
deviation-center-line_median2.6011765710793497
in-drivable-lane_median6.199999999999648


other stats
deviation-center-line_max2.6011765710793497
deviation-center-line_mean2.6011765710793497
deviation-center-line_min2.6011765710793497
deviation-heading_max8.476319442283595
deviation-heading_mean8.476319442283595
deviation-heading_median8.476319442283595
deviation-heading_min8.476319442283595
distance-from-start_max2.87224522632079
distance-from-start_mean2.87224522632079
distance-from-start_median2.87224522632079
distance-from-start_min2.87224522632079
driven_any_max7.907819516422021
driven_any_mean7.907819516422021
driven_any_median7.907819516422021
driven_any_min7.907819516422021
driven_lanedir_consec_max6.797015960902462
driven_lanedir_consec_mean6.797015960902462
driven_lanedir_consec_min6.797015960902462
driven_lanedir_max6.844723941197957
driven_lanedir_mean6.844723941197957
driven_lanedir_median6.844723941197957
driven_lanedir_min6.844723941197957
in-drivable-lane_max6.199999999999648
in-drivable-lane_mean6.199999999999648
in-drivable-lane_min6.199999999999648
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.907819516422021, "survival_time": 59.99999999999873, "driven_lanedir": 6.844723941197957, "in-drivable-lane": 6.199999999999648, "deviation-heading": 8.476319442283595, "distance-from-start": 2.87224522632079, "deviation-center-line": 2.6011765710793497, "driven_lanedir_consec": 6.797015960902462}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
156651396Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-04-6.2.510:02:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
156621396Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-testingsim-0of4successnodavinci-stage-04-6.2.510:06:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.000000000000009
in-drivable-lane_median1.6999999999999953
driven_lanedir_consec_median0.48906962484873706
deviation-center-line_median0.6173250298219506


other stats
deviation-center-line_max1.48987340735174
deviation-center-line_mean0.7236810400406165
deviation-center-line_min0.17020069316682498
deviation-heading_max5.787115413885615
deviation-heading_mean4.097430658775629
deviation-heading_median4.659848565593539
deviation-heading_min1.2829100900298234
distance-from-start_max0.6187081828095375
distance-from-start_mean0.5085389266783515
distance-from-start_median0.5325902286626009
distance-from-start_min0.35026706657866696
driven_any_max1.1827944367963457
driven_any_mean0.84098988852643
driven_any_median0.9007347936115092
driven_any_min0.3796955300863558
driven_lanedir_consec_max0.6438298199371708
driven_lanedir_consec_mean0.4909600974912527
driven_lanedir_consec_min0.3418713203303658
driven_lanedir_max0.7775946901136608
driven_lanedir_mean0.5784340155011491
driven_lanedir_median0.597135025780285
driven_lanedir_min0.3418713203303658
in-drivable-lane_max5.150000000000016
in-drivable-lane_mean2.137500000000002
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 0.99025000003118, "survival_time": 10.000000000000009, "driven_lanedir": 0.6446425824064272, "in-drivable-lane": 1.699999999999994, "deviation-heading": 4.96117753477311, "distance-from-start": 0.6094157250253215, "deviation-center-line": 0.5074764749184153, "driven_lanedir_consec": 0.6438298199371708}, "udem-000-ego1": {"driven_any": 1.1827944367963457, "survival_time": 10.000000000000009, "driven_lanedir": 0.7775946901136608, "in-drivable-lane": 1.6999999999999966, "deviation-heading": 4.358519596413968, "distance-from-start": 0.4557647322998802, "deviation-center-line": 0.7271735847254858, "driven_lanedir_consec": 0.4285117805433314}, "udem-000-ego2": {"driven_any": 0.8112195871918387, "survival_time": 10.000000000000009, "driven_lanedir": 0.5496274691541427, "in-drivable-lane": 5.150000000000016, "deviation-heading": 1.2829100900298234, "distance-from-start": 0.6187081828095375, "deviation-center-line": 0.17020069316682498, "driven_lanedir_consec": 0.5496274691541427}, "udem-000-ego3": {"driven_any": 0.3796955300863558, "survival_time": 10.000000000000009, "driven_lanedir": 0.3418713203303658, "in-drivable-lane": 0.0, "deviation-heading": 5.787115413885615, "distance-from-start": 0.35026706657866696, "deviation-center-line": 1.48987340735174, "driven_lanedir_consec": 0.3418713203303658}}
simulation-passed1
survival_time_max10.000000000000009
survival_time_mean10.000000000000009
survival_time_min10.000000000000009
No reset possible
156591397Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-testingsim-2of4successnodavinci-stage-04-6.2.510:03:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median13.75000000000006
in-drivable-lane_median2.3999999999999995
driven_lanedir_consec_median0.9223186471304862
deviation-center-line_median0.970306719198916


other stats
deviation-center-line_max1.2406292490578297
deviation-center-line_mean0.970306719198916
deviation-center-line_min0.6999841893400024
deviation-heading_max4.49004565214791
deviation-heading_mean4.124005467207556
deviation-heading_median4.124005467207556
deviation-heading_min3.7579652822672007
distance-from-start_max0.923927682743502
distance-from-start_mean0.7499400326348766
distance-from-start_median0.7499400326348766
distance-from-start_min0.5759523825262511
driven_any_max1.674158338252044
driven_any_mean1.6741410756875486
driven_any_median1.6741410756875486
driven_any_min1.6741238131230531
driven_lanedir_consec_max1.24286626899061
driven_lanedir_consec_mean0.9223186471304862
driven_lanedir_consec_min0.6017710252703623
driven_lanedir_max1.24286626899061
driven_lanedir_mean1.2167207757829153
driven_lanedir_median1.2167207757829153
driven_lanedir_min1.1905752825752205
in-drivable-lane_max2.7000000000000064
in-drivable-lane_mean2.3999999999999995
in-drivable-lane_min2.0999999999999925
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.674158338252044, "survival_time": 13.75000000000006, "driven_lanedir": 1.1905752825752205, "in-drivable-lane": 2.7000000000000064, "deviation-heading": 4.49004565214791, "distance-from-start": 0.5759523825262511, "deviation-center-line": 0.6999841893400024, "driven_lanedir_consec": 0.6017710252703623}, "loop2-000-ego1": {"driven_any": 1.6741238131230531, "survival_time": 13.75000000000006, "driven_lanedir": 1.24286626899061, "in-drivable-lane": 2.0999999999999925, "deviation-heading": 3.7579652822672007, "distance-from-start": 0.923927682743502, "deviation-center-line": 1.2406292490578297, "driven_lanedir_consec": 1.24286626899061}}
simulation-passed1
survival_time_max13.75000000000006
survival_time_mean13.75000000000006
survival_time_min13.75000000000006
No reset possible
156541398Bea Baselines 🐤baseline-duckietownaido-LFP-sim-testingsim-3of4successnodavinci-stage-04-6.2.510:04:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median25.300000000000225
in-drivable-lane_median1.500000000000013
driven_lanedir_consec_median2.927520448983847
deviation-center-line_median1.8731302492483144


other stats
deviation-center-line_max1.8731302492483144
deviation-center-line_mean1.8731302492483144
deviation-center-line_min1.8731302492483144
deviation-heading_max4.262334441942872
deviation-heading_mean4.262334441942872
deviation-heading_median4.262334441942872
deviation-heading_min4.262334441942872
distance-from-start_max2.2782687514174715
distance-from-start_mean2.2782687514174715
distance-from-start_median2.2782687514174715
distance-from-start_min2.2782687514174715
driven_any_max3.2077468095785635
driven_any_mean3.2077468095785635
driven_any_median3.2077468095785635
driven_any_min3.2077468095785635
driven_lanedir_consec_max2.927520448983847
driven_lanedir_consec_mean2.927520448983847
driven_lanedir_consec_min2.927520448983847
driven_lanedir_max2.927520448983847
driven_lanedir_mean2.927520448983847
driven_lanedir_median2.927520448983847
driven_lanedir_min2.927520448983847
in-drivable-lane_max1.500000000000013
in-drivable-lane_mean1.500000000000013
in-drivable-lane_min1.500000000000013
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.2077468095785635, "survival_time": 25.300000000000225, "driven_lanedir": 2.927520448983847, "in-drivable-lane": 1.500000000000013, "deviation-heading": 4.262334441942872, "distance-from-start": 2.2782687514174715, "deviation-center-line": 1.8731302492483144, "driven_lanedir_consec": 2.927520448983847}}
simulation-passed1
survival_time_max25.300000000000225
survival_time_mean25.300000000000225
survival_time_min25.300000000000225
No reset possible
156491400Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-validationsim-3of4successnodavinci-stage-04-6.2.510:05:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median48.599999999999376
in-drivable-lane_median3.099999999999902
driven_lanedir_consec_median2.1822085786120473
deviation-center-line_median4.281969506383752


other stats
deviation-center-line_max4.281969506383752
deviation-center-line_mean4.281969506383752
deviation-center-line_min4.281969506383752
deviation-heading_max8.956926170181262
deviation-heading_mean8.956926170181262
deviation-heading_median8.956926170181262
deviation-heading_min8.956926170181262
distance-from-start_max1.84932503046977
distance-from-start_mean1.84932503046977
distance-from-start_median1.84932503046977
distance-from-start_min1.84932503046977
driven_any_max2.760582128240964
driven_any_mean2.760582128240964
driven_any_median2.760582128240964
driven_any_min2.760582128240964
driven_lanedir_consec_max2.1822085786120473
driven_lanedir_consec_mean2.1822085786120473
driven_lanedir_consec_min2.1822085786120473
driven_lanedir_max2.5502818256429407
driven_lanedir_mean2.5502818256429407
driven_lanedir_median2.5502818256429407
driven_lanedir_min2.5502818256429407
in-drivable-lane_max3.099999999999902
in-drivable-lane_mean3.099999999999902
in-drivable-lane_min3.099999999999902
per-episodes
details{"zigzag-000-ego0": {"driven_any": 2.760582128240964, "survival_time": 48.599999999999376, "driven_lanedir": 2.5502818256429407, "in-drivable-lane": 3.099999999999902, "deviation-heading": 8.956926170181262, "distance-from-start": 1.84932503046977, "deviation-center-line": 4.281969506383752, "driven_lanedir_consec": 2.1822085786120473}}
simulation-passed1
survival_time_max48.599999999999376
survival_time_mean48.599999999999376
survival_time_min48.599999999999376
No reset possible
156431401Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-validationsim-1of4successnodavinci-stage-04-6.2.510:09:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.449999999999882
driven_lanedir_consec_median3.305858702972225
deviation-center-line_median7.198939676780748


other stats
deviation-center-line_max7.198939676780748
deviation-center-line_mean7.198939676780748
deviation-center-line_min7.198939676780748
deviation-heading_max5.347648671657762
deviation-heading_mean5.347648671657762
deviation-heading_median5.347648671657762
deviation-heading_min5.347648671657762
distance-from-start_max2.180674072281247
distance-from-start_mean2.180674072281247
distance-from-start_median2.180674072281247
distance-from-start_min2.180674072281247
driven_any_max3.476091095751902
driven_any_mean3.476091095751902
driven_any_median3.476091095751902
driven_any_min3.476091095751902
driven_lanedir_consec_max3.305858702972225
driven_lanedir_consec_mean3.305858702972225
driven_lanedir_consec_min3.305858702972225
driven_lanedir_max3.305858702972225
driven_lanedir_mean3.305858702972225
driven_lanedir_median3.305858702972225
driven_lanedir_min3.305858702972225
in-drivable-lane_max3.449999999999882
in-drivable-lane_mean3.449999999999882
in-drivable-lane_min3.449999999999882
per-episodes
details{"loop-000-ego0": {"driven_any": 3.476091095751902, "survival_time": 59.99999999999873, "driven_lanedir": 3.305858702972225, "in-drivable-lane": 3.449999999999882, "deviation-heading": 5.347648671657762, "distance-from-start": 2.180674072281247, "deviation-center-line": 7.198939676780748, "driven_lanedir_consec": 3.305858702972225}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
156411402Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-validationsim-3of4successnodavinci-stage-04-6.2.510:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
156341403Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-validationsim-0of4successnodavinci-stage-04-6.2.510:15:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.024999999999956
driven_lanedir_consec_median2.7186759709641253
deviation-center-line_median5.862131942992704


other stats
deviation-center-line_max6.8926428573142395
deviation-center-line_mean5.678345665140167
deviation-center-line_min4.0964759172610234
deviation-heading_max8.918457822311643
deviation-heading_mean7.081123884150349
deviation-heading_median7.087670971017298
deviation-heading_min5.2306957722551575
distance-from-start_max2.8296782642090292
distance-from-start_mean1.888864829800502
distance-from-start_median1.639347737745438
distance-from-start_min1.4470855795021027
driven_any_max3.524090671773667
driven_any_mean3.5147133774298376
driven_any_median3.518834998148701
driven_any_min3.4970928416482807
driven_lanedir_consec_max3.391077995430446
driven_lanedir_consec_mean2.708466243383813
driven_lanedir_consec_min2.0054350361765554
driven_lanedir_max3.391077995430446
driven_lanedir_mean3.3679532290440797
driven_lanedir_median3.3641150341728117
driven_lanedir_min3.3525048524002488
in-drivable-lane_max2.749999999999872
in-drivable-lane_mean2.162499999999953
in-drivable-lane_min1.8500000000000263
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.5180863448801456, "survival_time": 59.99999999999873, "driven_lanedir": 3.373947912234794, "in-drivable-lane": 2.0499999999998835, "deviation-heading": 6.8453385018692146, "distance-from-start": 1.6666260059194336, "deviation-center-line": 4.0964759172610234, "driven_lanedir_consec": 2.0054350361765554}, "autolab-000-ego1": {"driven_any": 3.524090671773667, "survival_time": 59.99999999999873, "driven_lanedir": 3.391077995430446, "in-drivable-lane": 1.8500000000000263, "deviation-heading": 7.33000344016538, "distance-from-start": 2.8296782642090292, "deviation-center-line": 6.250381576789261, "driven_lanedir_consec": 3.391077995430446}, "autolab-000-ego2": {"driven_any": 3.4970928416482807, "survival_time": 59.99999999999873, "driven_lanedir": 3.354282156110829, "in-drivable-lane": 2.749999999999872, "deviation-heading": 5.2306957722551575, "distance-from-start": 1.612069469571442, "deviation-center-line": 6.8926428573142395, "driven_lanedir_consec": 3.354282156110829}, "autolab-000-ego3": {"driven_any": 3.5195836514172565, "survival_time": 59.99999999999873, "driven_lanedir": 3.3525048524002488, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 8.918457822311643, "distance-from-start": 1.4470855795021027, "deviation-center-line": 5.4738823091961475, "driven_lanedir_consec": 2.0830697858174214}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
156291405Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-validationsim-2of4successnodavinci-stage-04-6.2.510:04:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.1499999999999666
driven_lanedir_consec_median1.4203839696348646
deviation-center-line_median4.904461575108174


other stats
deviation-center-line_max4.904461575108174
deviation-center-line_mean4.904461575108174
deviation-center-line_min4.904461575108174
deviation-heading_max7.745124892472468
deviation-heading_mean7.745124892472468
deviation-heading_median7.745124892472468
deviation-heading_min7.745124892472468
distance-from-start_max1.2059816740532263
distance-from-start_mean1.2059816740532263
distance-from-start_median1.2059816740532263
distance-from-start_min1.2059816740532263
driven_any_max3.485084016237799
driven_any_mean3.485084016237799
driven_any_median3.485084016237799
driven_any_min3.485084016237799
driven_lanedir_consec_max1.4203839696348646
driven_lanedir_consec_mean1.4203839696348646
driven_lanedir_consec_min1.4203839696348646
driven_lanedir_max3.2905245152042193
driven_lanedir_mean3.2905245152042193
driven_lanedir_median3.2905245152042193
driven_lanedir_min3.2905245152042193
in-drivable-lane_max3.1499999999999666
in-drivable-lane_mean3.1499999999999666
in-drivable-lane_min3.1499999999999666
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.485084016237799, "survival_time": 59.99999999999873, "driven_lanedir": 3.2905245152042193, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.745124892472468, "distance-from-start": 1.2059816740532263, "deviation-center-line": 4.904461575108174, "driven_lanedir_consec": 1.4203839696348646}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
156241406Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-testingsim-1of4successnodavinci-stage-04-6.2.510:04:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median15.05000000000008
in-drivable-lane_median0.0
driven_lanedir_consec_median0.6855434087750805
deviation-center-line_median1.12957986069885


other stats
deviation-center-line_max1.12957986069885
deviation-center-line_mean1.12957986069885
deviation-center-line_min1.12957986069885
deviation-heading_max1.951860613365137
deviation-heading_mean1.951860613365137
deviation-heading_median1.951860613365137
deviation-heading_min1.951860613365137
distance-from-start_max0.6890064762174344
distance-from-start_mean0.6890064762174344
distance-from-start_median0.6890064762174344
distance-from-start_min0.6890064762174344
driven_any_max0.8405923695951633
driven_any_mean0.8405923695951633
driven_any_median0.8405923695951633
driven_any_min0.8405923695951633
driven_lanedir_consec_max0.6855434087750805
driven_lanedir_consec_mean0.6855434087750805
driven_lanedir_consec_min0.6855434087750805
driven_lanedir_max0.8262266008885575
driven_lanedir_mean0.8262266008885575
driven_lanedir_median0.8262266008885575
driven_lanedir_min0.8262266008885575
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 0.8405923695951633, "survival_time": 15.05000000000008, "driven_lanedir": 0.8262266008885575, "in-drivable-lane": 0.0, "deviation-heading": 1.951860613365137, "distance-from-start": 0.6890064762174344, "deviation-center-line": 1.12957986069885, "driven_lanedir_consec": 0.6855434087750805}}
simulation-passed1
survival_time_max15.05000000000008
survival_time_mean15.05000000000008
survival_time_min15.05000000000008
No reset possible
156221406Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-testingsim-3of4successnodavinci-stage-04-6.2.510:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
156171408Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-testingsim-2of4successnodavinci-stage-04-6.2.510:06:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.349999999999895
driven_lanedir_consec_median2.091626784820886
deviation-center-line_median5.917240573756968


other stats
deviation-center-line_max5.917240573756968
deviation-center-line_mean5.917240573756968
deviation-center-line_min5.917240573756968
deviation-heading_max8.389433025698892
deviation-heading_mean8.389433025698892
deviation-heading_median8.389433025698892
deviation-heading_min8.389433025698892
distance-from-start_max1.0307831250305386
distance-from-start_mean1.0307831250305386
distance-from-start_median1.0307831250305386
distance-from-start_min1.0307831250305386
driven_any_max3.4490819837243656
driven_any_mean3.4490819837243656
driven_any_median3.4490819837243656
driven_any_min3.4490819837243656
driven_lanedir_consec_max2.091626784820886
driven_lanedir_consec_mean2.091626784820886
driven_lanedir_consec_min2.091626784820886
driven_lanedir_max3.203992280226659
driven_lanedir_mean3.203992280226659
driven_lanedir_median3.203992280226659
driven_lanedir_min3.203992280226659
in-drivable-lane_max4.349999999999895
in-drivable-lane_mean4.349999999999895
in-drivable-lane_min4.349999999999895
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.4490819837243656, "survival_time": 59.99999999999873, "driven_lanedir": 3.203992280226659, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.389433025698892, "distance-from-start": 1.0307831250305386, "deviation-center-line": 5.917240573756968, "driven_lanedir_consec": 2.091626784820886}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
156101409Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-testingsim-0of4successnodavinci-stage-04-6.2.510:06:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.292103748604663
deviation-center-line_median4.949281369491427


other stats
deviation-center-line_max4.949281369491427
deviation-center-line_mean4.949281369491427
deviation-center-line_min4.949281369491427
deviation-heading_max5.605546349563034
deviation-heading_mean5.605546349563034
deviation-heading_median5.605546349563034
deviation-heading_min5.605546349563034
distance-from-start_max2.278496107947562
distance-from-start_mean2.278496107947562
distance-from-start_median2.278496107947562
distance-from-start_min2.278496107947562
driven_any_max3.5795858026067657
driven_any_mean3.5795858026067657
driven_any_median3.5795858026067657
driven_any_min3.5795858026067657
driven_lanedir_consec_max3.292103748604663
driven_lanedir_consec_mean3.292103748604663
driven_lanedir_consec_min3.292103748604663
driven_lanedir_max3.53367274833897
driven_lanedir_mean3.53367274833897
driven_lanedir_median3.53367274833897
driven_lanedir_min3.53367274833897
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 3.5795858026067657, "survival_time": 59.99999999999873, "driven_lanedir": 3.53367274833897, "in-drivable-lane": 0.0, "deviation-heading": 5.605546349563034, "distance-from-start": 2.278496107947562, "deviation-center-line": 4.949281369491427, "driven_lanedir_consec": 3.292103748604663}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
156051411Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-testingsim-1of4successnodavinci-stage-04-6.2.510:16:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.749999999999952
driven_lanedir_consec_median3.3108429130678627
deviation-center-line_median6.488612341525324


other stats
deviation-center-line_max7.194535652106716
deviation-center-line_mean6.189132437353033
deviation-center-line_min4.584769414254769
deviation-heading_max5.1659907865965735
deviation-heading_mean4.395400760189543
deviation-heading_median4.246938088221968
deviation-heading_min3.921736077717662
distance-from-start_max2.702654291483946
distance-from-start_mean2.5000234387240603
distance-from-start_median2.696936207575508
distance-from-start_min1.9035670482612792
driven_any_max3.5795805678303996
driven_any_mean3.511364143390294
driven_any_median3.497093152571938
driven_any_min3.4716897005868983
driven_lanedir_consec_max3.392650989219845
driven_lanedir_consec_mean3.3072216022018863
driven_lanedir_consec_min3.2145495934519746
driven_lanedir_max3.5546680924349143
driven_lanedir_mean3.3922512713982065
driven_lanedir_median3.361057245426797
driven_lanedir_min3.2922225023043183
in-drivable-lane_max3.5999999999999623
in-drivable-lane_mean2.2749999999999666
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 3.5795805678303996, "survival_time": 59.99999999999873, "driven_lanedir": 3.5546680924349143, "in-drivable-lane": 0.0, "deviation-heading": 3.933442455386819, "distance-from-start": 1.9035670482612792, "deviation-center-line": 4.584769414254769, "driven_lanedir_consec": 3.2145495934519746}, "4way-000-ego1": {"driven_any": 3.4850923665530997, "survival_time": 59.99999999999873, "driven_lanedir": 3.329463323831407, "in-drivable-lane": 3.1499999999999595, "deviation-heading": 4.560433721057117, "distance-from-start": 2.702654291483946, "deviation-center-line": 7.194535652106716, "driven_lanedir_consec": 3.329463323831407}, "4way-000-ego2": {"driven_any": 3.509093938590777, "survival_time": 59.99999999999873, "driven_lanedir": 3.3926511670221866, "in-drivable-lane": 2.349999999999945, "deviation-heading": 3.921736077717662, "distance-from-start": 2.698831659135408, "deviation-center-line": 6.220267984933724, "driven_lanedir_consec": 3.392650989219845}, "4way-000-ego3": {"driven_any": 3.4716897005868983, "survival_time": 59.99999999999873, "driven_lanedir": 3.2922225023043183, "in-drivable-lane": 3.5999999999999623, "deviation-heading": 5.1659907865965735, "distance-from-start": 2.695040756015608, "deviation-center-line": 6.756956698116925, "driven_lanedir_consec": 3.2922225023043183}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
156031411Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-testingsim-3of4successnodavinci-stage-04-6.2.510:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
155961412Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-testingsim-2of4successnodavinci-stage-04-6.2.510:05:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.349999999999895
driven_lanedir_consec_median2.0916627772105003
deviation-center-line_median5.917247390668543


other stats
deviation-center-line_max5.917247390668543
deviation-center-line_mean5.917247390668543
deviation-center-line_min5.917247390668543
deviation-heading_max8.389432170044804
deviation-heading_mean8.389432170044804
deviation-heading_median8.389432170044804
deviation-heading_min8.389432170044804
distance-from-start_max1.030783297990397
distance-from-start_mean1.030783297990397
distance-from-start_median1.030783297990397
distance-from-start_min1.030783297990397
driven_any_max3.4490819837251045
driven_any_mean3.4490819837251045
driven_any_median3.4490819837251045
driven_any_min3.4490819837251045
driven_lanedir_consec_max2.0916627772105003
driven_lanedir_consec_mean2.0916627772105003
driven_lanedir_consec_min2.0916627772105003
driven_lanedir_max3.204014087213283
driven_lanedir_mean3.204014087213283
driven_lanedir_median3.204014087213283
driven_lanedir_min3.204014087213283
in-drivable-lane_max4.349999999999895
in-drivable-lane_mean4.349999999999895
in-drivable-lane_min4.349999999999895
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.4490819837251045, "survival_time": 59.99999999999873, "driven_lanedir": 3.204014087213283, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.389432170044804, "distance-from-start": 1.030783297990397, "deviation-center-line": 5.917247390668543, "driven_lanedir_consec": 2.0916627772105003}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
155931414Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-validationsim-1of4successnodavinci-stage-04-6.2.510:03:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.449999999999882
driven_lanedir_consec_median3.3057932853077427
deviation-center-line_median7.154226688493768


other stats
deviation-center-line_max7.154226688493768
deviation-center-line_mean7.154226688493768
deviation-center-line_min7.154226688493768
deviation-heading_max5.348097201635609
deviation-heading_mean5.348097201635609
deviation-heading_median5.348097201635609
deviation-heading_min5.348097201635609
distance-from-start_max1.6303675543068192
distance-from-start_mean1.6303675543068192
distance-from-start_median1.6303675543068192
distance-from-start_min1.6303675543068192
driven_any_max3.47609109580057
driven_any_mean3.47609109580057
driven_any_median3.47609109580057
driven_any_min3.47609109580057
driven_lanedir_consec_max3.3057932853077427
driven_lanedir_consec_mean3.3057932853077427
driven_lanedir_consec_min3.3057932853077427
driven_lanedir_max3.3057932853077427
driven_lanedir_mean3.3057932853077427
driven_lanedir_median3.3057932853077427
driven_lanedir_min3.3057932853077427
in-drivable-lane_max3.449999999999882
in-drivable-lane_mean3.449999999999882
in-drivable-lane_min3.449999999999882
per-episodes
details{"loop-000-ego0": {"driven_any": 3.47609109580057, "survival_time": 59.99999999999873, "driven_lanedir": 3.3057932853077427, "in-drivable-lane": 3.449999999999882, "deviation-heading": 5.348097201635609, "distance-from-start": 1.6303675543068192, "deviation-center-line": 7.154226688493768, "driven_lanedir_consec": 3.3057932853077427}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
155911415Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-validationsim-3of4successnodavinci-stage-04-6.2.510:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
155901415Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-validationsim-2of4successnodavinci-stage-04-6.2.510:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
155851416Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-validationsim-2of4successnodavinci-stage-04-6.2.510:09:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.4156597876014327
deviation-center-line_median5.989789523960853


other stats
deviation-center-line_max8.495537949245412
deviation-center-line_mean5.971732905101129
deviation-center-line_min3.411814623237397
deviation-heading_max5.897113234379067
deviation-heading_mean4.048666897035051
deviation-heading_median3.883494575102228
deviation-heading_min2.53056520355668
distance-from-start_max2.619089336031859
distance-from-start_mean2.081728511655291
distance-from-start_median2.273437348983144
distance-from-start_min1.1609500126230166
driven_any_max3.5795929797204047
driven_any_mean3.0144689618920215
driven_any_median3.5518420920250877
driven_any_min1.3745986837975066
driven_lanedir_consec_max3.4641594614086646
driven_lanedir_consec_mean2.914869629053038
driven_lanedir_consec_min1.3639994796006216
driven_lanedir_max3.558362293690531
driven_lanedir_mean2.9724232090689076
driven_lanedir_median3.483665531492239
driven_lanedir_min1.3639994796006216
in-drivable-lane_max1.8499999999998948
in-drivable-lane_mean0.4624999999999737
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 3.5795929797204047, "survival_time": 59.99999999999873, "driven_lanedir": 3.5411070899715265, "in-drivable-lane": 0.0, "deviation-heading": 5.897113234379067, "distance-from-start": 2.263048461522456, "deviation-center-line": 5.473740300006772, "driven_lanedir_consec": 3.4641594614086646}, "4way-000-ego1": {"driven_any": 3.524094913434593, "survival_time": 59.99999999999873, "driven_lanedir": 3.4262239730129513, "in-drivable-lane": 1.8499999999998948, "deviation-heading": 3.513531876713755, "distance-from-start": 2.619089336031859, "deviation-center-line": 6.505838747914936, "driven_lanedir_consec": 3.4262237769992145}, "4way-000-ego2": {"driven_any": 3.579589270615582, "survival_time": 59.99999999999873, "driven_lanedir": 3.558362293690531, "in-drivable-lane": 0.0, "deviation-heading": 4.2534572734907, "distance-from-start": 2.2838262364438315, "deviation-center-line": 3.411814623237397, "driven_lanedir_consec": 3.4050957982036514}, "4way-000-ego3": {"driven_any": 1.3745986837975066, "survival_time": 59.99999999999873, "driven_lanedir": 1.3639994796006216, "in-drivable-lane": 0.0, "deviation-heading": 2.53056520355668, "distance-from-start": 1.1609500126230166, "deviation-center-line": 8.495537949245412, "driven_lanedir_consec": 1.3639994796006216}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
155781419Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-validationsim-2of4successnodavinci-stage-04-6.2.510:03:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.1499999999999666
driven_lanedir_consec_median1.4204028644018567
deviation-center-line_median4.903598525098628


other stats
deviation-center-line_max4.903598525098628
deviation-center-line_mean4.903598525098628
deviation-center-line_min4.903598525098628
deviation-heading_max7.744574599008731
deviation-heading_mean7.744574599008731
deviation-heading_median7.744574599008731
deviation-heading_min7.744574599008731
distance-from-start_max1.2060007868632094
distance-from-start_mean1.2060007868632094
distance-from-start_median1.2060007868632094
distance-from-start_min1.2060007868632094
driven_any_max3.485084017697367
driven_any_mean3.485084017697367
driven_any_median3.485084017697367
driven_any_min3.485084017697367
driven_lanedir_consec_max1.4204028644018567
driven_lanedir_consec_mean1.4204028644018567
driven_lanedir_consec_min1.4204028644018567
driven_lanedir_max3.290525892781009
driven_lanedir_mean3.290525892781009
driven_lanedir_median3.290525892781009
driven_lanedir_min3.290525892781009
in-drivable-lane_max3.1499999999999666
in-drivable-lane_mean3.1499999999999666
in-drivable-lane_min3.1499999999999666
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.485084017697367, "survival_time": 59.99999999999873, "driven_lanedir": 3.290525892781009, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.744574599008731, "distance-from-start": 1.2060007868632094, "deviation-center-line": 4.903598525098628, "driven_lanedir_consec": 1.4204028644018567}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
155721420Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-testingsim-0of4successnodavinci-stage-04-6.2.510:04:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.0000000000000284
driven_lanedir_consec_median2.241204615389226
deviation-center-line_median4.759684198968496


other stats
deviation-center-line_max4.759684198968496
deviation-center-line_mean4.759684198968496
deviation-center-line_min4.759684198968496
deviation-heading_max9.18078892152259
deviation-heading_mean9.18078892152259
deviation-heading_median9.18078892152259
deviation-heading_min9.18078892152259
distance-from-start_max1.6296054226673595
distance-from-start_mean1.6296054226673595
distance-from-start_median1.6296054226673595
distance-from-start_min1.6296054226673595
driven_any_max3.519583547683476
driven_any_mean3.519583547683476
driven_any_median3.519583547683476
driven_any_min3.519583547683476
driven_lanedir_consec_max2.241204615389226
driven_lanedir_consec_mean2.241204615389226
driven_lanedir_consec_min2.241204615389226
driven_lanedir_max3.353584317203001
driven_lanedir_mean3.353584317203001
driven_lanedir_median3.353584317203001
driven_lanedir_min3.353584317203001
in-drivable-lane_max2.0000000000000284
in-drivable-lane_mean2.0000000000000284
in-drivable-lane_min2.0000000000000284
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.519583547683476, "survival_time": 59.99999999999873, "driven_lanedir": 3.353584317203001, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 9.18078892152259, "distance-from-start": 1.6296054226673595, "deviation-center-line": 4.759684198968496, "driven_lanedir_consec": 2.241204615389226}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
155651422Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-testingsim-1of4successnodavinci-stage-04-6.2.510:09:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.04999999999999716
driven_lanedir_consec_median3.105242381638413
deviation-center-line_median4.2838554583648385


other stats
deviation-center-line_max6.480635029684861
deviation-center-line_mean4.233458533023654
deviation-center-line_min1.8854881856800791
deviation-heading_max6.074433982916035
deviation-heading_mean4.437287043141697
deviation-heading_median4.190213879538641
deviation-heading_min3.2942864305734707
distance-from-start_max2.6219633070118125
distance-from-start_mean2.3834433501492436
distance-from-start_median2.3769915028957085
distance-from-start_min2.157827087793745
driven_any_max3.5765946322989515
driven_any_mean3.229717557359504
driven_any_median3.2158432856394445
driven_any_min2.9105890258601756
driven_lanedir_consec_max3.4606351955763963
driven_lanedir_consec_mean3.0987684797264516
driven_lanedir_consec_min2.723953960052584
driven_lanedir_max3.5302995839808413
driven_lanedir_mean3.1848735445261127
driven_lanedir_median3.161506104690779
driven_lanedir_min2.8861823847420505
in-drivable-lane_max1.9499999999998892
in-drivable-lane_mean0.5124999999999709
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 2.9105890258601756, "survival_time": 59.99999999999873, "driven_lanedir": 2.8861823847420505, "in-drivable-lane": 0.0, "deviation-heading": 6.074433982916035, "distance-from-start": 2.157827087793745, "deviation-center-line": 3.0576160910267776, "driven_lanedir_consec": 2.723953960052584}, "udem-000-ego1": {"driven_any": 3.521095053928605, "survival_time": 59.99999999999873, "driven_lanedir": 3.4216564650122128, "in-drivable-lane": 1.9499999999998892, "deviation-heading": 3.2942864305734707, "distance-from-start": 2.6219633070118125, "deviation-center-line": 6.480635029684861, "driven_lanedir_consec": 3.4216564650122128}, "udem-000-ego2": {"driven_any": 2.9105915173502845, "survival_time": 59.99999999999873, "driven_lanedir": 2.9013557443693445, "in-drivable-lane": 0.0, "deviation-heading": 3.947864180395224, "distance-from-start": 2.395368409966694, "deviation-center-line": 1.8854881856800791, "driven_lanedir_consec": 2.7888282982646126}, "udem-000-ego3": {"driven_any": 3.5765946322989515, "survival_time": 59.99999999999873, "driven_lanedir": 3.5302995839808413, "in-drivable-lane": 0.09999999999999432, "deviation-heading": 4.432563578682058, "distance-from-start": 2.3586145958247235, "deviation-center-line": 5.5100948257029, "driven_lanedir_consec": 3.4606351955763963}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
155591423Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-testingsim-3of4successnodavinci-stage-04-6.2.510:08:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median49.74999999999931
in-drivable-lane_median1.0999999999999377
driven_lanedir_consec_median2.833004579842016
deviation-center-line_median4.613202410731162


other stats
deviation-center-line_max4.613202410731162
deviation-center-line_mean4.613202410731162
deviation-center-line_min4.613202410731162
deviation-heading_max2.4939487126008157
deviation-heading_mean2.4939487126008157
deviation-heading_median2.4939487126008157
deviation-heading_min2.4939487126008157
distance-from-start_max2.3401405715621477
distance-from-start_mean2.3401405715621477
distance-from-start_median2.3401405715621477
distance-from-start_min2.3401405715621477
driven_any_max2.889596956965826
driven_any_mean2.889596956965826
driven_any_median2.889596956965826
driven_any_min2.889596956965826
driven_lanedir_consec_max2.833004579842016
driven_lanedir_consec_mean2.833004579842016
driven_lanedir_consec_min2.833004579842016
driven_lanedir_max2.833004579842016
driven_lanedir_mean2.833004579842016
driven_lanedir_median2.833004579842016
driven_lanedir_min2.833004579842016
in-drivable-lane_max1.0999999999999377
in-drivable-lane_mean1.0999999999999377
in-drivable-lane_min1.0999999999999377
per-episodes
details{"4way-001-ego0": {"driven_any": 2.889596956965826, "survival_time": 49.74999999999931, "driven_lanedir": 2.833004579842016, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.4939487126008157, "distance-from-start": 2.3401405715621477, "deviation-center-line": 4.613202410731162, "driven_lanedir_consec": 2.833004579842016}}
simulation-passed1
survival_time_max49.74999999999931
survival_time_mean49.74999999999931
survival_time_min49.74999999999931
No reset possible
155541555Andrea Danieleexercises_braitenberglx22-BV1sim-1of5successnodavinci-stage-04-6.2.510:07:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d45-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
155481424Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-testingsim-0of4successnodavinci-stage-04-6.2.510:08:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.1499999999999257
driven_lanedir_consec_median3.3746337017701507
deviation-center-line_median6.057454700328478


other stats
deviation-center-line_max6.384332084814334
deviation-center-line_mean6.038904654854047
deviation-center-line_min5.656377133944901
deviation-heading_max7.471247478120028
deviation-heading_mean6.581525379111778
deviation-heading_median6.501228349070126
deviation-heading_min5.8523973401868306
distance-from-start_max2.955798853097406
distance-from-start_mean2.2776980078429148
distance-from-start_median2.4208015729281067
distance-from-start_min1.313390032418041
driven_any_max3.579593246505303
driven_any_mean3.529302881163586
driven_any_median3.515090515356918
driven_any_min3.5074372474352056
driven_lanedir_consec_max3.525823359544204
driven_lanedir_consec_mean3.062863916917712
driven_lanedir_consec_min1.9763649045863416
driven_lanedir_max3.525823359544204
driven_lanedir_mean3.4097663351344685
driven_lanedir_median3.3746337017701507
driven_lanedir_min3.3639745774533676
in-drivable-lane_max2.400000000000034
in-drivable-lane_mean1.6749999999999714
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.579593246505303, "survival_time": 59.99999999999873, "driven_lanedir": 3.525823359544204, "in-drivable-lane": 0.0, "deviation-heading": 6.822136240935285, "distance-from-start": 2.955798853097406, "deviation-center-line": 5.656377133944901, "driven_lanedir_consec": 3.525823359544204}, "autolab-000-ego1": {"driven_any": 3.5195908422465023, "survival_time": 59.99999999999873, "driven_lanedir": 3.384110905730893, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 7.471247478120028, "distance-from-start": 2.2087786070849105, "deviation-center-line": 5.794137771901705, "driven_lanedir_consec": 3.384110905730893}, "autolab-000-ego2": {"driven_any": 3.5074372474352056, "survival_time": 59.99999999999873, "driven_lanedir": 3.3639745774533676, "in-drivable-lane": 2.400000000000034, "deviation-heading": 5.8523973401868306, "distance-from-start": 1.313390032418041, "deviation-center-line": 6.320771628755251, "driven_lanedir_consec": 1.9763649045863416}, "autolab-000-ego3": {"driven_any": 3.5105901884673334, "survival_time": 59.99999999999873, "driven_lanedir": 3.365156497809408, "in-drivable-lane": 2.299999999999965, "deviation-heading": 6.180320457204967, "distance-from-start": 2.6328245387713025, "deviation-center-line": 6.384332084814334, "driven_lanedir_consec": 3.365156497809408}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
155441425Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-2of4successnodavinci-stage-04-6.2.510:06:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.099999999999845
driven_lanedir_consec_median3.2655265789104
deviation-center-line_median7.114511199103643


other stats
deviation-center-line_max7.114511199103643
deviation-center-line_mean7.114511199103643
deviation-center-line_min7.114511199103643
deviation-heading_max5.702635580930089
deviation-heading_mean5.702635580930089
deviation-heading_median5.702635580930089
deviation-heading_min5.702635580930089
distance-from-start_max1.6303678440695035
distance-from-start_mean1.6303678440695035
distance-from-start_median1.6303678440695035
distance-from-start_min1.6303678440695035
driven_any_max3.466336917289666
driven_any_mean3.466336917289666
driven_any_median3.466336917289666
driven_any_min3.466336917289666
driven_lanedir_consec_max3.2655265789104
driven_lanedir_consec_mean3.2655265789104
driven_lanedir_consec_min3.2655265789104
driven_lanedir_max3.2655265789104
driven_lanedir_mean3.2655265789104
driven_lanedir_median3.2655265789104
driven_lanedir_min3.2655265789104
in-drivable-lane_max4.099999999999845
in-drivable-lane_mean4.099999999999845
in-drivable-lane_min4.099999999999845
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.466336917289666, "survival_time": 59.99999999999873, "driven_lanedir": 3.2655265789104, "in-drivable-lane": 4.099999999999845, "deviation-heading": 5.702635580930089, "distance-from-start": 1.6303678440695035, "deviation-center-line": 7.114511199103643, "driven_lanedir_consec": 3.2655265789104}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
155391427Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-testingsim-0of4successnodavinci-stage-04-6.2.510:05:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.0000000000000284
driven_lanedir_consec_median2.275400628096487
deviation-center-line_median5.720691806105115


other stats
deviation-center-line_max5.720691806105115
deviation-center-line_mean5.720691806105115
deviation-center-line_min5.720691806105115
deviation-heading_max5.389911935102068
deviation-heading_mean5.389911935102068
deviation-heading_median5.389911935102068
deviation-heading_min5.389911935102068
distance-from-start_max1.706973798275489
distance-from-start_mean1.706973798275489
distance-from-start_median1.706973798275489
distance-from-start_min1.706973798275489
driven_any_max3.5195876689872945
driven_any_mean3.5195876689872945
driven_any_median3.5195876689872945
driven_any_min3.5195876689872945
driven_lanedir_consec_max2.275400628096487
driven_lanedir_consec_mean2.275400628096487
driven_lanedir_consec_min2.275400628096487
driven_lanedir_max3.387708520229716
driven_lanedir_mean3.387708520229716
driven_lanedir_median3.387708520229716
driven_lanedir_min3.387708520229716
in-drivable-lane_max2.0000000000000284
in-drivable-lane_mean2.0000000000000284
in-drivable-lane_min2.0000000000000284
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.5195876689872945, "survival_time": 59.99999999999873, "driven_lanedir": 3.387708520229716, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.389911935102068, "distance-from-start": 1.706973798275489, "deviation-center-line": 5.720691806105115, "driven_lanedir_consec": 2.275400628096487}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
155331430Bea Baselines 🐤minimal-agentaido-LFVI-sim-validationsim-1of4successnodavinci-stage-04-6.2.510:02:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.04999999999998
in-drivable-lane_median4.749999999999984
driven_lanedir_consec_median0.331229062365487
deviation-center-line_median0.26973530940385876


other stats
deviation-center-line_max0.26973530940385876
deviation-center-line_mean0.26973530940385876
deviation-center-line_min0.26973530940385876
deviation-heading_max2.5383505748046193
deviation-heading_mean2.5383505748046193
deviation-heading_median2.5383505748046193
deviation-heading_min2.5383505748046193
distance-from-start_max1.1587848457868677
distance-from-start_mean1.1587848457868677
distance-from-start_median1.1587848457868677
distance-from-start_min1.1587848457868677
driven_any_max1.158841900114123
driven_any_mean1.158841900114123
driven_any_median1.158841900114123
driven_any_min1.158841900114123
driven_lanedir_consec_max0.331229062365487
driven_lanedir_consec_mean0.331229062365487
driven_lanedir_consec_min0.331229062365487
driven_lanedir_max0.331229062365487
driven_lanedir_mean0.331229062365487
driven_lanedir_median0.331229062365487
driven_lanedir_min0.331229062365487
in-drivable-lane_max4.749999999999984
in-drivable-lane_mean4.749999999999984
in-drivable-lane_min4.749999999999984
per-episodes
details{"4way-000-ego0": {"driven_any": 1.158841900114123, "survival_time": 8.04999999999998, "driven_lanedir": 0.331229062365487, "in-drivable-lane": 4.749999999999984, "deviation-heading": 2.5383505748046193, "distance-from-start": 1.1587848457868677, "deviation-center-line": 0.26973530940385876, "driven_lanedir_consec": 0.331229062365487}}
simulation-passed1
survival_time_max8.04999999999998
survival_time_mean8.04999999999998
survival_time_min8.04999999999998
No reset possible
155201433Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-validationsim-0of4successnodavinci-stage-04-6.2.510:05:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median19.95000000000015
in-drivable-lane_median15.575000000000143
driven_lanedir_consec_median0.3010218083101922
deviation-center-line_median0.3970118868681207


other stats
deviation-center-line_max2.2346112831306932
deviation-center-line_mean0.7885775545340169
deviation-center-line_min0.12567516126913286
deviation-heading_max4.797258948144445
deviation-heading_mean2.707299691495644
deviation-heading_median2.642065173445396
deviation-heading_min0.7478094709473367
distance-from-start_max3.129125828735781
distance-from-start_mean1.1662292771696292
distance-from-start_median0.5771403828427081
distance-from-start_min0.3815105142573194
driven_any_max3.129843909463842
driven_any_mean1.166415544369201
driven_any_median0.5771503990770468
driven_any_min0.3815174698588687
driven_lanedir_consec_max0.7928447585809935
driven_lanedir_consec_mean0.3886457893287136
driven_lanedir_consec_min0.15969478211347665
driven_lanedir_max0.8014890585195535
driven_lanedir_mean0.39080686431335365
driven_lanedir_median0.3010218083101922
driven_lanedir_min0.15969478211347665
in-drivable-lane_max18.50000000000015
in-drivable-lane_mean12.412500000000112
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 0.3815174698588687, "survival_time": 19.95000000000015, "driven_lanedir": 0.199551480959018, "in-drivable-lane": 18.20000000000015, "deviation-heading": 0.9488219555580458, "distance-from-start": 0.3815105142573194, "deviation-center-line": 0.12567516126913286, "driven_lanedir_consec": 0.199551480959018}, "udem-000-ego1": {"driven_any": 0.7395025092531806, "survival_time": 19.95000000000015, "driven_lanedir": 0.15969478211347665, "in-drivable-lane": 18.50000000000015, "deviation-heading": 0.7478094709473367, "distance-from-start": 0.7394902813305423, "deviation-center-line": 0.13562525098197173, "driven_lanedir_consec": 0.15969478211347665}, "udem-000-ego2": {"driven_any": 0.41479828890091297, "survival_time": 19.95000000000015, "driven_lanedir": 0.4024921356613664, "in-drivable-lane": 0.0, "deviation-heading": 4.797258948144445, "distance-from-start": 0.4147904843548739, "deviation-center-line": 2.2346112831306932, "driven_lanedir_consec": 0.4024921356613664}, "udem-000-ego3": {"driven_any": 3.129843909463842, "survival_time": 19.95000000000015, "driven_lanedir": 0.8014890585195535, "in-drivable-lane": 12.95000000000014, "deviation-heading": 4.335308391332746, "distance-from-start": 3.129125828735781, "deviation-center-line": 0.6583985227542697, "driven_lanedir_consec": 0.7928447585809935}}
simulation-passed1
survival_time_max19.95000000000015
survival_time_mean19.95000000000015
survival_time_min19.95000000000015
No reset possible
154971437Bea Baselines 🐤minimal-agentlx22-objdetsimsuccessyesdavinci-stage-04-6.2.510:12:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
driven_lanedir_consec_median3.766385412387078


other stats
deviation-center-line_max1.326684653251739
deviation-center-line_mean1.1145360814864316
deviation-center-line_median1.1145360814864316
deviation-center-line_min0.9023875097211244
deviation-heading_max0.9653478875423056
deviation-heading_mean0.8614808538844678
deviation-heading_median0.8614808538844678
deviation-heading_min0.75761382022663
distance-from-start_max9.8511235402485
distance-from-start_mean9.83680867234296
distance-from-start_median9.83680867234296
distance-from-start_min9.822493804437425
driven_any_max9.857519753799252
driven_any_mean9.843192862723654
driven_any_median9.843192862723654
driven_any_min9.828865971648057
driven_lanedir_consec_max5.116504350759583
driven_lanedir_consec_mean3.766385412387078
driven_lanedir_consec_min2.416266474014573
driven_lanedir_max5.116504350759583
driven_lanedir_mean3.766385412387078
driven_lanedir_median3.766385412387078
driven_lanedir_min2.416266474014573
in-drivable-lane_max44.99999999999865
in-drivable-lane_mean36.82499999999853
in-drivable-lane_median36.82499999999853
in-drivable-lane_min28.649999999998418
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 9.857519753799252, "survival_time": 59.99999999999873, "driven_lanedir": 5.116504350759583, "in-drivable-lane": 28.649999999998418, "deviation-heading": 0.9653478875423056, "distance-from-start": 9.8511235402485, "deviation-center-line": 1.326684653251739, "driven_lanedir_consec": 5.116504350759583}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 9.828865971648057, "survival_time": 59.99999999999873, "driven_lanedir": 2.416266474014573, "in-drivable-lane": 44.99999999999865, "deviation-heading": 0.75761382022663, "distance-from-start": 9.822493804437425, "deviation-center-line": 0.9023875097211244, "driven_lanedir_consec": 2.416266474014573}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
154881447Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-3of4successnodavinci-stage-04-6.2.510:04:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.950000000000106
in-drivable-lane_median10.550000000000091
driven_lanedir_consec_median0.8098306254279477
deviation-center-line_median0.6056754982599343


other stats
deviation-center-line_max0.6056754982599343
deviation-center-line_mean0.6056754982599343
deviation-center-line_min0.6056754982599343
deviation-heading_max3.6841553172183903
deviation-heading_mean3.6841553172183903
deviation-heading_median3.6841553172183903
deviation-heading_min3.6841553172183903
distance-from-start_max2.628171879536872
distance-from-start_mean2.628171879536872
distance-from-start_median2.628171879536872
distance-from-start_min2.628171879536872
driven_any_max2.628857921604552
driven_any_mean2.628857921604552
driven_any_median2.628857921604552
driven_any_min2.628857921604552
driven_lanedir_consec_max0.8098306254279477
driven_lanedir_consec_mean0.8098306254279477
driven_lanedir_consec_min0.8098306254279477
driven_lanedir_max0.8098306254279477
driven_lanedir_mean0.8098306254279477
driven_lanedir_median0.8098306254279477
driven_lanedir_min0.8098306254279477
in-drivable-lane_max10.550000000000091
in-drivable-lane_mean10.550000000000091
in-drivable-lane_min10.550000000000091
per-episodes
details{"zigzag-000-ego0": {"driven_any": 2.628857921604552, "survival_time": 16.950000000000106, "driven_lanedir": 0.8098306254279477, "in-drivable-lane": 10.550000000000091, "deviation-heading": 3.6841553172183903, "distance-from-start": 2.628171879536872, "deviation-center-line": 0.6056754982599343, "driven_lanedir_consec": 0.8098306254279477}}
simulation-passed1
survival_time_max16.950000000000106
survival_time_mean16.950000000000106
survival_time_min16.950000000000106
No reset possible
154811448Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-1of4successnodavinci-stage-04-6.2.510:03:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.85000000000002
in-drivable-lane_median9.45000000000002
driven_lanedir_consec_median0.13666480491623645
deviation-center-line_median0.1078383533310603


other stats
deviation-center-line_max0.1078383533310603
deviation-center-line_mean0.1078383533310603
deviation-center-line_min0.1078383533310603
deviation-heading_max0.9508048428349388
deviation-heading_mean0.9508048428349388
deviation-heading_median0.9508048428349388
deviation-heading_min0.9508048428349388
distance-from-start_max1.6182798682575184
distance-from-start_mean1.6182798682575184
distance-from-start_median1.6182798682575184
distance-from-start_min1.6182798682575184
driven_any_max1.6183892771013868
driven_any_mean1.6183892771013868
driven_any_median1.6183892771013868
driven_any_min1.6183892771013868
driven_lanedir_consec_max0.13666480491623645
driven_lanedir_consec_mean0.13666480491623645
driven_lanedir_consec_min0.13666480491623645
driven_lanedir_max0.13666480491623645
driven_lanedir_mean0.13666480491623645
driven_lanedir_median0.13666480491623645
driven_lanedir_min0.13666480491623645
in-drivable-lane_max9.45000000000002
in-drivable-lane_mean9.45000000000002
in-drivable-lane_min9.45000000000002
per-episodes
details{"4way-000-ego0": {"driven_any": 1.6183892771013868, "survival_time": 10.85000000000002, "driven_lanedir": 0.13666480491623645, "in-drivable-lane": 9.45000000000002, "deviation-heading": 0.9508048428349388, "distance-from-start": 1.6182798682575184, "deviation-center-line": 0.1078383533310603, "driven_lanedir_consec": 0.13666480491623645}}
simulation-passed1
survival_time_max10.85000000000002
survival_time_mean10.85000000000002
survival_time_min10.85000000000002
No reset possible
154761450Bea Baselines 🐤minimal-agentaido-LF-sim-testingsim-3of4successnodavinci-stage-04-6.2.510:02:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3224736988087771
survival_time_median15.250000000000082
deviation-center-line_median0.2741150615740815
in-drivable-lane_median12.100000000000056


other stats
deviation-center-line_max0.2741150615740815
deviation-center-line_mean0.2741150615740815
deviation-center-line_min0.2741150615740815
deviation-heading_max2.486301423131022
deviation-heading_mean2.486301423131022
deviation-heading_median2.486301423131022
deviation-heading_min2.486301423131022
distance-from-start_max2.346684322024178
distance-from-start_mean2.346684322024178
distance-from-start_median2.346684322024178
distance-from-start_min2.346684322024178
driven_any_max2.3472858269950745
driven_any_mean2.3472858269950745
driven_any_median2.3472858269950745
driven_any_min2.3472858269950745
driven_lanedir_consec_max0.3224736988087771
driven_lanedir_consec_mean0.3224736988087771
driven_lanedir_consec_min0.3224736988087771
driven_lanedir_max0.3224736988087771
driven_lanedir_mean0.3224736988087771
driven_lanedir_median0.3224736988087771
driven_lanedir_min0.3224736988087771
in-drivable-lane_max12.100000000000056
in-drivable-lane_mean12.100000000000056
in-drivable-lane_min12.100000000000056
per-episodes
details{"zigzag-000-ego0": {"driven_any": 2.3472858269950745, "survival_time": 15.250000000000082, "driven_lanedir": 0.3224736988087771, "in-drivable-lane": 12.100000000000056, "deviation-heading": 2.486301423131022, "distance-from-start": 2.346684322024178, "deviation-center-line": 0.2741150615740815, "driven_lanedir_consec": 0.3224736988087771}}
simulation-passed1
survival_time_max15.250000000000082
survival_time_mean15.250000000000082
survival_time_min15.250000000000082
No reset possible
154691451Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-testingsim-1of4successnodavinci-stage-04-6.2.510:03:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.79999999999998
in-drivable-lane_median6.174999999999979
driven_lanedir_consec_median0.18712389148079245
deviation-center-line_median0.15973064632096934


other stats
deviation-center-line_max0.25956483782942774
deviation-center-line_mean0.17171613953350223
deviation-center-line_min0.1078384276626425
deviation-heading_max0.9508048428349388
deviation-heading_mean0.7378303653221978
deviation-heading_median0.7134396501489888
deviation-heading_min0.5736373181558746
distance-from-start_max1.1174703819521252
distance-from-start_mean0.5801993351597357
distance-from-start_median0.4397243952004576
distance-from-start_min0.323878168285902
driven_any_max1.1175260347648366
driven_any_mean0.5802187299655663
driven_any_median0.4397328577718137
driven_any_min0.3238831695538013
driven_lanedir_consec_max0.6843001798814146
driven_lanedir_consec_mean0.2932298736878741
driven_lanedir_consec_min0.11437153190849704
driven_lanedir_max0.6843001798814146
driven_lanedir_mean0.2932298736878741
driven_lanedir_median0.18712389148079245
driven_lanedir_min0.11437153190849704
in-drivable-lane_max6.59999999999998
in-drivable-lane_mean5.549999999999982
in-drivable-lane_min3.2499999999999885
per-episodes
details{"4way-000-ego0": {"driven_any": 0.5146585239873271, "survival_time": 7.79999999999998, "driven_lanedir": 0.13666599700910398, "in-drivable-lane": 6.39999999999998, "deviation-heading": 0.9508048428349388, "distance-from-start": 0.5146479428595184, "deviation-center-line": 0.1078384276626425, "driven_lanedir_consec": 0.13666599700910398}, "4way-000-ego1": {"driven_any": 0.3648071915563002, "survival_time": 7.79999999999998, "driven_lanedir": 0.23758178595248092, "in-drivable-lane": 5.94999999999998, "deviation-heading": 0.5736373181558746, "distance-from-start": 0.36480084754139674, "deviation-center-line": 0.20320962418622623, "driven_lanedir_consec": 0.23758178595248092}, "4way-000-ego2": {"driven_any": 1.1175260347648366, "survival_time": 7.79999999999998, "driven_lanedir": 0.6843001798814146, "in-drivable-lane": 3.2499999999999885, "deviation-heading": 0.6676943794629474, "distance-from-start": 1.1174703819521252, "deviation-center-line": 0.25956483782942774, "driven_lanedir_consec": 0.6843001798814146}, "4way-000-ego3": {"driven_any": 0.3238831695538013, "survival_time": 7.79999999999998, "driven_lanedir": 0.11437153190849704, "in-drivable-lane": 6.59999999999998, "deviation-heading": 0.7591849208350303, "distance-from-start": 0.323878168285902, "deviation-center-line": 0.11625166845571244, "driven_lanedir_consec": 0.11437153190849704}}
simulation-passed1
survival_time_max7.79999999999998
survival_time_mean7.79999999999998
survival_time_min7.79999999999998
No reset possible
154671452Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-testingsim-1of4successnodavinci-stage-04-6.2.510:05:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median14.200000000000069
in-drivable-lane_median11.000000000000057
driven_lanedir_consec_median0.3152938274760638
deviation-center-line_median0.26684016190284265


other stats
deviation-center-line_max0.3356902421161755
deviation-center-line_mean0.24640550413561532
deviation-center-line_min0.11625145062060036
deviation-heading_max2.486301423131022
deviation-heading_mean1.563252755154394
deviation-heading_median1.5495075837941936
deviation-heading_min0.6676944298981667
distance-from-start_max2.173942193160628
distance-from-start_mean1.5951256386014727
distance-from-start_median1.745851963918557
distance-from-start_min0.7148564334081484
driven_any_max2.174275713561512
driven_any_mean1.595266942374297
driven_any_median1.7459619017485188
driven_any_min0.7148682524386378
driven_lanedir_consec_max0.6842972359477595
driven_lanedir_consec_mean0.3573150593764172
driven_lanedir_consec_min0.11437534660578176
driven_lanedir_max0.6842972359477595
driven_lanedir_mean0.3573150593764172
driven_lanedir_median0.3152938274760638
driven_lanedir_min0.11437534660578176
in-drivable-lane_max13.000000000000068
in-drivable-lane_mean11.162500000000064
in-drivable-lane_min9.650000000000077
per-episodes
details{"loop-000-ego0": {"driven_any": 2.174275713561512, "survival_time": 14.200000000000069, "driven_lanedir": 0.3224767982503016, "in-drivable-lane": 11.050000000000042, "deviation-heading": 2.486301423131022, "distance-from-start": 2.173942193160628, "deviation-center-line": 0.27411484919814116, "driven_lanedir_consec": 0.3224767982503016}, "loop-000-ego1": {"driven_any": 1.7252690192462308, "survival_time": 14.200000000000069, "driven_lanedir": 0.30811085670182603, "in-drivable-lane": 10.95000000000007, "deviation-heading": 2.339830246753357, "distance-from-start": 1.7251591376367597, "deviation-center-line": 0.3356902421161755, "driven_lanedir_consec": 0.30811085670182603}, "loop-000-ego2": {"driven_any": 1.766654784250807, "survival_time": 14.200000000000069, "driven_lanedir": 0.6842972359477595, "in-drivable-lane": 9.650000000000077, "deviation-heading": 0.6676944298981667, "distance-from-start": 1.7665447902003542, "deviation-center-line": 0.2595654746075442, "driven_lanedir_consec": 0.6842972359477595}, "loop-000-ego3": {"driven_any": 0.7148682524386378, "survival_time": 14.200000000000069, "driven_lanedir": 0.11437534660578176, "in-drivable-lane": 13.000000000000068, "deviation-heading": 0.7591849208350301, "distance-from-start": 0.7148564334081484, "deviation-center-line": 0.11625145062060036, "driven_lanedir_consec": 0.11437534660578176}}
simulation-passed1
survival_time_max14.200000000000069
survival_time_mean14.200000000000069
survival_time_min14.200000000000069
No reset possible
154651453Bea Baselines 🐤minimal-agentaido-LFP-sim-testingsim-0of4successnodavinci-stage-04-6.2.510:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.14999999999999
in-drivable-lane_median3.74999999999999
driven_lanedir_consec_median0.13665955970746824
deviation-center-line_median0.10783802485851962


other stats
deviation-center-line_max0.10783802485851962
deviation-center-line_mean0.10783802485851962
deviation-center-line_min0.10783802485851962
deviation-heading_max0.9508048428349386
deviation-heading_mean0.9508048428349386
deviation-heading_median0.9508048428349386
deviation-heading_min0.9508048428349386
distance-from-start_max0.6813626821293306
distance-from-start_mean0.6813626821293306
distance-from-start_median0.6813626821293306
distance-from-start_min0.6813626821293306
driven_any_max0.6813744088473564
driven_any_mean0.6813744088473564
driven_any_median0.6813744088473564
driven_any_min0.6813744088473564
driven_lanedir_consec_max0.13665955970746824
driven_lanedir_consec_mean0.13665955970746824
driven_lanedir_consec_min0.13665955970746824
driven_lanedir_max0.13665955970746824
driven_lanedir_mean0.13665955970746824
driven_lanedir_median0.13665955970746824
driven_lanedir_min0.13665955970746824
in-drivable-lane_max3.74999999999999
in-drivable-lane_mean3.74999999999999
in-drivable-lane_min3.74999999999999
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.6813744088473564, "survival_time": 5.14999999999999, "driven_lanedir": 0.13665955970746824, "in-drivable-lane": 3.74999999999999, "deviation-heading": 0.9508048428349386, "distance-from-start": 0.6813626821293306, "deviation-center-line": 0.10783802485851962, "driven_lanedir_consec": 0.13665955970746824}}
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean5.14999999999999
survival_time_min5.14999999999999
No reset possible
154611453Bea Baselines 🐤minimal-agentaido-LFP-sim-testingsim-1of4successnodavinci-stage-04-6.2.510:02:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.85000000000002
in-drivable-lane_median9.45000000000002
driven_lanedir_consec_median0.13666480491623578
deviation-center-line_median0.10783813033632964


other stats
deviation-center-line_max0.10783813033632964
deviation-center-line_mean0.10783813033632964
deviation-center-line_min0.10783813033632964
deviation-heading_max0.9508048428349386
deviation-heading_mean0.9508048428349386
deviation-heading_median0.9508048428349386
deviation-heading_min0.9508048428349386
distance-from-start_max1.6182798682575148
distance-from-start_mean1.6182798682575148
distance-from-start_median1.6182798682575148
distance-from-start_min1.6182798682575148
driven_any_max1.618389277101394
driven_any_mean1.618389277101394
driven_any_median1.618389277101394
driven_any_min1.618389277101394
driven_lanedir_consec_max0.13666480491623578
driven_lanedir_consec_mean0.13666480491623578
driven_lanedir_consec_min0.13666480491623578
driven_lanedir_max0.13666480491623578
driven_lanedir_mean0.13666480491623578
driven_lanedir_median0.13666480491623578
driven_lanedir_min0.13666480491623578
in-drivable-lane_max9.45000000000002
in-drivable-lane_mean9.45000000000002
in-drivable-lane_min9.45000000000002
per-episodes
details{"loop-000-ego0": {"driven_any": 1.618389277101394, "survival_time": 10.85000000000002, "driven_lanedir": 0.13666480491623578, "in-drivable-lane": 9.45000000000002, "deviation-heading": 0.9508048428349386, "distance-from-start": 1.6182798682575148, "deviation-center-line": 0.10783813033632964, "driven_lanedir_consec": 0.13666480491623578}}
simulation-passed1
survival_time_max10.85000000000002
survival_time_mean10.85000000000002
survival_time_min10.85000000000002
No reset possible
154601454Bea Baselines 🐤template-pytorchaido-LFV-sim-validationsim-3of4successnodavinci-stage-04-6.2.510:02:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.6499999999999986
in-drivable-lane_median1.6999999999999984
driven_lanedir_consec_median0.0971575696065381
deviation-center-line_median0.04964386005899727


other stats
deviation-center-line_max0.04964386005899727
deviation-center-line_mean0.04964386005899727
deviation-center-line_min0.04964386005899727
deviation-heading_max0.7234086909095354
deviation-heading_mean0.7234086909095354
deviation-heading_median0.7234086909095354
deviation-heading_min0.7234086909095354
distance-from-start_max0.3930242685624512
distance-from-start_mean0.3930242685624512
distance-from-start_median0.3930242685624512
distance-from-start_min0.3930242685624512
driven_any_max0.4069524141440449
driven_any_mean0.4069524141440449
driven_any_median0.4069524141440449
driven_any_min0.4069524141440449
driven_lanedir_consec_max0.0971575696065381
driven_lanedir_consec_mean0.0971575696065381
driven_lanedir_consec_min0.0971575696065381
driven_lanedir_max0.0971575696065381
driven_lanedir_mean0.0971575696065381
driven_lanedir_median0.0971575696065381
driven_lanedir_min0.0971575696065381
in-drivable-lane_max1.6999999999999984
in-drivable-lane_mean1.6999999999999984
in-drivable-lane_min1.6999999999999984
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.4069524141440449, "survival_time": 2.6499999999999986, "driven_lanedir": 0.0971575696065381, "in-drivable-lane": 1.6999999999999984, "deviation-heading": 0.7234086909095354, "distance-from-start": 0.3930242685624512, "deviation-center-line": 0.04964386005899727, "driven_lanedir_consec": 0.0971575696065381}}
simulation-passed1
survival_time_max2.6499999999999986
survival_time_mean2.6499999999999986
survival_time_min2.6499999999999986
No reset possible
154491456Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-1of4successnodavinci-stage-04-6.2.510:10:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median44.84999999999938
driven_lanedir_consec_median1.529346060424126
deviation-center-line_median1.3712877373027537


other stats
deviation-center-line_max1.3712877373027537
deviation-center-line_mean1.3712877373027537
deviation-center-line_min1.3712877373027537
deviation-heading_max10.615162620956278
deviation-heading_mean10.615162620956278
deviation-heading_median10.615162620956278
deviation-heading_min10.615162620956278
distance-from-start_max0.36627249828646713
distance-from-start_mean0.36627249828646713
distance-from-start_median0.36627249828646713
distance-from-start_min0.36627249828646713
driven_any_max8.898160469131158
driven_any_mean8.898160469131158
driven_any_median8.898160469131158
driven_any_min8.898160469131158
driven_lanedir_consec_max1.529346060424126
driven_lanedir_consec_mean1.529346060424126
driven_lanedir_consec_min1.529346060424126
driven_lanedir_max1.529346060424126
driven_lanedir_mean1.529346060424126
driven_lanedir_median1.529346060424126
driven_lanedir_min1.529346060424126
in-drivable-lane_max44.84999999999938
in-drivable-lane_mean44.84999999999938
in-drivable-lane_min44.84999999999938
per-episodes
details{"udem1-000-ego0": {"driven_any": 8.898160469131158, "survival_time": 59.99999999999873, "driven_lanedir": 1.529346060424126, "in-drivable-lane": 44.84999999999938, "deviation-heading": 10.615162620956278, "distance-from-start": 0.36627249828646713, "deviation-center-line": 1.3712877373027537, "driven_lanedir_consec": 1.529346060424126}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
154451457Bea Baselines 🐤template-pytorchaido-LF-sim-validationsim-1of4successnodavinci-stage-04-6.2.510:04:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1554826936813305
survival_time_median19.650000000000144
deviation-center-line_median0.13511342005875163
in-drivable-lane_median18.150000000000137


other stats
deviation-center-line_max0.13511342005875163
deviation-center-line_mean0.13511342005875163
deviation-center-line_min0.13511342005875163
deviation-heading_max0.9924533579045408
deviation-heading_mean0.9924533579045408
deviation-heading_median0.9924533579045408
deviation-heading_min0.9924533579045408
distance-from-start_max0.7350157839368916
distance-from-start_mean0.7350157839368916
distance-from-start_median0.7350157839368916
distance-from-start_min0.7350157839368916
driven_any_max3.5435978836301065
driven_any_mean3.5435978836301065
driven_any_median3.5435978836301065
driven_any_min3.5435978836301065
driven_lanedir_consec_max0.1554826936813305
driven_lanedir_consec_mean0.1554826936813305
driven_lanedir_consec_min0.1554826936813305
driven_lanedir_max0.1554826936813305
driven_lanedir_mean0.1554826936813305
driven_lanedir_median0.1554826936813305
driven_lanedir_min0.1554826936813305
in-drivable-lane_max18.150000000000137
in-drivable-lane_mean18.150000000000137
in-drivable-lane_min18.150000000000137
per-episodes
details{"loop-000-ego0": {"driven_any": 3.5435978836301065, "survival_time": 19.650000000000144, "driven_lanedir": 0.1554826936813305, "in-drivable-lane": 18.150000000000137, "deviation-heading": 0.9924533579045408, "distance-from-start": 0.7350157839368916, "deviation-center-line": 0.13511342005875163, "driven_lanedir_consec": 0.1554826936813305}}
simulation-passed1
survival_time_max19.650000000000144
survival_time_mean19.650000000000144
survival_time_min19.650000000000144
No reset possible
154401554Andrea Danieleexercises_braitenberglx22-BV1sim-1of5successnodavinci-stage-04-6.2.510:08:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d45-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
154391457Bea Baselines 🐤template-pytorchaido-LF-sim-validationsim-2of4successnodavinci-stage-04-6.2.510:06:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.42315280295927626
survival_time_median59.99999999999873
deviation-center-line_median1.408632447137759
in-drivable-lane_median44.899999999999075


other stats
deviation-center-line_max1.408632447137759
deviation-center-line_mean1.408632447137759
deviation-center-line_min1.408632447137759
deviation-heading_max13.313770539613213
deviation-heading_mean13.313770539613213
deviation-heading_median13.313770539613213
deviation-heading_min13.313770539613213
distance-from-start_max0.6533800035089757
distance-from-start_mean0.6533800035089757
distance-from-start_median0.6533800035089757
distance-from-start_min0.6533800035089757
driven_any_max10.595376871147598
driven_any_mean10.595376871147598
driven_any_median10.595376871147598
driven_any_min10.595376871147598
driven_lanedir_consec_max0.42315280295927626
driven_lanedir_consec_mean0.42315280295927626
driven_lanedir_consec_min0.42315280295927626
driven_lanedir_max1.5581345723328557
driven_lanedir_mean1.5581345723328557
driven_lanedir_median1.5581345723328557
driven_lanedir_min1.5581345723328557
in-drivable-lane_max44.899999999999075
in-drivable-lane_mean44.899999999999075
in-drivable-lane_min44.899999999999075
per-episodes
details{"loop2-000-ego0": {"driven_any": 10.595376871147598, "survival_time": 59.99999999999873, "driven_lanedir": 1.5581345723328557, "in-drivable-lane": 44.899999999999075, "deviation-heading": 13.313770539613213, "distance-from-start": 0.6533800035089757, "deviation-center-line": 1.408632447137759, "driven_lanedir_consec": 0.42315280295927626}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
154381458Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-2of4successnodavinci-stage-04-6.2.510:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
154371458Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-1of4host-errornodavinci-stage-04-6.2.510:02:04
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 390, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.model = DDPG(state_dim=self.preprocessor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/submission/model.py", line 153, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 390, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.model = DDPG(state_dim=self.preprocessor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/submission/model.py", line 153, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
154341459Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-validationsim-2of4successnodavinci-stage-04-6.2.510:10:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median45.49999999999911
driven_lanedir_consec_median1.3961645019130744
deviation-center-line_median1.3881463058026138


other stats
deviation-center-line_max2.6878708487922536
deviation-center-line_mean1.3881463058026138
deviation-center-line_min0.08842176281297408
deviation-heading_max18.48880214202066
deviation-heading_mean9.55366900088886
deviation-heading_median9.55366900088886
deviation-heading_min0.6185358597570592
distance-from-start_max1.0836623357430886
distance-from-start_mean0.6967994275543938
distance-from-start_median0.6967994275543938
distance-from-start_min0.30993651936569916
driven_any_max7.1062142492419955
driven_any_mean3.709432803093973
driven_any_median3.709432803093973
driven_any_min0.31265135694595036
driven_lanedir_consec_max2.6639730304366047
driven_lanedir_consec_mean1.3961645019130744
driven_lanedir_consec_min0.12835597338954408
driven_lanedir_max2.6639730304366047
driven_lanedir_mean1.3961645019130744
driven_lanedir_median1.3961645019130744
driven_lanedir_min0.12835597338954408
in-drivable-lane_max58.94999999999872
in-drivable-lane_mean45.49999999999911
in-drivable-lane_min32.0499999999995
per-episodes
details{"loop2-000-ego0": {"driven_any": 7.1062142492419955, "survival_time": 59.99999999999873, "driven_lanedir": 2.6639730304366047, "in-drivable-lane": 32.0499999999995, "deviation-heading": 18.48880214202066, "distance-from-start": 1.0836623357430886, "deviation-center-line": 2.6878708487922536, "driven_lanedir_consec": 2.6639730304366047}, "loop2-000-ego1": {"driven_any": 0.31265135694595036, "survival_time": 59.99999999999873, "driven_lanedir": 0.12835597338954408, "in-drivable-lane": 58.94999999999872, "deviation-heading": 0.6185358597570592, "distance-from-start": 0.30993651936569916, "deviation-center-line": 0.08842176281297408, "driven_lanedir_consec": 0.12835597338954408}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
154281460Bea Baselines 🐤template-pytorchaido-LFP-sim-validationsim-0of4successnodavinci-stage-04-6.2.510:09:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median56.44999999999874
driven_lanedir_consec_median0.18305529659459577
deviation-center-line_median0.23899269006304477


other stats
deviation-center-line_max0.23899269006304477
deviation-center-line_mean0.23899269006304477
deviation-center-line_min0.23899269006304477
deviation-heading_max2.8398737934878695
deviation-heading_mean2.8398737934878695
deviation-heading_median2.8398737934878695
deviation-heading_min2.8398737934878695
distance-from-start_max0.976645522115132
distance-from-start_mean0.976645522115132
distance-from-start_median0.976645522115132
distance-from-start_min0.976645522115132
driven_any_max6.574021381337734
driven_any_mean6.574021381337734
driven_any_median6.574021381337734
driven_any_min6.574021381337734
driven_lanedir_consec_max0.18305529659459577
driven_lanedir_consec_mean0.18305529659459577
driven_lanedir_consec_min0.18305529659459577
driven_lanedir_max0.18305529659459577
driven_lanedir_mean0.18305529659459577
driven_lanedir_median0.18305529659459577
driven_lanedir_min0.18305529659459577
in-drivable-lane_max56.44999999999874
in-drivable-lane_mean56.44999999999874
in-drivable-lane_min56.44999999999874
per-episodes
details{"autolab-000-ego0": {"driven_any": 6.574021381337734, "survival_time": 59.99999999999873, "driven_lanedir": 0.18305529659459577, "in-drivable-lane": 56.44999999999874, "deviation-heading": 2.8398737934878695, "distance-from-start": 0.976645522115132, "deviation-center-line": 0.23899269006304477, "driven_lanedir_consec": 0.18305529659459577}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
154271460Bea Baselines 🐤template-pytorchaido-LFP-sim-validationsim-1of4successnodavinci-stage-04-6.2.510:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.25
in-drivable-lane_median1.1499999999999997
driven_lanedir_consec_median0.12248439126934808
deviation-center-line_median0.06884214821091866


other stats
deviation-center-line_max0.06884214821091866
deviation-center-line_mean0.06884214821091866
deviation-center-line_min0.06884214821091866
deviation-heading_max0.7945753899590251
deviation-heading_mean0.7945753899590251
deviation-heading_median0.7945753899590251
deviation-heading_min0.7945753899590251
distance-from-start_max0.24779518037486783
distance-from-start_mean0.24779518037486783
distance-from-start_median0.24779518037486783
distance-from-start_min0.24779518037486783
driven_any_max0.25943731488648497
driven_any_mean0.25943731488648497
driven_any_median0.25943731488648497
driven_any_min0.25943731488648497
driven_lanedir_consec_max0.12248439126934808
driven_lanedir_consec_mean0.12248439126934808
driven_lanedir_consec_min0.12248439126934808
driven_lanedir_max0.12248439126934808
driven_lanedir_mean0.12248439126934808
driven_lanedir_median0.12248439126934808
driven_lanedir_min0.12248439126934808
in-drivable-lane_max1.1499999999999997
in-drivable-lane_mean1.1499999999999997
in-drivable-lane_min1.1499999999999997
per-episodes
details{"loop-000-ego0": {"driven_any": 0.25943731488648497, "survival_time": 2.25, "driven_lanedir": 0.12248439126934808, "in-drivable-lane": 1.1499999999999997, "deviation-heading": 0.7945753899590251, "distance-from-start": 0.24779518037486783, "deviation-center-line": 0.06884214821091866, "driven_lanedir_consec": 0.12248439126934808}}
simulation-passed1
survival_time_max2.25
survival_time_mean2.25
survival_time_min2.25
No reset possible
154211465Bea Baselines 🐤template-pytorchlx22-BV1sim-3of5successnodavinci-stage-04-6.2.510:07:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.2084303266753938


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.2084303266753938
distance-from-start_median0.2084303266753938
distance-from-start_min0.2084303266753938
driven_any_max4.748912990059565
driven_any_mean4.748912990059565
driven_any_median4.748912990059565
driven_any_min4.748912990059565
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max50.199999999999285
in-drivable-lane_mean50.199999999999285
in-drivable-lane_median50.199999999999285
in-drivable-lane_min50.199999999999285
per-episodes
details{"d50-ego0": {"driven_any": 4.748912990059565, "survival_time": 50.199999999999285, "driven_lanedir": 0.0, "in-drivable-lane": 50.199999999999285, "deviation-heading": 0.0, "distance-from-start": 0.2084303266753938, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max50.199999999999285
survival_time_mean50.199999999999285
survival_time_median50.199999999999285
survival_time_min50.199999999999285
No reset possible
154181465Bea Baselines 🐤template-pytorchlx22-BV1sim-1of5successnodavinci-stage-04-6.2.510:02:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.5698308375055094


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.5698308375055094
distance-from-start_median0.5698308375055094
distance-from-start_min0.5698308375055094
driven_any_max1.9628907079120048
driven_any_mean1.9628907079120048
driven_any_median1.9628907079120048
driven_any_min1.9628907079120048
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max11.750000000000032
in-drivable-lane_mean11.750000000000032
in-drivable-lane_median11.750000000000032
in-drivable-lane_min11.750000000000032
per-episodes
details{"d45-ego0": {"driven_any": 1.9628907079120048, "survival_time": 11.750000000000032, "driven_lanedir": 0.0, "in-drivable-lane": 11.750000000000032, "deviation-heading": 0.0, "distance-from-start": 0.5698308375055094, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max11.750000000000032
survival_time_mean11.750000000000032
survival_time_median11.750000000000032
survival_time_min11.750000000000032
No reset possible
154171468Bea Baselines 🐤template-pytorchaido-hello-sim-validationsanity-checksuccessnodavinci-stage-04-6.2.510:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.024346144257733737
deviation-center-line_median0.005601787298636326


other stats
deviation-center-line_max0.005601787298636326
deviation-center-line_mean0.005601787298636326
deviation-center-line_min0.005601787298636326
deviation-heading_max0.3075269285536246
deviation-heading_mean0.3075269285536246
deviation-heading_median0.3075269285536246
deviation-heading_min0.3075269285536246
distance-from-start_max0.03213992781469227
distance-from-start_mean0.03213992781469227
distance-from-start_median0.03213992781469227
distance-from-start_min0.03213992781469227
driven_any_max0.03228338218125903
driven_any_mean0.03228338218125903
driven_any_median0.03228338218125903
driven_any_min0.03228338218125903
driven_lanedir_consec_max0.024346144257733737
driven_lanedir_consec_mean0.024346144257733737
driven_lanedir_consec_min0.024346144257733737
driven_lanedir_max0.024346144257733737
driven_lanedir_mean0.024346144257733737
driven_lanedir_median0.024346144257733737
driven_lanedir_min0.024346144257733737
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.03228338218125903, "survival_time": 0.49999999999999994, "driven_lanedir": 0.024346144257733737, "in-drivable-lane": 0.0, "deviation-heading": 0.3075269285536246, "distance-from-start": 0.03213992781469227, "deviation-center-line": 0.005601787298636326, "driven_lanedir_consec": 0.024346144257733737}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
154161472Bea Baselines 🐤template-pytorchaido-LFV-sim-testingsim-1of4successnodavinci-stage-04-6.2.510:04:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.750000000000018
in-drivable-lane_median8.450000000000014
driven_lanedir_consec_median0.18147256668197095
deviation-center-line_median0.12751849722524336


other stats
deviation-center-line_max0.12751849722524336
deviation-center-line_mean0.12751849722524336
deviation-center-line_min0.12751849722524336
deviation-heading_max1.7967143922263558
deviation-heading_mean1.7967143922263558
deviation-heading_median1.7967143922263558
deviation-heading_min1.7967143922263558
distance-from-start_max0.26174093482115174
distance-from-start_mean0.26174093482115174
distance-from-start_median0.26174093482115174
distance-from-start_min0.26174093482115174
driven_any_max1.539262520351819
driven_any_mean1.539262520351819
driven_any_median1.539262520351819
driven_any_min1.539262520351819
driven_lanedir_consec_max0.18147256668197095
driven_lanedir_consec_mean0.18147256668197095
driven_lanedir_consec_min0.18147256668197095
driven_lanedir_max0.1904001505109525
driven_lanedir_mean0.1904001505109525
driven_lanedir_median0.1904001505109525
driven_lanedir_min0.1904001505109525
in-drivable-lane_max8.450000000000014
in-drivable-lane_mean8.450000000000014
in-drivable-lane_min8.450000000000014
per-episodes
details{"loop-000-ego0": {"driven_any": 1.539262520351819, "survival_time": 10.750000000000018, "driven_lanedir": 0.1904001505109525, "in-drivable-lane": 8.450000000000014, "deviation-heading": 1.7967143922263558, "distance-from-start": 0.26174093482115174, "deviation-center-line": 0.12751849722524336, "driven_lanedir_consec": 0.18147256668197095}}
simulation-passed1
survival_time_max10.750000000000018
survival_time_mean10.750000000000018
survival_time_min10.750000000000018
No reset possible
154031476Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-testingsim-1of4successnodavinci-stage-04-6.2.510:20:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median55.674999999998704
driven_lanedir_consec_median0.34576508967272135
deviation-center-line_median0.4212636353185951


other stats
deviation-center-line_max2.226508144491143
deviation-center-line_mean0.770122700873575
deviation-center-line_min0.01145538836596703
deviation-heading_max23.084689815717837
deviation-heading_mean7.605001802191307
deviation-heading_median3.417810225872243
deviation-heading_min0.4996969413029039
distance-from-start_max0.8570185958165677
distance-from-start_mean0.3800993957188042
distance-from-start_median0.30312974807551174
distance-from-start_min0.05711949090762563
driven_any_max8.78556473364672
driven_any_mean3.216947456801634
driven_any_median2.007927131663458
driven_any_min0.06637083023290166
driven_lanedir_consec_max1.122738474446361
driven_lanedir_consec_mean0.4594957253294219
driven_lanedir_consec_min0.023714247525883803
driven_lanedir_max3.227276262693847
driven_lanedir_mean1.1137683155817033
driven_lanedir_median0.6020413760535415
driven_lanedir_min0.023714247525883803
in-drivable-lane_max59.09999999999873
in-drivable-lane_mean49.587499999998954
in-drivable-lane_min27.89999999999969
per-episodes
details{"4way-000-ego0": {"driven_any": 3.9307985684892457, "survival_time": 59.99999999999873, "driven_lanedir": 1.16888774585345, "in-drivable-lane": 52.34999999999869, "deviation-heading": 6.146991917106684, "distance-from-start": 0.8570185958165677, "deviation-center-line": 0.7650969769065914, "driven_lanedir_consec": 1.122738474446361}, "4way-000-ego1": {"driven_any": 0.06637083023290166, "survival_time": 59.99999999999873, "driven_lanedir": 0.03519500625363303, "in-drivable-lane": 58.99999999999873, "deviation-heading": 0.6886285346378023, "distance-from-start": 0.05711949090762563, "deviation-center-line": 0.07743029373059884, "driven_lanedir_consec": 0.03519500625363303}, "4way-000-ego2": {"driven_any": 0.08505569483767053, "survival_time": 59.99999999999873, "driven_lanedir": 0.023714247525883803, "in-drivable-lane": 59.09999999999873, "deviation-heading": 0.4996969413029039, "distance-from-start": 0.06573359087221857, "deviation-center-line": 0.01145538836596703, "driven_lanedir_consec": 0.023714247525883803}, "4way-000-ego3": {"driven_any": 8.78556473364672, "survival_time": 59.99999999999873, "driven_lanedir": 3.227276262693847, "in-drivable-lane": 27.89999999999969, "deviation-heading": 23.084689815717837, "distance-from-start": 0.540525905278805, "deviation-center-line": 2.226508144491143, "driven_lanedir_consec": 0.6563351730918097}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
153941477Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-testingsim-1of4successnodavinci-stage-04-6.2.510:23:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median53.04999999999875
driven_lanedir_consec_median0.7065503830623663
deviation-center-line_median0.622524662243883


other stats
deviation-center-line_max1.814263494544616
deviation-center-line_mean0.800131638600073
deviation-center-line_min0.14121373536790982
deviation-heading_max23.62094815322469
deviation-heading_mean8.235755761821371
deviation-heading_median4.398053628810916
deviation-heading_min0.5259676364389662
distance-from-start_max1.0637662959747425
distance-from-start_mean0.8323455476115962
distance-from-start_median0.7791274544945619
distance-from-start_min0.7073609854825181
driven_any_max8.07258431686075
driven_any_mean4.666715695947609
driven_any_median4.940029362755562
driven_any_min0.7142197414185635
driven_lanedir_consec_max1.05616264157413
driven_lanedir_consec_mean0.7063279409685325
driven_lanedir_consec_min0.3560483561752674
driven_lanedir_max1.4306356252348538
driven_lanedir_mean0.8102659708776969
driven_lanedir_median0.7271899510503332
driven_lanedir_min0.3560483561752674
in-drivable-lane_max57.79999999999873
in-drivable-lane_mean48.699999999998894
in-drivable-lane_min30.89999999999933
per-episodes
details{"loop-000-ego0": {"driven_any": 5.141657251181424, "survival_time": 59.99999999999873, "driven_lanedir": 0.3560483561752674, "in-drivable-lane": 56.84999999999873, "deviation-heading": 2.06283609837067, "distance-from-start": 0.8242461902335529, "deviation-center-line": 0.21943301039844784, "driven_lanedir_consec": 0.3560483561752674}, "loop-000-ego1": {"driven_any": 4.738401474329699, "survival_time": 59.99999999999873, "driven_lanedir": 1.05616264157413, "in-drivable-lane": 30.89999999999933, "deviation-heading": 23.62094815322469, "distance-from-start": 0.7340087187555708, "deviation-center-line": 1.814263494544616, "driven_lanedir_consec": 1.05616264157413}, "loop-000-ego2": {"driven_any": 0.7142197414185635, "survival_time": 59.99999999999873, "driven_lanedir": 0.3982172605265366, "in-drivable-lane": 57.79999999999873, "deviation-heading": 0.5259676364389662, "distance-from-start": 0.7073609854825181, "deviation-center-line": 0.14121373536790982, "driven_lanedir_consec": 0.3982172605265366}, "loop-000-ego3": {"driven_any": 8.07258431686075, "survival_time": 59.99999999999873, "driven_lanedir": 1.4306356252348538, "in-drivable-lane": 49.24999999999877, "deviation-heading": 6.733271159251163, "distance-from-start": 1.0637662959747425, "deviation-center-line": 1.0256163140893182, "driven_lanedir_consec": 1.014883505598196}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
153851479Bea Baselines 🐤template-randomaido-LFV-sim-validationsim-3of4successnodavinci-stage-04-6.2.510:15:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median48.69999999999937
in-drivable-lane_median36.64999999999927
driven_lanedir_consec_median0.27329071924012593
deviation-center-line_median0.8940598330260409


other stats
deviation-center-line_max0.8940598330260409
deviation-center-line_mean0.8940598330260409
deviation-center-line_min0.8940598330260409
deviation-heading_max9.653852545002117
deviation-heading_mean9.653852545002117
deviation-heading_median9.653852545002117
deviation-heading_min9.653852545002117
distance-from-start_max1.1351054760255814
distance-from-start_mean1.1351054760255814
distance-from-start_median1.1351054760255814
distance-from-start_min1.1351054760255814
driven_any_max12.221812291295889
driven_any_mean12.221812291295889
driven_any_median12.221812291295889
driven_any_min12.221812291295889
driven_lanedir_consec_max0.27329071924012593
driven_lanedir_consec_mean0.27329071924012593
driven_lanedir_consec_min0.27329071924012593
driven_lanedir_max0.26112935377464863
driven_lanedir_mean0.26112935377464863
driven_lanedir_median0.26112935377464863
driven_lanedir_min0.26112935377464863
in-drivable-lane_max36.64999999999927
in-drivable-lane_mean36.64999999999927
in-drivable-lane_min36.64999999999927
per-episodes
details{"zigzag-000-ego0": {"driven_any": 12.221812291295889, "survival_time": 48.69999999999937, "driven_lanedir": 0.26112935377464863, "in-drivable-lane": 36.64999999999927, "deviation-heading": 9.653852545002117, "distance-from-start": 1.1351054760255814, "deviation-center-line": 0.8940598330260409, "driven_lanedir_consec": 0.27329071924012593}}
simulation-passed1
survival_time_max48.69999999999937
survival_time_mean48.69999999999937
survival_time_min48.69999999999937
No reset possible
153791481Bea Baselines 🐤template-randomaido-LFI-sim-validationsim-0of4successnodavinci-stage-04-6.2.510:02:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.7499999999999942
in-drivable-lane_median0.9
driven_lanedir_consec_median0.3901743521234762
deviation-center-line_median0.17124897035562428


other stats
deviation-center-line_max0.17124897035562428
deviation-center-line_mean0.17124897035562428
deviation-center-line_min0.17124897035562428
deviation-heading_max1.70314180472416
deviation-heading_mean1.70314180472416
deviation-heading_median1.70314180472416
deviation-heading_min1.70314180472416
distance-from-start_max0.4028556303039793
distance-from-start_mean0.4028556303039793
distance-from-start_median0.4028556303039793
distance-from-start_min0.4028556303039793
driven_any_max0.42407645028397256
driven_any_mean0.42407645028397256
driven_any_median0.42407645028397256
driven_any_min0.42407645028397256
driven_lanedir_consec_max0.3901743521234762
driven_lanedir_consec_mean0.3901743521234762
driven_lanedir_consec_min0.3901743521234762
driven_lanedir_max0.3901743521234762
driven_lanedir_mean0.3901743521234762
driven_lanedir_median0.3901743521234762
driven_lanedir_min0.3901743521234762
in-drivable-lane_max0.9
in-drivable-lane_mean0.9
in-drivable-lane_min0.9
per-episodes
details{"4way-000-ego0": {"driven_any": 0.42407645028397256, "survival_time": 3.7499999999999942, "driven_lanedir": 0.3901743521234762, "in-drivable-lane": 0.9, "deviation-heading": 1.70314180472416, "distance-from-start": 0.4028556303039793, "deviation-center-line": 0.17124897035562428, "driven_lanedir_consec": 0.3901743521234762}}
simulation-passed1
survival_time_max3.7499999999999942
survival_time_mean3.7499999999999942
survival_time_min3.7499999999999942
No reset possible
153771481Bea Baselines 🐤template-randomaido-LFI-sim-validationsim-3of4successnodavinci-stage-04-6.2.510:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
153701483Bea Baselines 🐤template-randomaido-LFVI_multi-sim-validationsim-1of4successnodavinci-stage-04-6.2.510:15:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median43.29999999999968
in-drivable-lane_median35.19999999999969
driven_lanedir_consec_median0.1481685404123385
deviation-center-line_median0.6130052941053471


other stats
deviation-center-line_max6.361236990588696
deviation-center-line_mean1.968961967548878
deviation-center-line_min0.28860029139612103
deviation-heading_max22.59467278731015
deviation-heading_mean9.325639720688413
deviation-heading_median6.178891513015082
deviation-heading_min2.350103069413334
distance-from-start_max1.0093404360059293
distance-from-start_mean0.6788871313560756
distance-from-start_median0.651676229557197
distance-from-start_min0.40285563030397936
driven_any_max10.522906217249696
driven_any_mean4.533111394485939
driven_any_median3.592731455205004
driven_any_min0.4240764502840531
driven_lanedir_consec_max0.3902130173718561
driven_lanedir_consec_mean0.1975964492168203
driven_lanedir_consec_min0.10383569867074804
driven_lanedir_max0.3902130173718561
driven_lanedir_mean0.18988251265665312
driven_lanedir_median0.1348795225002798
driven_lanedir_min0.09955798825419682
in-drivable-lane_max39.84999999999967
in-drivable-lane_mean27.787499999999763
in-drivable-lane_min0.9
per-episodes
details{"4way-000-ego0": {"driven_any": 0.4240764502840531, "survival_time": 43.29999999999968, "driven_lanedir": 0.3902130173718561, "in-drivable-lane": 0.9, "deviation-heading": 22.59467278731015, "distance-from-start": 0.40285563030397936, "deviation-center-line": 6.361236990588696, "driven_lanedir_consec": 0.3902130173718561}, "4way-000-ego1": {"driven_any": 10.522906217249696, "survival_time": 43.29999999999968, "driven_lanedir": 0.13630120329834927, "in-drivable-lane": 32.44999999999972, "deviation-heading": 9.32828495552219, "distance-from-start": 1.0093404360059293, "deviation-center-line": 0.7830123872563919, "driven_lanedir_consec": 0.14963153086450776}, "4way-000-ego2": {"driven_any": 4.117732239446985, "survival_time": 43.29999999999968, "driven_lanedir": 0.1334578417022103, "in-drivable-lane": 37.94999999999966, "deviation-heading": 3.0294980705079753, "distance-from-start": 0.6736010379604934, "deviation-center-line": 0.4429982009543024, "driven_lanedir_consec": 0.14670554996016927}, "4way-000-ego3": {"driven_any": 3.067730670963023, "survival_time": 43.29999999999968, "driven_lanedir": 0.09955798825419682, "in-drivable-lane": 39.84999999999967, "deviation-heading": 2.350103069413334, "distance-from-start": 0.6297514211539005, "deviation-center-line": 0.28860029139612103, "driven_lanedir_consec": 0.10383569867074804}}
simulation-passed1
survival_time_max43.29999999999968
survival_time_mean43.29999999999968
survival_time_min43.29999999999968
No reset possible
153641484Bea Baselines 🐤template-randomaido-LFV_multi-sim-validationsim-2of4successnodavinci-stage-04-6.2.510:08:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median45.099999999999575
in-drivable-lane_median37.09999999999956
driven_lanedir_consec_median0.23705557260553295
deviation-center-line_median0.6463758558852182


other stats
deviation-center-line_max0.7555292890833561
deviation-center-line_mean0.6463758558852182
deviation-center-line_min0.5372224226870801
deviation-heading_max5.523299123594233
deviation-heading_mean5.0377292657796975
deviation-heading_median5.0377292657796975
deviation-heading_min4.552159407965162
distance-from-start_max1.0442247976691843
distance-from-start_mean0.9534278048696496
distance-from-start_median0.9534278048696496
distance-from-start_min0.8626308120701148
driven_any_max11.376062002465083
driven_any_mean9.15341861992026
driven_any_median9.15341861992026
driven_any_min6.9307752373754345
driven_lanedir_consec_max0.26764947507969805
driven_lanedir_consec_mean0.23705557260553295
driven_lanedir_consec_min0.20646167013136785
driven_lanedir_max0.2496387990426845
driven_lanedir_mean0.2213862628967403
driven_lanedir_median0.2213862628967403
driven_lanedir_min0.1931337267507961
in-drivable-lane_max37.649999999999565
in-drivable-lane_mean37.09999999999956
in-drivable-lane_min36.54999999999956
per-episodes
details{"loop2-000-ego0": {"driven_any": 11.376062002465083, "survival_time": 45.099999999999575, "driven_lanedir": 0.2496387990426845, "in-drivable-lane": 36.54999999999956, "deviation-heading": 5.523299123594233, "distance-from-start": 1.0442247976691843, "deviation-center-line": 0.7555292890833561, "driven_lanedir_consec": 0.26764947507969805}, "loop2-000-ego1": {"driven_any": 6.9307752373754345, "survival_time": 45.099999999999575, "driven_lanedir": 0.1931337267507961, "in-drivable-lane": 37.649999999999565, "deviation-heading": 4.552159407965162, "distance-from-start": 0.8626308120701148, "deviation-center-line": 0.5372224226870801, "driven_lanedir_consec": 0.20646167013136785}}
simulation-passed1
survival_time_max45.099999999999575
survival_time_mean45.099999999999575
survival_time_min45.099999999999575
No reset possible
153601485Bea Baselines 🐤template-randomaido-LFP-sim-validationsim-0of4successnodavinci-stage-04-6.2.510:03:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median23.200000000000195
in-drivable-lane_median14.65000000000017
driven_lanedir_consec_median0.2737852330803683
deviation-center-line_median0.7687318160431588


other stats
deviation-center-line_max0.7687318160431588
deviation-center-line_mean0.7687318160431588
deviation-center-line_min0.7687318160431588
deviation-heading_max5.758343085491201
deviation-heading_mean5.758343085491201
deviation-heading_median5.758343085491201
deviation-heading_min5.758343085491201
distance-from-start_max0.7357883576773739
distance-from-start_mean0.7357883576773739
distance-from-start_median0.7357883576773739
distance-from-start_min0.7357883576773739
driven_any_max5.318401064622404
driven_any_mean5.318401064622404
driven_any_median5.318401064622404
driven_any_min5.318401064622404
driven_lanedir_consec_max0.2737852330803683
driven_lanedir_consec_mean0.2737852330803683
driven_lanedir_consec_min0.2737852330803683
driven_lanedir_max0.2557745570433345
driven_lanedir_mean0.2557745570433345
driven_lanedir_median0.2557745570433345
driven_lanedir_min0.2557745570433345
in-drivable-lane_max14.65000000000017
in-drivable-lane_mean14.65000000000017
in-drivable-lane_min14.65000000000017
per-episodes
details{"autolab-000-ego0": {"driven_any": 5.318401064622404, "survival_time": 23.200000000000195, "driven_lanedir": 0.2557745570433345, "in-drivable-lane": 14.65000000000017, "deviation-heading": 5.758343085491201, "distance-from-start": 0.7357883576773739, "deviation-center-line": 0.7687318160431588, "driven_lanedir_consec": 0.2737852330803683}}
simulation-passed1
survival_time_max23.200000000000195
survival_time_mean23.200000000000195
survival_time_min23.200000000000195
No reset possible
153571488Bea Baselines 🐤template-randomlx22-visservoingsimsuccessyesdavinci-stage-04-6.2.510:05:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median23.174999999999663
deviation-center-line_median1.1846435027267537
driven_lanedir_consec_median0.4119359833831363
survival_time_median35.84999999999938


other stats
deviation-center-line_max2.053692550333513
deviation-center-line_mean1.1846435027267537
deviation-center-line_min0.31559445511999407
deviation-heading_max15.80459948077375
deviation-heading_mean9.065579449172477
deviation-heading_median9.065579449172477
deviation-heading_min2.326559417571199
distance-from-start_max1.4108418329398822
distance-from-start_mean0.9784996704397644
distance-from-start_median0.9784996704397644
distance-from-start_min0.5461575079396466
driven_any_max15.326310847370593
driven_any_mean8.912150167222187
driven_any_median8.912150167222187
driven_any_min2.497989487073779
driven_lanedir_consec_max0.6105561181479094
driven_lanedir_consec_mean0.4119359833831363
driven_lanedir_consec_min0.21331584861836328
driven_lanedir_max0.5974394680482642
driven_lanedir_mean0.40241777001121354
driven_lanedir_median0.40241777001121354
driven_lanedir_min0.20739607197416288
in-drivable-lane_max38.19999999999931
in-drivable-lane_mean23.174999999999663
in-drivable-lane_min8.150000000000023
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 2.497989487073779, "survival_time": 11.700000000000031, "driven_lanedir": 0.20739607197416288, "in-drivable-lane": 8.150000000000023, "deviation-heading": 2.326559417571199, "distance-from-start": 0.5461575079396466, "deviation-center-line": 0.31559445511999407, "driven_lanedir_consec": 0.21331584861836328}, "LF-small-loop-001-ego0": {"driven_any": 15.326310847370593, "survival_time": 59.99999999999873, "driven_lanedir": 0.5974394680482642, "in-drivable-lane": 38.19999999999931, "deviation-heading": 15.80459948077375, "distance-from-start": 1.4108418329398822, "deviation-center-line": 2.053692550333513, "driven_lanedir_consec": 0.6105561181479094}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean35.84999999999938
survival_time_min11.700000000000031
No reset possible
153421498Bea Baselines 🐤template-randomaido-LFVI-sim-testingsim-0of4successnodavinci-stage-04-6.2.510:14:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median55.54999999999898
in-drivable-lane_median33.999999999999304
driven_lanedir_consec_median0.23486935510848683
deviation-center-line_median1.9152361710618249


other stats
deviation-center-line_max1.9152361710618249
deviation-center-line_mean1.9152361710618249
deviation-center-line_min1.9152361710618249
deviation-heading_max18.76264857218657
deviation-heading_mean18.76264857218657
deviation-heading_median18.76264857218657
deviation-heading_min18.76264857218657
distance-from-start_max1.290574960120657
distance-from-start_mean1.290574960120657
distance-from-start_median1.290574960120657
distance-from-start_min1.290574960120657
driven_any_max13.766585811745278
driven_any_mean13.766585811745278
driven_any_median13.766585811745278
driven_any_min13.766585811745278
driven_lanedir_consec_max0.23486935510848683
driven_lanedir_consec_mean0.23486935510848683
driven_lanedir_consec_min0.23486935510848683
driven_lanedir_max0.22765090740773952
driven_lanedir_mean0.22765090740773952
driven_lanedir_median0.22765090740773952
driven_lanedir_min0.22765090740773952
in-drivable-lane_max33.999999999999304
in-drivable-lane_mean33.999999999999304
in-drivable-lane_min33.999999999999304
per-episodes
details{"udem-000-ego0": {"driven_any": 13.766585811745278, "survival_time": 55.54999999999898, "driven_lanedir": 0.22765090740773952, "in-drivable-lane": 33.999999999999304, "deviation-heading": 18.76264857218657, "distance-from-start": 1.290574960120657, "deviation-center-line": 1.9152361710618249, "driven_lanedir_consec": 0.23486935510848683}}
simulation-passed1
survival_time_max55.54999999999898
survival_time_mean55.54999999999898
survival_time_min55.54999999999898
No reset possible
153291502Bea Baselines 🐤template-randomaido-LFV_multi-sim-testingsim-1of4successnodavinci-stage-04-6.2.510:22:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.199999999998774
in-drivable-lane_median51.49999999999876
driven_lanedir_consec_median0.21853936665470375
deviation-center-line_median0.6558628477973304


other stats
deviation-center-line_max1.3919847015555789
deviation-center-line_mean0.81620218081524
deviation-center-line_min0.56109832611072
deviation-heading_max9.906601177812297
deviation-heading_mean5.728605671043064
deviation-heading_median4.536008719589965
deviation-heading_min3.9358040671800296
distance-from-start_max1.3543782763136274
distance-from-start_mean1.0494456679466913
distance-from-start_median1.023653168809703
distance-from-start_min0.7960980578537311
driven_any_max14.612175482594528
driven_any_mean10.218740534833987
driven_any_median10.08333461358712
driven_any_min6.09611742956719
driven_lanedir_consec_max0.24555746228952957
driven_lanedir_consec_mean0.20899163900592865
driven_lanedir_consec_min0.15333036042477757
driven_lanedir_max0.2358197494342854
driven_lanedir_mean0.19479761986375457
driven_lanedir_median0.2060280026190392
driven_lanedir_min0.1313147247826545
in-drivable-lane_max52.39999999999874
in-drivable-lane_mean50.149999999998734
in-drivable-lane_min45.19999999999868
per-episodes
details{"loop-000-ego0": {"driven_any": 14.612175482594528, "survival_time": 59.199999999998774, "driven_lanedir": 0.2358197494342854, "in-drivable-lane": 45.19999999999868, "deviation-heading": 9.906601177812297, "distance-from-start": 1.3543782763136274, "deviation-center-line": 1.3919847015555789, "driven_lanedir_consec": 0.24555746228952957}, "loop-000-ego1": {"driven_any": 11.349124250612942, "survival_time": 59.199999999998774, "driven_lanedir": 0.22565943649319545, "in-drivable-lane": 51.14999999999877, "deviation-heading": 4.17325696101659, "distance-from-start": 1.0442247976692065, "deviation-center-line": 0.6271479250601518, "driven_lanedir_consec": 0.2397934631518233}, "loop-000-ego2": {"driven_any": 6.09611742956719, "survival_time": 59.199999999998774, "driven_lanedir": 0.1313147247826545, "in-drivable-lane": 52.39999999999874, "deviation-heading": 3.9358040671800296, "distance-from-start": 0.7960980578537311, "deviation-center-line": 0.684577770534509, "driven_lanedir_consec": 0.15333036042477757}, "loop-000-ego3": {"driven_any": 8.817544976561296, "survival_time": 59.199999999998774, "driven_lanedir": 0.18639656874488297, "in-drivable-lane": 51.849999999998744, "deviation-heading": 4.898760478163339, "distance-from-start": 1.0030815399501998, "deviation-center-line": 0.56109832611072, "driven_lanedir_consec": 0.19728527015758424}}
simulation-passed1
survival_time_max59.199999999998774
survival_time_mean59.199999999998774
survival_time_min59.199999999998774
No reset possible
153231503Bea Baselines 🐤template-randomaido-LFP-sim-testingsim-1of4successnodavinci-stage-04-6.2.510:05:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median43.29999999999968
in-drivable-lane_median35.7499999999996
driven_lanedir_consec_median0.054336775833862205
deviation-center-line_median0.6346586353316823


other stats
deviation-center-line_max0.6346586353316823
deviation-center-line_mean0.6346586353316823
deviation-center-line_min0.6346586353316823
deviation-heading_max5.904235246936354
deviation-heading_mean5.904235246936354
deviation-heading_median5.904235246936354
deviation-heading_min5.904235246936354
distance-from-start_max1.009340436005913
distance-from-start_mean1.009340436005913
distance-from-start_median1.009340436005913
distance-from-start_min1.009340436005913
driven_any_max10.522906217249686
driven_any_mean10.522906217249686
driven_any_median10.522906217249686
driven_any_min10.522906217249686
driven_lanedir_consec_max0.054336775833862205
driven_lanedir_consec_mean0.054336775833862205
driven_lanedir_consec_min0.054336775833862205
driven_lanedir_max0.05768311793249614
driven_lanedir_mean0.05768311793249614
driven_lanedir_median0.05768311793249614
driven_lanedir_min0.05768311793249614
in-drivable-lane_max35.7499999999996
in-drivable-lane_mean35.7499999999996
in-drivable-lane_min35.7499999999996
per-episodes
details{"loop-000-ego0": {"driven_any": 10.522906217249686, "survival_time": 43.29999999999968, "driven_lanedir": 0.05768311793249614, "in-drivable-lane": 35.7499999999996, "deviation-heading": 5.904235246936354, "distance-from-start": 1.009340436005913, "deviation-center-line": 0.6346586353316823, "driven_lanedir_consec": 0.054336775833862205}}
simulation-passed1
survival_time_max43.29999999999968
survival_time_mean43.29999999999968
survival_time_min43.29999999999968
No reset possible
153181504Bea Baselines 🐤template-rosaido-LFV-sim-validationsim-1of4successnodavinci-stage-04-6.2.510:02:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.649999999999981
in-drivable-lane_median6.599999999999981
driven_lanedir_consec_median0.15327655684778208
deviation-center-line_median0.0644974174496923


other stats
deviation-center-line_max0.0644974174496923
deviation-center-line_mean0.0644974174496923
deviation-center-line_min0.0644974174496923
deviation-heading_max0.6715626050120009
deviation-heading_mean0.6715626050120009
deviation-heading_median0.6715626050120009
deviation-heading_min0.6715626050120009
distance-from-start_max1.8953799856652844
distance-from-start_mean1.8953799856652844
distance-from-start_median1.8953799856652844
distance-from-start_min1.8953799856652844
driven_any_max1.930829639230796
driven_any_mean1.930829639230796
driven_any_median1.930829639230796
driven_any_min1.930829639230796
driven_lanedir_consec_max0.15327655684778208
driven_lanedir_consec_mean0.15327655684778208
driven_lanedir_consec_min0.15327655684778208
driven_lanedir_max0.15327655684778208
driven_lanedir_mean0.15327655684778208
driven_lanedir_median0.15327655684778208
driven_lanedir_min0.15327655684778208
in-drivable-lane_max6.599999999999981
in-drivable-lane_mean6.599999999999981
in-drivable-lane_min6.599999999999981
per-episodes
details{"loop-000-ego0": {"driven_any": 1.930829639230796, "survival_time": 7.649999999999981, "driven_lanedir": 0.15327655684778208, "in-drivable-lane": 6.599999999999981, "deviation-heading": 0.6715626050120009, "distance-from-start": 1.8953799856652844, "deviation-center-line": 0.0644974174496923, "driven_lanedir_consec": 0.15327655684778208}}
simulation-passed1
survival_time_max7.649999999999981
survival_time_mean7.649999999999981
survival_time_min7.649999999999981
No reset possible
153121506Bea Baselines 🐤template-rosaido-LFI-sim-validationsim-1of4successnodavinci-stage-04-6.2.510:02:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.249999999999993
in-drivable-lane_median3.3499999999999925
driven_lanedir_consec_median0.1359775641287699
deviation-center-line_median0.05348393574028397


other stats
deviation-center-line_max0.05348393574028397
deviation-center-line_mean0.05348393574028397
deviation-center-line_min0.05348393574028397
deviation-heading_max0.6106870497099331
deviation-heading_mean0.6106870497099331
deviation-heading_median0.6106870497099331
deviation-heading_min0.6106870497099331
distance-from-start_max0.9459491264812796
distance-from-start_mean0.9459491264812796
distance-from-start_median0.9459491264812796
distance-from-start_min0.9459491264812796
driven_any_max0.9697839443655054
driven_any_mean0.9697839443655054
driven_any_median0.9697839443655054
driven_any_min0.9697839443655054
driven_lanedir_consec_max0.1359775641287699
driven_lanedir_consec_mean0.1359775641287699
driven_lanedir_consec_min0.1359775641287699
driven_lanedir_max0.1359775641287699
driven_lanedir_mean0.1359775641287699
driven_lanedir_median0.1359775641287699
driven_lanedir_min0.1359775641287699
in-drivable-lane_max3.3499999999999925
in-drivable-lane_mean3.3499999999999925
in-drivable-lane_min3.3499999999999925
per-episodes
details{"udem1-000-ego0": {"driven_any": 0.9697839443655054, "survival_time": 4.249999999999993, "driven_lanedir": 0.1359775641287699, "in-drivable-lane": 3.3499999999999925, "deviation-heading": 0.6106870497099331, "distance-from-start": 0.9459491264812796, "deviation-center-line": 0.05348393574028397, "driven_lanedir_consec": 0.1359775641287699}}
simulation-passed1
survival_time_max4.249999999999993
survival_time_mean4.249999999999993
survival_time_min4.249999999999993
No reset possible
153051508Bea Baselines 🐤template-rosaido-LFVI_multi-sim-validationsim-1of4successnodavinci-stage-04-6.2.510:03:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.299999999999989
in-drivable-lane_median3.774999999999989
driven_lanedir_consec_median0.3449701674084662
deviation-center-line_median0.1390258374395318


other stats
deviation-center-line_max0.20172978415151016
deviation-center-line_mean0.1319583612751783
deviation-center-line_min0.048051986070139434
deviation-heading_max1.3066826673135543
deviation-heading_mean0.744500411210149
deviation-heading_median0.5798111699560544
deviation-heading_min0.5116966376149327
distance-from-start_max1.238237717899888
distance-from-start_mean0.9321746138540572
distance-from-start_median0.9617436143702334
distance-from-start_min0.5669735087758746
driven_any_max1.343391570978007
driven_any_mean0.9915536842542864
driven_any_median1.0202407857281168
driven_any_min0.5823415945829049
driven_lanedir_consec_max0.5770859377745708
driven_lanedir_consec_mean0.3480608416830602
driven_lanedir_consec_min0.12521709414073734
driven_lanedir_max0.5770859377745708
driven_lanedir_mean0.3480608416830602
driven_lanedir_median0.3449701674084662
driven_lanedir_min0.12521709414073734
in-drivable-lane_max4.399999999999989
in-drivable-lane_mean3.67499999999999
in-drivable-lane_min2.749999999999992
per-episodes
details{"4way-000-ego0": {"driven_any": 0.7820507948648737, "survival_time": 5.299999999999989, "driven_lanedir": 0.12521709414073734, "in-drivable-lane": 4.399999999999989, "deviation-heading": 0.6209888948050064, "distance-from-start": 0.7616943150643272, "deviation-center-line": 0.048051986070139434, "driven_lanedir_consec": 0.12521709414073734}, "4way-000-ego1": {"driven_any": 0.5823415945829049, "survival_time": 5.299999999999989, "driven_lanedir": 0.1394579297236529, "in-drivable-lane": 4.349999999999989, "deviation-heading": 0.5386334451071024, "distance-from-start": 0.5669735087758746, "deviation-center-line": 0.08456660557047599, "driven_lanedir_consec": 0.1394579297236529}, "4way-000-ego2": {"driven_any": 1.343391570978007, "survival_time": 5.299999999999989, "driven_lanedir": 0.5770859377745708, "in-drivable-lane": 3.1999999999999886, "deviation-heading": 0.5116966376149327, "distance-from-start": 1.1617929136761396, "deviation-center-line": 0.20172978415151016, "driven_lanedir_consec": 0.5770859377745708}, "4way-000-ego3": {"driven_any": 1.25843077659136, "survival_time": 5.299999999999989, "driven_lanedir": 0.5504824050932795, "in-drivable-lane": 2.749999999999992, "deviation-heading": 1.3066826673135543, "distance-from-start": 1.238237717899888, "deviation-center-line": 0.1934850693085876, "driven_lanedir_consec": 0.5504824050932795}}
simulation-passed1
survival_time_max5.299999999999989
survival_time_mean5.299999999999989
survival_time_min5.299999999999989
No reset possible
152981509Bea Baselines 🐤template-rosaido-LFV_multi-sim-validationsim-0of4successnodavinci-stage-04-6.2.510:03:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.549999999999981
in-drivable-lane_median5.9999999999999805
driven_lanedir_consec_median0.3038973503812593
deviation-center-line_median0.11634124534815216


other stats
deviation-center-line_max0.17609193476546975
deviation-center-line_mean0.11847337717476449
deviation-center-line_min0.06511908323728388
deviation-heading_max0.8691672294566
deviation-heading_mean0.6677435635371763
deviation-heading_median0.6254390009737818
deviation-heading_min0.5509290227445418
distance-from-start_max1.7683927743011347
distance-from-start_mean1.1432126401624365
distance-from-start_median1.2567523555872515
distance-from-start_min0.2909530751741074
driven_any_max1.968456748694957
driven_any_mean1.2398385337035696
driven_any_median1.3476732545546066
driven_any_min0.29555087701010824
driven_lanedir_consec_max0.7732669015340048
driven_lanedir_consec_mean0.3865628858753864
driven_lanedir_consec_min0.16518994120502217
driven_lanedir_max0.7732669015340048
driven_lanedir_mean0.3865628858753864
driven_lanedir_median0.3038973503812593
driven_lanedir_min0.16518994120502217
in-drivable-lane_max6.499999999999981
in-drivable-lane_mean5.737499999999982
in-drivable-lane_min4.449999999999984
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.29555087701010824, "survival_time": 7.549999999999981, "driven_lanedir": 0.16518994120502217, "in-drivable-lane": 6.499999999999981, "deviation-heading": 0.6410327785441896, "distance-from-start": 0.2909530751741074, "deviation-center-line": 0.06511908323728388, "driven_lanedir_consec": 0.16518994120502217}, "autolab-000-ego1": {"driven_any": 1.968456748694957, "survival_time": 7.549999999999981, "driven_lanedir": 0.16624174417310078, "in-drivable-lane": 6.499999999999981, "deviation-heading": 0.5509290227445418, "distance-from-start": 1.7683927743011347, "deviation-center-line": 0.09671892258725566, "driven_lanedir_consec": 0.16624174417310078}, "autolab-000-ego2": {"driven_any": 1.096853080591688, "survival_time": 7.549999999999981, "driven_lanedir": 0.44155295658941784, "in-drivable-lane": 5.4999999999999805, "deviation-heading": 0.609845223403374, "distance-from-start": 1.0838856190155215, "deviation-center-line": 0.17609193476546975, "driven_lanedir_consec": 0.44155295658941784}, "autolab-000-ego3": {"driven_any": 1.598493428517525, "survival_time": 7.549999999999981, "driven_lanedir": 0.7732669015340048, "in-drivable-lane": 4.449999999999984, "deviation-heading": 0.8691672294566, "distance-from-start": 1.429619092158982, "deviation-center-line": 0.13596356810904864, "driven_lanedir_consec": 0.7732669015340048}}
simulation-passed1
survival_time_max7.549999999999981
survival_time_mean7.549999999999981
survival_time_min7.549999999999981
No reset possible
152921514Bea Baselines 🐤template-roslx22-state-estimationsimsuccessyesdavinci-stage-04-6.2.510:03:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6718485392841359
survival_time_median8.09999999999998
deviation-center-line_median0.24120125839347137
in-drivable-lane_median5.599999999999983


other stats
deviation-center-line_max0.4187418456906367
deviation-center-line_mean0.2575348358399989
deviation-center-line_min0.11266140343588862
deviation-heading_max1.1369666467464674
deviation-heading_mean0.9376935487727742
deviation-heading_median0.952213774752598
deviation-heading_min0.723900224819257
distance-from-start_max2.4078722972534243
distance-from-start_mean2.0294722755833807
distance-from-start_median2.0387799592477736
distance-from-start_min1.6417645702489445
driven_any_max2.763960318863959
driven_any_mean2.182215884327482
driven_any_median2.0995062590775073
driven_any_min1.6831810750409806
driven_lanedir_consec_max1.2242586213369155
driven_lanedir_consec_mean0.8149004221922799
driven_lanedir_consec_min0.5485941059557882
driven_lanedir_max1.2242586213369155
driven_lanedir_mean0.8149004221922799
driven_lanedir_median0.6718485392841359
driven_lanedir_min0.5485941059557882
in-drivable-lane_max6.100000000000023
in-drivable-lane_mean5.233333333333331
in-drivable-lane_min3.999999999999986
per-episodes
details{"LF-zig-zag-000-ego0": {"driven_any": 1.6831810750409806, "survival_time": 6.8999999999999835, "driven_lanedir": 0.6718485392841359, "in-drivable-lane": 3.999999999999986, "deviation-heading": 0.723900224819257, "distance-from-start": 1.6417645702489445, "deviation-center-line": 0.11266140343588862, "driven_lanedir_consec": 0.6718485392841359}, "LF-zig-zag-001-ego0": {"driven_any": 2.763960318863959, "survival_time": 10.450000000000014, "driven_lanedir": 1.2242586213369155, "in-drivable-lane": 6.100000000000023, "deviation-heading": 0.952213774752598, "distance-from-start": 2.4078722972534243, "deviation-center-line": 0.4187418456906367, "driven_lanedir_consec": 1.2242586213369155}, "LF-zig-zag-002-ego0": {"driven_any": 2.0995062590775073, "survival_time": 8.09999999999998, "driven_lanedir": 0.5485941059557882, "in-drivable-lane": 5.599999999999983, "deviation-heading": 1.1369666467464674, "distance-from-start": 2.0387799592477736, "deviation-center-line": 0.24120125839347137, "driven_lanedir_consec": 0.5485941059557882}}
simulation-passed1
survival_time_max10.450000000000014
survival_time_mean8.483333333333325
survival_time_min6.8999999999999835
No reset possible
152861515Bea Baselines 🐤template-roslx22-BV1sim-3of5successnodavinci-stage-04-6.2.510:02:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.5437401173636058


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.5437401173636058
distance-from-start_median1.5437401173636058
distance-from-start_min1.5437401173636058
driven_any_max1.5695315154632516
driven_any_mean1.5695315154632516
driven_any_median1.5695315154632516
driven_any_min1.5695315154632516
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max6.249999999999986
in-drivable-lane_mean6.249999999999986
in-drivable-lane_median6.249999999999986
in-drivable-lane_min6.249999999999986
per-episodes
details{"d50-ego0": {"driven_any": 1.5695315154632516, "survival_time": 6.249999999999986, "driven_lanedir": 0.0, "in-drivable-lane": 6.249999999999986, "deviation-heading": 0.0, "distance-from-start": 1.5437401173636058, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max6.249999999999986
survival_time_mean6.249999999999986
survival_time_median6.249999999999986
survival_time_min6.249999999999986
No reset possible
152811523Bea Baselines 🐤template-rosaido-LFVI-sim-testingsim-0of4successnodavinci-stage-04-6.2.510:03:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.999999999999993
in-drivable-lane_median6.499999999999981
driven_lanedir_consec_median0.1863779478005123
deviation-center-line_median0.26304083401538153


other stats
deviation-center-line_max0.26304083401538153
deviation-center-line_mean0.26304083401538153
deviation-center-line_min0.26304083401538153
deviation-heading_max2.7893624348021873
deviation-heading_mean2.7893624348021873
deviation-heading_median2.7893624348021873
deviation-heading_min2.7893624348021873
distance-from-start_max2.218301255603608
distance-from-start_mean2.218301255603608
distance-from-start_median2.218301255603608
distance-from-start_min2.218301255603608
driven_any_max2.307392902404519
driven_any_mean2.307392902404519
driven_any_median2.307392902404519
driven_any_min2.307392902404519
driven_lanedir_consec_max0.1863779478005123
driven_lanedir_consec_mean0.1863779478005123
driven_lanedir_consec_min0.1863779478005123
driven_lanedir_max0.1863779478005123
driven_lanedir_mean0.1863779478005123
driven_lanedir_median0.1863779478005123
driven_lanedir_min0.1863779478005123
in-drivable-lane_max6.499999999999981
in-drivable-lane_mean6.499999999999981
in-drivable-lane_min6.499999999999981
per-episodes
details{"udem-000-ego0": {"driven_any": 2.307392902404519, "survival_time": 8.999999999999993, "driven_lanedir": 0.1863779478005123, "in-drivable-lane": 6.499999999999981, "deviation-heading": 2.7893624348021873, "distance-from-start": 2.218301255603608, "deviation-center-line": 0.26304083401538153, "driven_lanedir_consec": 0.1863779478005123}}
simulation-passed1
survival_time_max8.999999999999993
survival_time_mean8.999999999999993
survival_time_min8.999999999999993
No reset possible
152771523Bea Baselines 🐤template-rosaido-LFVI-sim-testingsim-3of4successnodavinci-stage-04-6.2.510:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
152711524Bea Baselines 🐤template-rosaido-LFI-sim-testingsim-2of4successnodavinci-stage-04-6.2.510:01:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
152671526Bea Baselines 🐤template-rosaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-04-6.2.510:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
152641527Bea Baselines 🐤template-rosaido-LFV_multi-sim-testingsim-0of4successnodavinci-stage-04-6.2.510:03:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.0499999999999865
in-drivable-lane_median5.099999999999986
driven_lanedir_consec_median0.15530289071844405
deviation-center-line_median0.08158360050410748


other stats
deviation-center-line_max0.40015189854233296
deviation-center-line_mean0.1549249909508287
deviation-center-line_min0.05638086425276689
deviation-heading_max0.6667813241693127
deviation-heading_mean0.44655526376606
deviation-heading_median0.4449949641384162
deviation-heading_min0.2294498026180951
distance-from-start_max1.5008488556661697
distance-from-start_mean0.772899240261069
distance-from-start_median0.572651601343879
distance-from-start_min0.4454449026903484
driven_any_max1.6168338136260236
driven_any_mean0.8063398971211644
driven_any_median0.5810828969810387
driven_any_min0.4463599808965568
driven_lanedir_consec_max0.4946436139694823
driven_lanedir_consec_mean0.22654748868605373
driven_lanedir_consec_min0.10094055933784452
driven_lanedir_max0.4946436139694823
driven_lanedir_mean0.22654748868605373
driven_lanedir_median0.15530289071844405
driven_lanedir_min0.10094055933784452
in-drivable-lane_max5.249999999999987
in-drivable-lane_mean3.86249999999999
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.4463599808965568, "survival_time": 6.0499999999999865, "driven_lanedir": 0.11140778066139267, "in-drivable-lane": 5.149999999999986, "deviation-heading": 0.6667813241693127, "distance-from-start": 0.4454449026903484, "deviation-center-line": 0.05638086425276689, "driven_lanedir_consec": 0.11140778066139267}, "autolab-000-ego1": {"driven_any": 1.6168338136260236, "survival_time": 6.0499999999999865, "driven_lanedir": 0.19919800077549543, "in-drivable-lane": 5.0499999999999865, "deviation-heading": 0.3468282200220515, "distance-from-start": 1.5008488556661697, "deviation-center-line": 0.09663879082971057, "driven_lanedir_consec": 0.19919800077549543}, "autolab-000-ego2": {"driven_any": 0.4974743856314771, "survival_time": 6.0499999999999865, "driven_lanedir": 0.4946436139694823, "in-drivable-lane": 0.0, "deviation-heading": 0.2294498026180951, "distance-from-start": 0.49657873610451664, "deviation-center-line": 0.40015189854233296, "driven_lanedir_consec": 0.4946436139694823}, "autolab-000-ego3": {"driven_any": 0.6646914083306001, "survival_time": 6.0499999999999865, "driven_lanedir": 0.10094055933784452, "in-drivable-lane": 5.249999999999987, "deviation-heading": 0.5431617082547809, "distance-from-start": 0.6487244665832415, "deviation-center-line": 0.0665284101785044, "driven_lanedir_consec": 0.10094055933784452}}
simulation-passed1
survival_time_max6.0499999999999865
survival_time_mean6.0499999999999865
survival_time_min6.0499999999999865
No reset possible
152581528Bea Baselines 🐤template-rosaido-LFP-sim-testingsim-3of4successnodavinci-stage-04-6.2.510:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.799999999999984
in-drivable-lane_median4.899999999999987
driven_lanedir_consec_median0.32736513659314515
deviation-center-line_median0.1592056046507359


other stats
deviation-center-line_max0.1592056046507359
deviation-center-line_mean0.1592056046507359
deviation-center-line_min0.1592056046507359
deviation-heading_max1.5040548844655617
deviation-heading_mean1.5040548844655617
deviation-heading_median1.5040548844655617
deviation-heading_min1.5040548844655617
distance-from-start_max1.7944009362059865
distance-from-start_mean1.7944009362059865
distance-from-start_median1.7944009362059865
distance-from-start_min1.7944009362059865
driven_any_max1.8123505003800304
driven_any_mean1.8123505003800304
driven_any_median1.8123505003800304
driven_any_min1.8123505003800304
driven_lanedir_consec_max0.32736513659314515
driven_lanedir_consec_mean0.32736513659314515
driven_lanedir_consec_min0.32736513659314515
driven_lanedir_max0.32736513659314515
driven_lanedir_mean0.32736513659314515
driven_lanedir_median0.32736513659314515
driven_lanedir_min0.32736513659314515
in-drivable-lane_max4.899999999999987
in-drivable-lane_mean4.899999999999987
in-drivable-lane_min4.899999999999987
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.8123505003800304, "survival_time": 6.799999999999984, "driven_lanedir": 0.32736513659314515, "in-drivable-lane": 4.899999999999987, "deviation-heading": 1.5040548844655617, "distance-from-start": 1.7944009362059865, "deviation-center-line": 0.1592056046507359, "driven_lanedir_consec": 0.32736513659314515}}
simulation-passed1
survival_time_max6.799999999999984
survival_time_mean6.799999999999984
survival_time_min6.799999999999984
No reset possible
152541529Bea Baselines 🐤template-tensorflowaido-LFV-sim-validationsim-2of4failednodavinci-stage-04-6.2.510:01:39
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
152491530Bea Baselines 🐤template-tensorflowaido-LFVI-sim-validationsim-0of4failednodavinci-stage-04-6.2.510:01:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
152441531Bea Baselines 🐤template-tensorflowaido-LFI-sim-validationsim-2of4successnodavinci-stage-04-6.2.510:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
152371533Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-validationsim-2of4successnodavinci-stage-04-6.2.510:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
152331534Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-validationsim-1of4failednodavinci-stage-04-6.2.510:01:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
152291535Bea Baselines 🐤template-tensorflowaido-LFP-sim-validationsim-3of4failednodavinci-stage-04-6.2.510:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
152231540Bea Baselines 🐤template-tensorflowlx22-BV1sim-3of5failednodavinci-stage-04-6.2.510:00:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
152151547Bea Baselines 🐤template-tensorflowaido-LFV-sim-testingsim-3of4failednodavinci-stage-04-6.2.510:01:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
152101548Bea Baselines 🐤template-tensorflowaido-LFVI-sim-testingsim-0of4failednodavinci-stage-04-6.2.510:01:42
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
152021549Bea Baselines 🐤template-tensorflowaido-LFI-sim-testingsim-1of4failednodavinci-stage-04-6.2.510:01:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
151981551Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-testingsim-1of4failednodavinci-stage-04-6.2.510:01:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
151961552Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-testingsim-2of4failednodavinci-stage-04-6.2.510:01:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
151901553Bea Baselines 🐤template-tensorflowaido-LFP-sim-testingsim-1of4failednodavinci-stage-04-6.2.510:01:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
151851369Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-testingsim-3of4successnodavinci-stage-04-6.2.510:03:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
151821293Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-1of4abortednodavinci-stage-04-6.2.510:04:17
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1302, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 749, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
151811293Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-04-6.2.510:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
151741295Bea Baselines 🐤template-randomaido-LFP-sim-testingsim-3of4successnodavinci-stage-04-6.2.510:08:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median36.34999999999917
driven_lanedir_consec_median0.23799216289173675
deviation-center-line_median2.122382603135255


other stats
deviation-center-line_max2.122382603135255
deviation-center-line_mean2.122382603135255
deviation-center-line_min2.122382603135255
deviation-heading_max20.52214487263099
deviation-heading_mean20.52214487263099
deviation-heading_median20.52214487263099
deviation-heading_min20.52214487263099
distance-from-start_max1.4108418329398902
distance-from-start_mean1.4108418329398902
distance-from-start_median1.4108418329398902
distance-from-start_min1.4108418329398902
driven_any_max15.326310847370609
driven_any_mean15.326310847370609
driven_any_median15.326310847370609
driven_any_min15.326310847370609
driven_lanedir_consec_max0.23799216289173675
driven_lanedir_consec_mean0.23799216289173675
driven_lanedir_consec_min0.23799216289173675
driven_lanedir_max0.2454177542370326
driven_lanedir_mean0.2454177542370326
driven_lanedir_median0.2454177542370326
driven_lanedir_min0.2454177542370326
in-drivable-lane_max36.34999999999917
in-drivable-lane_mean36.34999999999917
in-drivable-lane_min36.34999999999917
per-episodes
details{"zigzag-000-ego0": {"driven_any": 15.326310847370609, "survival_time": 59.99999999999873, "driven_lanedir": 0.2454177542370326, "in-drivable-lane": 36.34999999999917, "deviation-heading": 20.52214487263099, "distance-from-start": 1.4108418329398902, "deviation-center-line": 2.122382603135255, "driven_lanedir_consec": 0.23799216289173675}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
151731295Bea Baselines 🐤template-randomaido-LFP-sim-testingsim-2of4successnodavinci-stage-04-6.2.510:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.300000000000026
in-drivable-lane_median7.850000000000014
driven_lanedir_consec_median0.02948472541340319
deviation-center-line_median0.3268416970813497


other stats
deviation-center-line_max0.3268416970813497
deviation-center-line_mean0.3268416970813497
deviation-center-line_min0.3268416970813497
deviation-heading_max2.548872596322993
deviation-heading_mean2.548872596322993
deviation-heading_median2.548872596322993
deviation-heading_min2.548872596322993
distance-from-start_max0.5461575079396523
distance-from-start_mean0.5461575079396523
distance-from-start_median0.5461575079396523
distance-from-start_min0.5461575079396523
driven_any_max2.2681416551684617
driven_any_mean2.2681416551684617
driven_any_median2.2681416551684617
driven_any_min2.2681416551684617
driven_lanedir_consec_max0.02948472541340319
driven_lanedir_consec_mean0.02948472541340319
driven_lanedir_consec_min0.02948472541340319
driven_lanedir_max0.032831067512037126
driven_lanedir_mean0.032831067512037126
driven_lanedir_median0.032831067512037126
driven_lanedir_min0.032831067512037126
in-drivable-lane_max7.850000000000014
in-drivable-lane_mean7.850000000000014
in-drivable-lane_min7.850000000000014
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.2681416551684617, "survival_time": 11.300000000000026, "driven_lanedir": 0.032831067512037126, "in-drivable-lane": 7.850000000000014, "deviation-heading": 2.548872596322993, "distance-from-start": 0.5461575079396523, "deviation-center-line": 0.3268416970813497, "driven_lanedir_consec": 0.02948472541340319}}
simulation-passed1
survival_time_max11.300000000000026
survival_time_mean11.300000000000026
survival_time_min11.300000000000026
No reset possible
151601271Bea Baselines 🐤template-randomaido-LFVI_multi-sim-validationsim-1of4successnodavinci-stage-04-6.2.510:15:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median43.29999999999968
in-drivable-lane_median35.19999999999969
driven_lanedir_consec_median0.1481685404123385
deviation-center-line_median0.6130052941053471


other stats
deviation-center-line_max6.361236990588696
deviation-center-line_mean1.968961967548878
deviation-center-line_min0.28860029139612103
deviation-heading_max22.59467278731015
deviation-heading_mean9.325639720688413
deviation-heading_median6.178891513015082
deviation-heading_min2.350103069413334
distance-from-start_max1.0093404360059293
distance-from-start_mean0.6788871313560756
distance-from-start_median0.651676229557197
distance-from-start_min0.40285563030397936
driven_any_max10.522906217249696
driven_any_mean4.533111394485939
driven_any_median3.592731455205004
driven_any_min0.4240764502840531
driven_lanedir_consec_max0.3902130173718561
driven_lanedir_consec_mean0.1975964492168203
driven_lanedir_consec_min0.10383569867074804
driven_lanedir_max0.3902130173718561
driven_lanedir_mean0.18988251265665312
driven_lanedir_median0.1348795225002798
driven_lanedir_min0.09955798825419682
in-drivable-lane_max39.84999999999967
in-drivable-lane_mean27.787499999999763
in-drivable-lane_min0.9
per-episodes
details{"4way-000-ego0": {"driven_any": 0.4240764502840531, "survival_time": 43.29999999999968, "driven_lanedir": 0.3902130173718561, "in-drivable-lane": 0.9, "deviation-heading": 22.59467278731015, "distance-from-start": 0.40285563030397936, "deviation-center-line": 6.361236990588696, "driven_lanedir_consec": 0.3902130173718561}, "4way-000-ego1": {"driven_any": 10.522906217249696, "survival_time": 43.29999999999968, "driven_lanedir": 0.13630120329834927, "in-drivable-lane": 32.44999999999972, "deviation-heading": 9.32828495552219, "distance-from-start": 1.0093404360059293, "deviation-center-line": 0.7830123872563919, "driven_lanedir_consec": 0.14963153086450776}, "4way-000-ego2": {"driven_any": 4.117732239446985, "survival_time": 43.29999999999968, "driven_lanedir": 0.1334578417022103, "in-drivable-lane": 37.94999999999966, "deviation-heading": 3.0294980705079753, "distance-from-start": 0.6736010379604934, "deviation-center-line": 0.4429982009543024, "driven_lanedir_consec": 0.14670554996016927}, "4way-000-ego3": {"driven_any": 3.067730670963023, "survival_time": 43.29999999999968, "driven_lanedir": 0.09955798825419682, "in-drivable-lane": 39.84999999999967, "deviation-heading": 2.350103069413334, "distance-from-start": 0.6297514211539005, "deviation-center-line": 0.28860029139612103, "driven_lanedir_consec": 0.10383569867074804}}
simulation-passed1
survival_time_max43.29999999999968
survival_time_mean43.29999999999968
survival_time_min43.29999999999968
No reset possible
151591271Bea Baselines 🐤template-randomaido-LFVI_multi-sim-validationsim-3of4successnodavinci-stage-04-6.2.510:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
151581271Bea Baselines 🐤template-randomaido-LFVI_multi-sim-validationsim-2of4successnodavinci-stage-04-6.2.510:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
151461267Bea Baselines 🐤template-randomaido-LFV-sim-validationsim-3of4successnodavinci-stage-04-6.2.510:15:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median48.69999999999937
in-drivable-lane_median36.64999999999927
driven_lanedir_consec_median0.27329071924012593
deviation-center-line_median0.8940598330260409


other stats
deviation-center-line_max0.8940598330260409
deviation-center-line_mean0.8940598330260409
deviation-center-line_min0.8940598330260409
deviation-heading_max9.653852545002117
deviation-heading_mean9.653852545002117
deviation-heading_median9.653852545002117
deviation-heading_min9.653852545002117
distance-from-start_max1.1351054760255814
distance-from-start_mean1.1351054760255814
distance-from-start_median1.1351054760255814
distance-from-start_min1.1351054760255814
driven_any_max12.221812291295889
driven_any_mean12.221812291295889
driven_any_median12.221812291295889
driven_any_min12.221812291295889
driven_lanedir_consec_max0.27329071924012593
driven_lanedir_consec_mean0.27329071924012593
driven_lanedir_consec_min0.27329071924012593
driven_lanedir_max0.26112935377464863
driven_lanedir_mean0.26112935377464863
driven_lanedir_median0.26112935377464863
driven_lanedir_min0.26112935377464863
in-drivable-lane_max36.64999999999927
in-drivable-lane_mean36.64999999999927
in-drivable-lane_min36.64999999999927
per-episodes
details{"zigzag-000-ego0": {"driven_any": 12.221812291295889, "survival_time": 48.69999999999937, "driven_lanedir": 0.26112935377464863, "in-drivable-lane": 36.64999999999927, "deviation-heading": 9.653852545002117, "distance-from-start": 1.1351054760255814, "deviation-center-line": 0.8940598330260409, "driven_lanedir_consec": 0.27329071924012593}}
simulation-passed1
survival_time_max48.69999999999937
survival_time_mean48.69999999999937
survival_time_min48.69999999999937
No reset possible
15145526Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-testingsim-3of4failednodavinci-stage-04-6.2.510:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15141783Andrea Danieletemplate-randomaido-LF-sim-validationsim-2of4successnodavinci-stage-04-6.2.510:03:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.27378584101885495
survival_time_median20.550000000000157
deviation-center-line_median0.7687309613328539
in-drivable-lane_median12.000000000000131


other stats
deviation-center-line_max0.7687309613328539
deviation-center-line_mean0.7687309613328539
deviation-center-line_min0.7687309613328539
deviation-heading_max5.7583430601860695
deviation-heading_mean5.7583430601860695
deviation-heading_median5.7583430601860695
deviation-heading_min5.7583430601860695
distance-from-start_max0.7357883576773772
distance-from-start_mean0.7357883576773772
distance-from-start_median0.7357883576773772
distance-from-start_min0.7357883576773772
driven_any_max4.915576034387011
driven_any_mean4.915576034387011
driven_any_median4.915576034387011
driven_any_min4.915576034387011
driven_lanedir_consec_max0.27378584101885495
driven_lanedir_consec_mean0.27378584101885495
driven_lanedir_consec_min0.27378584101885495
driven_lanedir_max0.2557751649818414
driven_lanedir_mean0.2557751649818414
driven_lanedir_median0.2557751649818414
driven_lanedir_min0.2557751649818414
in-drivable-lane_max12.000000000000131
in-drivable-lane_mean12.000000000000131
in-drivable-lane_min12.000000000000131
per-episodes
details{"loop2-000-ego0": {"driven_any": 4.915576034387011, "survival_time": 20.550000000000157, "driven_lanedir": 0.2557751649818414, "in-drivable-lane": 12.000000000000131, "deviation-heading": 5.7583430601860695, "distance-from-start": 0.7357883576773772, "deviation-center-line": 0.7687309613328539, "driven_lanedir_consec": 0.27378584101885495}}
simulation-passed1
survival_time_max20.550000000000157
survival_time_mean20.550000000000157
survival_time_min20.550000000000157
No reset possible
151391273Bea Baselines 🐤template-randomaido-LFP-sim-validationsim-2of4successnodavinci-stage-04-6.2.510:02:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median15.700000000000088
in-drivable-lane_median8.100000000000078
driven_lanedir_consec_median0.27378153863999577
deviation-center-line_median0.6226670229639317


other stats
deviation-center-line_max0.6226670229639317
deviation-center-line_mean0.6226670229639317
deviation-center-line_min0.6226670229639317
deviation-heading_max4.9776949056766355
deviation-heading_mean4.9776949056766355
deviation-heading_median4.9776949056766355
deviation-heading_min4.9776949056766355
distance-from-start_max0.6297514211538986
distance-from-start_mean0.6297514211538986
distance-from-start_median0.6297514211538986
distance-from-start_min0.6297514211538986
driven_any_max3.532822332695487
driven_any_mean3.532822332695487
driven_any_median3.532822332695487
driven_any_min3.532822332695487
driven_lanedir_consec_max0.27378153863999577
driven_lanedir_consec_mean0.27378153863999577
driven_lanedir_consec_min0.27378153863999577
driven_lanedir_max0.2627748326499355
driven_lanedir_mean0.2627748326499355
driven_lanedir_median0.2627748326499355
driven_lanedir_min0.2627748326499355
in-drivable-lane_max8.100000000000078
in-drivable-lane_mean8.100000000000078
in-drivable-lane_min8.100000000000078
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.532822332695487, "survival_time": 15.700000000000088, "driven_lanedir": 0.2627748326499355, "in-drivable-lane": 8.100000000000078, "deviation-heading": 4.9776949056766355, "distance-from-start": 0.6297514211538986, "deviation-center-line": 0.6226670229639317, "driven_lanedir_consec": 0.27378153863999577}}
simulation-passed1
survival_time_max15.700000000000088
survival_time_mean15.700000000000088
survival_time_min15.700000000000088
No reset possible
15135785Andrea Danieletemplate-rosaido-LF-sim-validationsim-1of4successnodavinci-stage-04-6.2.510:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2806241427905898
survival_time_median5.349999999999989
deviation-center-line_median0.10985009332565145
in-drivable-lane_median3.999999999999989


other stats
deviation-center-line_max0.10985009332565145
deviation-center-line_mean0.10985009332565145
deviation-center-line_min0.10985009332565145
deviation-heading_max0.5863653159439228
deviation-heading_mean0.5863653159439228
deviation-heading_median0.5863653159439228
deviation-heading_min0.5863653159439228
distance-from-start_max1.2918576942896178
distance-from-start_mean1.2918576942896178
distance-from-start_median1.2918576942896178
distance-from-start_min1.2918576942896178
driven_any_max1.3055980709925792
driven_any_mean1.3055980709925792
driven_any_median1.3055980709925792
driven_any_min1.3055980709925792
driven_lanedir_consec_max0.2806241427905898
driven_lanedir_consec_mean0.2806241427905898
driven_lanedir_consec_min0.2806241427905898
driven_lanedir_max0.2806241427905898
driven_lanedir_mean0.2806241427905898
driven_lanedir_median0.2806241427905898
driven_lanedir_min0.2806241427905898
in-drivable-lane_max3.999999999999989
in-drivable-lane_mean3.999999999999989
in-drivable-lane_min3.999999999999989
per-episodes
details{"loop-000-ego0": {"driven_any": 1.3055980709925792, "survival_time": 5.349999999999989, "driven_lanedir": 0.2806241427905898, "in-drivable-lane": 3.999999999999989, "deviation-heading": 0.5863653159439228, "distance-from-start": 1.2918576942896178, "deviation-center-line": 0.10985009332565145, "driven_lanedir_consec": 0.2806241427905898}}
simulation-passed1
survival_time_max5.349999999999989
survival_time_mean5.349999999999989
survival_time_min5.349999999999989
No reset possible
151251270Bea Baselines 🐤template-randomaido-LF-sim-validationsim-1of4successnodavinci-stage-04-6.2.510:06:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2701303550718044
survival_time_median49.74999999999931
deviation-center-line_median0.8041846674982114
in-drivable-lane_median40.59999999999928


other stats
deviation-center-line_max0.8041846674982114
deviation-center-line_mean0.8041846674982114
deviation-center-line_min0.8041846674982114
deviation-heading_max6.675380463416964
deviation-heading_mean6.675380463416964
deviation-heading_median6.675380463416964
deviation-heading_min6.675380463416964
distance-from-start_max1.137627771926658
distance-from-start_mean1.137627771926658
distance-from-start_median1.137627771926658
distance-from-start_min1.137627771926658
driven_any_max12.45015338279087
driven_any_mean12.45015338279087
driven_any_median12.45015338279087
driven_any_min12.45015338279087
driven_lanedir_consec_max0.2701303550718044
driven_lanedir_consec_mean0.2701303550718044
driven_lanedir_consec_min0.2701303550718044
driven_lanedir_max0.2521152682910448
driven_lanedir_mean0.2521152682910448
driven_lanedir_median0.2521152682910448
driven_lanedir_min0.2521152682910448
in-drivable-lane_max40.59999999999928
in-drivable-lane_mean40.59999999999928
in-drivable-lane_min40.59999999999928
per-episodes
details{"loop-000-ego0": {"driven_any": 12.45015338279087, "survival_time": 49.74999999999931, "driven_lanedir": 0.2521152682910448, "in-drivable-lane": 40.59999999999928, "deviation-heading": 6.675380463416964, "distance-from-start": 1.137627771926658, "deviation-center-line": 0.8041846674982114, "driven_lanedir_consec": 0.2701303550718044}}
simulation-passed1
survival_time_max49.74999999999931
survival_time_mean49.74999999999931
survival_time_min49.74999999999931
No reset possible
150441297Andrea Censicollision-check-exerciselx22-collision-check-valistep1host-erroryesdavinci-stage-04-6.2.510:00:42
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.41/images/create?tag=2022_11_24_17_26_06&fromImage=registry-stage2.duckietown.org%2Fandreacensi%2Faido-submissions

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 93, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 429, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.ImageNotFound: 404 Client Error for http+docker://localhost/v1.41/images/create?tag=2022_11_24_17_26_06&fromImage=registry-stage2.duckietown.org%2Fandreacensi%2Faido-submissions: Not Found ("pull access denied for registry-stage2.duckietown.org/andreacensi/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 112, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  registry-stage2.duckietown.org/andreacensi/aido-submissions@sha256:840e7105f36db90b5d37324bdcab451125a96c2e8b8f5c02658293c659de9b5d  tag  2022_11_24_17_26_06

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 51, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull registry-stage2.duckietown.org/andreacensi/aido-submissions:2022_11_24_17_26_06@sha256:840e7105f36db90b5d37324bdcab451125a96c2e8b8f5c02658293c659de9b5d
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible