Duckietown Challenges Home Challenges Submissions

Evaluator 123

ID123
evaluatordavinci-stage-03-6.2.51
owneruser1000001
machinedavinci-stage
processdavinci-stage-03-6.2.51
version6.2.51
first heard
last heard
statusinactive
# evaluating
# success246 15126
# timeout2 16207
# failed59 15192
# error2 15884
# aborted2 15183
# host-error12 15062
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)2.8 GHz
Free % of processors99%
RAM total (MB)251.6 GB
RAM free (MB)244.3 GB
Disk (MB)491.1 GB
Disk available (MB)174.8 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, ETH_small_intersect
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
166641701Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-testingsim-2of4host-erroryesdavinci-stage-03-6.2.510:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  [Previous line repeated 2 more times]
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
166621712Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-validationsim-0of3host-erroryesdavinci-stage-03-6.2.510:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  [Previous line repeated 2 more times]
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
166581712Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-validationsim-1of3host-erroryesdavinci-stage-03-6.2.510:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  [Previous line repeated 2 more times]
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
166531712Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-validationsim-1of3host-erroryesdavinci-stage-03-6.2.510:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  [Previous line repeated 2 more times]
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
166451701Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-testingsim-2of4timeoutyesdavinci-stage-03-6.2.51----No reset possible
166431701Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-testingsim-1of4successyesdavinci-stage-03-6.2.510:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.09999999999998
in-drivable-lane_median0.0
driven_lanedir_consec_median0.41885674395418215
deviation-center-line_median0.2592734099538108


other stats
deviation-center-line_max0.2592734099538108
deviation-center-line_mean0.2592734099538108
deviation-center-line_min0.2592734099538108
deviation-heading_max0.7151194489559713
deviation-heading_mean0.7151194489559713
deviation-heading_median0.7151194489559713
deviation-heading_min0.7151194489559713
distance-from-start_max0.4199960454985642
distance-from-start_mean0.4199960454985642
distance-from-start_median0.4199960454985642
distance-from-start_min0.4199960454985642
driven_any_max0.42359927688869903
driven_any_mean0.42359927688869903
driven_any_median0.42359927688869903
driven_any_min0.42359927688869903
driven_lanedir_consec_max0.41885674395418215
driven_lanedir_consec_mean0.41885674395418215
driven_lanedir_consec_min0.41885674395418215
driven_lanedir_max0.41885674395418215
driven_lanedir_mean0.41885674395418215
driven_lanedir_median0.41885674395418215
driven_lanedir_min0.41885674395418215
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 0.42359927688869903, "survival_time": 8.09999999999998, "driven_lanedir": 0.41885674395418215, "in-drivable-lane": 0.0, "deviation-heading": 0.7151194489559713, "distance-from-start": 0.4199960454985642, "deviation-center-line": 0.2592734099538108, "driven_lanedir_consec": 0.41885674395418215}}
simulation-passed1
survival_time_max8.09999999999998
survival_time_mean8.09999999999998
survival_time_min8.09999999999998
No reset possible
166381703Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-testingsim-0of4successyesdavinci-stage-03-6.2.510:08:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.292103748604663
deviation-center-line_median4.949281369491427


other stats
deviation-center-line_max4.949281369491427
deviation-center-line_mean4.949281369491427
deviation-center-line_min4.949281369491427
deviation-heading_max5.605546349563034
deviation-heading_mean5.605546349563034
deviation-heading_median5.605546349563034
deviation-heading_min5.605546349563034
distance-from-start_max2.278496107947562
distance-from-start_mean2.278496107947562
distance-from-start_median2.278496107947562
distance-from-start_min2.278496107947562
driven_any_max3.5795858026067657
driven_any_mean3.5795858026067657
driven_any_median3.5795858026067657
driven_any_min3.5795858026067657
driven_lanedir_consec_max3.292103748604663
driven_lanedir_consec_mean3.292103748604663
driven_lanedir_consec_min3.292103748604663
driven_lanedir_max3.53367274833897
driven_lanedir_mean3.53367274833897
driven_lanedir_median3.53367274833897
driven_lanedir_min3.53367274833897
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 3.5795858026067657, "survival_time": 59.99999999999873, "driven_lanedir": 3.53367274833897, "in-drivable-lane": 0.0, "deviation-heading": 5.605546349563034, "distance-from-start": 2.278496107947562, "deviation-center-line": 4.949281369491427, "driven_lanedir_consec": 3.292103748604663}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
166301704Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-testingsim-0of4successyesdavinci-stage-03-6.2.510:17:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.1749999999998764
driven_lanedir_consec_median3.3248172596190684
deviation-center-line_median5.75716887821971


other stats
deviation-center-line_max6.627907079134618
deviation-center-line_mean5.497801828136498
deviation-center-line_min3.848962476971951
deviation-heading_max11.413636489405157
deviation-heading_mean7.6893062297262045
deviation-heading_median7.06163724081356
deviation-heading_min5.220313947872544
distance-from-start_max3.071318609975737
distance-from-start_mean2.3992593598839593
distance-from-start_median2.4470384918328207
distance-from-start_min1.6316418458944593
driven_any_max3.579587562679039
driven_any_mean3.521088411159384
driven_any_median3.51433972593214
driven_any_min3.476086630094217
driven_lanedir_consec_max3.4776012543896866
driven_lanedir_consec_mean3.338894985703014
driven_lanedir_consec_min3.2283441691842336
driven_lanedir_max3.4776012543896866
driven_lanedir_mean3.377098944667144
driven_lanedir_median3.3812666483317493
driven_lanedir_min3.2682612276153913
in-drivable-lane_max3.449999999999882
in-drivable-lane_mean1.9499999999999087
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.509092316575898, "survival_time": 59.99999999999873, "driven_lanedir": 3.3813732916227455, "in-drivable-lane": 2.3499999999998664, "deviation-heading": 5.432222638225493, "distance-from-start": 1.6316418458944593, "deviation-center-line": 6.627907079134618, "driven_lanedir_consec": 3.3813732916227455}, "autolab-000-ego1": {"driven_any": 3.5195871352883814, "survival_time": 59.99999999999873, "driven_lanedir": 3.381160005040753, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 5.220313947872544, "distance-from-start": 2.830245940398582, "deviation-center-line": 6.258804535671791, "driven_lanedir_consec": 3.2283441691842336}, "autolab-000-ego2": {"driven_any": 3.476086630094217, "survival_time": 59.99999999999873, "driven_lanedir": 3.2682612276153913, "in-drivable-lane": 3.449999999999882, "deviation-heading": 8.691051843401628, "distance-from-start": 2.063831043267061, "deviation-center-line": 5.25553322076763, "driven_lanedir_consec": 3.2682612276153913}, "autolab-000-ego3": {"driven_any": 3.579587562679039, "survival_time": 59.99999999999873, "driven_lanedir": 3.4776012543896866, "in-drivable-lane": 0.0, "deviation-heading": 11.413636489405157, "distance-from-start": 3.071318609975737, "deviation-center-line": 3.848962476971951, "driven_lanedir_consec": 3.4776012543896866}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
166291705Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-testingsim-2of4successyesdavinci-stage-03-6.2.510:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
166251706Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-testingsim-1of4successyesdavinci-stage-03-6.2.510:05:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.1999999999999318
driven_lanedir_consec_median3.4359165318271345
deviation-center-line_median4.892013423501352


other stats
deviation-center-line_max4.892013423501352
deviation-center-line_mean4.892013423501352
deviation-center-line_min4.892013423501352
deviation-heading_max7.875545669467039
deviation-heading_mean7.875545669467039
deviation-heading_median7.875545669467039
deviation-heading_min7.875545669467039
distance-from-start_max2.786057442773228
distance-from-start_mean2.786057442773228
distance-from-start_median2.786057442773228
distance-from-start_min2.786057442773228
driven_any_max3.5436077823063186
driven_any_mean3.5436077823063186
driven_any_median3.5436077823063186
driven_any_min3.5436077823063186
driven_lanedir_consec_max3.4359165318271345
driven_lanedir_consec_mean3.4359165318271345
driven_lanedir_consec_min3.4359165318271345
driven_lanedir_max3.4359165318271345
driven_lanedir_mean3.4359165318271345
driven_lanedir_median3.4359165318271345
driven_lanedir_min3.4359165318271345
in-drivable-lane_max1.1999999999999318
in-drivable-lane_mean1.1999999999999318
in-drivable-lane_min1.1999999999999318
per-episodes
details{"loop-000-ego0": {"driven_any": 3.5436077823063186, "survival_time": 59.99999999999873, "driven_lanedir": 3.4359165318271345, "in-drivable-lane": 1.1999999999999318, "deviation-heading": 7.875545669467039, "distance-from-start": 2.786057442773228, "deviation-center-line": 4.892013423501352, "driven_lanedir_consec": 3.4359165318271345}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
166181708Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-validationsim-0of4successyesdavinci-stage-03-6.2.510:04:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.1000000000000156
driven_lanedir_consec_median3.4856553091076994
deviation-center-line_median7.514935466498128


other stats
deviation-center-line_max7.514935466498128
deviation-center-line_mean7.514935466498128
deviation-center-line_min7.514935466498128
deviation-heading_max2.919831926025915
deviation-heading_mean2.919831926025915
deviation-heading_median2.919831926025915
deviation-heading_min2.919831926025915
distance-from-start_max2.8766441843618256
distance-from-start_mean2.8766441843618256
distance-from-start_median2.8766441843618256
distance-from-start_min2.8766441843618256
driven_any_max3.5465963271067142
driven_any_mean3.5465963271067142
driven_any_median3.5465963271067142
driven_any_min3.5465963271067142
driven_lanedir_consec_max3.4856553091076994
driven_lanedir_consec_mean3.4856553091076994
driven_lanedir_consec_min3.4856553091076994
driven_lanedir_max3.4856553091076994
driven_lanedir_mean3.4856553091076994
driven_lanedir_median3.4856553091076994
driven_lanedir_min3.4856553091076994
in-drivable-lane_max1.1000000000000156
in-drivable-lane_mean1.1000000000000156
in-drivable-lane_min1.1000000000000156
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.5465963271067142, "survival_time": 59.99999999999873, "driven_lanedir": 3.4856553091076994, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.919831926025915, "distance-from-start": 2.8766441843618256, "deviation-center-line": 7.514935466498128, "driven_lanedir_consec": 3.4856553091076994}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
166151709Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-validationsim-1of4successyesdavinci-stage-03-6.2.510:05:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.3284423748962833
deviation-center-line_median2.2080698436648767


other stats
deviation-center-line_max2.2080698436648767
deviation-center-line_mean2.2080698436648767
deviation-center-line_min2.2080698436648767
deviation-heading_max3.646079460993991
deviation-heading_mean3.646079460993991
deviation-heading_median3.646079460993991
deviation-heading_min3.646079460993991
distance-from-start_max2.0667500720956693
distance-from-start_mean2.0667500720956693
distance-from-start_median2.0667500720956693
distance-from-start_min2.0667500720956693
driven_any_max3.579583385567372
driven_any_mean3.579583385567372
driven_any_median3.579583385567372
driven_any_min3.579583385567372
driven_lanedir_consec_max3.3284423748962833
driven_lanedir_consec_mean3.3284423748962833
driven_lanedir_consec_min3.3284423748962833
driven_lanedir_max3.558841603983183
driven_lanedir_mean3.558841603983183
driven_lanedir_median3.558841603983183
driven_lanedir_min3.558841603983183
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-000-ego0": {"driven_any": 3.579583385567372, "survival_time": 59.99999999999873, "driven_lanedir": 3.558841603983183, "in-drivable-lane": 0.0, "deviation-heading": 3.646079460993991, "distance-from-start": 2.0667500720956693, "deviation-center-line": 2.2080698436648767, "driven_lanedir_consec": 3.3284423748962833}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
166131709Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-validationsim-3of4successyesdavinci-stage-03-6.2.510:01:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
166081710Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-validationsim-0of4successyesdavinci-stage-03-6.2.510:09:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.200000000000017
driven_lanedir_consec_median2.4146675176310586
deviation-center-line_median3.947705796799454


other stats
deviation-center-line_max6.091229568413222
deviation-center-line_mean4.214852861011506
deviation-center-line_min2.872770282033897
deviation-heading_max6.386481527905395
deviation-heading_mean5.35354556440471
deviation-heading_median5.451360814369008
deviation-heading_min4.1249791009754295
distance-from-start_max2.281674511474288
distance-from-start_mean1.714053337572477
distance-from-start_median1.836882099225881
distance-from-start_min0.900774640363858
driven_any_max3.579588827869872
driven_any_mean3.2555873758340863
driven_any_median3.5015869259609413
driven_any_min2.4395868235445906
driven_lanedir_consec_max3.4224970151785294
driven_lanedir_consec_mean2.2942753407245777
driven_lanedir_consec_min0.9252693124576647
driven_lanedir_max3.5575561401701146
driven_lanedir_mean3.1699347353913017
driven_lanedir_median3.415152633778211
driven_lanedir_min2.2918775338386688
in-drivable-lane_max2.5000000000000355
in-drivable-lane_mean1.2250000000000174
in-drivable-lane_min0.0
per-episodes
details{"udem-001-ego0": {"driven_any": 2.4395868235445906, "survival_time": 59.99999999999873, "driven_lanedir": 2.2918775338386688, "in-drivable-lane": 2.5000000000000355, "deviation-heading": 6.080254254951424, "distance-from-start": 0.900774640363858, "deviation-center-line": 6.091229568413222, "driven_lanedir_consec": 0.9252693124576647}, "udem-001-ego1": {"driven_any": 3.5795872366067147, "survival_time": 59.99999999999873, "driven_lanedir": 3.5575561401701146, "in-drivable-lane": 0.0, "deviation-heading": 4.1249791009754295, "distance-from-start": 2.227888326915521, "deviation-center-line": 2.872770282033897, "driven_lanedir_consec": 3.4083694793883828}, "udem-001-ego2": {"driven_any": 3.579588827869872, "survival_time": 59.99999999999873, "driven_lanedir": 3.554406946632496, "in-drivable-lane": 0.0, "deviation-heading": 4.822467373786592, "distance-from-start": 2.281674511474288, "deviation-center-line": 2.9756165082921022, "driven_lanedir_consec": 3.4224970151785294}, "udem-001-ego3": {"driven_any": 3.4235866153151684, "survival_time": 59.99999999999873, "driven_lanedir": 3.2758983209239267, "in-drivable-lane": 2.400000000000034, "deviation-heading": 6.386481527905395, "distance-from-start": 1.4458758715362408, "deviation-center-line": 4.919795085306806, "driven_lanedir_consec": 1.420965555873734}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
165991713Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-validationsim-3of4successyesdavinci-stage-03-6.2.510:04:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median52.74999999999914
in-drivable-lane_median0.0
driven_lanedir_consec_median3.049495028380312
deviation-center-line_median4.252786905257612


other stats
deviation-center-line_max4.252786905257612
deviation-center-line_mean4.252786905257612
deviation-center-line_min4.252786905257612
deviation-heading_max7.335832537624176
deviation-heading_mean7.335832537624176
deviation-heading_median7.335832537624176
deviation-heading_min7.335832537624176
distance-from-start_max2.5590901305577565
distance-from-start_mean2.5590901305577565
distance-from-start_median2.5590901305577565
distance-from-start_min2.5590901305577565
driven_any_max3.10259355659584
driven_any_mean3.10259355659584
driven_any_median3.10259355659584
driven_any_min3.10259355659584
driven_lanedir_consec_max3.049495028380312
driven_lanedir_consec_mean3.049495028380312
driven_lanedir_consec_min3.049495028380312
driven_lanedir_max3.049495028380312
driven_lanedir_mean3.049495028380312
driven_lanedir_median3.049495028380312
driven_lanedir_min3.049495028380312
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.10259355659584, "survival_time": 52.74999999999914, "driven_lanedir": 3.049495028380312, "in-drivable-lane": 0.0, "deviation-heading": 7.335832537624176, "distance-from-start": 2.5590901305577565, "deviation-center-line": 4.252786905257612, "driven_lanedir_consec": 3.049495028380312}}
simulation-passed1
survival_time_max52.74999999999914
survival_time_mean52.74999999999914
survival_time_min52.74999999999914
No reset possible
165951714Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-testingsim-2of4successyesdavinci-stage-03-6.2.510:03:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.04999999999878
in-drivable-lane_median3.549999999999798
driven_lanedir_consec_median3.250910080242586
deviation-center-line_median6.40909921931243


other stats
deviation-center-line_max6.40909921931243
deviation-center-line_mean6.40909921931243
deviation-center-line_min6.40909921931243
deviation-heading_max5.86874944154476
deviation-heading_mean5.86874944154476
deviation-heading_median5.86874944154476
deviation-heading_min5.86874944154476
distance-from-start_max1.63145897748322
distance-from-start_mean1.63145897748322
distance-from-start_median1.63145897748322
distance-from-start_min1.63145897748322
driven_any_max3.4043224992272147
driven_any_mean3.4043224992272147
driven_any_median3.4043224992272147
driven_any_min3.4043224992272147
driven_lanedir_consec_max3.250910080242586
driven_lanedir_consec_mean3.250910080242586
driven_lanedir_consec_min3.250910080242586
driven_lanedir_max3.250910080242586
driven_lanedir_mean3.250910080242586
driven_lanedir_median3.250910080242586
driven_lanedir_min3.250910080242586
in-drivable-lane_max3.549999999999798
in-drivable-lane_mean3.549999999999798
in-drivable-lane_min3.549999999999798
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.4043224992272147, "survival_time": 59.04999999999878, "driven_lanedir": 3.250910080242586, "in-drivable-lane": 3.549999999999798, "deviation-heading": 5.86874944154476, "distance-from-start": 1.63145897748322, "deviation-center-line": 6.40909921931243, "driven_lanedir_consec": 3.250910080242586}}
simulation-passed1
survival_time_max59.04999999999878
survival_time_mean59.04999999999878
survival_time_min59.04999999999878
No reset possible
165911715Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-testingsim-3of4successyesdavinci-stage-03-6.2.510:02:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
165891715Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-testingsim-0of4successyesdavinci-stage-03-6.2.510:04:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median49.9499999999993
in-drivable-lane_median0.0
driven_lanedir_consec_median2.9030524638411164
deviation-center-line_median3.789617561777741


other stats
deviation-center-line_max3.789617561777741
deviation-center-line_mean3.789617561777741
deviation-center-line_min3.789617561777741
deviation-heading_max4.33452755283993
deviation-heading_mean4.33452755283993
deviation-heading_median4.33452755283993
deviation-heading_min4.33452755283993
distance-from-start_max1.573887224004309
distance-from-start_mean1.573887224004309
distance-from-start_median1.573887224004309
distance-from-start_min1.573887224004309
driven_any_max2.934594724979699
driven_any_mean2.934594724979699
driven_any_median2.934594724979699
driven_any_min2.934594724979699
driven_lanedir_consec_max2.9030524638411164
driven_lanedir_consec_mean2.9030524638411164
driven_lanedir_consec_min2.9030524638411164
driven_lanedir_max2.9099692680363995
driven_lanedir_mean2.9099692680363995
driven_lanedir_median2.9099692680363995
driven_lanedir_min2.9099692680363995
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 2.934594724979699, "survival_time": 49.9499999999993, "driven_lanedir": 2.9099692680363995, "in-drivable-lane": 0.0, "deviation-heading": 4.33452755283993, "distance-from-start": 1.573887224004309, "deviation-center-line": 3.789617561777741, "driven_lanedir_consec": 2.9030524638411164}}
simulation-passed1
survival_time_max49.9499999999993
survival_time_mean49.9499999999993
survival_time_min49.9499999999993
No reset possible
165821717Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-testingsim-2of4successyesdavinci-stage-03-6.2.510:10:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.3736117232564378
deviation-center-line_median3.737280565079689


other stats
deviation-center-line_max3.737280565079689
deviation-center-line_mean3.737280565079689
deviation-center-line_min3.737280565079689
deviation-heading_max4.891434118207675
deviation-heading_mean4.891434118207675
deviation-heading_median4.891434118207675
deviation-heading_min4.891434118207675
distance-from-start_max2.2750369053700705
distance-from-start_mean2.2750369053700705
distance-from-start_median2.2750369053700705
distance-from-start_min2.2750369053700705
driven_any_max3.5795882003110293
driven_any_mean3.5795882003110293
driven_any_median3.5795882003110293
driven_any_min3.5795882003110293
driven_lanedir_consec_max3.3736117232564378
driven_lanedir_consec_mean3.3736117232564378
driven_lanedir_consec_min3.3736117232564378
driven_lanedir_max3.5508258394155683
driven_lanedir_mean3.5508258394155683
driven_lanedir_median3.5508258394155683
driven_lanedir_min3.5508258394155683
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 3.5795882003110293, "survival_time": 59.99999999999873, "driven_lanedir": 3.5508258394155683, "in-drivable-lane": 0.0, "deviation-heading": 4.891434118207675, "distance-from-start": 2.2750369053700705, "deviation-center-line": 3.737280565079689, "driven_lanedir_consec": 3.3736117232564378}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
165781718Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-testingsim-1of4successyesdavinci-stage-03-6.2.510:07:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.7499999999999003
driven_lanedir_consec_median3.413654775946143
deviation-center-line_median5.825136539085346


other stats
deviation-center-line_max7.271389663591529
deviation-center-line_mean5.643680285819743
deviation-center-line_min3.653058401516753
deviation-heading_max7.874648432322972
deviation-heading_mean6.124556829055049
deviation-heading_median6.375210937656442
deviation-heading_min3.873157008584335
distance-from-start_max2.9910037406399708
distance-from-start_mean2.647919639528748
distance-from-start_median2.691628549092109
distance-from-start_min2.2174177192908053
driven_any_max3.546591928181605
driven_any_mean3.512845634385255
driven_any_median3.527100534458862
driven_any_min3.4505895404416917
driven_lanedir_consec_max3.4489608990054887
driven_lanedir_consec_mean3.3789582924454376
driven_lanedir_consec_min3.2395627188839757
driven_lanedir_max3.4489608990054887
driven_lanedir_mean3.3789582924454376
driven_lanedir_median3.413654775946143
driven_lanedir_min3.2395627188839757
in-drivable-lane_max4.299999999999894
in-drivable-lane_mean2.2249999999999277
in-drivable-lane_min1.1000000000000156
per-episodes
details{"loop-000-ego0": {"driven_any": 3.543607782867822, "survival_time": 59.99999999999873, "driven_lanedir": 3.4359237462525183, "in-drivable-lane": 1.1999999999999318, "deviation-heading": 7.874648432322972, "distance-from-start": 2.7860421196308716, "deviation-center-line": 4.889961247945737, "driven_lanedir_consec": 3.4359237462525183}, "loop-000-ego1": {"driven_any": 3.4505895404416917, "survival_time": 59.99999999999873, "driven_lanedir": 3.2395627188839757, "in-drivable-lane": 4.299999999999894, "deviation-heading": 6.05385337048463, "distance-from-start": 2.2174177192908053, "deviation-center-line": 7.271389663591529, "driven_lanedir_consec": 3.2395627188839757}, "loop-000-ego2": {"driven_any": 3.546591928181605, "survival_time": 59.99999999999873, "driven_lanedir": 3.4489608990054887, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 6.696568504828256, "distance-from-start": 2.9910037406399708, "deviation-center-line": 3.653058401516753, "driven_lanedir_consec": 3.4489608990054887}, "loop-000-ego3": {"driven_any": 3.5105932860499025, "survival_time": 59.99999999999873, "driven_lanedir": 3.391385805639767, "in-drivable-lane": 2.2999999999998693, "deviation-heading": 3.873157008584335, "distance-from-start": 2.597214978553346, "deviation-center-line": 6.760311830224953, "driven_lanedir_consec": 3.391385805639767}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
165691720Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-testingsim-0of4successyesdavinci-stage-03-6.2.510:11:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.4692997359006403
deviation-center-line_median3.623644320092078


other stats
deviation-center-line_max3.623644320092078
deviation-center-line_mean3.623644320092078
deviation-center-line_min3.623644320092078
deviation-heading_max11.947232259174388
deviation-heading_mean11.947232259174388
deviation-heading_median11.947232259174388
deviation-heading_min11.947232259174388
distance-from-start_max3.168925231786075
distance-from-start_mean3.168925231786075
distance-from-start_median3.168925231786075
distance-from-start_min3.168925231786075
driven_any_max3.5795865108076983
driven_any_mean3.5795865108076983
driven_any_median3.5795865108076983
driven_any_min3.5795865108076983
driven_lanedir_consec_max3.4692997359006403
driven_lanedir_consec_mean3.4692997359006403
driven_lanedir_consec_min3.4692997359006403
driven_lanedir_max3.4692997359006403
driven_lanedir_mean3.4692997359006403
driven_lanedir_median3.4692997359006403
driven_lanedir_min3.4692997359006403
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.5795865108076983, "survival_time": 59.99999999999873, "driven_lanedir": 3.4692997359006403, "in-drivable-lane": 0.0, "deviation-heading": 11.947232259174388, "distance-from-start": 3.168925231786075, "deviation-center-line": 3.623644320092078, "driven_lanedir_consec": 3.4692997359006403}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
165641723Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-1of4successyesdavinci-stage-03-6.2.510:03:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.700000000000044
in-drivable-lane_median10.950000000000044
driven_lanedir_consec_median0.19955171937759708
deviation-center-line_median0.12567511082985278


other stats
deviation-center-line_max0.12567511082985278
deviation-center-line_mean0.12567511082985278
deviation-center-line_min0.12567511082985278
deviation-heading_max0.9488219555580464
deviation-heading_mean0.9488219555580464
deviation-heading_median0.9488219555580464
deviation-heading_min0.9488219555580464
distance-from-start_max1.924049384083022
distance-from-start_mean1.924049384083022
distance-from-start_median1.924049384083022
distance-from-start_min1.924049384083022
driven_any_max1.924195440713655
driven_any_mean1.924195440713655
driven_any_median1.924195440713655
driven_any_min1.924195440713655
driven_lanedir_consec_max0.19955171937759708
driven_lanedir_consec_mean0.19955171937759708
driven_lanedir_consec_min0.19955171937759708
driven_lanedir_max0.19955171937759708
driven_lanedir_mean0.19955171937759708
driven_lanedir_median0.19955171937759708
driven_lanedir_min0.19955171937759708
in-drivable-lane_max10.950000000000044
in-drivable-lane_mean10.950000000000044
in-drivable-lane_min10.950000000000044
per-episodes
details{"loop-000-ego0": {"driven_any": 1.924195440713655, "survival_time": 12.700000000000044, "driven_lanedir": 0.19955171937759708, "in-drivable-lane": 10.950000000000044, "deviation-heading": 0.9488219555580464, "distance-from-start": 1.924049384083022, "deviation-center-line": 0.12567511082985278, "driven_lanedir_consec": 0.19955171937759708}}
simulation-passed1
survival_time_max12.700000000000044
survival_time_mean12.700000000000044
survival_time_min12.700000000000044
No reset possible
165601723Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-0of4successyesdavinci-stage-03-6.2.510:01:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.2
in-drivable-lane_median0.0
driven_lanedir_consec_median0.16440570511787245
deviation-center-line_median0.19162140900760455


other stats
deviation-center-line_max0.19162140900760455
deviation-center-line_mean0.19162140900760455
deviation-center-line_min0.19162140900760455
deviation-heading_max1.1939422489088862
deviation-heading_mean1.1939422489088862
deviation-heading_median1.1939422489088862
deviation-heading_min1.1939422489088862
distance-from-start_max0.19201183050647508
distance-from-start_mean0.19201183050647508
distance-from-start_median0.19201183050647508
distance-from-start_min0.19201183050647508
driven_any_max0.19201481064322065
driven_any_mean0.19201481064322065
driven_any_median0.19201481064322065
driven_any_min0.19201481064322065
driven_lanedir_consec_max0.16440570511787245
driven_lanedir_consec_mean0.16440570511787245
driven_lanedir_consec_min0.16440570511787245
driven_lanedir_max0.16440570511787245
driven_lanedir_mean0.16440570511787245
driven_lanedir_median0.16440570511787245
driven_lanedir_min0.16440570511787245
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.19201481064322065, "survival_time": 2.2, "driven_lanedir": 0.16440570511787245, "in-drivable-lane": 0.0, "deviation-heading": 1.1939422489088862, "distance-from-start": 0.19201183050647508, "deviation-center-line": 0.19162140900760455, "driven_lanedir_consec": 0.16440570511787245}}
simulation-passed1
survival_time_max2.2
survival_time_mean2.2
survival_time_min2.2
No reset possible
165551725Bea Baselines 🐤minimal-agentaido-LFI-sim-validationsim-1of4successyesdavinci-stage-03-6.2.510:02:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.699999999999984
in-drivable-lane_median4.949999999999983
driven_lanedir_consec_median0.19955565328420843
deviation-center-line_median0.12567493837705537


other stats
deviation-center-line_max0.12567493837705537
deviation-center-line_mean0.12567493837705537
deviation-center-line_min0.12567493837705537
deviation-heading_max0.9488219555580464
deviation-heading_mean0.9488219555580464
deviation-heading_median0.9488219555580464
deviation-heading_min0.9488219555580464
distance-from-start_max0.9347143740566054
distance-from-start_mean0.9347143740566054
distance-from-start_median0.9347143740566054
distance-from-start_min0.9347143740566054
driven_any_max0.9347451682894398
driven_any_mean0.9347451682894398
driven_any_median0.9347451682894398
driven_any_min0.9347451682894398
driven_lanedir_consec_max0.19955565328420843
driven_lanedir_consec_mean0.19955565328420843
driven_lanedir_consec_min0.19955565328420843
driven_lanedir_max0.19955565328420843
driven_lanedir_mean0.19955565328420843
driven_lanedir_median0.19955565328420843
driven_lanedir_min0.19955565328420843
in-drivable-lane_max4.949999999999983
in-drivable-lane_mean4.949999999999983
in-drivable-lane_min4.949999999999983
per-episodes
details{"udem1-000-ego0": {"driven_any": 0.9347451682894398, "survival_time": 6.699999999999984, "driven_lanedir": 0.19955565328420843, "in-drivable-lane": 4.949999999999983, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.9347143740566054, "deviation-center-line": 0.12567493837705537, "driven_lanedir_consec": 0.19955565328420843}}
simulation-passed1
survival_time_max6.699999999999984
survival_time_mean6.699999999999984
survival_time_min6.699999999999984
No reset possible
165491726Bea Baselines 🐤minimal-agentaido-LF-sim-validationsim-3of4successyesdavinci-stage-03-6.2.510:01:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.31872576909325967
survival_time_median12.40000000000004
deviation-center-line_median0.2634611971893196
in-drivable-lane_median9.150000000000045


other stats
deviation-center-line_max0.2634611971893196
deviation-center-line_mean0.2634611971893196
deviation-center-line_min0.2634611971893196
deviation-heading_max2.539741615834614
deviation-heading_mean2.539741615834614
deviation-heading_median2.539741615834614
deviation-heading_min2.539741615834614
distance-from-start_max1.8751243016635968
distance-from-start_mean1.8751243016635968
distance-from-start_median1.8751243016635968
distance-from-start_min1.8751243016635968
driven_any_max1.875978020012028
driven_any_mean1.875978020012028
driven_any_median1.875978020012028
driven_any_min1.875978020012028
driven_lanedir_consec_max0.31872576909325967
driven_lanedir_consec_mean0.31872576909325967
driven_lanedir_consec_min0.31872576909325967
driven_lanedir_max0.31872576909325967
driven_lanedir_mean0.31872576909325967
driven_lanedir_median0.31872576909325967
driven_lanedir_min0.31872576909325967
in-drivable-lane_max9.150000000000045
in-drivable-lane_mean9.150000000000045
in-drivable-lane_min9.150000000000045
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.875978020012028, "survival_time": 12.40000000000004, "driven_lanedir": 0.31872576909325967, "in-drivable-lane": 9.150000000000045, "deviation-heading": 2.539741615834614, "distance-from-start": 1.8751243016635968, "deviation-center-line": 0.2634611971893196, "driven_lanedir_consec": 0.31872576909325967}}
simulation-passed1
survival_time_max12.40000000000004
survival_time_mean12.40000000000004
survival_time_min12.40000000000004
No reset possible
165341731Bea Baselines 🐤minimal-agentlx22-objdetsimsuccessyesdavinci-stage-03-6.2.510:12:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
driven_lanedir_consec_median3.766385412387078


other stats
deviation-center-line_max1.326684653251739
deviation-center-line_mean1.1145360814864316
deviation-center-line_median1.1145360814864316
deviation-center-line_min0.9023875097211244
deviation-heading_max0.9653478875423056
deviation-heading_mean0.8614808538844678
deviation-heading_median0.8614808538844678
deviation-heading_min0.75761382022663
distance-from-start_max9.8511235402485
distance-from-start_mean9.83680867234296
distance-from-start_median9.83680867234296
distance-from-start_min9.822493804437425
driven_any_max9.857519753799252
driven_any_mean9.843192862723654
driven_any_median9.843192862723654
driven_any_min9.828865971648057
driven_lanedir_consec_max5.116504350759583
driven_lanedir_consec_mean3.766385412387078
driven_lanedir_consec_min2.416266474014573
driven_lanedir_max5.116504350759583
driven_lanedir_mean3.766385412387078
driven_lanedir_median3.766385412387078
driven_lanedir_min2.416266474014573
in-drivable-lane_max44.99999999999865
in-drivable-lane_mean36.82499999999853
in-drivable-lane_median36.82499999999853
in-drivable-lane_min28.649999999998418
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 9.857519753799252, "survival_time": 59.99999999999873, "driven_lanedir": 5.116504350759583, "in-drivable-lane": 28.649999999998418, "deviation-heading": 0.9653478875423056, "distance-from-start": 9.8511235402485, "deviation-center-line": 1.326684653251739, "driven_lanedir_consec": 5.116504350759583}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 9.828865971648057, "survival_time": 59.99999999999873, "driven_lanedir": 2.416266474014573, "in-drivable-lane": 44.99999999999865, "deviation-heading": 0.75761382022663, "distance-from-start": 9.822493804437425, "deviation-center-line": 0.9023875097211244, "driven_lanedir_consec": 2.416266474014573}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
165291734Bea Baselines 🐤minimal-agentlx22-BV1sim-4of5successyesdavinci-stage-03-6.2.510:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.4895714408351146


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.4895714408351146
distance-from-start_median0.4895714408351146
distance-from-start_min0.4895714408351146
driven_any_max0.4895812966985538
driven_any_mean0.4895812966985538
driven_any_median0.4895812966985538
driven_any_min0.4895812966985538
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max3.999999999999994
in-drivable-lane_mean3.999999999999994
in-drivable-lane_median3.999999999999994
in-drivable-lane_min3.999999999999994
per-episodes
details{"d60-ego0": {"driven_any": 0.4895812966985538, "survival_time": 3.999999999999994, "driven_lanedir": 0.0, "in-drivable-lane": 3.999999999999994, "deviation-heading": 0.0, "distance-from-start": 0.4895714408351146, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max3.999999999999994
survival_time_mean3.999999999999994
survival_time_median3.999999999999994
survival_time_min3.999999999999994
No reset possible
165261737Bea Baselines 🐤minimal-agentaido-hello-sim-validationsanity-checksuccessyesdavinci-stage-03-6.2.510:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.027182527438338155
deviation-center-line_median0.005231420846612685


other stats
deviation-center-line_max0.005231420846612685
deviation-center-line_mean0.005231420846612685
deviation-center-line_min0.005231420846612685
deviation-heading_max0.26820132194453994
deviation-heading_mean0.26820132194453994
deviation-heading_median0.26820132194453994
deviation-heading_min0.26820132194453994
distance-from-start_max0.03160072536398472
distance-from-start_mean0.03160072536398472
distance-from-start_median0.03160072536398472
distance-from-start_min0.03160072536398472
driven_any_max0.03160074670807487
driven_any_mean0.03160074670807487
driven_any_median0.03160074670807487
driven_any_min0.03160074670807487
driven_lanedir_consec_max0.027182527438338155
driven_lanedir_consec_mean0.027182527438338155
driven_lanedir_consec_min0.027182527438338155
driven_lanedir_max0.027182527438338155
driven_lanedir_mean0.027182527438338155
driven_lanedir_median0.027182527438338155
driven_lanedir_min0.027182527438338155
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.03160074670807487, "survival_time": 0.49999999999999994, "driven_lanedir": 0.027182527438338155, "in-drivable-lane": 0.0, "deviation-heading": 0.26820132194453994, "distance-from-start": 0.03160072536398472, "deviation-center-line": 0.005231420846612685, "driven_lanedir_consec": 0.027182527438338155}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
165211742Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-0of4successyesdavinci-stage-03-6.2.510:02:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.549999999999985
in-drivable-lane_median5.149999999999984
driven_lanedir_consec_median0.1366674275206068
deviation-center-line_median0.10783868180360472


other stats
deviation-center-line_max0.10783868180360472
deviation-center-line_mean0.10783868180360472
deviation-center-line_min0.10783868180360472
deviation-heading_max0.9508048428349388
deviation-heading_mean0.9508048428349388
deviation-heading_median0.9508048428349388
deviation-heading_min0.9508048428349388
distance-from-start_max0.9098858043373246
distance-from-start_mean0.9098858043373246
distance-from-start_median0.9098858043373246
distance-from-start_min0.9098858043373246
driven_any_max0.9099105248203296
driven_any_mean0.9099105248203296
driven_any_median0.9099105248203296
driven_any_min0.9099105248203296
driven_lanedir_consec_max0.1366674275206068
driven_lanedir_consec_mean0.1366674275206068
driven_lanedir_consec_min0.1366674275206068
driven_lanedir_max0.1366674275206068
driven_lanedir_mean0.1366674275206068
driven_lanedir_median0.1366674275206068
driven_lanedir_min0.1366674275206068
in-drivable-lane_max5.149999999999984
in-drivable-lane_mean5.149999999999984
in-drivable-lane_min5.149999999999984
per-episodes
details{"udem-000-ego0": {"driven_any": 0.9099105248203296, "survival_time": 6.549999999999985, "driven_lanedir": 0.1366674275206068, "in-drivable-lane": 5.149999999999984, "deviation-heading": 0.9508048428349388, "distance-from-start": 0.9098858043373246, "deviation-center-line": 0.10783868180360472, "driven_lanedir_consec": 0.1366674275206068}}
simulation-passed1
survival_time_max6.549999999999985
survival_time_mean6.549999999999985
survival_time_min6.549999999999985
No reset possible
165161743Bea Baselines 🐤minimal-agentaido-LFI-sim-testingsim-2of4successyesdavinci-stage-03-6.2.510:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
165121744Bea Baselines 🐤minimal-agentaido-LF-sim-testingsim-1of4successyesdavinci-stage-03-6.2.510:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1366657585905522
survival_time_median7.549999999999981
deviation-center-line_median0.10783809919009872
in-drivable-lane_median6.149999999999981


other stats
deviation-center-line_max0.10783809919009872
deviation-center-line_mean0.10783809919009872
deviation-center-line_min0.10783809919009872
deviation-heading_max0.9508048428349384
deviation-heading_mean0.9508048428349384
deviation-heading_median0.9508048428349384
deviation-heading_min0.9508048428349384
distance-from-start_max1.076322287151137
distance-from-start_mean1.076322287151137
distance-from-start_median1.076322287151137
distance-from-start_min1.076322287151137
driven_any_max1.0763767010128955
driven_any_mean1.0763767010128955
driven_any_median1.0763767010128955
driven_any_min1.0763767010128955
driven_lanedir_consec_max0.1366657585905522
driven_lanedir_consec_mean0.1366657585905522
driven_lanedir_consec_min0.1366657585905522
driven_lanedir_max0.1366657585905522
driven_lanedir_mean0.1366657585905522
driven_lanedir_median0.1366657585905522
driven_lanedir_min0.1366657585905522
in-drivable-lane_max6.149999999999981
in-drivable-lane_mean6.149999999999981
in-drivable-lane_min6.149999999999981
per-episodes
details{"loop-000-ego0": {"driven_any": 1.0763767010128955, "survival_time": 7.549999999999981, "driven_lanedir": 0.1366657585905522, "in-drivable-lane": 6.149999999999981, "deviation-heading": 0.9508048428349384, "distance-from-start": 1.076322287151137, "deviation-center-line": 0.10783809919009872, "driven_lanedir_consec": 0.1366657585905522}}
simulation-passed1
survival_time_max7.549999999999981
survival_time_mean7.549999999999981
survival_time_min7.549999999999981
No reset possible
165081745Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-testingsim-2of4successyesdavinci-stage-03-6.2.510:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
165051745Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-testingsim-1of4successyesdavinci-stage-03-6.2.510:03:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.79999999999998
in-drivable-lane_median6.174999999999979
driven_lanedir_consec_median0.18712389148079245
deviation-center-line_median0.15973064632096934


other stats
deviation-center-line_max0.25956483782942774
deviation-center-line_mean0.17171613953350223
deviation-center-line_min0.1078384276626425
deviation-heading_max0.9508048428349388
deviation-heading_mean0.7378303653221978
deviation-heading_median0.7134396501489888
deviation-heading_min0.5736373181558746
distance-from-start_max1.1174703819521252
distance-from-start_mean0.5801993351597357
distance-from-start_median0.4397243952004576
distance-from-start_min0.323878168285902
driven_any_max1.1175260347648366
driven_any_mean0.5802187299655663
driven_any_median0.4397328577718137
driven_any_min0.3238831695538013
driven_lanedir_consec_max0.6843001798814146
driven_lanedir_consec_mean0.2932298736878741
driven_lanedir_consec_min0.11437153190849704
driven_lanedir_max0.6843001798814146
driven_lanedir_mean0.2932298736878741
driven_lanedir_median0.18712389148079245
driven_lanedir_min0.11437153190849704
in-drivable-lane_max6.59999999999998
in-drivable-lane_mean5.549999999999982
in-drivable-lane_min3.2499999999999885
per-episodes
details{"4way-000-ego0": {"driven_any": 0.5146585239873271, "survival_time": 7.79999999999998, "driven_lanedir": 0.13666599700910398, "in-drivable-lane": 6.39999999999998, "deviation-heading": 0.9508048428349388, "distance-from-start": 0.5146479428595184, "deviation-center-line": 0.1078384276626425, "driven_lanedir_consec": 0.13666599700910398}, "4way-000-ego1": {"driven_any": 0.3648071915563002, "survival_time": 7.79999999999998, "driven_lanedir": 0.23758178595248092, "in-drivable-lane": 5.94999999999998, "deviation-heading": 0.5736373181558746, "distance-from-start": 0.36480084754139674, "deviation-center-line": 0.20320962418622623, "driven_lanedir_consec": 0.23758178595248092}, "4way-000-ego2": {"driven_any": 1.1175260347648366, "survival_time": 7.79999999999998, "driven_lanedir": 0.6843001798814146, "in-drivable-lane": 3.2499999999999885, "deviation-heading": 0.6676943794629474, "distance-from-start": 1.1174703819521252, "deviation-center-line": 0.25956483782942774, "driven_lanedir_consec": 0.6843001798814146}, "4way-000-ego3": {"driven_any": 0.3238831695538013, "survival_time": 7.79999999999998, "driven_lanedir": 0.11437153190849704, "in-drivable-lane": 6.59999999999998, "deviation-heading": 0.7591849208350303, "distance-from-start": 0.323878168285902, "deviation-center-line": 0.11625166845571244, "driven_lanedir_consec": 0.11437153190849704}}
simulation-passed1
survival_time_max7.79999999999998
survival_time_mean7.79999999999998
survival_time_min7.79999999999998
No reset possible
164961748Bea Baselines 🐤template-pytorchaido-LFV-sim-validationsim-3of4successyesdavinci-stage-03-6.2.510:07:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median17.500000000000114
in-drivable-lane_median12.500000000000089
driven_lanedir_consec_median0.5183011872925802
deviation-center-line_median0.6005682519449633


other stats
deviation-center-line_max0.6005682519449633
deviation-center-line_mean0.6005682519449633
deviation-center-line_min0.6005682519449633
deviation-heading_max3.450714881057225
deviation-heading_mean3.450714881057225
deviation-heading_median3.450714881057225
deviation-heading_min3.450714881057225
distance-from-start_max0.39470454950972034
distance-from-start_mean0.39470454950972034
distance-from-start_median0.39470454950972034
distance-from-start_min0.39470454950972034
driven_any_max2.7697042769336004
driven_any_mean2.7697042769336004
driven_any_median2.7697042769336004
driven_any_min2.7697042769336004
driven_lanedir_consec_max0.5183011872925802
driven_lanedir_consec_mean0.5183011872925802
driven_lanedir_consec_min0.5183011872925802
driven_lanedir_max0.5183011872925802
driven_lanedir_mean0.5183011872925802
driven_lanedir_median0.5183011872925802
driven_lanedir_min0.5183011872925802
in-drivable-lane_max12.500000000000089
in-drivable-lane_mean12.500000000000089
in-drivable-lane_min12.500000000000089
per-episodes
details{"zigzag-000-ego0": {"driven_any": 2.7697042769336004, "survival_time": 17.500000000000114, "driven_lanedir": 0.5183011872925802, "in-drivable-lane": 12.500000000000089, "deviation-heading": 3.450714881057225, "distance-from-start": 0.39470454950972034, "deviation-center-line": 0.6005682519449633, "driven_lanedir_consec": 0.5183011872925802}}
simulation-passed1
survival_time_max17.500000000000114
survival_time_mean17.500000000000114
survival_time_min17.500000000000114
No reset possible
164951748Bea Baselines 🐤template-pytorchaido-LFV-sim-validationsim-0of4successyesdavinci-stage-03-6.2.510:02:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.850000000000001
in-drivable-lane_median0.8000000000000007
driven_lanedir_consec_median0.10976112723874376
deviation-center-line_median0.05858204157622809


other stats
deviation-center-line_max0.05858204157622809
deviation-center-line_mean0.05858204157622809
deviation-center-line_min0.05858204157622809
deviation-heading_max0.7734206499356491
deviation-heading_mean0.7734206499356491
deviation-heading_median0.7734206499356491
deviation-heading_min0.7734206499356491
distance-from-start_max0.18464904812645264
distance-from-start_mean0.18464904812645264
distance-from-start_median0.18464904812645264
distance-from-start_min0.18464904812645264
driven_any_max0.1880204845392568
driven_any_mean0.1880204845392568
driven_any_median0.1880204845392568
driven_any_min0.1880204845392568
driven_lanedir_consec_max0.10976112723874376
driven_lanedir_consec_mean0.10976112723874376
driven_lanedir_consec_min0.10976112723874376
driven_lanedir_max0.10976112723874376
driven_lanedir_mean0.10976112723874376
driven_lanedir_median0.10976112723874376
driven_lanedir_min0.10976112723874376
in-drivable-lane_max0.8000000000000007
in-drivable-lane_mean0.8000000000000007
in-drivable-lane_min0.8000000000000007
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.1880204845392568, "survival_time": 1.850000000000001, "driven_lanedir": 0.10976112723874376, "in-drivable-lane": 0.8000000000000007, "deviation-heading": 0.7734206499356491, "distance-from-start": 0.18464904812645264, "deviation-center-line": 0.05858204157622809, "driven_lanedir_consec": 0.10976112723874376}}
simulation-passed1
survival_time_max1.850000000000001
survival_time_mean1.850000000000001
survival_time_min1.850000000000001
No reset possible
164931749Bea Baselines 🐤template-pytorchaido-LFVI-sim-validationsim-2of4successyesdavinci-stage-03-6.2.510:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
164901749Bea Baselines 🐤template-pytorchaido-LFVI-sim-validationsim-1of4successyesdavinci-stage-03-6.2.510:02:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.4499999999999993
in-drivable-lane_median1.6999999999999993
driven_lanedir_consec_median0.02289027196978033
deviation-center-line_median0.012951349896566097


other stats
deviation-center-line_max0.012951349896566097
deviation-center-line_mean0.012951349896566097
deviation-center-line_min0.012951349896566097
deviation-heading_max0.6305528241681043
deviation-heading_mean0.6305528241681043
deviation-heading_median0.6305528241681043
deviation-heading_min0.6305528241681043
distance-from-start_max0.06944335541211777
distance-from-start_mean0.06944335541211777
distance-from-start_median0.06944335541211777
distance-from-start_min0.06944335541211777
driven_any_max0.1250737696464561
driven_any_mean0.1250737696464561
driven_any_median0.1250737696464561
driven_any_min0.1250737696464561
driven_lanedir_consec_max0.02289027196978033
driven_lanedir_consec_mean0.02289027196978033
driven_lanedir_consec_min0.02289027196978033
driven_lanedir_max0.02289027196978033
driven_lanedir_mean0.02289027196978033
driven_lanedir_median0.02289027196978033
driven_lanedir_min0.02289027196978033
in-drivable-lane_max1.6999999999999993
in-drivable-lane_mean1.6999999999999993
in-drivable-lane_min1.6999999999999993
per-episodes
details{"4way-000-ego0": {"driven_any": 0.1250737696464561, "survival_time": 2.4499999999999993, "driven_lanedir": 0.02289027196978033, "in-drivable-lane": 1.6999999999999993, "deviation-heading": 0.6305528241681043, "distance-from-start": 0.06944335541211777, "deviation-center-line": 0.012951349896566097, "driven_lanedir_consec": 0.02289027196978033}}
simulation-passed1
survival_time_max2.4499999999999993
survival_time_mean2.4499999999999993
survival_time_min2.4499999999999993
No reset possible
164881750Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-2of4successyesdavinci-stage-03-6.2.510:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
164841751Bea Baselines 🐤template-pytorchaido-LF-sim-validationsim-2of4successyesdavinci-stage-03-6.2.510:06:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4703271325767604
survival_time_median59.99999999999873
deviation-center-line_median2.318260405698643
in-drivable-lane_median40.04999999999903


other stats
deviation-center-line_max2.318260405698643
deviation-center-line_mean2.318260405698643
deviation-center-line_min2.318260405698643
deviation-heading_max13.079182116644208
deviation-heading_mean13.079182116644208
deviation-heading_median13.079182116644208
deviation-heading_min13.079182116644208
distance-from-start_max0.6335574831861017
distance-from-start_mean0.6335574831861017
distance-from-start_median0.6335574831861017
distance-from-start_min0.6335574831861017
driven_any_max9.906275376446514
driven_any_mean9.906275376446514
driven_any_median9.906275376446514
driven_any_min9.906275376446514
driven_lanedir_consec_max1.4703271325767604
driven_lanedir_consec_mean1.4703271325767604
driven_lanedir_consec_min1.4703271325767604
driven_lanedir_max2.3479253699295164
driven_lanedir_mean2.3479253699295164
driven_lanedir_median2.3479253699295164
driven_lanedir_min2.3479253699295164
in-drivable-lane_max40.04999999999903
in-drivable-lane_mean40.04999999999903
in-drivable-lane_min40.04999999999903
per-episodes
details{"loop2-000-ego0": {"driven_any": 9.906275376446514, "survival_time": 59.99999999999873, "driven_lanedir": 2.3479253699295164, "in-drivable-lane": 40.04999999999903, "deviation-heading": 13.079182116644208, "distance-from-start": 0.6335574831861017, "deviation-center-line": 2.318260405698643, "driven_lanedir_consec": 1.4703271325767604}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
164811751Bea Baselines 🐤template-pytorchaido-LF-sim-validationsim-3of4successyesdavinci-stage-03-6.2.510:08:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.286360184626066
survival_time_median59.99999999999873
deviation-center-line_median1.339924215500536
in-drivable-lane_median46.84999999999887


other stats
deviation-center-line_max1.339924215500536
deviation-center-line_mean1.339924215500536
deviation-center-line_min1.339924215500536
deviation-heading_max13.167088996044969
deviation-heading_mean13.167088996044969
deviation-heading_median13.167088996044969
deviation-heading_min13.167088996044969
distance-from-start_max0.29610542301688025
distance-from-start_mean0.29610542301688025
distance-from-start_median0.29610542301688025
distance-from-start_min0.29610542301688025
driven_any_max12.03350498596885
driven_any_mean12.03350498596885
driven_any_median12.03350498596885
driven_any_min12.03350498596885
driven_lanedir_consec_max1.286360184626066
driven_lanedir_consec_mean1.286360184626066
driven_lanedir_consec_min1.286360184626066
driven_lanedir_max1.286476747069294
driven_lanedir_mean1.286476747069294
driven_lanedir_median1.286476747069294
driven_lanedir_min1.286476747069294
in-drivable-lane_max46.84999999999887
in-drivable-lane_mean46.84999999999887
in-drivable-lane_min46.84999999999887
per-episodes
details{"zigzag-000-ego0": {"driven_any": 12.03350498596885, "survival_time": 59.99999999999873, "driven_lanedir": 1.286476747069294, "in-drivable-lane": 46.84999999999887, "deviation-heading": 13.167088996044969, "distance-from-start": 0.29610542301688025, "deviation-center-line": 1.339924215500536, "driven_lanedir_consec": 1.286360184626066}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
164801752Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-1of4host-erroryesdavinci-stage-03-6.2.510:01:44
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 390, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.model = DDPG(state_dim=self.preprocessor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/submission/model.py", line 153, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 390, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.model = DDPG(state_dim=self.preprocessor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/submission/model.py", line 153, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
164791752Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-2of4successyesdavinci-stage-03-6.2.510:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
164781752Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-3of4successyesdavinci-stage-03-6.2.510:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
164731753Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-validationsim-2of4successyesdavinci-stage-03-6.2.510:13:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median37.84999999999917
driven_lanedir_consec_median1.3762361510311725
deviation-center-line_median1.8205624711389827


other stats
deviation-center-line_max1.973064862863822
deviation-center-line_mean1.8205624711389827
deviation-center-line_min1.6680600794141438
deviation-heading_max20.702420070250856
deviation-heading_mean18.621047753290753
deviation-heading_median18.621047753290753
deviation-heading_min16.53967543633065
distance-from-start_max0.8448827929496168
distance-from-start_mean0.6750369650826796
distance-from-start_median0.6750369650826796
distance-from-start_min0.5051911372157425
driven_any_max9.245219449146989
driven_any_mean8.182596266133014
driven_any_median8.182596266133014
driven_any_min7.119973083119043
driven_lanedir_consec_max1.4993746970046178
driven_lanedir_consec_mean1.3762361510311725
driven_lanedir_consec_min1.2530976050577267
driven_lanedir_max1.7053755754744249
driven_lanedir_mean1.6865103475684171
driven_lanedir_median1.6865103475684171
driven_lanedir_min1.66764511966241
in-drivable-lane_max41.04999999999902
in-drivable-lane_mean37.84999999999917
in-drivable-lane_min34.64999999999932
per-episodes
details{"loop2-000-ego0": {"driven_any": 7.119973083119043, "survival_time": 59.99999999999873, "driven_lanedir": 1.7053755754744249, "in-drivable-lane": 34.64999999999932, "deviation-heading": 20.702420070250856, "distance-from-start": 0.8448827929496168, "deviation-center-line": 1.6680600794141438, "driven_lanedir_consec": 1.2530976050577267}, "loop2-000-ego1": {"driven_any": 9.245219449146989, "survival_time": 59.99999999999873, "driven_lanedir": 1.66764511966241, "in-drivable-lane": 41.04999999999902, "deviation-heading": 16.53967543633065, "distance-from-start": 0.5051911372157425, "deviation-center-line": 1.973064862863822, "driven_lanedir_consec": 1.4993746970046178}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
164681755Bea Baselines 🐤template-pytorchlx22-modconsimsuccessyesdavinci-stage-03-6.2.510:09:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median35.92499999999954
deviation-center-line_median0.7208995785009187
driven_lanedir_consec_median0.5545885087526398
survival_time_median42.67499999999948


other stats
deviation-center-line_max1.268906908783161
deviation-center-line_mean0.7208995785009187
deviation-center-line_min0.1728922482186763
deviation-heading_max13.144757066494028
deviation-heading_mean7.462371105585805
deviation-heading_median7.462371105585805
deviation-heading_min1.7799851446775818
distance-from-start_max1.3237555022448242
distance-from-start_mean0.8648356783550832
distance-from-start_median0.8648356783550832
distance-from-start_min0.4059158544653423
driven_any_max13.853228376912709
driven_any_mean9.78266586843668
driven_any_median9.78266586843668
driven_any_min5.712103359960654
driven_lanedir_consec_max1.0465714633039496
driven_lanedir_consec_mean0.5545885087526398
driven_lanedir_consec_min0.06260555420132996
driven_lanedir_max1.2617769841693822
driven_lanedir_mean0.6621912691853561
driven_lanedir_median0.6621912691853561
driven_lanedir_min0.06260555420132996
in-drivable-lane_max47.799999999998875
in-drivable-lane_mean35.92499999999954
in-drivable-lane_min24.05000000000021
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 13.853228376912709, "survival_time": 59.99999999999873, "driven_lanedir": 1.2617769841693822, "in-drivable-lane": 47.799999999998875, "deviation-heading": 13.144757066494028, "distance-from-start": 1.3237555022448242, "deviation-center-line": 1.268906908783161, "driven_lanedir_consec": 1.0465714633039496}, "LF-full-loop-001-ego0": {"driven_any": 5.712103359960654, "survival_time": 25.350000000000225, "driven_lanedir": 0.06260555420132996, "in-drivable-lane": 24.05000000000021, "deviation-heading": 1.7799851446775818, "distance-from-start": 0.4059158544653423, "deviation-center-line": 0.1728922482186763, "driven_lanedir_consec": 0.06260555420132996}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean42.67499999999948
survival_time_min25.350000000000225
No reset possible
164661757Bea Baselines 🐤template-pytorchlx22-visservoingsimsuccessyesdavinci-stage-03-6.2.510:04:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median21.024999999999515
deviation-center-line_median0.8310203673386801
driven_lanedir_consec_median0.8309444052725339
survival_time_median31.299999999999365


other stats
deviation-center-line_max1.5812284102141847
deviation-center-line_mean0.8310203673386801
deviation-center-line_min0.0808123244631756
deviation-heading_max14.251526584793622
deviation-heading_mean7.570463917970621
deviation-heading_median7.570463917970621
deviation-heading_min0.8894012511476214
distance-from-start_max0.5995430559332351
distance-from-start_mean0.4032808357521209
distance-from-start_median0.4032808357521209
distance-from-start_min0.20701861557100676
driven_any_max10.700701043756853
driven_any_mean5.474973891901727
driven_any_median5.474973891901727
driven_any_min0.24924674004660147
driven_lanedir_consec_max1.5335981165439203
driven_lanedir_consec_mean0.8309444052725339
driven_lanedir_consec_min0.12829069400114734
driven_lanedir_max2.266182255585174
driven_lanedir_mean1.1972364747931608
driven_lanedir_median1.1972364747931608
driven_lanedir_min0.12829069400114734
in-drivable-lane_max40.999999999999034
in-drivable-lane_mean21.024999999999515
in-drivable-lane_min1.049999999999998
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 10.700701043756853, "survival_time": 59.99999999999873, "driven_lanedir": 2.266182255585174, "in-drivable-lane": 40.999999999999034, "deviation-heading": 14.251526584793622, "distance-from-start": 0.5995430559332351, "deviation-center-line": 1.5812284102141847, "driven_lanedir_consec": 1.5335981165439203}, "LF-small-loop-001-ego0": {"driven_any": 0.24924674004660147, "survival_time": 2.5999999999999988, "driven_lanedir": 0.12829069400114734, "in-drivable-lane": 1.049999999999998, "deviation-heading": 0.8894012511476214, "distance-from-start": 0.20701861557100676, "deviation-center-line": 0.0808123244631756, "driven_lanedir_consec": 0.12829069400114734}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean31.299999999999365
survival_time_min2.5999999999999988
No reset possible
164621759Bea Baselines 🐤template-pytorchlx22-BV1sim-0of5successyesdavinci-stage-03-6.2.510:01:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.6083865225799603


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.6083865225799603
distance-from-start_median0.6083865225799603
distance-from-start_min0.6083865225799603
driven_any_max0.7088457777499292
driven_any_mean0.7088457777499292
driven_any_median0.7088457777499292
driven_any_min0.7088457777499292
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max4.399999999999992
in-drivable-lane_mean4.399999999999992
in-drivable-lane_median4.399999999999992
in-drivable-lane_min4.399999999999992
per-episodes
details{"d30-ego0": {"driven_any": 0.7088457777499292, "survival_time": 4.399999999999992, "driven_lanedir": 0.0, "in-drivable-lane": 4.399999999999992, "deviation-heading": 0.0, "distance-from-start": 0.6083865225799603, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max4.399999999999992
survival_time_mean4.399999999999992
survival_time_median4.399999999999992
survival_time_min4.399999999999992
No reset possible
164561766Bea Baselines 🐤template-pytorchaido-LFV-sim-testingsim-3of4successyesdavinci-stage-03-6.2.510:08:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median21.35000000000017
in-drivable-lane_median15.00000000000014
driven_lanedir_consec_median0.8700823110614846
deviation-center-line_median0.562932922307127


other stats
deviation-center-line_max0.562932922307127
deviation-center-line_mean0.562932922307127
deviation-center-line_min0.562932922307127
deviation-heading_max4.3098760896757335
deviation-heading_mean4.3098760896757335
deviation-heading_median4.3098760896757335
deviation-heading_min4.3098760896757335
distance-from-start_max0.34554112896050165
distance-from-start_mean0.34554112896050165
distance-from-start_median0.34554112896050165
distance-from-start_min0.34554112896050165
driven_any_max4.015833978904281
driven_any_mean4.015833978904281
driven_any_median4.015833978904281
driven_any_min4.015833978904281
driven_lanedir_consec_max0.8700823110614846
driven_lanedir_consec_mean0.8700823110614846
driven_lanedir_consec_min0.8700823110614846
driven_lanedir_max0.8700823110614846
driven_lanedir_mean0.8700823110614846
driven_lanedir_median0.8700823110614846
driven_lanedir_min0.8700823110614846
in-drivable-lane_max15.00000000000014
in-drivable-lane_mean15.00000000000014
in-drivable-lane_min15.00000000000014
per-episodes
details{"zigzag-000-ego0": {"driven_any": 4.015833978904281, "survival_time": 21.35000000000017, "driven_lanedir": 0.8700823110614846, "in-drivable-lane": 15.00000000000014, "deviation-heading": 4.3098760896757335, "distance-from-start": 0.34554112896050165, "deviation-center-line": 0.562932922307127, "driven_lanedir_consec": 0.8700823110614846}}
simulation-passed1
survival_time_max21.35000000000017
survival_time_mean21.35000000000017
survival_time_min21.35000000000017
No reset possible
164531767Bea Baselines 🐤template-pytorchaido-LFVI-sim-testingsim-3of4successyesdavinci-stage-03-6.2.510:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
164471768Bea Baselines 🐤template-pytorchaido-LFI-sim-testingsim-1of4successyesdavinci-stage-03-6.2.510:03:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.699999999999991
in-drivable-lane_median2.3499999999999917
driven_lanedir_consec_median0.284751493232718
deviation-center-line_median0.09989043228450473


other stats
deviation-center-line_max0.09989043228450473
deviation-center-line_mean0.09989043228450473
deviation-center-line_min0.09989043228450473
deviation-heading_max1.3021829538792178
deviation-heading_mean1.3021829538792178
deviation-heading_median1.3021829538792178
deviation-heading_min1.3021829538792178
distance-from-start_max0.3024306801578253
distance-from-start_mean0.3024306801578253
distance-from-start_median0.3024306801578253
distance-from-start_min0.3024306801578253
driven_any_max0.6273094125029657
driven_any_mean0.6273094125029657
driven_any_median0.6273094125029657
driven_any_min0.6273094125029657
driven_lanedir_consec_max0.284751493232718
driven_lanedir_consec_mean0.284751493232718
driven_lanedir_consec_min0.284751493232718
driven_lanedir_max0.284751493232718
driven_lanedir_mean0.284751493232718
driven_lanedir_median0.284751493232718
driven_lanedir_min0.284751493232718
in-drivable-lane_max2.3499999999999917
in-drivable-lane_mean2.3499999999999917
in-drivable-lane_min2.3499999999999917
per-episodes
details{"udem1-000-ego0": {"driven_any": 0.6273094125029657, "survival_time": 4.699999999999991, "driven_lanedir": 0.284751493232718, "in-drivable-lane": 2.3499999999999917, "deviation-heading": 1.3021829538792178, "distance-from-start": 0.3024306801578253, "deviation-center-line": 0.09989043228450473, "driven_lanedir_consec": 0.284751493232718}}
simulation-passed1
survival_time_max4.699999999999991
survival_time_mean4.699999999999991
survival_time_min4.699999999999991
No reset possible
164441769Bea Baselines 🐤template-pytorchaido-LF-sim-testingsim-3of4successyesdavinci-stage-03-6.2.510:09:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.1115127327115393
survival_time_median59.99999999999873
deviation-center-line_median1.3798716288371509
in-drivable-lane_median45.09999999999887


other stats
deviation-center-line_max1.3798716288371509
deviation-center-line_mean1.3798716288371509
deviation-center-line_min1.3798716288371509
deviation-heading_max11.661195687864248
deviation-heading_mean11.661195687864248
deviation-heading_median11.661195687864248
deviation-heading_min11.661195687864248
distance-from-start_max0.7156700270164421
distance-from-start_mean0.7156700270164421
distance-from-start_median0.7156700270164421
distance-from-start_min0.7156700270164421
driven_any_max9.825993609550258
driven_any_mean9.825993609550258
driven_any_median9.825993609550258
driven_any_min9.825993609550258
driven_lanedir_consec_max1.1115127327115393
driven_lanedir_consec_mean1.1115127327115393
driven_lanedir_consec_min1.1115127327115393
driven_lanedir_max1.5141982349323304
driven_lanedir_mean1.5141982349323304
driven_lanedir_median1.5141982349323304
driven_lanedir_min1.5141982349323304
in-drivable-lane_max45.09999999999887
in-drivable-lane_mean45.09999999999887
in-drivable-lane_min45.09999999999887
per-episodes
details{"zigzag-000-ego0": {"driven_any": 9.825993609550258, "survival_time": 59.99999999999873, "driven_lanedir": 1.5141982349323304, "in-drivable-lane": 45.09999999999887, "deviation-heading": 11.661195687864248, "distance-from-start": 0.7156700270164421, "deviation-center-line": 1.3798716288371509, "driven_lanedir_consec": 1.1115127327115393}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
164431850Andrea Danielelx22-visservoinglx22-visservoingsimfailedyesdavinci-stage-03-6.2.510:02:33
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 722, in run_episode
    msg = await loop.run_in_executor(executor, f)
  File "/usr/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 243, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 333, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 360, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 418, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 591, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/submission_ws/src/agent/src/solution.py", line 81, in on_received_get_commands
              ||     raise Exception(msg)
              || Exception: I have been waiting for commands from the ROS part since 60 s
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
164361771Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-testingsim-3of4successyesdavinci-stage-03-6.2.510:16:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median40.79999999999982
in-drivable-lane_median34.649999999999814
driven_lanedir_consec_median0.5201778335215335
deviation-center-line_median0.5033983244535749


other stats
deviation-center-line_max0.8091889962960607
deviation-center-line_mean0.473695219513447
deviation-center-line_min0.07879523285057742
deviation-heading_max8.826955184088073
deviation-heading_mean4.52880939310061
deviation-heading_median4.43299018341178
deviation-heading_min0.4223020214908056
distance-from-start_max0.5670452882835323
distance-from-start_mean0.389037812148862
distance-from-start_median0.4019432918468391
distance-from-start_min0.1852193766182376
driven_any_max7.210987597390302
driven_any_mean2.699233463724466
driven_any_median1.5268782790043518
driven_any_min0.5321896994988577
driven_lanedir_consec_max1.4619927474008945
driven_lanedir_consec_mean0.6535540991632546
driven_lanedir_consec_min0.11186798220905692
driven_lanedir_max1.4619927474008945
driven_lanedir_mean0.6535540991632546
driven_lanedir_median0.5201778335215335
driven_lanedir_min0.11186798220905692
in-drivable-lane_max39.94999999999982
in-drivable-lane_mean34.412499999999795
in-drivable-lane_min28.39999999999971
per-episodes
details{"zigzag-000-ego0": {"driven_any": 7.210987597390302, "survival_time": 40.79999999999982, "driven_lanedir": 1.4619927474008945, "in-drivable-lane": 28.39999999999971, "deviation-heading": 8.826955184088073, "distance-from-start": 0.5670452882835323, "deviation-center-line": 0.8091889962960607, "driven_lanedir_consec": 1.4619927474008945}, "zigzag-000-ego1": {"driven_any": 0.5321896994988577, "survival_time": 40.79999999999982, "driven_lanedir": 0.11186798220905692, "in-drivable-lane": 39.94999999999982, "deviation-heading": 0.4223020214908056, "distance-from-start": 0.4757396962419171, "deviation-center-line": 0.07879523285057742, "driven_lanedir_consec": 0.11186798220905692}, "zigzag-000-ego2": {"driven_any": 2.066026288700556, "survival_time": 40.79999999999982, "driven_lanedir": 0.8098012840229142, "in-drivable-lane": 33.04999999999981, "deviation-heading": 5.423814646503306, "distance-from-start": 0.3281468874517611, "deviation-center-line": 0.4526197809221165, "driven_lanedir_consec": 0.8098012840229142}, "zigzag-000-ego3": {"driven_any": 0.9877302693081476, "survival_time": 40.79999999999982, "driven_lanedir": 0.23055438302015263, "in-drivable-lane": 36.249999999999815, "deviation-heading": 3.4421657203202543, "distance-from-start": 0.1852193766182376, "deviation-center-line": 0.5541768679850334, "driven_lanedir_consec": 0.23055438302015263}}
simulation-passed1
survival_time_max40.79999999999982
survival_time_mean40.79999999999982
survival_time_min40.79999999999982
No reset possible
164321772Bea Baselines 🐤template-pytorchaido-LFP-sim-testingsim-1of4successyesdavinci-stage-03-6.2.510:05:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median31.750000000000316
in-drivable-lane_median17.25000000000018
driven_lanedir_consec_median1.0844125893287762
deviation-center-line_median0.8467735465972205


other stats
deviation-center-line_max0.8467735465972205
deviation-center-line_mean0.8467735465972205
deviation-center-line_min0.8467735465972205
deviation-heading_max11.08585646013653
deviation-heading_mean11.08585646013653
deviation-heading_median11.08585646013653
deviation-heading_min11.08585646013653
distance-from-start_max0.40003972636641727
distance-from-start_mean0.40003972636641727
distance-from-start_median0.40003972636641727
distance-from-start_min0.40003972636641727
driven_any_max3.4249297680058475
driven_any_mean3.4249297680058475
driven_any_median3.4249297680058475
driven_any_min3.4249297680058475
driven_lanedir_consec_max1.0844125893287762
driven_lanedir_consec_mean1.0844125893287762
driven_lanedir_consec_min1.0844125893287762
driven_lanedir_max1.0844125893287762
driven_lanedir_mean1.0844125893287762
driven_lanedir_median1.0844125893287762
driven_lanedir_min1.0844125893287762
in-drivable-lane_max17.25000000000018
in-drivable-lane_mean17.25000000000018
in-drivable-lane_min17.25000000000018
per-episodes
details{"loop-000-ego0": {"driven_any": 3.4249297680058475, "survival_time": 31.750000000000316, "driven_lanedir": 1.0844125893287762, "in-drivable-lane": 17.25000000000018, "deviation-heading": 11.08585646013653, "distance-from-start": 0.40003972636641727, "deviation-center-line": 0.8467735465972205, "driven_lanedir_consec": 1.0844125893287762}}
simulation-passed1
survival_time_max31.750000000000316
survival_time_mean31.750000000000316
survival_time_min31.750000000000316
No reset possible
164291773Bea Baselines 🐤template-randomaido-LFV-sim-validationsim-2of4successyesdavinci-stage-03-6.2.510:04:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median24.750000000000217
in-drivable-lane_median16.200000000000195
driven_lanedir_consec_median0.2676465159268615
deviation-center-line_median0.7555297758130887


other stats
deviation-center-line_max0.7555297758130887
deviation-center-line_mean0.7555297758130887
deviation-center-line_min0.7555297758130887
deviation-heading_max5.523299068383883
deviation-heading_mean5.523299068383883
deviation-heading_median5.523299068383883
deviation-heading_min5.523299068383883
distance-from-start_max0.796098057853727
distance-from-start_mean0.796098057853727
distance-from-start_median0.796098057853727
distance-from-start_min0.796098057853727
driven_any_max6.0666647982270385
driven_any_mean6.0666647982270385
driven_any_median6.0666647982270385
driven_any_min6.0666647982270385
driven_lanedir_consec_max0.2676465159268615
driven_lanedir_consec_mean0.2676465159268615
driven_lanedir_consec_min0.2676465159268615
driven_lanedir_max0.24963703198272744
driven_lanedir_mean0.24963703198272744
driven_lanedir_median0.24963703198272744
driven_lanedir_min0.24963703198272744
in-drivable-lane_max16.200000000000195
in-drivable-lane_mean16.200000000000195
in-drivable-lane_min16.200000000000195
per-episodes
details{"loop2-000-ego0": {"driven_any": 6.0666647982270385, "survival_time": 24.750000000000217, "driven_lanedir": 0.24963703198272744, "in-drivable-lane": 16.200000000000195, "deviation-heading": 5.523299068383883, "distance-from-start": 0.796098057853727, "deviation-center-line": 0.7555297758130887, "driven_lanedir_consec": 0.2676465159268615}}
simulation-passed1
survival_time_max24.750000000000217
survival_time_mean24.750000000000217
survival_time_min24.750000000000217
No reset possible
164281773Bea Baselines 🐤template-randomaido-LFV-sim-validationsim-0of4successyesdavinci-stage-03-6.2.510:02:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.699999999999995
in-drivable-lane_median0.9
driven_lanedir_consec_median0.364506838392066
deviation-center-line_median0.14696541332404583


other stats
deviation-center-line_max0.14696541332404583
deviation-center-line_mean0.14696541332404583
deviation-center-line_min0.14696541332404583
deviation-heading_max1.6699264400950062
deviation-heading_mean1.6699264400950062
deviation-heading_median1.6699264400950062
deviation-heading_min1.6699264400950062
distance-from-start_max0.3743806210373658
distance-from-start_mean0.3743806210373658
distance-from-start_median0.3743806210373658
distance-from-start_min0.3743806210373658
driven_any_max0.3944302398862539
driven_any_mean0.3944302398862539
driven_any_median0.3944302398862539
driven_any_min0.3944302398862539
driven_lanedir_consec_max0.364506838392066
driven_lanedir_consec_mean0.364506838392066
driven_lanedir_consec_min0.364506838392066
driven_lanedir_max0.364506838392066
driven_lanedir_mean0.364506838392066
driven_lanedir_median0.364506838392066
driven_lanedir_min0.364506838392066
in-drivable-lane_max0.9
in-drivable-lane_mean0.9
in-drivable-lane_min0.9
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.3944302398862539, "survival_time": 3.699999999999995, "driven_lanedir": 0.364506838392066, "in-drivable-lane": 0.9, "deviation-heading": 1.6699264400950062, "distance-from-start": 0.3743806210373658, "deviation-center-line": 0.14696541332404583, "driven_lanedir_consec": 0.364506838392066}}
simulation-passed1
survival_time_max3.699999999999995
survival_time_mean3.699999999999995
survival_time_min3.699999999999995
No reset possible
164231774Bea Baselines 🐤template-randomaido-LFVI-sim-validationsim-2of4successyesdavinci-stage-03-6.2.510:01:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
164181776Bea Baselines 🐤template-randomaido-LF-sim-validationsim-0of4successyesdavinci-stage-03-6.2.510:04:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2718401947993705
survival_time_median27.70000000000026
deviation-center-line_median0.7655517188189105
in-drivable-lane_median19.150000000000237


other stats
deviation-center-line_max0.7655517188189105
deviation-center-line_mean0.7655517188189105
deviation-center-line_min0.7655517188189105
deviation-heading_max5.708723015945327
deviation-heading_mean5.708723015945327
deviation-heading_median5.708723015945327
deviation-heading_min5.708723015945327
distance-from-start_max0.7960980578537302
distance-from-start_mean0.7960980578537302
distance-from-start_median0.7960980578537302
distance-from-start_min0.7960980578537302
driven_any_max6.635455547557208
driven_any_mean6.635455547557208
driven_any_median6.635455547557208
driven_any_min6.635455547557208
driven_lanedir_consec_max0.2718401947993705
driven_lanedir_consec_mean0.2718401947993705
driven_lanedir_consec_min0.2718401947993705
driven_lanedir_max0.25382904192484634
driven_lanedir_mean0.25382904192484634
driven_lanedir_median0.25382904192484634
driven_lanedir_min0.25382904192484634
in-drivable-lane_max19.150000000000237
in-drivable-lane_mean19.150000000000237
in-drivable-lane_min19.150000000000237
per-episodes
details{"autolab-000-ego0": {"driven_any": 6.635455547557208, "survival_time": 27.70000000000026, "driven_lanedir": 0.25382904192484634, "in-drivable-lane": 19.150000000000237, "deviation-heading": 5.708723015945327, "distance-from-start": 0.7960980578537302, "deviation-center-line": 0.7655517188189105, "driven_lanedir_consec": 0.2718401947993705}}
simulation-passed1
survival_time_max27.70000000000026
survival_time_mean27.70000000000026
survival_time_min27.70000000000026
No reset possible
164121777Bea Baselines 🐤template-randomaido-LFVI_multi-sim-validationsim-0of4successyesdavinci-stage-03-6.2.510:12:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median28.850000000000275
in-drivable-lane_median22.925000000000257
driven_lanedir_consec_median0.1842700338005553
deviation-center-line_median0.4627381849764669


other stats
deviation-center-line_max4.099655310425073
deviation-center-line_mean1.3331675709092048
deviation-center-line_min0.3075386032588124
deviation-heading_max14.96173668874226
deviation-heading_mean6.250128407006366
deviation-heading_median3.9170785755528663
deviation-heading_min2.204619788177472
distance-from-start_max0.8626308120701165
distance-from-start_mean0.6103488428669119
distance-from-start_median0.5879544645467749
distance-from-start_min0.4028556303039817
driven_any_max7.1610713584054295
driven_any_mean3.3142682447917635
driven_any_median2.835962585238713
driven_any_min0.4240764502841981
driven_lanedir_consec_max0.3901369682576328
driven_lanedir_consec_mean0.21562824323701707
driven_lanedir_consec_min0.10383593708932493
driven_lanedir_max0.3901369682576328
driven_lanedir_mean0.2054725659587014
driven_lanedir_median0.16943030307989526
driven_lanedir_min0.09289268941738228
in-drivable-lane_max24.45000000000027
in-drivable-lane_mean17.800000000000196
in-drivable-lane_min0.9
per-episodes
details{"udem-000-ego0": {"driven_any": 0.4240764502841981, "survival_time": 28.850000000000275, "driven_lanedir": 0.3901369682576328, "in-drivable-lane": 0.9, "deviation-heading": 14.96173668874226, "distance-from-start": 0.4028556303039817, "deviation-center-line": 4.099655310425073, "driven_lanedir_consec": 0.3901369682576328}, "udem-000-ego1": {"driven_any": 7.1610713584054295, "survival_time": 28.850000000000275, "driven_lanedir": 0.1969626852808437, "in-drivable-lane": 21.40000000000026, "deviation-heading": 4.716518246290203, "distance-from-start": 0.8626308120701165, "deviation-center-line": 0.5494202956548411, "driven_lanedir_consec": 0.21028967498696935}, "udem-000-ego2": {"driven_any": 2.4684338587868724, "survival_time": 28.850000000000275, "driven_lanedir": 0.1418979208789468, "in-drivable-lane": 24.45000000000027, "deviation-heading": 2.204619788177472, "distance-from-start": 0.5461575079396516, "deviation-center-line": 0.37605607429809274, "driven_lanedir_consec": 0.1582503926141412}, "udem-000-ego3": {"driven_any": 3.2034913116905535, "survival_time": 28.850000000000275, "driven_lanedir": 0.09289268941738228, "in-drivable-lane": 24.45000000000025, "deviation-heading": 3.1176389048155295, "distance-from-start": 0.6297514211538984, "deviation-center-line": 0.3075386032588124, "driven_lanedir_consec": 0.10383593708932493}}
simulation-passed1
survival_time_max28.850000000000275
survival_time_mean28.850000000000275
survival_time_min28.850000000000275
No reset possible
164111777Bea Baselines 🐤template-randomaido-LFVI_multi-sim-validationsim-2of4successyesdavinci-stage-03-6.2.510:01:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
164101777Bea Baselines 🐤template-randomaido-LFVI_multi-sim-validationsim-3of4successyesdavinci-stage-03-6.2.510:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
164041779Bea Baselines 🐤template-randomaido-LFP-sim-validationsim-3of4successyesdavinci-stage-03-6.2.510:08:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median36.099999999999135
driven_lanedir_consec_median0.33349329950959106
deviation-center-line_median2.107688838912731


other stats
deviation-center-line_max2.107688838912731
deviation-center-line_mean2.107688838912731
deviation-center-line_min2.107688838912731
deviation-heading_max23.30238865255163
deviation-heading_mean23.30238865255163
deviation-heading_median23.30238865255163
deviation-heading_min23.30238865255163
distance-from-start_max1.4108418329398933
distance-from-start_mean1.4108418329398933
distance-from-start_median1.4108418329398933
distance-from-start_min1.4108418329398933
driven_any_max15.326310847370516
driven_any_mean15.326310847370516
driven_any_median15.326310847370516
driven_any_min15.326310847370516
driven_lanedir_consec_max0.33349329950959106
driven_lanedir_consec_mean0.33349329950959106
driven_lanedir_consec_min0.33349329950959106
driven_lanedir_max0.2728719387129268
driven_lanedir_mean0.2728719387129268
driven_lanedir_median0.2728719387129268
driven_lanedir_min0.2728719387129268
in-drivable-lane_max36.099999999999135
in-drivable-lane_mean36.099999999999135
in-drivable-lane_min36.099999999999135
per-episodes
details{"zigzag-000-ego0": {"driven_any": 15.326310847370516, "survival_time": 59.99999999999873, "driven_lanedir": 0.2728719387129268, "in-drivable-lane": 36.099999999999135, "deviation-heading": 23.30238865255163, "distance-from-start": 1.4108418329398933, "deviation-center-line": 2.107688838912731, "driven_lanedir_consec": 0.33349329950959106}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
163911791Bea Baselines 🐤template-randomaido-LFV-sim-testingsim-3of4successyesdavinci-stage-03-6.2.510:17:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median53.69999999999868
driven_lanedir_consec_median0.035772152071414265
deviation-center-line_median0.5480591600958397


other stats
deviation-center-line_max0.5480591600958397
deviation-center-line_mean0.5480591600958397
deviation-center-line_min0.5480591600958397
deviation-heading_max5.01528057758804
deviation-heading_mean5.01528057758804
deviation-heading_median5.01528057758804
deviation-heading_min5.01528057758804
distance-from-start_max1.4108418329398995
distance-from-start_mean1.4108418329398995
distance-from-start_median1.4108418329398995
distance-from-start_min1.4108418329398995
driven_any_max15.32631084737064
driven_any_mean15.32631084737064
driven_any_median15.32631084737064
driven_any_min15.32631084737064
driven_lanedir_consec_max0.035772152071414265
driven_lanedir_consec_mean0.035772152071414265
driven_lanedir_consec_min0.035772152071414265
driven_lanedir_max0.035772152071414265
driven_lanedir_mean0.035772152071414265
driven_lanedir_median0.035772152071414265
driven_lanedir_min0.035772152071414265
in-drivable-lane_max53.69999999999868
in-drivable-lane_mean53.69999999999868
in-drivable-lane_min53.69999999999868
per-episodes
details{"zigzag-000-ego0": {"driven_any": 15.32631084737064, "survival_time": 59.99999999999873, "driven_lanedir": 0.035772152071414265, "in-drivable-lane": 53.69999999999868, "deviation-heading": 5.01528057758804, "distance-from-start": 1.4108418329398995, "deviation-center-line": 0.5480591600958397, "driven_lanedir_consec": 0.035772152071414265}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
163851792Bea Baselines 🐤template-randomaido-LFVI-sim-testingsim-1of4successyesdavinci-stage-03-6.2.510:04:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.350000000000026
in-drivable-lane_median7.900000000000015
driven_lanedir_consec_median0.02729617395902917
deviation-center-line_median0.32682195168324285


other stats
deviation-center-line_max0.32682195168324285
deviation-center-line_mean0.32682195168324285
deviation-center-line_min0.32682195168324285
deviation-heading_max2.5540249040512006
deviation-heading_mean2.5540249040512006
deviation-heading_median2.5540249040512006
deviation-heading_min2.5540249040512006
distance-from-start_max0.5461575079396513
distance-from-start_mean0.5461575079396513
distance-from-start_median0.5461575079396513
distance-from-start_min0.5461575079396513
driven_any_max2.295525081876515
driven_any_mean2.295525081876515
driven_any_median2.295525081876515
driven_any_min2.295525081876515
driven_lanedir_consec_max0.02729617395902917
driven_lanedir_consec_mean0.02729617395902917
driven_lanedir_consec_min0.02729617395902917
driven_lanedir_max0.030642516057663105
driven_lanedir_mean0.030642516057663105
driven_lanedir_median0.030642516057663105
driven_lanedir_min0.030642516057663105
in-drivable-lane_max7.900000000000015
in-drivable-lane_mean7.900000000000015
in-drivable-lane_min7.900000000000015
per-episodes
details{"4way-000-ego0": {"driven_any": 2.295525081876515, "survival_time": 11.350000000000026, "driven_lanedir": 0.030642516057663105, "in-drivable-lane": 7.900000000000015, "deviation-heading": 2.5540249040512006, "distance-from-start": 0.5461575079396513, "deviation-center-line": 0.32682195168324285, "driven_lanedir_consec": 0.02729617395902917}}
simulation-passed1
survival_time_max11.350000000000026
survival_time_mean11.350000000000026
survival_time_min11.350000000000026
No reset possible
163701796Bea Baselines 🐤template-randomaido-LFV_multi-sim-testingsim-3of4successyesdavinci-stage-03-6.2.510:25:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median50.29999999999875
driven_lanedir_consec_median0.2447360136393999
deviation-center-line_median0.8201377542768524


other stats
deviation-center-line_max1.1069457194070875
deviation-center-line_mean0.7677403353962817
deviation-center-line_min0.3237401136243348
deviation-heading_max12.93145476995294
deviation-heading_mean8.15077258988621
deviation-heading_median8.265274464791538
deviation-heading_min3.141086660008822
distance-from-start_max1.410841832939908
distance-from-start_mean1.0363313004962076
distance-from-start_median1.0345816229075964
distance-from-start_min0.6653201232297296
driven_any_max15.326310847370548
driven_any_mean9.916481674175056
driven_any_median10.348447553867391
driven_any_min3.642720741594884
driven_lanedir_consec_max0.41005402159019166
driven_lanedir_consec_mean0.2556548579850866
driven_lanedir_consec_min0.12309338307135484
driven_lanedir_max0.40636448176148865
driven_lanedir_mean0.24489136742153575
driven_lanedir_median0.23207066701918888
driven_lanedir_min0.10905965388627664
in-drivable-lane_max55.59999999999871
in-drivable-lane_mean50.837499999998734
in-drivable-lane_min47.14999999999874
per-episodes
details{"zigzag-000-ego0": {"driven_any": 12.1929529246946, "survival_time": 59.99999999999873, "driven_lanedir": 0.22628350607467773, "in-drivable-lane": 47.999999999998806, "deviation-heading": 10.0526055653766, "distance-from-start": 1.1351054760255626, "deviation-center-line": 0.970368058015948, "driven_lanedir_consec": 0.22628350607467773}, "zigzag-000-ego1": {"driven_any": 15.326310847370548, "survival_time": 59.99999999999873, "driven_lanedir": 0.23785782796370003, "in-drivable-lane": 47.14999999999874, "deviation-heading": 12.93145476995294, "distance-from-start": 1.410841832939908, "deviation-center-line": 1.1069457194070875, "driven_lanedir_consec": 0.26318852120412206}, "zigzag-000-ego2": {"driven_any": 8.503942183040182, "survival_time": 59.99999999999873, "driven_lanedir": 0.10905965388627664, "in-drivable-lane": 55.59999999999871, "deviation-heading": 3.141086660008822, "distance-from-start": 0.9340577697896302, "deviation-center-line": 0.3237401136243348, "driven_lanedir_consec": 0.12309338307135484}, "zigzag-000-ego3": {"driven_any": 3.642720741594884, "survival_time": 59.99999999999873, "driven_lanedir": 0.40636448176148865, "in-drivable-lane": 52.59999999999869, "deviation-heading": 6.477943364206477, "distance-from-start": 0.6653201232297296, "deviation-center-line": 0.6699074505377567, "driven_lanedir_consec": 0.41005402159019166}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
163641797Bea Baselines 🐤template-randomaido-LFP-sim-testingsim-1of4successyesdavinci-stage-03-6.2.510:06:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median43.29999999999968
in-drivable-lane_median35.7499999999996
driven_lanedir_consec_median0.054336775833862205
deviation-center-line_median0.6346586353316823


other stats
deviation-center-line_max0.6346586353316823
deviation-center-line_mean0.6346586353316823
deviation-center-line_min0.6346586353316823
deviation-heading_max5.904235246936354
deviation-heading_mean5.904235246936354
deviation-heading_median5.904235246936354
deviation-heading_min5.904235246936354
distance-from-start_max1.009340436005913
distance-from-start_mean1.009340436005913
distance-from-start_median1.009340436005913
distance-from-start_min1.009340436005913
driven_any_max10.522906217249686
driven_any_mean10.522906217249686
driven_any_median10.522906217249686
driven_any_min10.522906217249686
driven_lanedir_consec_max0.054336775833862205
driven_lanedir_consec_mean0.054336775833862205
driven_lanedir_consec_min0.054336775833862205
driven_lanedir_max0.05768311793249614
driven_lanedir_mean0.05768311793249614
driven_lanedir_median0.05768311793249614
driven_lanedir_min0.05768311793249614
in-drivable-lane_max35.7499999999996
in-drivable-lane_mean35.7499999999996
in-drivable-lane_min35.7499999999996
per-episodes
details{"loop-000-ego0": {"driven_any": 10.522906217249686, "survival_time": 43.29999999999968, "driven_lanedir": 0.05768311793249614, "in-drivable-lane": 35.7499999999996, "deviation-heading": 5.904235246936354, "distance-from-start": 1.009340436005913, "deviation-center-line": 0.6346586353316823, "driven_lanedir_consec": 0.054336775833862205}}
simulation-passed1
survival_time_max43.29999999999968
survival_time_mean43.29999999999968
survival_time_min43.29999999999968
No reset possible
163591798Bea Baselines 🐤template-rosaido-LFV-sim-validationsim-1of4successyesdavinci-stage-03-6.2.510:02:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.649999999999984
in-drivable-lane_median5.749999999999984
driven_lanedir_consec_median0.11268899573197944
deviation-center-line_median0.052704278979125406


other stats
deviation-center-line_max0.052704278979125406
deviation-center-line_mean0.052704278979125406
deviation-center-line_min0.052704278979125406
deviation-heading_max0.6613490281448264
deviation-heading_mean0.6613490281448264
deviation-heading_median0.6613490281448264
deviation-heading_min0.6613490281448264
distance-from-start_max1.3741336668120083
distance-from-start_mean1.3741336668120083
distance-from-start_median1.3741336668120083
distance-from-start_min1.3741336668120083
driven_any_max1.7923430404039196
driven_any_mean1.7923430404039196
driven_any_median1.7923430404039196
driven_any_min1.7923430404039196
driven_lanedir_consec_max0.11268899573197944
driven_lanedir_consec_mean0.11268899573197944
driven_lanedir_consec_min0.11268899573197944
driven_lanedir_max0.11268899573197944
driven_lanedir_mean0.11268899573197944
driven_lanedir_median0.11268899573197944
driven_lanedir_min0.11268899573197944
in-drivable-lane_max5.749999999999984
in-drivable-lane_mean5.749999999999984
in-drivable-lane_min5.749999999999984
per-episodes
details{"loop-000-ego0": {"driven_any": 1.7923430404039196, "survival_time": 6.649999999999984, "driven_lanedir": 0.11268899573197944, "in-drivable-lane": 5.749999999999984, "deviation-heading": 0.6613490281448264, "distance-from-start": 1.3741336668120083, "deviation-center-line": 0.052704278979125406, "driven_lanedir_consec": 0.11268899573197944}}
simulation-passed1
survival_time_max6.649999999999984
survival_time_mean6.649999999999984
survival_time_min6.649999999999984
No reset possible
163531800Bea Baselines 🐤template-rosaido-LFI-sim-validationsim-0of4successyesdavinci-stage-03-6.2.510:01:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.4499999999999993
in-drivable-lane_median1.1499999999999988
driven_lanedir_consec_median0.2273510515122872
deviation-center-line_median0.08768334603166283


other stats
deviation-center-line_max0.08768334603166283
deviation-center-line_mean0.08768334603166283
deviation-center-line_min0.08768334603166283
deviation-heading_max0.6530006848174887
deviation-heading_mean0.6530006848174887
deviation-heading_median0.6530006848174887
deviation-heading_min0.6530006848174887
distance-from-start_max0.38313750838276833
distance-from-start_mean0.38313750838276833
distance-from-start_median0.38313750838276833
distance-from-start_min0.38313750838276833
driven_any_max0.38876556129686257
driven_any_mean0.38876556129686257
driven_any_median0.38876556129686257
driven_any_min0.38876556129686257
driven_lanedir_consec_max0.2273510515122872
driven_lanedir_consec_mean0.2273510515122872
driven_lanedir_consec_min0.2273510515122872
driven_lanedir_max0.2273510515122872
driven_lanedir_mean0.2273510515122872
driven_lanedir_median0.2273510515122872
driven_lanedir_min0.2273510515122872
in-drivable-lane_max1.1499999999999988
in-drivable-lane_mean1.1499999999999988
in-drivable-lane_min1.1499999999999988
per-episodes
details{"4way-000-ego0": {"driven_any": 0.38876556129686257, "survival_time": 2.4499999999999993, "driven_lanedir": 0.2273510515122872, "in-drivable-lane": 1.1499999999999988, "deviation-heading": 0.6530006848174887, "distance-from-start": 0.38313750838276833, "deviation-center-line": 0.08768334603166283, "driven_lanedir_consec": 0.2273510515122872}}
simulation-passed1
survival_time_max2.4499999999999993
survival_time_mean2.4499999999999993
survival_time_min2.4499999999999993
No reset possible
163491801Bea Baselines 🐤template-rosaido-LF-sim-validationsim-1of4successyesdavinci-stage-03-6.2.510:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.19791074241763673
survival_time_median5.799999999999987
deviation-center-line_median0.07408306619697755
in-drivable-lane_median4.599999999999987


other stats
deviation-center-line_max0.07408306619697755
deviation-center-line_mean0.07408306619697755
deviation-center-line_min0.07408306619697755
deviation-heading_max0.6471009543775244
deviation-heading_mean0.6471009543775244
deviation-heading_median0.6471009543775244
deviation-heading_min0.6471009543775244
distance-from-start_max1.348999606415863
distance-from-start_mean1.348999606415863
distance-from-start_median1.348999606415863
distance-from-start_min1.348999606415863
driven_any_max1.4073374059713697
driven_any_mean1.4073374059713697
driven_any_median1.4073374059713697
driven_any_min1.4073374059713697
driven_lanedir_consec_max0.19791074241763673
driven_lanedir_consec_mean0.19791074241763673
driven_lanedir_consec_min0.19791074241763673
driven_lanedir_max0.19791074241763673
driven_lanedir_mean0.19791074241763673
driven_lanedir_median0.19791074241763673
driven_lanedir_min0.19791074241763673
in-drivable-lane_max4.599999999999987
in-drivable-lane_mean4.599999999999987
in-drivable-lane_min4.599999999999987
per-episodes
details{"loop-000-ego0": {"driven_any": 1.4073374059713697, "survival_time": 5.799999999999987, "driven_lanedir": 0.19791074241763673, "in-drivable-lane": 4.599999999999987, "deviation-heading": 0.6471009543775244, "distance-from-start": 1.348999606415863, "deviation-center-line": 0.07408306619697755, "driven_lanedir_consec": 0.19791074241763673}}
simulation-passed1
survival_time_max5.799999999999987
survival_time_mean5.799999999999987
survival_time_min5.799999999999987
No reset possible
163471802Bea Baselines 🐤template-rosaido-LFVI_multi-sim-validationsim-2of4successyesdavinci-stage-03-6.2.510:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
163411803Bea Baselines 🐤template-rosaido-LFV_multi-sim-validationsim-1of4successyesdavinci-stage-03-6.2.510:04:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.050000000000036
in-drivable-lane_median9.900000000000038
driven_lanedir_consec_median0.4042667278342681
deviation-center-line_median0.11579597284676424


other stats
deviation-center-line_max1.424256693201336
deviation-center-line_mean0.43021816826526016
deviation-center-line_min0.06502403416617625
deviation-heading_max1.19871368729543
deviation-heading_mean0.6909464311823174
deviation-heading_median0.5743835005682044
deviation-heading_min0.41630503629743065
distance-from-start_max2.9476898527235793
distance-from-start_mean1.376707464250793
distance-from-start_median1.0577120810571223
distance-from-start_min0.4437158421653478
driven_any_max3.2694488149196053
driven_any_mean1.477698516292317
driven_any_median1.0917116159383944
driven_any_min0.4579220183728744
driven_lanedir_consec_max0.6907692811072494
driven_lanedir_consec_mean0.4361130038388312
driven_lanedir_consec_min0.24514927857953903
driven_lanedir_max0.6907692811072494
driven_lanedir_mean0.4361130038388312
driven_lanedir_median0.4042667278342681
driven_lanedir_min0.24514927857953903
in-drivable-lane_max10.850000000000035
in-drivable-lane_mean7.662500000000028
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 3.2694488149196053, "survival_time": 12.050000000000036, "driven_lanedir": 0.34537869941280364, "in-drivable-lane": 10.500000000000036, "deviation-heading": 0.5853611649144193, "distance-from-start": 2.9476898527235793, "deviation-center-line": 0.1186808373567997, "driven_lanedir_consec": 0.34537869941280364}, "loop-000-ego1": {"driven_any": 0.4771472378379757, "survival_time": 12.050000000000036, "driven_lanedir": 0.46315475625573255, "in-drivable-lane": 0.0, "deviation-heading": 1.19871368729543, "distance-from-start": 0.4657833782147857, "deviation-center-line": 1.424256693201336, "driven_lanedir_consec": 0.46315475625573255}, "loop-000-ego2": {"driven_any": 1.7062759940388132, "survival_time": 12.050000000000036, "driven_lanedir": 0.6907692811072494, "in-drivable-lane": 9.300000000000038, "deviation-heading": 0.5634058362219896, "distance-from-start": 1.649640783899459, "deviation-center-line": 0.11291110833672878, "driven_lanedir_consec": 0.6907692811072494}, "loop-000-ego3": {"driven_any": 0.4579220183728744, "survival_time": 12.050000000000036, "driven_lanedir": 0.24514927857953903, "in-drivable-lane": 10.850000000000035, "deviation-heading": 0.41630503629743065, "distance-from-start": 0.4437158421653478, "deviation-center-line": 0.06502403416617625, "driven_lanedir_consec": 0.24514927857953903}}
simulation-passed1
survival_time_max12.050000000000036
survival_time_mean12.050000000000036
survival_time_min12.050000000000036
No reset possible
163381804Bea Baselines 🐤template-rosaido-LFP-sim-validationsim-1of4successyesdavinci-stage-03-6.2.510:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.850000000000001
in-drivable-lane_median0.9500000000000008
driven_lanedir_consec_median0.14019363913470628
deviation-center-line_median0.05017479887221617


other stats
deviation-center-line_max0.05017479887221617
deviation-center-line_mean0.05017479887221617
deviation-center-line_min0.05017479887221617
deviation-heading_max0.5913791463156683
deviation-heading_mean0.5913791463156683
deviation-heading_median0.5913791463156683
deviation-heading_min0.5913791463156683
distance-from-start_max0.25848655431862816
distance-from-start_mean0.25848655431862816
distance-from-start_median0.25848655431862816
distance-from-start_min0.25848655431862816
driven_any_max0.2593367051059751
driven_any_mean0.2593367051059751
driven_any_median0.2593367051059751
driven_any_min0.2593367051059751
driven_lanedir_consec_max0.14019363913470628
driven_lanedir_consec_mean0.14019363913470628
driven_lanedir_consec_min0.14019363913470628
driven_lanedir_max0.14019363913470628
driven_lanedir_mean0.14019363913470628
driven_lanedir_median0.14019363913470628
driven_lanedir_min0.14019363913470628
in-drivable-lane_max0.9500000000000008
in-drivable-lane_mean0.9500000000000008
in-drivable-lane_min0.9500000000000008
per-episodes
details{"loop-000-ego0": {"driven_any": 0.2593367051059751, "survival_time": 1.850000000000001, "driven_lanedir": 0.14019363913470628, "in-drivable-lane": 0.9500000000000008, "deviation-heading": 0.5913791463156683, "distance-from-start": 0.25848655431862816, "deviation-center-line": 0.05017479887221617, "driven_lanedir_consec": 0.14019363913470628}}
simulation-passed1
survival_time_max1.850000000000001
survival_time_mean1.850000000000001
survival_time_min1.850000000000001
No reset possible
163351804Bea Baselines 🐤template-rosaido-LFP-sim-validationsim-3of4successyesdavinci-stage-03-6.2.510:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.599999999999995
in-drivable-lane_median2.549999999999995
driven_lanedir_consec_median0.1458174872267639
deviation-center-line_median0.059340568830611146


other stats
deviation-center-line_max0.059340568830611146
deviation-center-line_mean0.059340568830611146
deviation-center-line_min0.059340568830611146
deviation-heading_max0.6856080312885067
deviation-heading_mean0.6856080312885067
deviation-heading_median0.6856080312885067
deviation-heading_min0.6856080312885067
distance-from-start_max0.7234327719880624
distance-from-start_mean0.7234327719880624
distance-from-start_median0.7234327719880624
distance-from-start_min0.7234327719880624
driven_any_max0.7471869737541152
driven_any_mean0.7471869737541152
driven_any_median0.7471869737541152
driven_any_min0.7471869737541152
driven_lanedir_consec_max0.1458174872267639
driven_lanedir_consec_mean0.1458174872267639
driven_lanedir_consec_min0.1458174872267639
driven_lanedir_max0.1458174872267639
driven_lanedir_mean0.1458174872267639
driven_lanedir_median0.1458174872267639
driven_lanedir_min0.1458174872267639
in-drivable-lane_max2.549999999999995
in-drivable-lane_mean2.549999999999995
in-drivable-lane_min2.549999999999995
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.7471869737541152, "survival_time": 3.599999999999995, "driven_lanedir": 0.1458174872267639, "in-drivable-lane": 2.549999999999995, "deviation-heading": 0.6856080312885067, "distance-from-start": 0.7234327719880624, "deviation-center-line": 0.059340568830611146, "driven_lanedir_consec": 0.1458174872267639}}
simulation-passed1
survival_time_max3.599999999999995
survival_time_mean3.599999999999995
survival_time_min3.599999999999995
No reset possible
163291809Bea Baselines 🐤template-roslx22-BV1sim-0of5successyesdavinci-stage-03-6.2.510:02:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.123611067501419


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.123611067501419
distance-from-start_median3.123611067501419
distance-from-start_min3.123611067501419
driven_any_max4.34083946249021
driven_any_mean4.34083946249021
driven_any_median4.34083946249021
driven_any_min4.34083946249021
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max16.100000000000094
in-drivable-lane_mean16.100000000000094
in-drivable-lane_median16.100000000000094
in-drivable-lane_min16.100000000000094
per-episodes
details{"d30-ego0": {"driven_any": 4.34083946249021, "survival_time": 16.100000000000094, "driven_lanedir": 0.0, "in-drivable-lane": 16.100000000000094, "deviation-heading": 0.0, "distance-from-start": 3.123611067501419, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max16.100000000000094
survival_time_mean16.100000000000094
survival_time_median16.100000000000094
survival_time_min16.100000000000094
No reset possible
163221816Bea Baselines 🐤template-rosaido-LFV-sim-testingsim-3of4successyesdavinci-stage-03-6.2.510:03:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.99999999999998
in-drivable-lane_median7.049999999999979
driven_lanedir_consec_median0.11740045883179696
deviation-center-line_median0.05931707423839125


other stats
deviation-center-line_max0.05931707423839125
deviation-center-line_mean0.05931707423839125
deviation-center-line_min0.05931707423839125
deviation-heading_max0.6860846415035129
deviation-heading_mean0.6860846415035129
deviation-heading_median0.6860846415035129
deviation-heading_min0.6860846415035129
distance-from-start_max2.156127467286299
distance-from-start_mean2.156127467286299
distance-from-start_median2.156127467286299
distance-from-start_min2.156127467286299
driven_any_max2.197835518274973
driven_any_mean2.197835518274973
driven_any_median2.197835518274973
driven_any_min2.197835518274973
driven_lanedir_consec_max0.11740045883179696
driven_lanedir_consec_mean0.11740045883179696
driven_lanedir_consec_min0.11740045883179696
driven_lanedir_max0.11740045883179696
driven_lanedir_mean0.11740045883179696
driven_lanedir_median0.11740045883179696
driven_lanedir_min0.11740045883179696
in-drivable-lane_max7.049999999999979
in-drivable-lane_mean7.049999999999979
in-drivable-lane_min7.049999999999979
per-episodes
details{"zigzag-000-ego0": {"driven_any": 2.197835518274973, "survival_time": 7.99999999999998, "driven_lanedir": 0.11740045883179696, "in-drivable-lane": 7.049999999999979, "deviation-heading": 0.6860846415035129, "distance-from-start": 2.156127467286299, "deviation-center-line": 0.05931707423839125, "driven_lanedir_consec": 0.11740045883179696}}
simulation-passed1
survival_time_max7.99999999999998
survival_time_mean7.99999999999998
survival_time_min7.99999999999998
No reset possible
163181817Bea Baselines 🐤template-rosaido-LFVI-sim-testingsim-1of4successyesdavinci-stage-03-6.2.510:02:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.649999999999995
in-drivable-lane_median2.849999999999995
driven_lanedir_consec_median0.0958561589992546
deviation-center-line_median0.0507509574506658


other stats
deviation-center-line_max0.0507509574506658
deviation-center-line_mean0.0507509574506658
deviation-center-line_min0.0507509574506658
deviation-heading_max0.6402488650137794
deviation-heading_mean0.6402488650137794
deviation-heading_median0.6402488650137794
deviation-heading_min0.6402488650137794
distance-from-start_max0.7714151000309615
distance-from-start_mean0.7714151000309615
distance-from-start_median0.7714151000309615
distance-from-start_min0.7714151000309615
driven_any_max0.7879630940645415
driven_any_mean0.7879630940645415
driven_any_median0.7879630940645415
driven_any_min0.7879630940645415
driven_lanedir_consec_max0.0958561589992546
driven_lanedir_consec_mean0.0958561589992546
driven_lanedir_consec_min0.0958561589992546
driven_lanedir_max0.0958561589992546
driven_lanedir_mean0.0958561589992546
driven_lanedir_median0.0958561589992546
driven_lanedir_min0.0958561589992546
in-drivable-lane_max2.849999999999995
in-drivable-lane_mean2.849999999999995
in-drivable-lane_min2.849999999999995
per-episodes
details{"4way-000-ego0": {"driven_any": 0.7879630940645415, "survival_time": 3.649999999999995, "driven_lanedir": 0.0958561589992546, "in-drivable-lane": 2.849999999999995, "deviation-heading": 0.6402488650137794, "distance-from-start": 0.7714151000309615, "deviation-center-line": 0.0507509574506658, "driven_lanedir_consec": 0.0958561589992546}}
simulation-passed1
survival_time_max3.649999999999995
survival_time_mean3.649999999999995
survival_time_min3.649999999999995
No reset possible
163131818Bea Baselines 🐤template-rosaido-LFI-sim-testingsim-3of4successyesdavinci-stage-03-6.2.510:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
163101819Bea Baselines 🐤template-rosaido-LF-sim-testingsim-2of4successyesdavinci-stage-03-6.2.510:01:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.27836714090946557
survival_time_median7.649999999999981
deviation-center-line_median0.14982139443571937
in-drivable-lane_median5.849999999999984


other stats
deviation-center-line_max0.14982139443571937
deviation-center-line_mean0.14982139443571937
deviation-center-line_min0.14982139443571937
deviation-heading_max1.4772613338579594
deviation-heading_mean1.4772613338579594
deviation-heading_median1.4772613338579594
deviation-heading_min1.4772613338579594
distance-from-start_max2.00854819342489
distance-from-start_mean2.00854819342489
distance-from-start_median2.00854819342489
distance-from-start_min2.00854819342489
driven_any_max2.029298256692792
driven_any_mean2.029298256692792
driven_any_median2.029298256692792
driven_any_min2.029298256692792
driven_lanedir_consec_max0.27836714090946557
driven_lanedir_consec_mean0.27836714090946557
driven_lanedir_consec_min0.27836714090946557
driven_lanedir_max0.27836714090946557
driven_lanedir_mean0.27836714090946557
driven_lanedir_median0.27836714090946557
driven_lanedir_min0.27836714090946557
in-drivable-lane_max5.849999999999984
in-drivable-lane_mean5.849999999999984
in-drivable-lane_min5.849999999999984
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.029298256692792, "survival_time": 7.649999999999981, "driven_lanedir": 0.27836714090946557, "in-drivable-lane": 5.849999999999984, "deviation-heading": 1.4772613338579594, "distance-from-start": 2.00854819342489, "deviation-center-line": 0.14982139443571937, "driven_lanedir_consec": 0.27836714090946557}}
simulation-passed1
survival_time_max7.649999999999981
survival_time_mean7.649999999999981
survival_time_min7.649999999999981
No reset possible
163061820Bea Baselines 🐤template-rosaido-LFVI_multi-sim-testingsim-3of4successyesdavinci-stage-03-6.2.510:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
163031821Bea Baselines 🐤template-rosaido-LFV_multi-sim-testingsim-2of4successyesdavinci-stage-03-6.2.510:02:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.449999999999981
in-drivable-lane_median5.499999999999982
driven_lanedir_consec_median0.355186966444504
deviation-center-line_median0.19359306211762045


other stats
deviation-center-line_max0.3163199861171496
deviation-center-line_mean0.19359306211762045
deviation-center-line_min0.07086613811809131
deviation-heading_max1.2273780778350745
deviation-heading_mean0.9864382197697412
deviation-heading_median0.9864382197697412
deviation-heading_min0.7454983617044082
distance-from-start_max1.7332480299531736
distance-from-start_mean1.406535848525058
distance-from-start_median1.406535848525058
distance-from-start_min1.0798236670969423
driven_any_max1.8456007541388375
driven_any_mean1.474936808055697
driven_any_median1.474936808055697
driven_any_min1.1042728619725564
driven_lanedir_consec_max0.5906997013335109
driven_lanedir_consec_mean0.355186966444504
driven_lanedir_consec_min0.11967423155549706
driven_lanedir_max0.5906997013335109
driven_lanedir_mean0.355186966444504
driven_lanedir_median0.355186966444504
driven_lanedir_min0.11967423155549706
in-drivable-lane_max6.4499999999999815
in-drivable-lane_mean5.499999999999982
in-drivable-lane_min4.549999999999984
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.1042728619725564, "survival_time": 7.449999999999981, "driven_lanedir": 0.11967423155549706, "in-drivable-lane": 6.4499999999999815, "deviation-heading": 0.7454983617044082, "distance-from-start": 1.0798236670969423, "deviation-center-line": 0.07086613811809131, "driven_lanedir_consec": 0.11967423155549706}, "loop2-000-ego1": {"driven_any": 1.8456007541388375, "survival_time": 7.449999999999981, "driven_lanedir": 0.5906997013335109, "in-drivable-lane": 4.549999999999984, "deviation-heading": 1.2273780778350745, "distance-from-start": 1.7332480299531736, "deviation-center-line": 0.3163199861171496, "driven_lanedir_consec": 0.5906997013335109}}
simulation-passed1
survival_time_max7.449999999999981
survival_time_mean7.449999999999981
survival_time_min7.449999999999981
No reset possible
162941848Andrea Danieleexercises_braitenberglx22-BV1sim-3of5successyesdavinci-stage-03-6.2.510:06:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.682286588947275


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.682286588947275
distance-from-start_median5.682286588947275
distance-from-start_min5.682286588947275
driven_any_max5.71549970919627
driven_any_mean5.71549970919627
driven_any_median5.71549970919627
driven_any_min5.71549970919627
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max45.74999999999954
in-drivable-lane_mean45.74999999999954
in-drivable-lane_median45.74999999999954
in-drivable-lane_min45.74999999999954
per-episodes
details{"d50-ego0": {"driven_any": 5.71549970919627, "survival_time": 45.74999999999954, "driven_lanedir": 0.0, "in-drivable-lane": 45.74999999999954, "deviation-heading": 0.0, "distance-from-start": 5.682286588947275, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max45.74999999999954
survival_time_mean45.74999999999954
survival_time_median45.74999999999954
survival_time_min45.74999999999954
No reset possible
162891843Bea Baselines 🐤template-tensorflowaido-LFI-sim-testingsim-3of4successyesdavinci-stage-03-6.2.510:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
162851844Bea Baselines 🐤template-tensorflowaido-LF-sim-testingsim-3of4failedyesdavinci-stage-03-6.2.510:00:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
162811846Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-testingsim-2of4failedyesdavinci-stage-03-6.2.510:01:49
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
162771847Bea Baselines 🐤template-tensorflowaido-LFP-sim-testingsim-2of4failedyesdavinci-stage-03-6.2.510:01:41
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
162711847Bea Baselines 🐤template-tensorflowaido-LFP-sim-testingsim-3of4failedyesdavinci-stage-03-6.2.510:00:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
162611601Andrea Danieleexercises_braitenberglx22-BV1sim-3of5successyesdavinci-stage-03-6.2.510:04:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean6.341760000000476


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max6.341760000000476
distance-from-start_median6.341760000000476
distance-from-start_min6.341760000000476
driven_any_max6.3417600000005665
driven_any_mean6.3417600000005665
driven_any_median6.3417600000005665
driven_any_min6.3417600000005665
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max30.400000000000297
in-drivable-lane_mean30.400000000000297
in-drivable-lane_median30.400000000000297
in-drivable-lane_min30.400000000000297
per-episodes
details{"d50-ego0": {"driven_any": 6.3417600000005665, "survival_time": 30.400000000000297, "driven_lanedir": 0.0, "in-drivable-lane": 30.400000000000297, "deviation-heading": 0.0, "distance-from-start": 6.341760000000476, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max30.400000000000297
survival_time_mean30.400000000000297
survival_time_median30.400000000000297
survival_time_min30.400000000000297
No reset possible
162581601Andrea Danieleexercises_braitenberglx22-BV1sim-4of5abortednodavinci-stage-03-6.2.510:00:44
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1302, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 749, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
162511533Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-validationsim-2of4successyesdavinci-stage-03-6.2.510:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
162481549Bea Baselines 🐤template-tensorflowaido-LFI-sim-testingsim-3of4successyesdavinci-stage-03-6.2.510:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
162421535Bea Baselines 🐤template-tensorflowaido-LFP-sim-validationsim-1of4failedyesdavinci-stage-03-6.2.510:00:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
162371535Bea Baselines 🐤template-tensorflowaido-LFP-sim-validationsim-3of4failedyesdavinci-stage-03-6.2.510:01:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
162321547Bea Baselines 🐤template-tensorflowaido-LFV-sim-testingsim-0of4failedyesdavinci-stage-03-6.2.510:01:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
162291550Bea Baselines 🐤template-tensorflowaido-LF-sim-testingsim-0of4failedyesdavinci-stage-03-6.2.510:01:00
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
162231552Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-testingsim-3of4failedyesdavinci-stage-03-6.2.510:01:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
162221553Bea Baselines 🐤template-tensorflowaido-LFP-sim-testingsim-3of4failedyesdavinci-stage-03-6.2.510:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
162211553Bea Baselines 🐤template-tensorflowaido-LFP-sim-testingsim-2of4failedyesdavinci-stage-03-6.2.510:01:21
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
162191553Bea Baselines 🐤template-tensorflowaido-LFP-sim-testingsim-1of4failedyesdavinci-stage-03-6.2.510:02:51
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16214526Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-testingsim-0of4failedyesdavinci-stage-03-6.2.510:00:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
162071532Bea Baselines 🐤template-tensorflowaido-LF-sim-validationsim-2of4timeoutyesdavinci-stage-03-6.2.510:02:01
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
162041599Andrea Danieleexercises_braitenberglx22-BV1sim-3of5successnodavinci-stage-03-6.2.510:03:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.094196639731773


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.094196639731773
distance-from-start_median5.094196639731773
distance-from-start_min5.094196639731773
driven_any_max5.709441443209762
driven_any_mean5.709441443209762
driven_any_median5.709441443209762
driven_any_min5.709441443209762
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max16.900000000000105
in-drivable-lane_mean16.900000000000105
in-drivable-lane_median16.900000000000105
in-drivable-lane_min16.900000000000105
per-episodes
details{"d50-ego0": {"driven_any": 5.709441443209762, "survival_time": 16.900000000000105, "driven_lanedir": 0.0, "in-drivable-lane": 16.900000000000105, "deviation-heading": 0.0, "distance-from-start": 5.094196639731773, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max16.900000000000105
survival_time_mean16.900000000000105
survival_time_median16.900000000000105
survival_time_min16.900000000000105
No reset possible
161951597Andrea Danieleexercises_braitenberglx22-BV1sim-0of5successnodavinci-stage-03-6.2.510:07:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d30-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
161901593Andrea Danieleplanning-exerciselx22-planning-dd-empty-teststep1successyesdavinci-stage-03-6.2.510:16:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.9629629629629628
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.2626749063171028


other stats
nfeasible27
nsamples27
No reset possible
161851592Andrea Danieleplanning-exerciselx22-planning-dd-static-teststep1-2of4successyesdavinci-stage-03-6.2.510:04:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible6
nsamples6
No reset possible
161821585Andrea Danieleplanning-exerciselx22-planning-dd-dynamic-valistep1-0of4successyesdavinci-stage-03-6.2.510:02:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible3
nsamples3
No reset possible
161811585Andrea Danieleplanning-exerciselx22-planning-dd-dynamic-valistep1-2of4successyesdavinci-stage-03-6.2.510:00:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
161771594Andrea Danieleplanning-exerciselx22-planning-cc-dynamic-teststep1-0of4successyesdavinci-stage-03-6.2.510:02:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible3
nsamples3
No reset possible
161731595Andrea Danieleplanning-exerciselx22-planning-cc-static-teststep1-0of4successyesdavinci-stage-03-6.2.510:02:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible3
nsamples3
No reset possible
161721595Andrea Danieleplanning-exerciselx22-planning-cc-static-teststep1-2of4successyesdavinci-stage-03-6.2.510:00:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
161711595Andrea Danieleplanning-exerciselx22-planning-cc-static-teststep1-1of4successyesdavinci-stage-03-6.2.510:00:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
161641588Andrea Danieleplanning-exerciselx22-planning-cc-dynamic-valistep1-0of4successyesdavinci-stage-03-6.2.510:02:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible3
nsamples3
No reset possible
161601589Andrea Danieleplanning-exerciselx22-planning-cc-static-valistep1-3of4successyesdavinci-stage-03-6.2.510:00:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
161551584Andrea Censiexercises_braitenberglx22-BV1sim-1of5successnodavinci-stage-03-6.2.510:09:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d45-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
161511576Andrea Censiplanning-exerciselx22-planning-dd-dynamic-teststep1-0of4successyesdavinci-stage-03-6.2.510:02:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible3
nsamples3
No reset possible
161501576Andrea Censiplanning-exerciselx22-planning-dd-dynamic-teststep1-2of4successyesdavinci-stage-03-6.2.510:00:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
161491583Andrea Censicollision-check-exerciselx22-collision-check-teststep1successyesdavinci-stage-03-6.2.510:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.53
false_positive_rate0.42


other stats
nsamples200
No reset possible
161341579Andrea Censiplanning-exerciselx22-planning-cc-dynamic-teststep1-2of4erroryesdavinci-stage-03-6.2.510:17:00
Waited 1000 seconds [...]
Waited 1000 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
161311579Andrea Censiplanning-exerciselx22-planning-cc-dynamic-teststep1-1of4successyesdavinci-stage-03-6.2.510:00:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
161301580Andrea Censiplanning-exerciselx22-planning-cc-static-teststep1-1of4successyesdavinci-stage-03-6.2.510:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
161281580Andrea Censiplanning-exerciselx22-planning-cc-static-teststep1-2of4successyesdavinci-stage-03-6.2.510:00:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
161271580Andrea Censiplanning-exerciselx22-planning-cc-static-teststep1-3of4successyesdavinci-stage-03-6.2.510:00:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
161251573Andrea Censiplanning-exerciselx22-planning-cc-dynamic-valistep1-1of4successyesdavinci-stage-03-6.2.510:00:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
161221573Andrea Censiplanning-exerciselx22-planning-cc-dynamic-valistep1-2of4successyesdavinci-stage-03-6.2.510:00:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
161171574Andrea Censiplanning-exerciselx22-planning-cc-static-valistep1-1of4successyesdavinci-stage-03-6.2.510:02:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
161101559Andrea Censiplanning-exerciselx22-planning-dd-static-valistep1-3of4failedyesdavinci-stage-03-6.2.510:00:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 64, in run_checker
    agent_ci._get_node_protocol()
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 101, in _get_node_protocol
    msgs = read_reply(
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "checker" aborted with the following error:

error in checker |list[1]
                 |#0 tuple[2]
                 |   #0 Cannot import the node class
                 |   #1 dict[2]
                 |      │ node_symbol: planner.Planner
                 |      │ tb:
                 |      │ |Traceback (most recent call last):
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |    return __import__(name, fromlist=["dummy"])
                 |      │ |ModuleNotFoundError: No module named 'planner'
                 |      │ |
                 |      │ |During handling of the above exception, another exception occurred:
                 |      │ |
                 |      │ |Traceback (most recent call last):
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |    return __import__(name, fromlist=["dummy"])
                 |      │ |ModuleNotFoundError: No module named 'planner'
                 |      │ |
                 |      │ |During handling of the above exception, another exception occurred:
                 |      │ |
                 |      │ |Traceback (most recent call last):
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/launcher.py", line 93, in launcher_main
                 |      │ |    node_type = import_name(config.node)
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 46, in import_name
                 |      │ |    module = import_name(module_name)
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 76, in import_name
                 |      │ |    raise ValueError(msg)
                 |      │ |ValueError: Cannot import name 'planner'.> Traceback (most recent call last):
                 |      │ |>   File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |>     return __import__(name, fromlist=["dummy"])
                 |      │ |> ModuleNotFoundError: No module named 'planner'
                 |      │ |>
                 |      │ |> During handling of the above exception, another exception occurred:
                 |      │ |>
                 |      │ |> Traceback (most recent call last):
                 |      │ |>   File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |>     return __import__(name, fromlist=["dummy"])
                 |      │ |> ModuleNotFoundError: No module named 'planner'
                 |      │ |>
                 |      │ |

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/dt_planning/planning_checker.py", line 102, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 115, in run_checker
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
161051561Andrea Censiplanning-exerciselx22-planning-cc-dynamic-valistep1-3of4failedyesdavinci-stage-03-6.2.510:00:42
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 64, in run_checker
    agent_ci._get_node_protocol()
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 101, in _get_node_protocol
    msgs = read_reply(
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "checker" aborted with the following error:

error in checker |list[1]
                 |#0 tuple[2]
                 |   #0 Cannot import the node class
                 |   #1 dict[2]
                 |      │ node_symbol: planner.Planner
                 |      │ tb:
                 |      │ |Traceback (most recent call last):
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |    return __import__(name, fromlist=["dummy"])
                 |      │ |ModuleNotFoundError: No module named 'planner'
                 |      │ |
                 |      │ |During handling of the above exception, another exception occurred:
                 |      │ |
                 |      │ |Traceback (most recent call last):
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |    return __import__(name, fromlist=["dummy"])
                 |      │ |ModuleNotFoundError: No module named 'planner'
                 |      │ |
                 |      │ |During handling of the above exception, another exception occurred:
                 |      │ |
                 |      │ |Traceback (most recent call last):
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/launcher.py", line 93, in launcher_main
                 |      │ |    node_type = import_name(config.node)
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 46, in import_name
                 |      │ |    module = import_name(module_name)
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 76, in import_name
                 |      │ |    raise ValueError(msg)
                 |      │ |ValueError: Cannot import name 'planner'.> Traceback (most recent call last):
                 |      │ |>   File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |>     return __import__(name, fromlist=["dummy"])
                 |      │ |> ModuleNotFoundError: No module named 'planner'
                 |      │ |>
                 |      │ |> During handling of the above exception, another exception occurred:
                 |      │ |>
                 |      │ |> Traceback (most recent call last):
                 |      │ |>   File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |>     return __import__(name, fromlist=["dummy"])
                 |      │ |> ModuleNotFoundError: No module named 'planner'
                 |      │ |>
                 |      │ |

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/dt_planning/planning_checker.py", line 102, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 115, in run_checker
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
161011561Andrea Censiplanning-exerciselx22-planning-cc-dynamic-valistep1-0of4failedyesdavinci-stage-03-6.2.510:00:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 64, in run_checker
    agent_ci._get_node_protocol()
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 101, in _get_node_protocol
    msgs = read_reply(
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "checker" aborted with the following error:

error in checker |list[1]
                 |#0 tuple[2]
                 |   #0 Cannot import the node class
                 |   #1 dict[2]
                 |      │ node_symbol: planner.Planner
                 |      │ tb:
                 |      │ |Traceback (most recent call last):
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |    return __import__(name, fromlist=["dummy"])
                 |      │ |ModuleNotFoundError: No module named 'planner'
                 |      │ |
                 |      │ |During handling of the above exception, another exception occurred:
                 |      │ |
                 |      │ |Traceback (most recent call last):
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |    return __import__(name, fromlist=["dummy"])
                 |      │ |ModuleNotFoundError: No module named 'planner'
                 |      │ |
                 |      │ |During handling of the above exception, another exception occurred:
                 |      │ |
                 |      │ |Traceback (most recent call last):
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/launcher.py", line 93, in launcher_main
                 |      │ |    node_type = import_name(config.node)
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 46, in import_name
                 |      │ |    module = import_name(module_name)
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 76, in import_name
                 |      │ |    raise ValueError(msg)
                 |      │ |ValueError: Cannot import name 'planner'.> Traceback (most recent call last):
                 |      │ |>   File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |>     return __import__(name, fromlist=["dummy"])
                 |      │ |> ModuleNotFoundError: No module named 'planner'
                 |      │ |>
                 |      │ |> During handling of the above exception, another exception occurred:
                 |      │ |>
                 |      │ |> Traceback (most recent call last):
                 |      │ |>   File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |>     return __import__(name, fromlist=["dummy"])
                 |      │ |> ModuleNotFoundError: No module named 'planner'
                 |      │ |>
                 |      │ |

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/dt_planning/planning_checker.py", line 102, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 115, in run_checker
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
160951562Andrea Censiplanning-exerciselx22-planning-cc-static-valistep1-0of4failedyesdavinci-stage-03-6.2.510:03:13
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 64, in run_checker
    agent_ci._get_node_protocol()
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 101, in _get_node_protocol
    msgs = read_reply(
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "checker" aborted with the following error:

error in checker |list[1]
                 |#0 tuple[2]
                 |   #0 Cannot import the node class
                 |   #1 dict[2]
                 |      │ node_symbol: planner.Planner
                 |      │ tb:
                 |      │ |Traceback (most recent call last):
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |    return __import__(name, fromlist=["dummy"])
                 |      │ |ModuleNotFoundError: No module named 'planner'
                 |      │ |
                 |      │ |During handling of the above exception, another exception occurred:
                 |      │ |
                 |      │ |Traceback (most recent call last):
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |    return __import__(name, fromlist=["dummy"])
                 |      │ |ModuleNotFoundError: No module named 'planner'
                 |      │ |
                 |      │ |During handling of the above exception, another exception occurred:
                 |      │ |
                 |      │ |Traceback (most recent call last):
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/launcher.py", line 93, in launcher_main
                 |      │ |    node_type = import_name(config.node)
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 46, in import_name
                 |      │ |    module = import_name(module_name)
                 |      │ |  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 76, in import_name
                 |      │ |    raise ValueError(msg)
                 |      │ |ValueError: Cannot import name 'planner'.> Traceback (most recent call last):
                 |      │ |>   File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |>     return __import__(name, fromlist=["dummy"])
                 |      │ |> ModuleNotFoundError: No module named 'planner'
                 |      │ |>
                 |      │ |> During handling of the above exception, another exception occurred:
                 |      │ |>
                 |      │ |> Traceback (most recent call last):
                 |      │ |>   File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
                 |      │ |>     return __import__(name, fromlist=["dummy"])
                 |      │ |> ModuleNotFoundError: No module named 'planner'
                 |      │ |>
                 |      │ |

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/dt_planning/planning_checker.py", line 102, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 115, in run_checker
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
160921557Andrea Danieleexercises_braitenberglx22-BV1sim-1of5successnodavinci-stage-03-6.2.510:09:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d45-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
160861556Frank (Chude) Qianexercises_braitenberglx22-BV1sim-1of5successnodavinci-stage-03-6.2.510:08:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d45-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
16082385Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-validationsim-3of4host-errornodavinci-stage-03-6.2.510:01:44
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-stage-03-6.2.51-job16082-680859, up, --no-start,
│          --renew-anon-volumes]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-stage-03-6.2.51-job16082-680859', 'up', '--no-start', '--renew-anon-volumes']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16075385Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-validationsim-0of4successnodavinci-stage-03-6.2.510:34:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median25.14999999999937
driven_lanedir_consec_median-3.737936363796966
deviation-center-line_median2.858609940652501


other stats
deviation-center-line_max6.096434560097759
deviation-center-line_mean3.511994979674815
deviation-center-line_min2.234325477296499
deviation-heading_max35.322943486303124
deviation-heading_mean29.274472894393472
deviation-heading_median27.740958705116405
deviation-heading_min26.29303068103796
distance-from-start_max0.18876591577595633
distance-from-start_mean0.1803459748306426
distance-from-start_median0.18372597034042837
distance-from-start_min0.16516604286575734
driven_any_max14.470738268243862
driven_any_mean12.539467981626954
driven_any_median12.304531656727342
driven_any_min11.078070344809271
driven_lanedir_consec_max-3.0119939024918416
driven_lanedir_consec_mean-3.7239506292148024
driven_lanedir_consec_min-4.407935886773436
driven_lanedir_max-3.0119939024918416
driven_lanedir_mean-4.94226517242592
driven_lanedir_median-4.018656293106822
driven_lanedir_min-8.71975420099819
in-drivable-lane_max28.29999999999935
in-drivable-lane_mean21.662499999999476
in-drivable-lane_min8.04999999999982
per-episodes
details{"autolab-000-ego0": {"driven_any": 11.900860712247868, "survival_time": 59.99999999999873, "driven_lanedir": -3.877620876267077, "in-drivable-lane": 25.149999999999352, "deviation-heading": 28.450539616263, "distance-from-start": 0.1786902754096685, "deviation-center-line": 2.5643261674917945, "driven_lanedir_consec": -3.5130189200623496}, "autolab-000-ego1": {"driven_any": 11.078070344809271, "survival_time": 59.99999999999873, "driven_lanedir": -3.0119939024918416, "in-drivable-lane": 25.14999999999938, "deviation-heading": 27.03137779396981, "distance-from-start": 0.18876166527118823, "deviation-center-line": 3.1528937138132074, "driven_lanedir_consec": -3.0119939024918416}, "autolab-000-ego2": {"driven_any": 14.470738268243862, "survival_time": 59.99999999999873, "driven_lanedir": -8.71975420099819, "in-drivable-lane": 8.04999999999982, "deviation-heading": 35.322943486303124, "distance-from-start": 0.18876591577595633, "deviation-center-line": 6.096434560097759, "driven_lanedir_consec": -4.407935886773436}, "autolab-000-ego3": {"driven_any": 12.708202601206814, "survival_time": 59.99999999999873, "driven_lanedir": -4.159691709946569, "in-drivable-lane": 28.29999999999935, "deviation-heading": 26.29303068103796, "distance-from-start": 0.16516604286575734, "deviation-center-line": 2.234325477296499, "driven_lanedir_consec": -3.962853807531582}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16071386Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-validationsim-2of4successnodavinci-stage-03-6.2.510:07:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median21.699999999999513
driven_lanedir_consec_median-2.3582709483885766
deviation-center-line_median3.065511986747849


other stats
deviation-center-line_max3.065511986747849
deviation-center-line_mean3.065511986747849
deviation-center-line_min3.065511986747849
deviation-heading_max28.45705063837741
deviation-heading_mean28.45705063837741
deviation-heading_median28.45705063837741
deviation-heading_min28.45705063837741
distance-from-start_max0.2035327852024029
distance-from-start_mean0.2035327852024029
distance-from-start_median0.2035327852024029
distance-from-start_min0.2035327852024029
driven_any_max10.213750370739987
driven_any_mean10.213750370739987
driven_any_median10.213750370739987
driven_any_min10.213750370739987
driven_lanedir_consec_max-2.3582709483885766
driven_lanedir_consec_mean-2.3582709483885766
driven_lanedir_consec_min-2.3582709483885766
driven_lanedir_max-2.3582709483885766
driven_lanedir_mean-2.3582709483885766
driven_lanedir_median-2.3582709483885766
driven_lanedir_min-2.3582709483885766
in-drivable-lane_max21.699999999999513
in-drivable-lane_mean21.699999999999513
in-drivable-lane_min21.699999999999513
per-episodes
details{"loop2-000-ego0": {"driven_any": 10.213750370739987, "survival_time": 59.99999999999873, "driven_lanedir": -2.3582709483885766, "in-drivable-lane": 21.699999999999513, "deviation-heading": 28.45705063837741, "distance-from-start": 0.2035327852024029, "deviation-center-line": 3.065511986747849, "driven_lanedir_consec": -2.3582709483885766}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16066388Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-validationsim-1of4successnodavinci-stage-03-6.2.510:17:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median25.099999999999465
driven_lanedir_consec_median-4.1358578290560235
deviation-center-line_median2.534905247462591


other stats
deviation-center-line_max2.534905247462591
deviation-center-line_mean2.534905247462591
deviation-center-line_min2.534905247462591
deviation-heading_max28.344907365725245
deviation-heading_mean28.344907365725245
deviation-heading_median28.344907365725245
deviation-heading_min28.344907365725245
distance-from-start_max0.25624319293874853
distance-from-start_mean0.25624319293874853
distance-from-start_median0.25624319293874853
distance-from-start_min0.25624319293874853
driven_any_max14.17917291524884
driven_any_mean14.17917291524884
driven_any_median14.17917291524884
driven_any_min14.17917291524884
driven_lanedir_consec_max-4.1358578290560235
driven_lanedir_consec_mean-4.1358578290560235
driven_lanedir_consec_min-4.1358578290560235
driven_lanedir_max-4.629994795757691
driven_lanedir_mean-4.629994795757691
driven_lanedir_median-4.629994795757691
driven_lanedir_min-4.629994795757691
in-drivable-lane_max25.099999999999465
in-drivable-lane_mean25.099999999999465
in-drivable-lane_min25.099999999999465
per-episodes
details{"4way-000-ego0": {"driven_any": 14.17917291524884, "survival_time": 59.99999999999873, "driven_lanedir": -4.629994795757691, "in-drivable-lane": 25.099999999999465, "deviation-heading": 28.344907365725245, "distance-from-start": 0.25624319293874853, "deviation-center-line": 2.534905247462591, "driven_lanedir_consec": -4.1358578290560235}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16060389Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-validationsim-1of4successnodavinci-stage-03-6.2.510:09:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median25.34999999999936
driven_lanedir_consec_median-3.820982336600986
deviation-center-line_median2.9643585896922726


other stats
deviation-center-line_max2.9643585896922726
deviation-center-line_mean2.9643585896922726
deviation-center-line_min2.9643585896922726
deviation-heading_max28.40386938632571
deviation-heading_mean28.40386938632571
deviation-heading_median28.40386938632571
deviation-heading_min28.40386938632571
distance-from-start_max0.2291652144664277
distance-from-start_mean0.2291652144664277
distance-from-start_median0.2291652144664277
distance-from-start_min0.2291652144664277
driven_any_max12.813171569980552
driven_any_mean12.813171569980552
driven_any_median12.813171569980552
driven_any_min12.813171569980552
driven_lanedir_consec_max-3.820982336600986
driven_lanedir_consec_mean-3.820982336600986
driven_lanedir_consec_min-3.820982336600986
driven_lanedir_max-4.172829879310328
driven_lanedir_mean-4.172829879310328
driven_lanedir_median-4.172829879310328
driven_lanedir_min-4.172829879310328
in-drivable-lane_max25.34999999999936
in-drivable-lane_mean25.34999999999936
in-drivable-lane_min25.34999999999936
per-episodes
details{"udem1-000-ego0": {"driven_any": 12.813171569980552, "survival_time": 59.99999999999873, "driven_lanedir": -4.172829879310328, "in-drivable-lane": 25.34999999999936, "deviation-heading": 28.40386938632571, "distance-from-start": 0.2291652144664277, "deviation-center-line": 2.9643585896922726, "driven_lanedir_consec": -3.820982336600986}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16058389Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-validationsim-3of4successnodavinci-stage-03-6.2.510:01:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
16048392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-0of4successnodavinci-stage-03-6.2.510:34:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median34.249999999999105
driven_lanedir_consec_median-2.6694944678338226
deviation-center-line_median2.405521775635835


other stats
deviation-center-line_max2.7286615302082686
deviation-center-line_mean2.349466205404397
deviation-center-line_min1.8581597401376504
deviation-heading_max27.82149612644852
deviation-heading_mean24.044289748631087
deviation-heading_median23.528260963666785
deviation-heading_min21.29914094074225
distance-from-start_max0.17646020416603256
distance-from-start_mean0.16137983321585173
distance-from-start_median0.16041062562411618
distance-from-start_min0.148237877449142
driven_any_max12.491889690813045
driven_any_mean11.59554920776644
driven_any_median11.891874649942444
driven_any_min10.106557840367833
driven_lanedir_consec_max-1.7400107870114063
driven_lanedir_consec_mean-2.703603662186848
driven_lanedir_consec_min-3.7354149260683407
driven_lanedir_max-1.7400107870114063
driven_lanedir_mean-2.78766530700623
driven_lanedir_median-2.6694944678338226
driven_lanedir_min-4.071661505345869
in-drivable-lane_max37.649999999999025
in-drivable-lane_mean33.26249999999915
in-drivable-lane_min26.899999999999352
per-episodes
details{"autolab-000-ego0": {"driven_any": 11.930500466585732, "survival_time": 59.99999999999873, "driven_lanedir": -3.1960961406335837, "in-drivable-lane": 31.749999999999297, "deviation-heading": 25.550365203018, "distance-from-start": 0.15856447905993465, "deviation-center-line": 2.7286615302082686, "driven_lanedir_consec": -3.1960961406335837}, "autolab-000-ego1": {"driven_any": 10.106557840367833, "survival_time": 59.99999999999873, "driven_lanedir": -1.7400107870114063, "in-drivable-lane": 37.649999999999025, "deviation-heading": 21.29914094074225, "distance-from-start": 0.148237877449142, "deviation-center-line": 2.3417381068749075, "driven_lanedir_consec": -1.7400107870114063}, "autolab-000-ego2": {"driven_any": 12.491889690813045, "survival_time": 59.99999999999873, "driven_lanedir": -4.071661505345869, "in-drivable-lane": 26.899999999999352, "deviation-heading": 27.82149612644852, "distance-from-start": 0.17646020416603256, "deviation-center-line": 1.8581597401376504, "driven_lanedir_consec": -3.7354149260683407}, "autolab-000-ego3": {"driven_any": 11.853248833299151, "survival_time": 59.99999999999873, "driven_lanedir": -2.142892795034061, "in-drivable-lane": 36.74999999999891, "deviation-heading": 21.50615672431557, "distance-from-start": 0.16225677218829768, "deviation-center-line": 2.469305444396762, "driven_lanedir_consec": -2.142892795034061}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16040394Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-testingsim-3of4successnodavinci-stage-03-6.2.510:20:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median25.749999999999456
driven_lanedir_consec_median-3.8187352764530975
deviation-center-line_median2.645349763598596


other stats
deviation-center-line_max2.645349763598596
deviation-center-line_mean2.645349763598596
deviation-center-line_min2.645349763598596
deviation-heading_max28.986151177948987
deviation-heading_mean28.986151177948987
deviation-heading_median28.986151177948987
deviation-heading_min28.986151177948987
distance-from-start_max0.16303424924766313
distance-from-start_mean0.16303424924766313
distance-from-start_median0.16303424924766313
distance-from-start_min0.16303424924766313
driven_any_max11.210489845224918
driven_any_mean11.210489845224918
driven_any_median11.210489845224918
driven_any_min11.210489845224918
driven_lanedir_consec_max-3.8187352764530975
driven_lanedir_consec_mean-3.8187352764530975
driven_lanedir_consec_min-3.8187352764530975
driven_lanedir_max-3.8187352764530975
driven_lanedir_mean-3.8187352764530975
driven_lanedir_median-3.8187352764530975
driven_lanedir_min-3.8187352764530975
in-drivable-lane_max25.749999999999456
in-drivable-lane_mean25.749999999999456
in-drivable-lane_min25.749999999999456
per-episodes
details{"zigzag-000-ego0": {"driven_any": 11.210489845224918, "survival_time": 59.99999999999873, "driven_lanedir": -3.8187352764530975, "in-drivable-lane": 25.749999999999456, "deviation-heading": 28.986151177948987, "distance-from-start": 0.16303424924766313, "deviation-center-line": 2.645349763598596, "driven_lanedir_consec": -3.8187352764530975}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16038394Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-testingsim-1of4successnodavinci-stage-03-6.2.510:03:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.199999999999996
in-drivable-lane_median4.399999999999987
driven_lanedir_consec_median-0.5762860121358497
deviation-center-line_median0.1891075292075373


other stats
deviation-center-line_max0.1891075292075373
deviation-center-line_mean0.1891075292075373
deviation-center-line_min0.1891075292075373
deviation-heading_max3.731673308920557
deviation-heading_mean3.731673308920557
deviation-heading_median3.731673308920557
deviation-heading_min3.731673308920557
distance-from-start_max0.14768153616305996
distance-from-start_mean0.14768153616305996
distance-from-start_median0.14768153616305996
distance-from-start_min0.14768153616305996
driven_any_max1.699534586140817
driven_any_mean1.699534586140817
driven_any_median1.699534586140817
driven_any_min1.699534586140817
driven_lanedir_consec_max-0.5762860121358497
driven_lanedir_consec_mean-0.5762860121358497
driven_lanedir_consec_min-0.5762860121358497
driven_lanedir_max-0.5762860121358497
driven_lanedir_mean-0.5762860121358497
driven_lanedir_median-0.5762860121358497
driven_lanedir_min-0.5762860121358497
in-drivable-lane_max4.399999999999987
in-drivable-lane_mean4.399999999999987
in-drivable-lane_min4.399999999999987
per-episodes
details{"loop-000-ego0": {"driven_any": 1.699534586140817, "survival_time": 9.199999999999996, "driven_lanedir": -0.5762860121358497, "in-drivable-lane": 4.399999999999987, "deviation-heading": 3.731673308920557, "distance-from-start": 0.14768153616305996, "deviation-center-line": 0.1891075292075373, "driven_lanedir_consec": -0.5762860121358497}}
simulation-passed1
survival_time_max9.199999999999996
survival_time_mean9.199999999999996
survival_time_min9.199999999999996
No reset possible
16033396Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-testingsim-1of4successnodavinci-stage-03-6.2.510:09:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median33.84999999999915
driven_lanedir_consec_median-2.7075699907715687
deviation-center-line_median2.516226315024263


other stats
deviation-center-line_max2.516226315024263
deviation-center-line_mean2.516226315024263
deviation-center-line_min2.516226315024263
deviation-heading_max24.784036788727068
deviation-heading_mean24.784036788727068
deviation-heading_median24.784036788727068
deviation-heading_min24.784036788727068
distance-from-start_max0.18149308035837972
distance-from-start_mean0.18149308035837972
distance-from-start_median0.18149308035837972
distance-from-start_min0.18149308035837972
driven_any_max11.8562856538058
driven_any_mean11.8562856538058
driven_any_median11.8562856538058
driven_any_min11.8562856538058
driven_lanedir_consec_max-2.7075699907715687
driven_lanedir_consec_mean-2.7075699907715687
driven_lanedir_consec_min-2.7075699907715687
driven_lanedir_max-2.7075699907715687
driven_lanedir_mean-2.7075699907715687
driven_lanedir_median-2.7075699907715687
driven_lanedir_min-2.7075699907715687
in-drivable-lane_max33.84999999999915
in-drivable-lane_mean33.84999999999915
in-drivable-lane_min33.84999999999915
per-episodes
details{"udem1-000-ego0": {"driven_any": 11.8562856538058, "survival_time": 59.99999999999873, "driven_lanedir": -2.7075699907715687, "in-drivable-lane": 33.84999999999915, "deviation-heading": 24.784036788727068, "distance-from-start": 0.18149308035837972, "deviation-center-line": 2.516226315024263, "driven_lanedir_consec": -2.7075699907715687}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16031396Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-testingsim-2of4successnodavinci-stage-03-6.2.510:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
16028398Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-03-6.2.510:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
16023514Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-validationsim-1of4failednodavinci-stage-03-6.2.510:01:13
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16019515Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-validationsim-3of4failednodavinci-stage-03-6.2.510:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16015516Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-validationsim-0of4failednodavinci-stage-03-6.2.510:01:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16010518Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-validationsim-1of4failednodavinci-stage-03-6.2.510:01:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16005519Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-validationsim-2of4failednodavinci-stage-03-6.2.510:00:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16001519Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-validationsim-1of4failednodavinci-stage-03-6.2.510:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15998520Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-validationsim-1of4failednodavinci-stage-03-6.2.510:01:11
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15994521Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-testingsim-3of4failednodavinci-stage-03-6.2.510:01:17
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15989523Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-testingsim-2of4failednodavinci-stage-03-6.2.510:01:47
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15986523Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-testingsim-1of4failednodavinci-stage-03-6.2.510:01:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15983524Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-testingsim-2of4successnodavinci-stage-03-6.2.510:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
15980525Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-testingsim-0of4failednodavinci-stage-03-6.2.510:01:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15978525Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-testingsim-1of4failednodavinci-stage-03-6.2.510:01:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15976527Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-03-6.2.510:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
15975527Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-testingsim-0of4failednodavinci-stage-03-6.2.510:01:34
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15974527Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-testingsim-3of4successnodavinci-stage-03-6.2.510:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
15973528Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-validationsim-0of4failednodavinci-stage-03-6.2.510:01:10
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15968529Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-validationsim-2of4successnodavinci-stage-03-6.2.510:04:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median43.499999999999666
in-drivable-lane_median16.04999999999949
driven_lanedir_consec_median4.3285758645895624
deviation-center-line_median2.1396096627710643


other stats
deviation-center-line_max2.1396096627710643
deviation-center-line_mean2.1396096627710643
deviation-center-line_min2.1396096627710643
deviation-heading_max12.224935652990435
deviation-heading_mean12.224935652990435
deviation-heading_median12.224935652990435
deviation-heading_min12.224935652990435
distance-from-start_max1.599720056942492
distance-from-start_mean1.599720056942492
distance-from-start_median1.599720056942492
distance-from-start_min1.599720056942492
driven_any_max8.10718952484514
driven_any_mean8.10718952484514
driven_any_median8.10718952484514
driven_any_min8.10718952484514
driven_lanedir_consec_max4.3285758645895624
driven_lanedir_consec_mean4.3285758645895624
driven_lanedir_consec_min4.3285758645895624
driven_lanedir_max4.3285758645895624
driven_lanedir_mean4.3285758645895624
driven_lanedir_median4.3285758645895624
driven_lanedir_min4.3285758645895624
in-drivable-lane_max16.04999999999949
in-drivable-lane_mean16.04999999999949
in-drivable-lane_min16.04999999999949
per-episodes
details{"loop2-000-ego0": {"driven_any": 8.10718952484514, "survival_time": 43.499999999999666, "driven_lanedir": 4.3285758645895624, "in-drivable-lane": 16.04999999999949, "deviation-heading": 12.224935652990435, "distance-from-start": 1.599720056942492, "deviation-center-line": 2.1396096627710643, "driven_lanedir_consec": 4.3285758645895624}}
simulation-passed1
survival_time_max43.499999999999666
survival_time_mean43.499999999999666
survival_time_min43.499999999999666
No reset possible
15962530Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-validationsim-1of4successnodavinci-stage-03-6.2.510:06:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median29.450000000000284
in-drivable-lane_median0.0
driven_lanedir_consec_median4.76106227195214
deviation-center-line_median1.2962217143154684


other stats
deviation-center-line_max1.2962217143154684
deviation-center-line_mean1.2962217143154684
deviation-center-line_min1.2962217143154684
deviation-heading_max6.444222046936028
deviation-heading_mean6.444222046936028
deviation-heading_median6.444222046936028
deviation-heading_min6.444222046936028
distance-from-start_max2.3431398413938047
distance-from-start_mean2.3431398413938047
distance-from-start_median2.3431398413938047
distance-from-start_min2.3431398413938047
driven_any_max4.994067872410223
driven_any_mean4.994067872410223
driven_any_median4.994067872410223
driven_any_min4.994067872410223
driven_lanedir_consec_max4.76106227195214
driven_lanedir_consec_mean4.76106227195214
driven_lanedir_consec_min4.76106227195214
driven_lanedir_max4.76106227195214
driven_lanedir_mean4.76106227195214
driven_lanedir_median4.76106227195214
driven_lanedir_min4.76106227195214
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 4.994067872410223, "survival_time": 29.450000000000284, "driven_lanedir": 4.76106227195214, "in-drivable-lane": 0.0, "deviation-heading": 6.444222046936028, "distance-from-start": 2.3431398413938047, "deviation-center-line": 1.2962217143154684, "driven_lanedir_consec": 4.76106227195214}}
simulation-passed1
survival_time_max29.450000000000284
survival_time_mean29.450000000000284
survival_time_min29.450000000000284
No reset possible
15958531Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-validationsim-2of4successnodavinci-stage-03-6.2.510:01:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
15944535Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-testingsim-1of4successnodavinci-stage-03-6.2.510:19:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.549999999999998
driven_lanedir_consec_median9.327434968144065
deviation-center-line_median2.817941526172745


other stats
deviation-center-line_max2.9777619577802956
deviation-center-line_mean2.8076844045299363
deviation-center-line_min2.61709260799396
deviation-heading_max17.17772001050437
deviation-heading_mean14.994471443185558
deviation-heading_median14.46648990256414
deviation-heading_min13.867185957109584
distance-from-start_max3.2515347840230957
distance-from-start_mean2.5107132200489857
distance-from-start_median2.448949982858853
distance-from-start_min1.8934181304551416
driven_any_max10.193737678489445
driven_any_mean9.94055539689568
driven_any_median9.962664674882811
driven_any_min9.643154559327646
driven_lanedir_consec_max9.497126320841865
driven_lanedir_consec_mean9.210410515967157
driven_lanedir_consec_min8.689645806738632
driven_lanedir_max9.497126320841865
driven_lanedir_mean9.210410515967157
driven_lanedir_median9.327434968144065
driven_lanedir_min8.689645806738632
in-drivable-lane_max5.249999999999801
in-drivable-lane_mean1.5874999999999493
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 10.1517675557512, "survival_time": 59.99999999999873, "driven_lanedir": 8.689645806738632, "in-drivable-lane": 5.249999999999801, "deviation-heading": 17.17772001050437, "distance-from-start": 3.2515347840230957, "deviation-center-line": 2.9295656995716297, "driven_lanedir_consec": 8.689645806738632}, "loop-000-ego1": {"driven_any": 9.643154559327646, "survival_time": 59.99999999999873, "driven_lanedir": 9.262887147012671, "in-drivable-lane": 0.0, "deviation-heading": 13.867185957109584, "distance-from-start": 2.4398223787655917, "deviation-center-line": 2.61709260799396, "driven_lanedir_consec": 9.262887147012671}, "loop-000-ego2": {"driven_any": 9.773561794014428, "survival_time": 59.99999999999873, "driven_lanedir": 9.391982789275454, "in-drivable-lane": 0.0, "deviation-heading": 13.993365840109693, "distance-from-start": 2.4580775869521134, "deviation-center-line": 2.7063173527738607, "driven_lanedir_consec": 9.391982789275454}, "loop-000-ego3": {"driven_any": 10.193737678489445, "survival_time": 59.99999999999873, "driven_lanedir": 9.497126320841865, "in-drivable-lane": 1.099999999999996, "deviation-heading": 14.939613965018587, "distance-from-start": 1.8934181304551416, "deviation-center-line": 2.9777619577802956, "driven_lanedir_consec": 9.497126320841865}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
15941536Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-testingsim-3of4successnodavinci-stage-03-6.2.510:04:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median24.800000000000217
in-drivable-lane_median0.350000000000005
driven_lanedir_consec_median3.277651687755331
deviation-center-line_median0.9642151946696348


other stats
deviation-center-line_max0.9642151946696348
deviation-center-line_mean0.9642151946696348
deviation-center-line_min0.9642151946696348
deviation-heading_max5.9424099793768645
deviation-heading_mean5.9424099793768645
deviation-heading_median5.9424099793768645
deviation-heading_min5.9424099793768645
distance-from-start_max2.225673550019025
distance-from-start_mean2.225673550019025
distance-from-start_median2.225673550019025
distance-from-start_min2.225673550019025
driven_any_max3.490435690551515
driven_any_mean3.490435690551515
driven_any_median3.490435690551515
driven_any_min3.490435690551515
driven_lanedir_consec_max3.277651687755331
driven_lanedir_consec_mean3.277651687755331
driven_lanedir_consec_min3.277651687755331
driven_lanedir_max3.277651687755331
driven_lanedir_mean3.277651687755331
driven_lanedir_median3.277651687755331
driven_lanedir_min3.277651687755331
in-drivable-lane_max0.350000000000005
in-drivable-lane_mean0.350000000000005
in-drivable-lane_min0.350000000000005
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.490435690551515, "survival_time": 24.800000000000217, "driven_lanedir": 3.277651687755331, "in-drivable-lane": 0.350000000000005, "deviation-heading": 5.9424099793768645, "distance-from-start": 2.225673550019025, "deviation-center-line": 0.9642151946696348, "driven_lanedir_consec": 3.277651687755331}}
simulation-passed1
survival_time_max24.800000000000217
survival_time_mean24.800000000000217
survival_time_min24.800000000000217
No reset possible
15936537Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-testingsim-1of4successnodavinci-stage-03-6.2.510:08:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median43.349999999999675
in-drivable-lane_median0.0
driven_lanedir_consec_median7.34781630595053
deviation-center-line_median1.9379298604619957


other stats
deviation-center-line_max1.9379298604619957
deviation-center-line_mean1.9379298604619957
deviation-center-line_min1.9379298604619957
deviation-heading_max10.123344575186158
deviation-heading_mean10.123344575186158
deviation-heading_median10.123344575186158
deviation-heading_min10.123344575186158
distance-from-start_max2.9347469640206505
distance-from-start_mean2.9347469640206505
distance-from-start_median2.9347469640206505
distance-from-start_min2.9347469640206505
driven_any_max7.636068913955206
driven_any_mean7.636068913955206
driven_any_median7.636068913955206
driven_any_min7.636068913955206
driven_lanedir_consec_max7.34781630595053
driven_lanedir_consec_mean7.34781630595053
driven_lanedir_consec_min7.34781630595053
driven_lanedir_max7.34781630595053
driven_lanedir_mean7.34781630595053
driven_lanedir_median7.34781630595053
driven_lanedir_min7.34781630595053
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 7.636068913955206, "survival_time": 43.349999999999675, "driven_lanedir": 7.34781630595053, "in-drivable-lane": 0.0, "deviation-heading": 10.123344575186158, "distance-from-start": 2.9347469640206505, "deviation-center-line": 1.9379298604619957, "driven_lanedir_consec": 7.34781630595053}}
simulation-passed1
survival_time_max43.349999999999675
survival_time_mean43.349999999999675
survival_time_min43.349999999999675
No reset possible
15921542Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-testingsim-0of4successnodavinci-stage-03-6.2.510:16:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.12500000000000178
driven_lanedir_consec_median1.5464274188828693
deviation-center-line_median3.88834571803374


other stats
deviation-center-line_max5.995298609068646
deviation-center-line_mean3.5478165269827704
deviation-center-line_min0.4192760627949571
deviation-heading_max29.305482154495444
deviation-heading_mean18.130496641203436
deviation-heading_median20.350561502939556
deviation-heading_min2.5153814044391813
distance-from-start_max3.2467912652463076
distance-from-start_mean1.7341174593477984
distance-from-start_median1.3928032994319903
distance-from-start_min0.9040719732809048
driven_any_max9.786393679394576
driven_any_mean3.594881927408283
driven_any_median1.6569576809611193
driven_any_min1.2792186683163185
driven_lanedir_consec_max8.404094934578325
driven_lanedir_consec_mean3.182119562199702
driven_lanedir_consec_min1.231528476454744
driven_lanedir_max9.26732996620705
driven_lanedir_mean3.400988916565156
driven_lanedir_median1.5525486117994147
driven_lanedir_min1.231528476454744
in-drivable-lane_max49.89999999999872
in-drivable-lane_mean12.537499999999682
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 9.786393679394576, "survival_time": 59.99999999999873, "driven_lanedir": 9.26732996620705, "in-drivable-lane": 0.25000000000000355, "deviation-heading": 13.442052170002745, "distance-from-start": 3.2467912652463076, "deviation-center-line": 3.0040417567289825, "driven_lanedir_consec": 8.404094934578325}, "udem-000-ego1": {"driven_any": 1.2792186683163185, "survival_time": 59.99999999999873, "driven_lanedir": 1.231528476454744, "in-drivable-lane": 0.0, "deviation-heading": 29.305482154495444, "distance-from-start": 0.9040719732809048, "deviation-center-line": 5.995298609068646, "driven_lanedir_consec": 1.231528476454744}, "udem-000-ego2": {"driven_any": 1.6352488715529498, "survival_time": 59.99999999999873, "driven_lanedir": 1.5018498794210051, "in-drivable-lane": 49.89999999999872, "deviation-heading": 2.5153814044391813, "distance-from-start": 1.1836507602679311, "deviation-center-line": 0.4192760627949571, "driven_lanedir_consec": 1.4909740024266485}, "udem-000-ego3": {"driven_any": 1.6786664903692887, "survival_time": 59.99999999999873, "driven_lanedir": 1.6032473441778243, "in-drivable-lane": 0.0, "deviation-heading": 27.25907083587637, "distance-from-start": 1.6019558385960495, "deviation-center-line": 4.772649679338497, "driven_lanedir_consec": 1.60188083533909}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
15914763Bea Baselines 🐤challenge-aido_LF-template-ros:daffy:e107400fd98b91bb7c02b7b24d7be5f5d7623035aido-hello-sim-validationsanity-checksuccessnodavinci-stage-03-6.2.510:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.041386855198155104
deviation-center-line_median0.006494610833933571


other stats
deviation-center-line_max0.006494610833933571
deviation-center-line_mean0.006494610833933571
deviation-center-line_min0.006494610833933571
deviation-heading_max0.293581787588131
deviation-heading_mean0.293581787588131
deviation-heading_median0.293581787588131
deviation-heading_min0.293581787588131
distance-from-start_max0.051680541900992145
distance-from-start_mean0.051680541900992145
distance-from-start_median0.051680541900992145
distance-from-start_min0.051680541900992145
driven_any_max0.05173433573782145
driven_any_mean0.05173433573782145
driven_any_median0.05173433573782145
driven_any_min0.05173433573782145
driven_lanedir_consec_max0.041386855198155104
driven_lanedir_consec_mean0.041386855198155104
driven_lanedir_consec_min0.041386855198155104
driven_lanedir_max0.041386855198155104
driven_lanedir_mean0.041386855198155104
driven_lanedir_median0.041386855198155104
driven_lanedir_min0.041386855198155104
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.05173433573782145, "survival_time": 0.49999999999999994, "driven_lanedir": 0.041386855198155104, "in-drivable-lane": 0.0, "deviation-heading": 0.293581787588131, "distance-from-start": 0.051680541900992145, "deviation-center-line": 0.006494610833933571, "driven_lanedir_consec": 0.041386855198155104}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
15908791Bea Baselines 🐤challenge-aido_LF-baseline-RPL-ros:daffy-staging:61ce4781fdb88fb08748da51bde492a74499e71daido-hello-sim-validationsanity-checksuccessnodavinci-stage-03-6.2.510:01:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.009295559539588494
deviation-center-line_median0.007006772765454841


other stats
deviation-center-line_max0.007006772765454841
deviation-center-line_mean0.007006772765454841
deviation-center-line_min0.007006772765454841
deviation-heading_max0.26302297782027906
deviation-heading_mean0.26302297782027906
deviation-heading_median0.26302297782027906
deviation-heading_min0.26302297782027906
distance-from-start_max0.010491969616325947
distance-from-start_mean0.010491969616325947
distance-from-start_median0.010491969616325947
distance-from-start_min0.010491969616325947
driven_any_max0.010496600675557183
driven_any_mean0.010496600675557183
driven_any_median0.010496600675557183
driven_any_min0.010496600675557183
driven_lanedir_consec_max0.009295559539588494
driven_lanedir_consec_mean0.009295559539588494
driven_lanedir_consec_min0.009295559539588494
driven_lanedir_max0.009295559539588494
driven_lanedir_mean0.009295559539588494
driven_lanedir_median0.009295559539588494
driven_lanedir_min0.009295559539588494
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.010496600675557183, "survival_time": 0.49999999999999994, "driven_lanedir": 0.009295559539588494, "in-drivable-lane": 0.0, "deviation-heading": 0.26302297782027906, "distance-from-start": 0.010491969616325947, "deviation-center-line": 0.007006772765454841, "driven_lanedir_consec": 0.009295559539588494}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
15902815Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-validationsim-2of4successnodavinci-stage-03-6.2.510:03:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.692768953399423
deviation-center-line_median0.22838243511519724


other stats
deviation-center-line_max0.22838243511519724
deviation-center-line_mean0.22838243511519724
deviation-center-line_min0.22838243511519724
deviation-heading_max2.327018578184933
deviation-heading_mean2.327018578184933
deviation-heading_median2.327018578184933
deviation-heading_min2.327018578184933
distance-from-start_max1.517284045125221
distance-from-start_mean1.517284045125221
distance-from-start_median1.517284045125221
distance-from-start_min1.517284045125221
driven_any_max5.702917901484924
driven_any_mean5.702917901484924
driven_any_median5.702917901484924
driven_any_min5.702917901484924
driven_lanedir_consec_max5.692768953399423
driven_lanedir_consec_mean5.692768953399423
driven_lanedir_consec_min5.692768953399423
driven_lanedir_max5.692768953399423
driven_lanedir_mean5.692768953399423
driven_lanedir_median5.692768953399423
driven_lanedir_min5.692768953399423
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 5.702917901484924, "survival_time": 59.99999999999873, "driven_lanedir": 5.692768953399423, "in-drivable-lane": 0.0, "deviation-heading": 2.327018578184933, "distance-from-start": 1.517284045125221, "deviation-center-line": 0.22838243511519724, "driven_lanedir_consec": 5.692768953399423}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
15892817Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-validationsim-2of4successnodavinci-stage-03-6.2.510:11:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.496299828477744
deviation-center-line_median0.17183898904941014


other stats
deviation-center-line_max0.21132079357626976
deviation-center-line_mean0.1743653873253979
deviation-center-line_min0.1424627776265016
deviation-heading_max1.5868854715733702
deviation-heading_mean1.4512616339961206
deviation-heading_median1.4728924991747463
deviation-heading_min1.2723760660616197
distance-from-start_max3.152836469048969
distance-from-start_mean2.690530320315596
distance-from-start_median2.641239810973879
distance-from-start_min2.3268051902656572
driven_any_max5.831435519999375
driven_any_mean5.567123575605065
driven_any_median5.707730195058858
driven_any_min5.021598392303173
driven_lanedir_consec_max5.704845460644086
driven_lanedir_consec_mean5.327153206008904
driven_lanedir_consec_min4.611167706436042
driven_lanedir_max5.8223962690688085
driven_lanedir_mean5.560890784650249
driven_lanedir_median5.703499571898595
driven_lanedir_min5.014167725734996
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 5.021598392303173, "survival_time": 59.99999999999873, "driven_lanedir": 5.014167725734996, "in-drivable-lane": 0.0, "deviation-heading": 1.5868854715733702, "distance-from-start": 2.339170523946391, "deviation-center-line": 0.1827495883978732, "driven_lanedir_consec": 4.611167706436042}, "4way-000-ego1": {"driven_any": 5.831435519999375, "survival_time": 59.99999999999873, "driven_lanedir": 5.8223962690688085, "in-drivable-lane": 0.0, "deviation-heading": 1.537638141336496, "distance-from-start": 3.152836469048969, "deviation-center-line": 0.21132079357626976, "driven_lanedir_consec": 5.584035348945523}, "4way-000-ego2": {"driven_any": 5.707095572773834, "survival_time": 59.99999999999873, "driven_lanedir": 5.702153535639253, "in-drivable-lane": 0.0, "deviation-heading": 1.408146857012997, "distance-from-start": 2.3268051902656572, "deviation-center-line": 0.16092838970094706, "driven_lanedir_consec": 5.408564308009964}, "4way-000-ego3": {"driven_any": 5.708364817343881, "survival_time": 59.99999999999873, "driven_lanedir": 5.704845608157938, "in-drivable-lane": 0.0, "deviation-heading": 1.2723760660616197, "distance-from-start": 2.943309098001367, "deviation-center-line": 0.1424627776265016, "driven_lanedir_consec": 5.704845460644086}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
15887818Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-validationsim-0of4successnodavinci-stage-03-6.2.510:10:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.4477076357371352
deviation-center-line_median0.0719572483263306


other stats
deviation-center-line_max0.0719572483263306
deviation-center-line_mean0.0719572483263306
deviation-center-line_min0.0719572483263306
deviation-heading_max1.9197947517405864
deviation-heading_mean1.9197947517405864
deviation-heading_median1.9197947517405864
deviation-heading_min1.9197947517405864
distance-from-start_max0.4476854412517205
distance-from-start_mean0.4476854412517205
distance-from-start_median0.4476854412517205
distance-from-start_min0.4476854412517205
driven_any_max0.4483014753438006
driven_any_mean0.4483014753438006
driven_any_median0.4483014753438006
driven_any_min0.4483014753438006
driven_lanedir_consec_max0.4477076357371352
driven_lanedir_consec_mean0.4477076357371352
driven_lanedir_consec_min0.4477076357371352
driven_lanedir_max0.4477076357371352
driven_lanedir_mean0.4477076357371352
driven_lanedir_median0.4477076357371352
driven_lanedir_min0.4477076357371352
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-001-ego0": {"driven_any": 0.4483014753438006, "survival_time": 59.99999999999873, "driven_lanedir": 0.4477076357371352, "in-drivable-lane": 0.0, "deviation-heading": 1.9197947517405864, "distance-from-start": 0.4476854412517205, "deviation-center-line": 0.0719572483263306, "driven_lanedir_consec": 0.4477076357371352}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
15884819Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-validation467erroryesdavinci-stage-03-6.2.510:01:29
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 177, in object_from_ipce_
    return object_from_ipce_dict(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 461, in object_from_ipce_dict
    attrs[k] = object_from_ipce_(v, et_V, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 391, in object_from_ipce_dataclass_instance
    raise ZValueError(msg, anns=anns, T=T, known=sorted(mj), f=f)
zuper_commons.types.exceptions.ZValueError: Cannot find field 'dynamics' in data for class ScenarioRobotSpec and no default available
│  anns: dict[7]
│        │ configuration: RobotConfiguration
│        │ color: str
│        │ description: str
│        │ controllable: bool
│        │ protocol: Optional[ProtocolDesc ]
│        │ dynamics: str
│        │ dynamics_params: Dict[str,Any ]
│     T: str
│ known: [color, configuration, controllable, description, protocol]
│     f: Field(name='dynamics',type=<class 'str'>,default=<dataclasses._MISSING_TYPE object at 0x7fad82468e50>,default_factory=<dataclasses._MISSING_TYPE object at 0x7fad82468e50>,init=True,repr=True,hash=None,compare=True,metadata=mappingproxy({}),_field_type=_FIELD)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 74, in object_from_ipce
    res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'robots' of Scenario.
│ K_annotations: dict[6]
│                │ scenario_name: str
│                │ environment: Any
│                │ player_robots: List[str]
│                │ robots: Dict[str,ScenarioRobotSpec]
│                │ duckies: Dict[str,ScenarioDuckieSpec]
│                │ payload_yaml: str
│   expect_type: Dict[str,ScenarioRobotSpec]
│         ann_K: Dict[str,ScenarioRobotSpec]
│        K_name: Scenario

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 167, in main
    episodes0 = get_episodes_from_dirs(config.scenarios)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 833, in get_episodes_from_dirs
    scenario = cast(Scenario, object_from_ipce(config_, Scenario))
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 93, in object_from_ipce
    raise ZValueError(msg, expect_type=expect_type, mj=mj) from e
zuper_commons.types.exceptions.ZValueError: Cannot deserialize object
│ expect_type: Scenario
│          mj: dict[6]
│              │ payload_yaml: ''
│              │ player_robots: [ego0, ego1, ego2, ego3]
│              │ scenario_name: LFV_multi-state-4way-000
│              │ robots:
│              │ dict[4]
│              │ │ ego0:
│              │ │ dict[5]
│              │ │ │ color: red
│              │ │ │ protocol: PROTOCOL_STATE
│              │ │ │ description: Playable robot ego0
│              │ │ │ controllable: True
│              │ │ │ configuration: {pose: {x: 3.19, y: 1.276, theta_deg: 180.0} , velocity: {x: 0.0, y: 0.0, theta_deg: 0.0} }
│              │ │ ego1:
│              │ │ dict[5]
│              │ │ │ color: green
│              │ │ │ protocol: PROTOCOL_STATE
│              │ │ │ description: Playable robot ego1
│              │ │ │ controllable: True
│              │ │ │ configuration: {pose: {x: 2.75, y: 2.175, theta_deg: 90.0} , velocity: {x: 0.0, y: 0.0, theta_deg: 0.0} }
│              │ │ ego2:
│              │ │ dict[5]
│              │ │ │ color: blue
│              │ │ │ protocol: PROTOCOL_STATE
│              │ │ │ description: Playable robot ego2
│              │ │ │ controllable: True
│              │ │ │ configuration: {pose: {x: 2.75, y: 3.074, theta_deg: 90.0} , velocity: {x: 0.0, y: 0.0, theta_deg: 0.0} }
│              │ │ ego3:
│              │ │ dict[5]
│              │ │ │ color: red
│              │ │ │ protocol: PROTOCOL_STATE
│              │ │ │ description: Playable robot ego3
│              │ │ │ controllable: True
│              │ │ │ configuration: {pose: {x: 1.914, y: 2.7492, theta_deg: 0.0} , velocity: {x: 0.0, y: 0.0, theta_deg: 0.0} }
│              │ duckies: {}
│              │ environment:
│              │ |# 5x5 counter-clockwise loop with a 4-way intersection in the middle
│              │ |# Designed to test the 4-way intersection tile and traffic light
│              │ |tiles:
│              │ |- [floor, floor, floor, floor, floor, floor, floor]
│              │ |- [floor, curve_left/W , straight/W, 3way_left/W   , straight/W, curve_left/N, floor]
│              │ |- [floor, straight/S   , asphalt   , straight/N    , asphalt   , straight/N, floor]
│              │ |- [floor, 3way_left/S  , straight/W, 4way          , straight/E, 3way_left/N, floor]
│              │ |- [floor, straight/S   , asphalt   , straight/S    , asphalt   , straight/N, floor]
│              │ |- [floor, curve_left/S , straight/E, 3way_left/E   , straight/E, curve_left/E, floor]
│              │ |- [floor, floor, floor, floor, floor, floor, floor]
│              │ |
│              │ |objects:
│              │ |  trafficlight:
│              │ |    kind: trafficlight
│              │ |    place:
│              │ |      tile: [3,3]
│              │ |      relative:
│              │ |        ~SE2Transform:
│              │ |          p: [-0.18,-0.18]
│              │ |          theta_deg: 135
│              │ |    height: 0.4
│              │ |    optional: true
│              │ |
│              │ |tile_size: 0.585
│              │ |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15879821Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-testingsim-0of4successnodavinci-stage-03-6.2.510:04:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.6173794793891885
deviation-center-line_median0.3790863571459804


other stats
deviation-center-line_max0.3790863571459804
deviation-center-line_mean0.3790863571459804
deviation-center-line_min0.3790863571459804
deviation-heading_max2.844192295741865
deviation-heading_mean2.844192295741865
deviation-heading_median2.844192295741865
deviation-heading_min2.844192295741865
distance-from-start_max2.723986924723346
distance-from-start_mean2.723986924723346
distance-from-start_median2.723986924723346
distance-from-start_min2.723986924723346
driven_any_max5.636243490208466
driven_any_mean5.636243490208466
driven_any_median5.636243490208466
driven_any_min5.636243490208466
driven_lanedir_consec_max5.6173794793891885
driven_lanedir_consec_mean5.6173794793891885
driven_lanedir_consec_min5.6173794793891885
driven_lanedir_max5.6173794793891885
driven_lanedir_mean5.6173794793891885
driven_lanedir_median5.6173794793891885
driven_lanedir_min5.6173794793891885
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 5.636243490208466, "survival_time": 59.99999999999873, "driven_lanedir": 5.6173794793891885, "in-drivable-lane": 0.0, "deviation-heading": 2.844192295741865, "distance-from-start": 2.723986924723346, "deviation-center-line": 0.3790863571459804, "driven_lanedir_consec": 5.6173794793891885}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
15875822Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-testingsim-2of4successnodavinci-stage-03-6.2.510:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
15870823Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-testingsim-0of4successnodavinci-stage-03-6.2.510:11:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.237107191226386
deviation-center-line_median0.23759334910349403


other stats
deviation-center-line_max2.1326977700633005
deviation-center-line_mean0.6838879528223635
deviation-center-line_min0.1276673430191657
deviation-heading_max13.12196147454032
deviation-heading_mean4.364557637939925
deviation-heading_median1.584486276774531
deviation-heading_min1.1672965236703177
distance-from-start_max3.1342802968590027
distance-from-start_mean1.8729192379232904
distance-from-start_median2.1786983274170795
distance-from-start_min4.440892098500626e-16
driven_any_max5.758579747198662
driven_any_mean4.134329883566824
driven_any_median5.389369893534051
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max5.458898880219736
driven_lanedir_consec_mean3.983314078454992
driven_lanedir_consec_min0.0001430511474609375
driven_lanedir_max5.755160319127538
driven_lanedir_mean4.130829489397701
driven_lanedir_median5.384007293657903
driven_lanedir_min0.0001430511474609375
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-001-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "in-drivable-lane": 0.0, "deviation-heading": 13.12196147454032, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 2.1326977700633005, "driven_lanedir_consec": 0.0001430511474609375}, "udem-001-ego1": {"driven_any": 5.250523118831771, "survival_time": 59.99999999999873, "driven_lanedir": 5.244914558422043, "in-drivable-lane": 0.0, "deviation-heading": 1.5492135672194798, "distance-from-start": 2.858024790062626, "deviation-center-line": 0.24799702258050904, "driven_lanedir_consec": 5.244914558422043}, "udem-001-ego2": {"driven_any": 5.758579747198662, "survival_time": 59.99999999999873, "driven_lanedir": 5.755160319127538, "in-drivable-lane": 0.0, "deviation-heading": 1.1672965236703177, "distance-from-start": 3.1342802968590027, "deviation-center-line": 0.1276673430191657, "driven_lanedir_consec": 5.458898880219736}, "udem-001-ego3": {"driven_any": 5.52821666823633, "survival_time": 59.99999999999873, "driven_lanedir": 5.523100028893762, "in-drivable-lane": 0.0, "deviation-heading": 1.6197589863295825, "distance-from-start": 1.4993718647715328, "deviation-center-line": 0.22718967562647904, "driven_lanedir_consec": 5.229299824030728}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
15865824Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-testingsim-0of4successnodavinci-stage-03-6.2.510:10:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median1.2100199545198067
deviation-center-line_median1.272693831894064


other stats
deviation-center-line_max1.272693831894064
deviation-center-line_mean1.272693831894064
deviation-center-line_min1.272693831894064
deviation-heading_max5.855606525916092
deviation-heading_mean5.855606525916092
deviation-heading_median5.855606525916092
deviation-heading_min5.855606525916092
distance-from-start_max1.194075152462886
distance-from-start_mean1.194075152462886
distance-from-start_median1.194075152462886
distance-from-start_min1.194075152462886
driven_any_max1.2141472555607715
driven_any_mean1.2141472555607715
driven_any_median1.2141472555607715
driven_any_min1.2141472555607715
driven_lanedir_consec_max1.2100199545198067
driven_lanedir_consec_mean1.2100199545198067
driven_lanedir_consec_min1.2100199545198067
driven_lanedir_max1.2100199545198067
driven_lanedir_mean1.2100199545198067
driven_lanedir_median1.2100199545198067
driven_lanedir_min1.2100199545198067
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-001-ego0": {"driven_any": 1.2141472555607715, "survival_time": 59.99999999999873, "driven_lanedir": 1.2100199545198067, "in-drivable-lane": 0.0, "deviation-heading": 5.855606525916092, "distance-from-start": 1.194075152462886, "deviation-center-line": 1.272693831894064, "driven_lanedir_consec": 1.2100199545198067}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
15858826Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-validationsim-0of4successnodavinci-stage-03-6.2.510:12:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median1.829863345092516
deviation-center-line_median0.7452453730558963


other stats
deviation-center-line_max0.7452453730558963
deviation-center-line_mean0.7452453730558963
deviation-center-line_min0.7452453730558963
deviation-heading_max2.253920939651482
deviation-heading_mean2.253920939651482
deviation-heading_median2.253920939651482
deviation-heading_min2.253920939651482
distance-from-start_max1.4208404655961004
distance-from-start_mean1.4208404655961004
distance-from-start_median1.4208404655961004
distance-from-start_min1.4208404655961004
driven_any_max1.8373653561570753
driven_any_mean1.8373653561570753
driven_any_median1.8373653561570753
driven_any_min1.8373653561570753
driven_lanedir_consec_max1.829863345092516
driven_lanedir_consec_mean1.829863345092516
driven_lanedir_consec_min1.829863345092516
driven_lanedir_max1.829863345092516
driven_lanedir_mean1.829863345092516
driven_lanedir_median1.829863345092516
driven_lanedir_min1.829863345092516
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.8373653561570753, "survival_time": 59.99999999999873, "driven_lanedir": 1.829863345092516, "in-drivable-lane": 0.0, "deviation-heading": 2.253920939651482, "distance-from-start": 1.4208404655961004, "deviation-center-line": 0.7452453730558963, "driven_lanedir_consec": 1.829863345092516}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
15851828Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-testingsim-3of4successnodavinci-stage-03-6.2.510:05:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median1.8922261091347536e-06
deviation-center-line_median0.4065255308886839


other stats
deviation-center-line_max0.4065255308886839
deviation-center-line_mean0.4065255308886839
deviation-center-line_min0.4065255308886839
deviation-heading_max40.96731053008268
deviation-heading_mean40.96731053008268
deviation-heading_median40.96731053008268
deviation-heading_min40.96731053008268
distance-from-start_max9.930136612989092e-16
distance-from-start_mean9.930136612989092e-16
distance-from-start_median9.930136612989092e-16
distance-from-start_min9.930136612989092e-16
driven_any_max1.19161639355867e-12
driven_any_mean1.19161639355867e-12
driven_any_median1.19161639355867e-12
driven_any_min1.19161639355867e-12
driven_lanedir_consec_max1.8922261091347536e-06
driven_lanedir_consec_mean1.8922261091347536e-06
driven_lanedir_consec_min1.8922261091347536e-06
driven_lanedir_max1.8922261091347536e-06
driven_lanedir_mean1.8922261091347536e-06
driven_lanedir_median1.8922261091347536e-06
driven_lanedir_min1.8922261091347536e-06
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.19161639355867e-12, "survival_time": 59.99999999999873, "driven_lanedir": 1.8922261091347536e-06, "in-drivable-lane": 0.0, "deviation-heading": 40.96731053008268, "distance-from-start": 9.930136612989092e-16, "deviation-center-line": 0.4065255308886839, "driven_lanedir_consec": 1.8922261091347536e-06}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
158461324Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-validationsim-0of4failednodavinci-stage-03-6.2.510:01:13
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
158411325Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-validationsim-3of4failednodavinci-stage-03-6.2.510:01:11
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
158341326Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-validationsim-0of4failednodavinci-stage-03-6.2.510:01:12
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
158321327Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-validationsim-3of4failednodavinci-stage-03-6.2.510:01:00
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
158251328Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-validationsim-3of4failednodavinci-stage-03-6.2.510:01:12
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
158221330Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-validationsim-2of4failednodavinci-stage-03-6.2.510:00:57
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
158151332Bea Baselines 🐤baseline-RPL-roslx22-objdetsimfailedyesdavinci-stage-03-6.2.510:00:58
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
158121335Bea Baselines 🐤baseline-RPL-roslx22-BV1sim-3of5failednodavinci-stage-03-6.2.510:00:57
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
158071338Bea Baselines 🐤baseline-RPL-rosaido-hello-sim-validationsanity-checkfailednodavinci-stage-03-6.2.510:01:04
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
158051342Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-testingsim-0of4failednodavinci-stage-03-6.2.510:01:12
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
158011343Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-testingsim-0of4failednodavinci-stage-03-6.2.510:01:11
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
157941344Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-testingsim-0of4failednodavinci-stage-03-6.2.510:01:12
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
157911346Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-testingsim-2of4failednodavinci-stage-03-6.2.510:01:10
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
157861347Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-testingsim-1of4failednodavinci-stage-03-6.2.510:01:14
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
157741350Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-validationsim-0of4successnodavinci-stage-03-6.2.510:13:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median16.34999999999967
driven_lanedir_consec_median3.5078485452922403
deviation-center-line_median3.3066478739156993


other stats
deviation-center-line_max3.3066478739156993
deviation-center-line_mean3.3066478739156993
deviation-center-line_min3.3066478739156993
deviation-heading_max14.91185401409574
deviation-heading_mean14.91185401409574
deviation-heading_median14.91185401409574
deviation-heading_min14.91185401409574
distance-from-start_max1.35129958167935
distance-from-start_mean1.35129958167935
distance-from-start_median1.35129958167935
distance-from-start_min1.35129958167935
driven_any_max7.91363492566989
driven_any_mean7.91363492566989
driven_any_median7.91363492566989
driven_any_min7.91363492566989
driven_lanedir_consec_max3.5078485452922403
driven_lanedir_consec_mean3.5078485452922403
driven_lanedir_consec_min3.5078485452922403
driven_lanedir_max5.078178720170576
driven_lanedir_mean5.078178720170576
driven_lanedir_median5.078178720170576
driven_lanedir_min5.078178720170576
in-drivable-lane_max16.34999999999967
in-drivable-lane_mean16.34999999999967
in-drivable-lane_min16.34999999999967
per-episodes
details{"udem-000-ego0": {"driven_any": 7.91363492566989, "survival_time": 59.99999999999873, "driven_lanedir": 5.078178720170576, "in-drivable-lane": 16.34999999999967, "deviation-heading": 14.91185401409574, "distance-from-start": 1.35129958167935, "deviation-center-line": 3.3066478739156993, "driven_lanedir_consec": 3.5078485452922403}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
157711351Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-validationsim-2of4successnodavinci-stage-03-6.2.510:01:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
157661352Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-validationsim-3of4successnodavinci-stage-03-6.2.510:06:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.139809103770904
survival_time_median59.99999999999873
deviation-center-line_median4.687415779147404
in-drivable-lane_median3.499999999999958


other stats
deviation-center-line_max4.687415779147404
deviation-center-line_mean4.687415779147404
deviation-center-line_min4.687415779147404
deviation-heading_max11.248632063374732
deviation-heading_mean11.248632063374732
deviation-heading_median11.248632063374732
deviation-heading_min11.248632063374732
distance-from-start_max4.071203490701128
distance-from-start_mean4.071203490701128
distance-from-start_median4.071203490701128
distance-from-start_min4.071203490701128
driven_any_max7.907796148383485
driven_any_mean7.907796148383485
driven_any_median7.907796148383485
driven_any_min7.907796148383485
driven_lanedir_consec_max7.139809103770904
driven_lanedir_consec_mean7.139809103770904
driven_lanedir_consec_min7.139809103770904
driven_lanedir_max7.139809103770904
driven_lanedir_mean7.139809103770904
driven_lanedir_median7.139809103770904
driven_lanedir_min7.139809103770904
in-drivable-lane_max3.499999999999958
in-drivable-lane_mean3.499999999999958
in-drivable-lane_min3.499999999999958
per-episodes
details{"zigzag-000-ego0": {"driven_any": 7.907796148383485, "survival_time": 59.99999999999873, "driven_lanedir": 7.139809103770904, "in-drivable-lane": 3.499999999999958, "deviation-heading": 11.248632063374732, "distance-from-start": 4.071203490701128, "deviation-center-line": 4.687415779147404, "driven_lanedir_consec": 7.139809103770904}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
157621353Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-validationsim-0of4successnodavinci-stage-03-6.2.510:07:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median22.000000000000178
in-drivable-lane_median0.8000000000000114
driven_lanedir_consec_median0.5688806638334413
deviation-center-line_median1.6822574705515425


other stats
deviation-center-line_max2.049265470744686
deviation-center-line_mean1.4453336612912322
deviation-center-line_min0.36755423331715814
deviation-heading_max14.508969885441632
deviation-heading_mean8.405725617441043
deviation-heading_median8.673095944504501
deviation-heading_min1.7677406953135364
distance-from-start_max1.8869551000402565
distance-from-start_mean0.8878657754951976
distance-from-start_median0.6203704024957694
distance-from-start_min0.42376719694899545
driven_any_max2.7761900249417457
driven_any_mean1.1381481789473131
driven_any_median0.6485642350318642
driven_any_min0.4792742207837793
driven_lanedir_consec_max1.6742666977452674
driven_lanedir_consec_mean0.8076443097336166
driven_lanedir_consec_min0.41854921352231633
driven_lanedir_max2.4861614949264506
driven_lanedir_mean1.0106180090289123
driven_lanedir_median0.5688806638334413
driven_lanedir_min0.41854921352231633
in-drivable-lane_max16.20000000000019
in-drivable-lane_mean4.4500000000000535
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 0.4792742207837793, "survival_time": 22.000000000000178, "driven_lanedir": 0.41854921352231633, "in-drivable-lane": 0.0, "deviation-heading": 14.508969885441632, "distance-from-start": 0.42376719694899545, "deviation-center-line": 1.9083638780381125, "driven_lanedir_consec": 0.41854921352231633}, "udem-000-ego1": {"driven_any": 0.8178325059137013, "survival_time": 22.000000000000178, "driven_lanedir": 0.674250579942909, "in-drivable-lane": 16.20000000000019, "deviation-heading": 1.7677406953135364, "distance-from-start": 0.7726779035883197, "deviation-center-line": 0.36755423331715814, "driven_lanedir_consec": 0.674250579942909}, "udem-000-ego2": {"driven_any": 2.7761900249417457, "survival_time": 22.000000000000178, "driven_lanedir": 2.4861614949264506, "in-drivable-lane": 1.6000000000000227, "deviation-heading": 2.9556618630809797, "distance-from-start": 1.8869551000402565, "deviation-center-line": 1.4561510630649723, "driven_lanedir_consec": 1.6742666977452674}, "udem-000-ego3": {"driven_any": 0.4792959641500272, "survival_time": 22.000000000000178, "driven_lanedir": 0.4635107477239735, "in-drivable-lane": 0.0, "deviation-heading": 14.390530025928022, "distance-from-start": 0.4680629014032191, "deviation-center-line": 2.049265470744686, "driven_lanedir_consec": 0.4635107477239735}}
simulation-passed1
survival_time_max22.000000000000178
survival_time_mean22.000000000000178
survival_time_min22.000000000000178
No reset possible
157571354Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-validationsim-2of4successnodavinci-stage-03-6.2.510:04:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median21.250000000000167
in-drivable-lane_median0.8000000000000014
driven_lanedir_consec_median1.8713044420566496
deviation-center-line_median1.561445869092485


other stats
deviation-center-line_max1.654933802801375
deviation-center-line_mean1.561445869092485
deviation-center-line_min1.4679579353835954
deviation-heading_max6.622491906042299
deviation-heading_mean5.358065957051593
deviation-heading_median5.358065957051593
deviation-heading_min4.093640008060887
distance-from-start_max1.0171000672390342
distance-from-start_mean0.8121051864342014
distance-from-start_median0.8121051864342014
distance-from-start_min0.6071103056293685
driven_any_max2.669885351609403
driven_any_mean2.523893874391863
driven_any_median2.523893874391863
driven_any_min2.3779023971743234
driven_lanedir_consec_max2.3202404563129795
driven_lanedir_consec_mean1.8713044420566496
driven_lanedir_consec_min1.42236842780032
driven_lanedir_max2.3202404563129795
driven_lanedir_mean2.252489836942958
driven_lanedir_median2.252489836942958
driven_lanedir_min2.184739217572936
in-drivable-lane_max1.6000000000000028
in-drivable-lane_mean0.8000000000000014
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.3779023971743234, "survival_time": 21.250000000000167, "driven_lanedir": 2.3202404563129795, "in-drivable-lane": 0.0, "deviation-heading": 4.093640008060887, "distance-from-start": 1.0171000672390342, "deviation-center-line": 1.654933802801375, "driven_lanedir_consec": 2.3202404563129795}, "loop2-000-ego1": {"driven_any": 2.669885351609403, "survival_time": 21.250000000000167, "driven_lanedir": 2.184739217572936, "in-drivable-lane": 1.6000000000000028, "deviation-heading": 6.622491906042299, "distance-from-start": 0.6071103056293685, "deviation-center-line": 1.4679579353835954, "driven_lanedir_consec": 1.42236842780032}}
simulation-passed1
survival_time_max21.250000000000167
survival_time_mean21.250000000000167
survival_time_min21.250000000000167
No reset possible
157561355Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-validationsim-0of4successnodavinci-stage-03-6.2.510:02:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.400000000000029
in-drivable-lane_median0.0
driven_lanedir_consec_median1.3117039680638425
deviation-center-line_median0.7134659612145099


other stats
deviation-center-line_max0.7134659612145099
deviation-center-line_mean0.7134659612145099
deviation-center-line_min0.7134659612145099
deviation-heading_max2.7890490867024056
deviation-heading_mean2.7890490867024056
deviation-heading_median2.7890490867024056
deviation-heading_min2.7890490867024056
distance-from-start_max1.1463604247213914
distance-from-start_mean1.1463604247213914
distance-from-start_median1.1463604247213914
distance-from-start_min1.1463604247213914
driven_any_max1.3622284035488876
driven_any_mean1.3622284035488876
driven_any_median1.3622284035488876
driven_any_min1.3622284035488876
driven_lanedir_consec_max1.3117039680638425
driven_lanedir_consec_mean1.3117039680638425
driven_lanedir_consec_min1.3117039680638425
driven_lanedir_max1.3117039680638425
driven_lanedir_mean1.3117039680638425
driven_lanedir_median1.3117039680638425
driven_lanedir_min1.3117039680638425
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.3622284035488876, "survival_time": 11.400000000000029, "driven_lanedir": 1.3117039680638425, "in-drivable-lane": 0.0, "deviation-heading": 2.7890490867024056, "distance-from-start": 1.1463604247213914, "deviation-center-line": 0.7134659612145099, "driven_lanedir_consec": 1.3117039680638425}}
simulation-passed1
survival_time_max11.400000000000029
survival_time_mean11.400000000000029
survival_time_min11.400000000000029
No reset possible
157511357Bea Baselines 🐤baseline-duckietown-mllx22-objdetsimsuccessyesdavinci-stage-03-6.2.510:09:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median42.14999999999974
driven_lanedir_consec_median4.744071096042223


other stats
deviation-center-line_max1.8909340338453744
deviation-center-line_mean1.256572277427619
deviation-center-line_median1.256572277427619
deviation-center-line_min0.6222105210098633
deviation-heading_max2.3650655366577964
deviation-heading_mean2.203522095523688
deviation-heading_median2.203522095523688
deviation-heading_min2.04197865438958
distance-from-start_max6.778598354686377
distance-from-start_mean5.161644938461317
distance-from-start_median5.161644938461317
distance-from-start_min3.5446915222362554
driven_any_max6.786087279352217
driven_any_mean5.451688058845778
driven_any_median5.451688058845778
driven_any_min4.117288838339339
driven_lanedir_consec_max6.77868650317204
driven_lanedir_consec_mean4.744071096042223
driven_lanedir_consec_min2.7094556889124073
driven_lanedir_max6.77868650317204
driven_lanedir_mean4.744071096042223
driven_lanedir_median4.744071096042223
driven_lanedir_min2.7094556889124073
in-drivable-lane_max10.950000000000152
in-drivable-lane_mean5.475000000000076
in-drivable-lane_median5.475000000000076
in-drivable-lane_min0.0
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 6.786087279352217, "survival_time": 52.24999999999917, "driven_lanedir": 6.77868650317204, "in-drivable-lane": 0.0, "deviation-heading": 2.04197865438958, "distance-from-start": 6.778598354686377, "deviation-center-line": 1.8909340338453744, "driven_lanedir_consec": 6.77868650317204}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 4.117288838339339, "survival_time": 32.05000000000032, "driven_lanedir": 2.7094556889124073, "in-drivable-lane": 10.950000000000152, "deviation-heading": 2.3650655366577964, "distance-from-start": 3.5446915222362554, "deviation-center-line": 0.6222105210098633, "driven_lanedir_consec": 2.7094556889124073}}
simulation-passed1
survival_time_max52.24999999999917
survival_time_mean42.14999999999974
survival_time_min32.05000000000032
No reset possible
157421367Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-testingsim-1of4successnodavinci-stage-03-6.2.510:11:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median56.04999999999895
in-drivable-lane_median5.949999999999854
driven_lanedir_consec_median3.6113200930157023
deviation-center-line_median4.3160617489699


other stats
deviation-center-line_max4.3160617489699
deviation-center-line_mean4.3160617489699
deviation-center-line_min4.3160617489699
deviation-heading_max10.580165655732747
deviation-heading_mean10.580165655732747
deviation-heading_median10.580165655732747
deviation-heading_min10.580165655732747
distance-from-start_max2.921506528684634
distance-from-start_mean2.921506528684634
distance-from-start_median2.921506528684634
distance-from-start_min2.921506528684634
driven_any_max7.296741488521007
driven_any_mean7.296741488521007
driven_any_median7.296741488521007
driven_any_min7.296741488521007
driven_lanedir_consec_max3.6113200930157023
driven_lanedir_consec_mean3.6113200930157023
driven_lanedir_consec_min3.6113200930157023
driven_lanedir_max6.245464485871592
driven_lanedir_mean6.245464485871592
driven_lanedir_median6.245464485871592
driven_lanedir_min6.245464485871592
in-drivable-lane_max5.949999999999854
in-drivable-lane_mean5.949999999999854
in-drivable-lane_min5.949999999999854
per-episodes
details{"loop-000-ego0": {"driven_any": 7.296741488521007, "survival_time": 56.04999999999895, "driven_lanedir": 6.245464485871592, "in-drivable-lane": 5.949999999999854, "deviation-heading": 10.580165655732747, "distance-from-start": 2.921506528684634, "deviation-center-line": 4.3160617489699, "driven_lanedir_consec": 3.6113200930157023}}
simulation-passed1
survival_time_max56.04999999999895
survival_time_mean56.04999999999895
survival_time_min56.04999999999895
No reset possible
157411367Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-testingsim-2of4successnodavinci-stage-03-6.2.510:03:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median17.050000000000107
in-drivable-lane_median7.500000000000092
driven_lanedir_consec_median1.0147627580140095
deviation-center-line_median0.5248522438271236


other stats
deviation-center-line_max0.5248522438271236
deviation-center-line_mean0.5248522438271236
deviation-center-line_min0.5248522438271236
deviation-heading_max3.1362578899097784
deviation-heading_mean3.1362578899097784
deviation-heading_median3.1362578899097784
deviation-heading_min3.1362578899097784
distance-from-start_max1.413248350458319
distance-from-start_mean1.413248350458319
distance-from-start_median1.413248350458319
distance-from-start_min1.413248350458319
driven_any_max2.112331225942567
driven_any_mean2.112331225942567
driven_any_median2.112331225942567
driven_any_min2.112331225942567
driven_lanedir_consec_max1.0147627580140095
driven_lanedir_consec_mean1.0147627580140095
driven_lanedir_consec_min1.0147627580140095
driven_lanedir_max1.0286932620094282
driven_lanedir_mean1.0286932620094282
driven_lanedir_median1.0286932620094282
driven_lanedir_min1.0286932620094282
in-drivable-lane_max7.500000000000092
in-drivable-lane_mean7.500000000000092
in-drivable-lane_min7.500000000000092
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.112331225942567, "survival_time": 17.050000000000107, "driven_lanedir": 1.0286932620094282, "in-drivable-lane": 7.500000000000092, "deviation-heading": 3.1362578899097784, "distance-from-start": 1.413248350458319, "deviation-center-line": 0.5248522438271236, "driven_lanedir_consec": 1.0147627580140095}}
simulation-passed1
survival_time_max17.050000000000107
survival_time_mean17.050000000000107
survival_time_min17.050000000000107
No reset possible
157391368Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-testingsim-3of4successnodavinci-stage-03-6.2.510:01:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
157261372Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-testingsim-1of4successnodavinci-stage-03-6.2.510:24:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median16.09999999999954
driven_lanedir_consec_median5.174928224192271
deviation-center-line_median4.172934490443127


other stats
deviation-center-line_max4.812958302467858
deviation-center-line_mean4.165292297397421
deviation-center-line_min3.5023419062355745
deviation-heading_max16.517134929383097
deviation-heading_mean14.573327489680548
deviation-heading_median14.850582912588854
deviation-heading_min12.075009204161388
distance-from-start_max2.9030722590434275
distance-from-start_mean2.391093349024953
distance-from-start_median2.39571086304923
distance-from-start_min1.8698794109579244
driven_any_max7.913986192645288
driven_any_mean7.913778245101669
driven_any_median7.913771485265453
driven_any_min7.913583817230483
driven_lanedir_consec_max5.509512170857265
driven_lanedir_consec_mean5.037213036762299
driven_lanedir_consec_min4.289483527807388
driven_lanedir_max5.509512170857265
driven_lanedir_mean5.105042948595948
driven_lanedir_median5.174928224192271
driven_lanedir_min4.560803175141983
in-drivable-lane_max21.499999999999694
in-drivable-lane_mean16.987499999999596
in-drivable-lane_min14.249999999999613
per-episodes
details{"loop-000-ego0": {"driven_any": 7.9138288572279825, "survival_time": 59.99999999999873, "driven_lanedir": 4.560803175141983, "in-drivable-lane": 21.499999999999694, "deviation-heading": 12.075009204161388, "distance-from-start": 2.9030722590434275, "deviation-center-line": 3.742307283951056, "driven_lanedir_consec": 4.289483527807388}, "loop-000-ego1": {"driven_any": 7.913986192645288, "survival_time": 59.99999999999873, "driven_lanedir": 5.509512170857265, "in-drivable-lane": 14.249999999999613, "deviation-heading": 13.86547611508628, "distance-from-start": 2.3335218580657124, "deviation-center-line": 4.603561696935198, "driven_lanedir_consec": 5.509512170857265}, "loop-000-ego2": {"driven_any": 7.913583817230483, "survival_time": 59.99999999999873, "driven_lanedir": 4.958355158862108, "in-drivable-lane": 17.04999999999952, "deviation-heading": 16.517134929383097, "distance-from-start": 2.4578998680327477, "deviation-center-line": 3.5023419062355745, "driven_lanedir_consec": 4.958355158862108}, "loop-000-ego3": {"driven_any": 7.913714113302923, "survival_time": 59.99999999999873, "driven_lanedir": 5.391501289522434, "in-drivable-lane": 15.149999999999554, "deviation-heading": 15.835689710091426, "distance-from-start": 1.8698794109579244, "deviation-center-line": 4.812958302467858, "driven_lanedir_consec": 5.391501289522434}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
157211373Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-testingsim-0of4successnodavinci-stage-03-6.2.510:04:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median33.05000000000026
in-drivable-lane_median3.5000000000000444
driven_lanedir_consec_median3.6435756386590343
deviation-center-line_median2.1976133138119676


other stats
deviation-center-line_max2.1976133138119676
deviation-center-line_mean2.1976133138119676
deviation-center-line_min2.1976133138119676
deviation-heading_max6.170617312179055
deviation-heading_mean6.170617312179055
deviation-heading_median6.170617312179055
deviation-heading_min6.170617312179055
distance-from-start_max3.3808929413138733
distance-from-start_mean3.3808929413138733
distance-from-start_median3.3808929413138733
distance-from-start_min3.3808929413138733
driven_any_max4.23670468468535
driven_any_mean4.23670468468535
driven_any_median4.23670468468535
driven_any_min4.23670468468535
driven_lanedir_consec_max3.6435756386590343
driven_lanedir_consec_mean3.6435756386590343
driven_lanedir_consec_min3.6435756386590343
driven_lanedir_max3.6435756386590343
driven_lanedir_mean3.6435756386590343
driven_lanedir_median3.6435756386590343
driven_lanedir_min3.6435756386590343
in-drivable-lane_max3.5000000000000444
in-drivable-lane_mean3.5000000000000444
in-drivable-lane_min3.5000000000000444
per-episodes
details{"autolab-000-ego0": {"driven_any": 4.23670468468535, "survival_time": 33.05000000000026, "driven_lanedir": 3.6435756386590343, "in-drivable-lane": 3.5000000000000444, "deviation-heading": 6.170617312179055, "distance-from-start": 3.3808929413138733, "deviation-center-line": 2.1976133138119676, "driven_lanedir_consec": 3.6435756386590343}}
simulation-passed1
survival_time_max33.05000000000026
survival_time_mean33.05000000000026
survival_time_min33.05000000000026
No reset possible
157171374Bea Baselines 🐤baseline-duckietownaido-LFV-sim-validationsim-3of4successnodavinci-stage-03-6.2.510:05:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median14.800000000000075
in-drivable-lane_median2.450000000000035
driven_lanedir_consec_median1.3365651749146346
deviation-center-line_median1.0721450874498766


other stats
deviation-center-line_max1.0721450874498766
deviation-center-line_mean1.0721450874498766
deviation-center-line_min1.0721450874498766
deviation-heading_max5.600882649809179
deviation-heading_mean5.600882649809179
deviation-heading_median5.600882649809179
deviation-heading_min5.600882649809179
distance-from-start_max1.1795381270516747
distance-from-start_mean1.1795381270516747
distance-from-start_median1.1795381270516747
distance-from-start_min1.1795381270516747
driven_any_max1.820029381259532
driven_any_mean1.820029381259532
driven_any_median1.820029381259532
driven_any_min1.820029381259532
driven_lanedir_consec_max1.3365651749146346
driven_lanedir_consec_mean1.3365651749146346
driven_lanedir_consec_min1.3365651749146346
driven_lanedir_max1.3365651749146346
driven_lanedir_mean1.3365651749146346
driven_lanedir_median1.3365651749146346
driven_lanedir_min1.3365651749146346
in-drivable-lane_max2.450000000000035
in-drivable-lane_mean2.450000000000035
in-drivable-lane_min2.450000000000035
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.820029381259532, "survival_time": 14.800000000000075, "driven_lanedir": 1.3365651749146346, "in-drivable-lane": 2.450000000000035, "deviation-heading": 5.600882649809179, "distance-from-start": 1.1795381270516747, "deviation-center-line": 1.0721450874498766, "driven_lanedir_consec": 1.3365651749146346}}
simulation-passed1
survival_time_max14.800000000000075
survival_time_mean14.800000000000075
survival_time_min14.800000000000075
No reset possible
156991379Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-validationsim-0of4successnodavinci-stage-03-6.2.510:25:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median30.174999999998988
driven_lanedir_consec_median2.2578558508568527
deviation-center-line_median2.471431538715348


other stats
deviation-center-line_max3.530873467765855
deviation-center-line_mean2.3246251398796343
deviation-center-line_min0.8247640143219854
deviation-heading_max23.112836538213585
deviation-heading_mean14.362308296991158
deviation-heading_median15.025916196253448
deviation-heading_min4.2845642572441465
distance-from-start_max2.092632590834022
distance-from-start_mean1.3907765851539973
distance-from-start_median1.2800636678267785
distance-from-start_min0.9103464141284096
driven_any_max7.912645704179486
driven_any_mean5.349100935959909
driven_any_median5.682547751787265
driven_any_min2.1186625360856204
driven_lanedir_consec_max3.525436875021678
driven_lanedir_consec_mean2.3224114684298405
driven_lanedir_consec_min1.2484972969839785
driven_lanedir_max4.640199464179554
driven_lanedir_mean3.0625237671018883
driven_lanedir_median3.180699153622011
driven_lanedir_min1.2484972969839785
in-drivable-lane_max48.4999999999987
in-drivable-lane_mean31.137499999999065
in-drivable-lane_min15.699999999999587
per-episodes
details{"autolab-000-ego0": {"driven_any": 4.554267777405633, "survival_time": 59.99999999999873, "driven_lanedir": 2.478830115178725, "in-drivable-lane": 36.19999999999855, "deviation-heading": 12.603512704857405, "distance-from-start": 1.058889268020124, "deviation-center-line": 1.9966268939671068, "driven_lanedir_consec": 1.253406740325247}, "autolab-000-ego1": {"driven_any": 6.810827726168896, "survival_time": 59.99999999999873, "driven_lanedir": 3.882568192065297, "in-drivable-lane": 24.149999999999423, "deviation-heading": 17.44831968764949, "distance-from-start": 2.092632590834022, "deviation-center-line": 2.9462361834635886, "driven_lanedir_consec": 3.262304961388459}, "autolab-000-ego2": {"driven_any": 7.912645704179486, "survival_time": 59.99999999999873, "driven_lanedir": 4.640199464179554, "in-drivable-lane": 15.699999999999587, "deviation-heading": 23.112836538213585, "distance-from-start": 1.5012380676334331, "deviation-center-line": 3.530873467765855, "driven_lanedir_consec": 3.525436875021678}, "autolab-000-ego3": {"driven_any": 2.1186625360856204, "survival_time": 59.99999999999873, "driven_lanedir": 1.2484972969839785, "in-drivable-lane": 48.4999999999987, "deviation-heading": 4.2845642572441465, "distance-from-start": 0.9103464141284096, "deviation-center-line": 0.8247640143219854, "driven_lanedir_consec": 1.2484972969839785}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
156951380Bea Baselines 🐤baseline-duckietownaido-LFP-sim-validationsim-0of4successnodavinci-stage-03-6.2.510:02:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.55000000000003
in-drivable-lane_median0.0
driven_lanedir_consec_median1.3390006419605616
deviation-center-line_median0.642980851039363


other stats
deviation-center-line_max0.642980851039363
deviation-center-line_mean0.642980851039363
deviation-center-line_min0.642980851039363
deviation-heading_max2.4512027299150017
deviation-heading_mean2.4512027299150017
deviation-heading_median2.4512027299150017
deviation-heading_min2.4512027299150017
distance-from-start_max1.1714524549442908
distance-from-start_mean1.1714524549442908
distance-from-start_median1.1714524549442908
distance-from-start_min1.1714524549442908
driven_any_max1.3821353851969258
driven_any_mean1.3821353851969258
driven_any_median1.3821353851969258
driven_any_min1.3821353851969258
driven_lanedir_consec_max1.3390006419605616
driven_lanedir_consec_mean1.3390006419605616
driven_lanedir_consec_min1.3390006419605616
driven_lanedir_max1.3390006419605616
driven_lanedir_mean1.3390006419605616
driven_lanedir_median1.3390006419605616
driven_lanedir_min1.3390006419605616
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.3821353851969258, "survival_time": 11.55000000000003, "driven_lanedir": 1.3390006419605616, "in-drivable-lane": 0.0, "deviation-heading": 2.4512027299150017, "distance-from-start": 1.1714524549442908, "deviation-center-line": 0.642980851039363, "driven_lanedir_consec": 1.3390006419605616}}
simulation-passed1
survival_time_max11.55000000000003
survival_time_mean11.55000000000003
survival_time_min11.55000000000003
No reset possible
156901382Bea Baselines 🐤baseline-duckietownlx22-objdetsimsuccessyesdavinci-stage-03-6.2.510:09:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median37.42499999999968
driven_lanedir_consec_median4.810256234229755


other stats
deviation-center-line_max2.0801499813387525
deviation-center-line_mean1.4988953117850456
deviation-center-line_median1.4988953117850456
deviation-center-line_min0.9176406422313388
deviation-heading_max2.6355613595226632
deviation-heading_mean2.3858020128711033
deviation-heading_median2.3858020128711033
deviation-heading_min2.136042666219544
distance-from-start_max6.777712756828244
distance-from-start_mean4.810504081297905
distance-from-start_median4.810504081297905
distance-from-start_min2.843295405767566
driven_any_max6.786087669203676
driven_any_mean4.827653313168814
driven_any_median4.827653313168814
driven_any_min2.869218957133953
driven_lanedir_consec_max6.777819443300092
driven_lanedir_consec_mean4.810256234229755
driven_lanedir_consec_min2.8426930251594165
driven_lanedir_max6.777819443300092
driven_lanedir_mean4.810256234229755
driven_lanedir_median4.810256234229755
driven_lanedir_min2.8426930251594165
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_median0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 6.786087669203676, "survival_time": 52.19999999999917, "driven_lanedir": 6.777819443300092, "in-drivable-lane": 0.0, "deviation-heading": 2.136042666219544, "distance-from-start": 6.777712756828244, "deviation-center-line": 2.0801499813387525, "driven_lanedir_consec": 6.777819443300092}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 2.869218957133953, "survival_time": 22.650000000000187, "driven_lanedir": 2.8426930251594165, "in-drivable-lane": 0.0, "deviation-heading": 2.6355613595226632, "distance-from-start": 2.843295405767566, "deviation-center-line": 0.9176406422313388, "driven_lanedir_consec": 2.8426930251594165}}
simulation-passed1
survival_time_max52.19999999999917
survival_time_mean37.42499999999968
survival_time_min22.650000000000187
No reset possible
156811392Bea Baselines 🐤baseline-duckietownaido-LFV-sim-testingsim-0of4successnodavinci-stage-03-6.2.510:11:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median39.3499999999999
in-drivable-lane_median11.949999999999836
driven_lanedir_consec_median2.2747745648918865
deviation-center-line_median2.4205088879408643


other stats
deviation-center-line_max2.4205088879408643
deviation-center-line_mean2.4205088879408643
deviation-center-line_min2.4205088879408643
deviation-heading_max13.979216186872474
deviation-heading_mean13.979216186872474
deviation-heading_median13.979216186872474
deviation-heading_min13.979216186872474
distance-from-start_max2.3080675572639566
distance-from-start_mean2.3080675572639566
distance-from-start_median2.3080675572639566
distance-from-start_min2.3080675572639566
driven_any_max5.078896789981636
driven_any_mean5.078896789981636
driven_any_median5.078896789981636
driven_any_min5.078896789981636
driven_lanedir_consec_max2.2747745648918865
driven_lanedir_consec_mean2.2747745648918865
driven_lanedir_consec_min2.2747745648918865
driven_lanedir_max2.94446435914208
driven_lanedir_mean2.94446435914208
driven_lanedir_median2.94446435914208
driven_lanedir_min2.94446435914208
in-drivable-lane_max11.949999999999836
in-drivable-lane_mean11.949999999999836
in-drivable-lane_min11.949999999999836
per-episodes
details{"autolab-000-ego0": {"driven_any": 5.078896789981636, "survival_time": 39.3499999999999, "driven_lanedir": 2.94446435914208, "in-drivable-lane": 11.949999999999836, "deviation-heading": 13.979216186872474, "distance-from-start": 2.3080675572639566, "deviation-center-line": 2.4205088879408643, "driven_lanedir_consec": 2.2747745648918865}}
simulation-passed1
survival_time_max39.3499999999999
survival_time_mean39.3499999999999
survival_time_min39.3499999999999
No reset possible
156771392Bea Baselines 🐤baseline-duckietownaido-LFV-sim-testingsim-1of4successnodavinci-stage-03-6.2.510:07:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median30.200000000000298
in-drivable-lane_median28.700000000000298
driven_lanedir_consec_median0.09792271509533768
deviation-center-line_median0.1083212681828197


other stats
deviation-center-line_max0.1083212681828197
deviation-center-line_mean0.1083212681828197
deviation-center-line_min0.1083212681828197
deviation-heading_max1.1995882026050435
deviation-heading_mean1.1995882026050435
deviation-heading_median1.1995882026050435
deviation-heading_min1.1995882026050435
distance-from-start_max2.4093498394525112
distance-from-start_mean2.4093498394525112
distance-from-start_median2.4093498394525112
distance-from-start_min2.4093498394525112
driven_any_max3.865033412199443
driven_any_mean3.865033412199443
driven_any_median3.865033412199443
driven_any_min3.865033412199443
driven_lanedir_consec_max0.09792271509533768
driven_lanedir_consec_mean0.09792271509533768
driven_lanedir_consec_min0.09792271509533768
driven_lanedir_max0.09792271509533768
driven_lanedir_mean0.09792271509533768
driven_lanedir_median0.09792271509533768
driven_lanedir_min0.09792271509533768
in-drivable-lane_max28.700000000000298
in-drivable-lane_mean28.700000000000298
in-drivable-lane_min28.700000000000298
per-episodes
details{"loop-000-ego0": {"driven_any": 3.865033412199443, "survival_time": 30.200000000000298, "driven_lanedir": 0.09792271509533768, "in-drivable-lane": 28.700000000000298, "deviation-heading": 1.1995882026050435, "distance-from-start": 2.4093498394525112, "deviation-center-line": 0.1083212681828197, "driven_lanedir_consec": 0.09792271509533768}}
simulation-passed1
survival_time_max30.200000000000298
survival_time_mean30.200000000000298
survival_time_min30.200000000000298
No reset possible
156601397Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-testingsim-0of4successnodavinci-stage-03-6.2.510:26:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median25.92499999999906
driven_lanedir_consec_median2.3646115229120306
deviation-center-line_median3.2486271161130515


other stats
deviation-center-line_max3.640286242439263
deviation-center-line_mean2.639349009741065
deviation-center-line_min0.4198555642988931
deviation-heading_max23.03106841353319
deviation-heading_mean16.93494422753877
deviation-heading_median21.056198959480756
deviation-heading_min2.596310577660389
distance-from-start_max2.5952869931157303
distance-from-start_mean1.7421869948350328
distance-from-start_median1.6470230450654624
distance-from-start_min1.0794148960934755
driven_any_max7.912918824497923
driven_any_mean6.215267233134213
driven_any_median7.457866847311441
driven_any_min2.0324164134160494
driven_lanedir_consec_max3.636166660257679
driven_lanedir_consec_mean2.350319858255987
driven_lanedir_consec_min1.0358897269422067
driven_lanedir_max4.4223589552784315
driven_lanedir_mean3.0482839831363693
driven_lanedir_median3.3674436251624194
driven_lanedir_min1.0358897269422067
in-drivable-lane_max50.84999999999873
in-drivable-lane_mean29.987499999999105
in-drivable-lane_min17.249999999999567
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.905508246506613, "survival_time": 59.99999999999873, "driven_lanedir": 2.981892265467782, "in-drivable-lane": 28.449999999999022, "deviation-heading": 21.56803724399301, "distance-from-start": 1.0794148960934755, "deviation-center-line": 3.488321056377729, "driven_lanedir_consec": 1.7236218948884234}, "autolab-000-ego1": {"driven_any": 7.010225448116269, "survival_time": 59.99999999999873, "driven_lanedir": 3.752994984857057, "in-drivable-lane": 23.399999999999093, "deviation-heading": 20.5443606749685, "distance-from-start": 2.0030067522119337, "deviation-center-line": 3.008933175848374, "driven_lanedir_consec": 3.0056011509356377}, "autolab-000-ego2": {"driven_any": 2.0324164134160494, "survival_time": 59.99999999999873, "driven_lanedir": 1.0358897269422067, "in-drivable-lane": 50.84999999999873, "deviation-heading": 2.596310577660389, "distance-from-start": 1.291039337918991, "deviation-center-line": 0.4198555642988931, "driven_lanedir_consec": 1.0358897269422067}, "autolab-000-ego3": {"driven_any": 7.912918824497923, "survival_time": 59.99999999999873, "driven_lanedir": 4.4223589552784315, "in-drivable-lane": 17.249999999999567, "deviation-heading": 23.03106841353319, "distance-from-start": 2.5952869931157303, "deviation-center-line": 3.640286242439263, "driven_lanedir_consec": 3.636166660257679}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
156521399Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-validationsim-0of4successnodavinci-stage-03-6.2.510:09:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median49.699999999999314
in-drivable-lane_median1.1000000000000156
driven_lanedir_consec_median2.825725124357286
deviation-center-line_median4.868938294800302


other stats
deviation-center-line_max4.868938294800302
deviation-center-line_mean4.868938294800302
deviation-center-line_min4.868938294800302
deviation-heading_max2.920667575049727
deviation-heading_mean2.920667575049727
deviation-heading_median2.920667575049727
deviation-heading_min2.920667575049727
distance-from-start_max2.1386574023523237
distance-from-start_mean2.1386574023523237
distance-from-start_median2.1386574023523237
distance-from-start_min2.1386574023523237
driven_any_max2.8865963267498715
driven_any_mean2.8865963267498715
driven_any_median2.8865963267498715
driven_any_min2.8865963267498715
driven_lanedir_consec_max2.825725124357286
driven_lanedir_consec_mean2.825725124357286
driven_lanedir_consec_min2.825725124357286
driven_lanedir_max2.825725124357286
driven_lanedir_mean2.825725124357286
driven_lanedir_median2.825725124357286
driven_lanedir_min2.825725124357286
in-drivable-lane_max1.1000000000000156
in-drivable-lane_mean1.1000000000000156
in-drivable-lane_min1.1000000000000156
per-episodes
details{"udem-000-ego0": {"driven_any": 2.8865963267498715, "survival_time": 49.699999999999314, "driven_lanedir": 2.825725124357286, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.920667575049727, "distance-from-start": 2.1386574023523237, "deviation-center-line": 4.868938294800302, "driven_lanedir_consec": 2.825725124357286}}
simulation-passed1
survival_time_max49.699999999999314
survival_time_mean49.699999999999314
survival_time_min49.699999999999314
No reset possible
156471400Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-validationsim-2of4successnodavinci-stage-03-6.2.510:04:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.1499999999999666
driven_lanedir_consec_median1.4203998040440715
deviation-center-line_median4.904463356399461


other stats
deviation-center-line_max4.904463356399461
deviation-center-line_mean4.904463356399461
deviation-center-line_min4.904463356399461
deviation-heading_max7.745124858723169
deviation-heading_mean7.745124858723169
deviation-heading_median7.745124858723169
deviation-heading_min7.745124858723169
distance-from-start_max1.2059816832534165
distance-from-start_mean1.2059816832534165
distance-from-start_median1.2059816832534165
distance-from-start_min1.2059816832534165
driven_any_max3.485084016236962
driven_any_mean3.485084016236962
driven_any_median3.485084016236962
driven_any_min3.485084016236962
driven_lanedir_consec_max1.4203998040440715
driven_lanedir_consec_mean1.4203998040440715
driven_lanedir_consec_min1.4203998040440715
driven_lanedir_max3.2905050472289954
driven_lanedir_mean3.2905050472289954
driven_lanedir_median3.2905050472289954
driven_lanedir_min3.2905050472289954
in-drivable-lane_max3.1499999999999666
in-drivable-lane_mean3.1499999999999666
in-drivable-lane_min3.1499999999999666
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.485084016236962, "survival_time": 59.99999999999873, "driven_lanedir": 3.2905050472289954, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.745124858723169, "distance-from-start": 1.2059816832534165, "deviation-center-line": 4.904463356399461, "driven_lanedir_consec": 1.4203998040440715}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
156371403Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-validationsim-3of4successnodavinci-stage-03-6.2.510:18:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.349999999999863
driven_lanedir_consec_median2.2674023788849116
deviation-center-line_median5.536893088323296


other stats
deviation-center-line_max5.653870952725518
deviation-center-line_mean5.457974501938994
deviation-center-line_min5.104240878383868
deviation-heading_max10.449364417109743
deviation-heading_mean10.11792868792557
deviation-heading_median10.098710996708824
deviation-heading_min9.824928341174887
distance-from-start_max2.5614095423342453
distance-from-start_mean2.0332734037963895
distance-from-start_median2.023972936634097
distance-from-start_min1.523738199583119
driven_any_max3.4820813210684833
driven_any_mean3.4569958269192997
driven_any_median3.4490866130099316
driven_any_min3.447728760588852
driven_lanedir_consec_max3.143458087423762
driven_lanedir_consec_mean2.322116699583174
driven_lanedir_consec_min1.610203953139111
driven_lanedir_max3.2610750728685343
driven_lanedir_mean3.200371790495466
driven_lanedir_median3.1833277569609386
driven_lanedir_min3.173756575191452
in-drivable-lane_max4.399999999999963
in-drivable-lane_mean4.0874999999999115
in-drivable-lane_min3.249999999999958
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.4490933302185676, "survival_time": 59.99999999999873, "driven_lanedir": 3.182424665546428, "in-drivable-lane": 4.3499999999998415, "deviation-heading": 10.087643041980582, "distance-from-start": 2.5614095423342453, "deviation-center-line": 5.533862530350289, "driven_lanedir_consec": 3.143458087423762}, "zigzag-000-ego1": {"driven_any": 3.447728760588852, "survival_time": 59.99999999999873, "driven_lanedir": 3.173756575191452, "in-drivable-lane": 4.399999999999963, "deviation-heading": 10.449364417109743, "distance-from-start": 1.5342133784714156, "deviation-center-line": 5.653870952725518, "driven_lanedir_consec": 1.6329981415649488}, "zigzag-000-ego2": {"driven_any": 3.4820813210684833, "survival_time": 59.99999999999873, "driven_lanedir": 3.2610750728685343, "in-drivable-lane": 3.249999999999958, "deviation-heading": 10.109778951437065, "distance-from-start": 1.523738199583119, "deviation-center-line": 5.104240878383868, "driven_lanedir_consec": 1.610203953139111}, "zigzag-000-ego3": {"driven_any": 3.4490798958012956, "survival_time": 59.99999999999873, "driven_lanedir": 3.184230848375449, "in-drivable-lane": 4.349999999999884, "deviation-heading": 9.824928341174887, "distance-from-start": 2.5137324947967783, "deviation-center-line": 5.5399236462963035, "driven_lanedir_consec": 2.901806616204875}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
156361403Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-validationsim-2of4successnodavinci-stage-03-6.2.510:05:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median41.949999999999754
in-drivable-lane_median2.0999999999999854
driven_lanedir_consec_median1.6184374408409197
deviation-center-line_median5.314566823663881


other stats
deviation-center-line_max5.605898707577726
deviation-center-line_mean5.314566823663881
deviation-center-line_min5.0232349397500355
deviation-heading_max12.492151788067773
deviation-heading_mean8.7311003580401
deviation-heading_median8.7311003580401
deviation-heading_min4.970048928012427
distance-from-start_max1.619836734308344
distance-from-start_mean1.309141287354286
distance-from-start_median1.309141287354286
distance-from-start_min0.998445840400228
driven_any_max2.3617420337632864
driven_any_mean1.724083393442756
driven_any_median1.724083393442756
driven_any_min1.0864247531222258
driven_lanedir_consec_max2.2050573724797125
driven_lanedir_consec_mean1.6184374408409197
driven_lanedir_consec_min1.031817509202127
driven_lanedir_max2.2050573724797125
driven_lanedir_mean1.6184374408409197
driven_lanedir_median1.6184374408409197
driven_lanedir_min1.031817509202127
in-drivable-lane_max3.0999999999999552
in-drivable-lane_mean2.0999999999999854
in-drivable-lane_min1.1000000000000156
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.0864247531222258, "survival_time": 41.949999999999754, "driven_lanedir": 1.031817509202127, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 12.492151788067773, "distance-from-start": 0.998445840400228, "deviation-center-line": 5.605898707577726, "driven_lanedir_consec": 1.031817509202127}, "loop2-000-ego1": {"driven_any": 2.3617420337632864, "survival_time": 41.949999999999754, "driven_lanedir": 2.2050573724797125, "in-drivable-lane": 3.0999999999999552, "deviation-heading": 4.970048928012427, "distance-from-start": 1.619836734308344, "deviation-center-line": 5.0232349397500355, "driven_lanedir_consec": 2.2050573724797125}}
simulation-passed1
survival_time_max41.949999999999754
survival_time_mean41.949999999999754
survival_time_min41.949999999999754
No reset possible
156231406Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-testingsim-0of4successnodavinci-stage-03-6.2.510:11:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.3819713089277443
deviation-center-line_median3.670190139750301


other stats
deviation-center-line_max3.670190139750301
deviation-center-line_mean3.670190139750301
deviation-center-line_min3.670190139750301
deviation-heading_max4.682835183981122
deviation-heading_mean4.682835183981122
deviation-heading_median4.682835183981122
deviation-heading_min4.682835183981122
distance-from-start_max2.2320761555794064
distance-from-start_mean2.2320761555794064
distance-from-start_median2.2320761555794064
distance-from-start_min2.2320761555794064
driven_any_max3.5795864361741097
driven_any_mean3.5795864361741097
driven_any_median3.5795864361741097
driven_any_min3.5795864361741097
driven_lanedir_consec_max3.3819713089277443
driven_lanedir_consec_mean3.3819713089277443
driven_lanedir_consec_min3.3819713089277443
driven_lanedir_max3.551265460849699
driven_lanedir_mean3.551265460849699
driven_lanedir_median3.551265460849699
driven_lanedir_min3.551265460849699
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 3.5795864361741097, "survival_time": 59.99999999999873, "driven_lanedir": 3.551265460849699, "in-drivable-lane": 0.0, "deviation-heading": 4.682835183981122, "distance-from-start": 2.2320761555794064, "deviation-center-line": 3.670190139750301, "driven_lanedir_consec": 3.3819713089277443}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
156201407Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-testingsim-1of4successnodavinci-stage-03-6.2.510:01:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.09999999999998
in-drivable-lane_median0.0
driven_lanedir_consec_median0.41885674395418215
deviation-center-line_median0.2592734099538108


other stats
deviation-center-line_max0.2592734099538108
deviation-center-line_mean0.2592734099538108
deviation-center-line_min0.2592734099538108
deviation-heading_max0.7151194489559713
deviation-heading_mean0.7151194489559713
deviation-heading_median0.7151194489559713
deviation-heading_min0.7151194489559713
distance-from-start_max0.4199960454985642
distance-from-start_mean0.4199960454985642
distance-from-start_median0.4199960454985642
distance-from-start_min0.4199960454985642
driven_any_max0.42359927688869903
driven_any_mean0.42359927688869903
driven_any_median0.42359927688869903
driven_any_min0.42359927688869903
driven_lanedir_consec_max0.41885674395418215
driven_lanedir_consec_mean0.41885674395418215
driven_lanedir_consec_min0.41885674395418215
driven_lanedir_max0.41885674395418215
driven_lanedir_mean0.41885674395418215
driven_lanedir_median0.41885674395418215
driven_lanedir_min0.41885674395418215
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 0.42359927688869903, "survival_time": 8.09999999999998, "driven_lanedir": 0.41885674395418215, "in-drivable-lane": 0.0, "deviation-heading": 0.7151194489559713, "distance-from-start": 0.4199960454985642, "deviation-center-line": 0.2592734099538108, "driven_lanedir_consec": 0.41885674395418215}}
simulation-passed1
survival_time_max8.09999999999998
survival_time_mean8.09999999999998
survival_time_min8.09999999999998
No reset possible
156131408Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-testingsim-1of4successnodavinci-stage-03-6.2.510:09:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.3499999999998664
driven_lanedir_consec_median3.381630870892481
deviation-center-line_median6.662994790807998


other stats
deviation-center-line_max6.662994790807998
deviation-center-line_mean6.662994790807998
deviation-center-line_min6.662994790807998
deviation-heading_max5.427561246722322
deviation-heading_mean5.427561246722322
deviation-heading_median5.427561246722322
deviation-heading_min5.427561246722322
distance-from-start_max2.1860021307337045
distance-from-start_mean2.1860021307337045
distance-from-start_median2.1860021307337045
distance-from-start_min2.1860021307337045
driven_any_max3.509092323425108
driven_any_mean3.509092323425108
driven_any_median3.509092323425108
driven_any_min3.509092323425108
driven_lanedir_consec_max3.381630870892481
driven_lanedir_consec_mean3.381630870892481
driven_lanedir_consec_min3.381630870892481
driven_lanedir_max3.381630870892481
driven_lanedir_mean3.381630870892481
driven_lanedir_median3.381630870892481
driven_lanedir_min3.381630870892481
in-drivable-lane_max2.3499999999998664
in-drivable-lane_mean2.3499999999998664
in-drivable-lane_min2.3499999999998664
per-episodes
details{"loop-000-ego0": {"driven_any": 3.509092323425108, "survival_time": 59.99999999999873, "driven_lanedir": 3.381630870892481, "in-drivable-lane": 2.3499999999998664, "deviation-heading": 5.427561246722322, "distance-from-start": 2.1860021307337045, "deviation-center-line": 6.662994790807998, "driven_lanedir_consec": 3.381630870892481}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
156061410Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-testingsim-3of4successnodavinci-stage-03-6.2.510:19:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.749999999999955
driven_lanedir_consec_median2.967583630098515
deviation-center-line_median4.936499581762261


other stats
deviation-center-line_max5.730573072686608
deviation-center-line_mean4.869852167143673
deviation-center-line_min3.875836432363564
deviation-heading_max12.742085043936966
deviation-heading_mean11.755117428407974
deviation-heading_median12.00130779644692
deviation-heading_min10.275769076801083
distance-from-start_max2.7363667230349455
distance-from-start_mean2.401179119880523
distance-from-start_median2.61282418444398
distance-from-start_min1.6427013875991858
driven_any_max3.5075798773472937
driven_any_mean3.403608315922737
driven_any_median3.4775792335299394
driven_any_min3.151694919283776
driven_lanedir_consec_max3.096555837247597
driven_lanedir_consec_mean2.687260211745085
driven_lanedir_consec_min1.7173177495357104
driven_lanedir_max3.302520401483574
driven_lanedir_mean3.1893582258787174
driven_lanedir_median3.236776064167141
driven_lanedir_min2.9813603736970133
in-drivable-lane_max3.6999999999998785
in-drivable-lane_mean2.762499999999936
in-drivable-lane_min1.8499999999999537
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.4685801016173095, "survival_time": 59.99999999999873, "driven_lanedir": 3.2300333077609547, "in-drivable-lane": 3.6999999999998785, "deviation-heading": 10.275769076801083, "distance-from-start": 2.544064021687348, "deviation-center-line": 4.350076895892649, "driven_lanedir_consec": 2.9538068865000175}, "zigzag-000-ego1": {"driven_any": 3.4865783654425693, "survival_time": 59.99999999999873, "driven_lanedir": 3.2435188205733265, "in-drivable-lane": 3.099999999999887, "deviation-heading": 11.389215220096572, "distance-from-start": 2.681584347200612, "deviation-center-line": 5.5229222676318726, "driven_lanedir_consec": 3.096555837247597}, "zigzag-000-ego2": {"driven_any": 3.5075798773472937, "survival_time": 59.99999999999873, "driven_lanedir": 3.302520401483574, "in-drivable-lane": 2.400000000000023, "deviation-heading": 12.61340037279727, "distance-from-start": 1.6427013875991858, "deviation-center-line": 3.875836432363564, "driven_lanedir_consec": 1.7173177495357104}, "zigzag-000-ego3": {"driven_any": 3.151694919283776, "survival_time": 59.99999999999873, "driven_lanedir": 2.9813603736970133, "in-drivable-lane": 1.8499999999999537, "deviation-heading": 12.742085043936966, "distance-from-start": 2.7363667230349455, "deviation-center-line": 5.730573072686608, "driven_lanedir_consec": 2.9813603736970133}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
156041411Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-testingsim-2of4successnodavinci-stage-03-6.2.510:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
156001412Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-testingsim-0of4successnodavinci-stage-03-6.2.510:04:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median45.14999999999957
in-drivable-lane_median0.0
driven_lanedir_consec_median2.6286605295435175
deviation-center-line_median4.749421103903259


other stats
deviation-center-line_max4.749421103903259
deviation-center-line_mean4.749421103903259
deviation-center-line_min4.749421103903259
deviation-heading_max3.0022009770680675
deviation-heading_mean3.0022009770680675
deviation-heading_median3.0022009770680675
deviation-heading_min3.0022009770680675
distance-from-start_max2.133910144488872
distance-from-start_mean2.133910144488872
distance-from-start_median2.133910144488872
distance-from-start_min2.133910144488872
driven_any_max2.6465975863112976
driven_any_mean2.6465975863112976
driven_any_median2.6465975863112976
driven_any_min2.6465975863112976
driven_lanedir_consec_max2.6286605295435175
driven_lanedir_consec_mean2.6286605295435175
driven_lanedir_consec_min2.6286605295435175
driven_lanedir_max2.6286605295435175
driven_lanedir_mean2.6286605295435175
driven_lanedir_median2.6286605295435175
driven_lanedir_min2.6286605295435175
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.6465975863112976, "survival_time": 45.14999999999957, "driven_lanedir": 2.6286605295435175, "in-drivable-lane": 0.0, "deviation-heading": 3.0022009770680675, "distance-from-start": 2.133910144488872, "deviation-center-line": 4.749421103903259, "driven_lanedir_consec": 2.6286605295435175}}
simulation-passed1
survival_time_max45.14999999999957
survival_time_mean45.14999999999957
survival_time_min45.14999999999957
No reset possible
155941414Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-validationsim-3of4successnodavinci-stage-03-6.2.510:04:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.349999999999895
driven_lanedir_consec_median1.3850760857666788
deviation-center-line_median5.586765713943565


other stats
deviation-center-line_max5.586765713943565
deviation-center-line_mean5.586765713943565
deviation-center-line_min5.586765713943565
deviation-heading_max8.627279155437556
deviation-heading_mean8.627279155437556
deviation-heading_median8.627279155437556
deviation-heading_min8.627279155437556
distance-from-start_max1.0494474660975028
distance-from-start_mean1.0494474660975028
distance-from-start_median1.0494474660975028
distance-from-start_min1.0494474660975028
driven_any_max3.449081931991406
driven_any_mean3.449081931991406
driven_any_median3.449081931991406
driven_any_min3.449081931991406
driven_lanedir_consec_max1.3850760857666788
driven_lanedir_consec_mean1.3850760857666788
driven_lanedir_consec_min1.3850760857666788
driven_lanedir_max3.20200785319052
driven_lanedir_mean3.20200785319052
driven_lanedir_median3.20200785319052
driven_lanedir_min3.20200785319052
in-drivable-lane_max4.349999999999895
in-drivable-lane_mean4.349999999999895
in-drivable-lane_min4.349999999999895
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.449081931991406, "survival_time": 59.99999999999873, "driven_lanedir": 3.20200785319052, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.627279155437556, "distance-from-start": 1.0494474660975028, "deviation-center-line": 5.586765713943565, "driven_lanedir_consec": 1.3850760857666788}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
155891415Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-validationsim-1of4successnodavinci-stage-03-6.2.510:05:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.3284423748962833
deviation-center-line_median2.2080698436648767


other stats
deviation-center-line_max2.2080698436648767
deviation-center-line_mean2.2080698436648767
deviation-center-line_min2.2080698436648767
deviation-heading_max3.646079460993991
deviation-heading_mean3.646079460993991
deviation-heading_median3.646079460993991
deviation-heading_min3.646079460993991
distance-from-start_max2.0667500720956693
distance-from-start_mean2.0667500720956693
distance-from-start_median2.0667500720956693
distance-from-start_min2.0667500720956693
driven_any_max3.579583385567372
driven_any_mean3.579583385567372
driven_any_median3.579583385567372
driven_any_min3.579583385567372
driven_lanedir_consec_max3.3284423748962833
driven_lanedir_consec_mean3.3284423748962833
driven_lanedir_consec_min3.3284423748962833
driven_lanedir_max3.558841603983183
driven_lanedir_mean3.558841603983183
driven_lanedir_median3.558841603983183
driven_lanedir_min3.558841603983183
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-000-ego0": {"driven_any": 3.579583385567372, "survival_time": 59.99999999999873, "driven_lanedir": 3.558841603983183, "in-drivable-lane": 0.0, "deviation-heading": 3.646079460993991, "distance-from-start": 2.0667500720956693, "deviation-center-line": 2.2080698436648767, "driven_lanedir_consec": 3.3284423748962833}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
155841417Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-validationsim-2of4successnodavinci-stage-03-6.2.510:09:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.499999999999858
driven_lanedir_consec_median2.073568167625771
deviation-center-line_median5.586339009536689


other stats
deviation-center-line_max5.586339009536689
deviation-center-line_mean5.586339009536689
deviation-center-line_min5.586339009536689
deviation-heading_max4.940364769457971
deviation-heading_mean4.940364769457971
deviation-heading_median4.940364769457971
deviation-heading_min4.940364769457971
distance-from-start_max1.7409270883034778
distance-from-start_mean1.7409270883034778
distance-from-start_median1.7409270883034778
distance-from-start_min1.7409270883034778
driven_any_max3.504586985619137
driven_any_mean3.504586985619137
driven_any_median3.504586985619137
driven_any_min3.504586985619137
driven_lanedir_consec_max2.073568167625771
driven_lanedir_consec_mean2.073568167625771
driven_lanedir_consec_min2.073568167625771
driven_lanedir_max3.360909384451456
driven_lanedir_mean3.360909384451456
driven_lanedir_median3.360909384451456
driven_lanedir_min3.360909384451456
in-drivable-lane_max2.499999999999858
in-drivable-lane_mean2.499999999999858
in-drivable-lane_min2.499999999999858
per-episodes
details{"4way-000-ego0": {"driven_any": 3.504586985619137, "survival_time": 59.99999999999873, "driven_lanedir": 3.360909384451456, "in-drivable-lane": 2.499999999999858, "deviation-heading": 4.940364769457971, "distance-from-start": 1.7409270883034778, "deviation-center-line": 5.586339009536689, "driven_lanedir_consec": 2.073568167625771}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
155751419Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-validationsim-3of4successnodavinci-stage-03-6.2.510:04:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median52.74999999999914
in-drivable-lane_median0.0
driven_lanedir_consec_median3.049495028380312
deviation-center-line_median4.252786905257612


other stats
deviation-center-line_max4.252786905257612
deviation-center-line_mean4.252786905257612
deviation-center-line_min4.252786905257612
deviation-heading_max7.335832537624176
deviation-heading_mean7.335832537624176
deviation-heading_median7.335832537624176
deviation-heading_min7.335832537624176
distance-from-start_max2.5590901305577565
distance-from-start_mean2.5590901305577565
distance-from-start_median2.5590901305577565
distance-from-start_min2.5590901305577565
driven_any_max3.10259355659584
driven_any_mean3.10259355659584
driven_any_median3.10259355659584
driven_any_min3.10259355659584
driven_lanedir_consec_max3.049495028380312
driven_lanedir_consec_mean3.049495028380312
driven_lanedir_consec_min3.049495028380312
driven_lanedir_max3.049495028380312
driven_lanedir_mean3.049495028380312
driven_lanedir_median3.049495028380312
driven_lanedir_min3.049495028380312
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.10259355659584, "survival_time": 52.74999999999914, "driven_lanedir": 3.049495028380312, "in-drivable-lane": 0.0, "deviation-heading": 7.335832537624176, "distance-from-start": 2.5590901305577565, "deviation-center-line": 4.252786905257612, "driven_lanedir_consec": 3.049495028380312}}
simulation-passed1
survival_time_max52.74999999999914
survival_time_mean52.74999999999914
survival_time_min52.74999999999914
No reset possible
155711420Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-testingsim-3of4successnodavinci-stage-03-6.2.510:04:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.5026609949387937
deviation-center-line_median4.00803286999595


other stats
deviation-center-line_max4.00803286999595
deviation-center-line_mean4.00803286999595
deviation-center-line_min4.00803286999595
deviation-heading_max9.741722574045852
deviation-heading_mean9.741722574045852
deviation-heading_median9.741722574045852
deviation-heading_min9.741722574045852
distance-from-start_max3.051215295455992
distance-from-start_mean3.051215295455992
distance-from-start_median3.051215295455992
distance-from-start_min3.051215295455992
driven_any_max3.579590602174237
driven_any_mean3.579590602174237
driven_any_median3.579590602174237
driven_any_min3.579590602174237
driven_lanedir_consec_max3.5026609949387937
driven_lanedir_consec_mean3.5026609949387937
driven_lanedir_consec_min3.5026609949387937
driven_lanedir_max3.5026609949387937
driven_lanedir_mean3.5026609949387937
driven_lanedir_median3.5026609949387937
driven_lanedir_min3.5026609949387937
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.579590602174237, "survival_time": 59.99999999999873, "driven_lanedir": 3.5026609949387937, "in-drivable-lane": 0.0, "deviation-heading": 9.741722574045852, "distance-from-start": 3.051215295455992, "deviation-center-line": 4.00803286999595, "driven_lanedir_consec": 3.5026609949387937}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
155691421Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-testingsim-2of4successnodavinci-stage-03-6.2.510:01:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
155631422Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-testingsim-2of4successnodavinci-stage-03-6.2.510:09:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.0050106271821506
deviation-center-line_median4.908963644722344


other stats
deviation-center-line_max6.01198792060873
deviation-center-line_mean4.593358939184355
deviation-center-line_min2.5435205466839994
deviation-heading_max5.727471290631747
deviation-heading_mean4.526175130231045
deviation-heading_median4.686700534848095
deviation-heading_min3.003828160596244
distance-from-start_max2.5613241003039633
distance-from-start_mean1.914912599777095
distance-from-start_median1.98188247541307
distance-from-start_min1.134561347978277
driven_any_max3.579580754957026
driven_any_mean3.2360870781772753
driven_any_median3.2450849856660264
driven_any_min2.8745975864200206
driven_lanedir_consec_max3.211958001358496
driven_lanedir_consec_mean3.019665595541482
driven_lanedir_consec_min2.856683126443131
driven_lanedir_max3.5310621633486874
driven_lanedir_mean3.181338396476557
driven_lanedir_median3.1688041281752737
driven_lanedir_min2.856683166206994
in-drivable-lane_max2.2000000000000313
in-drivable-lane_mean0.5500000000000078
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 2.8745975864200206, "survival_time": 59.99999999999873, "driven_lanedir": 2.856683166206994, "in-drivable-lane": 0.0, "deviation-heading": 3.003828160596244, "distance-from-start": 2.345983319386262, "deviation-center-line": 5.525958630071963, "driven_lanedir_consec": 2.856683126443131}, "4way-000-ego1": {"driven_any": 2.9765951859105204, "survival_time": 59.99999999999873, "driven_lanedir": 2.9585702681138724, "in-drivable-lane": 0.0, "deviation-heading": 3.74577370363053, "distance-from-start": 1.6177816314398783, "deviation-center-line": 6.01198792060873, "driven_lanedir_consec": 2.9318251947402816}, "4way-000-ego2": {"driven_any": 3.513574785421533, "survival_time": 59.99999999999873, "driven_lanedir": 3.379037988236675, "in-drivable-lane": 2.2000000000000313, "deviation-heading": 5.62762736606566, "distance-from-start": 2.5613241003039633, "deviation-center-line": 2.5435205466839994, "driven_lanedir_consec": 3.0781960596240197}, "4way-000-ego3": {"driven_any": 3.579580754957026, "survival_time": 59.99999999999873, "driven_lanedir": 3.5310621633486874, "in-drivable-lane": 0.0, "deviation-heading": 5.727471290631747, "distance-from-start": 1.134561347978277, "deviation-center-line": 4.291968659372725, "driven_lanedir_consec": 3.211958001358496}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
155561424Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-testingsim-3of4successnodavinci-stage-03-6.2.510:09:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.174999999999917
driven_lanedir_consec_median2.6226225453427174
deviation-center-line_median5.3031846613240265


other stats
deviation-center-line_max5.816265976116539
deviation-center-line_mean5.196634927837193
deviation-center-line_min4.363904412584181
deviation-heading_max13.510507170954757
deviation-heading_mean10.821915690706016
deviation-heading_median10.428621244524829
deviation-heading_min8.919913102819658
distance-from-start_max2.9580871089811698
distance-from-start_mean2.332849013698153
distance-from-start_median2.410604919303986
distance-from-start_min1.55209910720347
driven_any_max3.579590098610528
driven_any_mean3.3933509000885236
driven_any_median3.464904539716091
driven_any_min3.064004422311384
driven_lanedir_consec_max3.4992371353936753
driven_lanedir_consec_mean2.597829668578795
driven_lanedir_consec_min1.64683644823607
driven_lanedir_max3.4992371353936753
driven_lanedir_mean3.216224003341642
driven_lanedir_median3.212923209015736
driven_lanedir_min2.939812459941421
in-drivable-lane_max4.299999999999949
in-drivable-lane_mean2.162499999999946
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.579590098610528, "survival_time": 59.99999999999873, "driven_lanedir": 3.4992371353936753, "in-drivable-lane": 0.0, "deviation-heading": 8.919913102819658, "distance-from-start": 2.9580871089811698, "deviation-center-line": 4.363904412584181, "driven_lanedir_consec": 3.4992371353936753}, "zigzag-000-ego1": {"driven_any": 3.4790808241674496, "survival_time": 59.99999999999873, "driven_lanedir": 3.252574528929212, "in-drivable-lane": 3.3499999999998913, "deviation-heading": 10.055957232850009, "distance-from-start": 2.114012987076784, "deviation-center-line": 5.136572055912668, "driven_lanedir_consec": 2.305432630744014}, "zigzag-000-ego2": {"driven_any": 3.064004422311384, "survival_time": 59.99999999999873, "driven_lanedir": 2.939812459941421, "in-drivable-lane": 0.9999999999999432, "deviation-heading": 13.510507170954757, "distance-from-start": 2.707196851531188, "deviation-center-line": 5.469797266735385, "driven_lanedir_consec": 2.939812459941421}, "zigzag-000-ego3": {"driven_any": 3.4507282552647327, "survival_time": 59.99999999999873, "driven_lanedir": 3.17327188910226, "in-drivable-lane": 4.299999999999949, "deviation-heading": 10.80128525619965, "distance-from-start": 1.55209910720347, "deviation-center-line": 5.816265976116539, "driven_lanedir_consec": 1.64683644823607}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
155521555Andrea Danieleexercises_braitenberglx22-BV1sim-3of5successnodavinci-stage-03-6.2.510:08:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d50-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
155491424Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-testingsim-2of4successnodavinci-stage-03-6.2.510:04:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.3499999999998806
driven_lanedir_consec_median2.380746158820441
deviation-center-line_median6.07518739971563


other stats
deviation-center-line_max6.5629821214913955
deviation-center-line_mean6.07518739971563
deviation-center-line_min5.587392677939865
deviation-heading_max8.266160603781476
deviation-heading_mean7.316254408081507
deviation-heading_median7.316254408081507
deviation-heading_min6.3663482123815385
distance-from-start_max1.6314589686392718
distance-from-start_mean1.433307130896814
distance-from-start_median1.433307130896814
distance-from-start_min1.235155293154356
driven_any_max3.4865836169069464
driven_any_mean3.479150653763286
driven_any_median3.479150653763286
driven_any_min3.471717690619625
driven_lanedir_consec_max3.2882116374610164
driven_lanedir_consec_mean2.380746158820441
driven_lanedir_consec_min1.4732806801798657
driven_lanedir_max3.2882116374610164
driven_lanedir_mean3.2881134223745017
driven_lanedir_median3.2881134223745017
driven_lanedir_min3.2880152072879874
in-drivable-lane_max3.5999999999997954
in-drivable-lane_mean3.3499999999998806
in-drivable-lane_min3.099999999999966
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.471717690619625, "survival_time": 59.99999999999873, "driven_lanedir": 3.2882116374610164, "in-drivable-lane": 3.5999999999997954, "deviation-heading": 6.3663482123815385, "distance-from-start": 1.6314589686392718, "deviation-center-line": 6.5629821214913955, "driven_lanedir_consec": 3.2882116374610164}, "loop2-000-ego1": {"driven_any": 3.4865836169069464, "survival_time": 59.99999999999873, "driven_lanedir": 3.2880152072879874, "in-drivable-lane": 3.099999999999966, "deviation-heading": 8.266160603781476, "distance-from-start": 1.235155293154356, "deviation-center-line": 5.587392677939865, "driven_lanedir_consec": 1.4732806801798657}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
155421426Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-testingsim-1of4successnodavinci-stage-03-6.2.510:08:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.249999999999929
driven_lanedir_consec_median3.4642921416450347
deviation-center-line_median6.136200161902763


other stats
deviation-center-line_max6.136200161902763
deviation-center-line_mean6.136200161902763
deviation-center-line_min6.136200161902763
deviation-heading_max4.680365944406787
deviation-heading_mean4.680365944406787
deviation-heading_median4.680365944406787
deviation-heading_min4.680365944406787
distance-from-start_max2.417373767628198
distance-from-start_mean2.417373767628198
distance-from-start_median2.417373767628198
distance-from-start_min2.417373767628198
driven_any_max3.542094542339661
driven_any_mean3.542094542339661
driven_any_median3.542094542339661
driven_any_min3.542094542339661
driven_lanedir_consec_max3.4642921416450347
driven_lanedir_consec_mean3.4642921416450347
driven_lanedir_consec_min3.4642921416450347
driven_lanedir_max3.4642921416450347
driven_lanedir_mean3.4642921416450347
driven_lanedir_median3.4642921416450347
driven_lanedir_min3.4642921416450347
in-drivable-lane_max1.249999999999929
in-drivable-lane_mean1.249999999999929
in-drivable-lane_min1.249999999999929
per-episodes
details{"loop-000-ego0": {"driven_any": 3.542094542339661, "survival_time": 59.99999999999873, "driven_lanedir": 3.4642921416450347, "in-drivable-lane": 1.249999999999929, "deviation-heading": 4.680365944406787, "distance-from-start": 2.417373767628198, "deviation-center-line": 6.136200161902763, "driven_lanedir_consec": 3.4642921416450347}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
155371427Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-testingsim-1of4successnodavinci-stage-03-6.2.510:03:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median39.19999999999991
in-drivable-lane_median2.0000000000000284
driven_lanedir_consec_median1.303336274368214
deviation-center-line_median2.900740783049649


other stats
deviation-center-line_max2.900740783049649
deviation-center-line_mean2.900740783049649
deviation-center-line_min2.900740783049649
deviation-heading_max5.3959193297072545
deviation-heading_mean5.3959193297072545
deviation-heading_median5.3959193297072545
deviation-heading_min5.3959193297072545
distance-from-start_max1.390965508634873
distance-from-start_mean1.390965508634873
distance-from-start_median1.390965508634873
distance-from-start_min1.390965508634873
driven_any_max2.2295876463781625
driven_any_mean2.2295876463781625
driven_any_median2.2295876463781625
driven_any_min2.2295876463781625
driven_lanedir_consec_max1.303336274368214
driven_lanedir_consec_mean1.303336274368214
driven_lanedir_consec_min1.303336274368214
driven_lanedir_max2.097514770609055
driven_lanedir_mean2.097514770609055
driven_lanedir_median2.097514770609055
driven_lanedir_min2.097514770609055
in-drivable-lane_max2.0000000000000284
in-drivable-lane_mean2.0000000000000284
in-drivable-lane_min2.0000000000000284
per-episodes
details{"loop-000-ego0": {"driven_any": 2.2295876463781625, "survival_time": 39.19999999999991, "driven_lanedir": 2.097514770609055, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.3959193297072545, "distance-from-start": 1.390965508634873, "deviation-center-line": 2.900740783049649, "driven_lanedir_consec": 1.303336274368214}}
simulation-passed1
survival_time_max39.19999999999991
survival_time_mean39.19999999999991
survival_time_min39.19999999999991
No reset possible
155311429Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-3of4successnodavinci-stage-03-6.2.510:03:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.099999999999983
in-drivable-lane_median5.649999999999983
driven_lanedir_consec_median0.1397956002040246
deviation-center-line_median0.09390664341773942


other stats
deviation-center-line_max0.09390664341773942
deviation-center-line_mean0.09390664341773942
deviation-center-line_min0.09390664341773942
deviation-heading_max0.9654183287874442
deviation-heading_mean0.9654183287874442
deviation-heading_median0.9654183287874442
deviation-heading_min0.9654183287874442
distance-from-start_max1.0016247187181055
distance-from-start_mean1.0016247187181055
distance-from-start_median1.0016247187181055
distance-from-start_min1.0016247187181055
driven_any_max1.0016732136326914
driven_any_mean1.0016732136326914
driven_any_median1.0016732136326914
driven_any_min1.0016732136326914
driven_lanedir_consec_max0.1397956002040246
driven_lanedir_consec_mean0.1397956002040246
driven_lanedir_consec_min0.1397956002040246
driven_lanedir_max0.1397956002040246
driven_lanedir_mean0.1397956002040246
driven_lanedir_median0.1397956002040246
driven_lanedir_min0.1397956002040246
in-drivable-lane_max5.649999999999983
in-drivable-lane_mean5.649999999999983
in-drivable-lane_min5.649999999999983
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.0016732136326914, "survival_time": 7.099999999999983, "driven_lanedir": 0.1397956002040246, "in-drivable-lane": 5.649999999999983, "deviation-heading": 0.9654183287874442, "distance-from-start": 1.0016247187181055, "deviation-center-line": 0.09390664341773942, "driven_lanedir_consec": 0.1397956002040246}}
simulation-passed1
survival_time_max7.099999999999983
survival_time_mean7.099999999999983
survival_time_min7.099999999999983
No reset possible
155281430Bea Baselines 🐤minimal-agentaido-LFVI-sim-validationsim-1of4host-errornodavinci-stage-03-6.2.510:00:52
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon' 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
155261430Bea Baselines 🐤minimal-agentaido-LFVI-sim-validationsim-3of4successnodavinci-stage-03-6.2.510:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
155231431Bea Baselines 🐤minimal-agentaido-LFI-sim-validationsim-2of4successnodavinci-stage-03-6.2.510:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
155191433Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-validationsim-3of4successnodavinci-stage-03-6.2.510:01:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
155171433Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-validationsim-0of4host-errornodavinci-stage-03-6.2.510:00:17
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon' 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
155131433Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-validationsim-0of4host-errornodavinci-stage-03-6.2.510:00:17
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: Get https://registry-stage2.duckietown.org/v2/token?account=duckietowndaemon&client_id=docker&offline_token=true&service=registry-stage2.duckietown.org: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) (Client.Timeout exceeded while awaiting headers)")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon' 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
155101432Bea Baselines 🐤minimal-agentaido-LF-sim-validationsim-2of4host-errornodavinci-stage-03-6.2.510:00:17
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon' 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
155051434Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-validationsim-0of4successnodavinci-stage-03-6.2.510:04:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.250000000000025
in-drivable-lane_median8.775000000000027
driven_lanedir_consec_median0.3301338553680937
deviation-center-line_median0.20320237015909776


other stats
deviation-center-line_max0.27574141344199116
deviation-center-line_mean0.2019553718705288
deviation-center-line_min0.12567533372192854
deviation-heading_max0.9488219555580462
deviation-heading_mean0.8390918912315833
deviation-heading_median0.8356408604491967
deviation-heading_min0.7362638884698938
distance-from-start_max1.6837476731392351
distance-from-start_mean1.1946840199531843
distance-from-start_median1.3150560032892975
distance-from-start_min0.46487640009490705
driven_any_max1.6838575324025415
driven_any_mean1.194754885742435
driven_any_median1.3151384084002675
driven_any_min0.4648851937666637
driven_lanedir_consec_max0.5392559894853717
driven_lanedir_consec_mean0.3398044417698246
driven_lanedir_consec_min0.15969406685773935
driven_lanedir_max0.5392559894853717
driven_lanedir_mean0.3398044417698246
driven_lanedir_median0.3301338553680937
driven_lanedir_min0.15969406685773935
in-drivable-lane_max9.800000000000026
in-drivable-lane_mean8.725000000000026
in-drivable-lane_min7.55000000000003
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.4648851937666637, "survival_time": 11.250000000000025, "driven_lanedir": 0.19955171937759708, "in-drivable-lane": 9.500000000000025, "deviation-heading": 0.9488219555580462, "distance-from-start": 0.46487640009490705, "deviation-center-line": 0.12567533372192854, "driven_lanedir_consec": 0.19955171937759708}, "autolab-000-ego1": {"driven_any": 1.463212954741934, "survival_time": 11.250000000000025, "driven_lanedir": 0.15969406685773935, "in-drivable-lane": 9.800000000000026, "deviation-heading": 0.7478094709473367, "distance-from-start": 1.4631057991302578, "deviation-center-line": 0.1356249107782703, "driven_lanedir_consec": 0.15969406685773935}, "autolab-000-ego2": {"driven_any": 1.1670638620586014, "survival_time": 11.250000000000025, "driven_lanedir": 0.5392559894853717, "in-drivable-lane": 7.55000000000003, "deviation-heading": 0.9234722499510568, "distance-from-start": 1.1670062074483376, "deviation-center-line": 0.2707798295399252, "driven_lanedir_consec": 0.5392559894853717}, "autolab-000-ego3": {"driven_any": 1.6838575324025415, "survival_time": 11.250000000000025, "driven_lanedir": 0.4607159913585903, "in-drivable-lane": 8.05000000000003, "deviation-heading": 0.7362638884698938, "distance-from-start": 1.6837476731392351, "deviation-center-line": 0.27574141344199116, "driven_lanedir_consec": 0.4607159913585903}}
simulation-passed1
survival_time_max11.250000000000025
survival_time_mean11.250000000000025
survival_time_min11.250000000000025
No reset possible
155021435Bea Baselines 🐤minimal-agentaido-LFP-sim-validationsim-2of4successnodavinci-stage-03-6.2.510:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.499999999999992
in-drivable-lane_median2.749999999999991
driven_lanedir_consec_median0.19955231542409924
deviation-center-line_median0.12567511082985364


other stats
deviation-center-line_max0.12567511082985364
deviation-center-line_mean0.12567511082985364
deviation-center-line_min0.12567511082985364
deviation-heading_max0.9488219555580458
deviation-heading_mean0.9488219555580458
deviation-heading_median0.9488219555580458
deviation-heading_min0.9488219555580458
distance-from-start_max0.5733789333527137
distance-from-start_mean0.5733789333527137
distance-from-start_median0.5733789333527137
distance-from-start_min0.5733789333527137
driven_any_max0.5733903362648751
driven_any_mean0.5733903362648751
driven_any_median0.5733903362648751
driven_any_min0.5733903362648751
driven_lanedir_consec_max0.19955231542409924
driven_lanedir_consec_mean0.19955231542409924
driven_lanedir_consec_min0.19955231542409924
driven_lanedir_max0.19955231542409924
driven_lanedir_mean0.19955231542409924
driven_lanedir_median0.19955231542409924
driven_lanedir_min0.19955231542409924
in-drivable-lane_max2.749999999999991
in-drivable-lane_mean2.749999999999991
in-drivable-lane_min2.749999999999991
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.5733903362648751, "survival_time": 4.499999999999992, "driven_lanedir": 0.19955231542409924, "in-drivable-lane": 2.749999999999991, "deviation-heading": 0.9488219555580458, "distance-from-start": 0.5733789333527137, "deviation-center-line": 0.12567511082985364, "driven_lanedir_consec": 0.19955231542409924}}
simulation-passed1
survival_time_max4.499999999999992
survival_time_mean4.499999999999992
survival_time_min4.499999999999992
No reset possible
155001435Bea Baselines 🐤minimal-agentaido-LFP-sim-validationsim-0of4successnodavinci-stage-03-6.2.510:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.299999999999989
in-drivable-lane_median3.5499999999999883
driven_lanedir_consec_median0.1995526730519679
deviation-center-line_median0.12567493837705493


other stats
deviation-center-line_max0.12567493837705493
deviation-center-line_mean0.12567493837705493
deviation-center-line_min0.12567493837705493
deviation-heading_max0.9488219555580464
deviation-heading_mean0.9488219555580464
deviation-heading_median0.9488219555580464
deviation-heading_min0.9488219555580464
distance-from-start_max0.7065171257852313
distance-from-start_mean0.7065171257852313
distance-from-start_median0.7065171257852313
distance-from-start_min0.7065171257852313
driven_any_max0.7065288976667109
driven_any_mean0.7065288976667109
driven_any_median0.7065288976667109
driven_any_min0.7065288976667109
driven_lanedir_consec_max0.1995526730519679
driven_lanedir_consec_mean0.1995526730519679
driven_lanedir_consec_min0.1995526730519679
driven_lanedir_max0.1995526730519679
driven_lanedir_mean0.1995526730519679
driven_lanedir_median0.1995526730519679
driven_lanedir_min0.1995526730519679
in-drivable-lane_max3.5499999999999883
in-drivable-lane_mean3.5499999999999883
in-drivable-lane_min3.5499999999999883
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.7065288976667109, "survival_time": 5.299999999999989, "driven_lanedir": 0.1995526730519679, "in-drivable-lane": 3.5499999999999883, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.7065171257852313, "deviation-center-line": 0.12567493837705493, "driven_lanedir_consec": 0.1995526730519679}}
simulation-passed1
survival_time_max5.299999999999989
survival_time_mean5.299999999999989
survival_time_min5.299999999999989
No reset possible
154961438Bea Baselines 🐤minimal-agentlx22-visservoingsimsuccessyesdavinci-stage-03-6.2.510:02:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median2.6499999999999924
deviation-center-line_median0.17493349275674216
driven_lanedir_consec_median0.8221776345283069
survival_time_median8.14999999999998


other stats
deviation-center-line_max0.17647811751212122
deviation-center-line_mean0.17493349275674216
deviation-center-line_min0.1733888680013631
deviation-heading_max0.7383278077616701
deviation-heading_mean0.7099934263375745
deviation-heading_median0.7099934263375745
deviation-heading_min0.681659044913479
distance-from-start_max1.175276406473093
distance-from-start_mean1.175237634650054
distance-from-start_median1.175237634650054
distance-from-start_min1.1751988628270151
driven_any_max1.1755804280577309
driven_any_mean1.175457669946736
driven_any_median1.175457669946736
driven_any_min1.175334911835741
driven_lanedir_consec_max0.8828170026503562
driven_lanedir_consec_mean0.8221776345283069
driven_lanedir_consec_min0.7615382664062577
driven_lanedir_max0.8828170026503562
driven_lanedir_mean0.8221776345283069
driven_lanedir_median0.8221776345283069
driven_lanedir_min0.7615382664062577
in-drivable-lane_max2.999999999999991
in-drivable-lane_mean2.6499999999999924
in-drivable-lane_min2.2999999999999936
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 1.1755804280577309, "survival_time": 8.14999999999998, "driven_lanedir": 0.7615382664062577, "in-drivable-lane": 2.999999999999991, "deviation-heading": 0.681659044913479, "distance-from-start": 1.1751988628270151, "deviation-center-line": 0.1733888680013631, "driven_lanedir_consec": 0.7615382664062577}, "LF-small-loop-001-ego0": {"driven_any": 1.175334911835741, "survival_time": 8.14999999999998, "driven_lanedir": 0.8828170026503562, "in-drivable-lane": 2.2999999999999936, "deviation-heading": 0.7383278077616701, "distance-from-start": 1.175276406473093, "deviation-center-line": 0.17647811751212122, "driven_lanedir_consec": 0.8828170026503562}}
simulation-passed1
survival_time_max8.14999999999998
survival_time_mean8.14999999999998
survival_time_min8.14999999999998
No reset possible
154931440Bea Baselines 🐤minimal-agentlx22-BV1sim-0of5successnodavinci-stage-03-6.2.510:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.38992181148908706


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.38992181148908706
distance-from-start_median0.38992181148908706
distance-from-start_min0.38992181148908706
driven_any_max0.3899290723045018
driven_any_mean0.3899290723045018
driven_any_median0.3899290723045018
driven_any_min0.3899290723045018
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max3.399999999999996
in-drivable-lane_mean3.399999999999996
in-drivable-lane_median3.399999999999996
in-drivable-lane_min3.399999999999996
per-episodes
details{"d30-ego0": {"driven_any": 0.3899290723045018, "survival_time": 3.399999999999996, "driven_lanedir": 0.0, "in-drivable-lane": 3.399999999999996, "deviation-heading": 0.0, "distance-from-start": 0.38992181148908706, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean3.399999999999996
survival_time_median3.399999999999996
survival_time_min3.399999999999996
No reset possible
154891443Bea Baselines 🐤minimal-agentaido-hello-sim-validationsanity-checksuccessnodavinci-stage-03-6.2.510:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.027182527438338155
deviation-center-line_median0.005231420846612685


other stats
deviation-center-line_max0.005231420846612685
deviation-center-line_mean0.005231420846612685
deviation-center-line_min0.005231420846612685
deviation-heading_max0.26820132194453994
deviation-heading_mean0.26820132194453994
deviation-heading_median0.26820132194453994
deviation-heading_min0.26820132194453994
distance-from-start_max0.03160072536398472
distance-from-start_mean0.03160072536398472
distance-from-start_median0.03160072536398472
distance-from-start_min0.03160072536398472
driven_any_max0.03160074670807487
driven_any_mean0.03160074670807487
driven_any_median0.03160074670807487
driven_any_min0.03160074670807487
driven_lanedir_consec_max0.027182527438338155
driven_lanedir_consec_mean0.027182527438338155
driven_lanedir_consec_min0.027182527438338155
driven_lanedir_max0.027182527438338155
driven_lanedir_mean0.027182527438338155
driven_lanedir_median0.027182527438338155
driven_lanedir_min0.027182527438338155
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.03160074670807487, "survival_time": 0.49999999999999994, "driven_lanedir": 0.027182527438338155, "in-drivable-lane": 0.0, "deviation-heading": 0.26820132194453994, "distance-from-start": 0.03160072536398472, "deviation-center-line": 0.005231420846612685, "driven_lanedir_consec": 0.027182527438338155}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
154861447Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-0of4successnodavinci-stage-03-6.2.510:02:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.549999999999988
in-drivable-lane_median4.149999999999988
driven_lanedir_consec_median0.1366657585905482
deviation-center-line_median0.10783820466790534


other stats
deviation-center-line_max0.10783820466790534
deviation-center-line_mean0.10783820466790534
deviation-center-line_min0.10783820466790534
deviation-heading_max0.9508048428349386
deviation-heading_mean0.9508048428349386
deviation-heading_median0.9508048428349386
deviation-heading_min0.9508048428349386
distance-from-start_max0.7476573144701085
distance-from-start_mean0.7476573144701085
distance-from-start_median0.7476573144701085
distance-from-start_min0.7476573144701085
driven_any_max0.7476698075499906
driven_any_mean0.7476698075499906
driven_any_median0.7476698075499906
driven_any_min0.7476698075499906
driven_lanedir_consec_max0.1366657585905482
driven_lanedir_consec_mean0.1366657585905482
driven_lanedir_consec_min0.1366657585905482
driven_lanedir_max0.1366657585905482
driven_lanedir_mean0.1366657585905482
driven_lanedir_median0.1366657585905482
driven_lanedir_min0.1366657585905482
in-drivable-lane_max4.149999999999988
in-drivable-lane_mean4.149999999999988
in-drivable-lane_min4.149999999999988
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.7476698075499906, "survival_time": 5.549999999999988, "driven_lanedir": 0.1366657585905482, "in-drivable-lane": 4.149999999999988, "deviation-heading": 0.9508048428349386, "distance-from-start": 0.7476573144701085, "deviation-center-line": 0.10783820466790534, "driven_lanedir_consec": 0.1366657585905482}}
simulation-passed1
survival_time_max5.549999999999988
survival_time_mean5.549999999999988
survival_time_min5.549999999999988
No reset possible
154791449Bea Baselines 🐤minimal-agentaido-LFI-sim-testingsim-1of4successnodavinci-stage-03-6.2.510:02:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.850000000000003
in-drivable-lane_median8.450000000000005
driven_lanedir_consec_median0.13666265914899656
deviation-center-line_median0.10783777071756002


other stats
deviation-center-line_max0.10783777071756002
deviation-center-line_mean0.10783777071756002
deviation-center-line_min0.10783777071756002
deviation-heading_max0.9508048428349386
deviation-heading_mean0.9508048428349386
deviation-heading_median0.9508048428349386
deviation-heading_min0.9508048428349386
distance-from-start_max1.4547842507789357
distance-from-start_mean1.4547842507789357
distance-from-start_median1.4547842507789357
distance-from-start_min1.4547842507789357
driven_any_max1.454891323746283
driven_any_mean1.454891323746283
driven_any_median1.454891323746283
driven_any_min1.454891323746283
driven_lanedir_consec_max0.13666265914899656
driven_lanedir_consec_mean0.13666265914899656
driven_lanedir_consec_min0.13666265914899656
driven_lanedir_max0.13666265914899656
driven_lanedir_mean0.13666265914899656
driven_lanedir_median0.13666265914899656
driven_lanedir_min0.13666265914899656
in-drivable-lane_max8.450000000000005
in-drivable-lane_mean8.450000000000005
in-drivable-lane_min8.450000000000005
per-episodes
details{"udem1-000-ego0": {"driven_any": 1.454891323746283, "survival_time": 9.850000000000003, "driven_lanedir": 0.13666265914899656, "in-drivable-lane": 8.450000000000005, "deviation-heading": 0.9508048428349386, "distance-from-start": 1.4547842507789357, "deviation-center-line": 0.10783777071756002, "driven_lanedir_consec": 0.13666265914899656}}
simulation-passed1
survival_time_max9.850000000000003
survival_time_mean9.850000000000003
survival_time_min9.850000000000003
No reset possible
154751450Bea Baselines 🐤minimal-agentaido-LF-sim-testingsim-2of4successnodavinci-stage-03-6.2.510:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.30902388815479953
survival_time_median13.80000000000006
deviation-center-line_median0.26861568883973136
in-drivable-lane_median10.700000000000069


other stats
deviation-center-line_max0.26861568883973136
deviation-center-line_mean0.26861568883973136
deviation-center-line_min0.26861568883973136
deviation-heading_max2.499533756017491
deviation-heading_mean2.499533756017491
deviation-heading_median2.499533756017491
deviation-heading_min2.499533756017491
distance-from-start_max2.107081087129661
distance-from-start_mean2.107081087129661
distance-from-start_median2.107081087129661
distance-from-start_min2.107081087129661
driven_any_max2.107326449228953
driven_any_mean2.107326449228953
driven_any_median2.107326449228953
driven_any_min2.107326449228953
driven_lanedir_consec_max0.30902388815479953
driven_lanedir_consec_mean0.30902388815479953
driven_lanedir_consec_min0.30902388815479953
driven_lanedir_max0.30902388815479953
driven_lanedir_mean0.30902388815479953
driven_lanedir_median0.30902388815479953
driven_lanedir_min0.30902388815479953
in-drivable-lane_max10.700000000000069
in-drivable-lane_mean10.700000000000069
in-drivable-lane_min10.700000000000069
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.107326449228953, "survival_time": 13.80000000000006, "driven_lanedir": 0.30902388815479953, "in-drivable-lane": 10.700000000000069, "deviation-heading": 2.499533756017491, "distance-from-start": 2.107081087129661, "deviation-center-line": 0.26861568883973136, "driven_lanedir_consec": 0.30902388815479953}}
simulation-passed1
survival_time_max13.80000000000006
survival_time_mean13.80000000000006
survival_time_min13.80000000000006
No reset possible
154681452Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-testingsim-2of4successnodavinci-stage-03-6.2.510:03:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.650000000000002
in-drivable-lane_median7.325000000000005
driven_lanedir_consec_median0.22238961894840312
deviation-center-line_median0.2217639861515468


other stats
deviation-center-line_max0.3356899474445727
deviation-center-line_mean0.2217639861515468
deviation-center-line_min0.10783802485852088
deviation-heading_max2.3398302467533574
deviation-heading_mean1.645317544794148
deviation-heading_median1.645317544794148
deviation-heading_min0.9508048428349386
distance-from-start_max1.4215609490996366
distance-from-start_mean1.232352636856231
distance-from-start_median1.232352636856231
distance-from-start_min1.0431443246128251
driven_any_max1.421667748584305
driven_any_mean1.2324324663788455
driven_any_median1.2324324663788455
driven_any_min1.043197184173386
driven_lanedir_consec_max0.3081134793062541
driven_lanedir_consec_mean0.22238961894840312
driven_lanedir_consec_min0.1366657585905522
driven_lanedir_max0.3081134793062541
driven_lanedir_mean0.22238961894840312
driven_lanedir_median0.22238961894840312
driven_lanedir_min0.1366657585905522
in-drivable-lane_max8.250000000000002
in-drivable-lane_mean7.325000000000005
in-drivable-lane_min6.400000000000007
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.043197184173386, "survival_time": 9.650000000000002, "driven_lanedir": 0.1366657585905522, "in-drivable-lane": 8.250000000000002, "deviation-heading": 0.9508048428349386, "distance-from-start": 1.0431443246128251, "deviation-center-line": 0.10783802485852088, "driven_lanedir_consec": 0.1366657585905522}, "loop2-000-ego1": {"driven_any": 1.421667748584305, "survival_time": 9.650000000000002, "driven_lanedir": 0.3081134793062541, "in-drivable-lane": 6.400000000000007, "deviation-heading": 2.3398302467533574, "distance-from-start": 1.4215609490996366, "deviation-center-line": 0.3356899474445727, "driven_lanedir_consec": 0.3081134793062541}}
simulation-passed1
survival_time_max9.650000000000002
survival_time_mean9.650000000000002
survival_time_min9.650000000000002
No reset possible
154641452Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-testingsim-3of4successnodavinci-stage-03-6.2.510:06:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median21.200000000000166
in-drivable-lane_median19.625000000000163
driven_lanedir_consec_median0.17676532608959172
deviation-center-line_median0.12055883486711412


other stats
deviation-center-line_max0.8045746318533537
deviation-center-line_mean0.2853942640066456
deviation-center-line_min0.09588475443900028
deviation-heading_max5.2482884111975086
deviation-heading_mean1.8371274357323064
deviation-heading_median0.7612914460035247
deviation-heading_min0.5776384397246679
distance-from-start_max3.3354107982510546
distance-from-start_mean2.2110865327147784
distance-from-start_median2.191605904940471
distance-from-start_min1.1257235227271165
driven_any_max3.3361297078559655
driven_any_mean2.2114839832360524
driven_any_median2.1920133941339253
driven_any_min1.1257794368203942
driven_lanedir_consec_max1.1849271720723111
driven_lanedir_consec_mean0.4079658658358902
driven_lanedir_consec_min0.09340563909206612
driven_lanedir_max1.1849271720723111
driven_lanedir_mean0.4079658658358902
driven_lanedir_median0.17676532608959172
driven_lanedir_min0.09340563909206612
in-drivable-lane_max20.100000000000165
in-drivable-lane_mean17.837500000000155
in-drivable-lane_min12.00000000000012
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.3361297078559655, "survival_time": 21.200000000000166, "driven_lanedir": 1.1849271720723111, "in-drivable-lane": 12.00000000000012, "deviation-heading": 5.2482884111975086, "distance-from-start": 3.3354107982510546, "deviation-center-line": 0.8045746318533537, "driven_lanedir_consec": 1.1849271720723111}, "zigzag-000-ego1": {"driven_any": 2.855019965863893, "survival_time": 21.200000000000166, "driven_lanedir": 0.14869325237796405, "in-drivable-lane": 19.850000000000165, "deviation-heading": 0.5776384397246679, "distance-from-start": 2.8543136070620254, "deviation-center-line": 0.1372078405659203, "driven_lanedir_consec": 0.14869325237796405}, "zigzag-000-ego2": {"driven_any": 1.5290068224039577, "survival_time": 21.200000000000166, "driven_lanedir": 0.20483739980121937, "in-drivable-lane": 19.40000000000017, "deviation-heading": 0.7499200019270054, "distance-from-start": 1.5288982028189169, "deviation-center-line": 0.09588475443900028, "driven_lanedir_consec": 0.20483739980121937}, "zigzag-000-ego3": {"driven_any": 1.1257794368203942, "survival_time": 21.200000000000166, "driven_lanedir": 0.09340563909206612, "in-drivable-lane": 20.100000000000165, "deviation-heading": 0.772662890080044, "distance-from-start": 1.1257235227271165, "deviation-center-line": 0.10390982916830796, "driven_lanedir_consec": 0.09340563909206612}}
simulation-passed1
survival_time_max21.200000000000166
survival_time_mean21.200000000000166
survival_time_min21.200000000000166
No reset possible
154621453Bea Baselines 🐤minimal-agentaido-LFP-sim-testingsim-2of4successnodavinci-stage-03-6.2.510:01:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.050000000000036
in-drivable-lane_median8.950000000000042
driven_lanedir_consec_median0.30902388815479953
deviation-center-line_median0.26861568883973136


other stats
deviation-center-line_max0.26861568883973136
deviation-center-line_mean0.26861568883973136
deviation-center-line_min0.26861568883973136
deviation-heading_max2.499533756017491
deviation-heading_mean2.499533756017491
deviation-heading_median2.499533756017491
deviation-heading_min2.499533756017491
distance-from-start_max1.816331806096384
distance-from-start_mean1.816331806096384
distance-from-start_median1.816331806096384
distance-from-start_min1.816331806096384
driven_any_max1.8164449732417056
driven_any_mean1.8164449732417056
driven_any_median1.8164449732417056
driven_any_min1.8164449732417056
driven_lanedir_consec_max0.30902388815479953
driven_lanedir_consec_mean0.30902388815479953
driven_lanedir_consec_min0.30902388815479953
driven_lanedir_max0.30902388815479953
driven_lanedir_mean0.30902388815479953
driven_lanedir_median0.30902388815479953
driven_lanedir_min0.30902388815479953
in-drivable-lane_max8.950000000000042
in-drivable-lane_mean8.950000000000042
in-drivable-lane_min8.950000000000042
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.8164449732417056, "survival_time": 12.050000000000036, "driven_lanedir": 0.30902388815479953, "in-drivable-lane": 8.950000000000042, "deviation-heading": 2.499533756017491, "distance-from-start": 1.816331806096384, "deviation-center-line": 0.26861568883973136, "driven_lanedir_consec": 0.30902388815479953}}
simulation-passed1
survival_time_max12.050000000000036
survival_time_mean12.050000000000036
survival_time_min12.050000000000036
No reset possible
154591454Bea Baselines 🐤template-pytorchaido-LFV-sim-validationsim-2of4successnodavinci-stage-03-6.2.510:06:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median33.35000000000024
in-drivable-lane_median18.3500000000001
driven_lanedir_consec_median0.8182765847397058
deviation-center-line_median1.069915688705415


other stats
deviation-center-line_max1.069915688705415
deviation-center-line_mean1.069915688705415
deviation-center-line_min1.069915688705415
deviation-heading_max12.093522225951896
deviation-heading_mean12.093522225951896
deviation-heading_median12.093522225951896
deviation-heading_min12.093522225951896
distance-from-start_max0.2208837618638317
distance-from-start_mean0.2208837618638317
distance-from-start_median0.2208837618638317
distance-from-start_min0.2208837618638317
driven_any_max3.1362284537921994
driven_any_mean3.1362284537921994
driven_any_median3.1362284537921994
driven_any_min3.1362284537921994
driven_lanedir_consec_max0.8182765847397058
driven_lanedir_consec_mean0.8182765847397058
driven_lanedir_consec_min0.8182765847397058
driven_lanedir_max0.8182765847397058
driven_lanedir_mean0.8182765847397058
driven_lanedir_median0.8182765847397058
driven_lanedir_min0.8182765847397058
in-drivable-lane_max18.3500000000001
in-drivable-lane_mean18.3500000000001
in-drivable-lane_min18.3500000000001
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.1362284537921994, "survival_time": 33.35000000000024, "driven_lanedir": 0.8182765847397058, "in-drivable-lane": 18.3500000000001, "deviation-heading": 12.093522225951896, "distance-from-start": 0.2208837618638317, "deviation-center-line": 1.069915688705415, "driven_lanedir_consec": 0.8182765847397058}}
simulation-passed1
survival_time_max33.35000000000024
survival_time_mean33.35000000000024
survival_time_min33.35000000000024
No reset possible
154551455Bea Baselines 🐤template-pytorchaido-LFVI-sim-validationsim-1of4successnodavinci-stage-03-6.2.510:02:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.3
in-drivable-lane_median1.3999999999999997
driven_lanedir_consec_median0.02838676882329283
deviation-center-line_median0.01435653283195525


other stats
deviation-center-line_max0.01435653283195525
deviation-center-line_mean0.01435653283195525
deviation-center-line_min0.01435653283195525
deviation-heading_max0.7536460917807714
deviation-heading_mean0.7536460917807714
deviation-heading_median0.7536460917807714
deviation-heading_min0.7536460917807714
distance-from-start_max0.10909798342150127
distance-from-start_mean0.10909798342150127
distance-from-start_median0.10909798342150127
distance-from-start_min0.10909798342150127
driven_any_max0.1389643424461852
driven_any_mean0.1389643424461852
driven_any_median0.1389643424461852
driven_any_min0.1389643424461852
driven_lanedir_consec_max0.02838676882329283
driven_lanedir_consec_mean0.02838676882329283
driven_lanedir_consec_min0.02838676882329283
driven_lanedir_max0.02838676882329283
driven_lanedir_mean0.02838676882329283
driven_lanedir_median0.02838676882329283
driven_lanedir_min0.02838676882329283
in-drivable-lane_max1.3999999999999997
in-drivable-lane_mean1.3999999999999997
in-drivable-lane_min1.3999999999999997
per-episodes
details{"4way-000-ego0": {"driven_any": 0.1389643424461852, "survival_time": 2.3, "driven_lanedir": 0.02838676882329283, "in-drivable-lane": 1.3999999999999997, "deviation-heading": 0.7536460917807714, "distance-from-start": 0.10909798342150127, "deviation-center-line": 0.01435653283195525, "driven_lanedir_consec": 0.02838676882329283}}
simulation-passed1
survival_time_max2.3
survival_time_mean2.3
survival_time_min2.3
No reset possible
154511456Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-0of4successnodavinci-stage-03-6.2.510:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.25
in-drivable-lane_median1.55
driven_lanedir_consec_median0.010381044464116584
deviation-center-line_median0.008291031209926327


other stats
deviation-center-line_max0.008291031209926327
deviation-center-line_mean0.008291031209926327
deviation-center-line_min0.008291031209926327
deviation-heading_max0.5934709373330407
deviation-heading_mean0.5934709373330407
deviation-heading_median0.5934709373330407
deviation-heading_min0.5934709373330407
distance-from-start_max0.08714850093432373
distance-from-start_mean0.08714850093432373
distance-from-start_median0.08714850093432373
distance-from-start_min0.08714850093432373
driven_any_max0.11424881562409732
driven_any_mean0.11424881562409732
driven_any_median0.11424881562409732
driven_any_min0.11424881562409732
driven_lanedir_consec_max0.010381044464116584
driven_lanedir_consec_mean0.010381044464116584
driven_lanedir_consec_min0.010381044464116584
driven_lanedir_max0.010381044464116584
driven_lanedir_mean0.010381044464116584
driven_lanedir_median0.010381044464116584
driven_lanedir_min0.010381044464116584
in-drivable-lane_max1.55
in-drivable-lane_mean1.55
in-drivable-lane_min1.55
per-episodes
details{"4way-000-ego0": {"driven_any": 0.11424881562409732, "survival_time": 2.25, "driven_lanedir": 0.010381044464116584, "in-drivable-lane": 1.55, "deviation-heading": 0.5934709373330407, "distance-from-start": 0.08714850093432373, "deviation-center-line": 0.008291031209926327, "driven_lanedir_consec": 0.010381044464116584}}
simulation-passed1
survival_time_max2.25
survival_time_mean2.25
survival_time_min2.25
No reset possible
154501456Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-3of4successnodavinci-stage-03-6.2.510:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
154461457Bea Baselines 🐤template-pytorchaido-LF-sim-validationsim-3of4successnodavinci-stage-03-6.2.510:02:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.13342377802362004
survival_time_median8.349999999999984
deviation-center-line_median0.13079257050030013
in-drivable-lane_median6.499999999999987


other stats
deviation-center-line_max0.13079257050030013
deviation-center-line_mean0.13079257050030013
deviation-center-line_min0.13079257050030013
deviation-heading_max1.930187399509121
deviation-heading_mean1.930187399509121
deviation-heading_median1.930187399509121
deviation-heading_min1.930187399509121
distance-from-start_max1.0902019401143752
distance-from-start_mean1.0902019401143752
distance-from-start_median1.0902019401143752
distance-from-start_min1.0902019401143752
driven_any_max1.945582282330358
driven_any_mean1.945582282330358
driven_any_median1.945582282330358
driven_any_min1.945582282330358
driven_lanedir_consec_max0.13342377802362004
driven_lanedir_consec_mean0.13342377802362004
driven_lanedir_consec_min0.13342377802362004
driven_lanedir_max0.13342377802362004
driven_lanedir_mean0.13342377802362004
driven_lanedir_median0.13342377802362004
driven_lanedir_min0.13342377802362004
in-drivable-lane_max6.499999999999987
in-drivable-lane_mean6.499999999999987
in-drivable-lane_min6.499999999999987
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.945582282330358, "survival_time": 8.349999999999984, "driven_lanedir": 0.13342377802362004, "in-drivable-lane": 6.499999999999987, "deviation-heading": 1.930187399509121, "distance-from-start": 1.0902019401143752, "deviation-center-line": 0.13079257050030013, "driven_lanedir_consec": 0.13342377802362004}}
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean8.349999999999984
survival_time_min8.349999999999984
No reset possible
154411554Andrea Danieleexercises_braitenberglx22-BV1sim-3of5successnodavinci-stage-03-6.2.510:09:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d50-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
154311459Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-validationsim-1of4successnodavinci-stage-03-6.2.510:26:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median49.574999999998866
driven_lanedir_consec_median0.7043389727343972
deviation-center-line_median0.8766044294841716


other stats
deviation-center-line_max1.6549063043615144
deviation-center-line_mean0.8743881383646889
deviation-center-line_min0.08943739012889788
deviation-heading_max14.780096013788224
deviation-heading_mean8.313907015159845
deviation-heading_median8.915753971440461
deviation-heading_min0.6440241039702355
distance-from-start_max1.6693557080890575
distance-from-start_mean0.6676436407933078
distance-from-start_median0.3941494484249916
distance-from-start_min0.21291995823419052
driven_any_max10.967433506856434
driven_any_mean6.840135945262375
driven_any_median8.089351199454297
driven_any_min0.2144078752844724
driven_lanedir_consec_max1.2305614544349797
driven_lanedir_consec_mean0.6906511885880383
driven_lanedir_consec_min0.12336535444837926
driven_lanedir_max1.2305614544349797
driven_lanedir_mean0.789477259406133
driven_lanedir_median0.9019911143705864
driven_lanedir_min0.12336535444837926
in-drivable-lane_max58.94999999999872
in-drivable-lane_mean50.69999999999888
in-drivable-lane_min44.69999999999906
per-episodes
details{"loop-000-ego0": {"driven_any": 8.599897665807923, "survival_time": 59.99999999999873, "driven_lanedir": 0.7986700701781126, "in-drivable-lane": 49.79999999999876, "deviation-heading": 9.672908146620989, "distance-from-start": 1.6693557080890575, "deviation-center-line": 0.8643648380411888, "driven_lanedir_consec": 0.7986700701781126}, "loop-000-ego1": {"driven_any": 0.2144078752844724, "survival_time": 59.99999999999873, "driven_lanedir": 0.12336535444837926, "in-drivable-lane": 58.94999999999872, "deviation-heading": 0.6440241039702355, "distance-from-start": 0.21291995823419052, "deviation-center-line": 0.08943739012889788, "driven_lanedir_consec": 0.12336535444837926}, "loop-000-ego2": {"driven_any": 7.578804733100672, "survival_time": 59.99999999999873, "driven_lanedir": 1.0053121585630604, "in-drivable-lane": 44.69999999999906, "deviation-heading": 14.780096013788224, "distance-from-start": 0.28646802938769644, "deviation-center-line": 1.6549063043615144, "driven_lanedir_consec": 0.6100078752906817}, "loop-000-ego3": {"driven_any": 10.967433506856434, "survival_time": 59.99999999999873, "driven_lanedir": 1.2305614544349797, "in-drivable-lane": 49.34999999999898, "deviation-heading": 8.158599796259933, "distance-from-start": 0.5018308674622868, "deviation-center-line": 0.8888440209271544, "driven_lanedir_consec": 1.2305614544349797}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
154261461Bea Baselines 🐤template-pytorchlx22-modconsimsuccessyesdavinci-stage-03-6.2.510:10:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median33.724999999999426
deviation-center-line_median1.382936419521216
driven_lanedir_consec_median0.8155460552125413
survival_time_median48.34999999999939


other stats
deviation-center-line_max1.7113147514623528
deviation-center-line_mean1.382936419521216
deviation-center-line_min1.0545580875800789
deviation-heading_max14.588919807537645
deviation-heading_mean11.754314715121938
deviation-heading_median11.754314715121938
deviation-heading_min8.919709622706232
distance-from-start_max0.7927154539287221
distance-from-start_mean0.6523218661962156
distance-from-start_median0.6523218661962156
distance-from-start_min0.5119282784637089
driven_any_max8.247138757043217
driven_any_mean6.3378248764018235
driven_any_median6.3378248764018235
driven_any_min4.428510995760429
driven_lanedir_consec_max1.615840490921476
driven_lanedir_consec_mean0.8155460552125413
driven_lanedir_consec_min0.01525161950360654
driven_lanedir_max1.615840490921476
driven_lanedir_mean1.2613053923640551
driven_lanedir_median1.2613053923640551
driven_lanedir_min0.9067702938066342
in-drivable-lane_max42.04999999999896
in-drivable-lane_mean33.724999999999426
in-drivable-lane_min25.3999999999999
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 8.247138757043217, "survival_time": 59.99999999999873, "driven_lanedir": 1.615840490921476, "in-drivable-lane": 42.04999999999896, "deviation-heading": 14.588919807537645, "distance-from-start": 0.7927154539287221, "deviation-center-line": 1.7113147514623528, "driven_lanedir_consec": 1.615840490921476}, "LF-full-loop-001-ego0": {"driven_any": 4.428510995760429, "survival_time": 36.70000000000005, "driven_lanedir": 0.9067702938066342, "in-drivable-lane": 25.3999999999999, "deviation-heading": 8.919709622706232, "distance-from-start": 0.5119282784637089, "deviation-center-line": 1.0545580875800789, "driven_lanedir_consec": 0.01525161950360654}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean48.34999999999939
survival_time_min36.70000000000005
No reset possible
154151472Bea Baselines 🐤template-pytorchaido-LFV-sim-testingsim-3of4successnodavinci-stage-03-6.2.510:17:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median48.89999999999936
in-drivable-lane_median32.09999999999934
driven_lanedir_consec_median1.4828439363802803
deviation-center-line_median1.2166903628404124


other stats
deviation-center-line_max1.2166903628404124
deviation-center-line_mean1.2166903628404124
deviation-center-line_min1.2166903628404124
deviation-heading_max12.9746260239314
deviation-heading_mean12.9746260239314
deviation-heading_median12.9746260239314
deviation-heading_min12.9746260239314
distance-from-start_max0.32884481874866545
distance-from-start_mean0.32884481874866545
distance-from-start_median0.32884481874866545
distance-from-start_min0.32884481874866545
driven_any_max6.547558683456682
driven_any_mean6.547558683456682
driven_any_median6.547558683456682
driven_any_min6.547558683456682
driven_lanedir_consec_max1.4828439363802803
driven_lanedir_consec_mean1.4828439363802803
driven_lanedir_consec_min1.4828439363802803
driven_lanedir_max1.4828439363802803
driven_lanedir_mean1.4828439363802803
driven_lanedir_median1.4828439363802803
driven_lanedir_min1.4828439363802803
in-drivable-lane_max32.09999999999934
in-drivable-lane_mean32.09999999999934
in-drivable-lane_min32.09999999999934
per-episodes
details{"zigzag-000-ego0": {"driven_any": 6.547558683456682, "survival_time": 48.89999999999936, "driven_lanedir": 1.4828439363802803, "in-drivable-lane": 32.09999999999934, "deviation-heading": 12.9746260239314, "distance-from-start": 0.32884481874866545, "deviation-center-line": 1.2166903628404124, "driven_lanedir_consec": 1.4828439363802803}}
simulation-passed1
survival_time_max48.89999999999936
survival_time_mean48.89999999999936
survival_time_min48.89999999999936
No reset possible
154121473Bea Baselines 🐤template-pytorchaido-LFVI-sim-testingsim-1of4successnodavinci-stage-03-6.2.510:03:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.299999999999993
in-drivable-lane_median2.4499999999999917
driven_lanedir_consec_median0.18954164195445977
deviation-center-line_median0.07927624897761028


other stats
deviation-center-line_max0.07927624897761028
deviation-center-line_mean0.07927624897761028
deviation-center-line_min0.07927624897761028
deviation-heading_max1.2352252536813295
deviation-heading_mean1.2352252536813295
deviation-heading_median1.2352252536813295
deviation-heading_min1.2352252536813295
distance-from-start_max0.24953616409976687
distance-from-start_mean0.24953616409976687
distance-from-start_median0.24953616409976687
distance-from-start_min0.24953616409976687
driven_any_max0.5770046412704225
driven_any_mean0.5770046412704225
driven_any_median0.5770046412704225
driven_any_min0.5770046412704225
driven_lanedir_consec_max0.18954164195445977
driven_lanedir_consec_mean0.18954164195445977
driven_lanedir_consec_min0.18954164195445977
driven_lanedir_max0.18954164195445977
driven_lanedir_mean0.18954164195445977
driven_lanedir_median0.18954164195445977
driven_lanedir_min0.18954164195445977
in-drivable-lane_max2.4499999999999917
in-drivable-lane_mean2.4499999999999917
in-drivable-lane_min2.4499999999999917
per-episodes
details{"4way-000-ego0": {"driven_any": 0.5770046412704225, "survival_time": 4.299999999999993, "driven_lanedir": 0.18954164195445977, "in-drivable-lane": 2.4499999999999917, "deviation-heading": 1.2352252536813295, "distance-from-start": 0.24953616409976687, "deviation-center-line": 0.07927624897761028, "driven_lanedir_consec": 0.18954164195445977}}
simulation-passed1
survival_time_max4.299999999999993
survival_time_mean4.299999999999993
survival_time_min4.299999999999993
No reset possible
154101473Bea Baselines 🐤template-pytorchaido-LFVI-sim-testingsim-3of4successnodavinci-stage-03-6.2.510:01:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
154091473Bea Baselines 🐤template-pytorchaido-LFVI-sim-testingsim-2of4successnodavinci-stage-03-6.2.510:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
154021475Bea Baselines 🐤template-pytorchaido-LF-sim-testingsim-0of4successnodavinci-stage-03-6.2.510:09:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.593239332029309
survival_time_median59.99999999999873
deviation-center-line_median1.740203443770885
in-drivable-lane_median35.199999999999


other stats
deviation-center-line_max1.740203443770885
deviation-center-line_mean1.740203443770885
deviation-center-line_min1.740203443770885
deviation-heading_max18.64910372761524
deviation-heading_mean18.64910372761524
deviation-heading_median18.64910372761524
deviation-heading_min18.64910372761524
distance-from-start_max0.8193469747481381
distance-from-start_mean0.8193469747481381
distance-from-start_median0.8193469747481381
distance-from-start_min0.8193469747481381
driven_any_max5.091842316648326
driven_any_mean5.091842316648326
driven_any_median5.091842316648326
driven_any_min5.091842316648326
driven_lanedir_consec_max1.593239332029309
driven_lanedir_consec_mean1.593239332029309
driven_lanedir_consec_min1.593239332029309
driven_lanedir_max1.593239332029309
driven_lanedir_mean1.593239332029309
driven_lanedir_median1.593239332029309
driven_lanedir_min1.593239332029309
in-drivable-lane_max35.199999999999
in-drivable-lane_mean35.199999999999
in-drivable-lane_min35.199999999999
per-episodes
details{"autolab-000-ego0": {"driven_any": 5.091842316648326, "survival_time": 59.99999999999873, "driven_lanedir": 1.593239332029309, "in-drivable-lane": 35.199999999999, "deviation-heading": 18.64910372761524, "distance-from-start": 0.8193469747481381, "deviation-center-line": 1.740203443770885, "driven_lanedir_consec": 1.593239332029309}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
154011475Bea Baselines 🐤template-pytorchaido-LF-sim-testingsim-3of4successnodavinci-stage-03-6.2.510:09:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.843553544551521
survival_time_median59.99999999999873
deviation-center-line_median1.4456066778159142
in-drivable-lane_median29.949999999999346


other stats
deviation-center-line_max1.4456066778159142
deviation-center-line_mean1.4456066778159142
deviation-center-line_min1.4456066778159142
deviation-heading_max23.407812689396913
deviation-heading_mean23.407812689396913
deviation-heading_median23.407812689396913
deviation-heading_min23.407812689396913
distance-from-start_max0.7471908963050212
distance-from-start_mean0.7471908963050212
distance-from-start_median0.7471908963050212
distance-from-start_min0.7471908963050212
driven_any_max8.371027988271912
driven_any_mean8.371027988271912
driven_any_median8.371027988271912
driven_any_min8.371027988271912
driven_lanedir_consec_max2.843553544551521
driven_lanedir_consec_mean2.843553544551521
driven_lanedir_consec_min2.843553544551521
driven_lanedir_max2.843553544551521
driven_lanedir_mean2.843553544551521
driven_lanedir_median2.843553544551521
driven_lanedir_min2.843553544551521
in-drivable-lane_max29.949999999999346
in-drivable-lane_mean29.949999999999346
in-drivable-lane_min29.949999999999346
per-episodes
details{"zigzag-000-ego0": {"driven_any": 8.371027988271912, "survival_time": 59.99999999999873, "driven_lanedir": 2.843553544551521, "in-drivable-lane": 29.949999999999346, "deviation-heading": 23.407812689396913, "distance-from-start": 0.7471908963050212, "deviation-center-line": 1.4456066778159142, "driven_lanedir_consec": 2.843553544551521}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
154001475Bea Baselines 🐤template-pytorchaido-LF-sim-testingsim-2of4successnodavinci-stage-03-6.2.510:01:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.35256045014061965
survival_time_median8.09999999999998
deviation-center-line_median0.14386911473778702
in-drivable-lane_median6.349999999999984


other stats
deviation-center-line_max0.14386911473778702
deviation-center-line_mean0.14386911473778702
deviation-center-line_min0.14386911473778702
deviation-heading_max1.3308789200196498
deviation-heading_mean1.3308789200196498
deviation-heading_median1.3308789200196498
deviation-heading_min1.3308789200196498
distance-from-start_max1.3603802754366887
distance-from-start_mean1.3603802754366887
distance-from-start_median1.3603802754366887
distance-from-start_min1.3603802754366887
driven_any_max2.529090542204486
driven_any_mean2.529090542204486
driven_any_median2.529090542204486
driven_any_min2.529090542204486
driven_lanedir_consec_max0.35256045014061965
driven_lanedir_consec_mean0.35256045014061965
driven_lanedir_consec_min0.35256045014061965
driven_lanedir_max0.35256045014061965
driven_lanedir_mean0.35256045014061965
driven_lanedir_median0.35256045014061965
driven_lanedir_min0.35256045014061965
in-drivable-lane_max6.349999999999984
in-drivable-lane_mean6.349999999999984
in-drivable-lane_min6.349999999999984
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.529090542204486, "survival_time": 8.09999999999998, "driven_lanedir": 0.35256045014061965, "in-drivable-lane": 6.349999999999984, "deviation-heading": 1.3308789200196498, "distance-from-start": 1.3603802754366887, "deviation-center-line": 0.14386911473778702, "driven_lanedir_consec": 0.35256045014061965}}
simulation-passed1
survival_time_max8.09999999999998
survival_time_mean8.09999999999998
survival_time_min8.09999999999998
No reset possible
153991476Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-testingsim-1of4host-errornodavinci-stage-03-6.2.510:01:31
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 390, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.model = DDPG(state_dim=self.preprocessor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/submission/model.py", line 153, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 390, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.model = DDPG(state_dim=self.preprocessor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/submission/model.py", line 153, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
153921477Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-testingsim-2of4successnodavinci-stage-03-6.2.510:10:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median28.39999999999937
driven_lanedir_consec_median0.29847398281374315
deviation-center-line_median5.209591475332532


other stats
deviation-center-line_max9.988449910110443
deviation-center-line_mean5.209591475332532
deviation-center-line_min0.4307330405546219
deviation-heading_max85.5572587325548
deviation-heading_mean43.90382969178714
deviation-heading_median43.90382969178714
deviation-heading_min2.2504006510194743
distance-from-start_max0.3965363270253792
distance-from-start_mean0.3742519588759696
distance-from-start_median0.3742519588759696
distance-from-start_min0.3519675907265601
driven_any_max7.418647697779046
driven_any_mean3.961631032317712
driven_any_median3.961631032317712
driven_any_min0.5046143668563786
driven_lanedir_consec_max0.38283927207553914
driven_lanedir_consec_mean0.29847398281374315
driven_lanedir_consec_min0.21410869355194717
driven_lanedir_max0.38283927207553914
driven_lanedir_mean0.29847398281374315
driven_lanedir_median0.29847398281374315
driven_lanedir_min0.21410869355194717
in-drivable-lane_max56.79999999999873
in-drivable-lane_mean28.39999999999937
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.5046143668563786, "survival_time": 59.99999999999873, "driven_lanedir": 0.38283927207553914, "in-drivable-lane": 0.0, "deviation-heading": 85.5572587325548, "distance-from-start": 0.3965363270253792, "deviation-center-line": 9.988449910110443, "driven_lanedir_consec": 0.38283927207553914}, "loop2-000-ego1": {"driven_any": 7.418647697779046, "survival_time": 59.99999999999873, "driven_lanedir": 0.21410869355194717, "in-drivable-lane": 56.79999999999873, "deviation-heading": 2.2504006510194743, "distance-from-start": 0.3519675907265601, "deviation-center-line": 0.4307330405546219, "driven_lanedir_consec": 0.21410869355194717}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
153901478Bea Baselines 🐤template-pytorchaido-LFP-sim-testingsim-0of4successnodavinci-stage-03-6.2.510:05:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median31.100000000000307
in-drivable-lane_median23.900000000000276
driven_lanedir_consec_median0.3811970311605939
deviation-center-line_median0.5014803365406109


other stats
deviation-center-line_max0.5014803365406109
deviation-center-line_mean0.5014803365406109
deviation-center-line_min0.5014803365406109
deviation-heading_max5.002849625743178
deviation-heading_mean5.002849625743178
deviation-heading_median5.002849625743178
deviation-heading_min5.002849625743178
distance-from-start_max0.4156151773078378
distance-from-start_mean0.4156151773078378
distance-from-start_median0.4156151773078378
distance-from-start_min0.4156151773078378
driven_any_max2.4568235598272983
driven_any_mean2.4568235598272983
driven_any_median2.4568235598272983
driven_any_min2.4568235598272983
driven_lanedir_consec_max0.3811970311605939
driven_lanedir_consec_mean0.3811970311605939
driven_lanedir_consec_min0.3811970311605939
driven_lanedir_max0.3811970311605939
driven_lanedir_mean0.3811970311605939
driven_lanedir_median0.3811970311605939
driven_lanedir_min0.3811970311605939
in-drivable-lane_max23.900000000000276
in-drivable-lane_mean23.900000000000276
in-drivable-lane_min23.900000000000276
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.4568235598272983, "survival_time": 31.100000000000307, "driven_lanedir": 0.3811970311605939, "in-drivable-lane": 23.900000000000276, "deviation-heading": 5.002849625743178, "distance-from-start": 0.4156151773078378, "deviation-center-line": 0.5014803365406109, "driven_lanedir_consec": 0.3811970311605939}}
simulation-passed1
survival_time_max31.100000000000307
survival_time_mean31.100000000000307
survival_time_min31.100000000000307
No reset possible
153831480Bea Baselines 🐤template-randomaido-LFVI-sim-validationsim-0of4successnodavinci-stage-03-6.2.510:07:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median28.850000000000275
in-drivable-lane_median18.900000000000233
driven_lanedir_consec_median0.25774306587044116
deviation-center-line_median0.8659891122281899


other stats
deviation-center-line_max0.8659891122281899
deviation-center-line_mean0.8659891122281899
deviation-center-line_min0.8659891122281899
deviation-heading_max7.706889663126838
deviation-heading_mean7.706889663126838
deviation-heading_median7.706889663126838
deviation-heading_min7.706889663126838
distance-from-start_max0.8626308120701125
distance-from-start_mean0.8626308120701125
distance-from-start_median0.8626308120701125
distance-from-start_min0.8626308120701125
driven_any_max7.161071358405415
driven_any_mean7.161071358405415
driven_any_median7.161071358405415
driven_any_min7.161071358405415
driven_lanedir_consec_max0.25774306587044116
driven_lanedir_consec_mean0.25774306587044116
driven_lanedir_consec_min0.25774306587044116
driven_lanedir_max0.2397300056472842
driven_lanedir_mean0.2397300056472842
driven_lanedir_median0.2397300056472842
driven_lanedir_min0.2397300056472842
in-drivable-lane_max18.900000000000233
in-drivable-lane_mean18.900000000000233
in-drivable-lane_min18.900000000000233
per-episodes
details{"udem-000-ego0": {"driven_any": 7.161071358405415, "survival_time": 28.850000000000275, "driven_lanedir": 0.2397300056472842, "in-drivable-lane": 18.900000000000233, "deviation-heading": 7.706889663126838, "distance-from-start": 0.8626308120701125, "deviation-center-line": 0.8659891122281899, "driven_lanedir_consec": 0.25774306587044116}}
simulation-passed1
survival_time_max28.850000000000275
survival_time_mean28.850000000000275
survival_time_min28.850000000000275
No reset possible
153751481Bea Baselines 🐤template-randomaido-LFI-sim-validationsim-1of4successnodavinci-stage-03-6.2.510:04:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median20.70000000000016
in-drivable-lane_median12.150000000000135
driven_lanedir_consec_median0.2718508044257806
deviation-center-line_median0.7655525719315331


other stats
deviation-center-line_max0.7655525719315331
deviation-center-line_mean0.7655525719315331
deviation-center-line_min0.7655525719315331
deviation-heading_max5.708723015945327
deviation-heading_mean5.708723015945327
deviation-heading_median5.708723015945327
deviation-heading_min5.708723015945327
distance-from-start_max0.7357883576773756
distance-from-start_mean0.7357883576773756
distance-from-start_median0.7357883576773756
distance-from-start_min0.7357883576773756
driven_any_max5.001991003394682
driven_any_mean5.001991003394682
driven_any_median5.001991003394682
driven_any_min5.001991003394682
driven_lanedir_consec_max0.2718508044257806
driven_lanedir_consec_mean0.2718508044257806
driven_lanedir_consec_min0.2718508044257806
driven_lanedir_max0.2538357176450212
driven_lanedir_mean0.2538357176450212
driven_lanedir_median0.2538357176450212
driven_lanedir_min0.2538357176450212
in-drivable-lane_max12.150000000000135
in-drivable-lane_mean12.150000000000135
in-drivable-lane_min12.150000000000135
per-episodes
details{"udem1-000-ego0": {"driven_any": 5.001991003394682, "survival_time": 20.70000000000016, "driven_lanedir": 0.2538357176450212, "in-drivable-lane": 12.150000000000135, "deviation-heading": 5.708723015945327, "distance-from-start": 0.7357883576773756, "deviation-center-line": 0.7655525719315331, "driven_lanedir_consec": 0.2718508044257806}}
simulation-passed1
survival_time_max20.70000000000016
survival_time_mean20.70000000000016
survival_time_min20.70000000000016
No reset possible
153671484Bea Baselines 🐤template-randomaido-LFV_multi-sim-validationsim-1of4successnodavinci-stage-03-6.2.510:19:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.64999999999875
in-drivable-lane_median52.39999999999873
driven_lanedir_consec_median0.20841941457351276
deviation-center-line_median0.6235918393283303


other stats
deviation-center-line_max3.9618906351925345
deviation-center-line_mean1.3480922472158894
deviation-center-line_min0.18329467501436195
deviation-heading_max29.06091202107619
deviation-heading_mean10.086526110865954
deviation-heading_median4.852439390352202
deviation-heading_min1.5803136416832215
distance-from-start_max1.390232809724702
distance-from-start_mean0.8610879612709739
distance-from-start_median0.7658648678412762
distance-from-start_min0.5223892996766412
driven_any_max14.859731274916312
driven_any_mean6.788261723046844
driven_any_median5.402007576921902
driven_any_min1.4893004634272606
driven_lanedir_consec_max0.4727232702196713
driven_lanedir_consec_mean0.24835079061387844
driven_lanedir_consec_min0.10384106308881692
driven_lanedir_max0.4727232702196713
driven_lanedir_mean0.2405349726449092
driven_lanedir_median0.19278777863557428
driven_lanedir_min0.10384106308881692
in-drivable-lane_max57.149999999998755
in-drivable-lane_mean41.13749999999905
in-drivable-lane_min2.599999999999994
per-episodes
details{"loop-000-ego0": {"driven_any": 14.859731274916312, "survival_time": 59.64999999999875, "driven_lanedir": 0.2521152682910448, "in-drivable-lane": 50.49999999999872, "deviation-heading": 6.675380463416964, "distance-from-start": 1.390232809724702, "deviation-center-line": 0.8041846674982114, "driven_lanedir_consec": 0.2701303550718044}, "loop-000-ego1": {"driven_any": 1.4893004634272606, "survival_time": 59.64999999999875, "driven_lanedir": 0.4727232702196713, "in-drivable-lane": 2.599999999999994, "deviation-heading": 29.06091202107619, "distance-from-start": 0.5223892996766412, "deviation-center-line": 3.9618906351925345, "driven_lanedir_consec": 0.4727232702196713}, "loop-000-ego2": {"driven_any": 9.314714690416322, "survival_time": 59.64999999999875, "driven_lanedir": 0.13346028898010376, "in-drivable-lane": 54.29999999999873, "deviation-heading": 3.0294983172874397, "distance-from-start": 1.0093404360059108, "deviation-center-line": 0.4429990111584493, "driven_lanedir_consec": 0.14670847407522114}, "loop-000-ego3": {"driven_any": 1.4893004634274822, "survival_time": 59.64999999999875, "driven_lanedir": 0.10384106308881692, "in-drivable-lane": 57.149999999998755, "deviation-heading": 1.5803136416832215, "distance-from-start": 0.5223892996766415, "deviation-center-line": 0.18329467501436195, "driven_lanedir_consec": 0.10384106308881692}}
simulation-passed1
survival_time_max59.64999999999875
survival_time_mean59.64999999999875
survival_time_min59.64999999999875
No reset possible
153581487Bea Baselines 🐤template-randomlx22-objdetsimsuccessyesdavinci-stage-03-6.2.510:12:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median54.49999999999904
driven_lanedir_consec_median0.26709798212212443


other stats
deviation-center-line_max1.037569790997506
deviation-center-line_mean0.8435604085256779
deviation-center-line_median0.8435604085256779
deviation-center-line_min0.64955102605385
deviation-heading_max4.206744090268851
deviation-heading_mean4.053028283662815
deviation-heading_median4.053028283662815
deviation-heading_min3.899312477056781
distance-from-start_max1.4108418329398793
distance-from-start_mean1.2742348024332677
distance-from-start_median1.2742348024332677
distance-from-start_min1.1376277719266563
driven_any_max15.326310847370594
driven_any_mean13.855133975004188
driven_any_median13.855133975004188
driven_any_min12.38395710263778
driven_lanedir_consec_max0.46522399883077714
driven_lanedir_consec_mean0.26709798212212443
driven_lanedir_consec_min0.06897196541347173
driven_lanedir_max0.4443159195617077
driven_lanedir_mean0.24618990285305495
driven_lanedir_median0.24618990285305495
driven_lanedir_min0.04806388614440227
in-drivable-lane_max53.699999999998695
in-drivable-lane_mean46.67499999999907
in-drivable-lane_median46.67499999999907
in-drivable-lane_min39.64999999999946
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 15.326310847370594, "survival_time": 59.99999999999873, "driven_lanedir": 0.4443159195617077, "in-drivable-lane": 53.699999999998695, "deviation-heading": 3.899312477056781, "distance-from-start": 1.4108418329398793, "deviation-center-line": 0.64955102605385, "driven_lanedir_consec": 0.46522399883077714}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 12.38395710263778, "survival_time": 48.99999999999935, "driven_lanedir": 0.04806388614440227, "in-drivable-lane": 39.64999999999946, "deviation-heading": 4.206744090268851, "distance-from-start": 1.1376277719266563, "deviation-center-line": 1.037569790997506, "driven_lanedir_consec": 0.06897196541347173}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean54.49999999999904
survival_time_min48.99999999999935
No reset possible
153541490Bea Baselines 🐤template-randomlx22-BV1sim-1of5successnodavinci-stage-03-6.2.510:02:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.6297514211538973


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.6297514211538973
distance-from-start_median0.6297514211538973
distance-from-start_min0.6297514211538973
driven_any_max3.022989906942301
driven_any_mean3.022989906942301
driven_any_median3.022989906942301
driven_any_min3.022989906942301
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max12.850000000000048
in-drivable-lane_mean12.850000000000048
in-drivable-lane_median12.850000000000048
in-drivable-lane_min12.850000000000048
per-episodes
details{"d45-ego0": {"driven_any": 3.022989906942301, "survival_time": 12.850000000000048, "driven_lanedir": 0.0, "in-drivable-lane": 12.850000000000048, "deviation-heading": 0.0, "distance-from-start": 0.6297514211538973, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max12.850000000000048
survival_time_mean12.850000000000048
survival_time_median12.850000000000048
survival_time_min12.850000000000048
No reset possible
153521490Bea Baselines 🐤template-randomlx22-BV1sim-0of5successnodavinci-stage-03-6.2.510:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.4028556303039808


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.4028556303039808
distance-from-start_median0.4028556303039808
distance-from-start_min0.4028556303039808
driven_any_max0.4240764502839582
driven_any_mean0.4240764502839582
driven_any_median0.4240764502839582
driven_any_min0.4240764502839582
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max3.7499999999999942
in-drivable-lane_mean3.7499999999999942
in-drivable-lane_median3.7499999999999942
in-drivable-lane_min3.7499999999999942
per-episodes
details{"d30-ego0": {"driven_any": 0.4240764502839582, "survival_time": 3.7499999999999942, "driven_lanedir": 0.0, "in-drivable-lane": 3.7499999999999942, "deviation-heading": 0.0, "distance-from-start": 0.4028556303039808, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max3.7499999999999942
survival_time_mean3.7499999999999942
survival_time_median3.7499999999999942
survival_time_min3.7499999999999942
No reset possible
153481497Bea Baselines 🐤template-randomaido-LFV-sim-testingsim-1of4successnodavinci-stage-03-6.2.510:06:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median27.70000000000026
in-drivable-lane_median21.450000000000205
driven_lanedir_consec_median0.012425607873532307
deviation-center-line_median0.5849703367275559


other stats
deviation-center-line_max0.5849703367275559
deviation-center-line_mean0.5849703367275559
deviation-center-line_min0.5849703367275559
deviation-heading_max4.775258728877611
deviation-heading_mean4.775258728877611
deviation-heading_median4.775258728877611
deviation-heading_min4.775258728877611
distance-from-start_max0.7960980578537297
distance-from-start_mean0.7960980578537297
distance-from-start_median0.7960980578537297
distance-from-start_min0.7960980578537297
driven_any_max6.63545554755722
driven_any_mean6.63545554755722
driven_any_median6.63545554755722
driven_any_min6.63545554755722
driven_lanedir_consec_max0.012425607873532307
driven_lanedir_consec_mean0.012425607873532307
driven_lanedir_consec_min0.012425607873532307
driven_lanedir_max0.01577326127428158
driven_lanedir_mean0.01577326127428158
driven_lanedir_median0.01577326127428158
driven_lanedir_min0.01577326127428158
in-drivable-lane_max21.450000000000205
in-drivable-lane_mean21.450000000000205
in-drivable-lane_min21.450000000000205
per-episodes
details{"loop-000-ego0": {"driven_any": 6.63545554755722, "survival_time": 27.70000000000026, "driven_lanedir": 0.01577326127428158, "in-drivable-lane": 21.450000000000205, "deviation-heading": 4.775258728877611, "distance-from-start": 0.7960980578537297, "deviation-center-line": 0.5849703367275559, "driven_lanedir_consec": 0.012425607873532307}}
simulation-passed1
survival_time_max27.70000000000026
survival_time_mean27.70000000000026
survival_time_min27.70000000000026
No reset possible
153401499Bea Baselines 🐤template-randomaido-LFI-sim-testingsim-1of4successnodavinci-stage-03-6.2.510:04:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median24.450000000000212
in-drivable-lane_median17.850000000000154
driven_lanedir_consec_median0.050146904256652025
deviation-center-line_median0.5014783130439592


other stats
deviation-center-line_max0.5014783130439592
deviation-center-line_mean0.5014783130439592
deviation-center-line_min0.5014783130439592
deviation-heading_max5.174156496722106
deviation-heading_mean5.174156496722106
deviation-heading_median5.174156496722106
deviation-heading_min5.174156496722106
distance-from-start_max0.796098057853711
distance-from-start_mean0.796098057853711
distance-from-start_median0.796098057853711
distance-from-start_min0.796098057853711
driven_any_max5.895396370035972
driven_any_mean5.895396370035972
driven_any_median5.895396370035972
driven_any_min5.895396370035972
driven_lanedir_consec_max0.050146904256652025
driven_lanedir_consec_mean0.050146904256652025
driven_lanedir_consec_min0.050146904256652025
driven_lanedir_max0.053494557657393305
driven_lanedir_mean0.053494557657393305
driven_lanedir_median0.053494557657393305
driven_lanedir_min0.053494557657393305
in-drivable-lane_max17.850000000000154
in-drivable-lane_mean17.850000000000154
in-drivable-lane_min17.850000000000154
per-episodes
details{"udem1-000-ego0": {"driven_any": 5.895396370035972, "survival_time": 24.450000000000212, "driven_lanedir": 0.053494557657393305, "in-drivable-lane": 17.850000000000154, "deviation-heading": 5.174156496722106, "distance-from-start": 0.796098057853711, "deviation-center-line": 0.5014783130439592, "driven_lanedir_consec": 0.050146904256652025}}
simulation-passed1
survival_time_max24.450000000000212
survival_time_mean24.450000000000212
survival_time_min24.450000000000212
No reset possible
153371500Bea Baselines 🐤template-randomaido-LF-sim-testingsim-0of4successnodavinci-stage-03-6.2.510:02:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.029483020207996535
survival_time_median11.450000000000028
deviation-center-line_median0.32684152243677644
in-drivable-lane_median8.000000000000016


other stats
deviation-center-line_max0.32684152243677644
deviation-center-line_mean0.32684152243677644
deviation-center-line_min0.32684152243677644
deviation-heading_max2.5488727326530465
deviation-heading_mean2.5488727326530465
deviation-heading_median2.5488727326530465
deviation-heading_min2.5488727326530465
distance-from-start_max0.5461575079396548
distance-from-start_mean0.5461575079396548
distance-from-start_median0.5461575079396548
distance-from-start_min0.5461575079396548
driven_any_max2.3519174817467863
driven_any_mean2.3519174817467863
driven_any_median2.3519174817467863
driven_any_min2.3519174817467863
driven_lanedir_consec_max0.029483020207996535
driven_lanedir_consec_mean0.029483020207996535
driven_lanedir_consec_min0.029483020207996535
driven_lanedir_max0.03283067360874581
driven_lanedir_mean0.03283067360874581
driven_lanedir_median0.03283067360874581
driven_lanedir_min0.03283067360874581
in-drivable-lane_max8.000000000000016
in-drivable-lane_mean8.000000000000016
in-drivable-lane_min8.000000000000016
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.3519174817467863, "survival_time": 11.450000000000028, "driven_lanedir": 0.03283067360874581, "in-drivable-lane": 8.000000000000016, "deviation-heading": 2.5488727326530465, "distance-from-start": 0.5461575079396548, "deviation-center-line": 0.32684152243677644, "driven_lanedir_consec": 0.029483020207996535}}
simulation-passed1
survival_time_max11.450000000000028
survival_time_mean11.450000000000028
survival_time_min11.450000000000028
No reset possible
153341500Bea Baselines 🐤template-randomaido-LF-sim-testingsim-1of4successnodavinci-stage-03-6.2.510:04:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.24555746228952957
survival_time_median39.24999999999991
deviation-center-line_median1.3919847015555789
in-drivable-lane_median25.24999999999981


other stats
deviation-center-line_max1.3919847015555789
deviation-center-line_mean1.3919847015555789
deviation-center-line_min1.3919847015555789
deviation-heading_max9.906601177812297
deviation-heading_mean9.906601177812297
deviation-heading_median9.906601177812297
deviation-heading_min9.906601177812297
distance-from-start_max1.0093404360059268
distance-from-start_mean1.0093404360059268
distance-from-start_median1.0093404360059268
distance-from-start_min1.0093404360059268
driven_any_max9.462416332537492
driven_any_mean9.462416332537492
driven_any_median9.462416332537492
driven_any_min9.462416332537492
driven_lanedir_consec_max0.24555746228952957
driven_lanedir_consec_mean0.24555746228952957
driven_lanedir_consec_min0.24555746228952957
driven_lanedir_max0.2358197494342854
driven_lanedir_mean0.2358197494342854
driven_lanedir_median0.2358197494342854
driven_lanedir_min0.2358197494342854
in-drivable-lane_max25.24999999999981
in-drivable-lane_mean25.24999999999981
in-drivable-lane_min25.24999999999981
per-episodes
details{"loop-000-ego0": {"driven_any": 9.462416332537492, "survival_time": 39.24999999999991, "driven_lanedir": 0.2358197494342854, "in-drivable-lane": 25.24999999999981, "deviation-heading": 9.906601177812297, "distance-from-start": 1.0093404360059268, "deviation-center-line": 1.3919847015555789, "driven_lanedir_consec": 0.24555746228952957}}
simulation-passed1
survival_time_max39.24999999999991
survival_time_mean39.24999999999991
survival_time_min39.24999999999991
No reset possible
153331501Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-03-6.2.510:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
153261502Bea Baselines 🐤template-randomaido-LFV_multi-sim-testingsim-0of4successnodavinci-stage-03-6.2.510:16:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median44.399999999999615
in-drivable-lane_median36.89999999999958
driven_lanedir_consec_median0.16636007500288152
deviation-center-line_median0.6465381124900755


other stats
deviation-center-line_max3.843921290582837
deviation-center-line_mean1.365959723489658
deviation-center-line_min0.3268413783956437
deviation-heading_max34.73068339720075
deviation-heading_mean11.863967459268938
deviation-heading_median5.088156815887916
deviation-heading_min2.548872808099167
distance-from-start_max1.0442247976691943
distance-from-start_mean0.7726084491662092
distance-from-start_median0.7348495479070991
distance-from-start_min0.5765099031814445
driven_any_max11.02110496898546
driven_any_mean5.960730691438496
driven_any_median5.132220528138905
driven_any_min2.5573767404907164
driven_lanedir_consec_max0.2424977297667874
driven_lanedir_consec_mean0.1511732098444039
driven_lanedir_consec_min0.029474959605065187
driven_lanedir_max0.22840118579828728
driven_lanedir_mean0.13782421614551926
driven_lanedir_median0.14503534079604596
driven_lanedir_min0.03282499719169785
in-drivable-lane_max40.949999999999605
in-drivable-lane_mean31.049999999999716
in-drivable-lane_min9.450000000000106
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.5573767404907164, "survival_time": 44.399999999999615, "driven_lanedir": 0.03282499719169785, "in-drivable-lane": 40.949999999999605, "deviation-heading": 2.548872808099167, "distance-from-start": 0.5765099031814445, "deviation-center-line": 0.3268413783956437, "driven_lanedir_consec": 0.029474959605065187}, "autolab-000-ego1": {"driven_any": 4.1683236267102375, "survival_time": 44.399999999999615, "driven_lanedir": 0.22840118579828728, "in-drivable-lane": 9.450000000000106, "deviation-heading": 34.73068339720075, "distance-from-start": 0.6736010379604851, "deviation-center-line": 3.843921290582837, "driven_lanedir_consec": 0.2424977297667874}, "autolab-000-ego2": {"driven_any": 11.02110496898546, "survival_time": 44.399999999999615, "driven_lanedir": 0.13091508050074063, "in-drivable-lane": 37.59999999999958, "deviation-heading": 3.900775995746317, "distance-from-start": 1.0442247976691943, "deviation-center-line": 0.686307068420695, "driven_lanedir_consec": 0.15293047772426194}, "autolab-000-ego3": {"driven_any": 6.096117429567572, "survival_time": 44.399999999999615, "driven_lanedir": 0.1591556010913513, "in-drivable-lane": 36.19999999999958, "deviation-heading": 6.275537636029516, "distance-from-start": 0.7960980578537132, "deviation-center-line": 0.6067691565594562, "driven_lanedir_consec": 0.1797896722815011}}
simulation-passed1
survival_time_max44.399999999999615
survival_time_mean44.399999999999615
survival_time_min44.399999999999615
No reset possible
153211503Bea Baselines 🐤template-randomaido-LFP-sim-testingsim-0of4successnodavinci-stage-03-6.2.510:02:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.94999999999998
in-drivable-lane_median5.549999999999983
driven_lanedir_consec_median0.020891462039611675
deviation-center-line_median0.16974575483481455


other stats
deviation-center-line_max0.16974575483481455
deviation-center-line_mean0.16974575483481455
deviation-center-line_min0.16974575483481455
deviation-heading_max1.6654350665682798
deviation-heading_mean1.6654350665682798
deviation-heading_median1.6654350665682798
deviation-heading_min1.6654350665682798
distance-from-start_max0.5351951936475464
distance-from-start_mean0.5351951936475464
distance-from-start_median0.5351951936475464
distance-from-start_min0.5351951936475464
driven_any_max1.5709859611218706
driven_any_mean1.5709859611218706
driven_any_median1.5709859611218706
driven_any_min1.5709859611218706
driven_lanedir_consec_max0.020891462039611675
driven_lanedir_consec_mean0.020891462039611675
driven_lanedir_consec_min0.020891462039611675
driven_lanedir_max0.020891462039611675
driven_lanedir_mean0.020891462039611675
driven_lanedir_median0.020891462039611675
driven_lanedir_min0.020891462039611675
in-drivable-lane_max5.549999999999983
in-drivable-lane_mean5.549999999999983
in-drivable-lane_min5.549999999999983
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.5709859611218706, "survival_time": 7.94999999999998, "driven_lanedir": 0.020891462039611675, "in-drivable-lane": 5.549999999999983, "deviation-heading": 1.6654350665682798, "distance-from-start": 0.5351951936475464, "deviation-center-line": 0.16974575483481455, "driven_lanedir_consec": 0.020891462039611675}}
simulation-passed1
survival_time_max7.94999999999998
survival_time_mean7.94999999999998
survival_time_min7.94999999999998
No reset possible
153171505Bea Baselines 🐤template-rosaido-LFVI-sim-validationsim-2of4successnodavinci-stage-03-6.2.510:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
153131506Bea Baselines 🐤template-rosaido-LFI-sim-validationsim-2of4successnodavinci-stage-03-6.2.510:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
153041508Bea Baselines 🐤template-rosaido-LFVI_multi-sim-validationsim-0of4successnodavinci-stage-03-6.2.510:04:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.549999999999986
in-drivable-lane_median6.249999999999989
driven_lanedir_consec_median0.5260499934418864
deviation-center-line_median0.20119946559073723


other stats
deviation-center-line_max0.334677994098822
deviation-center-line_mean0.2046368928519749
deviation-center-line_min0.08147064612760313
deviation-heading_max1.390534387876176
deviation-heading_mean0.859325047941333
deviation-heading_median0.7495454898319036
deviation-heading_min0.5476748242253484
distance-from-start_max2.214860576995327
distance-from-start_mean1.1275196030945454
distance-from-start_median0.957909822204885
distance-from-start_min0.3793981909730845
driven_any_max2.2683994733864203
driven_any_mean1.1436306839168675
driven_any_median0.9629349929649792
driven_any_min0.3802532763510908
driven_lanedir_consec_max0.9256153333007432
driven_lanedir_consec_mean0.5432852393167469
driven_lanedir_consec_min0.1954256370824714
driven_lanedir_max0.9256153333007432
driven_lanedir_mean0.5473175854842066
driven_lanedir_median0.5341146857768059
driven_lanedir_min0.1954256370824714
in-drivable-lane_max7.399999999999986
in-drivable-lane_mean6.2499999999999885
in-drivable-lane_min5.099999999999991
per-episodes
details{"udem-000-ego0": {"driven_any": 0.3802532763510908, "survival_time": 8.549999999999986, "driven_lanedir": 0.21896239468593404, "in-drivable-lane": 7.399999999999986, "deviation-heading": 0.6059510827797092, "distance-from-start": 0.3793981909730845, "deviation-center-line": 0.08147064612760313, "driven_lanedir_consec": 0.21896239468593404}, "udem-000-ego1": {"driven_any": 0.7125947031469251, "survival_time": 8.549999999999986, "driven_lanedir": 0.1954256370824714, "in-drivable-lane": 7.349999999999986, "deviation-heading": 0.5476748242253484, "distance-from-start": 0.7114127845117173, "deviation-center-line": 0.11642962840947498, "driven_lanedir_consec": 0.1954256370824714}, "udem-000-ego2": {"driven_any": 1.213275282783033, "survival_time": 8.549999999999986, "driven_lanedir": 0.9256153333007432, "in-drivable-lane": 5.099999999999991, "deviation-heading": 0.893139896884098, "distance-from-start": 1.2044068598980526, "deviation-center-line": 0.2859693027719995, "driven_lanedir_consec": 0.9256153333007432}, "udem-000-ego3": {"driven_any": 2.2683994733864203, "survival_time": 8.549999999999986, "driven_lanedir": 0.8492669768676777, "in-drivable-lane": 5.1499999999999915, "deviation-heading": 1.390534387876176, "distance-from-start": 2.214860576995327, "deviation-center-line": 0.334677994098822, "driven_lanedir_consec": 0.8331375921978388}}
simulation-passed1
survival_time_max8.549999999999986
survival_time_mean8.549999999999986
survival_time_min8.549999999999986
No reset possible
153021508Bea Baselines 🐤template-rosaido-LFVI_multi-sim-validationsim-3of4successnodavinci-stage-03-6.2.510:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
152971510Bea Baselines 🐤template-rosaido-LFP-sim-validationsim-3of4successnodavinci-stage-03-6.2.510:01:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.2499999999999964
in-drivable-lane_median2.349999999999996
driven_lanedir_consec_median0.12008659740675036
deviation-center-line_median0.0451209961421012


other stats
deviation-center-line_max0.0451209961421012
deviation-center-line_mean0.0451209961421012
deviation-center-line_min0.0451209961421012
deviation-heading_max0.6306694543776076
deviation-heading_mean0.6306694543776076
deviation-heading_median0.6306694543776076
deviation-heading_min0.6306694543776076
distance-from-start_max0.5881328049306841
distance-from-start_mean0.5881328049306841
distance-from-start_median0.5881328049306841
distance-from-start_min0.5881328049306841
driven_any_max0.6193186677043458
driven_any_mean0.6193186677043458
driven_any_median0.6193186677043458
driven_any_min0.6193186677043458
driven_lanedir_consec_max0.12008659740675036
driven_lanedir_consec_mean0.12008659740675036
driven_lanedir_consec_min0.12008659740675036
driven_lanedir_max0.12008659740675036
driven_lanedir_mean0.12008659740675036
driven_lanedir_median0.12008659740675036
driven_lanedir_min0.12008659740675036
in-drivable-lane_max2.349999999999996
in-drivable-lane_mean2.349999999999996
in-drivable-lane_min2.349999999999996
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.6193186677043458, "survival_time": 3.2499999999999964, "driven_lanedir": 0.12008659740675036, "in-drivable-lane": 2.349999999999996, "deviation-heading": 0.6306694543776076, "distance-from-start": 0.5881328049306841, "deviation-center-line": 0.0451209961421012, "driven_lanedir_consec": 0.12008659740675036}}
simulation-passed1
survival_time_max3.2499999999999964
survival_time_mean3.2499999999999964
survival_time_min3.2499999999999964
No reset possible
152941510Bea Baselines 🐤template-rosaido-LFP-sim-validationsim-2of4successnodavinci-stage-03-6.2.510:01:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.849999999999998
in-drivable-lane_median1.8499999999999976
driven_lanedir_consec_median0.18180388911794895
deviation-center-line_median0.06203251013273742


other stats
deviation-center-line_max0.06203251013273742
deviation-center-line_mean0.06203251013273742
deviation-center-line_min0.06203251013273742
deviation-heading_max0.5933644354313745
deviation-heading_mean0.5933644354313745
deviation-heading_median0.5933644354313745
deviation-heading_min0.5933644354313745
distance-from-start_max0.5956048087253367
distance-from-start_mean0.5956048087253367
distance-from-start_median0.5956048087253367
distance-from-start_min0.5956048087253367
driven_any_max0.5987261431153381
driven_any_mean0.5987261431153381
driven_any_median0.5987261431153381
driven_any_min0.5987261431153381
driven_lanedir_consec_max0.18180388911794895
driven_lanedir_consec_mean0.18180388911794895
driven_lanedir_consec_min0.18180388911794895
driven_lanedir_max0.18180388911794895
driven_lanedir_mean0.18180388911794895
driven_lanedir_median0.18180388911794895
driven_lanedir_min0.18180388911794895
in-drivable-lane_max1.8499999999999976
in-drivable-lane_mean1.8499999999999976
in-drivable-lane_min1.8499999999999976
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.5987261431153381, "survival_time": 2.849999999999998, "driven_lanedir": 0.18180388911794895, "in-drivable-lane": 1.8499999999999976, "deviation-heading": 0.5933644354313745, "distance-from-start": 0.5956048087253367, "deviation-center-line": 0.06203251013273742, "driven_lanedir_consec": 0.18180388911794895}}
simulation-passed1
survival_time_max2.849999999999998
survival_time_mean2.849999999999998
survival_time_min2.849999999999998
No reset possible
152871515Bea Baselines 🐤template-roslx22-BV1sim-0of5successnodavinci-stage-03-6.2.510:02:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.997772662320364


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.997772662320364
distance-from-start_median4.997772662320364
distance-from-start_min4.997772662320364
driven_any_max6.060703602282261
driven_any_mean6.060703602282261
driven_any_median6.060703602282261
driven_any_min6.060703602282261
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max21.45000000000017
in-drivable-lane_mean21.45000000000017
in-drivable-lane_median21.45000000000017
in-drivable-lane_min21.45000000000017
per-episodes
details{"d30-ego0": {"driven_any": 6.060703602282261, "survival_time": 21.45000000000017, "driven_lanedir": 0.0, "in-drivable-lane": 21.45000000000017, "deviation-heading": 0.0, "distance-from-start": 4.997772662320364, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max21.45000000000017
survival_time_mean21.45000000000017
survival_time_median21.45000000000017
survival_time_min21.45000000000017
No reset possible
152831522Bea Baselines 🐤template-rosaido-LFV-sim-testingsim-1of4successnodavinci-stage-03-6.2.510:02:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.399999999999982
in-drivable-lane_median6.4499999999999815
driven_lanedir_consec_median0.16530060974893024
deviation-center-line_median0.06775994046003851


other stats
deviation-center-line_max0.06775994046003851
deviation-center-line_mean0.06775994046003851
deviation-center-line_min0.06775994046003851
deviation-heading_max0.5761932938947714
deviation-heading_mean0.5761932938947714
deviation-heading_median0.5761932938947714
deviation-heading_min0.5761932938947714
distance-from-start_max1.871633076081343
distance-from-start_mean1.871633076081343
distance-from-start_median1.871633076081343
distance-from-start_min1.871633076081343
driven_any_max1.8993577545200295
driven_any_mean1.8993577545200295
driven_any_median1.8993577545200295
driven_any_min1.8993577545200295
driven_lanedir_consec_max0.16530060974893024
driven_lanedir_consec_mean0.16530060974893024
driven_lanedir_consec_min0.16530060974893024
driven_lanedir_max0.16530060974893024
driven_lanedir_mean0.16530060974893024
driven_lanedir_median0.16530060974893024
driven_lanedir_min0.16530060974893024
in-drivable-lane_max6.4499999999999815
in-drivable-lane_mean6.4499999999999815
in-drivable-lane_min6.4499999999999815
per-episodes
details{"loop-000-ego0": {"driven_any": 1.8993577545200295, "survival_time": 7.399999999999982, "driven_lanedir": 0.16530060974893024, "in-drivable-lane": 6.4499999999999815, "deviation-heading": 0.5761932938947714, "distance-from-start": 1.871633076081343, "deviation-center-line": 0.06775994046003851, "driven_lanedir_consec": 0.16530060974893024}}
simulation-passed1
survival_time_max7.399999999999982
survival_time_mean7.399999999999982
survival_time_min7.399999999999982
No reset possible
152761523Bea Baselines 🐤template-rosaido-LFVI-sim-testingsim-1of4successnodavinci-stage-03-6.2.510:02:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.849999999999984
in-drivable-lane_median5.949999999999983
driven_lanedir_consec_median0.14034309441245463
deviation-center-line_median0.06233555880741286


other stats
deviation-center-line_max0.06233555880741286
deviation-center-line_mean0.06233555880741286
deviation-center-line_min0.06233555880741286
deviation-heading_max0.6042580044345098
deviation-heading_mean0.6042580044345098
deviation-heading_median0.6042580044345098
deviation-heading_min0.6042580044345098
distance-from-start_max1.6999539884225772
distance-from-start_mean1.6999539884225772
distance-from-start_median1.6999539884225772
distance-from-start_min1.6999539884225772
driven_any_max1.7327238267742102
driven_any_mean1.7327238267742102
driven_any_median1.7327238267742102
driven_any_min1.7327238267742102
driven_lanedir_consec_max0.14034309441245463
driven_lanedir_consec_mean0.14034309441245463
driven_lanedir_consec_min0.14034309441245463
driven_lanedir_max0.14034309441245463
driven_lanedir_mean0.14034309441245463
driven_lanedir_median0.14034309441245463
driven_lanedir_min0.14034309441245463
in-drivable-lane_max5.949999999999983
in-drivable-lane_mean5.949999999999983
in-drivable-lane_min5.949999999999983
per-episodes
details{"4way-000-ego0": {"driven_any": 1.7327238267742102, "survival_time": 6.849999999999984, "driven_lanedir": 0.14034309441245463, "in-drivable-lane": 5.949999999999983, "deviation-heading": 0.6042580044345098, "distance-from-start": 1.6999539884225772, "deviation-center-line": 0.06233555880741286, "driven_lanedir_consec": 0.14034309441245463}}
simulation-passed1
survival_time_max6.849999999999984
survival_time_mean6.849999999999984
survival_time_min6.849999999999984
No reset possible
152721525Bea Baselines 🐤template-rosaido-LF-sim-testingsim-2of4successnodavinci-stage-03-6.2.510:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.224986742259623
survival_time_median6.999999999999983
deviation-center-line_median0.14322886932730303
in-drivable-lane_median5.299999999999986


other stats
deviation-center-line_max0.14322886932730303
deviation-center-line_mean0.14322886932730303
deviation-center-line_min0.14322886932730303
deviation-heading_max1.5544072913919156
deviation-heading_mean1.5544072913919156
deviation-heading_median1.5544072913919156
deviation-heading_min1.5544072913919156
distance-from-start_max1.800777859915408
distance-from-start_mean1.800777859915408
distance-from-start_median1.800777859915408
distance-from-start_min1.800777859915408
driven_any_max1.8167325504447691
driven_any_mean1.8167325504447691
driven_any_median1.8167325504447691
driven_any_min1.8167325504447691
driven_lanedir_consec_max0.224986742259623
driven_lanedir_consec_mean0.224986742259623
driven_lanedir_consec_min0.224986742259623
driven_lanedir_max0.224986742259623
driven_lanedir_mean0.224986742259623
driven_lanedir_median0.224986742259623
driven_lanedir_min0.224986742259623
in-drivable-lane_max5.299999999999986
in-drivable-lane_mean5.299999999999986
in-drivable-lane_min5.299999999999986
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.8167325504447691, "survival_time": 6.999999999999983, "driven_lanedir": 0.224986742259623, "in-drivable-lane": 5.299999999999986, "deviation-heading": 1.5544072913919156, "distance-from-start": 1.800777859915408, "deviation-center-line": 0.14322886932730303, "driven_lanedir_consec": 0.224986742259623}}
simulation-passed1
survival_time_max6.999999999999983
survival_time_mean6.999999999999983
survival_time_min6.999999999999983
No reset possible
152651526Bea Baselines 🐤template-rosaido-LFVI_multi-sim-testingsim-0of4successnodavinci-stage-03-6.2.510:04:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.400000000000013
in-drivable-lane_median7.325000000000015
driven_lanedir_consec_median0.5553563311597431
deviation-center-line_median0.1838731730027661


other stats
deviation-center-line_max1.2258335973675265
deviation-center-line_mean0.4150455354118808
deviation-center-line_min0.06660219827446462
deviation-heading_max6.065343459203177
deviation-heading_mean2.2656734976932107
deviation-heading_median1.2901767480401112
deviation-heading_min0.41699703548944234
distance-from-start_max2.890924589090496
distance-from-start_mean1.419074017731938
distance-from-start_median1.2835284912462364
distance-from-start_min0.21831449934478248
driven_any_max3.0144240140143737
driven_any_mean1.4849479093064677
driven_any_median1.353123951644537
driven_any_min0.21911971992242296
driven_lanedir_consec_max0.906591809656884
driven_lanedir_consec_mean0.5317213827366949
driven_lanedir_consec_min0.1095810589704096
driven_lanedir_max0.906591809656884
driven_lanedir_mean0.5317213827366949
driven_lanedir_median0.5553563311597431
driven_lanedir_min0.1095810589704096
in-drivable-lane_max9.650000000000013
in-drivable-lane_mean6.3125000000000115
in-drivable-lane_min0.9500000000000008
per-episodes
details{"udem-000-ego0": {"driven_any": 0.8894928423024814, "survival_time": 10.400000000000013, "driven_lanedir": 0.5461657636765018, "in-drivable-lane": 0.9500000000000008, "deviation-heading": 6.065343459203177, "distance-from-start": 0.8052663318123509, "deviation-center-line": 1.2258335973675265, "driven_lanedir_consec": 0.5461657636765018}, "udem-000-ego1": {"driven_any": 3.0144240140143737, "survival_time": 10.400000000000013, "driven_lanedir": 0.906591809656884, "in-drivable-lane": 6.600000000000018, "deviation-heading": 2.092469905523512, "distance-from-start": 2.890924589090496, "deviation-center-line": 0.2880084404550441, "driven_lanedir_consec": 0.906591809656884}, "udem-000-ego2": {"driven_any": 1.8167550609865928, "survival_time": 10.400000000000013, "driven_lanedir": 0.5645468986429845, "in-drivable-lane": 8.050000000000013, "deviation-heading": 0.41699703548944234, "distance-from-start": 1.761790650680122, "deviation-center-line": 0.07973790555048803, "driven_lanedir_consec": 0.5645468986429845}, "udem-000-ego3": {"driven_any": 0.21911971992242296, "survival_time": 10.400000000000013, "driven_lanedir": 0.1095810589704096, "in-drivable-lane": 9.650000000000013, "deviation-heading": 0.4878835905567104, "distance-from-start": 0.21831449934478248, "deviation-center-line": 0.06660219827446462, "driven_lanedir_consec": 0.1095810589704096}}
simulation-passed1
survival_time_max10.400000000000013
survival_time_mean10.400000000000013
survival_time_min10.400000000000013
No reset possible
152591527Bea Baselines 🐤template-rosaido-LFV_multi-sim-testingsim-2of4successnodavinci-stage-03-6.2.510:02:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.349999999999984
in-drivable-lane_median6.699999999999985
driven_lanedir_consec_median0.31194351664702125
deviation-center-line_median0.14815233178588855


other stats
deviation-center-line_max0.18943051157838184
deviation-center-line_mean0.14815233178588855
deviation-center-line_min0.10687415199339528
deviation-heading_max1.2014267664391736
deviation-heading_mean0.9254469398581257
deviation-heading_median0.9254469398581257
deviation-heading_min0.6494671132770777
distance-from-start_max2.1462992047293024
distance-from-start_mean1.8989280960128432
distance-from-start_median1.8989280960128432
distance-from-start_min1.6515569872963844
driven_any_max2.234171410023607
driven_any_mean1.9624970713444672
driven_any_median1.9624970713444672
driven_any_min1.6908227326653276
driven_lanedir_consec_max0.3757429133103321
driven_lanedir_consec_mean0.31194351664702125
driven_lanedir_consec_min0.24814411998371044
driven_lanedir_max0.3757429133103321
driven_lanedir_mean0.31194351664702125
driven_lanedir_median0.31194351664702125
driven_lanedir_min0.24814411998371044
in-drivable-lane_max6.999999999999983
in-drivable-lane_mean6.699999999999985
in-drivable-lane_min6.399999999999987
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.6908227326653276, "survival_time": 8.349999999999984, "driven_lanedir": 0.24814411998371044, "in-drivable-lane": 6.999999999999983, "deviation-heading": 0.6494671132770777, "distance-from-start": 1.6515569872963844, "deviation-center-line": 0.10687415199339528, "driven_lanedir_consec": 0.24814411998371044}, "loop2-000-ego1": {"driven_any": 2.234171410023607, "survival_time": 8.349999999999984, "driven_lanedir": 0.3757429133103321, "in-drivable-lane": 6.399999999999987, "deviation-heading": 1.2014267664391736, "distance-from-start": 2.1462992047293024, "deviation-center-line": 0.18943051157838184, "driven_lanedir_consec": 0.3757429133103321}}
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean8.349999999999984
survival_time_min8.349999999999984
No reset possible
152551529Bea Baselines 🐤template-tensorflowaido-LFV-sim-validationsim-0of4failednodavinci-stage-03-6.2.510:01:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
152501530Bea Baselines 🐤template-tensorflowaido-LFVI-sim-validationsim-1of4failednodavinci-stage-03-6.2.510:01:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
152451531Bea Baselines 🐤template-tensorflowaido-LFI-sim-validationsim-3of4successnodavinci-stage-03-6.2.510:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
152401532Bea Baselines 🐤template-tensorflowaido-LF-sim-validationsim-3of4failednodavinci-stage-03-6.2.510:01:00
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
152351533Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-validationsim-0of4failednodavinci-stage-03-6.2.510:01:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
152321535Bea Baselines 🐤template-tensorflowaido-LFP-sim-validationsim-0of4failednodavinci-stage-03-6.2.510:00:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
152251535Bea Baselines 🐤template-tensorflowaido-LFP-sim-validationsim-1of4failednodavinci-stage-03-6.2.510:00:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
152201540Bea Baselines 🐤template-tensorflowlx22-BV1sim-4of5failednodavinci-stage-03-6.2.510:00:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
152171540Bea Baselines 🐤template-tensorflowlx22-BV1sim-1of5failednodavinci-stage-03-6.2.510:01:03
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
152121547Bea Baselines 🐤template-tensorflowaido-LFV-sim-testingsim-0of4failednodavinci-stage-03-6.2.510:01:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
152071548Bea Baselines 🐤template-tensorflowaido-LFVI-sim-testingsim-2of4successnodavinci-stage-03-6.2.510:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
152031550Bea Baselines 🐤template-tensorflowaido-LF-sim-testingsim-3of4failednodavinci-stage-03-6.2.510:01:00
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
151991551Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-testingsim-0of4failednodavinci-stage-03-6.2.510:01:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
151941552Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-testingsim-1of4failednodavinci-stage-03-6.2.510:01:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
151921553Bea Baselines 🐤template-tensorflowaido-LFP-sim-testingsim-3of4failednodavinci-stage-03-6.2.510:01:17
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
151871369Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-testingsim-0of4successnodavinci-stage-03-6.2.510:04:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.699999999999984
in-drivable-lane_median0.0
driven_lanedir_consec_median0.5870086052428155
deviation-center-line_median0.2666145991209239


other stats
deviation-center-line_max0.2666145991209239
deviation-center-line_mean0.2666145991209239
deviation-center-line_min0.2666145991209239
deviation-heading_max1.6312868879707314
deviation-heading_mean1.6312868879707314
deviation-heading_median1.6312868879707314
deviation-heading_min1.6312868879707314
distance-from-start_max0.6088681695022287
distance-from-start_mean0.6088681695022287
distance-from-start_median0.6088681695022287
distance-from-start_min0.6088681695022287
driven_any_max0.7381571900619482
driven_any_mean0.7381571900619482
driven_any_median0.7381571900619482
driven_any_min0.7381571900619482
driven_lanedir_consec_max0.5870086052428155
driven_lanedir_consec_mean0.5870086052428155
driven_lanedir_consec_min0.5870086052428155
driven_lanedir_max0.7163377349593194
driven_lanedir_mean0.7163377349593194
driven_lanedir_median0.7163377349593194
driven_lanedir_min0.7163377349593194
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 0.7381571900619482, "survival_time": 6.699999999999984, "driven_lanedir": 0.7163377349593194, "in-drivable-lane": 0.0, "deviation-heading": 1.6312868879707314, "distance-from-start": 0.6088681695022287, "deviation-center-line": 0.2666145991209239, "driven_lanedir_consec": 0.5870086052428155}}
simulation-passed1
survival_time_max6.699999999999984
survival_time_mean6.699999999999984
survival_time_min6.699999999999984
No reset possible
151831293Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-0of4abortednodavinci-stage-03-6.2.510:01:38
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1302, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 749, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
151791294Bea Baselines 🐤template-randomaido-LFV_multi-sim-testingsim-2of4successnodavinci-stage-03-6.2.510:07:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median44.99999999999958
in-drivable-lane_median39.249999999999574
driven_lanedir_consec_median0.1329316137267978
deviation-center-line_median0.4769519451920501


other stats
deviation-center-line_max0.627148077892518
deviation-center-line_mean0.4769519451920501
deviation-center-line_min0.3267558124915822
deviation-heading_max4.173256858222429
deviation-heading_mean3.3650961945019375
deviation-heading_median3.3650961945019375
deviation-heading_min2.5569355307814456
distance-from-start_max1.0442247976691823
distance-from-start_mean0.7951911528044138
distance-from-start_median0.7951911528044138
distance-from-start_min0.5461575079396452
driven_any_max11.349124250612952
driven_any_mean6.923556868843365
driven_any_median6.923556868843365
driven_any_min2.497989487073778
driven_lanedir_consec_max0.2397940766790495
driven_lanedir_consec_mean0.1329316137267978
driven_lanedir_consec_min0.02606915077454608
driven_lanedir_max0.2256600500204217
driven_lanedir_mean0.1275377118421561
driven_lanedir_median0.1275377118421561
driven_lanedir_min0.029415373663890465
in-drivable-lane_max41.54999999999957
in-drivable-lane_mean39.249999999999574
in-drivable-lane_min36.94999999999958
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.497989487073778, "survival_time": 44.99999999999958, "driven_lanedir": 0.029415373663890465, "in-drivable-lane": 41.54999999999957, "deviation-heading": 2.5569355307814456, "distance-from-start": 0.5461575079396452, "deviation-center-line": 0.3267558124915822, "driven_lanedir_consec": 0.02606915077454608}, "loop2-000-ego1": {"driven_any": 11.349124250612952, "survival_time": 44.99999999999958, "driven_lanedir": 0.2256600500204217, "in-drivable-lane": 36.94999999999958, "deviation-heading": 4.173256858222429, "distance-from-start": 1.0442247976691823, "deviation-center-line": 0.627148077892518, "driven_lanedir_consec": 0.2397940766790495}}
simulation-passed1
survival_time_max44.99999999999958
survival_time_mean44.99999999999958
survival_time_min44.99999999999958
No reset possible
15171397Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-testingsim-0of4successnodavinci-stage-03-6.2.510:07:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-2.980675798258526
survival_time_median59.99999999999873
deviation-center-line_median1.6637876864642946
in-drivable-lane_median22.09999999999952


other stats
deviation-center-line_max1.6637876864642946
deviation-center-line_mean1.6637876864642946
deviation-center-line_min1.6637876864642946
deviation-heading_max30.795731684839257
deviation-heading_mean30.795731684839257
deviation-heading_median30.795731684839257
deviation-heading_min30.795731684839257
distance-from-start_max0.15168812422450223
distance-from-start_mean0.15168812422450223
distance-from-start_median0.15168812422450223
distance-from-start_min0.15168812422450223
driven_any_max11.044601005967774
driven_any_mean11.044601005967774
driven_any_median11.044601005967774
driven_any_min11.044601005967774
driven_lanedir_consec_max-2.980675798258526
driven_lanedir_consec_mean-2.980675798258526
driven_lanedir_consec_min-2.980675798258526
driven_lanedir_max-2.980675798258526
driven_lanedir_mean-2.980675798258526
driven_lanedir_median-2.980675798258526
driven_lanedir_min-2.980675798258526
in-drivable-lane_max22.09999999999952
in-drivable-lane_mean22.09999999999952
in-drivable-lane_min22.09999999999952
per-episodes
details{"autolab-000-ego0": {"driven_any": 11.044601005967774, "survival_time": 59.99999999999873, "driven_lanedir": -2.980675798258526, "in-drivable-lane": 22.09999999999952, "deviation-heading": 30.795731684839257, "distance-from-start": 0.15168812422450223, "deviation-center-line": 1.6637876864642946, "driven_lanedir_consec": -2.980675798258526}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
151651268Bea Baselines 🐤template-randomaido-LFVI-sim-validationsim-0of4successnodavinci-stage-03-6.2.510:08:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median28.850000000000275
in-drivable-lane_median18.900000000000233
driven_lanedir_consec_median0.25774306587044116
deviation-center-line_median0.8659891122281899


other stats
deviation-center-line_max0.8659891122281899
deviation-center-line_mean0.8659891122281899
deviation-center-line_min0.8659891122281899
deviation-heading_max7.706889663126838
deviation-heading_mean7.706889663126838
deviation-heading_median7.706889663126838
deviation-heading_min7.706889663126838
distance-from-start_max0.8626308120701125
distance-from-start_mean0.8626308120701125
distance-from-start_median0.8626308120701125
distance-from-start_min0.8626308120701125
driven_any_max7.161071358405415
driven_any_mean7.161071358405415
driven_any_median7.161071358405415
driven_any_min7.161071358405415
driven_lanedir_consec_max0.25774306587044116
driven_lanedir_consec_mean0.25774306587044116
driven_lanedir_consec_min0.25774306587044116
driven_lanedir_max0.2397300056472842
driven_lanedir_mean0.2397300056472842
driven_lanedir_median0.2397300056472842
driven_lanedir_min0.2397300056472842
in-drivable-lane_max18.900000000000233
in-drivable-lane_mean18.900000000000233
in-drivable-lane_min18.900000000000233
per-episodes
details{"udem-000-ego0": {"driven_any": 7.161071358405415, "survival_time": 28.850000000000275, "driven_lanedir": 0.2397300056472842, "in-drivable-lane": 18.900000000000233, "deviation-heading": 7.706889663126838, "distance-from-start": 0.8626308120701125, "deviation-center-line": 0.8659891122281899, "driven_lanedir_consec": 0.25774306587044116}}
simulation-passed1
survival_time_max28.850000000000275
survival_time_mean28.850000000000275
survival_time_min28.850000000000275
No reset possible
151621269Bea Baselines 🐤template-randomaido-LFI-sim-validationsim-1of4successnodavinci-stage-03-6.2.510:03:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median20.70000000000016
in-drivable-lane_median12.150000000000135
driven_lanedir_consec_median0.2718508044257806
deviation-center-line_median0.7655525719315331


other stats
deviation-center-line_max0.7655525719315331
deviation-center-line_mean0.7655525719315331
deviation-center-line_min0.7655525719315331
deviation-heading_max5.708723015945327
deviation-heading_mean5.708723015945327
deviation-heading_median5.708723015945327
deviation-heading_min5.708723015945327
distance-from-start_max0.7357883576773756
distance-from-start_mean0.7357883576773756
distance-from-start_median0.7357883576773756
distance-from-start_min0.7357883576773756
driven_any_max5.001991003394682
driven_any_mean5.001991003394682
driven_any_median5.001991003394682
driven_any_min5.001991003394682
driven_lanedir_consec_max0.2718508044257806
driven_lanedir_consec_mean0.2718508044257806
driven_lanedir_consec_min0.2718508044257806
driven_lanedir_max0.2538357176450212
driven_lanedir_mean0.2538357176450212
driven_lanedir_median0.2538357176450212
driven_lanedir_min0.2538357176450212
in-drivable-lane_max12.150000000000135
in-drivable-lane_mean12.150000000000135
in-drivable-lane_min12.150000000000135
per-episodes
details{"udem1-000-ego0": {"driven_any": 5.001991003394682, "survival_time": 20.70000000000016, "driven_lanedir": 0.2538357176450212, "in-drivable-lane": 12.150000000000135, "deviation-heading": 5.708723015945327, "distance-from-start": 0.7357883576773756, "deviation-center-line": 0.7655525719315331, "driven_lanedir_consec": 0.2718508044257806}}
simulation-passed1
survival_time_max20.70000000000016
survival_time_mean20.70000000000016
survival_time_min20.70000000000016
No reset possible
151521272Bea Baselines 🐤template-randomaido-LFV_multi-sim-validationsim-1of4successnodavinci-stage-03-6.2.510:18:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.64999999999875
in-drivable-lane_median52.39999999999873
driven_lanedir_consec_median0.20841941457351276
deviation-center-line_median0.6235918393283303


other stats
deviation-center-line_max3.9618906351925345
deviation-center-line_mean1.3480922472158894
deviation-center-line_min0.18329467501436195
deviation-heading_max29.06091202107619
deviation-heading_mean10.086526110865954
deviation-heading_median4.852439390352202
deviation-heading_min1.5803136416832215
distance-from-start_max1.390232809724702
distance-from-start_mean0.8610879612709739
distance-from-start_median0.7658648678412762
distance-from-start_min0.5223892996766412
driven_any_max14.859731274916312
driven_any_mean6.788261723046844
driven_any_median5.402007576921902
driven_any_min1.4893004634272606
driven_lanedir_consec_max0.4727232702196713
driven_lanedir_consec_mean0.24835079061387844
driven_lanedir_consec_min0.10384106308881692
driven_lanedir_max0.4727232702196713
driven_lanedir_mean0.2405349726449092
driven_lanedir_median0.19278777863557428
driven_lanedir_min0.10384106308881692
in-drivable-lane_max57.149999999998755
in-drivable-lane_mean41.13749999999905
in-drivable-lane_min2.599999999999994
per-episodes
details{"loop-000-ego0": {"driven_any": 14.859731274916312, "survival_time": 59.64999999999875, "driven_lanedir": 0.2521152682910448, "in-drivable-lane": 50.49999999999872, "deviation-heading": 6.675380463416964, "distance-from-start": 1.390232809724702, "deviation-center-line": 0.8041846674982114, "driven_lanedir_consec": 0.2701303550718044}, "loop-000-ego1": {"driven_any": 1.4893004634272606, "survival_time": 59.64999999999875, "driven_lanedir": 0.4727232702196713, "in-drivable-lane": 2.599999999999994, "deviation-heading": 29.06091202107619, "distance-from-start": 0.5223892996766412, "deviation-center-line": 3.9618906351925345, "driven_lanedir_consec": 0.4727232702196713}, "loop-000-ego2": {"driven_any": 9.314714690416322, "survival_time": 59.64999999999875, "driven_lanedir": 0.13346028898010376, "in-drivable-lane": 54.29999999999873, "deviation-heading": 3.0294983172874397, "distance-from-start": 1.0093404360059108, "deviation-center-line": 0.4429990111584493, "driven_lanedir_consec": 0.14670847407522114}, "loop-000-ego3": {"driven_any": 1.4893004634274822, "survival_time": 59.64999999999875, "driven_lanedir": 0.10384106308881692, "in-drivable-lane": 57.149999999998755, "deviation-heading": 1.5803136416832215, "distance-from-start": 0.5223892996766415, "deviation-center-line": 0.18329467501436195, "driven_lanedir_consec": 0.10384106308881692}}
simulation-passed1
survival_time_max59.64999999999875
survival_time_mean59.64999999999875
survival_time_min59.64999999999875
No reset possible
151471267Bea Baselines 🐤template-randomaido-LFV-sim-validationsim-0of4successnodavinci-stage-03-6.2.510:03:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.699999999999995
in-drivable-lane_median0.9
driven_lanedir_consec_median0.364506838392066
deviation-center-line_median0.14696541332404583


other stats
deviation-center-line_max0.14696541332404583
deviation-center-line_mean0.14696541332404583
deviation-center-line_min0.14696541332404583
deviation-heading_max1.6699264400950062
deviation-heading_mean1.6699264400950062
deviation-heading_median1.6699264400950062
deviation-heading_min1.6699264400950062
distance-from-start_max0.3743806210373658
distance-from-start_mean0.3743806210373658
distance-from-start_median0.3743806210373658
distance-from-start_min0.3743806210373658
driven_any_max0.3944302398862539
driven_any_mean0.3944302398862539
driven_any_median0.3944302398862539
driven_any_min0.3944302398862539
driven_lanedir_consec_max0.364506838392066
driven_lanedir_consec_mean0.364506838392066
driven_lanedir_consec_min0.364506838392066
driven_lanedir_max0.364506838392066
driven_lanedir_mean0.364506838392066
driven_lanedir_median0.364506838392066
driven_lanedir_min0.364506838392066
in-drivable-lane_max0.9
in-drivable-lane_mean0.9
in-drivable-lane_min0.9
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.3944302398862539, "survival_time": 3.699999999999995, "driven_lanedir": 0.364506838392066, "in-drivable-lane": 0.9, "deviation-heading": 1.6699264400950062, "distance-from-start": 0.3743806210373658, "deviation-center-line": 0.14696541332404583, "driven_lanedir_consec": 0.364506838392066}}
simulation-passed1
survival_time_max3.699999999999995
survival_time_mean3.699999999999995
survival_time_min3.699999999999995
No reset possible
15143783Andrea Danieletemplate-randomaido-LF-sim-validationsim-0of4successnodavinci-stage-03-6.2.510:03:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2718401947993705
survival_time_median27.70000000000026
deviation-center-line_median0.7655517188189105
in-drivable-lane_median19.150000000000237


other stats
deviation-center-line_max0.7655517188189105
deviation-center-line_mean0.7655517188189105
deviation-center-line_min0.7655517188189105
deviation-heading_max5.708723015945327
deviation-heading_mean5.708723015945327
deviation-heading_median5.708723015945327
deviation-heading_min5.708723015945327
distance-from-start_max0.7960980578537302
distance-from-start_mean0.7960980578537302
distance-from-start_median0.7960980578537302
distance-from-start_min0.7960980578537302
driven_any_max6.635455547557208
driven_any_mean6.635455547557208
driven_any_median6.635455547557208
driven_any_min6.635455547557208
driven_lanedir_consec_max0.2718401947993705
driven_lanedir_consec_mean0.2718401947993705
driven_lanedir_consec_min0.2718401947993705
driven_lanedir_max0.25382904192484634
driven_lanedir_mean0.25382904192484634
driven_lanedir_median0.25382904192484634
driven_lanedir_min0.25382904192484634
in-drivable-lane_max19.150000000000237
in-drivable-lane_mean19.150000000000237
in-drivable-lane_min19.150000000000237
per-episodes
details{"autolab-000-ego0": {"driven_any": 6.635455547557208, "survival_time": 27.70000000000026, "driven_lanedir": 0.25382904192484634, "in-drivable-lane": 19.150000000000237, "deviation-heading": 5.708723015945327, "distance-from-start": 0.7960980578537302, "deviation-center-line": 0.7655517188189105, "driven_lanedir_consec": 0.2718401947993705}}
simulation-passed1
survival_time_max27.70000000000026
survival_time_mean27.70000000000026
survival_time_min27.70000000000026
No reset possible
15133789Andrea Danieletemplate-pytorchaido-LF-sim-validationsim-2of4successnodavinci-stage-03-6.2.510:07:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2229326785931809
survival_time_median59.99999999999873
deviation-center-line_median1.6228660537526909
in-drivable-lane_median44.149999999998855


other stats
deviation-center-line_max1.6228660537526909
deviation-center-line_mean1.6228660537526909
deviation-center-line_min1.6228660537526909
deviation-heading_max15.083872892584283
deviation-heading_mean15.083872892584283
deviation-heading_median15.083872892584283
deviation-heading_min15.083872892584283
distance-from-start_max0.38017612525006017
distance-from-start_mean0.38017612525006017
distance-from-start_median0.38017612525006017
distance-from-start_min0.38017612525006017
driven_any_max10.338707703249035
driven_any_mean10.338707703249035
driven_any_median10.338707703249035
driven_any_min10.338707703249035
driven_lanedir_consec_max1.2229326785931809
driven_lanedir_consec_mean1.2229326785931809
driven_lanedir_consec_min1.2229326785931809
driven_lanedir_max1.4531324494592168
driven_lanedir_mean1.4531324494592168
driven_lanedir_median1.4531324494592168
driven_lanedir_min1.4531324494592168
in-drivable-lane_max44.149999999998855
in-drivable-lane_mean44.149999999998855
in-drivable-lane_min44.149999999998855
per-episodes
details{"loop2-000-ego0": {"driven_any": 10.338707703249035, "survival_time": 59.99999999999873, "driven_lanedir": 1.4531324494592168, "in-drivable-lane": 44.149999999998855, "deviation-heading": 15.083872892584283, "distance-from-start": 0.38017612525006017, "deviation-center-line": 1.6228660537526909, "driven_lanedir_consec": 1.2229326785931809}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
151261270Bea Baselines 🐤template-randomaido-LF-sim-validationsim-0of4successnodavinci-stage-03-6.2.510:04:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2718401947993705
survival_time_median27.70000000000026
deviation-center-line_median0.7655517188189105
in-drivable-lane_median19.150000000000237


other stats
deviation-center-line_max0.7655517188189105
deviation-center-line_mean0.7655517188189105
deviation-center-line_min0.7655517188189105
deviation-heading_max5.708723015945327
deviation-heading_mean5.708723015945327
deviation-heading_median5.708723015945327
deviation-heading_min5.708723015945327
distance-from-start_max0.7960980578537302
distance-from-start_mean0.7960980578537302
distance-from-start_median0.7960980578537302
distance-from-start_min0.7960980578537302
driven_any_max6.635455547557208
driven_any_mean6.635455547557208
driven_any_median6.635455547557208
driven_any_min6.635455547557208
driven_lanedir_consec_max0.2718401947993705
driven_lanedir_consec_mean0.2718401947993705
driven_lanedir_consec_min0.2718401947993705
driven_lanedir_max0.25382904192484634
driven_lanedir_mean0.25382904192484634
driven_lanedir_median0.25382904192484634
driven_lanedir_min0.25382904192484634
in-drivable-lane_max19.150000000000237
in-drivable-lane_mean19.150000000000237
in-drivable-lane_min19.150000000000237
per-episodes
details{"autolab-000-ego0": {"driven_any": 6.635455547557208, "survival_time": 27.70000000000026, "driven_lanedir": 0.25382904192484634, "in-drivable-lane": 19.150000000000237, "deviation-heading": 5.708723015945327, "distance-from-start": 0.7960980578537302, "deviation-center-line": 0.7655517188189105, "driven_lanedir_consec": 0.2718401947993705}}
simulation-passed1
survival_time_max27.70000000000026
survival_time_mean27.70000000000026
survival_time_min27.70000000000026
No reset possible
150621297Andrea Censicollision-check-exerciselx22-collision-check-valistep1host-erroryesdavinci-stage-03-6.2.510:00:43
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.41/images/create?tag=2022_11_24_17_26_06&fromImage=registry-stage2.duckietown.org%2Fandreacensi%2Faido-submissions

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 93, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 429, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.ImageNotFound: 404 Client Error for http+docker://localhost/v1.41/images/create?tag=2022_11_24_17_26_06&fromImage=registry-stage2.duckietown.org%2Fandreacensi%2Faido-submissions: Not Found ("pull access denied for registry-stage2.duckietown.org/andreacensi/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 112, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  registry-stage2.duckietown.org/andreacensi/aido-submissions@sha256:840e7105f36db90b5d37324bdcab451125a96c2e8b8f5c02658293c659de9b5d  tag  2022_11_24_17_26_06

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 51, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull registry-stage2.duckietown.org/andreacensi/aido-submissions:2022_11_24_17_26_06@sha256:840e7105f36db90b5d37324bdcab451125a96c2e8b8f5c02658293c659de9b5d
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible