Duckietown Challenges Home Challenges Submissions

Evaluator 57

ID57
evaluatorArchimede-stage-03
owneruser1000001
machineArchimede-stage
processArchimede-stage-03
version6.2.43
first heard
last heard
statusinactive
# evaluating
# success27 7936
# timeout1 8083
# failed3 7930
# error
# aborted2 8062
# host-error
arm0
x86_641
Mac0
gpu available1
Number of processors40
Processor frequency (MHz)2.1 GHz
Free % of processors78%
RAM total (MB)376.6 GB
RAM free (MB)271.1 GB
Disk (MB)74209.1 GB
Disk available (MB)63556.5 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, ETH_small_intersect
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
8083882Bea Baselines 🐤template-randomaido-LFV-sim-validationsim-0of4timeoutnoArchimede-stage-03----No reset possible
8079883Bea Baselines 🐤template-tensorflowaido-LFV-sim-validationsim-3of4failednoArchimede-stage-030:02:19
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8074884Bea Baselines 🐤template-rosaido-LF-sim-validationsim-3of4successnoArchimede-stage-030:02:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.18802929720025308
survival_time_median5.649999999999988
deviation-center-line_median0.06547256444852217
in-drivable-lane_median4.599999999999988


other stats
deviation-center-line_max0.06547256444852217
deviation-center-line_mean0.06547256444852217
deviation-center-line_min0.06547256444852217
deviation-heading_max0.6039235570725672
deviation-heading_mean0.6039235570725672
deviation-heading_median0.6039235570725672
deviation-heading_min0.6039235570725672
distance-from-start_max1.3046494570153535
distance-from-start_mean1.3046494570153535
distance-from-start_median1.3046494570153535
distance-from-start_min1.3046494570153535
driven_any_max1.3921409246269638
driven_any_mean1.3921409246269638
driven_any_median1.3921409246269638
driven_any_min1.3921409246269638
driven_lanedir_consec_max0.18802929720025308
driven_lanedir_consec_mean0.18802929720025308
driven_lanedir_consec_min0.18802929720025308
driven_lanedir_max0.18802929720025308
driven_lanedir_mean0.18802929720025308
driven_lanedir_median0.18802929720025308
driven_lanedir_min0.18802929720025308
in-drivable-lane_max4.599999999999988
in-drivable-lane_mean4.599999999999988
in-drivable-lane_min4.599999999999988
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.3921409246269638, "survival_time": 5.649999999999988, "driven_lanedir": 0.18802929720025308, "in-drivable-lane": 4.599999999999988, "deviation-heading": 0.6039235570725672, "distance-from-start": 1.3046494570153535, "deviation-center-line": 0.06547256444852217, "driven_lanedir_consec": 0.18802929720025308}}
simulation-passed1
survival_time_max5.649999999999988
survival_time_mean5.649999999999988
survival_time_min5.649999999999988
No reset possible
8068684Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-testingsim-0of4abortednoArchimede-stage-030:01:19
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1264, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 711, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8062686Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-testingsim-3of4abortednoArchimede-stage-030:06:40
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1264, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 711, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8056687Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-testingsim-2of4successnoArchimede-stage-030:07:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.406513421257873


other stats
deviation-center-line_max0.406513421257873
deviation-center-line_mean0.406513421257873
deviation-center-line_min0.406513421257873
deviation-heading_max40.967332753486225
deviation-heading_mean40.967332753486225
deviation-heading_median40.967332753486225
deviation-heading_min40.967332753486225
distance-from-start_max4.965068306494546e-16
distance-from-start_mean4.965068306494546e-16
distance-from-start_median4.965068306494546e-16
distance-from-start_min4.965068306494546e-16
driven_any_max5.95808196779335e-13
driven_any_mean5.95808196779335e-13
driven_any_median5.95808196779335e-13
driven_any_min5.95808196779335e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.406513421257873, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
8051717Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-validationsim-1of4successnoArchimede-stage-030:05:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.099999999999845
driven_lanedir_consec_median3.265534945442065
deviation-center-line_median7.114511298462666


other stats
deviation-center-line_max7.114511298462666
deviation-center-line_mean7.114511298462666
deviation-center-line_min7.114511298462666
deviation-heading_max5.702635614477716
deviation-heading_mean5.702635614477716
deviation-heading_median5.702635614477716
deviation-heading_min5.702635614477716
distance-from-start_max1.6303678378962243
distance-from-start_mean1.6303678378962243
distance-from-start_median1.6303678378962243
distance-from-start_min1.6303678378962243
driven_any_max3.4663369172893987
driven_any_mean3.4663369172893987
driven_any_median3.4663369172893987
driven_any_min3.4663369172893987
driven_lanedir_consec_max3.265534945442065
driven_lanedir_consec_mean3.265534945442065
driven_lanedir_consec_min3.265534945442065
driven_lanedir_max3.265534945442065
driven_lanedir_mean3.265534945442065
driven_lanedir_median3.265534945442065
driven_lanedir_min3.265534945442065
in-drivable-lane_max4.099999999999845
in-drivable-lane_mean4.099999999999845
in-drivable-lane_min4.099999999999845
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.4663369172893987, "survival_time": 59.99999999999873, "driven_lanedir": 3.265534945442065, "in-drivable-lane": 4.099999999999845, "deviation-heading": 5.702635614477716, "distance-from-start": 1.6303678378962243, "deviation-center-line": 7.114511298462666, "driven_lanedir_consec": 3.265534945442065}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
8049718Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-validationsim-3of4successnoArchimede-stage-030:01:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
8042719Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-validationsim-2of4successnoArchimede-stage-030:13:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.0999999999999377
driven_lanedir_consec_median2.9739039028570327
deviation-center-line_median3.987567693216043


other stats
deviation-center-line_max6.355354617390863
deviation-center-line_mean4.250566787221852
deviation-center-line_min2.67177714506446
deviation-heading_max6.378578140906584
deviation-heading_mean3.851864326637447
deviation-heading_median3.299904356446799
deviation-heading_min2.429070452749606
distance-from-start_max2.622846621511338
distance-from-start_mean1.9359200828092535
distance-from-start_median2.127382276630859
distance-from-start_min0.8660691564639582
driven_any_max3.5795837364261445
driven_any_mean3.0268033484995422
driven_any_median3.137096506981436
driven_any_min2.2534366436091524
driven_lanedir_consec_max3.483685068871533
driven_lanedir_consec_mean2.566865763583437
driven_lanedir_consec_min0.8359701797481495
driven_lanedir_max3.560636596432562
driven_lanedir_mean2.955289769471091
driven_lanedir_median3.0771837142917815
driven_lanedir_min2.1061550528682385
in-drivable-lane_max2.400000000000034
in-drivable-lane_mean1.1499999999999773
in-drivable-lane_min0.0
per-episodes
details{"4way-001-ego0": {"driven_any": 2.7275969188330973, "survival_time": 59.99999999999873, "driven_lanedir": 2.67068235971203, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.429070452749606, "distance-from-start": 2.261936693036538, "deviation-center-line": 4.511110206804874, "driven_lanedir_consec": 2.6706820218658365}, "4way-001-ego1": {"driven_any": 3.5795837364261445, "survival_time": 59.99999999999873, "driven_lanedir": 3.560636596432562, "in-drivable-lane": 0.0, "deviation-heading": 3.343516238791276, "distance-from-start": 1.992827860225181, "deviation-center-line": 2.67177714506446, "driven_lanedir_consec": 3.2771257838482284}, "4way-001-ego2": {"driven_any": 3.546596095129775, "survival_time": 59.99999999999873, "driven_lanedir": 3.483685068871533, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 3.256292474102322, "distance-from-start": 2.622846621511338, "deviation-center-line": 3.4640251796272117, "driven_lanedir_consec": 3.483685068871533}, "4way-001-ego3": {"driven_any": 2.2534366436091524, "survival_time": 59.99999999999873, "driven_lanedir": 2.1061550528682385, "in-drivable-lane": 2.400000000000034, "deviation-heading": 6.378578140906584, "distance-from-start": 0.8660691564639582, "deviation-center-line": 6.355354617390863, "driven_lanedir_consec": 0.8359701797481495}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
8037721Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-validation348successyesArchimede-stage-030:11:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.024999999999956
driven_lanedir_consec_median2.3543500771721333
deviation-center-line_median6.190490090892524


other stats
deviation-center-line_max7.342897133571408
deviation-center-line_mean5.815429151776418
deviation-center-line_min3.537839291749216
deviation-heading_max8.643847237807897
deviation-heading_mean5.76930803334383
deviation-heading_median5.4624178823709
deviation-heading_min3.5085491308256205
distance-from-start_max2.193280058841909
distance-from-start_mean1.7770214145879324
distance-from-start_median1.782212633108848
distance-from-start_min1.350380333292125
driven_any_max3.5195878597993744
driven_any_mean3.0189647101076136
driven_any_median3.3875880363680313
driven_any_min1.7810949078950165
driven_lanedir_consec_max3.321041772578862
driven_lanedir_consec_mean2.4282328710653815
driven_lanedir_consec_min1.6831895573383966
driven_lanedir_max3.387629211991127
driven_lanedir_mean2.883329810013805
driven_lanedir_median3.231250235362848
driven_lanedir_min1.6831895573383966
in-drivable-lane_max2.749999999999872
in-drivable-lane_mean2.162499999999953
in-drivable-lane_min1.8500000000000263
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.2780872163786823, "survival_time": 59.99999999999873, "driven_lanedir": 3.141458698146834, "in-drivable-lane": 2.0499999999998835, "deviation-heading": 5.2703183754430984, "distance-from-start": 2.193280058841909, "deviation-center-line": 3.537839291749216, "driven_lanedir_consec": 2.590440128989314}, "autolab-000-ego1": {"driven_any": 1.7810949078950165, "survival_time": 59.99999999999873, "driven_lanedir": 1.6831895573383966, "in-drivable-lane": 1.8500000000000263, "deviation-heading": 3.5085491308256205, "distance-from-start": 1.350380333292125, "deviation-center-line": 7.342897133571408, "driven_lanedir_consec": 1.6831895573383966}, "autolab-000-ego2": {"driven_any": 3.4970888563573808, "survival_time": 59.99999999999873, "driven_lanedir": 3.321041772578862, "in-drivable-lane": 2.749999999999872, "deviation-heading": 8.643847237807897, "distance-from-start": 2.062725630049209, "deviation-center-line": 5.639409156018586, "driven_lanedir_consec": 3.321041772578862}, "autolab-000-ego3": {"driven_any": 3.5195878597993744, "survival_time": 59.99999999999873, "driven_lanedir": 3.387629211991127, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.654517389298703, "distance-from-start": 1.501699636168487, "deviation-center-line": 6.741571025766462, "driven_lanedir_consec": 2.1182600253549526}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
8031722Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-validationsim-0of4successnoArchimede-stage-030:08:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median58.999999999998785
in-drivable-lane_median5.099999999999877
driven_lanedir_consec_median2.892079268568325
deviation-center-line_median5.68067401244577


other stats
deviation-center-line_max5.68067401244577
deviation-center-line_mean5.68067401244577
deviation-center-line_min5.68067401244577
deviation-heading_max11.303441083989476
deviation-heading_mean11.303441083989476
deviation-heading_median11.303441083989476
deviation-heading_min11.303441083989476
distance-from-start_max2.5229792435170997
distance-from-start_mean2.5229792435170997
distance-from-start_median2.5229792435170997
distance-from-start_min2.5229792435170997
driven_any_max3.3245754522162305
driven_any_mean3.3245754522162305
driven_any_median3.3245754522162305
driven_any_min3.3245754522162305
driven_lanedir_consec_max2.892079268568325
driven_lanedir_consec_mean2.892079268568325
driven_lanedir_consec_min2.892079268568325
driven_lanedir_max2.9981420962757213
driven_lanedir_mean2.9981420962757213
driven_lanedir_median2.9981420962757213
driven_lanedir_min2.9981420962757213
in-drivable-lane_max5.099999999999877
in-drivable-lane_mean5.099999999999877
in-drivable-lane_min5.099999999999877
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.3245754522162305, "survival_time": 58.999999999998785, "driven_lanedir": 2.9981420962757213, "in-drivable-lane": 5.099999999999877, "deviation-heading": 11.303441083989476, "distance-from-start": 2.5229792435170997, "deviation-center-line": 5.68067401244577, "driven_lanedir_consec": 2.892079268568325}}
simulation-passed1
survival_time_max58.999999999998785
survival_time_mean58.999999999998785
survival_time_min58.999999999998785
No reset possible
8029722Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-validationsim-2of4successnoArchimede-stage-030:02:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.399999999999984
in-drivable-lane_median0.0
driven_lanedir_consec_median0.43685686215365394
deviation-center-line_median0.2706641555037605


other stats
deviation-center-line_max0.2706641555037605
deviation-center-line_mean0.2706641555037605
deviation-center-line_min0.2706641555037605
deviation-heading_max0.7151185427551809
deviation-heading_mean0.7151185427551809
deviation-heading_median0.7151185427551809
deviation-heading_min0.7151185427551809
distance-from-start_max0.4379491769922931
distance-from-start_mean0.4379491769922931
distance-from-start_median0.4379491769922931
distance-from-start_min0.4379491769922931
driven_any_max0.4415992768886728
driven_any_mean0.4415992768886728
driven_any_median0.4415992768886728
driven_any_min0.4415992768886728
driven_lanedir_consec_max0.43685686215365394
driven_lanedir_consec_mean0.43685686215365394
driven_lanedir_consec_min0.43685686215365394
driven_lanedir_max0.43685686215365394
driven_lanedir_mean0.43685686215365394
driven_lanedir_median0.43685686215365394
driven_lanedir_min0.43685686215365394
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 0.4415992768886728, "survival_time": 8.399999999999984, "driven_lanedir": 0.43685686215365394, "in-drivable-lane": 0.0, "deviation-heading": 0.7151185427551809, "distance-from-start": 0.4379491769922931, "deviation-center-line": 0.2706641555037605, "driven_lanedir_consec": 0.43685686215365394}}
simulation-passed1
survival_time_max8.399999999999984
survival_time_mean8.399999999999984
survival_time_min8.399999999999984
No reset possible
8026724Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-testingsim-2of4successnoArchimede-stage-030:01:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
8020725Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-testingsim-2of4successnoArchimede-stage-030:13:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.5499999999999687
driven_lanedir_consec_median2.5521777999651367
deviation-center-line_median5.276797031290652


other stats
deviation-center-line_max6.817971565580157
deviation-center-line_mean5.2567873608638145
deviation-center-line_min3.655583815293795
deviation-heading_max6.563252471748053
deviation-heading_mean4.458256283671568
deviation-heading_median4.387903950884231
deviation-heading_min2.4939647611697566
distance-from-start_max2.3401405714912578
distance-from-start_mean1.678945179368026
distance-from-start_median1.7603022682051854
distance-from-start_min0.8550356095704745
driven_any_max3.579581939422362
driven_any_mean2.706590698244142
driven_any_median2.5925965173345773
driven_any_min2.061587818885054
driven_lanedir_consec_max3.258167265952898
driven_lanedir_consec_mean2.284883167375797
driven_lanedir_consec_min0.7770098036200156
driven_lanedir_max3.5632991203022852
driven_lanedir_mean2.65155918095966
driven_lanedir_median2.556825232069489
driven_lanedir_min1.9292871393973776
in-drivable-lane_max2.0000000000000284
in-drivable-lane_mean0.7749999999999915
in-drivable-lane_min0.0
per-episodes
details{"4way-001-ego0": {"driven_any": 2.8895969569657365, "survival_time": 59.99999999999873, "driven_lanedir": 2.833003826969273, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.4939647611697566, "distance-from-start": 2.3401405714912578, "deviation-center-line": 6.355081535980259, "driven_lanedir_consec": 2.833003826969273}, "4way-001-ego1": {"driven_any": 3.579581939422362, "survival_time": 59.99999999999873, "driven_lanedir": 3.5632991203022852, "in-drivable-lane": 0.0, "deviation-heading": 3.0789990866269132, "distance-from-start": 1.9674451050747892, "deviation-center-line": 3.655583815293795, "driven_lanedir_consec": 3.258167265952898}, "4way-001-ego2": {"driven_any": 2.061587818885054, "survival_time": 59.99999999999873, "driven_lanedir": 1.9292871393973776, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.696808815141548, "distance-from-start": 0.8550356095704745, "deviation-center-line": 6.817971565580157, "driven_lanedir_consec": 0.7770098036200156}, "4way-001-ego3": {"driven_any": 2.2955960777034177, "survival_time": 59.99999999999873, "driven_lanedir": 2.2806466371697045, "in-drivable-lane": 0.0, "deviation-heading": 6.563252471748053, "distance-from-start": 1.5531594313355817, "deviation-center-line": 4.198512526601045, "driven_lanedir_consec": 2.271351772961}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
8016726Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-testingsim-0of4successnoArchimede-stage-030:10:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median39.999999999999865
in-drivable-lane_median1.1000000000000156
driven_lanedir_consec_median2.247826541640637
deviation-center-line_median5.1521327769406415


other stats
deviation-center-line_max5.1521327769406415
deviation-center-line_mean5.1521327769406415
deviation-center-line_min5.1521327769406415
deviation-heading_max2.4955592650063254
deviation-heading_mean2.4955592650063254
deviation-heading_median2.4955592650063254
deviation-heading_min2.4955592650063254
distance-from-start_max1.7870695980324909
distance-from-start_mean1.7870695980324909
distance-from-start_median1.7870695980324909
distance-from-start_min1.7870695980324909
driven_any_max2.3045969519228993
driven_any_mean2.3045969519228993
driven_any_median2.3045969519228993
driven_any_min2.3045969519228993
driven_lanedir_consec_max2.247826541640637
driven_lanedir_consec_mean2.247826541640637
driven_lanedir_consec_min2.247826541640637
driven_lanedir_max2.247826541640637
driven_lanedir_mean2.247826541640637
driven_lanedir_median2.247826541640637
driven_lanedir_min2.247826541640637
in-drivable-lane_max1.1000000000000156
in-drivable-lane_mean1.1000000000000156
in-drivable-lane_min1.1000000000000156
per-episodes
details{"udem-001-ego0": {"driven_any": 2.3045969519228993, "survival_time": 39.999999999999865, "driven_lanedir": 2.247826541640637, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.4955592650063254, "distance-from-start": 1.7870695980324909, "deviation-center-line": 5.1521327769406415, "driven_lanedir_consec": 2.247826541640637}}
simulation-passed1
survival_time_max39.999999999999865
survival_time_mean39.999999999999865
survival_time_min39.999999999999865
No reset possible
8013727Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-testingsim-1of4successnoArchimede-stage-030:05:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.9499999999998447
driven_lanedir_consec_median3.2632395998669774
deviation-center-line_median6.920928875636815


other stats
deviation-center-line_max7.278875740496013
deviation-center-line_mean6.920928875636815
deviation-center-line_min6.562982010777615
deviation-heading_max6.398456490334182
deviation-heading_mean6.382402331687234
deviation-heading_median6.382402331687234
deviation-heading_min6.366348173040286
distance-from-start_max1.6564545386505578
distance-from-start_mean1.643956756540885
distance-from-start_median1.643956756540885
distance-from-start_min1.6314589744312122
driven_any_max3.471717690619401
driven_any_mean3.461153555093776
driven_any_median3.461153555093776
driven_any_min3.4505894195681512
driven_lanedir_consec_max3.288198932551972
driven_lanedir_consec_mean3.2632395998669774
driven_lanedir_consec_min3.238280267181983
driven_lanedir_max3.288198932551972
driven_lanedir_mean3.2632395998669774
driven_lanedir_median3.2632395998669774
driven_lanedir_min3.238280267181983
in-drivable-lane_max4.299999999999894
in-drivable-lane_mean3.9499999999998447
in-drivable-lane_min3.5999999999997954
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.471717690619401, "survival_time": 59.99999999999873, "driven_lanedir": 3.288198932551972, "in-drivable-lane": 3.5999999999997954, "deviation-heading": 6.366348173040286, "distance-from-start": 1.6314589744312122, "deviation-center-line": 6.562982010777615, "driven_lanedir_consec": 3.288198932551972}, "loop2-000-ego1": {"driven_any": 3.4505894195681512, "survival_time": 59.99999999999873, "driven_lanedir": 3.238280267181983, "in-drivable-lane": 4.299999999999894, "deviation-heading": 6.398456490334182, "distance-from-start": 1.6564545386505578, "deviation-center-line": 7.278875740496013, "driven_lanedir_consec": 3.238280267181983}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
8007728Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-2of4successnoArchimede-stage-030:12:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.1000000000000156
driven_lanedir_consec_median3.4856832599244276
deviation-center-line_median7.5149542302072865


other stats
deviation-center-line_max7.5149542302072865
deviation-center-line_mean7.5149542302072865
deviation-center-line_min7.5149542302072865
deviation-heading_max2.919832203938026
deviation-heading_mean2.919832203938026
deviation-heading_median2.919832203938026
deviation-heading_min2.919832203938026
distance-from-start_max2.876644168365493
distance-from-start_mean2.876644168365493
distance-from-start_median2.876644168365493
distance-from-start_min2.876644168365493
driven_any_max3.5465963271060996
driven_any_mean3.5465963271060996
driven_any_median3.5465963271060996
driven_any_min3.5465963271060996
driven_lanedir_consec_max3.4856832599244276
driven_lanedir_consec_mean3.4856832599244276
driven_lanedir_consec_min3.4856832599244276
driven_lanedir_max3.4856832599244276
driven_lanedir_mean3.4856832599244276
driven_lanedir_median3.4856832599244276
driven_lanedir_min3.4856832599244276
in-drivable-lane_max1.1000000000000156
in-drivable-lane_mean1.1000000000000156
in-drivable-lane_min1.1000000000000156
per-episodes
details{"loop-000-ego0": {"driven_any": 3.5465963271060996, "survival_time": 59.99999999999873, "driven_lanedir": 3.4856832599244276, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.919832203938026, "distance-from-start": 2.876644168365493, "deviation-center-line": 7.5149542302072865, "driven_lanedir_consec": 3.4856832599244276}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
8002729Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-testingsim-0of4successnoArchimede-stage-030:08:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.849999999999876
driven_lanedir_consec_median2.2261398227518057
deviation-center-line_median6.026388849207418


other stats
deviation-center-line_max6.026388849207418
deviation-center-line_mean6.026388849207418
deviation-center-line_min6.026388849207418
deviation-heading_max10.125115628768944
deviation-heading_mean10.125115628768944
deviation-heading_median10.125115628768944
deviation-heading_min10.125115628768944
distance-from-start_max1.712119374546537
distance-from-start_mean1.712119374546537
distance-from-start_median1.712119374546537
distance-from-start_min1.712119374546537
driven_any_max3.434227933985115
driven_any_mean3.434227933985115
driven_any_median3.434227933985115
driven_any_min3.434227933985115
driven_lanedir_consec_max2.2261398227518057
driven_lanedir_consec_mean2.2261398227518057
driven_lanedir_consec_min2.2261398227518057
driven_lanedir_max3.1490843804779587
driven_lanedir_mean3.1490843804779587
driven_lanedir_median3.1490843804779587
driven_lanedir_min3.1490843804779587
in-drivable-lane_max4.849999999999876
in-drivable-lane_mean4.849999999999876
in-drivable-lane_min4.849999999999876
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.434227933985115, "survival_time": 59.99999999999873, "driven_lanedir": 3.1490843804779587, "in-drivable-lane": 4.849999999999876, "deviation-heading": 10.125115628768944, "distance-from-start": 1.712119374546537, "deviation-center-line": 6.026388849207418, "driven_lanedir_consec": 2.2261398227518057}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7996689Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-validationsim-3of4successnoArchimede-stage-030:05:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.850000000000048
in-drivable-lane_median9.600000000000051
driven_lanedir_consec_median0.39597038108777993
deviation-center-line_median0.2727382860824792


other stats
deviation-center-line_max0.3711793675044237
deviation-center-line_mean0.2630700617566134
deviation-center-line_min0.13562430735707134
deviation-heading_max2.538350574804619
deviation-heading_mean1.5839275146709082
deviation-heading_median1.5305477977045596
deviation-heading_min0.7362638884698938
distance-from-start_max1.948694714107751
distance-from-start_mean1.6104892935753965
distance-from-start_median1.6878960391208713
distance-from-start_min1.1174703819520926
driven_any_max1.948851565778035
driven_any_mean1.6105973523255368
driven_any_median1.6880059043796614
driven_any_min1.117526034764789
driven_lanedir_consec_max0.6388965134401671
driven_lanedir_consec_mean0.39763340186260654
driven_lanedir_consec_min0.1596963318346993
driven_lanedir_max0.6388965134401671
driven_lanedir_mean0.39763340186260654
driven_lanedir_median0.39597038108777993
driven_lanedir_min0.1596963318346993
in-drivable-lane_max11.400000000000048
in-drivable-lane_mean9.612500000000054
in-drivable-lane_min7.850000000000057
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.948851565778035, "survival_time": 12.850000000000048, "driven_lanedir": 0.33122477082350965, "in-drivable-lane": 9.550000000000052, "deviation-heading": 2.538350574804619, "distance-from-start": 1.948694714107751, "deviation-center-line": 0.26973515872064796, "driven_lanedir_consec": 0.33122477082350965}, "autolab-000-ego1": {"driven_any": 1.117526034764789, "survival_time": 12.850000000000048, "driven_lanedir": 0.1596963318346993, "in-drivable-lane": 11.400000000000048, "deviation-heading": 0.7478094709473367, "distance-from-start": 1.1174703819520926, "deviation-center-line": 0.13562430735707134, "driven_lanedir_consec": 0.1596963318346993}, "autolab-000-ego2": {"driven_any": 1.6921542763567934, "survival_time": 12.850000000000048, "driven_lanedir": 0.6388965134401671, "in-drivable-lane": 7.850000000000057, "deviation-heading": 2.3132861244617824, "distance-from-start": 1.6920444051025412, "deviation-center-line": 0.3711793675044237, "driven_lanedir_consec": 0.6388965134401671}, "autolab-000-ego3": {"driven_any": 1.6838575324025296, "survival_time": 12.850000000000048, "driven_lanedir": 0.4607159913520502, "in-drivable-lane": 9.650000000000052, "deviation-heading": 0.7362638884698938, "distance-from-start": 1.6837476731392012, "deviation-center-line": 0.27574141344431047, "driven_lanedir_consec": 0.4607159913520502}}
simulation-passed1
survival_time_max12.850000000000048
survival_time_mean12.850000000000048
survival_time_min12.850000000000048
No reset possible
7992690Bea Baselines 🐤minimal-agentaido-LFP-sim-validationsim-3of4successnoArchimede-stage-030:02:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.449999999999985
in-drivable-lane_median4.699999999999984
driven_lanedir_consec_median0.1995452820775112
deviation-center-line_median0.1256753841610605


other stats
deviation-center-line_max0.1256753841610605
deviation-center-line_mean0.1256753841610605
deviation-center-line_min0.1256753841610605
deviation-heading_max0.948821955558047
deviation-heading_mean0.948821955558047
deviation-heading_median0.948821955558047
deviation-heading_min0.948821955558047
distance-from-start_max0.8933842387456702
distance-from-start_mean0.8933842387456702
distance-from-start_median0.8933842387456702
distance-from-start_min0.8933842387456702
driven_any_max0.8934060045503954
driven_any_mean0.8934060045503954
driven_any_median0.8934060045503954
driven_any_min0.8934060045503954
driven_lanedir_consec_max0.1995452820775112
driven_lanedir_consec_mean0.1995452820775112
driven_lanedir_consec_min0.1995452820775112
driven_lanedir_max0.1995452820775112
driven_lanedir_mean0.1995452820775112
driven_lanedir_median0.1995452820775112
driven_lanedir_min0.1995452820775112
in-drivable-lane_max4.699999999999984
in-drivable-lane_mean4.699999999999984
in-drivable-lane_min4.699999999999984
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.8934060045503954, "survival_time": 6.449999999999985, "driven_lanedir": 0.1995452820775112, "in-drivable-lane": 4.699999999999984, "deviation-heading": 0.948821955558047, "distance-from-start": 0.8933842387456702, "deviation-center-line": 0.1256753841610605, "driven_lanedir_consec": 0.1995452820775112}}
simulation-passed1
survival_time_max6.449999999999985
survival_time_mean6.449999999999985
survival_time_min6.449999999999985
No reset possible
7986691Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-0of4successnoArchimede-stage-030:04:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.499999999999986
in-drivable-lane_median6.749999999999985
driven_lanedir_consec_median0.1995523154256309
deviation-center-line_median0.12567533372177786


other stats
deviation-center-line_max0.12567533372177786
deviation-center-line_mean0.12567533372177786
deviation-center-line_min0.12567533372177786
deviation-heading_max0.948821955558047
deviation-heading_mean0.948821955558047
deviation-heading_median0.948821955558047
deviation-heading_min0.948821955558047
distance-from-start_max1.2330570688218754
distance-from-start_mean1.2330570688218754
distance-from-start_median1.2330570688218754
distance-from-start_min1.2330570688218754
driven_any_max1.2331286149593077
driven_any_mean1.2331286149593077
driven_any_median1.2331286149593077
driven_any_min1.2331286149593077
driven_lanedir_consec_max0.1995523154256309
driven_lanedir_consec_mean0.1995523154256309
driven_lanedir_consec_min0.1995523154256309
driven_lanedir_max0.1995523154256309
driven_lanedir_mean0.1995523154256309
driven_lanedir_median0.1995523154256309
driven_lanedir_min0.1995523154256309
in-drivable-lane_max6.749999999999985
in-drivable-lane_mean6.749999999999985
in-drivable-lane_min6.749999999999985
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.2331286149593077, "survival_time": 8.499999999999986, "driven_lanedir": 0.1995523154256309, "in-drivable-lane": 6.749999999999985, "deviation-heading": 0.948821955558047, "distance-from-start": 1.2330570688218754, "deviation-center-line": 0.12567533372177786, "driven_lanedir_consec": 0.1995523154256309}}
simulation-passed1
survival_time_max8.499999999999986
survival_time_mean8.499999999999986
survival_time_min8.499999999999986
No reset possible
7982692Bea Baselines 🐤minimal-agentaido-LFVI-sim-validationsim-2of4successnoArchimede-stage-030:01:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7972695Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-validationsim-0of4successnoArchimede-stage-030:06:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median14.250000000000068
in-drivable-lane_median11.000000000000073
driven_lanedir_consec_median0.3959648974606744
deviation-center-line_median0.27273836142376845


other stats
deviation-center-line_max0.3711792475699576
deviation-center-line_mean0.2630702395454934
deviation-center-line_min0.1356249877644792
deviation-heading_max2.538350574804619
deviation-heading_mean1.583927406158633
deviation-heading_median1.5305475806800095
deviation-heading_min0.7362638884698945
distance-from-start_max2.1822334065149938
distance-from-start_mean1.3494658762364464
distance-from-start_median1.4254146254446962
distance-from-start_min0.36480084754139935
driven_any_max2.182581278372633
driven_any_mean1.349596161599964
driven_any_median1.4254980882354609
driven_any_min0.36480719155630226
driven_lanedir_consec_max0.6388981877178178
driven_lanedir_consec_mean0.39763107861846647
driven_lanedir_consec_min0.1596963318346993
driven_lanedir_max0.6388981877178178
driven_lanedir_mean0.39763107861846647
driven_lanedir_median0.3959648974606744
driven_lanedir_min0.1596963318346993
in-drivable-lane_max12.800000000000068
in-drivable-lane_mean11.012500000000074
in-drivable-lane_min9.250000000000078
per-episodes
details{"4way-000-ego0": {"driven_any": 1.1588419001141266, "survival_time": 14.250000000000068, "driven_lanedir": 0.3312290623583545, "in-drivable-lane": 10.950000000000072, "deviation-heading": 2.538350574804619, "distance-from-start": 1.1587848457868513, "deviation-center-line": 0.2697353094032301, "driven_lanedir_consec": 0.3312290623583545}, "4way-000-ego1": {"driven_any": 0.36480719155630226, "survival_time": 14.250000000000068, "driven_lanedir": 0.1596963318346993, "in-drivable-lane": 12.800000000000068, "deviation-heading": 0.7478094709473372, "distance-from-start": 0.36480084754139935, "deviation-center-line": 0.1356249877644792, "driven_lanedir_consec": 0.1596963318346993}, "4way-000-ego2": {"driven_any": 1.6921542763567952, "survival_time": 14.250000000000068, "driven_lanedir": 0.6388981877178178, "in-drivable-lane": 9.250000000000078, "deviation-heading": 2.3132856904126817, "distance-from-start": 1.6920444051025412, "deviation-center-line": 0.3711792475699576, "driven_lanedir_consec": 0.6388981877178178}, "4way-000-ego3": {"driven_any": 2.182581278372633, "survival_time": 14.250000000000068, "driven_lanedir": 0.4607007325629944, "in-drivable-lane": 11.050000000000072, "deviation-heading": 0.7362638884698945, "distance-from-start": 2.1822334065149938, "deviation-center-line": 0.2757414134443068, "driven_lanedir_consec": 0.4607007325629944}}
simulation-passed1
survival_time_max14.250000000000068
survival_time_mean14.250000000000068
survival_time_min14.250000000000068
No reset possible
7970695Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-validationsim-2of4successnoArchimede-stage-030:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7968696Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-testingsim-1of4successnoArchimede-stage-030:02:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.949999999999994
in-drivable-lane_median2.324999999999993
driven_lanedir_consec_median0.18712240136512193
deviation-center-line_median0.15552364466153024


other stats
deviation-center-line_max0.20320919013290775
deviation-center-line_mean0.15552364466153024
deviation-center-line_min0.1078380991901527
deviation-heading_max0.9508048428349384
deviation-heading_mean0.7622210804954062
deviation-heading_median0.7622210804954062
deviation-heading_min0.5736373181558739
distance-from-start_max0.4813616860528379
distance-from-start_mean0.4813616860528368
distance-from-start_median0.4813616860528368
distance-from-start_min0.4813616860528357
driven_any_max0.48137121711489606
driven_any_mean0.48137121711489367
driven_any_median0.48137121711489367
driven_any_min0.4813712171148913
driven_lanedir_consec_max0.2375799978145845
driven_lanedir_consec_mean0.18712240136512193
driven_lanedir_consec_min0.13666480491565935
driven_lanedir_max0.2375799978145845
driven_lanedir_mean0.18712240136512193
driven_lanedir_median0.18712240136512193
driven_lanedir_min0.13666480491565935
in-drivable-lane_max2.5499999999999936
in-drivable-lane_mean2.324999999999993
in-drivable-lane_min2.099999999999993
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.48137121711489606, "survival_time": 3.949999999999994, "driven_lanedir": 0.13666480491565935, "in-drivable-lane": 2.5499999999999936, "deviation-heading": 0.9508048428349384, "distance-from-start": 0.4813616860528379, "deviation-center-line": 0.1078380991901527, "driven_lanedir_consec": 0.13666480491565935}, "loop2-000-ego1": {"driven_any": 0.4813712171148913, "survival_time": 3.949999999999994, "driven_lanedir": 0.2375799978145845, "in-drivable-lane": 2.099999999999993, "deviation-heading": 0.5736373181558739, "distance-from-start": 0.4813616860528357, "deviation-center-line": 0.20320919013290775, "driven_lanedir_consec": 0.2375799978145845}}
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean3.949999999999994
survival_time_min3.949999999999994
No reset possible
7960698Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-0of4successnoArchimede-stage-030:04:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.499999999999981
in-drivable-lane_median6.299999999999981
driven_lanedir_consec_median0.087152841812152
deviation-center-line_median0.08531017396418544


other stats
deviation-center-line_max0.08531017396418544
deviation-center-line_mean0.08531017396418544
deviation-center-line_min0.08531017396418544
deviation-heading_max1.021124492111859
deviation-heading_mean1.021124492111859
deviation-heading_median1.021124492111859
deviation-heading_min1.021124492111859
distance-from-start_max1.0680700911320549
distance-from-start_mean1.0680700911320549
distance-from-start_median1.0680700911320549
distance-from-start_min1.0680700911320549
driven_any_max1.068124105945288
driven_any_mean1.068124105945288
driven_any_median1.068124105945288
driven_any_min1.068124105945288
driven_lanedir_consec_max0.087152841812152
driven_lanedir_consec_mean0.087152841812152
driven_lanedir_consec_min0.087152841812152
driven_lanedir_max0.087152841812152
driven_lanedir_mean0.087152841812152
driven_lanedir_median0.087152841812152
driven_lanedir_min0.087152841812152
in-drivable-lane_max6.299999999999981
in-drivable-lane_mean6.299999999999981
in-drivable-lane_min6.299999999999981
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.068124105945288, "survival_time": 7.499999999999981, "driven_lanedir": 0.087152841812152, "in-drivable-lane": 6.299999999999981, "deviation-heading": 1.021124492111859, "distance-from-start": 1.0680700911320549, "deviation-center-line": 0.08531017396418544, "driven_lanedir_consec": 0.087152841812152}}
simulation-passed1
survival_time_max7.499999999999981
survival_time_mean7.499999999999981
survival_time_min7.499999999999981
No reset possible
7955699Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-0of4successnoArchimede-stage-030:03:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.749999999999988
in-drivable-lane_median4.349999999999987
driven_lanedir_consec_median0.1366659970085249
deviation-center-line_median0.10783823581419195


other stats
deviation-center-line_max0.10783823581419195
deviation-center-line_mean0.10783823581419195
deviation-center-line_min0.10783823581419195
deviation-heading_max0.9508048428349388
deviation-heading_mean0.9508048428349388
deviation-heading_median0.9508048428349388
deviation-heading_min0.9508048428349388
distance-from-start_max0.7799926905395445
distance-from-start_mean0.7799926905395445
distance-from-start_median0.7799926905395445
distance-from-start_min0.7799926905395445
driven_any_max0.780006743477985
driven_any_mean0.780006743477985
driven_any_median0.780006743477985
driven_any_min0.780006743477985
driven_lanedir_consec_max0.1366659970085249
driven_lanedir_consec_mean0.1366659970085249
driven_lanedir_consec_min0.1366659970085249
driven_lanedir_max0.1366659970085249
driven_lanedir_mean0.1366659970085249
driven_lanedir_median0.1366659970085249
driven_lanedir_min0.1366659970085249
in-drivable-lane_max4.349999999999987
in-drivable-lane_mean4.349999999999987
in-drivable-lane_min4.349999999999987
per-episodes
details{"4way-000-ego0": {"driven_any": 0.780006743477985, "survival_time": 5.749999999999988, "driven_lanedir": 0.1366659970085249, "in-drivable-lane": 4.349999999999987, "deviation-heading": 0.9508048428349388, "distance-from-start": 0.7799926905395445, "deviation-center-line": 0.10783823581419195, "driven_lanedir_consec": 0.1366659970085249}}
simulation-passed1
survival_time_max5.749999999999988
survival_time_mean5.749999999999988
survival_time_min5.749999999999988
No reset possible
7949700Bea Baselines 🐤minimal-agentaido-LFI-sim-testingsim-0of4successnoArchimede-stage-030:02:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.049999999999994
in-drivable-lane_median2.6499999999999932
driven_lanedir_consec_median0.13666480491562938
deviation-center-line_median0.1078383533311162


other stats
deviation-center-line_max0.1078383533311162
deviation-center-line_mean0.1078383533311162
deviation-center-line_min0.1078383533311162
deviation-heading_max0.9508048428349392
deviation-heading_mean0.9508048428349392
deviation-heading_median0.9508048428349392
deviation-heading_min0.9508048428349392
distance-from-start_max0.4978300060106556
distance-from-start_mean0.4978300060106556
distance-from-start_median0.4978300060106556
distance-from-start_min0.4978300060106556
driven_any_max0.49784012437011055
driven_any_mean0.49784012437011055
driven_any_median0.49784012437011055
driven_any_min0.49784012437011055
driven_lanedir_consec_max0.13666480491562938
driven_lanedir_consec_mean0.13666480491562938
driven_lanedir_consec_min0.13666480491562938
driven_lanedir_max0.13666480491562938
driven_lanedir_mean0.13666480491562938
driven_lanedir_median0.13666480491562938
driven_lanedir_min0.13666480491562938
in-drivable-lane_max2.6499999999999932
in-drivable-lane_mean2.6499999999999932
in-drivable-lane_min2.6499999999999932
per-episodes
details{"udem1-000-ego0": {"driven_any": 0.49784012437011055, "survival_time": 4.049999999999994, "driven_lanedir": 0.13666480491562938, "in-drivable-lane": 2.6499999999999932, "deviation-heading": 0.9508048428349392, "distance-from-start": 0.4978300060106556, "deviation-center-line": 0.1078383533311162, "driven_lanedir_consec": 0.13666480491562938}}
simulation-passed1
survival_time_max4.049999999999994
survival_time_mean4.049999999999994
survival_time_min4.049999999999994
No reset possible
7946701Bea Baselines 🐤minimal-agentaido-LF-sim-testingsim-1of4successnoArchimede-stage-030:02:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.13666480491565935
survival_time_median10.85000000000002
deviation-center-line_median0.1078380248585773
in-drivable-lane_median9.45000000000002


other stats
deviation-center-line_max0.1078380248585773
deviation-center-line_mean0.1078380248585773
deviation-center-line_min0.1078380248585773
deviation-heading_max0.9508048428349384
deviation-heading_mean0.9508048428349384
deviation-heading_median0.9508048428349384
deviation-heading_min0.9508048428349384
distance-from-start_max1.6182798682574868
distance-from-start_mean1.6182798682574868
distance-from-start_median1.6182798682574868
distance-from-start_min1.6182798682574868
driven_any_max1.6183892771013535
driven_any_mean1.6183892771013535
driven_any_median1.6183892771013535
driven_any_min1.6183892771013535
driven_lanedir_consec_max0.13666480491565935
driven_lanedir_consec_mean0.13666480491565935
driven_lanedir_consec_min0.13666480491565935
driven_lanedir_max0.13666480491565935
driven_lanedir_mean0.13666480491565935
driven_lanedir_median0.13666480491565935
driven_lanedir_min0.13666480491565935
in-drivable-lane_max9.45000000000002
in-drivable-lane_mean9.45000000000002
in-drivable-lane_min9.45000000000002
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.6183892771013535, "survival_time": 10.85000000000002, "driven_lanedir": 0.13666480491565935, "in-drivable-lane": 9.45000000000002, "deviation-heading": 0.9508048428349384, "distance-from-start": 1.6182798682574868, "deviation-center-line": 0.1078380248585773, "driven_lanedir_consec": 0.13666480491565935}}
simulation-passed1
survival_time_max10.85000000000002
survival_time_mean10.85000000000002
survival_time_min10.85000000000002
No reset possible
7940702Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-testingsim-0of4successnoArchimede-stage-030:05:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.14999999999998
in-drivable-lane_median5.7749999999999835
driven_lanedir_consec_median0.2593080899456762
deviation-center-line_median0.2403442564693939


other stats
deviation-center-line_max0.6912492474624361
deviation-center-line_mean0.31994399427707665
deviation-center-line_min0.10783821670708268
deviation-heading_max2.339188809527301
deviation-heading_mean1.1429380079662788
deviation-heading_median0.82946295209097
deviation-heading_min0.5736373181558743
distance-from-start_max1.175276406473078
distance-from-start_mean0.7619857456783881
distance-from-start_median0.7539328643495388
distance-from-start_min0.3648008475413966
driven_any_max1.1753349118357292
driven_any_mean0.7620163484462006
driven_any_median0.7539616451963927
driven_any_min0.3648071915562875
driven_lanedir_consec_max0.6611857977617436
driven_lanedir_consec_mean0.32911693406076736
driven_lanedir_consec_min0.13666575858997354
driven_lanedir_max0.989786654295282
driven_lanedir_mean0.411267148194152
driven_lanedir_median0.2593080899456762
driven_lanedir_min0.13666575858997354
in-drivable-lane_max6.7499999999999805
in-drivable-lane_mean4.574999999999987
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 0.5146585239872619, "survival_time": 8.14999999999998, "driven_lanedir": 0.13666575858997354, "in-drivable-lane": 6.7499999999999805, "deviation-heading": 0.9508048428349392, "distance-from-start": 0.5146479428595236, "deviation-center-line": 0.10783821670708268, "driven_lanedir_consec": 0.13666575858997354}, "4way-000-ego1": {"driven_any": 0.3648071915562875, "survival_time": 8.14999999999998, "driven_lanedir": 0.23757999781458297, "in-drivable-lane": 6.29999999999998, "deviation-heading": 0.5736373181558743, "distance-from-start": 0.3648008475413966, "deviation-center-line": 0.20320962418590907, "driven_lanedir_consec": 0.23757999781458297}, "4way-000-ego2": {"driven_any": 0.9932647664055236, "survival_time": 8.14999999999998, "driven_lanedir": 0.989786654295282, "in-drivable-lane": 0.0, "deviation-heading": 0.7081210613470007, "distance-from-start": 0.993217785839554, "deviation-center-line": 0.6912492474624361, "driven_lanedir_consec": 0.6611857977617436}, "4way-000-ego3": {"driven_any": 1.1753349118357292, "survival_time": 8.14999999999998, "driven_lanedir": 0.2810361820767695, "in-drivable-lane": 5.249999999999987, "deviation-heading": 2.339188809527301, "distance-from-start": 1.175276406473078, "deviation-center-line": 0.27747888875287874, "driven_lanedir_consec": 0.2810361820767695}}
simulation-passed1
survival_time_max8.14999999999998
survival_time_mean8.14999999999998
survival_time_min8.14999999999998
No reset possible
7938526Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-testingsim-0of4failednoArchimede-stage-030:01:06
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7936658Bea Baselines 🐤template-pytorchaido-LF-sim-testingsim-1of4successnoArchimede-stage-030:12:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.169350910966185
survival_time_median59.99999999999873
deviation-center-line_median2.7343580259477145
in-drivable-lane_median27.14999999999946


other stats
deviation-center-line_max2.7343580259477145
deviation-center-line_mean2.7343580259477145
deviation-center-line_min2.7343580259477145
deviation-heading_max24.84734322970778
deviation-heading_mean24.84734322970778
deviation-heading_median24.84734322970778
deviation-heading_min24.84734322970778
distance-from-start_max0.34630028866539586
distance-from-start_mean0.34630028866539586
distance-from-start_median0.34630028866539586
distance-from-start_min0.34630028866539586
driven_any_max6.5174535732542855
driven_any_mean6.5174535732542855
driven_any_median6.5174535732542855
driven_any_min6.5174535732542855
driven_lanedir_consec_max2.169350910966185
driven_lanedir_consec_mean2.169350910966185
driven_lanedir_consec_min2.169350910966185
driven_lanedir_max2.169350910966185
driven_lanedir_mean2.169350910966185
driven_lanedir_median2.169350910966185
driven_lanedir_min2.169350910966185
in-drivable-lane_max27.14999999999946
in-drivable-lane_mean27.14999999999946
in-drivable-lane_min27.14999999999946
per-episodes
details{"loop2-000-ego0": {"driven_any": 6.5174535732542855, "survival_time": 59.99999999999873, "driven_lanedir": 2.169350910966185, "in-drivable-lane": 27.14999999999946, "deviation-heading": 24.84734322970778, "distance-from-start": 0.34630028866539586, "deviation-center-line": 2.7343580259477145, "driven_lanedir_consec": 2.169350910966185}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7930526Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-testingsim-3of4failednoArchimede-stage-030:02:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible