Duckietown Challenges Home Challenges Submissions

Evaluator 116

ID116
evaluatorArchimede-stage-02-6.2.50
owneruser1000001
machineArchimede-stage
processArchimede-stage-02-6.2.50
version6.2.50
first heard
last heard
statusinactive
# evaluating
# success3 13986
# timeout1 14008
# failed
# error
# aborted
# host-error
arm0
x86_641
Mac0
gpu available1
Number of processors40
Processor frequency (MHz)2.1 GHz
Free % of processors30%
RAM total (MB)376.6 GB
RAM free (MB)255.3 GB
Disk (MB)74209.1 GB
Disk available (MB)63737.6 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, ETH_small_intersect
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
14008783Andrea Danieletemplate-randomaido-LF-sim-validationsim-0of4timeoutnoArchimede-stage-02-6.2.50----No reset possible
140041195Bea Baselines 🐤template-randomlx22-modconsimsuccessyesArchimede-stage-02-6.2.500:03:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median5.975000000000012
deviation-center-line_median0.11301514542133596
driven_lanedir_consec_median-0.0018954959263237647
survival_time_median7.35000000000001


other stats
deviation-center-line_max0.14467724602501503
deviation-center-line_mean0.11301514542133596
deviation-center-line_min0.08135304481765684
deviation-heading_max1.3868142659242308
deviation-heading_mean1.0779200749256197
deviation-heading_median1.0779200749256197
deviation-heading_min0.7690258839270084
distance-from-start_max0.5461575079399126
distance-from-start_mean0.4044333226819924
distance-from-start_median0.4044333226819924
distance-from-start_min0.26270913742407226
driven_any_max2.215855426827692
driven_any_mean1.246529558046666
driven_any_median1.246529558046666
driven_any_min0.27720368926564026
driven_lanedir_consec_max0.003586872133226837
driven_lanedir_consec_mean-0.0018954959263237647
driven_lanedir_consec_min-0.007377863985874367
driven_lanedir_max0.003586872133226837
driven_lanedir_mean-0.0018954959263237647
driven_lanedir_median-0.0018954959263237647
driven_lanedir_min-0.007377863985874367
in-drivable-lane_max9.400000000000029
in-drivable-lane_mean5.975000000000012
in-drivable-lane_min2.5499999999999963
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 2.215855426827692, "survival_time": 11.200000000000024, "driven_lanedir": -0.007377863985874367, "in-drivable-lane": 9.400000000000029, "deviation-heading": 1.3868142659242308, "distance-from-start": 0.5461575079399126, "deviation-center-line": 0.14467724602501503, "driven_lanedir_consec": -0.007377863985874367}, "LF-full-loop-001-ego0": {"driven_any": 0.27720368926564026, "survival_time": 3.4999999999999956, "driven_lanedir": 0.003586872133226837, "in-drivable-lane": 2.5499999999999963, "deviation-heading": 0.7690258839270084, "distance-from-start": 0.26270913742407226, "deviation-center-line": 0.08135304481765684, "driven_lanedir_consec": 0.003586872133226837}}
simulation-passed1
survival_time_max11.200000000000024
survival_time_mean7.35000000000001
survival_time_min3.4999999999999956
No reset possible
139981202Bea Baselines 🐤template-roslx22-state-estimationsimsuccessyesArchimede-stage-02-6.2.500:04:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.46546198142172734
survival_time_median8.79999999999999
deviation-center-line_median0.19762340097737416
in-drivable-lane_median6.599999999999994


other stats
deviation-center-line_max0.27976551346973144
deviation-center-line_mean0.19109721459515056
deviation-center-line_min0.09590272933834612
deviation-heading_max2.099937426929875
deviation-heading_mean1.2508465792826116
deviation-heading_median1.1829163345071232
deviation-heading_min0.469685976410837
distance-from-start_max2.822300508124187
distance-from-start_mean2.2442745360510776
distance-from-start_median2.116634300087633
distance-from-start_min1.793888799941412
driven_any_max3.1838924691989363
driven_any_mean2.454631403526464
driven_any_median2.1572900632448553
driven_any_min2.0227116781355994
driven_lanedir_consec_max0.9430753382219184
driven_lanedir_consec_mean0.5972881695273576
driven_lanedir_consec_min0.3833271889384271
driven_lanedir_max0.9984783184015368
driven_lanedir_mean0.6157558295872304
driven_lanedir_median0.46546198142172734
driven_lanedir_min0.3833271889384271
in-drivable-lane_max7.300000000000031
in-drivable-lane_mean6.616666666666668
in-drivable-lane_min5.94999999999998
per-episodes
details{"LF-zig-zag-000-ego0": {"driven_any": 2.0227116781355994, "survival_time": 7.79999999999998, "driven_lanedir": 0.3833271889384271, "in-drivable-lane": 5.94999999999998, "deviation-heading": 0.469685976410837, "distance-from-start": 1.793888799941412, "deviation-center-line": 0.09590272933834612, "driven_lanedir_consec": 0.3833271889384271}, "LF-zig-zag-001-ego0": {"driven_any": 3.1838924691989363, "survival_time": 11.850000000000032, "driven_lanedir": 0.9984783184015368, "in-drivable-lane": 7.300000000000031, "deviation-heading": 2.099937426929875, "distance-from-start": 2.822300508124187, "deviation-center-line": 0.27976551346973144, "driven_lanedir_consec": 0.9430753382219184}, "LF-zig-zag-002-ego0": {"driven_any": 2.1572900632448553, "survival_time": 8.79999999999999, "driven_lanedir": 0.46546198142172734, "in-drivable-lane": 6.599999999999994, "deviation-heading": 1.1829163345071232, "distance-from-start": 2.116634300087633, "deviation-center-line": 0.19762340097737416, "driven_lanedir_consec": 0.46546198142172734}}
simulation-passed1
survival_time_max11.850000000000032
survival_time_mean9.483333333333334
survival_time_min7.79999999999998
No reset possible
13986789Andrea Danieletemplate-pytorchaido-LF-sim-validationsim-2of4successnoArchimede-stage-02-6.2.500:13:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.46978162465639706
survival_time_median45.49999999999955
deviation-center-line_median0.3436224995930581
in-drivable-lane_median40.79999999999954


other stats
deviation-center-line_max0.3436224995930581
deviation-center-line_mean0.3436224995930581
deviation-center-line_min0.3436224995930581
deviation-heading_max3.524726323056118
deviation-heading_mean3.524726323056118
deviation-heading_median3.524726323056118
deviation-heading_min3.524726323056118
distance-from-start_max0.7187165691864398
distance-from-start_mean0.7187165691864398
distance-from-start_median0.7187165691864398
distance-from-start_min0.7187165691864398
driven_any_max7.86685244667644
driven_any_mean7.86685244667644
driven_any_median7.86685244667644
driven_any_min7.86685244667644
driven_lanedir_consec_max0.46978162465639706
driven_lanedir_consec_mean0.46978162465639706
driven_lanedir_consec_min0.46978162465639706
driven_lanedir_max0.46978162465639706
driven_lanedir_mean0.46978162465639706
driven_lanedir_median0.46978162465639706
driven_lanedir_min0.46978162465639706
in-drivable-lane_max40.79999999999954
in-drivable-lane_mean40.79999999999954
in-drivable-lane_min40.79999999999954
per-episodes
details{"loop-000-ego0": {"driven_any": 7.86685244667644, "survival_time": 45.49999999999955, "driven_lanedir": 0.46978162465639706, "in-drivable-lane": 40.79999999999954, "deviation-heading": 3.524726323056118, "distance-from-start": 0.7187165691864398, "deviation-center-line": 0.3436224995930581, "driven_lanedir_consec": 0.46978162465639706}}
simulation-passed1
survival_time_max45.49999999999955
survival_time_mean45.49999999999955
survival_time_min45.49999999999955
No reset possible