Challenge "lx22-planning-cc-dynamic-vali"

These are the metrics defined:

mistake ratio - mistakes

A mistake is when you provide an infeasible plan

Success ratio - success_ratio

Percentage of (declared) successfull queries.

Duration - duration

Average plan duration

Plan complexity - complexity

Average plan complexity (number of steps)

Min distance - avg_min_distance

Min distance from obstacles

Evaluation steps details

• At the beginning execute step step1-0of4.

• If step step1-0of4 has result failed, then declare the submission FAILED.

• If step step1-0of4 has result error, then declare the submission ERROR.

• At the beginning execute step step1-1of4.

• If step step1-1of4 has result failed, then declare the submission FAILED.

• If step step1-1of4 has result error, then declare the submission ERROR.

• At the beginning execute step step1-2of4.

• If step step1-2of4 has result failed, then declare the submission FAILED.

• If step step1-2of4 has result error, then declare the submission ERROR.

• At the beginning execute step step1-3of4.

• If step step1-3of4 has result failed, then declare the submission FAILED.

• If step step1-3of4 has result error, then declare the submission ERROR.

• If (step step1-0of4 has result success) and (step step1-1of4 has result success) and (step step1-2of4 has result success) and (step step1-3of4 has result success), then declare the submission SUCCESS.

Evaluation step step1-0of4

Timeout 1000.0

This is the Docker Compose configuration skeleton:

version: '3'
services:
    solution:
        image: SUBMISSION_CONTAINER
        environment:
            replica: '{"index": 0, "total": 4}'
            AIDONODE_DATA_IN: /fifos/checker-in
            AIDONODE_DATA_OUT: fifo:/fifos/checker-out
    evaluator:
        image: registry-stage2.duckietown.org/andrea/duckietown-challenges:lx22-planning-cc-dynamic-vali-step1-0of4-evaluator@sha256:7ced2063c6e018a5b5a4268c92201cdf0795d8bd25b680ff3745b990fde10c30
        environment:
            replica: '{"index": 0, "total": 4}'

The text SUBMISSION_CONTAINER will be replaced with the user containter.

Resources required for evaluating this step

No particular resources required.

Evaluation step step1-1of4

Timeout 1000.0

This is the Docker Compose configuration skeleton:

version: '3'
services:
    solution:
        image: SUBMISSION_CONTAINER
        environment:
            replica: '{"index": 1, "total": 4}'
            AIDONODE_DATA_IN: /fifos/checker-in
            AIDONODE_DATA_OUT: fifo:/fifos/checker-out
    evaluator:
        image: registry-stage2.duckietown.org/andrea/duckietown-challenges:lx22-planning-cc-dynamic-vali-step1-1of4-evaluator@sha256:dbeefe33ae248bc474121cedb3e7cfc1b650a2f8d2683ee11a2da7733666fcf7
        environment:
            replica: '{"index": 1, "total": 4}'

The text SUBMISSION_CONTAINER will be replaced with the user containter.

Resources required for evaluating this step

No particular resources required.

Evaluation step step1-2of4

Timeout 1000.0

This is the Docker Compose configuration skeleton:

version: '3'
services:
    solution:
        image: SUBMISSION_CONTAINER
        environment:
            replica: '{"index": 2, "total": 4}'
            AIDONODE_DATA_IN: /fifos/checker-in
            AIDONODE_DATA_OUT: fifo:/fifos/checker-out
    evaluator:
        image: registry-stage2.duckietown.org/andrea/duckietown-challenges:lx22-planning-cc-dynamic-vali-step1-2of4-evaluator@sha256:dbeefe33ae248bc474121cedb3e7cfc1b650a2f8d2683ee11a2da7733666fcf7
        environment:
            replica: '{"index": 2, "total": 4}'

The text SUBMISSION_CONTAINER will be replaced with the user containter.

Resources required for evaluating this step

No particular resources required.

Evaluation step step1-3of4

Timeout 1000.0

This is the Docker Compose configuration skeleton:

version: '3'
services:
    solution:
        image: SUBMISSION_CONTAINER
        environment:
            replica: '{"index": 3, "total": 4}'
            AIDONODE_DATA_IN: /fifos/checker-in
            AIDONODE_DATA_OUT: fifo:/fifos/checker-out
    evaluator:
        image: registry-stage2.duckietown.org/andrea/duckietown-challenges:lx22-planning-cc-dynamic-vali-step1-3of4-evaluator@sha256:dbeefe33ae248bc474121cedb3e7cfc1b650a2f8d2683ee11a2da7733666fcf7
        environment:
            replica: '{"index": 3, "total": 4}'

The text SUBMISSION_CONTAINER will be replaced with the user containter.

Resources required for evaluating this step

No particular resources required.