Report evaluation coverage and outcomes

Intermediate65 min

Aggregate exactly one intended trial per unique task ID. Prediction rows contain task and status, with status pass, fail, or error. Reject duplicate task IDs, unknown tasks, duplicate predictions, and unknown statuses. Report scheduled count, each observed status count, missing count, coverage, pass/scheduled success rate, and pass/(pass+fail) executed success rate. Return None for a rate with zero denominator. The two success rates have different purposes and must remain labeled; missing results are never silently dropped.

Your task

Complete the starter function using the contract above.
Use the examples and visible tests to check normal inputs, boundaries, and rejected inputs.
Run tests to record your result, then compare with the explained reference solution.

Examples

EXAMPLE 1

Input4 scheduled; 1 pass, 1 fail, 1 error, 1 missing

Outputcoverage .75; success .25; executed success .5

Each denominator answers a different question.

EXAMPLE 2

InputNo scheduled tasks

OutputRates None

No evidence does not mean zero or perfect quality.

def score_runs(task_ids, predictions):
    raise NotImplementedError