Chap learning material

All folders / Evaluation metrics

Evaluation metrics

The six headline metrics Chap shows on every evaluation, one guide each, and a guide to reading them together.

Metric guide

MAE: cases off, on average

MAE is how many cases the middle line was off, on average. The easiest metric to explain.

For Epidemiologists, Data scientists and modellers, HMIS staff, District health officers

Intermediate · 10 min · Self-paced from a link or presented live · Synthetic data

After Session 1: What is a model, and is it any good?

point forecastmedian

Metric guide

MAPE: percent off

MAPE is the miss as a share of what really happened, and why it breaks in quiet months.

For Epidemiologists, Data scientists and modellers, HMIS staff

Intermediate · 10 min · Self-paced from a link or presented live · Synthetic data

After Session 1: What is a model, and is it any good?

point forecastmedian

Metrics

Reading the metrics together

The six headline metrics side by side: what each asks, when they disagree, and how to compare a model with the baseline.

For Epidemiologists, Data scientists and modellers, HMIS staff

Intermediate · 30 min · Presented live or self-paced from a link · Synthetic data

After Session 1: What is a model, and is it any good?

skillcomparisonbaselines