ML4WX

Post-processing & calibration

Suitable Measures for the Potential Operational Utility of AI NWP Rainfall Forecasts Over Africa

Shruti Nath, Docko Sow, Koomi Toussaint Amoussouvi, Fenwick Cooper, Josiah Kiarie Kimani, John Bagiliko, Florian Pappenberger, Rendani Mbuvha

arXiv preprint · · ECMWF, University of Oxford

PaperPDF

In one sentence. Calibrated GraphCast, GenCast and FGN beat IFS for African rainfall by a median of about 5%, with IFS better only in dry high-elevation areas.

Abstract

Artificial intelligence (AI)-based weather prediction is approaching the skill of physical numerical weather prediction (NWP) systems at a fraction of the computational cost. This is particularly promising for Africa, where rainfall extremes are intensifying and many forecasting centres lack the infrastructure to run physical models at extended lead times. We present a calibrated comparison of GraphCast, GenCast and the Functional Generative Network (FGN) against the physical NWP model IFS for rainfall prediction across Africa. Deterministic and probabilistic forecasts are postprocessed using Isotonic Distributional Regression and evaluated with the Continuous Ranked Probability Score against IMERG, RFEv2 and CHIRPS across seasons, wet and dry regimes, elevation zones and lead times. All models retain skill beyond climatology across most seasons and at extended lead times. AI models generally outperform IFS in wet regions, whereas IFS performs better in dry, high-elevation areas, where its finer resolution better represents orographic controls on rainfall. Across observational datasets and seasons, AI models achieve a median improvement of approximately 5% over IFS. GraphCast achieves calibrated skill comparable to the ensemble-based FGN, although FGN provides greater significant skill at longer lead times. These results highlight the potential of calibrated AI weather prediction to provide accessible and computationally efficient rainfall forecasts across Africa, while demonstrating the continuing importance of spatial resolution, ensemble design and regional characteristics.

Labels

Topic
Post-processing & calibration, Global medium-range NWP, Applications & impacts
Type
Evaluation or intercomparison of existing models
Method
Graph neural network, Diffusion / flow matching / score-based
Time scale
3–15 days
Domain
Regional
Data
NWP analysis or forecasts (IFS, GFS, ...), Satellite
Status
Research
Identifiers
arXiv:2609.31775 OpenAlex:W7214798140
Added
2026-10-22

Labels and summary are generated by Claude and reviewed weekly. Wrong? Edit this entry.