Benchmarks, datasets & evaluation★ Highlight
WeatherBench 2: A benchmark for the next generation of data-driven global weather models
Why it matters. WeatherBench 2 is the standard benchmark and evaluation framework for data-driven global medium-range models, and nearly all ML weather papers use it.
In one sentence. WeatherBench 2 provides an open evaluation framework, training and ground-truth data, and baselines for data-driven global 1-14 day forecasts.
Abstract
WeatherBench 2 is an update to the global, medium-range (1-14 day) weather forecasting benchmark proposed by Rasp et al. (2020), designed with the aim to accelerate progress in data-driven weather modeling. WeatherBench 2 consists of an open-source evaluation framework, publicly available training, ground truth and baseline data as well as a continuously updated website with the latest metrics and state-of-the-art models: https://sites.research.google/weatherbench. This paper describes the design principles of the evaluation framework and presents results for current state-of-the-art physical and data-driven weather models. The metrics are based on established practices for evaluating weather forecasts at leading operational weather centers. We define a set of headline scores to provide an overview of model performance. In addition, we also discuss caveats in the current evaluation setup and challenges for the future of data-driven weather forecasting.
Labels
- Topic
- Benchmarks, datasets & evaluation, Global medium-range NWP
- Type
- Benchmark or dataset
- Time scale
- 3–15 days
- Domain
- Global
- Data
- ERA5 / reanalysis, NWP analysis or forecasts (IFS, GFS, ...)
- Status
- Research
- Identifiers
- arXiv:2308.15560 DOI:10.1029/2023ms004019 OpenAlex:W4399779937
- Added
- 2026-10-22
Labels and summary are generated by Claude and reviewed weekly. Wrong? Edit this entry.