ML4WX

Topics

Post-processing & calibration

Statistical post-processing of NWP or ML forecasts: bias correction, ensemble calibration, distributional regression, station forecasts.

Search and filter this topic Plain list on GitHub

'98
'16
'18
'19
'20
'21
'22
'23
263 papers per year

★ Highlights

★ Statistical Postprocessing for Weather Forecasts -- Review, Challenges and Avenues in a Big Data World

Stéphane Vannitsem, John Bjørnar Bremnes, Jonathan Demaeyer et al. · Bulletin of the American Meteorological Society ·

Review of statistical postprocessing methods for NWP forecasts and their challenges in big-data settings, with little explicit machine learning focus.

Deutscher Wetterdienst (DWD)ECMWFKarlsruhe Institute of Technology (KIT)KNMI (Royal Netherlands Meteorological Institute)MET Norway (Norwegian Meteorological Institute)Met OfficeMétéo-France (incl. CNRM)MeteoSwiss

All papers (263)

Self-Supervised Pre-Training for Precipitation Post-Processor

Sojung An, Junha Lee, Jiyeon Jang et al. · arXiv ·

Self-supervised encoder pretraining on atmospheric variables, then transfer to a labelled precipitation task, improves regional NWP precipitation correction over other approaches.

Interpolation of mountain weather forecasts by machine learning

Kazuma Iwase, Tomoyuki Takenawa · Journal of Information Processing, Volume 32, 873--880 (2024) ·

LightGBM interpolates plains forecasts and observations to improve temperature and precipitation forecasts in Japanese mountain areas, with partial RMSE gains.

Statistical post-processing of visibility ensemble forecasts

Sándor Baran, Mária Lakatos · Meteorological Applications 30 (2023), 1-18 ·

Compares proportional-odds logistic regression and MLP classifiers for calibrating ECMWF visibility ensembles; POLR generally beats MLP and beats raw ensembles.

Machine Learning Weather Analogs for Near-Surface Variables

Weiming Hu, Guido Cervone, George S. Young et al. · Boundary-Layer Meteorology ·

Deep-learning latent space replaces hand-tuned similarity weights in analog ensembles for near-surface wind and solar forecasts, improving RMSE in Pennsylvania.

ConvMOS: climate model output statistics with deep learning

Michael Steininger, Daniel Abel, Katrin Ziegler et al. · Data Mining and Knowledge Discovery ·

ConvMOS, a convolutional bias-correction model for REMO precipitation with per-location and global parameters, reduces errors and better captures extreme precipitation.

Machine Learning Weather Analogs for Renewable Forecasting

Weiming Hu, Guido Cervone, George S. Young et al. · Research Square ·

Deep-learning latent similarity metric for analog ensembles outperforms the original AnEn in RMSE, bias and CRPS for wind and solar forecasts in Pennsylvania.

Short-Term Weather Forecast Skill of Artificial Neural Networks

Christopher C. Hennon, Andrew Coleman, Andrew Hill · Weather and Forecasting ·

Neural networks trained on MOS, HRRR and NWS guidance cut 1-day temperature error 20–30% versus MOS at 11 US cities, though gains over linear regression were not significant.

Towards implementing artificial intelligence post-processing in weather and climate: proposed actions from the Oxford 2019 workshop

Sue Ellen Haupt, William Chapman, Samantha V. Adams et al. · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences ·

Oxford workshop position on AI post-processing for weather and climate, releasing five archived ML-ready datasets with baseline notebooks to encourage trustworthy, FAIR and physically informed methods.

The Alan Turing InstituteKarlsruhe Institute of Technology (KIT)Met OfficeNSF NCAR / UCAR

Deep Learning for Climate Model Output Statistics

Michael Steininger, Daniel Abel, Katrin Ziegler et al. · arXiv ·

ConvMOS, a CNN for model output statistics, reduces precipitation errors in the REMO regional climate model and outperforms three common MOS approaches.

Deep Learning for Post-Processing Ensemble Weather Forecasts

Peter Grönquist, Chengyuan Yao, Tal Ben-Nun et al. · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences ·

A deep neural network post-processes a subset of ensemble trajectories, improving CRPS by over 14% and allowing fewer members to match the full ensemble.

ECMWFETH Zurich

★ Statistical Postprocessing for Weather Forecasts -- Review, Challenges and Avenues in a Big Data World

Stéphane Vannitsem, John Bjørnar Bremnes, Jonathan Demaeyer et al. · Bulletin of the American Meteorological Society ·

Review of statistical postprocessing methods for NWP forecasts and their challenges in big-data settings, with little explicit machine learning focus.

Deutscher Wetterdienst (DWD)ECMWFKarlsruhe Institute of Technology (KIT)KNMI (Royal Netherlands Meteorological Institute)MET Norway (Norwegian Meteorological Institute)Met OfficeMétéo-France (incl. CNRM)MeteoSwiss

Distilling an Analog Ensemble into a Deep Neural Network

Salvatore Candido, Aakanksha Singh, Luca Delle Monache · preprint ·

Distills the analog ensemble post-processing into a small neural network, enabling fast on-the-fly ECMWF lower-stratosphere wind corrections with a model of only hundreds of kilobytes.

Improving Atmospheric River Forecasts With Machine Learning

W. E. Chapman, A. C. Subramanian, L. Delle Monache et al. · Geophysical Research Letters ·

A CNN postprocesses GFS integrated vapor transport forecasts, cutting RMSE by 9-17% from 3 hours to 7 days and improving atmospheric river forecasts over the western US.

Also relevant (190)

An Intercomparison of Deep-Learning Methods for Super-Resolution Bias-Correction (SRBC) of Indian Summer Monsoon Rainfall (ISMR) Using CORDEX-SA Simulations

Deveshwar Singh, Yunsoo Choi, Rijul Dimri et al. · Asia-Pacific Journal of Atmospheric Sciences ·

Intercomparison of deep-learning super-resolution bias-correction methods for Indian summer monsoon rainfall in CORDEX South Asia simulations; the abstract is unavailable, so the classification relies on the title.

Downscaling & super-resolution

Merging satellite and gauge-measured precipitation using LightGBM with an emphasis on extreme quantiles

Hristos Tyralis, Georgia Papacharalampous, Nikolaos Doulamis et al. · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 16 (2023) 6969-6979 ·

Applies LightGBM to probabilistically merge contiguous-US gauge data with PERSIANN and IMERG satellite precipitation, outperforming quantile regression forests at extreme quantiles.

Observations & remote sensing

Outcomes of the WMO Prize Challenge to Improve Subseasonal to Seasonal Predictions Using Artificial Intelligence

F. Vitart, A. W. Robertson, A. Spring et al. · Bulletin of the American Meteorological Society ·

WMO prize challenge winners used AI to post-process ECMWF S2S forecasts, beating bias-corrected references for weeks 3-6 precipitation and temperature.

Sub-seasonal to seasonalColumbia University (LEAP, Lamont-Doherty)Environment and Climate Change Canada (ECCC)ECMWFMax Planck Institute for MeteorologySwiss Data Science Center (SDSC)

Spatial Mixture-of-Experts

Nikoli Dryden, Torsten Hoefler · arXiv ·

Spatial Mixture-of-Experts layer routes experts by location and sets new state of the art for medium-range weather prediction and ensemble post-processing.

Global medium-range NWP

Can we integrate spatial verification methods into neural-network loss functions for atmospheric science?

Ryan Lagerquist, Imme Ebert-Uphoff · Artificial Intelligence for the Earth Systems (2022), 1 (4), pg. e220021 ·

Spatially enhanced loss functions using neighbourhood and spectral filters improve neural network convection forecasts, with spectral-filter models giving better-calibrated probabilities than pixelwise training.

Benchmarks, datasets & evaluationColorado State University (incl. CIRA)NOAA (incl. GFDL, PSL, GSL, NCEP/EMC)

A Decision Support System for Wind Power Production

Ruggero Donida Labati, Angelo Genovese, Vincenzo Piuri et al. · IEEE Transactions on Systems Man and Cybernetics Systems ·

Neural-network decision support system calibrates weather forecasts for wind farm orography and predicts power output, improving prediction at ten real wind farms.

Applications & impacts