Probabilistic & ensemble forecasting★ Highlight

Huge Ensembles Part II: Properties of a Huge Ensemble of Hindcasts Generated with Spherical Fourier Neural Operators

Ankur Mahesh, William Collins, Boris Bonev, Noah Brenowitz, Yair Cohen, Peter Harrington, Karthik Kashinath, Thorsten Kurth, Joshua North, Travis OBrien, Michael Pritchard, David Pruitt et al.

Geoscientific model development · 02 August 2024 · Lawrence Berkeley National Laboratory / NERSC, NVIDIA, University of California, Berkeley

Paper PDF

Why it matters. Generates 7,424-member SFNO ensemble, showing ML can sample extreme tails cheaply; important for extremes and ensemble forecasting research.

In one sentence. A 7,424-member Spherical Fourier Neural Operator huge ensemble samples events 4 sigma from the mean and improves extreme-weather uncertainty quantification for summer 2023 forecasts.

Abstract

In Part I, we created an ensemble based on Spherical Fourier Neural Operators. As initial condition perturbations, we used bred vectors, and as model perturbations, we used multiple checkpoints trained independently from scratch. Based on diagnostics that assess the ensemble's physical fidelity, our ensemble has comparable performance to operational weather forecasting systems. However, it requires orders of magnitude fewer computational resources. Here in Part II, we generate a huge ensemble (HENS), with 7,424 members initialized each day of summer 2023. We enumerate the technical requirements for running huge ensembles at this scale. HENS precisely samples the tails of the forecast distribution and presents a detailed sampling of internal variability. HENS has two primary applications: (1) as a large dataset with which to study the statistics and drivers of extreme weather and (2) as a weather forecasting system. For extreme climate statistics, HENS samples events 4$σ$ away from the ensemble mean. At each grid cell, HENS increases the skill of the most accurate ensemble member and enhances coverage of possible future trajectories. As a weather forecasting model, HENS issues extreme weather forecasts with better uncertainty quantification. It also reduces the probability of outlier events, in which the verification value lies outside the ensemble forecast distribution.

Labels

Labels and summary are generated by Claude and reviewed weekly. Wrong? Edit this entry.