ML4WX

Sub-seasonal to seasonal

Incorrect computation of Madden-Julian oscillation prediction skill

Tamaki Suematsu, Zane Martin, Elizabeth A. Barnes, Charlotte A. DeMott, Samson Hagos, Yoo‐Geun Ham, Daehyun Kim, Hyemi Kim, Tieh‐Yong Koh, Eric Daniel Maloney

npj Climate and Atmospheric Science · · Colorado State University (incl. CIRA), University of Cambridge (Aardvark)

Paper

In one sentence. Shows that a published ML MJO forecast skill was miscalculated; correct skill falls from 26–27 to 11–12 days, below dynamical models.

Abstract

The Madden–Julian oscillation (MJO) is a major tropical weather system and one of the largest sources of predictability for subseasonal-to-seasonal weather forecasts. Skillful prediction of the MJO has been a highly active area of research due to its large socio-economic impacts. Silini et al., herein S21, developed a machine learning model to predict the MJO, which they claimed to have an MJO prediction skill of 26–27 days over all seasons and 45 days for December–February (DJF) winter. If true, this would make the skill of their model competitive with that of the state-of-the-art dynamical MJO prediction systems at 20–35 days. However, here we show that the MJO prediction was calculated incorrectly in S21, which spuriously increased the performance of their model. Correctly computed skill of their model was substantially lower than that reported in S21; the skill for all seasons drops to 11–12 days and the skill for forecasts initialized during DJF drops to 15 days. Our findings clarify that the S21 machine learning model is not competitive with state-of-the-art numerical weather prediction models in predicting the MJO.

Labels

Topic
Sub-seasonal to seasonal, Benchmarks, datasets & evaluation
Type
Evaluation or intercomparison of existing models
Method
Other
Time scale
2 weeks–2 months
Domain
Global
Status
Research
Identifiers
DOI:10.1038/s41612-024-00687-1 OpenAlex:W4399731413
Added
2026-10-22

Labels and summary are generated by Claude and reviewed weekly. Wrong? Edit this entry.