WeatherGFM: Learning A Weather Generalist Foundation Model via In-context Learning
In one sentence. WeatherGFM is a generalist weather foundation model using in-context visual prompting to handle up to ten weather tasks, including forecasting, super-resolution and post-processing.
Abstract
The Earth's weather system encompasses intricate weather data modalities and diverse weather understanding tasks, which hold significant value to human life. Existing data-driven models focus on single weather understanding tasks (e.g., weather forecasting). Although these models have achieved promising results, they fail to tackle various complex tasks within a single and unified model. Moreover, the paradigm that relies on limited real observations for a single scenario hinders the model's performance upper bound. In response to these limitations, we draw inspiration from the in-context learning paradigm employed in state-of-the-art visual foundation models and large language models. In this paper, we introduce the first generalist weather foundation model (WeatherGFM), designed to address a wide spectrum of weather understanding tasks in a unified manner. More specifically, we initially unify the representation and definition of the diverse weather understanding tasks. Subsequently, we devised weather prompt formats to manage different weather data modalities, namely single, multiple, and temporal modalities. Finally, we adopt a visual prompting question-answering paradigm for the training of unified weather understanding tasks. Extensive experiments indicate that our WeatherGFM can effectively handle up to ten weather understanding tasks, including weather forecasting, super-resolution, weather image translation, and post-processing. Our method also showcases generalization ability on unseen tasks.
Labels
- Topic
- Foundation models, Post-processing & calibration
- Type
- New model or method
- Method
- Other
- Time scale
- 3–15 days
- Domain
- Global
- Data
- ERA5 / reanalysis
- Status
- Research
- Identifiers
- arXiv:2411.05420 OpenAlex:W4404389581
- Added
- 2026-10-22
Labels and summary are generated by Claude and reviewed weekly. Wrong? Edit this entry.