ML4WX

Explainability, uncertainty & physics

Physically Interpretable Neural Networks for the Geosciences: Applications to Earth System Variability

Benjamin A. Toms, Elizabeth A. Barnes, Imme Ebert-Uphoff

Journal of Advances in Modeling Earth Systems · · Colorado State University (incl. CIRA)

PaperPDF

In one sentence. Applies backwards optimization and layerwise relevance propagation to neural networks, recovering scientifically meaningful patterns in climate variability data.

Abstract

Neural networks have become increasingly prevalent within the geosciences, although a common limitation of their usage has been a lack of methods to interpret what the networks learn and how they make decisions. As such, neural networks have often been used within the geosciences to most accurately identify a desired output given a set of inputs, with the interpretation of what the network learns used as a secondary metric to ensure the network is making the right decision for the right reason. Neural network interpretation techniques have become more advanced in recent years, however, and we therefore propose that the ultimate objective of using a neural network can also be the interpretation of what the network has learned rather than the output itself. We show that the interpretation of neural networks can enable the discovery of scientifically meaningful connections within geoscientific data. In particular, we use two methods for neural network interpretation called backwards optimization and layerwise relevance propagation, both of which project the decision pathways of a network back onto the original input dimensions. To the best of our knowledge, LRP has not yet been applied to geoscientific research, and we believe it has great potential in this area. We show how these interpretation techniques can be used to reliably infer scientifically meaningful information from neural networks by applying them to common climate patterns. These results suggest that combining interpretable neural networks with novel scientific hypotheses will open the door to many new avenues in neural network-related geoscience research.

Labels

Topic
Explainability, uncertainty & physics, Climate analysis & attribution
Type
New model or method
Method
Classical ML (trees, GP, linear, kernels), Other
Domain
Global
Data
ERA5 / reanalysis, CMIP / climate model output
Status
Research
Identifiers
arXiv:1912.01752 DOI:10.1029/2019ms002002 OpenAlex:W2993514765
Added
2026-10-22

Labels and summary are generated by Claude and reviewed weekly. Wrong? Edit this entry.