Software, scaling & compression

Exascale Deep Learning for Climate Analytics

Thorsten Kurth, Sean Treichler, Joshua Romero, Mayur Mudigonda, Nathan Luehr, Everett Phillips, Ankur Mahesh, Michael Matheson, Jack Deslippe, Massimiliano Fatica, Prabhat, Michael Houston

SC18: International Conference for High Performance Computing, Networking, Storage and Analysis · 03 October 2018 · Lawrence Berkeley National Laboratory / NERSC, NVIDIA, Oak Ridge National Laboratory

PaperPDF

In one sentence. Tiramisu and DeepLabv3+ segment extreme weather patterns and scale to 27,360 V100 GPUs at 325.8 PF/s sustained throughput.

Abstract

We extract pixel-level masks of extreme weather patterns using variants of Tiramisu and DeepLabv3+ neural networks. We describe improvements to the software frameworks, input pipeline, and the network training algorithms necessary to efficiently scale deep learning on the Piz Daint and Summit systems. The Tiramisu network scales to 5300 P100 GPUs with a sustained throughput of 21.0 PF/s and parallel efficiency of 79.0%. DeepLabv3+ scales up to 27360 V100 GPUs with a sustained throughput of 325.8 PF/s and a parallel efficiency of 90.7% in single precision. By taking advantage of the FP16 Tensor Cores, a half-precision version of the DeepLabv3+ network achieves a peak and sustained throughput of 1.13 EF/s and 999.0 PF/s respectively.

Labels

Topic

Software, scaling & compression

Type

New model or method

Method

CNN / U-Net

Domain

Global

Data

Other

Status

Research

Identifiers

arXiv:1810.01993 DOI:10.1109/sc.2018.00054 OpenAlex:W2952046647

Added

2026-10-22

Labels and summary are generated by Claude and reviewed weekly. Wrong? Edit this entry.