Federated Learning with GANs-based Synthetic Minority Over-sampling Technique for Improving Weather Prediction from Imbalanced Data

Elaheh Jafarigol, Theodore B. Trafali̇s

Research Square · 05 May 2023 · University of Oklahoma (AI2ES)

In one sentence. Federated learning with GAN-based oversampling is applied to imbalanced tabular weather data; gains are reported without numbers.

Abstract

Abstract Detecting rare events is a challenging task among machine learning practitioners, motivating them to navigate and further improve data processing and algorithmic approaches to find accurate and computationally efficient methods for imbalanced learning. Imbalanced data is common in weather prediction, where the massive size of data poses storage and computational challenges. To learn from imbalanced data, the algorithms must strive to learn each class precisely to be able to classify both the minority and the majority class. While creating complex models is somewhat necessary for such problems, the machine learning algorithm must have adequate generalization capabilities. In recent years, federated learning has been used as an environmentally-friendly approach, which can produce accurate results in a distributed setting. Although privacy is not a concern of this study, inherent characteristics of federated learning are beneficial in weather prediction. Deep learning combined with data augmentation is explored in the framework of federated learning. We compare multiple data augmentation methods in a centralized and federated learning framework. Federated learning has great potential for weather prediction tasks. By leveraging data from multiple sources, we were able to improve the accuracy and generalization of the classifier. Addressing the issue of imbalanced data is an essential step. Incorporating the two remarkable approaches of Generative Adversarial Networks and Synthetic Minority Over-sampling Technique is a suitable solution for tabular weather data, and our experimental results confirm the effectiveness of this approach.

Labels

Labels and summary are generated by Claude and reviewed weekly. Wrong? Edit this entry.