ML4WX

Benchmarks, datasets & evaluation

Evaluating the Dark Sky Weather Forecast Data Over Florida and Georgia

Haimanote Kebede Bayabil, Fitsum Tilahun Teshome, Songzi Wu, Ziwen Yu

Research Square ·

PaperPDF

In one sentence. Evaluates Dark Sky daily forecasts against 124 Florida and Georgia stations; finds good yes/no rain detection (POD 0.91–1.0) but poor rainfall amounts.

Abstract

Abstract The Dark Sky (DKS; © 2020 Apple Inc.) provides weather forecasts for most locations throughout the world. The objectives of this study were to 1) evaluate the accuracy of the DKS system in capturing selected weather parameters compared to observations at 124 weather stations in Florida and Georgia and 2) provide a strategy using machine learning to identify features that affect the accuracy of rainfall forecast. Daily forecast weather data were obtained using the DKS’ application programming interface (API). Data included daily total rainfall, minimum (Tmin) and maximum (Tmax) temperatures, daily average wind speed, dew point, and relative humidity (RH). The DKS system performed better in capturing forecasts of Tmin and Tmax, and dew point but its performances with rainfall, RH, and wind speed were poor. In addition, the DKS forecast system over-predicts rainfall events <5mm while under-predicting events >5mm. However, the DKS system was able to forecast the occurrence (yes/no) of rainfall events with a probability of detection (POD) values between 0.91 and 1.0. Machine learning model results showed that the accuracy of rainfall forecast was affected by changes in temperature after a rainfall event. The error of a next-day precipitation forecast was < 2.5 mm when post rainfall temperature drops by 5℃. Overall, results suggest that the DKS forecast system could be a reliable source of dichotomous (yes/no) rainfall forecasts, but its quantitative rainfall predictions were poor.

Labels

Topic
Benchmarks, datasets & evaluation, Post-processing & calibration
Type
Evaluation or intercomparison of existing models
Method
Classical ML (trees, GP, linear, kernels)
Time scale
6 h–3 days
Domain
Regional
Data
Station / in-situ, Other
Status
Research
Identifiers
DOI:10.21203/rs.3.rs-1887463/v1 OpenAlex:W4289261849
Added
2026-10-22

Labels and summary are generated by Claude and reviewed weekly. Wrong? Edit this entry.