Benchmarks, datasets & evaluation
In Search of Micromodels: Black-box Evaluation of Spatio-temporal Models in Normal and Extreme Conditions
In one sentence. Black-box evaluation of NWP temperature and precipitation outputs under normal and extreme conditions to find scenarios for lightweight data-driven micromodels on Edge devices.
Abstract
Spatio-temporal modelling is an emerging research area due to the increasing availability of sensor data collected across space and time. The models are build either with a modeldriven or data-driven approach. The former often results in complex monolith models that are not suitable for lightweight Edge deployment. The latter requires a vast amount of data and may not provide an overall good performance. Consequently, the data-driven approach is being used to substitute only parts of model-driven outputs, by creating micromodels that tackle specific scenarios. The main contribution of this paper is a definition and demonstration of the process for finding such scenarios for which a spatio-temporal model could be improved or replaced by a micromodel and deployed on Edge. The process is demonstrated on an example of a Numerical Weather Prediction model (NWP), namely its outputs of temperature and precipitation. NWP is evaluated using black-box testing considering the specificity of spatial and temporal components, in both normal and extreme conditions. The novelty of this process is its ability to highlight weaknesses of the existing expert models and suggest scenarios in which the models can be improved and deployed on the Edge.
Labels
- Topic
- Benchmarks, datasets & evaluation
- Type
- Evaluation or intercomparison of existing models
- Method
- Other
- Time scale
- 6 h–3 days
- Domain
- Regional
- Data
- NWP analysis or forecasts (IFS, GFS, ...)
- Status
- Research
- Identifiers
- DOI:10.24138/jcomss-2022-0092 OpenAlex:W4313128072
- Added
- 2026-10-22
Labels and summary are generated by Claude and reviewed weekly. Wrong? Edit this entry.