WeatherBench 2: A benchmark for the next generation of data-driven global weather models
Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:S54SPIKOrecord.jsonopen to challenge →
read the original abstract
WeatherBench 2 is an update to the global, medium-range (1-14 day) weather forecasting benchmark proposed by Rasp et al. (2020), designed with the aim to accelerate progress in data-driven weather modeling. WeatherBench 2 consists of an open-source evaluation framework, publicly available training, ground truth and baseline data as well as a continuously updated website with the latest metrics and state-of-the-art models: https://sites.research.google/weatherbench. This paper describes the design principles of the evaluation framework and presents results for current state-of-the-art physical and data-driven weather models. The metrics are based on established practices for evaluating weather forecasts at leading operational weather centers. We define a set of headline scores to provide an overview of model performance. In addition, we also discuss caveats in the current evaluation setup and challenges for the future of data-driven weather forecasting.
This paper has not been read by Pith yet.
Forward citations
Cited by 6 Pith papers
-
PhysMetrics.Weather: An Evaluation Framework for Physical Consistency in ML Weather Models
PhysMetrics.Weather is an evaluation framework that quantifies physical realism of ML weather prediction models using conservation, spectral, and dynamical metrics.
-
Mechanism Learning: Prototype-Anchored Mechanism Inference for Scientific Forecasting
Mechanism learning infers active local evolution rules via prototype-anchored descriptors to achieve more robust forecasting than direct state prediction on benchmarks like Burgers, WeatherBench2, and Lorenz96.
-
Earth System Foundation Model (ESFM): A unified framework for heterogeneous data integration and forecasting
ESFM is a single open foundation model that unifies heterogeneous Earth data sources and forecasts missing regions while preserving inter-variable physical relationships.
-
Integrating Weather Foundation Model and Satellite to Enable Fine-Grained Solar Irradiance Forecasting
Baguan-solar integrates Baguan weather foundation model forecasts with geostationary satellite data via a decoupled two-stage multimodal framework to deliver kilometer-scale 24-hour solar irradiance predictions, cutti...
-
HealDA: Highlighting the importance of initial errors in end-to-end AI weather forecasts
HealDA supplies ML-based initial conditions for AI weather models that produce forecasts trailing ERA5-initialized runs by less than one day of effective lead time, with the skill gap arising mainly from initial error size.
-
Machine learning is revolutionizing weather forecasting -- the next step is a change in how we work
Machine learning success in weather prediction will drive changes in development practices, data handling, verification, and service creation at weather centers.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.