Pith. sign in

REVIEW 9 cited by

WeatherBench 2: A benchmark for the next generation of data-driven global weather models

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2308.15560 v2 pith:S54SPIKO submitted 2023-08-29 physics.ao-ph cs.AI

classification physics.ao-phcs.AI
keywords weatherdata-drivenweatherbenchevaluationmodelsbenchmarkcurrentforecasting
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

WeatherBench 2 is an update to the global, medium-range (1-14 day) weather forecasting benchmark proposed by Rasp et al. (2020), designed with the aim to accelerate progress in data-driven weather modeling. WeatherBench 2 consists of an open-source evaluation framework, publicly available training, ground truth and baseline data as well as a continuously updated website with the latest metrics and state-of-the-art models: https://sites.research.google/weatherbench. This paper describes the design principles of the evaluation framework and presents results for current state-of-the-art physical and data-driven weather models. The metrics are based on established practices for evaluating weather forecasts at leading operational weather centers. We define a set of headline scores to provide an overview of model performance. In addition, we also discuss caveats in the current evaluation setup and challenges for the future of data-driven weather forecasting.

Discussion (0). Sign in to comment.

Forward citations

Cited by 9 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. PhysMetrics.Weather: An Evaluation Framework for Physical Consistency in ML Weather Models

    cs.LG 2026-06 unverdicted novelty 6.0 of 10

    PhysMetrics.Weather is an evaluation framework that quantifies physical realism of ML weather prediction models using conservation, spectral, and dynamical metrics.

  2. Mechanism Learning: Prototype-Anchored Mechanism Inference for Scientific Forecasting

    cs.LG 2026-05 unverdicted novelty 6.0 of 10

    Mechanism learning infers active local evolution rules via prototype-anchored descriptors to achieve more robust forecasting than direct state prediction on benchmarks like Burgers, WeatherBench2, and Lorenz96.

  3. Earth System Foundation Model (ESFM): A unified framework for heterogeneous data integration and forecasting

    physics.ao-ph 2026-04 unverdicted novelty 6.0 of 10

    ESFM is a single open foundation model that unifies heterogeneous Earth data sources and forecasts missing regions while preserving inter-variable physical relationships.

  4. Integrating Weather Foundation Model and Satellite to Enable Fine-Grained Solar Irradiance Forecasting

    cs.LG 2026-03 unverdicted novelty 6.0 of 10

    Baguan-solar integrates Baguan weather foundation model forecasts with geostationary satellite data via a decoupled two-stage multimodal framework to deliver kilometer-scale 24-hour solar irradiance predictions, cutti...

  5. AS-Bridge: A Bidirectional Generative Framework Bridging Next-Generation Astronomical Surveys

    astro-ph.IM 2026-03 conditional novelty 6.0 of 10

    A Brownian-bridge diffusion model learns probabilistic LSST↔Euclid image translation on simulations and uses reconstruction inconsistency to detect strong lenses.

  6. HealDA: Highlighting the importance of initial errors in end-to-end AI weather forecasts

    physics.ao-ph 2026-01 conditional novelty 6.0 of 10

    HealDA supplies ML-based initial conditions for AI weather models that produce forecasts trailing ERA5-initialized runs by less than one day of effective lead time, with the skill gap arising mainly from initial error size.

  7. Uncertainty Quantification for Regression: A Unified Framework based on kernel scores

    cs.LG 2025-10 conditional novelty 5.0 of 10

    Kernel-score divergences define a unified family of regression uncertainty measures whose kernel choice controls robustness, tail sensitivity, and OOD responsiveness.

  8. The Rise of AI in Weather and Climate Information and its Impact on Global Inequality

    physics.ao-ph 2026-03 conditional novelty 4.0 of 10

    AI weather and climate tools inherit Northern-controlled data and compute, risking worse forecasts and maladaptation for the Global South rather than democratizing climate information.

  9. Machine learning is revolutionizing weather forecasting -- the next step is a change in how we work

    physics.ao-ph 2026-06 unverdicted novelty 3.0 of 10

    Machine learning success in weather prediction will drive changes in development practices, data handling, verification, and service creation at weather centers.

Pith tools