REVIEW 47 cited by
ClimaX: A foundation model for weather and climate
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
ClimaX: A foundation model for weather and climate
read the original abstract
Most state-of-the-art approaches for weather and climate modeling are based on physics-informed numerical models of the atmosphere. These approaches aim to model the non-linear dynamics and complex interactions between multiple variables, which are challenging to approximate. Additionally, many such numerical models are computationally intensive, especially when modeling the atmospheric phenomenon at a fine-grained spatial and temporal resolution. Recent data-driven approaches based on machine learning instead aim to directly solve a downstream forecasting or projection task by learning a data-driven functional mapping using deep neural networks. However, these networks are trained using curated and homogeneous climate datasets for specific spatiotemporal tasks, and thus lack the generality of numerical models. We develop and demonstrate ClimaX, a flexible and generalizable deep learning model for weather and climate science that can be trained using heterogeneous datasets spanning different variables, spatio-temporal coverage, and physical groundings. ClimaX extends the Transformer architecture with novel encoding and aggregation blocks that allow effective use of available compute while maintaining general utility. ClimaX is pre-trained with a self-supervised learning objective on climate datasets derived from CMIP6. The pre-trained ClimaX can then be fine-tuned to address a breadth of climate and weather tasks, including those that involve atmospheric variables and spatio-temporal scales unseen during pretraining. Compared to existing data-driven baselines, we show that this generality in ClimaX results in superior performance on benchmarks for weather forecasting and climate projections, even when pretrained at lower resolutions and compute budgets. The source code is available at https://github.com/microsoft/ClimaX.
Forward citations
Cited by 47 Pith papers
-
Toward Mechanistic Interpretability of an AI Foundation Model Fine-Tuned for Atmospheric Chemistry
Aurora, a foundation model fine-tuned for air quality, captures rough NOx–ozone coupling but lacks the chemical consistency and emission-plume fidelity of process-based models.
-
Geospatial Diffusion-based Evolution Synthesis (GeoDES) for Storm-Centered Weather Augmentation
GeoDES generates realistic synthetic cyclone evolutions via 2D-pretrained, temporally-inflated diffusion with correlated noise, beating weather foundation models on storm-kinetics and energy-spectrum metrics.
-
Beyond Linear Superposition: Discovering Climate Features in AI Weather Models with KAN-SAE
KAN-SAE applies nonlinear per-feature B-spline activations in sparse autoencoders to discover 72% more alive climate features and interpretable patterns such as European heatwaves and Pacific typhoons in deep learning...
-
Does Your Wildfire Prediction Model Actually Work, or Just Score Well?
WILDFIRE-FM is the first wildfire-specific Earth foundation model, paired with a fixed-contract evaluation framework that demonstrates wildfire model transfer conclusions depend strongly on evaluation design and task ...
-
A Self-Supervised Framework for Space Object Behaviour Characterisation
Self-supervised Perceiver-VAE pre-trained on 227,000 light curves from MMT-9 and fine-tuned on simulators achieves 85% accuracy and 0.92-0.95 ROC AUC in anomaly detection and motion mode prediction for space objects.
-
Integrating GNSS-Derived Zenith Wet Delay into a Weather Foundation Model Improves Precipitation Forecasting
Integrating GNSS-derived Zenith Wet Delay into Aurora improves six-hour precipitation skill, with an 8.8% ETS gain at the 99th percentile and a more realistic power spectrum.
-
Incomplete Observations Boost Evolutionary Performance in Ocean Modeling
Using an EM loop with Langevin sampling, a generative state-space model learns ocean dynamics from incomplete satellite observations and improves SST reconstruction and one-step forecasts over its pretrained baseline.
-
SetGo: Metadata Readiness for Scientific AI Datasets
SetGo assesses and repairs metadata readiness of scientific AI datasets before publication, raising FAIR scores on four benchmark corpora from ~52–57% to ~81–91%.
-
Integrating GNSS-Derived Zenith Wet Delay into a Weather Foundation Model Improves Precipitation Forecasting
Adding GNSS-derived Zenith Wet Delay as an input to a fine-tuned Aurora weather model improves 6-hour precipitation skill, with gains concentrated in extreme events (ETS99 +8.8%).
-
Signal or Noise? Understanding Generative Models for Real-World Sensor Time Series
Across 14 sensor generation settings, flow-matching models are the strongest overall baseline, while demographic conditioning, time-frequency modeling, and moderate synthetic augmentation improve hard regimes and down...
-
From Global to Local: Efficient Regional Weather Downscaling with Global Weather Foundation Model
Frozen Aurora latent embeddings plus multi-scale MLP heads downscale global weather to mesoscale resolution, often beating WRF-ARW and image super-resolution at far lower cost.
-
Less Tokens, Better Forecasts: Sparse Residual Routing for Efficient Weather Prediction
Sparse residual routing of 25% of spatial tokens through middle ViT blocks improves ERA5 weather forecast skill while cutting training time ~2.5x and peak memory >2.2x.
-
Automated Data Readiness for Scientific AI
REDI automates raw-to-AI-ready scientific data prep via a five-stage IPTSO pipeline with provenance, readiness scoring, and multi-domain validation matching expert references.
-
Learning Spatio-Temporal Foundation Models from Pure Synthetic Data
A spatio-temporal foundation model pre-trained exclusively on synthetic stochastic graph dynamics outperforms real-data-pretrained STFMs in zero-shot traffic forecasting, according to the paper's benchmarks.
-
STaT: Resolving Shape Distortion in Non-Stationary Time Series via Tri-Modal Synergy
STaT is a Symbolic-Temporal-Textual Alignment model that integrates three modalities to reduce shape distortion in non-stationary time series forecasting, reporting up to 8.9% gains in magnitude metrics and 8.5% less ...
-
No Epoch Like the Present: Robust Climate Emulation Requires Out-of-Distribution Generalisation
ML climate emulators degrade under seasonal distribution shifts that proxy long-term climate change, but physically motivated compositional decompositions improve out-of-distribution performance with modest in-distrib...
-
SAFE-SVD: Sensitivity-Aware Fidelity-Enforcing SVD for Physics Foundation Models
SAFE-SVD introduces a sensitivity-aware fidelity-enforcing SVD framework for compressing physics foundation models that maintains higher accuracy than standard methods at greater compression ratios.
-
Does Your Wildfire Prediction Model Actually Work, or Just Score Well?
Introduces WILDFIRE-FM and a fixed-contract evaluation framework demonstrating that wildfire model transfer conclusions depend strongly on evaluation design and task formulation.
-
Multi-Quantile Regression for Extreme Precipitation Downscaling
Q-SRDRN multi-quantile network with pinball loss and per-quantile heads detects extreme precipitation events up to 18 times more effectively than deterministic baselines while preserving augmentation benefits for the median.
-
MixINN: Accelerating Plant Breeding by Combining Mixed Models and Deep Learning for Interaction Prediction
MixINN combines mixed models and deep learning to predict genotype-environment interactions in corn trials, yielding 5.8-7.2% higher average yields when selecting top-performing genotypes compared to standard methods.
-
Deep Wave Network for Modeling Multi-Scale Physical Dynamics
DW-Net improves the accuracy versus computational cost Pareto front over standard U-Nets for 2D and 3D multi-scale flow benchmarks by stacking multiple waves while keeping training settings identical.
-
A Multimodal Vision Transformer-based Modeling Framework for Prediction of Fluid Flows in Energy Systems
A multimodal SwinV2-UNet vision transformer conditioned on data modality and time predicts spatiotemporal fluid flows and reconstructs unobserved fields from limited views using CFD data of argon jet injection.
-
Generalized Spherical Neural Operators: Green's Function Formulation
GSNO uses position-dependent spherical Green's functions to create flexible neural operators that adapt to non-equivariant systems on spheres while keeping spectral efficiency and grid invariance.
-
Towards a Physics Foundation Model
A single transformer-based model, GPhyT, trained on diverse 2D simulation data, predicts next states across several fluid and heat-transfer systems and extrapolates to similar unseen regimes with plausible results.
-
GAIR: Location-Aware Self-Supervised Contrastive Pre-Training with Geo-Aligned Implicit Representations
GAIR introduces a geo-aligned implicit representation module inside a multi-encoder contrastive SSL framework that produces location-aware embeddings and outperforms prior geo-foundation models on 22 geospatial datase...
-
Nipping the Butterfly Effect in the Bud: Self-Output Fine-Tuning for Autoregressive Weather Prediction
SOFT fine-tunes a weather model on its own one-step predictions, reducing long-horizon autoregressive error by aligning inputs with the training distribution.
-
Apeliotes: A Diffusion-Based Modeling Framework for km-scale Multi-Level Atmospheric Fields
A diffusion downscaler trained on WRF data and driven by the Aurora foundation model generates 4-km multi-level atmospheric fields, including vertical wind profiles, with reported correlations of 0.91-0.99.
-
Learning Climate Variability from Scarce Data with Diffusion Models: A Test Case for ENSO
Diffusion models recover known ENSO variability structure from synthetic LIM data when given enough samples, but require pre-training on CMIP6 plus fine-tuning to match observations with the ~700 samples available in ERSSTv5.
-
Otter Weather: Skillful and Computationally Efficient Medium-Range Weather Forecasting
Otter Weather is a spatiotemporal model that outperforms NWP baselines by 9.6% at 24h lead with under 3.5 A100-days training and extends efficiency gains to probabilistic forecasting via CRPS.
-
Emerging Flexible Designs for Geospatial Multimodal Foundation Models
Standardized pretraining and evaluation of geospatial multimodal foundation models on GEOBench reveals design trade-offs in flexibility, modality alignment, and task performance.
-
Probabilistic Precipitation Nowcasting with Rectified Flow Transformers
FREUD applies rectified flow transformers with frame-wise encoding and a unified decoder to achieve state-of-the-art probabilistic precipitation nowcasting on the SEVIR benchmark.
-
Hybrid Quantum-Classical Corrective Diffusion Modeling for Meteorological Downscaling
Hybrid quantum-classical corrective diffusion model improves MAE and CRPS on 2020 validation wind data but exhibits a generalization gap on 2021 out-of-distribution tests.
-
PINN-Cast: Exploring the Role of Continuous-Depth NODE in Transformers and Physics Informed Loss as Soft Physical Constraints in Short-term Weather Forecasting
PINN-Cast combines continuous-depth Neural ODEs inside transformer blocks with a two-branch attention module and physics-informed loss to produce short-term weather forecasts that respect governing physical principles.
-
Towards Scaling Law Analysis For Spatiotemporal Weather Data
Scaling laws for weather models exhibit strong cross-channel and cross-horizon heterogeneity, where globally pooled metrics appear favorable while many individual channels degrade at longer leads.
-
HVR-Met: A Hypothesis-Verification-Replanning Agentic System for Extreme Weather Diagnosis
HVR-Met reports pass rates of 71.86% on index calculation, 79.52% on plotting, and 85% on final reports using a hypothesis-verification-replanning agent loop.
-
PIANO: Physics Informed Autoregressive Network
PIANO makes physics-informed neural networks autoregressive, rolling out predictions conditioned on past states under physics constraints, and claims stable, accurate long-horizon PDE and weather forecasts.
-
On the Genealogy of Machine Learning Weather Prediction
ML weather prediction inherited NWP’s IVP framing, so model choice should explicitly align with either physical system structure or data statistical structure rather than defaulting to learned time-steppers.
-
Factorized Neural Operators Decompose Dynamic and Persistent Responses
FaNO splits spectral neural operators into a dynamic branch and a static global-scaled persistent branch, improving weather, fluid, and geometry benchmarks.
-
LangRetrieval: Language-Guided Self-Evolving Satellite-to-Radar Retrieval via CSI-Driven Reward
LangRetrieval is a conditional flow matching framework with semantic warm-up and GRPO-based self-evolving optimization using CSI rewards to improve satellite-to-radar precipitation retrieval.
-
AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discovery
A survey organizing AI-powered research automation into five workflow stages, defining AutoResearch and Vibe Research, and proposing five evaluation dimensions while noting domain-conditioned limits on autonomy.
-
Scalable and Trustworthy Earth Observation Foundation Models
Remote-sensing foundation models need domain-specific design and evaluation around measurement physics and decision constraints; benchmark accuracy alone is insufficient for trustworthy EO deployment.
-
Towards a Foundation Model for the Martian Atmosphere
The paper reviews data sources, physical models, downstream applications, and AI techniques to outline considerations for building a foundation model for the Martian atmosphere.
-
Earth Science Foundation Models: From Perception to Reasoning and Discovery
The paper delivers a unified review and roadmap of Earth science foundation models, structured by capability depth from perception to agentic reasoning and by application breadth across atmosphere, hydrosphere, lithos...
-
Physics-Encoded Inverse Modeling for Arctic Snow Depth Estimation
PhysE-Inv predicts a snow-depth proxy generated from the same ERA5 inputs the model sees, so its accuracy against real Arctic snow depth is unestablished.
-
Earth Science Foundation Models: From Perception to Reasoning and Discovery
A review of Earth science foundation models covering capability evolution from perception to discovery, applications across atmosphere/hydrosphere/lithosphere/biosphere/anthroposphere/cryosphere, over 200 datasets, an...
-
Toward Artificial Intelligence Enabled Earth System Coupling
AI methods can strengthen cross-domain interactions and support more coherent multi-component representations in Earth system models.
-
Position: Multimodal Large Language Models Can Significantly Advance Scientific Reasoning
Position paper claims multimodal LLMs can significantly advance scientific reasoning and proposes a four-stage roadmap plus challenges and suggestions.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.