REVIEW 7 cited by
Data driven weather forecasts trained and initialised directly from observations
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Data driven weather forecasts trained and initialised directly from observations
read the original abstract
Skilful Machine Learned weather forecasts have challenged our approach to numerical weather prediction, demonstrating competitive performance compared to traditional physics-based approaches. Data-driven systems have been trained to forecast future weather by learning from long historical records of past weather such as the ECMWF ERA5. These datasets have been made freely available to the wider research community, including the commercial sector, which has been a major factor in the rapid rise of ML forecast systems and the levels of accuracy they have achieved. However, historical reanalyses used for training and real-time analyses used for initial conditions are produced by data assimilation, an optimal blending of observations with a physics-based forecast model. As such, many ML forecast systems have an implicit and unquantified dependence on the physics-based models they seek to challenge. Here we propose a new approach, training a neural network to predict future weather purely from historical observations with no dependence on reanalyses. We use raw observations to initialise a model of the atmosphere (in observation space) learned directly from the observations themselves. Forecasts of crucial weather parameters (such as surface temperature and wind) are obtained by predicting weather parameter observations (e.g. SYNOP surface data) at future times and arbitrary locations. We present preliminary results on forecasting observations 12-hours into the future. These already demonstrate successful learning of time evolutions of the physical processes captured in real observations. We argue that this new approach, by staying purely in observation space, avoids many of the challenges of traditional data assimilation, can exploit a wider range of observations and is readily expanded to simultaneous forecasting of the full Earth system (atmosphere, land, ocean and composition).
Forward citations
Cited by 7 Pith papers
-
AIFS-DOP: End-to-End Medium-Range Weather Prediction from Observations Alone with Machine Learning
An ML model trained only on harmonized gridded observations achieves competitive medium-range weather forecast skill with the IFS for several upper-air and surface headline scores when verified against observations.
-
Global reanalysis from observations alone with machine learning
Observation-only machine learning can generate multi-decade global atmospheric reanalyses with large-scale skill near ERA5 and surface errors between ERA-Interim and ERA5, in a single day of compute.
-
Skillful high-resolution weather forecasting independent of physical models
ObsCast produces skillful short-term high-resolution weather analyses and forecasts over the contiguous US and Europe using only observational data, outperforming operational NWP without relying on NWP-derived data fo...
-
Earth-o1: A Grid-free Observation-native Atmospheric World Model
Earth-o1 learns continuous atmospheric dynamics from ungridded observations and matches operational IFS forecast skill in hindcasts.
-
HealDA: Highlighting the importance of initial errors in end-to-end AI weather forecasts
HealDA supplies ML-based initial conditions for AI weather models that produce forecasts trailing ERA5-initialized runs by less than one day of effective lead time, with the skill gap arising mainly from initial error size.
-
Machine learning is revolutionizing weather forecasting -- the next step is a change in how we work
Machine learning success in weather prediction will drive changes in development practices, data handling, verification, and service creation at weather centers.
-
Toward Artificial Intelligence Enabled Earth System Coupling
AI methods can strengthen cross-domain interactions and support more coherent multi-component representations in Earth system models.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.