Pith. sign in

REVIEW 9 cited by

Predicting Physics in Mesh-reduced Space with Temporal Attention

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2201.09113 v4 pith:XVIIZEHC submitted 2022-01-22 cs.LG

classification cs.LG
keywords temporalattentioncomplexmodelshigh-dimensionalmeshmethodmodel
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Graph-based next-step prediction models have recently been very successful in modeling complex high-dimensional physical systems on irregular meshes. However, due to their short temporal attention span, these models suffer from error accumulation and drift. In this paper, we propose a new method that captures long-term dependencies through a transformer-style temporal attention model. We introduce an encoder-decoder structure to summarize features and create a compact mesh representation of the system state, to allow the temporal model to operate on a low-dimensional mesh representations in a memory efficient manner. Our method outperforms a competitive GNN baseline on several complex fluid dynamics prediction tasks, from sonic shocks to vascular flow. We demonstrate stable rollouts without the need for training noise and show perfectly phase-stable predictions even for very long sequences. More broadly, we believe our approach paves the way to bringing the benefits of attention-based sequence models to solving high-dimensional complex physics tasks.

Discussion (0). Sign in to comment.

Forward citations

Cited by 9 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Spatio-Temporal Prediction of Unsteady Airfoil Aerodynamics Using Augmented Graph Neural Ordinary Differential Equations with Exogenous Controls

    cs.LG 2026-07 conditional novelty 6.0 of 10

    GNODE, a graph-neural-network-plus-neural-ODE surrogate with augmented latent dimensions, predicts unsteady transonic airfoil flows with more stable and accurate rollouts than an autoregressive GNN baseline.

  2. Adaptive Physics Transformer with Fused Global-Local Attention for Subsurface Energy Systems

    cs.LG 2026-02 conditional novelty 6.0 of 10

    APT, a mesh-agnostic neural operator fusing graph-based local features with global attention, is claimed to be the first architecture trained directly on adaptive-mesh-refinement simulations and outperforms state-of-t...

  3. M4GN: Mesh-based Multi-segment Hierarchical Graph Network for Dynamic Simulations

    cs.LG 2025-09 conditional novelty 6.0 of 10

    A hierarchical mesh-graph network with modal-decomposition-guided segmentation reports up to 56% lower rollout error than baselines and introduces a long-range beam-deformation benchmark.

  4. Point-wise Diffusion Models for Physical Systems with Shape Variations: Application to Spatio-temporal and Large-scale system

    physics.comp-ph 2025-08 unverdicted novelty 6.0 of 10

    A point-wise diffusion transformer predicts spatio-temporal physical fields on arbitrary meshes and point clouds, claiming up to 200x faster inference and better accuracy than image-based diffusion surrogates.

  5. Thickness-aware E(3)-Equivariant 3D Mesh Neural Networks

    cs.CV 2025-05 conditional novelty 6.0 of 10

    A mesh GNN that links opposite surfaces via learned thickness edges improves node-level 3D deformation prediction while a PCA-based canonical coordinate system preserves E(3) equivariance.

  6. Data-free neural PDE solvers based on Graph Neural Networks and weak forms

    cs.CE 2026-07 conditional novelty 5.0 of 10

    A graph-neural-network PDE solver trained on the weak-form force residual — no simulation data — reports residual convergence below 1% on unseen load cases and one modified geometry, with residual-based test-time refinement.

  7. Inferring processes within dynamic forest models using hybrid modeling

    q-bio.QM 2025-08 unverdicted novelty 5.0 of 10

    The abstract claims a hybrid gap-model plus neural-network approach, FINN, improves forest growth inference and forecasting, but the manuscript body is an unrelated diffusion-model paper, so the abstract's claims are ...

  8. GITO: Graph-Informed Transformer Operator for Learning Complex Partial Differential Equations

    cs.LG 2025-06 conditional novelty 5.0 of 10

    GITO, a graph-informed transformer operator, reports lower relative L2 errors than existing transformer-based neural operators on Navier-Stokes, heat conduction, and airfoil benchmark datasets.

  9. FIGNN: Feature-Specific Interpretability for Graph Neural Network Surrogate Models

    cs.LG 2025-06 conditional novelty 5.0 of 10

    FIGNN adds per-feature Top-K masking branches to a frozen GNN surrogate, producing variable-specific spatial attributions and error budgets for climate and fluid dynamics forecasts.

Pith tools