Pith. sign in

REVIEW 8 cited by

Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2106.13008 v5 pith:YATVK45K submitted 2021-06-24 cs.LG cs.AI

Haixu Wu , Jiehui Xu , Jianmin Wang , Mingsheng Long This is my paper
classification cs.LGcs.AI
keywords seriesautoformerlong-termauto-correlationdecompositionforecastingdependenciesdesign
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Extending the forecasting time is a critical demand for real applications, such as extreme weather early warning and long-term energy consumption planning. This paper studies the long-term forecasting problem of time series. Prior Transformer-based models adopt various self-attention mechanisms to discover the long-range dependencies. However, intricate temporal patterns of the long-term future prohibit the model from finding reliable dependencies. Also, Transformers have to adopt the sparse versions of point-wise self-attentions for long series efficiency, resulting in the information utilization bottleneck. Going beyond Transformers, we design Autoformer as a novel decomposition architecture with an Auto-Correlation mechanism. We break with the pre-processing convention of series decomposition and renovate it as a basic inner block of deep models. This design empowers Autoformer with progressive decomposition capacities for complex time series. Further, inspired by the stochastic process theory, we design the Auto-Correlation mechanism based on the series periodicity, which conducts the dependencies discovery and representation aggregation at the sub-series level. Auto-Correlation outperforms self-attention in both efficiency and accuracy. In long-term forecasting, Autoformer yields state-of-the-art accuracy, with a 38% relative improvement on six benchmarks, covering five practical applications: energy, traffic, economics, weather and disease. Code is available at this repository: \url{https://github.com/thuml/Autoformer}.

Discussion (0). Sign in to comment.

Forward citations

Cited by 8 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. TelecomTS: A Multi-Modal Observability Dataset for Time Series and Language Analysis

    cs.AI 2025-10 conditional novelty 7.0 of 10

    TelecomTS is a new observability dataset from 5G networks that preserves absolute scale and supports multi-modal tasks, showing that current time series and language models struggle with abrupt noisy dynamics.

  2. Time Series Foundation Models for Multivariate Financial Time Series Forecasting

    q-fin.GN 2025-07 reject novelty 6.0 of 10

    Pretrained TTM shows large transfer and sample-efficiency gains in three financial forecasting tasks relative to training from scratch, but methodological flaws including possible look-ahead bias weaken the quantitati...

  3. RhyMix: A Lightweight Adaptive Multi-Rhythm Network for Long-Term Time Series Forecasting

    cs.LG 2026-07 conditional novelty 5.5 of 10

    RhyMix reaches state-of-the-art long-term multivariate forecasting on 10 of 12 public benchmarks with a ~40K-parameter dual-path adaptive architecture of linear complexity.

  4. Exogenous Dropout: A Simple, Strong Baseline for Corruption-Robust Time Series Forecasting with Covariates

    cs.LG 2026-07 conditional novelty 5.0 of 10

    Exogenous dropout, a model-agnostic whole-channel training mask, restores corruption robustness better than a deliberately bounded gated-FiLM architecture across three forecasting domains.

  5. MSTN: A Lightweight and Fast Model for General TimeSeries Analysis

    cs.LG 2025-11 unverdicted novelty 5.0 of 10

    MSTN is a lightweight hybrid model that reports new state-of-the-art results on 33 of 40 time series benchmarks for imputation, forecasting, and classification while using under one million parameters and sub-second i...

  6. FinCast: A Foundation Model for Financial Time-Series Forecasting

    cs.LG 2025-08 conditional novelty 5.0 of 10

    FinCast, a 1B-parameter sparse-MoE transformer pretrained on 20B+ financial time points, reports 20% and 23% average MSE reductions over SOTA in zero-shot and supervised financial forecasting.

  7. Towards Foundation Auto-Encoders for Time-Series Anomaly Detection

    cs.LG 2025-07 conditional novelty 4.0 of 10

    A univariate VAE with dilated convolutions is proposed as a simple 'foundation' model for time-series anomaly detection, with preliminary zero-shot experiments on two datasets.

  8. Foundation Models for Clean Energy Forecasting: A Comprehensive Review

    eess.SY 2025-07 conditional novelty 3.0 of 10

    A survey of foundation model methods, data, and open problems for renewable energy forecasting, built from roughly 218 cited works.

Pith tools