Pith. sign in

REVIEW 7 cited by

One Fits All:Power General Time Series Analysis by Pretrained LM

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2302.11939 v6 pith:GPS7PZGA submitted 2023-02-23 cs.LG cs.AI

Tian Zhou , PeiSong Niu , Xue Wang , Liang Sun , Rong Jin This is my paper · ORCID
classification cs.LGcs.AI
keywords analysisseriestimepre-trainedlanguagemodelmodelstasks
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Although we have witnessed great success of pre-trained models in natural language processing (NLP) and computer vision (CV), limited progress has been made for general time series analysis. Unlike NLP and CV where a unified model can be used to perform different tasks, specially designed approach still dominates in each time series analysis task such as classification, anomaly detection, forecasting, and few-shot learning. The main challenge that blocks the development of pre-trained model for time series analysis is the lack of a large amount of data for training. In this work, we address this challenge by leveraging language or CV models, pre-trained from billions of tokens, for time series analysis. Specifically, we refrain from altering the self-attention and feedforward layers of the residual blocks in the pre-trained language or image model. This model, known as the Frozen Pretrained Transformer (FPT), is evaluated through fine-tuning on all major types of tasks involving time series. Our results demonstrate that pre-trained models on natural language or images can lead to a comparable or state-of-the-art performance in all main time series analysis tasks, as illustrated in Figure 1. We also found both theoretically and empirically that the self-attention module behaviors similarly to principle component analysis (PCA), an observation that helps explains how transformer bridges the domain gap and a crucial step towards understanding the universality of a pre-trained transformer.The code is publicly available at https://github.com/DAMO-DI-ML/One_Fits_All.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 7 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. OpenAlex reports about 118 citations worldwide. Full citation record

  1. A Cost-Effective Multimodal LLM Reasoning Framework for Question Answering over Irregular Clinical Time Series

    cs.AI 2026-07 conditional novelty 6.0 of 10

    ClinPRISM reaches 49.83% average accuracy on CLIR-Bench irregular clinical time-series QA using a 4B LLM, 16 temporal tokens, and 0.15 s/question.

  2. LLM-Guided Task-Semantic Field Factorization for Industrial Process Forecasting

    cs.LG 2026-07 conditional novelty 6.0 of 10

    TSF converts process variable documents into frozen semantic vectors that scale the numerical input window before a time-series backbone, yielding average MAE reductions of 2.9–3.6% across industrial forecasting tasks.

  3. Surprised by Attention: Predictable Query Dynamics for Time Series Anomaly Detection

    cs.LG 2026-03 conditional novelty 6.0 of 10

    Predicting multi-head attention queries from history and scoring cosine mismatch against an EMA target, combined with reconstruction error, improves unsupervised multivariate anomaly ranking and localization.

  4. Modular Foundation Models for Time-Series Perception in Digital Twins

    cs.LG 2026-07 conditional novelty 5.0 of 10

    A gated bank of frozen self-supervised time-series encoders, aligned and aggregated by a Transformer, supports competitive multi-task perception for digital twins and hydro-generator virtual sensing.

  5. MSTN: A Lightweight and Fast Model for General TimeSeries Analysis

    cs.LG 2025-11 unverdicted novelty 5.0 of 10

    MSTN is a lightweight hybrid model that reports new state-of-the-art results on 33 of 40 time series benchmarks for imputation, forecasting, and classification while using under one million parameters and sub-second i...

  6. LLM4Delay: Flight Delay Prediction via Cross-Modality Adaptation of Large Language Models and Aircraft Trajectory Representation

    cs.LG 2025-10 unverdicted novelty 5.0 of 10

    LLM4Delay improves flight delay prediction accuracy by using instance-level projection to adapt LLMs for integrating textual aeronautical information with multiple aircraft trajectories.

  7. Evaluation of a Foundational Model and Stochastic Models for Forecasting Sporadic or Spiky Production Outages of High-Performance Machine Learning Services

    cs.LG 2025-06 conditional novelty 5.0 of 10

    On seven years of monthly production outage counts from a large ML service, a fine-tuned TimesFM foundation model beats moving-average and autoregressive baselines for total outages, but per root cause the best model varies.

Pith tools