REVIEW 14 cited by
TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecasting
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
The past decade has witnessed significant advances in time series modeling with deep learning. While achieving state-of-the-art results, the best-performing architectures vary highly across applications and domains. Meanwhile, for natural language processing, the Generative Pre-trained Transformer (GPT) has demonstrated impressive performance via training one general-purpose model across various textual datasets. It is intriguing to explore whether GPT-type architectures can be effective for time series, capturing the intrinsic dynamic attributes and leading to significant accuracy improvements. In this paper, we propose a novel framework, TEMPO, that can effectively learn time series representations. We focus on utilizing two essential inductive biases of the time series task for pre-trained models: (i) decomposition of the complex interaction between trend, seasonal and residual components; and (ii) introducing the design of prompts to facilitate distribution adaptation in different types of time series. TEMPO expands the capability for dynamically modeling real-world temporal phenomena from data within diverse domains. Our experiments demonstrate the superior performance of TEMPO over state-of-the-art methods on zero shot setting for a number of time series benchmark datasets. This performance gain is observed not only in scenarios involving previously unseen datasets but also in scenarios with multi-modal inputs. This compelling finding highlights TEMPO's potential to constitute a foundational model-building framework.
Forward citations
Cited by 14 Pith papers
-
Reprogramming Vision Foundation Models for Spatio-Temporal Forecasting
ST-VFM reprograms frozen vision foundation models with temporal-aware token adapters and cross-prompt coordination, and reports state-of-the-art results on ten spatio-temporal forecasting benchmarks.
-
TSRouter: Dynamic Modality-Model Selection for Time Series Reasoning
A heterogeneous-graph router jointly selects the optimal modality (text, vision, or both) and model per time series query, beating prior routing baselines and generalizing to unseen models and tasks.
-
A Cost-Effective Multimodal LLM Reasoning Framework for Question Answering over Irregular Clinical Time Series
ClinPRISM reaches 49.83% average accuracy on CLIR-Bench irregular clinical time-series QA using a 4B LLM, 16 temporal tokens, and 0.15 s/question.
-
Taming Text-to-Sounding Video Generation via Advanced Modality Condition and Interaction
Separating the text condition into a video caption and a visually grounded audio caption, and fusing the diffusion towers with dual cross-attention, gives the reported-best text-to-sounding-video quality and synchroni...
-
Mobile Traffic Prediction using LLMs with Efficient In-context Demonstration Selection
A two-step in-context demonstration selection method, based on distance similarity and zero-shot prediction error, improves LLM-based mobile traffic prediction on a real 5G dataset compared with zero-shot and simple b...
-
Hopformer: Homogeneity-Pursuit Transformer for Time Series Forecasting
A two-stage forecaster (SPA trend extraction + LoRA-fine-tuned residual Transformer) that the paper claims beats prior models by 6.56% MASE, though the claim is not robust to its own extended baseline tables.
-
BALM-TSF: Balanced Multimodal Alignment for LLM-Based Time Series Forecasting
BALM-TSF combines a statistical-prompt text branch with a patch-based time series branch, using scaling plus contrastive alignment to balance the two modalities, improving long-term and few-shot forecasting on five of...
-
LSDM: LLM-Enhanced Spatio-temporal Diffusion Model for Service-Level Mobile Traffic Prediction
LSDM predicts next-hour mobile traffic per app category by feeding a diffusion model with satellite imagery, POI counts, and LLM-generated text descriptions, outperforming eight baselines on a single real-world dataset.
-
Causal Graph Fuzzy LLMs: A First Introduction and Applications in Time Series Forecasting
CGF-LLM combines fuzzy time series and PCMCI causal graphs into text input for fine-tuned GPT-2, reporting improved one-step-ahead forecast NRMSE and a reduction in token count on four datasets.
-
Fusing Large Language Models with Temporal Transformers for Time Series Forecasting
A gated fusion of GPT-2 semantic features and a PatchTST-style Transformer encoder improves average MSE/MAE slightly on ETT, Weather, and ILI, while losing to PatchTST on four of the six datasets.
-
Fourier Basis Mapping: A Time-Frequency Learning Framework for Time Series Forecasting
Using Fourier basis expansion to build time-frequency features improves long-term and short-term time series forecasting across linear, MLP, and transformer backbones.
-
On Identifying Why and When Foundation Models Perform Well on Time-Series Forecasting Using Automated Explanations and Rating
On four public datasets, Gradient Boosting with hand-built features beat Chronos, Llama, and ARIMA on most accuracy metrics, while Chronos only led on financial sMAPE.
-
Foundation Models for Demand Forecasting via Dual-Strategy Ensembling
A dual ensemble of hierarchical partitions and diverse backbones improves foundation-model sales forecasts on M5 and three external datasets, though the zero-shot protocol is under-specified.
-
Large Language models for Time Series Analysis: Techniques, Applications, and Challenges
A review of LLM-based time series analysis that proposes several taxonomies, but is undermined by citation errors and a lack of systematic methodology.
Discussion (0). Sign in to comment.