Pith. sign in

REVIEW 4 major objections 5 minor 17 references

Paper claims a scaling law linking training sample counts to predictive horizon in chaotic time series, with zero-shot gains on Bitcoin returns.

Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →

T0 review · deepseek-v4-flash

2026-08-05 05:48 UTC pith:VQEJVCMM

load-bearing objection The scaling law is extrapolated, not observed, and the financial edge leaks test-window information, but the resampled-Lorenz pretraining recipe is a genuinely useful construction worth a careful second look. the 4 major comments →

arxiv 2509.04921 v1 pith:VQEJVCMM submitted 2025-09-05 cs.LG

Scaling Law for Large-Scale Pre-Training Using Chaotic Time Series and Predictability in Financial Time Series

classification cs.LG
keywords time series forecastingchaotic time seriesLorenz modelscaling lawszero-shot transferfinancial time seriesTransformerBitcoin prediction
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

Financial time series, the paper argues, are discrete samples of a chaotic process at the microstructure scale, so synthetic Lorenz-system trajectories resampled at wider and wider intervals can stand in for real tick data. On this premise, the author trains a 0.1M to 10M parameter decoder-only Transformer on 10 billion samples per resampling horizon and reports a scaling-law-like relationship: to hold one-step-ahead prediction skill (correlation 0.1) as the horizon grows, the number of training samples must grow exponentially. The same pretrained models, used zero-shot on Bitcoin order flow, price change, and volume aggregated at 5 to 60 second timeframes, are claimed to beat an autocorrelation baseline, with the 1000-unit horizon matching roughly 10 to 15 second data. The payoff, if the law is robust, is that near-future prediction of some real-world series becomes a question of compute budget.

Core claim

The central claim is that a Transformer trained only on resampled Lorenz-model trajectories, never on real financial data, can predict one-step-ahead financial returns better than a statistical autocorrelation model, and that the horizon it can look ahead is governed by a scaling law. The mapping is x = order flow, y = price change rate, and z = volume, with Lorenz parameters sampled from sigma in [9,11], rho in [26,30], beta in [2.3,3.1] to simulate variation across assets. Trained with causal self-attention, a 512-token context, and a single epoch over 10 billion samples at resampling intervals 100 to 1000, the model maintains a correlation of about 0.1 between predicted and actual y; the

What carries the argument

The load-bearing object is the resampled Lorenz trajectory. The Lorenz equations dx/dt = sigma(y-x), dy/dt = x(rho-z)-y, dz/dt = xy-beta*z are integrated at Delta t = 0.01 and then sampled every R in {100,...,1000} integration steps; the resampling interval R is the predictive horizon in 'unit time', and each 513-step resampled sequence yields 512 one-step-ahead training examples through the model's causal mask. The paper assigns x to order flow, y to price change rate (the trading signal), and z to volume, citing a prior result that price-volume dynamics can take the Lorenz form. The scaling law is read from the training-sample count needed to reach correlation 0.1 against the target y at e

Load-bearing premise

Bitcoin order flow, price change, and volume are discrete observations of a chaotic microstructure process whose state space can be approximated by resampled Lorenz trajectories with parameters in the chosen ranges; the paper gives a visual comparison but no quantitative test of this equivalence.

What would settle it

Compute the scaling-law curve for a horizon beyond 1000, say 2000, at 100 to 200 billion samples: if the correlation at 0.1 does not appear in the extrapolated sample budget, the law is an artifact of the chosen range. Alternatively, hold the resampled-Lorenz training fixed and test on a non-chaotic stochastic process with matched autocorrelation and volatility; if the model's excess return over autocorrelation disappears, the transfer is not specifically chaos.

Watch this falsifier. Get emailed when new claim-graph text bears on it.

Share X Bluesky LinkedIn Reddit HN

If this is right

  • If the scaling law holds, pushing from horizon 1000 to longer horizons requires 100-200 billion sample-class budgets, so the achievable look-ahead is bounded by compute and data generation cost.
  • Long-horizon pretraining transfers better than horizon-matched training in the tested range; 1000-unit models dominate on Bitcoin at all timeframes, suggesting the relevant training distribution should be deliberately more 'chaotic-difficult'.
  • Zero-shot transfer to real financial data, if real, makes synthetic chaotic pretraining a viable route for sub-minute trading signals without access to proprietary tick data.
  • The attractor formation during training, with the model gradually reconstructing the Lorenz state space in its predictions, provides a qualitative diagnostic for when scale is enough.
  • The approach is data-inexpensive in one dimension: since chaotic trajectories are generated on the fly, 10 billion samples require no storage or curation, only simulation compute.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • Inference: if the scaling law is a property of deterministic chaotic systems generally, the same resampling-plus-pretraining recipe should transfer to other chaotic equations such as Mackey-Glass, Rossler, or Henon; a positive result there would make the law a generic feature rather than a Lorenz quirk.
  • Inference: the paper leaves open the baseline question; a stochastic process with the same autocorrelation structure as resampled Lorenz (for example, a matched AR(1)) would separate the model having learned chaos from the model having learned autocorrelation, since the current comparison uses only the autocorrelation model.
  • Inference: the zero-shot profitability claim is measured pre-cost; a testable extension is to include realistic taker and maker fees at 5 to 30 second holding periods. The paper acknowledges that fees would erode profits, so the claim that matters is predictive skill, not tradable alpha.
  • Inference: if the microstructure-chaos premise is right, the paper implies that very short-horizon prediction (seconds) is the regime where deterministic structure is visible, while daily returns are noise-dominated; that would help explain the conflicting evidence on financial chaos.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Referee Report

4 major / 5 minor

Summary. The paper proposes to model financial time series by resampling chaotic Lorenz-system trajectories at various intervals, pretraining a decoder-only Transformer on 10 billion samples per horizon (100–1000 integration units), and then applying the pretrained models zero-shot to Bitcoin trade data aggregated at 5–60 second timeframes. The main claims are (i) a scaling-law-like phenomenon in which the training-sample count needed to reach an information coefficient of 0.1 grows exponentially with the predictive horizon, and (ii) that the pretrained models yield significant performance improvements over an autocorrelation baseline in a long/short trading evaluation.

Significance. If the scaling law were actually observed and transferable to financial data, this would be a notable result: it would connect chaotic dynamics pretraining with a concrete resource-accuracy trade-off and a forward-looking claim about near-future predictability. The paper is honest about several limitations (e.g., non-convergence at long horizons), reports a substantial amount of training, and gives enough architecture/training detail to be reproducible in principle. However, the central contribution is not supported by the evidence as presented: the longest-horizon scaling-law point is extrapolated from a run that never reached the stated threshold, the financial evaluation appears to contain look-ahead bias, and the transfer premise is only visually illustrated. These issues are load-bearing, so the scientific contribution as claimed is not established.

major comments (4)
  1. [§3.2, Fig. 9] The central scaling-law claim is not supported by the reported measurements. The text states that for horizon 1000 the correlation coefficient did not reach 0.1 even after 10B samples and that no convergence was observed; the Fig. 9 point for 1000 is therefore extrapolated from an assumed trend ('approximately 100-200 billion training samples'). An extrapolated point cannot be reported as an observed scaling law. Moreover, each horizon is represented by a single run with no error bars, the IC=0.1 threshold is arbitrary, and five points (one extrapolated) cannot distinguish exponential from power-law growth. Since the abstract and conclusions explicitly say 'observed', this is a load-bearing inconsistency.
  2. [§3.3, Fig. 10/11, Table 2] The trading evaluation likely contains look-ahead bias. The strategy 'longs the top 20th percentile (top 5%) and shorts the bottom 5%' is described without stating that the percentile thresholds are computed only from information available at each prediction time. If the thresholds are full-window quantiles of the prediction distribution, the backtest uses future information and the excess-return improvements are invalid. Furthermore, 'significant performance improvements' is unsupported: no significance tests are reported, Table 2 shows negative excess returns for 25s, 30s, and 60s timeframes, and the positive results are concentrated at selected horizons after inspecting all horizons. The conclusion that models with longer horizons 'consistently' outperform is contradicted by Table 2 (e.g., 5s horizon 1000 excess 0.045 vs horizon 700 excess 0.071; 60s all negative).
  3. [§2.1, §2.4] The transfer from Lorenz resampled data to Bitcoin is not established. The paper's mapping of x,y,z to order flow, price change, and volume is based on a reference model and a visual comparison (Fig. 4). The Introduction itself cites conflicting evidence on whether financial time series are chaotic ([6]-[10]). No quantitative test of the equivalence is provided, nor an ablation with a different chaotic system or with shuffled/randomized training data. The zero-shot excess returns could therefore be coincidental. A minimal test would be to compare the pretrained model against a model trained on resampled data with different Lorenz parameters or against ARIMA/random-signal baselines with the same evaluation protocol.
  4. [§3.1, §3.2] The scaling-law plot uses the crossing time of IC=0.1 from curves that, by the paper's own account, have not converged for the longest horizons. §3.1 states that for horizons 700 and 1000 'no convergence in loss reduction was observed' even at 10B samples. A crossing time read from a non-converged curve is not a stable estimator of the sample requirement; the plotted relationship may shift substantially with longer training. This is not a minor caveat but undermines the quantitative form of the claimed law.
minor comments (5)
  1. [Title/Abstract] Typo in title: 'Tim e' should be 'Time'.
  2. [Fig. 7 caption] The caption reads 'completion points of 100 million, 100 million, and 1 billion training samples'; the second value is likely a typo (e.g., 300M or 500M).
  3. [§3.3] 'top 20th percentile (top 5%)' is ambiguous. Clarify whether the threshold is the top 5% of predictions or the top 20th percentile (i.e., top 20%).
  4. [§2.4, Eq. (2.1)] Equation (2.1) appears twice with the same number; the second occurrence in §2.4 should be renumbered.
  5. [Table 2] No error bars or variance estimates are reported for the return/excess-return values. Given the short evaluation window, some indication of variability (e.g., bootstrap CIs) is needed.

Circularity Check

0 steps flagged

No significant circularity: the zero-shot transfer and loss scaling are empirical; the extrapolated horizon-1000 point is an overclaim, not a circular reduction.

full rationale

The paper's central derivation is not circular. The Lorenz-model training data is generated from resampled chaotic time series independently of the Bitcoin test set, and the model weights are never updated on Bitcoin data, so the zero-shot predictions are genuine out-of-sample evaluations. The scaling-law claim rests on an empirical plot of training-sample counts needed to reach IC=0.1 at each horizon (Fig. 9). The horizon-1000 point is admittedly not observed: Sec. 3.2 states the correlation coefficient 'did not reach 0.1 even at the end of the 10 billion training sample period' and the 'approximately 100-200 billion' sample estimate is an extrapolation. That is an overclaim or robustness limitation, not a definitional identity: the paper does not present a fitted equation whose evaluation is then relabeled as a prediction. Similarly, the trading strategy in Sec. 3.3 uses prediction-percentile thresholds; if those thresholds are computed on the test set, that is in-sample evaluation leakage, but the same procedure is applied to the autocorrelation baseline, and it does not make the model's output equivalent to its training target by construction. There are no load-bearing self-citations, no imported uniqueness theorems, and no ansatz smuggled in via the author's own prior work; references [4], [5], and [11] are external. The paper's honest reporting of non-convergence actually weakens the scaling-law evidence but does not create circularity. Therefore the appropriate circularity score is 0.

Axiom & Free-Parameter Ledger

4 free parameters · 4 axioms · 0 invented entities

The central claims rest on: (1) a contested domain premise that financial series are chaotic at microstructure scales; (2) the adequacy of the Lorenz model with hand-chosen parameter ranges as the generative model; (3) a hand-picked IC=0.1 threshold that defines the scaling law; (4) a training-distribution assumption that random-parameter resampled Lorenz sequences transfer to real returns; and (5) full-window quantile thresholds in the strategy evaluation. No new physical entities are introduced.

free parameters (4)
  • Lorenz parameter sampling ranges (sigma 9-11, rho 26-30, beta 2.3-3.1; initial x,y,z 0.18-0.22)
    Hand-chosen ranges around representative values (sigma=10, rho=28, beta=8/3), not estimated from Bitcoin data; they define the synthetic training distribution that the transfer claim depends on (Sec. 2.1).
  • Skill threshold for the scaling law (IC = 0.1) = 0.1
    Hand-picked benchmark used to read off sample counts at each horizon in Fig. 9; cited to no external source, and the horizon-1000 crossing is extrapolated because IC never reached 0.1 at 10B samples (Sec. 3.2).
  • Long/short quantile thresholds (top/bottom 5%) = computed on the full test window
    Strategy thresholds estimated over the entire two-month Bitcoin test set (Sec. 3.3); applying them at trade time would use future information, and the reported excess returns depend on them.
  • Resampling intervals (predictive horizons) = [100, 200, 300, 400, 500, 700, 1000]
    Experimental design choices; the scaling law is measured across these, and the periods studied were not derived from data.
axioms (4)
  • domain assumption Financial time series possess chaotic properties at microstructure time scales and are discrete observations of a chaotic process
    Maintained despite contradictory evidence cited in the paper itself ([6][7][8] vs [9][10]); the entire synthetic-to-real transfer argument rests on it (Sec. 1).
  • domain assumption The Lorenz model with parameters in [9,11] x [26,30] x [2.3,3.1] is an adequate generator of financial microstructure dynamics
    Adopted from [11]; no parameter estimation or distributional validation against the Bitcoin test data, only a visual comparison (Sec. 2.1, Fig. 4).
  • domain assumption A transformer trained on resampled Lorenz sequences generalizes zero-shot to real financial returns
    Core transfer assumption; no mechanism is given and no non-chaotic control (e.g., noise with the same autocorrelation) is trained (Sec. 2.3, 3.3).
  • domain assumption Loss is MSE over the three Lorenz channels and this objective is aligned with one-step return prediction
    Training objective choice (Sec. 2.3).

pith-pipeline@v1.4.0-alltime-deepseek-medium · 10595 in / 22408 out tokens · 207279 ms · 2026-08-05T05:48:03.781428+00:00 · methodology

0 comments
Cite this review

Pith. "Pith review of Scaling Law for Large-Scale Pre-Training Using Chaotic Time Series and Predictability in Financial Time Series." pith.science (2026). https://pith.science/paper/VQEJVCMM

@misc{pith2026250904921,
  author       = {Pith},
  title        = {Pith review of: Scaling Law for Large-Scale Pre-Training Using Chaotic Time Series and Predictability in Financial Time Series},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/VQEJVCMM}},
  note         = {Machine review of arXiv:2509.04921}
}
Share X Bluesky LinkedIn Reddit HN
read the original abstract

Time series forecasting plays a critical role in decision-making processes across diverse fields including meteorology, traffic, electricity, economics, finance, and so on. Especially, predicting returns on financial instruments is a challenging problem. Some researchers have proposed time series foundation models applicable to various forecasting tasks. Simultaneously, based on the recognition that real-world time series exhibit chaotic properties, methods have been developed to artificially generate synthetic chaotic time series, construct diverse datasets and train models. In this study, we propose a methodology for modeling financial time series by generating artificial chaotic time series and applying resampling techniques to simulate financial time series data, which we then use as training samples. Increasing the resampling interval to extend predictive horizons, we conducted large-scale pre-training using 10 billion training samples for each case. We subsequently created test datasets for multiple timeframes using actual Bitcoin trade data and performed zero-shot prediction without re-training the pre-trained model. The results of evaluating the profitability of a simple trading strategy based on these predictions demonstrated significant performance improvements over autocorrelation models. During the large-scale pre-training process, we observed a scaling law-like phenomenon that we can achieve predictive performance at a certain level with extended predictive horizons for chaotic time series by increasing the number of training samples exponentially. If this scaling law proves robust and holds true across various chaotic models, it suggests the potential to predict near-future events by investing substantial computational resources. Future research should focus on further large-scale training and verifying the applicability of this scaling law to diverse chaotic models.

Figures

Figures reproduced from arXiv: 2509.04921 by Yuki Takemoto.

Figure 1
Figure 1. Figure 1: a) Financial time series versus various other real [PITH_FULL_IMAGE:figures/full_fig_p005_1.png] view at source ↗
Figure 2
Figure 2. Figure 2: a) Conventional Seq-to-Seq method for predicting [PITH_FULL_IMAGE:figures/full_fig_p006_2.png] view at source ↗
Figure 3
Figure 3. Figure 3: (first half) 7 [PITH_FULL_IMAGE:figures/full_fig_p007_3.png] view at source ↗
Figure 3
Figure 3. Figure 3: 10,000 sequences of representative training samp [PITH_FULL_IMAGE:figures/full_fig_p008_3.png] view at source ↗
Figure 4
Figure 4. Figure 4: State spaces (attractors) for each time series. To [PITH_FULL_IMAGE:figures/full_fig_p011_4.png] view at source ↗
Figure 5
Figure 5. Figure 5: Prediction results for chaotic time series. a)–c) [PITH_FULL_IMAGE:figures/full_fig_p012_5.png] view at source ↗
Figure 6
Figure 6. Figure 6: a) Loss curve as a function of the number of trained s [PITH_FULL_IMAGE:figures/full_fig_p013_6.png] view at source ↗
Figure 7
Figure 7. Figure 7: Evolution of state space in prediction outputs (pr [PITH_FULL_IMAGE:figures/full_fig_p013_7.png] view at source ↗
Figure 8
Figure 8. Figure 8: Variation of loss curve with model parameter count [PITH_FULL_IMAGE:figures/full_fig_p014_8.png] view at source ↗
Figure 9
Figure 9. Figure 9: Scaling law for predictive horizon length in chaot [PITH_FULL_IMAGE:figures/full_fig_p015_9.png] view at source ↗
Figure 10
Figure 10. Figure 10: a) Representative balance curve (financial time s [PITH_FULL_IMAGE:figures/full_fig_p016_10.png] view at source ↗
Figure 11
Figure 11. Figure 11: Model excess returns for each timeframes of financ [PITH_FULL_IMAGE:figures/full_fig_p017_11.png] view at source ↗

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Reference graph

Works this paper leans on

17 extracted references · 13 canonical work pages

  1. [1]

    Maddix, Michael W

    Abdul Fatir Ansari, Lorenzo Stella, Caner Turkmen, Xiyu an Zhang, Pedro Mercado, Huibin Shen, Oleksandr Shchur, Syama Sundar Rangapuram, Sebastia n Pineda Arango, Shubham Kapoor, Jasper Zschiegner, Danielle C. Maddix, Michael W. M ahoney, Kari Torkkola, Andrew Gordon Wilson, Michael Bohlke-Schneider, and Yuyan g Wang. Chronos: Learning the Language of Tim...

  2. [2]

    Mamba4Cast: Efficient Zero-Shot Time Series Forecas ting with State Space Models

    Sathya Kamesh Bhethanabhotla, Omar Swelam, Julien Siem s, David Salinas, and Frank Hutter. Mamba4Cast: Efficient Zero-Shot Time Series Forecas ting with State Space Models. CoRR (arXiv preprint) , abs/2410.09385, October 12, 2024

  3. [3]

    FinTSB: A Comprehensive and Prac tical Benchmark for Financial Time Series Forecasting

    Yifan Hu, Yuante Li, Peiyuan Liu, Yuxia Zhu, Naiqi Li, Tao Dai, Shu-tao Xia, Dawei Cheng, and Changjun Jiang. FinTSB: A Comprehensive and Prac tical Benchmark for Financial Time Series Forecasting. CoRR (arXiv preprint) , abs/2502.18834, February 26, 2025

  4. [4]

    Panda: A Pre trained Forecast Model for Universal Representation of Chaotic Dynamics

    Jeffrey Lai, Anthony Bao, and William Gilpin. Panda: A Pre trained Forecast Model for Universal Representation of Chaotic Dynamics. CoRR (arXiv preprint) , abs/2505.13755, May 19, 2025

  5. [5]

    True Zer o-Shot Inference of Dynamical Systems Preserving Long-Term Statistics

    Christoph Jürgen Hemmer and Daniel Durstewitz. True Zer o-Shot Inference of Dynamical Systems Preserving Long-Term Statistics. CoRR (arXiv preprint) , abs/2505.13192, May 19, 2025

  6. [6]

    McKenzie

    Michael D. McKenzie. Chaotic Behavior in National Stock Market Indices: New Evidence from the Close Returns Test. Global Finance Journal , vol. 12, no. 1, pp. 35–53, March

  7. [7]

    David A. Hsieh. Chaos and Nonlinear Dynamics: Applicati on to Financial Markets. The Journal of Finance , vol. 46, no. 5, pp. 1839–1877, December 1991

  8. [8]

    Scheinkman and Blake LeBaron

    José A. Scheinkman and Blake LeBaron. Nonlinear Dynamic s and Stock Returns. The Journal of Business , vol. 62, no. 3, pp. 311–337, July 1989

  9. [9]

    Sandubete and Lorenzo Escot

    Julio E. Sandubete and Lorenzo Escot. Chaotic Signals In side Some Tick-by-Tick Financial Time Series. Chaos, Solitons & Fractals , vol. 137, Article 109852, 2020

  10. [10]

    Chaotic Analysis of the Foreign Exchange Rates

    Atin Das and Pritha Das. Chaotic Analysis of the Foreign Exchange Rates. Applied Mathematics and Computation , vol. 179, no. 2, pp. 988–997, 2006

  11. [11]

    Expectations, Price Fluctuations and L orenz Attractor

    Victor Olkhov. Expectations, Price Fluctuations and L orenz Attractor. MPRA Paper No. 89105, Munich Personal RePEc Archive (MPRA) , September 2018

  12. [12]

    Financial Time Series An alysis Using Total-CApEn and A vg-CApEn with Cumulative Histogram Matrix

    Jinyang Li and Pengjian Shang. Financial Time Series An alysis Using Total-CApEn and A vg-CApEn with Cumulative Histogram Matrix. Communications in Nonlinear Science and Numerical Simulation , vol. 63, pp. 239–252, March 2018

  13. [13]

    Seasonal Mackey –Glass–GARCH Process and Short-Term Dynamics

    Catherine Kyrtsou and Michel Terraza. Seasonal Mackey –Glass–GARCH Process and Short-Term Dynamics. Empirical Economics, vol. 38, no. 2, pp. 325–345, April 2010. 18

  14. [14]

    Gomez, Lukasz Kaiser, and Illia Polosukhin

    Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszko reit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. Attention is Al l You Need. In Advances in Neural Information Processing Systems 30 (NeurIPS 2017) , pp. 5998–6008, December 2017

  15. [15]

    I nformer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting

    Haixu Wu, Jiehui Xu, Jianmin Wang, and Mingsheng Long. I nformer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting. In Proceedings of the AAAI Con- ference on Artificial Intelligence (AAAI 2021) , vol. 35, no. 12, pp. 11106–11115, May 2021

  16. [16]

    Bryan Lim and Sercan Ö. Arik. Temporal Fusion Transformers for Interpretable Mu lti- Horizon Time Series Forecasting. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD 2022) , pp. 1267–1275, August 2021

  17. [17]

    Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbia h, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry , Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henigh an, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Chris topher Hesse, Mark Chen, Eric Sigler, Mateusz Lit...