REVIEW 4 major objections 5 minor 45 references
Regression and Forecasting of U.S. Stock Returns Based on LSTM
T0 review · 4 major / 5 minor · reviewed 2026-08-09 · deepseek-v4-flash
Pith's one-line read The paper claims that the Fama-French five-factor model is the best linear specification for all three U.S. stock sectors studied, and that an LSTM neural network predicts high-technology sector returns better than any factor model.
desk verdict Routine factor-model comparison undercut by comparing in-sample fits to out-of-sample LSTM and by vanishing LSTM implementation detail. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The comparison runs on two kinds of machinery: ordinary least squares regressions of excess returns on the standard factor sets (market, size, value, and for the five-factor model also profitability and investment), and an LSTM recurrent neural network with gated memory units. The factor regressions produce the estimating equations (5)-(7) and the R-squared/RMSE/MAE benchmarks in Tables 5-7. The LSTM, trained on 70 percent of the monthly data and tested on 30 percent, produces Table 8. The paper's inference about LSTM's edge in Hitec rests on reading the two sets of R-squared values side by side.
What would settle it
Re-estimate the five-factor model on the same 70 percent training window used for the LSTM and compute its R-squared on the 30 percent test window for the Hitec sector. If that out-of-sample R-squared reaches or exceeds the LSTM's 0.929, the paper's central claim fails. A supporting check is to run a walk-forward comparison across subperiods to see whether the LSTM advantage is stable or an artifact of the single split.
Extended reading notes
Core claim
The central discovery is that the Fama-French five-factor model is the most valid of the three linear factor models for all three sectors, and that an LSTM network can capture sector-specific, nonlinear return drivers that the five-factor model misses, most clearly in high technology. For Manuf and Other, the five-factor model already explains over 90 percent of return variation, so the paper argues that more complexity buys little. For Hitec, the LSTM's R-squared of 0.929 versus the five-factor model's 0.871 is presented as evidence that neural networks can improve prediction when linear factors fall short, due to LSTM's ability to model long-term dependencies and nonlinear patterns.
Load-bearing premise
The load-bearing premise is that the full-sample R-squared of the factor models and the holdout R-squared of the LSTM are directly comparable; if they are not, the claimed LSTM superiority in high technology is not established.
Editorial extensions
If this is right
- For the Manuf and Other sectors, the five-factor model should remain the default tool, since it explains more than 90 percent of return variation.
- In the Hitec sector, predictions from an LSTM can exceed the five-factor model's accuracy, supporting a hybrid approach there.
- The insignificance of RMW and CMA in the Manuf sector suggests that a leaner model may suffice for manufacturing stocks.
- Combining factor models with LSTM offers a practical path that balances interpretability with nonlinear predictive power.
- The results imply that the value of deep learning in return forecasting is sector-dependent, not universal.
Reading between the lines
- The R-squared comparison mixes evaluation protocols: factor regressions use the full sample while LSTM uses a holdout, so the reported gap in Hitec may overstate LSTM's true advantage; an equal-protocol test is a natural extension.
- The paper recommends substituting future SMB, HML, RMW, and CMA values into its equations, but provides no way to forecast these factors; adding a factor-forecasting module would make the recommendation actionable.
- A walk-forward validation that retrains the LSTM and re-estimates factor betas on rolling windows would test whether the Hitec edge persists out of sample or reflects memorization of the 2004-2024 period.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript analyzes monthly U.S. stock returns for three sectors (Manuf, Hitec, Other) over January 2004 to January 2024, fitting the Fama-French three-factor, Carhart four-factor, and Fama-French five-factor regressions and an LSTM regression model. It reports R-squared, RMSE, and MAE for each model and concludes that the Fama-French five-factor model has better validity for all three sectors, while the LSTM model better predicts returns in the Hitec sector. The paper recommends using the five-factor model for Manuf and Other, and combining LSTM for Hitec.
Significance. If the comparison were valid, the paper would offer evidence on sector-specific performance differences between classical factor models and an LSTM for U.S. stock returns. The topic is relevant and the use of standard factor definitions is sensible. However, the execution prevents the results from being interpretable: the factor-model and LSTM metrics are not computed under a common evaluation protocol, the LSTM is not described sufficiently for reproduction, and the proposed forecasting procedure for the factor model is incomplete. The paper does not provide code, data, or enough methodological detail to assess whether the central claims are supported.
major comments (4)
- [§3.1, Tables 5–7 vs. §3.2, Table 8] The R-squared values in Tables 5–7 are in-sample fits from OLS regressions on the full 2004–2024 sample, whereas the LSTM in §3.2 is trained on 70% of the data and evaluated on the remaining 30%. If Table 8 reports test-set R-squared, then the two sets of R-squared values are not directly comparable, and the comparison is biased against the LSTM (or in favor of the factor models, depending on the direction of overfitting). The paper must compute factor-model R-squared, RMSE, and MAE on the same 30% hold-out, or report LSTM training-set performance, before any claim such as 'the Fama-French five-factor model has better validity' or 'LSTM better predicts Hitec' can be assessed.
- [§3.1.3, after Eq. (7)] The sentence instructing an investor to substitute predicted future values of SMB, HML, RMW, and CMA into the fitted regression presupposes that these factor values can be forecast. No method, model, or validation for forecasting these factors is provided, and no ex-ante availability argument is given. Without such a method, Equations (5)–(7) are in-sample fitted relationships rather than forecasting equations, so the investment-strategy recommendation in §4 is not supported.
- [§3.2, Table 8] The LSTM model is unspecified: the text does not report the input features, sequence length or lookback, number of layers, hidden units, activation functions, optimizer, learning rate, batch size, epochs, regularization, or whether the R-squared is computed on the training set or the test set. Without this information, the reported R-squared values, including the high Hitec value of 0.929, cannot be reproduced or audited for data leakage or overfitting. This is a load-bearing gap because the paper's only evidence for the LSTM claim is Table 8.
- [§3.1, Tables 5–7] The conclusion that the Fama-French five-factor model is 'best' rests on small in-sample R-squared differences (e.g., Manuf: 0.901, 0.904, 0.909; Hitec: 0.864, 0.864, 0.871; Other: 0.936, 0.940, 0.946) with no statistical test of whether the increments are significant, and no adjusted R-squared or out-of-sample comparison. In the Manuf regression, RMW and CMA are insignificant (p = 0.420 and p = 0.859 in Table 4), yet Equation (5) still includes them and the model is recommended. The paper should report incremental F-tests, adjusted R-squared, and cross-validated predictive comparisons before making the superiority claim.
minor comments (5)
- [§2.2 and §3.1.1] Equations (2)–(4) omit the intercept term even though the general regression form in Equation (1) includes β0, and Equation (4) and Equation (5) use 'MB' where 'SMB' is intended; this notation inconsistency should be corrected.
- [Abstract] The abstract contains a duplicated phrase: 'French five-factor model for the three sectors of the market' appears twice in consecutive sentences.
- [§4] The 'Investment Strategy' paragraph is repeated verbatim twice in the conclusion; one copy should be removed.
- [§2.4] The description of data preprocessing is vague: the paper states that vacant values are filled using Lagrange interpolation and outliers are eliminated 'in a similar way,' but it does not define the outlier criterion, the interpolation window, or the source and construction of the sector return series. More detail is needed for reproducibility.
- [References] Several references appear unrelated to the claims they are attached to (e.g., references [12], [13], [14], and [17] concern generalized linear models, regression modeling strategies, weighted log-rank tests, and local regression, none of which is actually used in the paper). The citation list should be trimmed to relevant sources.
Circularity Check
The central F-F5-versus-LSTM comparison compares an in-sample R² (Tables 5–7) with a test-set R² (Table 8), so the claimed predictive-accuracy ranking is forced by the estimation protocol rather than by out-of-sample prediction.
-
fitted input called prediction
[Section 3.1 (Tables 5–7), Section 3.2 (Table 8), and discussion after Table 8]
"In terms of explanatory power and predictive accuracy, the F-F5 model performs the best. Using LSTM for regression on relevant data, with the training set and test set split in a 7:3 ratio. In the cases of the Manufacturing and Other sectors, if the five-factor model already has a coefficient of determination over 0.9, further use of LSTM may not significantly enhance predictive performance."
The F-F5 R² values in Tables 5–7 come from OLS regressions fit on the full 2004–2024 sample (equations 2–7), so those R² values measure in-sample fit: OLS minimizes the sum of squared residuals on exactly the data used to compute R². The paper calls this 'predictive accuracy' and uses it to conclude that F-F5 is superior in Manuf and Other and that LSTM adds value only in Hitec. Table 8's LSTM R² is, by the 7:3 split stated in §3.2, a test-set statistic. Comparing a fit statistic to a test statistic is not a prediction: the apparent advantage of F-F5 in Manuf/Other is an artifact of reporting in-sample R², and the claimed superiority ranking is not supported. This is the load-bearing evidence for the paper's central comparative conclusion.
full rationale
The LSTM evaluation itself is genuinely out-of-sample (7:3 split), so it is not circular. The factor-model regressions are standard in-sample OLS fits; reporting R² as explanatory power would be legitimate. The circular/forced element is the paper's step of labeling those in-sample R² values 'predictive accuracy' and comparing them with the LSTM test-set R² to decide where LSTM helps. Because the F-F5 R² is by construction a measure of fit to the estimation sample, the conclusion that F-F5 is the best predictor in Manuf and Other, and that LSTM only helps in Hitec, is statistically forced by the evaluation protocol rather than derived from comparable forecasts. The paper also recommends substituting forecasted SMB, HML, RMW, and CMA values without providing a forecasting method; this is an incompleteness/correctness concern rather than a circularity. The self-citations in the reference list (e.g., [4], [5], [10], [16], [45]) are motivational and are not load-bearing for the derivation, so they do not affect the circularity score.
Assumptions & free parameters
free parameters (7)
- FF3 loadings (Manuf) =
market 0.9219, SMB 0.0473, HML 0.033
- Carhart4 loadings (Manuf) =
market 0.905, SMB 0.05, HML 0.009, MOM -0.06
- FF5 loadings (Manuf) =
market 0.95, SMB 0.08, HML 0.02, RMW 0.1, CMA 0.01
- FF5 loadings (Hitec) =
market 0.9, SMB 0.02, HML -0.19, RMW -0.08, CMA -0.06
- FF5 loadings (Other) =
market 0.83, SMB -0.03, HML 0.2977, RMW -0.1, CMA -0.07
- Train/test split ratio =
0.7
- LSTM architecture and hyperparameters =
not reported
assumptions (5)
- standard math Standard OLS assumptions hold for the factor model regressions
- domain assumption Fama-French and Carhart factor returns are correctly aligned with the sector portfolios
- domain assumption The LSTM feature set and preprocessing avoid look-ahead bias
- ad hoc to paper Future factor values can be forecasted when applying the fitted regression for prediction
- ad hoc to paper Outlier elimination and interpolation do not materially change the results
Cite this review
Pith. "Pith review of Regression and Forecasting of U.S. Stock Returns Based on LSTM." pith.science (2026). https://pith.science/paper/KGALFERD
@misc{pith2026250205210,
author = {Pith},
title = {Pith review of: Regression and Forecasting of U.S. Stock Returns Based on LSTM},
year = {2026},
howpublished = {\url{https://pith.science/paper/KGALFERD}},
note = {Machine review of arXiv:2502.05210}
}
read the original abstract
This paper analyses the investment returns of three stock sectors, Manuf, Hitec, and Other, in the U.S. stock market, based on the Fama-French three-factor model, the Carhart four-factor model, and the Fama-French five-factor model, in order to test the validity of the Fama-French three-factor model, the Carhart four-factor model, and the Fama-French five-factor model for the three sectors of the market. French five-factor model for the three sectors of the market. Also, the LSTM model is used to explore the additional factors affecting stock returns. The empirical results show that the Fama-French five-factor model has better validity for the three segments of the market under study, and the LSTM model has the ability to capture the factors affecting the returns of certain industries, and can better regress and predict the stock returns of the relevant industries. Keywords- Fama-French model; Carhart model; Factor model; LSTM model.
Reference graph
Works this paper leans on
-
[1]
Fama, E. F., & French, K. R. (2015). A five-factor asset pricing model. Journal of financial economics,116(1)
work page 2015
-
[2]
Tsaih, R., Hsu, Y., & Lai, C. C. (1998). Forecasting S&P 500 stock index futures with a hybrid AI system.Decisionsupportsystems,23(2),161-174
work page 1998
-
[3]
Agusta,S., Rakhman, F., Mustakini, J.H., &Wijayana, S. (2024).Enhancingthe accuracyof stock return movement prediction in Indonesia through recent fundamental value incorporation in multilayer perceptron.AsianJournalofAccountingResearch,9(4),358-377
work page 2024
-
[4]
Ke, Z., Xu, J., Zhang, Z., Cheng, Y., & Wu, W. (2024). A Consolidated Volatility Prediction with BackPropagationNeuralNetworkandGeneticAlgorithm.arXivpreprintarXiv:2412.07223
work page Pith review arXiv 2024
-
[5]
Hu, Z., Yu, R., Zhang, Z., Zheng, H., Liu, Q., & Zhou, Y. (2024). Developing Cryptocurrency TradingStrategyBasedonAutoencoder-CNN-GANsAlgorithms.arXivpreprintarXiv:2412.18202
work page Pith review arXiv 2024
-
[6]
Pawar, K., Jalem, R. S., & Tiwari, V. (2019). Stock market price prediction using LSTM RNN. InEmergingTrendsinExpertApplicationsandSecurity:ProceedingsofICETEAS2018(pp.493-503). SpringerSingapore
work page 2019
-
[7]
Ghosh, P., Neufeld, A., & Sahoo, J. K. (2022). Forecasting directional movements of stock prices forintradaytradingusingLSTMandrandomforests.FinanceResearchLetters,46,102280
work page 2022
-
[8]
Dami, S., & Esterabi, M. (2021). Predicting stock returns of Tehran exchange using LSTM neural networkandfeatureengineeringtechnique.MultimediaToolsandApplications,80(13),19947-19970
work page 2021
Show all 45 references
-
[9]
Fischer,T.,&Krauss,C.(2018).Deeplearningwithlongshort-termmemorynetworksforfinancial marketpredictions.Europeanjournalofoperationalresearch,270(2),654-669
2018
-
[10]
Zhang, Z., Li, X., Cheng, Y., Chen, Z., & Liu, Q. (2025). Credit Risk Identification in Supply ChainsUsingGenerativeAdversarialNetworks.arXivpreprintarXiv:2501.10348
2025 arXiv
-
[11]
Hansson,M.(2017).OnstockreturnpredictionwithLSTMnetworks
2017
-
[12]
Roberto M D ,Salvatore I ,Antonio P .Local and Overall Deviance R-Squared Measures for MixturesofGeneralizedLinearModels..Journalofclassification,2023,40(2):31-34
2023
-
[13]
W., & Nunez, J
Nunez, E., Steyerberg, E. W., & Nunez, J. (2011). Regression modeling strategies. Revista EspañoladeCardiología(EnglishEdition),64(6),501-507
2011
-
[14]
Newer, H. A. (2024). P-values and confidence intervals for weighted log-rank tests under truncated binomial design based on clustered medical data. Journal of Biopharmaceutical Statistics, 1- 12
2024
-
[15]
Kumar KM ,PatniCJ,RaparthiM ,etal.ApproachAdvancingStockMarket Forecastingwith JointRMSELossLSTM-CNNModel.FluctuationandNoiseLetters,2024,23(02):
2024
-
[16]
Ke, Z., & Yin, Y. (2024). Tail Risk Alert Based on Conditional Autoregressive VaR by RegressionQuantilesandMachineLearningAlgorithms.arXivpreprintarXiv:2412.06193
2024 arXiv
-
[17]
S., Grosse, E., & Shyu, W
Cleveland, W. S., Grosse, E., & Shyu, W. M. (2017). Local regression models. In Statistical modelsinS(pp.309-376).Routledge
2017
-
[18]
Liu, D. (2024). Mt2st: Adaptive multi-task to single-task learning. arXiv preprint arXiv:2406.18038
2024 arXiv
-
[19]
(2024).Self-contrast: Betterreflectionthroughinconsistentsolvingperspectives.arXivpreprintarXiv:2401.02009
Zhang, W., Shen, Y., Wu, L., Peng, Q.,Wang, J., Zhuang, Y., & Lu, W. (2024).Self-contrast: Betterreflectionthroughinconsistentsolvingperspectives.arXivpreprintarXiv:2401.02009
2024 arXiv
-
[20]
Z., & Rehman, K
Muneer, S., Butt, B. Z., & Rehman, K. U. (2011). A multifactor model of banking industry stock returns: An emerging market perspective. Information Management and Business Review, 2(6), 267-275
2011
-
[21]
Liu, D., & Jiang, M. (2024). Distance recomputator and topology reconstructor for graph neuralnetworks.arXivpreprintarXiv:2406.17281
2024
-
[22]
International JournalofEconomicsandFinance,8(1),99-110
Acheampong,P.,&Swanzy,S.K.(2016).Empiricaltestofsinglefactorandmulti-factorasset pricing models: Evidence from non financial firms on the Ghana Stock Exchange (GSE). International JournalofEconomicsandFinance,8(1),99-110
2016
-
[23]
Xiao, C., & Liu, Y. (2025). A Multifrequency Data Fusion Deep Learning Model for Carbon PricePrediction.JournalofForecasting,44(2),436-458
2025
-
[24]
& Huang, C
Tang, J., Lin, C., Zhao, Z., Wei, S., Wu, B., Liu, Q., ... & Huang, C. (2024). Textsquare: Scalinguptext-centricvisualinstructiontuning.arXivpreprintarXiv:2404.12803
2024 arXiv
-
[25]
Chen, Z. (2023). Algorithms and Applications of Explainable Machine Learning. State UniversityofNewYorkatStonyBrook
2023
-
[26]
(2023, October)
Shi, W., Wang, X., Niu, K., Wang, L., & Zhang, D. (2023, October). WiCross: I Can Know When You Cross Using COTS WiFi Devices. In Adjunct Proceedings of the 2023 ACM International Joint Conference on Pervasive and Ubiquitous Computing & the 2023 ACM International Symposium onW...
2023
-
[27]
Sun, W., Cui, B., Tang, J., & Dong, X. M. (2024). Attentive Eraser: Unleashing Diffusion Model's Object Removal Potential via Self-Attention Redirection Guidance. arXiv preprint arXiv:2412.12974
2024
-
[28]
Li, Z., Wang, B., & Chen, Y. (2024). Knowledge Graph Embedding and Few-Shot Relational Learning Methods for Digital Assets in USA. Journal of Industrial Engineering and Applied Science,2(5),10-18
2024
-
[29]
Liu, D., Waleffe, R., Jiang, M., & Venkataraman, S. (2024). Graphsnapshot: Graph machine learningaccelerationwithfaststorageandretrieval.arXivpreprintarXiv:2406.17918
2024 arXiv
-
[30]
M., & Sharifzadeh, M
Elshqirat, D. M., & Sharifzadeh, M. M. (2018). Testing a multi-factor capital asset pricing modelintheJordanianstockmarket
2018
-
[31]
(2024).Towards visual-prompt temporalanswer grounding ininstructionalvideo.IEEETransactionsonPatternAnalysisandMachineIntelligence
Li, S.,Li, B.,Sun,B., &Weng, Y. (2024).Towards visual-prompt temporalanswer grounding ininstructionalvideo.IEEETransactionsonPatternAnalysisandMachineIntelligence
2024
-
[32]
(2021, July)
Chen, Z., Huang, J., Ahn, H., & Ning, X. (2021, July). Costly features classification using monte carlo tree search. In 2021 International joint conference on neural networks (IJCNN) (pp. 1-8). IEEE
2021
-
[33]
Chen, Y., Liu, L., & Fang, L. (2024). An Enhanced Credit Risk Evaluation by Incorporating RelatedPartyTransactioninBlockchainFirmsofChina.Mathematics,12(17),2673
2024
-
[34]
Zhang, W., Tang, K., Wu, H., Wang, M., Shen, Y., Hou, G., ... & Lu, W. (2024). Agent-pro: Learningtoevolveviapolicy-levelreflectionandoptimization.arXivpreprintarXiv:2402.17574
2024 arXiv
-
[35]
& Zhang, D
Li, Y., Wu, D., Chen, J., Shi, W., Wang, L., Su, L., ... & Zhang, D. (2024). SigCan: Toward ReliableToFEstimationLeveragingMultipathSignalCancellationonCommodityWiFiDevices.IEEE TransactionsonMobileComputing
2024
-
[36]
Li, B., Weng, Y., Xia, F., & Deng, H. (2024). Towards better Chinese-centric neural machine translationforlow-resourcelanguages.ComputerSpeech&Language,84,101566
2024
-
[37]
Yang,J.,Liu,J.,Yao,Z.,&Ma,C.(2024).Measuringdigitalizationcapabilitiesusingmachine learning.ResearchinInternationalBusinessandFinance,70,102380
2024
-
[38]
Xiao, C. (2025). Confusion-Resistant Federated Learning via Diffusion-Based Data Harmonization on Non-IID Data. Advances in Neural Information Processing Systems, 37, 137495- 137520
2025
-
[39]
(2022, October)
Chen, Z., Silvestri, F., Wang, J., Zhu, H., Ahn, H., & Tolomei, G. (2022, October). Relax: Reinforcement learning agent explainer for arbitrary predictive models. In Proceedings of the 31st ACMinternationalconferenceoninformation&knowledgemanagement(pp.252-261)
2022
-
[40]
(2022, October)
Tang, J., Qian, W., Song, L., Dong, X., Li, L., & Bai, X. (2022, October). Optimal boxes: boosting end-to-end scene text recognition by adjusting annotated bounding boxes via reinforcement learning. In European Conference on Computer Vision (pp. 233-248). Cham: Springer Nature...
2022
-
[41]
Li, B., Sun, B., Li, S., Chen, E., Liu, H., Weng, Y., ... & Hu, M. (2024). Distinct but correct: generating diversified and entity-revised medical response. Science China Information Sciences, 67(3), 132106
2024
-
[42]
Gu, J., Zhang, Y., & Hu, Z. (2025). FAN-TSF: A Frequency Adaptive Normalization ApproachforNon-stationaryTimeSeriesForecastingonStockMarketData(May27,2025)
2025
-
[43]
H., & Elhedhli, S
Li, Z., Bookbinder, J. H., & Elhedhli, S. (2012). Optimal shipment decisions for an airfreight forwarder: Formulation and solution methods. Transportation Research Part C: Emerging Technologies,21(1),17-30
2012
-
[44]
Chen,Z.,Da,Z.,Huang,D.,&Wang,L.(2023).Presidentialeconomicapprovalratingandthe cross-sectionofstockreturns.JournalofFinancialEconomics,147(1),106-131
2023
-
[45]
Yu, Q., Yin, Y., Zhou, S., Mu, H., & Hu, Z. (2025). Detecting Financial Fraud in Listed CompaniesviaaCNN-TransformerFramework
2025
Reviewed August 9, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.