REVIEW 4 major objections 5 minor 35 references
Integrating Traditional Technical Analysis with AI: A Multi-Agent LLM-Based Approach to Stock Market Forecasting
T0 review · 4 major / 5 minor · reviewed 2026-08-06 · deepseek-v4-flash
Pith's one-line read Integrating Elliott wave pattern recognition into a seven-agent LLM system enables faster and more accurate stock price forecasting, with DRL backtesting raising pattern validity by up to 16 percentage points.
desk verdict A well-described LLM-agent system for Elliott Wave analysis whose reported accuracy is built on a circular rule, so the empirical claims don't hold. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing machinery is the ElliottAgents architecture itself: a graph-orchestrated flow of LLM agents, each equipped with memory, planning, dynamic context, retrieval-augmented generation, and specialized tools. The Elliott Waves Analyst uses a dedicated pattern-recognition tool to detect non-overlapping impulsive waves; the Backtester uses Deep Reinforcement Learning trained on ten years of history to score candidate patterns; and the Investment Advisor applies Fibonacci proportions (approximately 1.62) to set price targets. The evaluation criteria are built from the same Elliott Wave rules the system forecasts with—a complete 1-2-3-4-5 wave is judged correct only if the following corrective wave A has exactly the same length and opposite direction of wave 5.
What would settle it
Run ElliottAgents' pattern detector on shuffled returns from the same stocks (or on synthetic random-walk prices) and compare the rate of detected 1-2-3-4-5 waves and the accuracy of its predicted wave-A lengths; if the detection rate and 'accuracy' do not drop materially relative to real data, the claimed predictive validity is an artifact of the evaluation rule rather than genuine forecast skill.
Extended reading notes
Core claim
The paper's core discovery is that a crew of seven specialized LLM agents—a coordinator, data engineer, Elliott waves analyst, backtester, technical analysis expert, investment advisor, and reports writer—can recognize Elliott impulse waves (1-2-3-4 and complete 1-2-3-4-5) in historical price data and turn them into forecasts of the next move. In cross-validation on 1,000 candlesticks per stock across daily and hourly intervals, the authors report that complete impulsive waves yield better predictions than incomplete ones, and that turning on the DRL backtester improves the fraction of predictions judged correct by up to 16 percentage points. The paper presents this as evidence that EWP can be integrated into a multi-agent architecture to more quickly and accurately predict future stock price movements, producing interpretable buy/sell signals with price targets.
Load-bearing premise
The reported accuracy scores depend on a definition of 'correct prediction' that is built from the same Elliott Wave rules the system uses to forecast, so the numbers measure how often the market conforms to the theory rather than whether the system beats an independent forecasting baseline.
Editorial extensions
If this is right
- If the reported results hold, traders could use ElliottAgents to generate interpretable forecasts with concrete entry, exit, and stop-loss levels from LLM-agent analyses.
- The reported improvement of up to 16 percentage points from DRL backtesting implies that continuous learning from historical patterns adds measurable predictive value beyond static pattern recognition.
- The system's performance on daily and hourly intervals suggests the multi-agent approach extends Elliott Wave analysis across timeframes, though the authors note short-term accuracy is limited by noise and high-frequency trading.
- Because the architecture's agents are modular, adding other technical-analysis methods or additional wave patterns would be straightforward, expanding the range of detectable market structures.
- The paper's stated conclusion is that it successfully answered the research question of whether EWP can be integrated into a multi-agent LLM architecture to predict stock price movements more quickly and accurately.
Reading between the lines
- A fair out-of-sample test would compare ElliottAgents' forecasts against a naive no-skill baseline, such as predicting that the previous trend continues, on held-out periods; the paper does not report such a comparison, so the Table 1 numbers should be read as theory-conformity rates rather than evidence of tradable alpha.
- The same evaluation trap would apply to any extension of this architecture to other rule-based technical indicators: if 'correct' is defined by the theory's own rules, the metrics reward markets that happen to follow the theory rather than the system's skill.
- The claimed continuous-learning benefit could be isolated by training the DRL backtester on the first half of the historical period and evaluating on the second half, testing whether the learning component generalizes or merely fits the training distribution.
- The paper's own admission that short-term predictions are unreliable due to high-frequency trading noise suggests the truthful claim may be narrower: Elliott-wave LLM agents are a decision-support tool for swing traders, not a short-term forecasting engine.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper introduces ElliottAgents, a multi-agent LLM-based system that combines the Elliott Wave Principle (EWP) with RAG, DRL, and a graph-based knowledge store to identify impulsive and corrective wave patterns in stock data and generate trading recommendations. The authors report a case study on Apple and a cross-validation study on six U.S. stocks at daily and hourly intervals, with and without DRL backtesting. They conclude that the system 'successfully addressed the primary research question' and that DRL backtesting improves pattern recognition validity by up to 16 percentage points.
Significance. The architectural idea is timely: orchestrating specialized LLM agents for financial chart analysis, with structured memory and external tools, is a plausible direction for interpretable technical-analysis systems. The paper gives a reasonably concrete description of the agent roles, tools, and workflow, and it attempts to connect pattern recognition to backtesting. However, the quantitative evaluation is not adequate to support the central forecasting claim. The complete-wave success criterion is defined using the same Elliott Wave symmetry the system is designed to detect, so Table 1 measures label consistency rather than out-of-sample predictive skill. Sample sizes are small, baselines and statistical tests are absent, and the DRL training/evaluation split is unspecified. As it stands, the contribution is a system description with anecdotal evidence, not a validated forecasting method.
major comments (4)
- [Section 5] For complete 1-2-3-4-5 waves, a prediction is defined as accurate only if the subsequent corrective wave A 'exhibited a exact same length to that of wave 5' and moves in the opposite direction. This success criterion is exactly the Elliott Wave symmetry that the system's Elliott Waves Analyst is designed to enforce and detect. The hit rates in Table 1 therefore measure how often the future price path can be labeled as conforming to the EWP rule, not whether the system predicted future price movements in an independent sense. The criterion is also not operationalized: no tolerance is given for 'exact' equality, so it is unclear how any continuous price sequence could satisfy it or how the reported percentages were computed. An independent forecast target, such as the sign or size of future returns over a fixed horizon, together with a random or no-change baseline, is required for the central claim to be testable.
- [Section 5, Table 1] Even setting aside the circularity, the statistical evidence is insufficient. The number of detected patterns per stock ranges from 8 to 28, and several cells have fewer than 10 observations, so a single pattern changes the accuracy by more than 10 percentage points. No confidence intervals, significance tests, or effect sizes are reported, and there is no comparison against a baseline such as random direction, momentum, or a standard time-series model. Consequently, the discussion claim that backtesting improves pattern recognition validity 'by up to 16%' is not established; in several rows the improvement is zero or within sampling noise (e.g., hourly GOOG complete waves at 77.78% and hourly CSCO complete waves at 50.00% show no improvement with backtesting).
- [Section 5, second experimental phase] The DRL model is 'trained on 10 years of historical data for each company,' while the evaluation uses 1000 candlesticks per stock. The manuscript does not state whether the evaluation window is disjoint from the DRL training period or how the 1000 samples are split for cross-validation. If the evaluation period overlaps the training period, the reported accuracies are partly in-sample. The authors should specify the temporal split and, ideally, use a walk-forward or held-out period. Without this information, the backtesting results cannot be interpreted as evidence of out-of-sample predictive ability.
- [Abstract, Section 1, Section 7] The abstract and discussion state that the experimental results 'validate the system's effectiveness in pattern recognition and trend forecasting' and that the platform has 'successfully addressed the primary research question' of more quickly and accurately predicting future stock price movements. Given the circular evaluation metric, the small samples, and the lack of baselines, these statements are not supported by the reported data. The discussion also claims that the approach detects wave patterns 'with greater accuracy than comparable systems utilizing EWP (Tirea et al., 2012),' but no quantitative comparison with Tirea et al. or any other system is provided. The single AAPL case study is anecdotal and does not account for transaction costs, risk, or out-of-sample robustness.
minor comments (5)
- [Abstract] 'an multi-agent system' should be 'a multi-agent system'.
- [Section 5] 'exhibited a exact same length to that of wave 5' should be 'exhibited the exact same length as wave 5'.
- [Table 1] The percentage rounding is inconsistent: for example, 7/12 is 58.33%, not 58.34%, and 11/15 is 73.33%, not 73.34%.
- [Section 7] The paragraph beginning 'The development and testing of ElliottAgents have successfully addressed the primary research question posed at the outset of this study. The platform has demonstrated...' is repeated verbatim in two consecutive paragraphs.
- [Section 4.4 and Section 7] There are typos: 'Continous learning agent' should be 'Continuous learning agent', and 'backtesting capabilities usind DRL' should be 'using DRL'.
Circularity Check
The reported accuracy metric for complete 1-2-3-4-5 waves is circular: a prediction counts as correct only if the future forms a corrective wave A with exactly the same length as wave 5, an Elliott Wave rule rather than an independent price forecast target.
-
self definitional
[Section 5 (Experimental Setup and Methodology), evaluation criteria for complete impulse waves]
"For complete waves (1-2-3-4-5), a prediction was considered accurate if the subsequent corrective wave A exhibited a exact same length to that of wave 5, moving in the opposite direction."
The system detects 1-2-3-4-5 impulse patterns using the Elliott Wave Principle and generates predictions from that same framework. This evaluation rule defines 'correct' as the future price path containing a corrective wave A whose length exactly equals wave 5 and moves opposite, which is itself an Elliott Wave structural expectation. Thus the reported accuracies (50-89% in Table 1) measure how often subsequent price action can be labeled as an Elliott Wave A matching wave 5, not how well the system forecasts an independent quantity such as the sign or magnitude of future returns. The metric is built from the same wave-theoretic assumptions the system is supposed to validate, so the central prediction claim reduces to a self-consistent labeling check.
full rationale
Section 5 defines the correctness criterion for complete impulsive waves as the appearance of a subsequent corrective wave A with 'exact same length to that of wave 5' moving opposite. This is an Elliott Wave structural equality, not an independent forecast target such as realized return sign or magnitude; a future downward move of any other length would count as wrong. The system's wave detection and prediction are both built on the same EWP/Fibonacci framework, so the Table 1 accuracies measure the market's conformity to the labeling rule rather than out-of-sample forecasting skill. The incomplete-wave criterion (average direction over n = 1.62 first-wave lengths) is closer to a neutral target, but the horizon itself is also taken from the same Fibonacci/EWP relation and no random, no-change, or significance baseline is reported; the 'up to 16%' backtesting improvement is therefore an improvement on this theory-dependent metric. Self-citations such as (Chudziak and Wawer, 2024) are background and do not by themselves carry the forecasting claim. The central quantitative evidence of predictive accuracy reduces, for the complete-wave case, to a self-consistent EWP labeling check; hence the high circularity score.
Assumptions & free parameters
free parameters (2)
- Fibonacci horizon multiplier =
1.62
- Wave A length equality criterion =
exact equality
assumptions (3)
- domain assumption Elliott Wave Principle is a meaningful description of market structure
- domain assumption The pattern-detection tool correctly identifies waves
- ad hoc to paper Exact length equality is a valid success criterion
Cite this review
Pith. "Pith review of Integrating Traditional Technical Analysis with AI: A Multi-Agent LLM-Based Approach to Stock Market Forecasting." pith.science (2026). https://pith.science/paper/55GEZ5RY
@misc{pith2026250616813,
author = {Pith},
title = {Pith review of: Integrating Traditional Technical Analysis with AI: A Multi-Agent LLM-Based Approach to Stock Market Forecasting},
year = {2026},
howpublished = {\url{https://pith.science/paper/55GEZ5RY}},
note = {Machine review of arXiv:2506.16813}
}
read the original abstract
Traditional technical analysis methods face limitations in accurately predicting trends in today's complex financial markets. This paper introduces ElliottAgents, an multi-agent system that integrates the Elliott Wave Principle with AI for stock market forecasting. The inherent complexity of financial markets, characterized by non-linear dynamics, noise, and susceptibility to unpredictable external factors, poses significant challenges for accurate prediction. To address these challenges, the system employs LLMs to enhance natural language understanding and decision-making capabilities within a multi-agent framework. By leveraging technologies such as Retrieval-Augmented Generation (RAG) and Deep Reinforcement Learning (DRL), ElliottAgents performs continuous, multi-faceted analysis of market data to identify wave patterns and predict future price movements. The research explores the system's ability to process historical stock data, recognize Elliott wave patterns, and generate actionable insights for traders. Experimental results, conducted on historical data from major U.S. companies, validate the system's effectiveness in pattern recognition and trend forecasting across various time frames. This paper contributes to the field of AI-driven financial analysis by demonstrating how traditional technical analysis methods can be effectively combined with modern AI approaches to create more reliable and interpretable market prediction systems.
Figures
Figures from the paper (5 more)
Reference graph
Works this paper leans on
-
[1]
write newline
" write newline "" before.all 'output.state := FUNCTION fin.entry add.period write newline FUNCTION new.block output.state before.all = 'skip after.block 'output.state := if FUNCTION new.sentence output.state after.block = 'skip output.state before.all = 'skip after.sentence 'output.state := if if FUNCTION not #0 #1 if FUNCTION and 'skip pop #0 if FUNCTIO...
-
[2]
Abrishami, S., Turek, M., Choudhury, A. R., and Kumar, P. (2019). Enhancing profit by predicting stock prices using deep neural networks. In 2019 IEEE 31st International Conference on Tools with Artificial Intelligence (ICTAI) , Portland, OR, USA
work page 2019
-
[3]
Akintola, K. and Oyetunji, O. (2021). Development of an agent-based framework for stock market trading. IRE Journals , 4(9)
work page 2021
-
[4]
Auffarth, B. (2023). Generative AI with LangChain, Build large language model (LLM) apps with Python, ChatGPT, and other LLMs . Packt Publishing
work page 2023
-
[5]
Boroden, C. (2008). Fibonacci Trading: How to Master the Time and Price Advantage . McGraw Hill
work page 2008
-
[6]
Chen, H. (2024). Understand the llm agent orchestration. https://medium.com/scisharp/understand-the-llm-agent-orchestration-043ebfaead1f Accessed: Jun. 1, 2024
work page 2024
-
[7]
Cheng, Y., Zhang, C., Zhang, Z., Meng, X., Hong, S., Li, W., Wang, Z., Wang, Z., Yin, F., Zhao, J., and He, X. (2024). Exploring large language model based intelligent agents: Definitions, methods, and prospects. arXiv:2401.03428v1 [cs.AI]
arXiv 2024
-
[8]
Chi-Min Chan, Weize Chen, Y. S. J. Y. W. X. S. Z. J. F. Z. L. (2023). Chateval: Towards better llm-based evaluators through multi-agent debate. arXiv:2308.07201v1 [cs.CL]
arXiv 2023
Show all 35 references
-
[9]
Chudziak, A. (2023). Predictability of stock returns using neural networks: Elusive in the long term. Expert Systems with Applications , 213
2023
-
[10]
Chudziak, J. A. and Wawer, M. (2024). Elliottagents: A natural language-driven multi-agent system for stock market analysis and prediction. In Proceedings of the 38th Pacific Asia Conference on Language, Information and Computation , Tokyo, Japan, (in press)
2024
-
[11]
J., Jr., R
Frost, A. J., Jr., R. R. P., and Collins, C. J. (2001). Elliott Wave Principle: Key to Market Behavior . Wiley
2001
-
[12]
A., El-fouly, R
Gamil, A. A., El-fouly, R. S., and Darwish, N. M. (2007). Stock technical analysis using multi agent and fuzzy logic. In Proceedings of the World Congress on Engineering, WCE 2007 , London, UK
2007
-
[13]
Guo, T. et al. (2024). Large language model based multi-agents: A survey of progress and challenges. arXiv:2402.01680v2 [cs.CL]
2024 arXiv
-
[14]
Hu, B., Zhao, C., Zhang, P., Zhou, Z., Yang, Y., Xu, Z., and Liu, B. (2024). Enabling intelligent interactions between an agent and an llm: A reinforcement learning approach. arXiv:2306.03604v8 [cs.AI]
2024 arXiv
-
[15]
Jin, M., Tang, H., Zhang, C., Yu, Q., Liu, C., Zhu, S., Zhang, Y., and Du, M. (2024). Time series forecasting with llms: Understanding and enhancing model capabilities. arXiv:2402.10835v2 [cs.CL]
2024 arXiv
-
[16]
and Duman, E
Kabbani, T. and Duman, E. (2022). Deep reinforcement learning approach for trading automation in the stock market. IEEE Access , 10
2022
-
[17]
Lapan, M. (2020). Deep Reinforcement Learning Hands-On Second Edition . Packt
2020
-
[18]
and Truitt, S
Larson, J. and Truitt, S. (2024). Graphrag: Unlocking llm discovery on narrative private data. https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data Accessed: May. 10, 2024
2024
-
[19]
Lewis, P. et al. (2021). Retrieval-augmented generation for knowledge-intensive nlp tasks. arXiv:2005.11401v4 [cs.CL]
2021 arXiv
-
[20]
Li, J., Zhang, Q., Yu, Y., Fu, Q., and Ye, D. (2024). More agents is all you need. arXiv:2402.05120v1 [cs.CL]
2024 arXiv
-
[21]
Luo, Y., Liu, K., and Davis, D. N. (2002). A multi-agent decision support system for stock trading. IEEE Network , 16(1)
2002
-
[22]
Lussange, J., Lazarevich, I., Bourgeois-Gironde, S., Palminteri, S., and Gutkin, B. (2020). Modelling stock markets by multi-agent reinforcement learning. Computational Economics . hal-03055070
2020
-
[23]
Minsky, M. (1988). The Society of Mind . Simon & Schuster
1988
-
[24]
Murphy, J. J. (1999). Technical Analysis of the Financial Markets: A Comprehensive Guide to Trading Methods and Applications . New York Institute of Finance
1999
-
[25]
and Norvig, P
Russell, S. and Norvig, P. (1995). Artificial Intelligence: A Modern Approach . Prentice Hall
1995
-
[26]
Szydlowski, K. L. and Chudziak, J. A. (2024). Toward predictive stock trading with hidformer integrated into reinforcement learning strategy. In Proceedings of the 36th International Conference on Tools for Artificial Intelligence (ICTAI 2024) , Herndon, VA, USA, (in press)
2024
-
[27]
A., Gupta, V., Althoff, T., and Hartvigsen, T
Tan, M., Merrill, M. A., Gupta, V., Althoff, T., and Hartvigsen, T. (2024). Are language models actually useful for time series forecasting? arXiv:2406.16964v1 [cs.LG]
2024 arXiv
-
[28]
Thomas, R. J. (2024). The rise of large action models, lams: How ai can understand and execute human intentions? https://medium.com/version-1/the-rise-of-large-action-models-lams-how-ai-can-understand-and-execute-human-intentions-f59c8e78bc09 Accessed: Jun. 20, 2024
2024
-
[29]
Tirea, M., Tandau, I., and Negru, V. (2012). Stock market multi-agent recommendation system based on the elliott wave principle. In International Conference on Availability, Reliability, and Security , Prague, Czech Republic
2012
-
[30]
Tsay, R. S. (2010). Analysis of Financial Time Series Third Edition . Wiley
2010
-
[31]
Wang, L., Zhang, X., Su, H., and Zhu, J. (2024). A comprehensive survey of continual learning: Theory, method and application. arXiv:2302.00487 [cs.LG]
2024 arXiv
-
[32]
Weng, L. (2023). Llm-powered autonomous agents. lilianweng.github.io
2023
-
[33]
Wittkampf, F. (2024). Next-level agents: Unlocking the power of dynamic context. https://towardsdatascience.com/next-level-agents-unlocking-the-power-of-dynamic-context-68b8647eef89 Accessed: Jun. 1, 2024
2024
-
[34]
Yao, S., Zhao, J., Yu, D., Du, N., Shafran, I., Narasimhan, K., and Cao, Y. (2023). React: Synergizing reasoning and acting in language models. arXiv:2210.03629 [cs.CL]
2023 arXiv
-
[35]
Zhao, P., Jin, Z., and Cheng, N. (2023). An in-depth survey of large language model-based artificial intelligence agents. arXiv:2309.14365v1 [cs.CL]
2023 arXiv
Reviewed August 6, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.