Paper: arXiv 2507.09347
Authors: Ivan Letteri
Abstract
Purpose: This study introduces a novel framework for identifying and exploiting predictive lead-lag relationships in financial markets. We propose an integrated approach that combines advanced statistical methodologies with machine learning models to enhance the identification and exploitation of predictive relationships between equities. Methods: We employed a Gaussian Mixture Model (GMM) to cluster nine prominent stocks based on their mid-range historical volatility profiles over a three-year period. From the resulting clusters, we constructed a multi-stage causal inference pipeline, incorporating the Granger Causality Test (GCT), a customised Peter-Clark Momentary Conditional Independence (PCMCI) test, and Effective Transfer Entropy (ETE) to identify robust, predictive linkages. Subsequently, Dynamic Time Warping (DTW) and a K-Nearest Neighbours (KNN) classifier were utilised to determine the optimal time lag for trade execution. The resulting strategy was rigorously backtested. Results: The proposed volatility-based trading strategy, tested from 8 June 2023 to 12 August 2023, demonstrated substantial efficacy. The portfolio yielded a total return of 15.38%, significantly outperforming the 10.39% return of a comparative Buy-and-Hold strategy. Key performance metrics, including a Sharpe Ratio up to 2.17 and a win rate up to 100% for certain pairs, confirmed the strategy’s viability. Conclusion: This research contributes a systematic and robust methodology for identifying profitable trading opportunities derived from volatility-based causal relationships. The findings have significant implications for both academic research in financial modelling and the practical application of algorithmic trading, offering a structured approach to developing resilient, data-driven strategies.
Complexity vs Empirical Score
- Math Complexity: 8.5/10
- Empirical Rigor: 6.0/10 (capped from 7.0: transaction costs only partially modelled; see penalty flags)
- Quadrant: Holy Grail — high math complexity, high empirical rigor
Why this score: The paper employs a sophisticated mathematical pipeline combining GMM clustering, multiple causal inference tests (Granger, PCMCI, Transfer Entropy), and DTW for lag optimization, indicating high mathematical density. While the backtest results show strong performance metrics and a defined testing period, the absence of publicly available code or datasets and reliance on a specific, short out-of-sample window slightly limits the empirical rigor compared to a fully reproducible study.
Research Flowchart
flowchart TD A["Research Goal"] -->|Identify lead-lag relationships| B["Data Preprocessing"] B --> C["Variance Reduction<br>GMM Clustering"] C --> D["Reliability Assessment<br>Multi-stage Causal Pipeline"] D -->|GCT, PCMCI, ETE| E["Trade Signal Generation<br>DTW + KNN"] E --> F["Strategy Execution"] F --> G["Performance Evaluation"] style A fill:#e1f5fe style G fill:#e8f5e8 style D fill:#fff3e0
Cited References (34)
- VolTS: A Volatility-based Trading System to forecast Stock Markets Trend using Statistics and Machine Learning (2023) — link
- VolTS Augmented: An Improvement of a Volatility-based Trading System to Forecast Stock Markets Trends (2024) — link
- DNN-ForwardTesting: A New Trading Strategy Validation using Statistical Timeseries Analysis and Deep Neural Networks (2022) — link
- Forecasting intraday volatility in the US equity market. Multiplicative component GARCH (2012) — link
- Pairs trading: Performance of a relative-value arbitrage rule (2006)
- How Crashes Develop: Intradaily Volatility and Crash Evolution (2019) — link
- Volatility and Correlation Forecasting (2006) — link
- K-Means++: The Advantages of Careful Seeding (2007)
and 26 more
- CHANGE DETECTION OF ORDERS IN STOCK MARKETS USING A GAUSSIAN MIXTURE MODEL (2014) — link
- Co-Integration and Error Correction: Representation, Estimation, and Testing (1987)
- Drift‐Independent Volatility Estimation Based on High, Low, Open, and Close Prices (2000)
- AITA: A new framework for Trading Forward Testing with an Artificial Intelligence Engine (2023) — link
- A Stock Trading System for a Medium Volatile Asset using Multi Layer Perceptron (2022) — link
- Imbalanced Dataset Optimization with New Resampling Techniques (2021) — link
- New Optimization Approaches in Malware Traffic Analysis (2021) — link
- Care Robots Learning Rules of Ethical Behavior Under the Supervision of an Ethical Teacher (Short paper) (2022) — link
- Logic-based Machine Learning for Transparent Ethical Agents (2020) — link
- A Logic-based Multi-agent System for Ethical Monitoring and Evaluation of Dialogues (2021) — link
- Feature Selection Strategies for HTTP Botnet Traffic Detection (2019) — link
- Causation, Prediction, and Search (2001) — link
- Causal inference in statistics: An overview (2009) — link
- Security in the internet of things: botnet detection in software-defined networks by deep learning techniques (2019) — link
- Dataset Optimization Strategies for MalwareTraffic Detection (2020) — link
- A Novel Resampling Technique for Imbalanced Dataset Optimization (2020) — link
- Stock Market Forecasting Using Machine Learning Models Through Volatility-Driven Trading Strategies (2024) — link
- Trading Strategy Validation Using Forwardtesting with Deep Neural Networks (2023) — link
- First Evaluation of an Adaptive Tool Supporting Formative Assessment in Data Science Courses (2023) — link
- The VIX index under scrutiny of machine learning techniques and neural networks (2021) — link
- High-Dimensional Granger Causality Tests with an Application to VIX and News* (2022) — link
- An Outlier Detection Algorithm based on KNN-kernel Density Estimation (2020) — link
- On Clustering Multimedia Time Series Data Using K-Means and Dynamic Time Warping (2007) — link
- Extension of constraint-procedural logic-generated environments for deep Q-learning agent training and benchmarking (2023) — link
- Selection of a Portfolio of Pairs Based on Cointegration: A Statistical Arbitrage Strategy (2013) — link
- High- Frequency and Model - Free Volatility Estimators (2009) — link
0 of 34 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.