Paper: arXiv 2505.21662

Authors: Mateusz Wilinski, Anubha Goel, Alexandros Iosifidis, Juho Kanniainen

Abstract

The rapid development of sophisticated machine learning methods, together with the increased availability of financial data, has the potential to transform financial research, but also poses a challenge in terms of validation and interpretation. A good case study is the task of classifying financial investors based on their behavioral patterns. Not only do we have access to both classification and clustering tools for high-dimensional data, but also data identifying individual investors is finally available. The problem, however, is that we do not have access to ground truth when working with real-world data. This, together with often limited interpretability of modern machine learning methods, makes it difficult to fully utilize the available research potential. In order to deal with this challenge we propose to use a realistic agent-based model as a way to generate synthetic data. This way one has access to ground truth, large replicable data, and limitless research scenarios. Using this approach we show how, even when classifying trading agents in a supervised manner is relatively easy, a more realistic task of unsupervised clustering may give incorrect or even misleading results. We complete the results with investigating the details of how supervised techniques were able to successfully distinguish between different trading behaviors.

Complexity vs Empirical Score

  • Math Complexity: 4.0/10
  • Empirical Rigor: 8.0/10
  • Quadrant: Street Traders — practical and empirical, lighter on theory

Why this score: The paper uses advanced machine learning methods but focuses heavily on empirical validation via a synthetic agent-based limit order book environment, featuring reproducible code and detailed implementation of trading simulations.

Research Flowchart

  flowchart TD
  A["Research Goal<br>Classify & Cluster<br>Trading Agents"] --> B["Methodology<br>Agent-Based Model<br>for Synthetic Data"]
  B --> C["Data Generation<br>Ground Truth Labels<br>with Behavioral Patterns"]
  C --> D["Computational Process<br>Supervised Classification<br>e.g., Random Forest, SVM"]
  C --> E["Computational Process<br>Unsupervised Clustering<br>e.g., K-Means, GMM"]
  D --> F["Key Findings<br>Supervised: Highly Accurate"]
  E --> G["Key Findings<br>Unsupervised: Error/Misleading"]

Cited References (61)

  1. An agent-based model of intra-day financial markets dynamics (2021)
  2. Statistical theory of the continuous double auction (2003)
  3. Market making and mean reversion (2011)
  4. Welfare effects of market making in continuous double auctions (2017)
  5. Learning to classify and imitate trading agents in continuous double auction markets (2021)
  6. Statistical properties of stock order books: empirical results and models (2002)
  7. Econophysics review: I. Empirical facts (2011)
  8. More statistical properties of order books and price impact (2003)
and 53 more
  1. The predictive power of zero intelligence in financial markets (2005)
  2. The information content of an open limit-order book (2009)
  3. An empirical analysis of the limit order book and the order flow in the Paris Bourse (1995)
  4. Get real: Realism metrics for robust limit order book market simulations (2020)
  5. Analysis and modeling of client order flow in limit order markets (2023)
  6. The flash crash: High-frequency trading in an electronic market (2017)
  7. The Flash Crash: A cautionary tale about highly fragmented markets (2019)
  8. Forecasting jump arrivals in stock prices: new attention-based network architecture using limit order book data (2019)
  9. Empirical properties of asset returns: stylized facts and statistical issues (2001)
  10. An introduction to variable and feature selection (2003)
  11. The challenges of data quality and data quality assessment in the big data era (2015)
  12. The variation of certain speculative prices (1963)
  13. Benchmark dataset for mid-price forecasting of limit order book data with machine learning methods (2018)
  14. Ward’s hierarchical agglomerative clustering method: which algorithms implement Ward’s criterion? (2014)
  15. The economy needs agent-based modelling (2009)
  16. Machine learning in finance (2020)
  17. Machine learning in finance: the case of deep learning for option pricing (2017)
  18. Credit risk assessment model for Jordanian commercial banks: Neural scoring approach (2014)
  19. Predicting the direction of stock market prices using tree-based classifiers (2019)
  20. A reinforcement learning extension to the Almgren-Chriss framework for optimal trade execution (2014)
  21. Generative ai for end-to-end limit order book modelling: A token-level autoregressive generative model of message flow using a deep state space network (2023)
  22. Temporal Data Meets LLM–Explainable Financial Time Series Forecasting — → 2306.11025
  23. Explainable Artificial Intelligence (XAI) 2.0: A manifesto of open challenges and interdisciplinary research directions (2024)
  24. Synergistic integration between machine learning and agent-based modeling: A multidisciplinary review (2021)
  25. A simple learning agent interacting with an agent-based market model (2024)
  26. Towards multi-agent reinforcement learning-driven over-the-counter market simulations (2024)
  27. Calibrating agent-based models to microdata with graph neural networks (2022) — link
  28. Price-time priority and pro rata matching in an order book model of financial markets (2011)
  29. ABIDES: Towards high-fidelity multi-agent market simulation (2020)
  30. Fast Agent-Based Simulation Framework with Applications to Reinforcement Learning and the Study of Trading Latency Effects (2021)
  31. Limit order books (2013)
  32. The survival of noise traders in financial markets (1988)
  33. Bid-ask spreads, trading volume and volatility: Intra-day evidence from the London Stock Exchange (1997)
  34. Layer-wise relevance propagation: an overview (2019)
  35. A survey of deep neural network architectures and their applications (2017)
  36. Selecting the number of clusters k with a stability trade-off: an internal validation criterion (2023)
  37. Tune: A research platform for distributed model selection and training (2018) — link
  38. Evaluation: From Precision, Recall and F-Measure to ROC, Informedness, Markedness & Correlation (2011)
  39. Liquidity and Market Structure (1988)
  40. High-Frequency Trading and Price Discovery (2014)
  41. High frequency trading and the new market makers (2013)
  42. Optimal liquidity trading (2005)
  43. Detecting liquidity traders (2009)
  44. Foundations of Technical Analysis (2000)
  45. Deep Learning for Price Prediction in Financial Markets (2018)
  46. The noise trader approach to finance (1990)
  47. Noise Trader Risk in Financial Markets (1990)
  48. Identification of information networks in stock markets (2021)
  49. Statistically validated lead-lag networks and inventory prediction in the foreign exchange market (2018)
  50. The diversity of high-frequency traders (2013)
  51. High-frequency trading around large institutional orders (2019)
  52. https://github.com/mateuszwilinski/cluster-investors/ (2025) — link
  53. https://github.com/mateuszwilinski/lob-abm-simulator/ (2025) — link

1 of 61 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.