Paper: arXiv 2505.05784

Authors: Yang Li, Zhi Chen, Steve Yang

Abstract

High-frequency trading (HFT) is an investing strategy that continuously monitors market states and places bid and ask orders at millisecond speeds. Traditional HFT approaches fit models with historical data and assume that future market states follow similar patterns. This limits the effectiveness of any single model to the specific conditions it was trained for. Additionally, these models achieve optimal solutions only under specific market conditions, such as assumptions about stock price’s stochastic process, stable order flow, and the absence of sudden volatility. Real-world markets, however, are dynamic, diverse, and frequently volatile. To address these challenges, we propose the FlowHFT, a novel imitation learning framework based on flow matching policy. FlowHFT simultaneously learns strategies from numerous expert models, each proficient in particular market scenarios. As a result, our framework can adaptively adjust investment decisions according to the prevailing market state. Furthermore, FlowHFT incorporates a grid-search fine-tuning mechanism. This allows it to refine strategies and achieve superior performance even in complex or extreme market scenarios where expert strategies may be suboptimal. We test FlowHFT in multiple market environments. We first show that flow matching policy is applicable in stochastic market environments, thus enabling FlowHFT to learn trading strategies under different market conditions. Notably, our single framework consistently achieves performance superior to the best expert for each market condition.

Complexity vs Empirical Score

  • Math Complexity: 8.5/10
  • Empirical Rigor: 4.0/10
  • Quadrant: Lab Rats — theoretically deep, empirically untested

Why this score: The paper relies heavily on advanced stochastic calculus, control theory, and flow matching neural networks with complex LaTeX equations, indicating high mathematical density. However, it lacks actual backtested results, code, or statistical metrics, describing only a theoretical framework with synthetic simulations rather than real-world implementation data.

Research Flowchart

  flowchart TD
  A["Research Goal: Develop robust HFT agent<br>adaptable to diverse market conditions"] --> B["Methodology: FlowHFT<br>Imitation Learning via Flow Matching"]
  B --> C{"Input Data"}
  C --> D["Historical Market Data<br>Simulated Stochastic Environments"]
  C --> E["Expert Trajectories<br>(Specialized strategies for specific conditions)"]
  B --> F["Flow Matching Policy<br>Learns continuous trajectory<br>distribution from experts"]
  F --> G["Grid-Search Fine-tuning<br>Refines strategy for extreme/volatile scenarios"]
  F & G --> H["Outcome: Adaptive HFT Framework"]
  H --> I["Performance: Single agent<br>outperforms best expert<br>across all tested conditions"]

Cited References (128)

  1. Finagent: A multimodal foundation agent for financial trading: Tool-augmented, diversified, and generalist (2024)
  2. Flow Q-Learning (2025) — link
  3. KAN: Kolmogorov-Arnold Networks (2024) — link
  4. Static Hedging of Standard Options (2014) — link
  5. Financial trading as a game: A deep reinforcement learning approach (2018) — link
  6. Automatic financial trading agent for low-risk portfolio management using deep reinforcement learning (2019) — link
  7. Adaptive quantitative trading: An imitative deep reinforcement learning approach (2020)
  8. An Overview of Machine Learning, Deep Learning, and Reinforcement Learning-Based Techniques in Quantitative Finance: Recent Progress and Challenges (2023)
and 120 more
  1. CHATREPORT: Democratizing Sustainability Disclosure Analysis through LLM-based Tools (2023) — link
  2. Improving Factuality and Reasoning in Language Models through Multiagent Debate (2023) — link
  3. Replication and analysis of Ebbinghaus’ forgetting curve (2015)
  4. Generative agents: Interactive simulacra of human behavior (2023) — link
  5. Code Llama: Open Foundation Models for Code (2023) — link
  6. Improving language understanding by generative pre-training (2018)
  7. GPT-4 Technical Report (2023) — link
  8. FinGPT: Open-Source Financial Large Language Models — → 2306.06031
  9. Bloomberggpt: A large language model for finance (2023) — link
  10. Sentiment-influenced trading system based on multimodal deep reinforcement learning (2021)
  11. A Deep Multimodal Reinforcement Learning System Combined with CNN and LSTM for Stock Trading (2019) — link
  12. Design and implementation of a multiagent stock trading system (2012)
  13. MSPM: A modularized and scalable multi-agent reinforcement learning-based system for financial portfolio management (2022)
  14. A multi-agent Q-learning framework for optimizing stock trading systems (2002)
  15. A multi-agent deep reinforcement learning framework for algorithmic trading in financial markets (2022)
  16. Modelling stock markets by multi-agent reinforcement learning (2021)
  17. word2vec Explained: deriving Mikolov et al.’s negative-sampling word-embedding method (2014) — link
  18. Glove: Global vectors for word representation (2014)
  19. Bert: Pre-training of deep bidirectional transformers for language understanding (2018) — link
  20. Long short-term memory based recurrent neural network architectures for large vocabulary speech recognition (2014) — link
  21. Interactive narrative: A novel application of artificial intelligence for computer games (2012)
  22. Weaviate — link
  23. Cohere: Privacy Management in Large Scale Systems (2023) — link
  24. Human memory: A proposed system and its control processes (1968)
  25. What are the differences between long-term, short-term, and working memory? (2008)
  26. Llama: Open and efficient foundation language models (2023) — link
  27. Generative AI for End-to-End Limit Order Book Modelling: A Token-Level Autoregressive Generative Model of Message Flow Using a Deep State Space Network (2023) — link
  28. Modelling microstructure noise with mutually exciting point processes (2013)
  29. Modeling foreign exchange market activity around macroeconomic news: Hawkes-process approach (2015)
  30. Modelling security market events in continuous time: Intensity based, multivariate point process models (2007)
  31. Limit theorems for nearly unstable Hawkes processes (2016)
  32. Exact simulation of Hawkes process with exponentially decaying intensity (2013)
  33. Bayesian Estimation of the ETAS Model for Earthquake Occurrences (2021)
  34. Bayesian Inference for Hawkes Processes (2013) — link
  35. Sora by OpenAI (2024) — link
  36. Mamba: Linear-Time Sequence Modeling with Selective State Spaces (2023) — link
  37. Benchmark dataset for mid-price forecasting of limit order book data with machine learning methods (2018) — link
  38. Forecasting Stock Prices from the Limit Order Book Using Convolutional Neural Networks (2017) — link
  39. DeepLOB: Deep Convolutional Neural Networks for Limit Order Books (2019) — link
  40. BDLOB: Bayesian Deep Convolutional Neural Networks for Limit Order Books (2018) — link
  41. Transformers for Limit Order Books (2020) — link
  42. Flow Matching for Generative Modeling (2022) — link
  43. Proximal Policy Optimization Algorithms (2017) — link
  44. Denoising diffusion probabilistic models (2020)
  45. Score-Based Generative Modeling through Stochastic Differential Equations (2021)
  46. Reverse-Time Diffusion Equation Models (1982)
  47. Market microstructure: A survey (2000)
  48. Trading and exchanges: Market microstructure for practitioners (2002)
  49. High-frequency trading in a limit order book (2008)
  50. Buy low, sell high: A high frequency trading perspective (2014)
  51. High frequency market making: Implications for liquidity (2017)
  52. Dealing with the inventory risk: a solution to the market making problem (2013)
  53. Reinforcement learning: An introduction (2018)
  54. Reinforcement Learning in High-frequency Market Making — → 2407.21025
  55. Deep reinforcement learning in high frequency trading (2018) — link
  56. Reinforcement learning in robotics: A survey (2013)
  57. Deep unsupervised learning using nonequilibrium thermodynamics (2015)
  58. Planning with diffusion for flexible behavior synthesis (2022) — link
  59. Diffusion Policy: Visuomotor Policy Learning via Action Diffusion (2024)
  60. Diffusion policies as an expressive policy class for offline reinforcement learning (2022) — link
  61. One step diffusion via shortcut models (2024) — link
  62. Point spectra of some mutually exciting point processes (1971)
  63. Attention is all you need (2017)
  64. Film: Visual reasoning with a general conditioning layer (2018)
  65. U-net: Convolutional networks for biomedical image segmentation (2015)
  66. Hawkes processes in finance (2015)
  67. Option pricing when underlying stock returns are discontinuous (1976)
  68. Continuous auctions and insider trading (1985)
  69. Informed speculation with imperfect competition (1989)
  70. Nice: Non-linear independent components estimation (2014) — link
  71. Score-based generative modeling through stochastic differential equations (2020) — link
  72. Handbook of Stochastic Methods (2004)
  73. The Fokker-Planck Equation: Methods of Solution and Applications (1996)
  74. Numerical Solution of Stochastic Differential Equations (1999)
  75. Markov chain Monte Carlo with approximate proposals (2015)
  76. Large deviations for diffusion processes with unbounded coefficients (2006)
  77. Optimal execution of portfolio transactions (2001)
  78. Optimal Trade Execution (1996)
  79. Optimal execution and transaction costs (1996)
  80. Volume Weighted Average Price: A Primer (2018)
  81. Reinforcement Learning: An Introduction (1998)
  82. Human-level control through deep reinforcement learning (2015)
  83. Continuous control with deep reinforcement learning (2015) — link
  84. Denoising diffusion probabilistic models (2020) — link
  85. Title of the Paper (2019)
  86. A multivariate Hawkes process approach for modeling financial market activity (2014)
  87. Hawkes processes for energy markets: Modeling negative and positive jumps (2021)
  88. Long short-term memory (1997)
  89. Learning phrase representations using RNN encoder-decoder for statistical machine translation (2014)
  90. HiPPO: A continuous-time sequence model (2020) — link
  91. Mamba2: Enhancing state-space models for continuous memory (2023)
  92. Chain-of-thought prompting elicits reasoning in large language models (2022) — link
  93. Chain of Continuous Thought: Novel Paradigm with Enhanced LLM Reasoning in Continuous Latent Space (2023)
  94. Multi-Agent Systems for Financial Trading: A Survey (2021)
  95. Language models are few-shot learners (2020) — link
  96. Advanced Continuous Reasoning in Latent Spaces (2024) — link
  97. Training Large Language Models to Reason in a Continuous Latent Space (2024) — link
  98. Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality (2024) — link
  99. HiPPO: Recurrent Memory with Optimal Polynomial Projections (2020) — link
  100. Market making under a weakly consistent limit order book model (2019)
  101. High-frequency market making to large institutional trades (2019)
  102. High-frequency market-making with inventory constraints and directional bets (2012) — link
  103. Brownian motion (2010)
  104. Lectures on the Poisson process (2017)
  105. The Financial Mathematics of Market Liquidity: From optimal execution to market making (2016)
  106. The problem of calibrating an agent-based model of high-frequency trading (2016) — link
  107. Deep reinforcement learning for active high frequency trading (2021) — link
  108. Reinforcement learning: A survey (1996)
  109. Introduction to reinforcement learning (2020)
  110. Markov decision processes (1990)
  111. Earnhft: Efficient hierarchical reinforcement learning for high frequency trading (2024)
  112. Reinforcement learning for stock prediction and high-frequency trading with T+ 1 rules (2022)
  113. Deep reinforcement learning for trading (2019) — link
  114. Frequant: A reinforcement-learning based adaptive portfolio optimization with multi-frequency decomposition (2024)
  115. Inside the black box: A simple guide to quantitative and high-frequency trading (2013)
  116. MacroHFT: Memory Augmented Context-aware Reinforcement Learning On High Frequency Trading (2024)
  117. Flow matching in latent space (2023) — link
  118. Flow matching guide and code (2024) — link
  119. Flowpolicy: Enabling fast and robust 3d flow-based policy via consistency flow matching for robot manipulation (2025)
  120. Shortcut to greatness: The new thinking and the revolution in Soviet foreign policy (2003)

2 of 128 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.