Paper: arXiv 2505.05784
Authors: Yang Li, Zhi Chen, Steve Yang
Abstract
High-frequency trading (HFT) is an investing strategy that continuously monitors market states and places bid and ask orders at millisecond speeds. Traditional HFT approaches fit models with historical data and assume that future market states follow similar patterns. This limits the effectiveness of any single model to the specific conditions it was trained for. Additionally, these models achieve optimal solutions only under specific market conditions, such as assumptions about stock price’s stochastic process, stable order flow, and the absence of sudden volatility. Real-world markets, however, are dynamic, diverse, and frequently volatile. To address these challenges, we propose the FlowHFT, a novel imitation learning framework based on flow matching policy. FlowHFT simultaneously learns strategies from numerous expert models, each proficient in particular market scenarios. As a result, our framework can adaptively adjust investment decisions according to the prevailing market state. Furthermore, FlowHFT incorporates a grid-search fine-tuning mechanism. This allows it to refine strategies and achieve superior performance even in complex or extreme market scenarios where expert strategies may be suboptimal. We test FlowHFT in multiple market environments. We first show that flow matching policy is applicable in stochastic market environments, thus enabling FlowHFT to learn trading strategies under different market conditions. Notably, our single framework consistently achieves performance superior to the best expert for each market condition.
Complexity vs Empirical Score
- Math Complexity: 8.5/10
- Empirical Rigor: 4.0/10
- Quadrant: Lab Rats — theoretically deep, empirically untested
Why this score: The paper relies heavily on advanced stochastic calculus, control theory, and flow matching neural networks with complex LaTeX equations, indicating high mathematical density. However, it lacks actual backtested results, code, or statistical metrics, describing only a theoretical framework with synthetic simulations rather than real-world implementation data.
Research Flowchart
flowchart TD
A["Research Goal: Develop robust HFT agent<br>adaptable to diverse market conditions"] --> B["Methodology: FlowHFT<br>Imitation Learning via Flow Matching"]
B --> C{"Input Data"}
C --> D["Historical Market Data<br>Simulated Stochastic Environments"]
C --> E["Expert Trajectories<br>(Specialized strategies for specific conditions)"]
B --> F["Flow Matching Policy<br>Learns continuous trajectory<br>distribution from experts"]
F --> G["Grid-Search Fine-tuning<br>Refines strategy for extreme/volatile scenarios"]
F & G --> H["Outcome: Adaptive HFT Framework"]
H --> I["Performance: Single agent<br>outperforms best expert<br>across all tested conditions"]
Cited References (128)
- Finagent: A multimodal foundation agent for financial trading: Tool-augmented, diversified, and generalist (2024)
- Flow Q-Learning (2025) — link
- KAN: Kolmogorov-Arnold Networks (2024) — link
- Static Hedging of Standard Options (2014) — link
- Financial trading as a game: A deep reinforcement learning approach (2018) — link
- Automatic financial trading agent for low-risk portfolio management using deep reinforcement learning (2019) — link
- Adaptive quantitative trading: An imitative deep reinforcement learning approach (2020)
- An Overview of Machine Learning, Deep Learning, and Reinforcement Learning-Based Techniques in Quantitative Finance: Recent Progress and Challenges (2023)
and 120 more
- CHATREPORT: Democratizing Sustainability Disclosure Analysis through LLM-based Tools (2023) — link
- Improving Factuality and Reasoning in Language Models through Multiagent Debate (2023) — link
- Replication and analysis of Ebbinghaus’ forgetting curve (2015)
- Generative agents: Interactive simulacra of human behavior (2023) — link
- Code Llama: Open Foundation Models for Code (2023) — link
- Improving language understanding by generative pre-training (2018)
- GPT-4 Technical Report (2023) — link
- FinGPT: Open-Source Financial Large Language Models — → 2306.06031
- Bloomberggpt: A large language model for finance (2023) — link
- Sentiment-influenced trading system based on multimodal deep reinforcement learning (2021)
- A Deep Multimodal Reinforcement Learning System Combined with CNN and LSTM for Stock Trading (2019) — link
- Design and implementation of a multiagent stock trading system (2012)
- MSPM: A modularized and scalable multi-agent reinforcement learning-based system for financial portfolio management (2022)
- A multi-agent Q-learning framework for optimizing stock trading systems (2002)
- A multi-agent deep reinforcement learning framework for algorithmic trading in financial markets (2022)
- Modelling stock markets by multi-agent reinforcement learning (2021)
- word2vec Explained: deriving Mikolov et al.’s negative-sampling word-embedding method (2014) — link
- Glove: Global vectors for word representation (2014)
- Bert: Pre-training of deep bidirectional transformers for language understanding (2018) — link
- Long short-term memory based recurrent neural network architectures for large vocabulary speech recognition (2014) — link
- Interactive narrative: A novel application of artificial intelligence for computer games (2012)
- Weaviate — link
- Cohere: Privacy Management in Large Scale Systems (2023) — link
- Human memory: A proposed system and its control processes (1968)
- What are the differences between long-term, short-term, and working memory? (2008)
- Llama: Open and efficient foundation language models (2023) — link
- Generative AI for End-to-End Limit Order Book Modelling: A Token-Level Autoregressive Generative Model of Message Flow Using a Deep State Space Network (2023) — link
- Modelling microstructure noise with mutually exciting point processes (2013)
- Modeling foreign exchange market activity around macroeconomic news: Hawkes-process approach (2015)
- Modelling security market events in continuous time: Intensity based, multivariate point process models (2007)
- Limit theorems for nearly unstable Hawkes processes (2016)
- Exact simulation of Hawkes process with exponentially decaying intensity (2013)
- Bayesian Estimation of the ETAS Model for Earthquake Occurrences (2021)
- Bayesian Inference for Hawkes Processes (2013) — link
- Sora by OpenAI (2024) — link
- Mamba: Linear-Time Sequence Modeling with Selective State Spaces (2023) — link
- Benchmark dataset for mid-price forecasting of limit order book data with machine learning methods (2018) — link
- Forecasting Stock Prices from the Limit Order Book Using Convolutional Neural Networks (2017) — link
- DeepLOB: Deep Convolutional Neural Networks for Limit Order Books (2019) — link
- BDLOB: Bayesian Deep Convolutional Neural Networks for Limit Order Books (2018) — link
- Transformers for Limit Order Books (2020) — link
- Flow Matching for Generative Modeling (2022) — link
- Proximal Policy Optimization Algorithms (2017) — link
- Denoising diffusion probabilistic models (2020)
- Score-Based Generative Modeling through Stochastic Differential Equations (2021)
- Reverse-Time Diffusion Equation Models (1982)
- Market microstructure: A survey (2000)
- Trading and exchanges: Market microstructure for practitioners (2002)
- High-frequency trading in a limit order book (2008)
- Buy low, sell high: A high frequency trading perspective (2014)
- High frequency market making: Implications for liquidity (2017)
- Dealing with the inventory risk: a solution to the market making problem (2013)
- Reinforcement learning: An introduction (2018)
- Reinforcement Learning in High-frequency Market Making — → 2407.21025
- Deep reinforcement learning in high frequency trading (2018) — link
- Reinforcement learning in robotics: A survey (2013)
- Deep unsupervised learning using nonequilibrium thermodynamics (2015)
- Planning with diffusion for flexible behavior synthesis (2022) — link
- Diffusion Policy: Visuomotor Policy Learning via Action Diffusion (2024)
- Diffusion policies as an expressive policy class for offline reinforcement learning (2022) — link
- One step diffusion via shortcut models (2024) — link
- Point spectra of some mutually exciting point processes (1971)
- Attention is all you need (2017)
- Film: Visual reasoning with a general conditioning layer (2018)
- U-net: Convolutional networks for biomedical image segmentation (2015)
- Hawkes processes in finance (2015)
- Option pricing when underlying stock returns are discontinuous (1976)
- Continuous auctions and insider trading (1985)
- Informed speculation with imperfect competition (1989)
- Nice: Non-linear independent components estimation (2014) — link
- Score-based generative modeling through stochastic differential equations (2020) — link
- Handbook of Stochastic Methods (2004)
- The Fokker-Planck Equation: Methods of Solution and Applications (1996)
- Numerical Solution of Stochastic Differential Equations (1999)
- Markov chain Monte Carlo with approximate proposals (2015)
- Large deviations for diffusion processes with unbounded coefficients (2006)
- Optimal execution of portfolio transactions (2001)
- Optimal Trade Execution (1996)
- Optimal execution and transaction costs (1996)
- Volume Weighted Average Price: A Primer (2018)
- Reinforcement Learning: An Introduction (1998)
- Human-level control through deep reinforcement learning (2015)
- Continuous control with deep reinforcement learning (2015) — link
- Denoising diffusion probabilistic models (2020) — link
- Title of the Paper (2019)
- A multivariate Hawkes process approach for modeling financial market activity (2014)
- Hawkes processes for energy markets: Modeling negative and positive jumps (2021)
- Long short-term memory (1997)
- Learning phrase representations using RNN encoder-decoder for statistical machine translation (2014)
- HiPPO: A continuous-time sequence model (2020) — link
- Mamba2: Enhancing state-space models for continuous memory (2023)
- Chain-of-thought prompting elicits reasoning in large language models (2022) — link
- Chain of Continuous Thought: Novel Paradigm with Enhanced LLM Reasoning in Continuous Latent Space (2023)
- Multi-Agent Systems for Financial Trading: A Survey (2021)
- Language models are few-shot learners (2020) — link
- Advanced Continuous Reasoning in Latent Spaces (2024) — link
- Training Large Language Models to Reason in a Continuous Latent Space (2024) — link
- Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality (2024) — link
- HiPPO: Recurrent Memory with Optimal Polynomial Projections (2020) — link
- Market making under a weakly consistent limit order book model (2019)
- High-frequency market making to large institutional trades (2019)
- High-frequency market-making with inventory constraints and directional bets (2012) — link
- Brownian motion (2010)
- Lectures on the Poisson process (2017)
- The Financial Mathematics of Market Liquidity: From optimal execution to market making (2016)
- The problem of calibrating an agent-based model of high-frequency trading (2016) — link
- Deep reinforcement learning for active high frequency trading (2021) — link
- Reinforcement learning: A survey (1996)
- Introduction to reinforcement learning (2020)
- Markov decision processes (1990)
- Earnhft: Efficient hierarchical reinforcement learning for high frequency trading (2024)
- Reinforcement learning for stock prediction and high-frequency trading with T+ 1 rules (2022)
- Deep reinforcement learning for trading (2019) — link
- Frequant: A reinforcement-learning based adaptive portfolio optimization with multi-frequency decomposition (2024)
- Inside the black box: A simple guide to quantitative and high-frequency trading (2013)
- MacroHFT: Memory Augmented Context-aware Reinforcement Learning On High Frequency Trading (2024)
- Flow matching in latent space (2023) — link
- Flow matching guide and code (2024) — link
- Flowpolicy: Enabling fast and robust 3d flow-based policy via consistency flow matching for robot manipulation (2025)
- Shortcut to greatness: The new thinking and the revolution in Soviet foreign policy (2003)
2 of 128 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.