Paper: arXiv 2510.04569
Authors: Jian’an Zhang
Abstract
We formulate option market making as a constrained, risk-sensitive control problem that unifies execution, hedging, and arbitrage-free implied-volatility surfaces inside a single learning loop. A fully differentiable eSSVI layer enforces static no-arbitrage conditions (butterfly and calendar) while the policy controls half-spreads, hedge intensity, and structured surface deformations (state-dependent rho-shift and psi-scale). Executions are intensity-driven and respond monotonically to spreads and relative mispricing; tail risk is shaped with a differentiable CVaR objective via the Rockafellar–Uryasev program. We provide theory for (i) grid-consistency and rates for butterfly/calendar surrogates, (ii) a primal–dual grounding of a learnable dual action acting as a state-dependent Lagrange multiplier, (iii) differentiable CVaR estimators with mixed pathwise and likelihood-ratio gradients and epi-convergence to the nonsmooth objective, (iv) an eSSVI wing-growth bound aligned with Lee’s moment constraints, and (v) policy-gradient validity under smooth surrogates. In simulation (Heston fallback; ABIDES-ready), the agent attains positive adjusted P&L on most intraday segments while keeping calendar violations at numerical zero and butterfly violations at the numerical floor; ex-post tails remain realistic and can be tuned through the CVaR weight. The five control heads admit clear economic semantics and analytic sensitivities, yielding a white-box learner that unifies pricing consistency and execution control in a reproducible pipeline.
Complexity vs Empirical Score
- Math Complexity: 9.2/10
- Empirical Rigor: 7.8/10
- Quadrant: Holy Grail — high math complexity, high empirical rigor
Why this score: The paper presents a highly advanced mathematical framework integrating stochastic control, constrained reinforcement learning, and differential geometry of arbitrage-free eSSVI surfaces, with rigorous theoretical proofs (e.g., convergence rates, primal-dual theory, CVaR gradient estimators). Empirically, it uses a sophisticated agent-based simulator (ABIDES-ready) with Heston fallback, reporting concrete metrics like P&L, arbitrage violations, and tunable tail risk, indicating substantial implementation and backtesting effort.
Research Flowchart
flowchart TD
A["Research Goal: Unify execution, hedging, & arbitrage-free surfaces in risk-sensitive market making"] --> B{"Key Methodology: Constrained RL & Stochastic Control Bridge"}
B --> C["Policy Control Heads<br/>Half-spreads, Hedge intensity, Surface deformations"]
B --> D["eSSVI Layer<br/>Enforces no-arbitrage constraints<br/>(Butterfly & Calendar)"]
B --> E["Objective Function<br/>Differentiable CVaR via Rockafellar-Uryasev"]
C --> F["Computational Process<br/>Constrained Policy Optimization<br/>Primal-Dual & Gradient Flow"]
D --> F
E --> F
F --> G["Simulations: Heston Fallback & ABIDES"]
G --> H["Key Outcomes:<br/>Positive P&L, Zero Calendar Violations, Tunable Tail Risk"]
Cited References (66)
- Optimal Dealer Pricing under Transactions and Return Uncertainty (1981)
- Bid, Ask and Transaction Prices in a Specialist Market with Heterogeneously Informed Traders (1985)
- Continuous Auctions and Insider Trading (1985)
- High-frequency trading in a limit order book (2008)
- Dealing with the Inventory Risk: A Solution to the Market Making Problem (2013)
- Algorithmic and High-Frequency Trading (2015)
- Buy Low, Sell High: A High Frequency Trading Perspective (2014)
- The Price Impact of Order Book Events: An Empirical Study (2014)
and 58 more
- The Flash Crash: High-Frequency Trading in an Electronic Market (2017)
- Empirical Market Microstructure (2007)
- Limit Order Books: A Survey (2013)
- Spectra of Some Self-Exciting and Mutually Exciting Point Processes (1971)
- Hawkes Processes in Finance (2015)
- Arbitrage-Free SVI Volatility Surfaces (2014)
- The Extended SSVI Volatility Surface (2019)
- No-Arbitrage SVI (2022)
- A Note on Sufficient Conditions for No Arbitrage (2005)
- Arbitrage-Free Implied Volatility Surfaces (2010) — link
- From Implied to Spot Volatilities (2009)
- The Moment Formula for Implied Volatility at Extreme Strikes (2004)
- The Pricing of Options and Corporate Liabilities (1973)
- Theory of Rational Option Pricing (1973)
- Prices of State-Contingent Claims Implicit in Option Prices (1978)
- A Closed-Form Solution for Options with Stochastic Volatility with Applications to Bond and Currency Options (1993)
- Deep Hedging (2019)
- Estimating Risks of Option Books Using Neural-SDE Market Models (2023)
- Arbitrage-Free Neural-SDE Market Models (2021) — link
- Deep Hedging: Learning to Simulate Equity Option Markets (2019) — link
- Optimization of Conditional Value-at-Risk (2000)
- Conditional Value-at-Risk for General Loss Distributions (2002)
- Some Remarks on the Value-at-Risk and the Conditional Value-at-Risk (2000)
- Algorithms for CVaR Optimization in MDPs (2014)
- Policy Gradient for Coherent Risk Measures (2015)
- Risk-Constrained Reinforcement Learning with Percentile Risk Criteria (2018)
- Near-Minimax-Optimal Risk-Sensitive Reinforcement Learning with CVaR (2023)
- Risk-Sensitive Reward-Free Reinforcement Learning with CVaR (2024)
- ABIDES: Towards High-Fidelity Market Simulation for AI Research (2020) — link
- ABIDES-Gym: Gym Environments for Multi-Agent Discrete Event Simulation of Limit Order Books (2021)
- Simulation of Arbitrage-Free Implied Volatility Surfaces (2023)
- Risk-Sensitive Markov Decision Processes (1972)
- A Mean Field Game Between Informed Traders and a Broker — → 2401.05257
- Brokers and Informed Traders: Dealing with Toxic Flow and Extracting Trading Signals (2025)
- Market Making with Exogenous Competition — → 2407.17393
- Proximal Policy Optimization Algorithms (2017)
- High-Dimensional Continuous Control Using Generalized Advantage Estimation (2016)
- On the Coherence of Expected Shortfall (2002)
- Coherent Measures of Risk (1999)
- Constrained Markov Decision Processes (1999)
- Markov Decision Processes: Discrete Stochastic Dynamic Programming (1994)
- Risk-Averse Dynamic Programming for Markov Decision Processes (2010)
- Lectures on Stochastic Programming: Modeling and Theory (2014)
- Constrained Policy Optimization (2017)
- Reward Constrained Policy Optimization (2019)
- A Long-Memory Model for Order Flow (2015)
- Trades, Quotes and Prices: Financial Markets Under the Microscope (2018)
- Monte Carlo Methods in Financial Engineering (2004)
- Trust Region Policy Optimization (2015)
- A Natural Policy Gradient (2002)
- Deep Reinforcement Learning that Matters (2018)
- Adam: A Method for Stochastic Optimization (2014) — link
- Options, Futures, and Other Derivatives (2018)
- The Complete Guide to Option Pricing Formulas (2007)
- Paul Wilmott on Quantitative Finance (2006)
- Variational Analysis (1998)
- Policy Gradient Methods for Reinforcement Learning with Function Approximation (2000)
- Simulation-Based Optimization of Markov Reward Processes (2001)
2 of 66 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.