Paper: arXiv 2505.15602
Authors: Patrick Cheridito, Jean-Loup Dupret, Donatien Hainaut
Abstract
In this paper, we introduce a model-based deep-learning approach to solve finite-horizon continuous-time stochastic control problems with jumps. We iteratively train two neural networks: one to represent the optimal policy and the other to approximate the value function. Leveraging a continuous-time version of the dynamic programming principle, we derive two different training objectives based on the Hamilton-Jacobi-Bellman equation, ensuring that the networks capture the underlying stochastic dynamics. Empirical evaluations on different problems illustrate the accuracy and scalability of our approach, demonstrating its effectiveness in solving complex, high-dimensional stochastic control tasks.
Complexity vs Empirical Score
- Math Complexity: 9.2/10
- Empirical Rigor: 6.5/10
- Quadrant: Holy Grail — high math complexity, high empirical rigor
Why this score: The paper employs dense advanced mathematics including stochastic calculus, Hamilton-Jacobi-Bellman PIDEs, and continuous-time dynamic programming, while also demonstrating empirical rigor with specific algorithms (GPI-PINN/CBU), code availability, and comparative backtests against established methods.
Research Flowchart
flowchart TD A["Research Goal: Solve continuous-time stochastic control with jumps"] --> B["Method: Model-based deep learning<br/>Continuous-time dynamic programming"] B --> C["Data/Inputs: Problem parameters<br/>(dynamics, horizon, cost functions)"] C --> D["Computational Process:<br/>Iterative training of two NNs"] D --> E["NN1: Policy Network<br/>Optimal control approximation"] D --> F["NN2: Value Network<br/>Value function approximation"] D --> G["Training: HJB equation<br/>based objectives"] E & F & G --> H["Outcomes:<br/>Accurate & scalable solution<br/>for high-dimensional problems"]
Cited References (341)
- A closed-form solution for options with stochastic volatility with applications to bond and currency options (1993)
- Deep learning for high-dimensional continuous-time stochastic optimal control without explicit solution (2024)
- Applied S tochastic C ontrol of J ump D iffusions (2007)
- Probability: Theory and Examples (2019)
- Optimal control of jump-Markov processes and viscosity solutions (1988)
- Risk management with local least squares M onte C arlo (2023)
- The volatility surface: a practitioner’s guide (2011)
- When and why PINN s fail to train: a neural tangent kernel perspective (2022)
and 333 more
- Neural G alerkin schemes with active learning for high-dimensional evolution equations (2024)
- Reinforcement learning for jump-diffusions with financial applications (2024)
- q-Learning in continuous time (2023)
- Applied stochastic processes and control for jump-diffusions: modeling, analysis and computation (2007)
- Introduction to Stochastic Control of Mixed Diffusion Processes, Viscosity Solutions and Applications in Finance and Insurance (2021)
- Reinforcement learning in continuous time and space: a stochastic control approach (2020)
- Optimal scheduling of entropy regularizer for continuoustime linear-quadratic reinforcement learning (2024)
- A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networks (2023)
- DeepXDE: A deep learning library for solving differential equations (2021)
- Stochastic optimal control matching (2024)
- Reinforcement learning in continuous time and space (2000)
- Adjoint matching: fine-tuning flow and diffusion generative models with memoryless stochastic optimal control (2024)
- Decoupling the short-and long-term behavior of stochastic volatility (2016) — link
- Fractional O rnstein- U hlenbeck processes (2003)
- Pricing under rough volatility (2016)
- Physics informed deep learning (Part 1): Data-driven solutions of nonlinear partial differential equations (2017) — link
- The distribution of realized stock return volatility (2001)
- Option valuation using the fast F ourier transform (1999)
- The W orld of VG (2009)
- Fractional B rownian motions, fractional noises and applications (1968)
- Discovering governing equations from data by sparse identification of nonlinear dynamical systems (2016)
- Data-driven discovery of coordinates and governing equations (2019)
- Neural actor-critic methods for H amilton– J acobi– B ellman PDE s: asymptotic analysis and numerical studies (2025)
- Towards automatic actor-critic solutions to continuous control (2021)
- Trust region policy optimization (2015)
- Solving time-continuous stochastic optimal control problems: Algorithm design and convergence analysis of actor-critic flow (2024)
- Brownian motion (1998)
- Asymptotic analysis for stochastic volatility: martingale expansion (2011)
- Stochastic volatility’s orderly smiles (2012)
- Stochastic V olatility M odeling (2015)
- The characteristic function of rough H eston models (2019)
- Roughening H eston (2019)
- Affine forward variance models (2019)
- Rational approximation of the rough H eston solution (2019)
- Hybrid scheme for B rownian semistationary processes (2017)
- The performance of popular stochastic volatility option pricing models during the subprime crisis (2011)
- Turbocharging M onte C arlo pricing for the rough B ergomi model (2018)
- Short-time at-the-money skew and rough fractional volatility (2017)
- Asymptotics for rough stochastic volatility models (2017)
- Short-time near-the-money skew in rough fractional volatility models (2019, a)
- On deep calibration of (rough) stochastic volatility models (2019, b) — link
- Long memory in continuous-time stochastic volatility models (1998)
- L 'e vy processes and stochastic calculus (2009)
- Regression-based algorithms for life insurance contracts with surrender guarantees (2010)
- A comparison of biased simulation schemes for stochastic volatility models (2010)
- Pricing equity-linked life insurance with endogenous minimum guarantees (1993)
- Weak approximation of stochastic differential equations and application to derivative pricing (2008)
- Mortality modelling with L 'e vy processes (2008)
- Modelling and management of mortality risk: a review (2008)
- Perfect hedging in rough H eston models (2018)
- Lifting the H eston model (2019)
- Multifactor approximation of rough volatility models (2019)
- Full and fast calibration of the H eston stochastic volatility model (2017)
- Simulated annealing (1987)
- On calibration of stochastic and fractional stochastic volatility models (2016)
- Approximation of the fractional B rownian sheet via O rnstein- U hlenbeck sheet (2007)
- Arbitrage-free SVI volatility surfaces (2014)
- Large deviations for local times and intersection local times of fractional B rownian motions and R iemann– L iouville processes (2011)
- Consistent variance curve models (2006)
- Portfolio insurance under rough volatility and V olterra processes (2021)
- Portfolio insurance strategies: a comparison of standard methods when the volatility of the stock is stochastic (2003)
- Portfolio Insurance: The Extreme Value Approach Applied to the CPPI Method (2016)
- Empirical characteristic function estimation and its applications (2004)
- Constant proportion portfolio insurance in the presence of jumps in asset prices (2009)
- The pricing of options on assets with stochastic volatilities (1987)
- Markovian structure of the V olterra H eston model (2019)
- Dynamic estimation of volatility risk premia and investor risk aversion from option-implied and realized volatilities (2011)
- Decomposition method for solving fractional R iccati differential equations (2006)
- A predictor-corrector approach for the numerical solution of fractional differential equations (2002)
- Hedging of contingent claims under incomplete information (1991)
- Moment explosions in the rough H eston model (2019)
- Coherent measures of risk (1999)
- Risk management of CPPI funds in switching regime markets (2011)
- Affine V olterra processes (2019)
- Improving the design of financial products in a multidimensional B lack- S choles market (2011)
- Dynamic strategies for asset allocation (1988)
- Theoretical foundations of constant-proportion portfolio insurance (1989)
- On the optimal design of insurance contracts with guarantees (2010)
- Optimal dynamic trading with leverage constraints (1992)
- Inhomogeneous affine V olterra processes (2020) — link
- On the optimality of path-dependent structured funds: The cost of standardization (2019)
- Martingale M ethods in financial M odelling (2006)
- The pricing of options and corporate liabilities (1973)
- Effectiveness of CPPI strategies under discrete-time trading (2009)
- Simplifying portfolio insurance (1987)
- Portfolio insurance strategies: OBPI versus CPPI (2001)
- Risk management of time varying floors for dynamic portfolio insurance (2018)
- CPPI with cushion insurance (2005)
- Recent developments in portfolio insurance (2008)
- Particle M arkov C hain M onte C arlo methods (2010)
- Is market fear persistent? A long-memory analysis (2018)
- Pension funds rules: P aradoxes in risk control (2017)
- Pricing of commodity derivatives on processes with memory (2020)
- MCMC methods for continuous-time financial econometrics (2010)
- An introduction to sequential M onte C arlo methods (2001)
- Efficient pricing of CPPI using M arkov operators (2009)
- Affine rough models (2018) — link
- A fractional multi-states model for insurance (2021)
- Option pricing in illiquid markets: A fractional jump–diffusion approach (2021)
- Black- S choles formula in subdiffusive regime (2009)
- Time-changed geometric fractional B rownian motion and option pricing with transaction costs (2012)
- Pricing E uropean option under the time-changed mixed Brownian-fractional Brownian model (2014)
- Pricing E uropean options and currency options by time changed mixed fractional B rownian motion with transaction costs (2016)
- Novel approach to nonlinear/non- Gaussian Bayesian state estimation (1993)
- Stochastic representation of subdiffusion processes with time-dependent drift (2009)
- The microstructural foundations of leverage effect and rough volatility (2018)
- Risk measures and comonotonicity: a review (2006)
- A fractional H awkes process for illiquidity modeling (2023)
- Probability distribution of returns in the Heston model with stochastic volatility (2002)
- On the C aputo operator of fractional calculus and C-L aguerre functions (2005)
- Continuous time Black–Scholes equation with transaction costs in subdiffusive fractional Brownian motion regime (2012)
- The random walk’s guide to anomalous diffusion: a fractional dynamics approach (2000)
- The restaurant at the end of the random walk: recent developments in the description of anomalous transport by fractional dynamics (2004)
- Five years of continuous-time random walks in econophysics (2006)
- Subdynamics of financial data from fractional Fokker-Planck equation (2009)
- Arbitrage in fractional Brownian motion models (2003)
- Black– S choles model under subordination (2003)
- Convolution-type derivatives, hitting-times of subordinators and time-changed $ C_0 $ -semigroups (2015)
- Financial M odelling with J ump P rocesses (2003)
- Optimal filtering of jump diffusions: E xtracting latent states from asset prices (2009)
- Estimation and Filtering With Big Option Data (2018)
- CDS pricing with fractional Hawkes processes (2022)
- Moment generating function of non-Markov self-excited claims processes (2021)
- A long memory property of stock market returns and a new model (1993)
- Solution of different type of the partial differential equation by differential transform method and Adomian’s decomposition method (2006)
- Fractional Taylor series for Caputo fractional derivatives. Construction of numerical schemes (2008)
- A new Fourier transform algorithm for value-at-risk (2004)
- Fluctuations and response in financial markets: the subtle nature of random price changes (2003)
- Optimal design of derivatives in illiquid markets (2002)
- Option pricing with L 'e vy-stable processes generated by L 'e vy-stable integrated variance (2009)
- Jumps and stochastic volatility: E xchange rate processes implicit in D eutsche mark options (1996)
- Calcul stochastique et probl `e mes de martingales (1979)
- Triangular array limits for continuous time random walks (2008)
- Bernstein functions: Theory and Applications (2010)
- Subordinators: Examples and Applications (1999)
- Trade duration risk in subdiffusive financial models (2020)
- Anomalous diffusions in option prices: connecting trade duration and the volatility term structure (2020)
- On changes of measure in stochastic volatility models (2006)
- The finite moment log stable process and option pricing (2003)
- Option pricing for a logstable asset price model (1999)
- Generalized Taylor’s formula (2007)
- Moment explosions in stochastic volatility models (2007)
- Moment Explosions (2010)
- Semi- Markov approach to continuous time random walk limit processes (2014)
- Limit theorems for prices of options written on semi- Markov processes (2021)
- Option pricing and hedging in illiquid markets in presence of jump clustering (2022)
- Fractional calculus and continuous-time finance II : the waiting-time distribution (2000)
- Fractional calculus and continuous-time finance (2000)
- Coupled continuous time random walks in finance (2006)
- Limit theorems for continuous-time random walks with infinite mean waiting times (2004)
- Fractional governing equations for coupled random walks (2012)
- Fractional diffusion models of option prices in markets with jumps (2007)
- How duration between trades of underlying securities affects option prices (2010)
- Time and the price impact of a trade (2000)
- Stochastic calculus for a time-changed semimartingale and the associated stochastic differential equations (2011)
- Hawkes process: F ast calibration, application to trade clustering, and diffusive limit (2014)
- A fractional H awkes process (2021)
- On the M ittag– L effler distributions (1998)
- Fractional H awkes processes (2020)
- Why the M ittag- L effler function can be considered the queen function of the fractional calculus? (2020)
- Fonctions de M ittag– L effler et processus de L 'e vy stables sans sauts n 'e gatifs (2010)
- Introductory lectures on fluctuations of L 'e vy processes with applications (2006)
- Critical reflexivity in financial markets: a H awkes process analysis (2013)
- Implied roughness in the term structure of oil market volatility (2024)
- Multilayer feedforward networks are universal approximators (1989)
- Volatility clustering in financial markets: empirical facts and agent-based models (2007)
- Non-parametric kernel estimation for symmetric H awkes processes. Application to high frequency financial data (2012)
- How markets slowly digest changes in supply and demand (2009)
- Branching-ratio approximation for the self-exciting H awkes process (2014)
- Higher T ranscendental F unctions (1953)
- Mittag– L effler functions and complete monotonicity (2015)
- Hawkes processes in finance (2015)
- Limit theorems for nearly unstable H awkes processes (2015)
- Rough fractional diffusions as scaling limits of nearly unstable heavy tailed H awkes processes (2016)
- Volatility is rough (2018)
- Market impact as anticipation of the order flow imbalance (2015)
- Hawkes model for price and trades high-frequency dynamics (2014)
- Estimation of slowly decreasing H awkes kernels: application to high-frequency order book dynamics (2016)
- High frequency market microstructure (2015)
- Affine point processes and portfolio credit risk (2010)
- A top-down approach to multiname credit (2011)
- Note on the inversion of the L aplace transform (1950)
- Price impact or trading volume: W hy is the A mihud (2002) measure priced? (2017)
- Can hedge funds time market liquidity? (2013)
- Rare event simulation for a generalized H awkes process (2009)
- A bivariate H awkes process for interest rate modeling (2016)
- The convolution transform (2012)
- Spectra of some self-exciting and mutually exciting point processes (1971)
- Illiquidity and stock returns: cross-section and time-series effects (2002)
- Order flow, transaction clock, and normality of asset returns (2000)
- The relation between price changes and trading volume: A survey (1987)
- Stock prices and volume (1992)
- The pricing of illiquidity as a characteristic and as risk (2015)
- Dynamic A utoregressive L iquidity ( DA r L i Q ) (2022)
- Multivariate H awkes processes: an application to financial data (2011)
- Long memory self-exciting jump diffusion for asset prices modeling (2022)
- Long memory in stock-market trading volume (2000)
- Hedging of options in the presence of jump clustering (2018)
- Portfolio optimization in fractional and rough H eston models (2020)
- Hawkes jump-diffusions and finance: a brief history and review (2022)
- Modeling financial contagion using mutually exciting jump processes (2015)
- A model for interest rates with clustering effects (2016)
- An analysis of the A mihud illiquidity premium (2013)
- Do liquidity measures measure liquidity? (2009)
- Continuous time processes for finance. S witching, self-exciting, fractional and other recent dynamics (2022)
- Volatility swaps and volatility options on discretely sampled realized variance (2014)
- Liquidation with self-exciting price impact (2016)
- Portfolio Choice in Markets with Contagion (2016)
- A switching microstructure model for stock prices (2019)
- Long-range dependence and self-similarity (2017)
- Optimal selling of an asset with jumps under incomplete information (2013)
- No-dynamic-arbitrage and market impact (2010)
- Dirac Processes and Default Risk (2015) — link
- A Unified Framework for Default Modeling (2022)
- Dynamic optimal execution in a mixed-market-impact H awkes price model (2016)
- Algorithmic and H igh- F requency T rading (2015)
- General intensity shapes in optimal liquidation (2015)
- Liquidation in limit order books with controlled intensity (2014)
- Incorporating order-flow into optimal execution (2016)
- Algorithmic trading with model uncertainty (2017)
- Price manipulation and quasi-arbitrage (2004)
- Direct estimation of equity market impact (2005)
- Barra market impact model handbook (1997)
- Optimal execution with nonlinear impact functions and trading-enhanced risk (2003)
- Th 'e orie des distributions (1966)
- Optimal liquidation with signals: the general propagator case (2022)
- Optimal liquidation problem in illiquid markets (2022)
- Liquidity Models in Continuous and Discrete Time (2011)
- The Financial Mathematics of Market Liquidity: From optimal execution to market making (2016)
- Optimal execution of portfolio transactions (2001)
- Value under liquidation (1999)
- Trades, Q uotes and P rices: financial markets under the microscope (2018)
- Optimal trading strategy and supply/demand dynamics (2013)
- Optimal execution strategies in limit order books with general shape functions (2010)
- Optimal control of execution costs (1998)
- A mathematical approach to order book modeling (2013)
- Simulating and analyzing order book data: The queue-reactive model (2015)
- Price dynamics in a Markovian limit order market (2013)
- Fokker-planck description for the queue dynamics of large tick stocks (2013)
- A causality-free neural network method for high-dimensional Hamilton-Jacobi-Bellman equations (2020)
- Deep splitting method for parabolic PDE s (2021)
- Adaptive deep learning for high-dimensional Hamilton–Jacobi–Bellman equations (2021)
- Dynamical models of market impact and algorithms for order execution (2013)
- Deep reinforcement learning for the optimal placement of cryptocurrency limit orders (2022)
- Optimal trade execution: a mean quadratic variation approach (2012)
- Controlled stochastic differential equations under Poisson uncertainty and with unbounded utility (2007)
- Optimal execution: A review (2022)
- Buy low, sell high: A high frequency trading perspective (2014)
- The price impact of order book events (2014)
- Continuous auctions and insider trading (1985)
- Optimal execution with non-linear transient market impact (2017)
- Optimal trade execution and price manipulation in order books with time-varying liquidity (2014)
- Optimal trade execution in order books with stochastic liquidity (2019)
- A simple microstructure model based on the Cox- BESQ process with application to optimal execution policy (2021)
- Deep learning approximation for stochastic control problems (2016)
- Numerical solution of the Hamilton–Jacobi–Bellman equation for stochastic optimal control problems (2005)
- On the convergence of finite element methods for Hamilton–Jacobi–Bellman equations (2013)
- Semi- Lagrangian schemes for linear and fully non-linear diffusion equations. (2013)
- Numerical Methods for Hamilton-Jacobi-Bellman Equations (2017) — link
- Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equations (2017)
- Three ways to solve partial differential equations with neural networks – a review (2021)
- Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations (2019)
- DGM : A deep learning algorithm for solving partial differential equations (2018)
- The deep parametric PDE method and applications to option pricing (2022)
- Solving the K olmogorov PDE by means of deep learning (2021)
- Numerically solving parametric families of high-dimensional K olmogorov partial differential equations via deep learning (2020)
- Solving high-dimensional partial differential equations using deep learning (2018)
- Machine learning approximation algorithms for high-dimensional fully nonlinear partial differential equations and second-order backward stochastic differential equations (2019)
- Machine learning for semi linear PDE s (2019)
- Solving stochastic optimal control problem via stochastic maximum principle with deep learning method (2022)
- The application of improved physics-informed neural network ( IPINN ) method in finance (2022)
- A unified deep artificial neural network approach to partial differential equations in complex geometries (2018)
- Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach (2005)
- Reinforcement L earning: A n I ntroduction (2018)
- A Course in R einforcement L earning (2023)
- Dynamic programming and M arkov processes (1960)
- Deep neural networks algorithms for stochastic control problems on finite horizon: numerical applications (2022)
- Deep neural networks algorithms for stochastic control problems on finite horizon: convergence analysis (2021)
- Approximate dynamic programming for real-time control and neural modeling (1992)
- Deep reinforcement learning: A n overview (2017) — link
- Online actor–critic algorithm to solve the continuous-time infinite horizon optimal control problem (2010)
- Deep learning (2015)
- Adaptive optimal control algorithm for continuous-time nonlinear systems based on policy iteration (2008)
- Adaptive optimal control for continuous-time linear systems based on policy iteration (2009)
- Continuous-time time-varying policy iteration (2019)
- Stochastic differential equations: an introduction with applications (2013)
- Optimal control of PDE s using physics-informed neural networks (2023)
- On the policy improvement algorithm in continuous time (2017)
- Long short-term memory (1997)
- Highway networks (2015) — link
- A proof that rectified deep neural networks overcome the curse of dimensionality in the numerical approximation of semilinear heat equations (2020)
- Optimal stochastic control, stochastic target problems, and backward SDE (2012)
- Global Convergence of Deep Galerkin and PINN s Methods for Solving Partial Differential Equations (2023) — link
- Error analysis for P hysics- I nformed N eural N etworks ( PINN s) approximating K olmogorov PDE s (2022)
- Optimal liquidation under indirect price impact with propagator (2023)
- Impact of rough stochastic volatility models on long-term life insurance pricing (2023)
- Trading co-integrated assets with price impact (2019)
- Optimal trading with signals and stochastic price impact (2022)
- Enhancing trading strategies with order book signals (2018)
- Strong error analysis for stochastic gradient descent optimization algorithms (2021)
- Gradient descent finds global minima of deep neural networks (2019)
- Relaxed actor-critic with convergence guarantees for continuous-time optimal control of nonlinear systems (2023)
- Valuation of guaranteed minimum accumulation benefits (GMABs) with physics-inspired neural networks (2024)
- Weak existence and uniqueness for affine stochastic V olterra equations with L1 -kernels (2021)
- Affine V olterra processes with jumps (2024)
- The rough H awkes H eston stochastic volatility model (2022) — link
- Price, trade size, and information in securities markets (1987)
- A subdiffusive stochastic volatility jump model (2023)
- Piecewise constant martingales and lazy clocks (2019)
- A neural network approach for stochastic optimal control (2024)
- Solving high-dimensional Hamilton–Jacobi–Bellman PDEs using neural networks: perspectives from the theory of controlled diffusions and measures on path space (2021)
- A distributional perspective on reinforcement learning (2017)
- A family of embedded Runge–Kutta formulae (1980)
- Soft actor-critic: off-policy maximum entropy deep reinforcement learning with a stochastic actor (2018)
- Optimal trade execution with instantaneous price impact and stochastic resilience (2017)
- Viscosity solutions for controlled McKean–Vlasov jump-diffusions (2020)
- Controlled Markov processes and viscosity solutions (2006)
- Adam: A method for stochastic optimization (2014) — link
- Weak dynamic programming principle for viscosity solutions (2011)
- Rough stochastic volatility modeling (2020)
- Affine H eston model style with self-exciting jumps and long memory (2024)
- A convergence theory for deep learning via over-parameterization (2019)
- Deep reinforcement learning through policy optimization (2016)
- Proximal policy optimization algorithms (2017)
- Playing A tari with deep reinforcement learning (2013)
- Residual algorithms: reinforcement learning with function approximation (1995)
- Addressing function approximation error in actor-critic methods (2018)
- Stochastic liquidity as a proxy for nonlinear price impact (2024)
- Optimal portfolio liquidation with cross-price impacts on trading (2022)
- Machine learning for continuous-time finance (2024)
- Asynchronous methods for deep reinforcement learning (2016)
- Continuous control with deep reinforcement learning (2019)
- Benchmarking deep reinforcement learning for continuous control (2016)
0 of 341 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.