Paper: arXiv 2501.12600

Abstract

We propose a scalable, policy-centric framework for continuous-time multi-asset portfolio-consumption optimization under inequality constraints. Our method integrates neural policies with Pontryagin’s Maximum Principle (PMP) and enforces feasibility by maximizing a log-barrier-regularized Hamiltonian at each time-state pair, thereby satisfying KKT conditions without value-function grids. Theoretically, we show that the barrier-regularized Hamiltonian yields O($ε$) policy error and a linear Hamiltonian gap (quadratic when the KKT solution is interior), and we extend the BPTT-PMP correspondence to constrained settings with stable costate convergence. Empirically, PG-DPO and its projected variant (P-PGDPO) recover KKT-optimal policies in canonical short-sale and consumption-cap problems while maintaining strict feasibility across dimensions; unlike PDE/BSDE solvers, runtime scales linearly with the number of assets and remains practical at n=100. These results provide a rigorous and scalable foundation for high-dimensional constrained continuous-time portfolio optimization.

Complexity vs Empirical Score

  • Math Complexity: 9.0/10
  • Empirical Rigor: 7.5/10
  • Quadrant: Holy Grail — high math complexity, high empirical rigor

Why this score: The paper features highly advanced mathematics including Pontryagin’s Maximum Principle, barrier-regularized Hamiltonians, KKT conditions, and high-dimensional convergence proofs, warranting a near-maximal complexity score. Empirically, it demonstrates scalable algorithms with linear runtime scaling to 100 assets, validates feasibility on canonical constrained problems, and compares against PDE/BSDE baselines, indicating strong implementation readiness despite the absence of explicit backtesting data.

Research Flowchart

  flowchart TD
  subgraph A ["1. Research Goal"]
      direction LR
      G["High-Dim Constrained<br>Portfolio Optimization"]
  end

  subgraph B ["2. Methodology"]
      direction LR
      M1["Neural Policy<br>π(s,t;θ)"] --> M2["Log-Barrier<br>Hamiltonian"]
      M2 --> M3["PMP & KKT<br>Optimization"]
  end

  subgraph C ["3. Inputs & Data"]
      direction LR
      I1["Asset Returns<br>& Dynamics"] --> I2["Constraints<br>Short-sale, Consumption"]
  end

  subgraph D ["4. Computational Process"]
      direction LR
      P1["Gradient Descent<br>on Barrier Hamiltonian"] --> P2["Converge to<br>KKT-Feasible Policy"]
  end

  subgraph E ["5. Key Outcomes"]
      direction LR
      O1["O(n) Scalability<br>vs PDE O(n^2)"] --> O2["Strict Feasibility<br>in High Dimensions"]
      O3["Stable PMP Convergence"]
  end

  A --> B
  C --> B
  B --> D
  D --> E

Cited References (107)

  1. Optimum consumption and portfolio rules in a continuous-time model (1971)
  2. Consumption and portfolio policies with incomplete markets and short-sale constraints: The infinite dimensional case (1991)
  3. A Monte Carlo method for optimal portfolios (2003)
  4. Decomposition of optimal dynamic portfolio choice with wealth-dependent utilities in incomplete markets (2020)
  5. Convex duality in constrained portfolio optimization (1992)
  6. Optimal retirement in a general market environment (2021)
  7. An intertemporal capital asset pricing model (1973)
  8. Strategic asset allocation (1997)
and 99 more
  1. Optimal consumption and portfolio policies when asset prices follow a diffusion process (1989)
  2. Conjugate convex functions in optimal stochastic control (1973)
  3. Growth and optimal intertemporal allocation of risks (1975)
  4. Methods of Mathematical Finance (1998)
  5. Stochastic Approximation and Recursive Algorithms and Applications (2003)
  6. Stochastic approximation: a dynamical systems viewpoint (2008)
  7. Stochastic Flows and Stochastic Differential Equations (1997)
  8. Foundations of Modern Probability (1997)
  9. Measure Theory, Vol. I and II (2007)
  10. Stochastic Stability of Differential Equations (2012)
  11. Deep learning algorithm to solve portfolio management with proportional transaction cost (2019)
  12. Stochastic differential equations (2003)
  13. Deep Learning Approximation for Stochastic Control Problems (2016) — link
  14. Deep stochastic optimization in finance (2023)
  15. Deep empirical risk minimization in finance: Looking into the future (2023)
  16. Pontryagin differentiable programming: An end-to-end learning and control framework (2020)
  17. Deep hedging (2019)
  18. User’s guide to viscosity solutions of second order partial differential equations (1992)
  19. Reflected solutions of backward SDE’s, and related obstacle problems for PDE’s (1997)
  20. Deep optimal stopping (2019)
  21. Continuous-time stochastic control and optimization with financial applications (2009)
  22. Solving high-dimensional partial differential equations using deep learning (2018)
  23. Machine learning approximation algorithms for high-dimensional fully nonlinear partial differential equations and second-order backward stochastic differential equations (2019)
  24. A regression-based Monte Carlo method to solve backward stochastic differential equations (2005)
  25. Controlled Markov processes and viscosity solutions (2006)
  26. Handbook on systemic risk (2013)
  27. Learning Merton’s Strategies in an Incomplete Market: Recursive Entropy Regularization and Biased Gaussian Exploration — → 2312.11797
  28. Partial differential equations (2022)
  29. Adapted solution of a backward stochastic differential equation (1990)
  30. Mathematical theory of optimal processes (2018)
  31. Backpropagation through time: what it does and how to do it (1990)
  32. A learning algorithm for continually running fully recurrent neural networks (1989)
  33. Gradient flows: in metric spaces and in the space of probability measures (2008)
  34. $\ $Euclidean, metric, and Wasserstein$\ $ gradient flows: an overview (2017)
  35. Numerical solution of stochastic differential equations with jumps in finance (2010)
  36. A stochastic approximation method (1951)
  37. Approximation by superpositions of a sigmoidal function (1989)
  38. Approximation capabilities of multilayer feedforward networks (1991)
  39. $\ $Euclidean, metric, and Wasserstein$\ $ gradient flows: an overview (2017)
  40. Nonlinear Systems (2002)
  41. Sur les op 'e rations dans les ensembles abstraits et leur application aux 'e quations int 'e grales (1922)
  42. Fixed point theory (2003)
  43. Forward-backward stochastic differential equations and their applications (1999)
  44. Stochastic controls: Hamiltonian systems and HJB equations (2012)
  45. A proposal on machine learning via dynamical systems (2017)
  46. DNN expression rate analysis of high-dimensional PDEs: application to option pricing (2022)
  47. Deep backward schemes for high-dimensional nonlinear PDEs (2020)
  48. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations (2019)
  49. Perspectives in flow control and optimization (2002)
  50. Optimization with PDE constraints (2008)
  51. A reduction of imitation learning and structured prediction to no-regret online learning (2011)
  52. Hindsight experience replay (2017)
  53. Multitask learning (1997)
  54. The loss surfaces of multilayer networks (2015)
  55. Deep learning (2016)
  56. Continuous-time Portfolio Optimization via Model-based Reinforcement Learning (2024)
  57. Solving consumption and portfolio choice problems: The state variable decomposition method (2010)
  58. Correlation risk and optimal portfolio choice (2010)
  59. A simulation approach to dynamic portfolio choice with an application to learning about return predictability (2005)
  60. Portfolio choice and equity characteristics: Characterizing the hedging demands induced by return predictability (2001)
  61. Predictability and transaction costs: The impact on rebalancing rules and behavior (2000)
  62. Transaction costs and predictability: Some utility cost calculations (1999)
  63. Optimal value and growth tilts in long-horizon portfolios (2011)
  64. Dynamic consumption and portfolio choice with stochastic volatility in incomplete markets (2005)
  65. A multivariate model of strategic asset allocation (2003)
  66. Who should buy long-term bonds? (2001)
  67. Consumption and portfolio decisions when expected returns are time varying (1999)
  68. Dynamic nonmyopic portfolio behavior (1996)
  69. A duality method for optimal consumption and investment under short-selling prohibition. I. General market coefficients (1992)
  70. Portfolio selection with consumption ratcheting (2018)
  71. A duality method for optimal consumption and investment under short-selling prohibition. II. Constant market coefficients (1992)
  72. Portfolio selection in stochastic environments (2007)
  73. Hedging contingent claims with constrained portfolios (1993)
  74. Lifetime portfolio selection under uncertainty: The continuous-time case (1969)
  75. Lifetime Portfolio Selection By Dynamic Stochastic Programming (1969)
  76. A Pontryagin-Guided Neural Policy Optimization Framework for Merton’s Portfolio Problem — → 2412.13101
  77. Minima of functions of several variables with inequalities as side constraints (1939)
  78. Nonlinear programming (2013)
  79. Numerical optimization (1999)
  80. Nonlinear programming: sequential unconstrained minimization techniques (1990)
  81. Convex optimization (2004)
  82. Optimal portfolio and consumption decisions for a “small investor” on a finite horizon (1987)
  83. Optimal investment and consumption with transaction costs (1994)
  84. Dusenberry’s ratcheting of consumption: optimal dynamic consumption and investment given intolerance for any decline in standard of living (1995)
  85. Breaking the Dimensional Barrier: A Pontryagin-Guided Direct Policy Optimization for Continuous-Time Multi-Asset Portfolio — → 2504.11116
  86. Habit formation: A resolution of the equity premium puzzle (1990)
  87. Intertemporally dependent preferences and the volatility of consumption and wealth (1989)
  88. The sensitivity of tests of the intertemporal allocation of consumption to near-rational alternatives (1988)
  89. Interior-point polynomial algorithms in convex programming (1994)
  90. Primal-dual interior-point methods (1997)
  91. On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming (2006)
  92. Nonlinear programming (1997)
  93. Numerical optimization (2006)
  94. Constrained portfolio-consumption strategies with uncertain parameters and borrowing costs (2019)
  95. Convergence of a robust deep FBSDE method for stochastic control (2023)
  96. Deep learning for constrained utility maximisation (2022)
  97. Physics-informed neural networks with hard nonlinear equality and inequality constraints (2025) — link
  98. Characterizing possible failure modes in physics-informed neural networks (2021)
  99. Deep-learning solution to portfolio selection with serially dependent returns (2020)

3 of 107 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.