Paper: arXiv 2404.13371

Abstract

This paper studies a risk-sensitive decision-making problem under uncertainty. It considers a decision-making process that unfolds over a fixed number of stages, in which a decision-maker chooses among multiple alternatives, some of which are deterministic and others are stochastic. The decision-maker’s cumulative value is updated at each stage, reflecting the outcomes of the chosen alternatives. After formulating this as a stochastic control problem, we delineate the necessary optimality conditions for it. Two illustrative examples from optimal betting and inventory management are provided to support our theory.

Complexity vs Empirical Score

  • Math Complexity: 8.0/10
  • Empirical Rigor: 3.0/10
  • Quadrant: Lab Rats — theoretically deep, empirically untested

Why this score: The paper is mathematically dense, featuring stochastic control formulations, KKT conditions, and non-convex optimization, but it lacks empirical testing, backtests, or implementation-heavy details, offering only theoretical illustrations.

Research Flowchart

  flowchart TD
  A["Research Goal:<br>Risk-Sensitive Decision Making Under Uncertainty"] --> B["Formulate Stochastic Control Problem"]
  B --> C{"Key Methodology:<br>Dynamic Programming & Bellman Equation"}
  C --> D["Data/Inputs:<br>Deterministic & Stochastic Alternatives"]
  D --> E["Computational Process:<br>Necessary Optimality Conditions"]
  E --> F["Outcomes:<br>General Theory & Optimal Policies"]
  F --> G["Validation:<br>Examples in Inventory Management & Optimal Betting"]

Cited References (102)

  1. On Frequency-Based Optimal Portfolio with Transaction Costs — → 2301.02754
  2. Probability and Random Processes for Electrical and Computer Engineers (2006)
  3. Variance-Based Regularization with Convex Objectives (2019)
  4. Theory of Games and Economic Behavior (2007)
  5. A Preference Foundation for Log Mean-Variance Criteria in Portfolio Choice Problems (1993)
  6. Lectures on Stochastic Programming: Modeling and Theory (2021)
  7. Dynamic Programming and Optimal Control: Volume I (2012)
  8. On Asymptotic Log-Optimal Portfolio Optimization (2023)
and 94 more
  1. Portfolio Optimization with Drawdown Constraints (2004)
  2. On Kelly Betting: Some Limitations (2015)
  3. Continuous-Time Finance (1992)
  4. Game-Theoretic Optimal Portfolios (1988)
  5. A Generalization of the Classical Kelly Betting Formula to the Case of Temporal Correlation (2021)
  6. Universal Portfolios (1991)
  7. CVX: Matlab Software for Disciplined Convex Programming, version 2.1 (2014)
  8. On Risk Reduction in Kelly Betting Using the Conservative Expected Value (2018)
  9. Robust Growth-Optimal Portfolios (2016)
  10. Elements of Information Theory (2006)
  11. Necessary and Sufficient Conditions for Frequency-Based Kelly Optimal Portfolio (2021)
  12. Convex Optimization (2004)
  13. Portfolio Choice and the Kelly Criterion (1975)
  14. Analysis of Kelly Betting on Finite Repeated Games (2020)
  15. Optimal Investment Strategy for Risky Assets (1998)
  16. On Optimal Myopic Portfolio Policies, With and Without Serial Correlation of Yields (1971)
  17. The Impact of Corporate Sustainability on Organizational Processes and Performance (2014)
  18. Value at Risk: the New Benchmark for Managing Financial Risk (2007)
  19. At What Frequency Should the Kelly Bettor Bet? (2018)
  20. Rebalancing Frequency Considerations for Kelly-Optimal Stock Portfolios in a Control-Theoretic Framework (2018)
  21. Prospect Theory: An Analysis of Decision under Risk (1979)
  22. On the Benefit of Nonlinear Control for Robust Logarithmic Growth: Coin Flipping Games as a Demonstration Case (2023)
  23. Necessary and Sufficient Conditions for Frequency-Based Kelly Optimal Portfolio (2020)
  24. A Generalization of the Classical Kelly Betting Formula to the Case of Temporal Correlation (2020)
  25. The Impact of Execution Delay on Kelly-Based Stock Trading: High-frequency Versus Buy and Hold (2019)
  26. The Growth of Relative Wealth and The Kelly Criterion (2018)
  27. Long-Term Capital Growth: the Good and Bad Properties of the Kelly and Fractional Kelly Capital Growth Criteria (2010)
  28. Computing Optimal Rebalance Frequency for Log-Optimal Portfolios in Linear Time (2015)
  29. Computing Optimal Rebalance Frequency for Log-Optimal Portfolios (2014)
  30. The Kelly Criterion and the Stock Market (1992)
  31. Analysis of the Rebalancing Frequency in Log-Optimal Portfolio Selection (2010)
  32. Portfolio Optimization Applications of Stochastic Receding Horizon Control (2007)
  33. Stock Trading: An Optimal Selling Rule (2001)
  34. Kelly Criterion for Multivariate Portfolios: A Model-Free Approach (2014)
  35. Optimum Consumption and Portfolio Rules in a Continuous-Time Model (1971)
  36. Market Efficiency, Long-Term Returns, and Behavioral Finance (2021)
  37. On Feedback Control in Kelly Betting: An Approximation Approach (2020)
  38. Partial Kelly Portfolios and Shrinkage Estimators (2012)
  39. Statistical Properties of Estimators for the Log-Optimal Portfolio (2020)
  40. Stochastic Programming: Minimax Approach (2009)
  41. Distributionally Robust Optimization under Moment Uncertainty with Application to Data-Driven Problems (2010)
  42. Kelly Criterion: From a Simple Random Walk to L 'e vy Processes (2021)
  43. A Novel Approach of Option Portfolio Construction Using the Kelly Criterion (2018)
  44. On Positive Solutions of a Delay Equation Arising When Trading in Financial Markets (2020)
  45. On a New Paradigm for Stock Trading via a Model-Free Feedback Controller (2015)
  46. The Kelly Criterion in Blackjack Sports Betting, and The Stock Market (2006)
  47. Asymptotic Optimality and Asymptotic Equipartition Properties of Log-Optimum Investment (1988)
  48. Probability: Theory and Examples (2019)
  49. Principles of mathematical analysis (1976)
  50. Contributions to the Theory of Kelly Betting with Applications to Stock Trading: A Control-Theoretic Approach (2019)
  51. Calculus: Early Transcendentals (2020)
  52. An Algorithm for Maximizing Expected Log Investment Return (1984)
  53. Optimal Growth in Two-Sided Markets (2021)
  54. On Inefficiency of Markowitz-Style Investment Strategies When Drawdown Is Important (2017)
  55. Growth Versus Security in Dynamic Investment Analysis (1992)
  56. Growth-Security Investment Strategy for Long and Short Runs (1993)
  57. Good and Bad Properties of the Kelly Criterion (2010)
  58. Investments (2018)
  59. Optimal Investment Strategies for Controlling Drawdowns (1993)
  60. On Portfolio Optimization Under ``Drawdown" Constraints (1994)
  61. Drawdown Measure in Portfolio Optimization (2005)
  62. How Useful Are Mean-Variance Considerations in Stock Trading via Feedback Control? (2012)
  63. Mean-Variance versus Direct Utility Maximization (1984)
  64. A Mean/Variance Analysis of Tracking Error (1992)
  65. Kelly-Based Options Trading Strategies on Settlement Date via Supervised Learning Algorithms (2022)
  66. Equilibrium in a Capital Asset Market (1966)
  67. Optimal Gambling Systems for Favorable Games (1961)
  68. Criteria for choice among risky ventures (1959)
  69. The Valuation of Risk Assets and the Selection of Risky Investments in Stock Portfolios and Capital Budgets (1975)
  70. Distributional Robust Kelly Gambling (2018) — link
  71. The Statistics of Sharpe Ratios (2002)
  72. Dynamic Trading with Predictable Returns and Transaction Costs (2013)
  73. CVXPY: A Python-Embedded Modeling Language for Convex Optimization (2016)
  74. Robust stochastic approximation approach to stochastic programming (2009)
  75. Optimal Execution of Portfolio Transactions (2001)
  76. Multi-Period Trading via Convex Optimization (2017) — link
  77. A Drawdown Formula for Stock Trading via Linear Feedback in a Market Governed by Brownian Motion (2013)
  78. The Kelly Capital Growth Investment Criterion: Theory and Practice (2011)
  79. Risk Reduction in Large Portfolios: Why Imposing the Wrong Constraints Helps (2003)
  80. A Simplified Model for Portfolio Analysis (1963)
  81. A Generalized Approach to Portfolio Optimization: Improving Performance by Constraining Portfolio Norms (2009)
  82. The Elimination Form of the Inverse and Its Application to Linear Programming (1957)
  83. Robust Portfolio Optimization and Management (2007)
  84. Optimization Methods in Finance (2006)
  85. Investment Science (2013)
  86. Markowitz Revisited: Mean-Variance Models in Financial Portfolio Analysis (2001)
  87. A New Interpretation of Information Rate (1956)
  88. Kelly Betting Can Be Too Conservative (2016)
  89. On Drawdown-Modulated Feedback Control in Stock Trading (2017)
  90. Portfolio Selection (1952)
  91. Geometric Mean Maximization: An Overlooked Portfolio Approach? (2010)
  92. Portfolio Selection: Efficient Diversification of Investments (1959)
  93. On the Maximum Drawdown of a Brownian Motion (2004)
  94. Maximum Drawdowns of Hedge Funds with Serial Correlation (2006)

1 of 102 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.