Paper: arXiv 2504.05743

Abstract

Fundamental and necessary principles for achieving efficient portfolio optimization based on asset and diversification dynamics are presented. The Commonality Principle is a necessary and sufficient condition for identifying optimal drivers of a portfolio in terms of its diversification dynamics. The proof relies on the Reichenbach Common Cause Principle, along with the fact that the sensitivities of portfolio constituents with respect to the common causal drivers are themselves causal. A conformal map preserves idiosyncratic diversification from the unconditional setting while optimizing systematic diversification on an embedded space of these sensitivities. Causal methodologies for combinatorial driver selection are presented, such as the use of Bayesian networks and correlation-based algorithms from Reichenbach’s principle. Limitations of linear models in capturing causality are discussed, and included for completeness alongside more advanced models such as neural networks. Portfolio optimization methods are presented that map risk from the sensitivity space to other risk measures of interest. Finally, the work introduces a novel risk management framework based on Common Causal Manifolds, including both theoretical development and experimental validation. The sensitivity space is predicted along the common causal manifold, which is modeled as a causal time system. Sensitivities are forecasted using SDEs calibrated to data previously extracted from neural networks to move along the manifold via its tangent bundles. An optimization method is then proposed that accumulates information across future predicted tangent bundles on the common causal time system manifold. It aggregates sensitivity-based distance metrics along the trajectory to build a comprehensive sensitivity distance matrix. This matrix enables trajectory-wide optimal diversification, taking into account future dynamics.

Complexity vs Empirical Score

  • Math Complexity: 8.5/10
  • Empirical Rigor: 3.0/10
  • Quadrant: Lab Rats — theoretically deep, empirically untested

Why this score: The paper heavily relies on advanced mathematical concepts like manifolds, SDEs, and causal geometry, indicating high math complexity. While it mentions experimental validation, the excerpt focuses on theoretical frameworks, proofs, and algorithms without providing specific backtest results, datasets, or code, placing it closer to theoretical ‘Lab Rats’ than empirical ‘Holy Grail’.

Research Flowchart

  flowchart TD
  Goal["Research Goal<br>Efficient Portfolio Optimization<br>via Causal Dynamics"]
  
  Input["Input Data<br>Asset Returns & Sensitivities"]
  
  Method["Key Methodology<br>Commonality Principle &<br>Bayesian Networks"]
  
  Process["Computational Process<br>Embedding Sensitivity Space<br>via Conformal Map"]
  
  Forecast["Forecasting<br>SDEs on Common Causal<br>Manifold (Tangent Bundles)"]
  
  Optimize["Optimization<br>Trajectory-wide Diversification<br>via Distance Matrix"]
  
  Outcome["Key Outcomes<br>Common Causal Manifolds &<br>Risk Management Framework"]

  Goal --> Input
  Input --> Method
  Method --> Process
  Process --> Forecast
  Forecast --> Optimize
  Optimize --> Outcome

Cited References (141)

  1. Portfolio Selection (1952)
  2. Liquidity Preference as Behavior Towards Risk (1958) — link
  3. CAPITAL ASSET PRICES: A THEORY OF MARKET EQUILIBRIUM UNDER CONDITIONS OF RISK (1964)
  4. The Valuation of Risk Assets and the Selection of Risky Investments in Stock Portfolios and Capital Budgets (1965)
  5. Learning Bayesian networks from correlated data (2008)
  6. An equilibrium characterization of the term structure (1977) — link
  7. The arbitrage theory of capital asset pricing (1976) — link
  8. The Determination of Financial Structure: The Incentive-Signalling Approach (1977) — link
and 133 more
  1. SECURITY PRICES, RISK, AND MAXIMAL GAINS FROM DIVERSIFICATION (1965) — link
  2. Asset Allocation (1991) — link
  3. Efficient Capital Markets: A Review of Theory and Empirical Work (1970) — link
  4. A critique of the asset pricing theory’s tests Part I: On past and potential testability of the theory (1977) — link
  5. Theory of Rational Option Pricing (1973)
  6. Option traders use (very) sophisticated heuristics, never the Black–Scholes–Merton formula (2011) — link
  7. Clustering Financial Time Series: How Long is Enough? (2016) — link
  8. Building Diversified Portfolios that Outperform Out-of-Sample (2016)
  9. Hierarchical PCA and Modeling Asset Correlations (2020) — link
  10. Estimation of Markov regime-switching regression models with endogenous switching (2008) — link
  11. Dynamic portfolio optimization across hidden market regimes (2018) — link
  12. Portfolio optimization based on network topology (2019) — link
  13. Fund2Vec: Mutual Funds Similarity using Graph Learning (2021) — link
  14. Random matrix theory for portfolio optimization: a stability approach (2004)
  15. Random matrix theory and financial correlations (1999) — link
  16. Random matrix approach to cross correlations in financial data (2002) — link
  17. Exponential Weighting and Random-Matrix-Theory-Based Filtering of Financial Covariance Matrices for Portfolio Optimization (2004) — link
  18. Global Portfolio Optimization (1992) — link
  19. Using the Black-Litterman Global Asset Allocation Model: Three (1998)
  20. A demystification of the Black–Litterman model: Managing quantitative and traditional portfolio construction (2000) — link
  21. Black-Litterman + 1: Generalizing to the Two Factor Case (2005)
  22. Coherent Asset Allocation and Diversification in the Presence of Stress Events (2011) — link
  23. Differential Machine Learning (2020) — link
  24. An artificial neural network approach to spatial habitat modelling with interspecific interaction (1999)
  25. A Comparison of Neural Network and Expert Systems Algorithms with Common Multivariate Procedures for Analysis of Social Science Data (1991) — link
  26. An accurate comparison of methods for quantifying variable importance in artificial neural networks using simulated data (2004) — link
  27. Developing an empirical model of phytoplankton primary production: a neural network case study (1999)
  28. NeuralSens: Sensitivity Analysis of Neural Networks (2021) — link
  29. Approximation by superpositions of a sigmoidal function (1989)
  30. Aplicación de técnicas de redes neuronales artificiales al diagnostico de procesos industriales (1996)
  31. The Direction of Time (1956)
  32. The False Strategy Theorem: A Financial Application of Experimental Mathematics (2021) — link
  33. The Generalized Dynamic Factor Model: Representation Theory (2001)
  34. CAUSALITY: MODELS, REASONING, AND INFERENCE, by Judea Pearl, Cambridge University Press, 2000 (2003)
  35. Measures on the closed subspaces of a Hilbert space (1975)
  36. Investment science : David G. Luenberger, ISBN 0-19-510809-4 New York, 1998, price in US: US 70 (1998)
  37. The topology of ridge systems. (1979)
  38. An Unsupervised Learning Framework for Marketneutral Portfolio (2022) — link
  39. Minimax and Biobjective Portfolio Selection Based on Collaborative Neurodynamic Optimization (2021) — link
  40. Decentralized Robust Portfolio Optimization Based on Cooperative-Competitive Multiagent Systems (2021) — link
  41. Computing a nearest symmetric positive semidefinite matrix (1988) — link
  42. Combined Clustering and Multi-Criteria Approach for Portfolio Selection (2019)
  43. Hierarchical risk parity: portfolio optimization[Unpublished bachelor’s thesis] (2021) — link
  44. Pricing Interest-Rate-Derivative Securities (1990) — link
  45. The Self-Organized Criticality Paradigm in Economics & Finance (2024) — link
  46. Self-fulfilling prophecies, quasi nonergodicity, and wealth inequality (2023) — link
  47. The inelastic market hypothesis: a microstructural interpretation (2022) — link
  48. In Search of the Origins of Financial Fluctuations: The Inelastic Markets Hypothesis (2020) — link
  49. When Can Statistical Theories Be Causally Closed? (2004)
  50. On Reichenbach’s common cause principle (1999)
  51. Marketron games: Self-propelling stocks vs dumb money and metastable dynamics of the good, bad, and ugly markets (2025) — link
  52. The Cross-Section of Expected Stock Returns (1992)
  53. Quantitative Portfolio Optimization: Advanced Techniques and Applications (2025)
  54. Towards automating causal discovery in financial markets and beyond (2023)
  55. Causal discovery in financial markets: A framework for nonstationary time-series data (2024) — link
  56. Capital asset prices: A theory of market equilibrium under conditions of risk (1964)
  57. The valuation of risk assets and the selection of risky investments in stock portfolios and capital budgets (1965) — link
  58. The arbitrage theory of capital asset pricing (1976) — link
  59. The determination of financial structure: The incentive-signalling approach (1977) — link
  60. The Direction of Time (1956)
  61. Reichenbachian Common Cause Systems (2004)
  62. Schur Complementary Allocation: A Unification of Hierarchical Risk Parity and Minimum Variance Portfolios (2024) — link
  63. The Hierarchical Equal Risk Contribution Portfolio (2018) — link
  64. Convex Optimization (2004)
  65. Numerical Optimization (2006)
  66. Deep Learning (2016)
  67. Deep learning for financial applications: A survey (2020)
  68. Conditional value-at-risk for general loss distributions (2002) — link
  69. Style Investing and Institutional Investors (2008)
  70. Market Microstructure: Confronting Many Viewpoints (2012)
  71. Trading and Exchanges: Market Microstructure for Practitioners (2003)
  72. The Microstructure of the ‘Flash Crash’: Flow Toxicity, Liquidity Crashes, and the Probability of Informed Trading (2011) — link
  73. Blockchain and Distributed Ledgers: Mathematics, Technology, and Economics (2021)
  74. Largest Quant Firms List (Ranked) (2025) — link
  75. Technical Analysis and Chart Interpretations: A Comprehensive Guide to Understanding Established Trading Tactics for Ultimate Profit (2016) — link
  76. Trades, Quotes and Prices: Financial Markets Under the Microscope (2018) — link
  77. Efficient capital markets: A review of theory and empirical work (1970)
  78. From efficient markets theory to behavioral finance (2003)
  79. The efficient market hypothesis and its critics (2003)
  80. Thinking, Fast and Slow (2011)
  81. Causal Factor Investing: Can Factor Investing Become Scientific? (2023)
  82. Space and Time (1923)
  83. The Foundation of the General Theory of Relativity (1916)
  84. A Distributional Approach to Time-Varying Sensitivity (1967) — link
  85. The Direction of Time (1956)
  86. Causality: Models, Reasoning and Inference (2009)
  87. Reichenbach’s common cause principle: Formal and philosophical aspects (2004)
  88. Portfolio optimization based on neural networks sensitivities from assets dynamics respect common drivers (2023) — link
  89. Artificial Intelligence in Finance (Aifi) Bootcamp February 2024 - Workshop Presentation - Portfolio optimization based on neural networks sensitivities from assets dynamics respect common drivers & A Portfolio’s Common Causal Conditional Risk-neutral PDE (2024) — link
  90. Causal Network Representations in Factor Investing (2025) — link
  91. Machine Learning for Factor Investing: Python Version (2020)
  92. Optimal projection filters with information geometry (2024) — link
  93. Common Causal Sensitivity Based Portfolio Optimization AIFI Winter Bootcamp 2025 (2025) — link
  94. A Review of Two Decades of Correlations, Hierarchies, Networks and Clustering in Financial Markets (2021) — link
  95. The Case for Causal Factor Investing (2024) — link
  96. Mathematical systems theory: Causality (1967) — link
  97. Risk, Return, and Equilibrium: Empirical Tests (1973)
  98. Do Stock Prices Move Too Much to be Justified by Subsequent Changes in Dividends? (1981)
  99. An Intertemporal Capital Asset Pricing Model (1973)
  100. Portfolio Selection (1952)
  101. Portfolio Selection: Efficient Diversification of Investments (1959)
  102. Elements (1956)
  103. Geometry: Euclid and Beyond (2000)
  104. Continuous-Time Finance (1992)
  105. RiskMetrics: Technical Document (1996)
  106. Projections of SDEs onto Submanifolds (2022) — link
  107. Integrating prediction in mean-variance portfolio optimization (2023)
  108. An overview on deep learning-based approximation methods for partial differential equations (2023) — link
  109. Man vs. Machine Learning: The Term Structure of Earnings Expectations and Conditional Biases (2020)
  110. Meilleures approximations et médianes conditionnelles (1985) — link
  111. The Importance of the Loss Function in Option Valuation (2004)
  112. Large Time-Varying Correlation Matrices with Applications to Finance (2004)
  113. Applications of Reinforcement Learning (2020) — link
  114. Stochastic Portfolio Theory (2002) — link
  115. The Geometry of Causality (2023) — link
  116. Higher-order moments in portfolio selection problems: A comprehensive literature review (2024) — link
  117. Forecasting portfolio variance: a new decomposition approach (2023) — link
  118. Modern Perspectives on Reinforcement Learning in Finance (2019)
  119. Stochastic PDE Projection on Manifolds: Assumed-Density and Galerkin Filters (2015)
  120. Shortcomings of Mean‐Variance Analysis (2015) — link
  121. Overfitting in portfolio optimization (2023)
  122. A Portfolio’s Common Causal Conditional Risk-neutral PDE (2024) — link
  123. Stochastic Partial Differential Equations and Portfolio Choice (2010) — link
  124. Risk-sensitive benchmarked asset management with expert forecasts (2021) — link
  125. A Distributional Approach to Time-Varying Sensitivity (1967)
  126. Machine Learning Advances for Time Series Forecasting (2023)
  127. Estimated Correlation Matrices and Portfolio Optimization (2004) — link
  128. Estimating and Forecasting Dynamic Correlation Matrices: A Nonlinear Common Factor Approach (2021) — link
  129. Risk-Sensitive Portfolio Optimization with Full and Partial Information (2004)
  130. Sensitivity Analysis of Minimum Variance Portfolios (2013) — link
  131. The Hierarchical Approach to Portfolio Management (2003) — link
  132. Properties of the BFGS method on Riemannian manifolds (2012)
  133. Probability Theory: A Comprehensive Course (2007) — link

0 of 141 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.