Paper: arXiv 2504.05743
Abstract
Fundamental and necessary principles for achieving efficient portfolio optimization based on asset and diversification dynamics are presented. The Commonality Principle is a necessary and sufficient condition for identifying optimal drivers of a portfolio in terms of its diversification dynamics. The proof relies on the Reichenbach Common Cause Principle, along with the fact that the sensitivities of portfolio constituents with respect to the common causal drivers are themselves causal. A conformal map preserves idiosyncratic diversification from the unconditional setting while optimizing systematic diversification on an embedded space of these sensitivities. Causal methodologies for combinatorial driver selection are presented, such as the use of Bayesian networks and correlation-based algorithms from Reichenbach’s principle. Limitations of linear models in capturing causality are discussed, and included for completeness alongside more advanced models such as neural networks. Portfolio optimization methods are presented that map risk from the sensitivity space to other risk measures of interest. Finally, the work introduces a novel risk management framework based on Common Causal Manifolds, including both theoretical development and experimental validation. The sensitivity space is predicted along the common causal manifold, which is modeled as a causal time system. Sensitivities are forecasted using SDEs calibrated to data previously extracted from neural networks to move along the manifold via its tangent bundles. An optimization method is then proposed that accumulates information across future predicted tangent bundles on the common causal time system manifold. It aggregates sensitivity-based distance metrics along the trajectory to build a comprehensive sensitivity distance matrix. This matrix enables trajectory-wide optimal diversification, taking into account future dynamics.
Complexity vs Empirical Score
- Math Complexity: 8.5/10
- Empirical Rigor: 3.0/10
- Quadrant: Lab Rats — theoretically deep, empirically untested
Why this score: The paper heavily relies on advanced mathematical concepts like manifolds, SDEs, and causal geometry, indicating high math complexity. While it mentions experimental validation, the excerpt focuses on theoretical frameworks, proofs, and algorithms without providing specific backtest results, datasets, or code, placing it closer to theoretical ‘Lab Rats’ than empirical ‘Holy Grail’.
Research Flowchart
flowchart TD Goal["Research Goal<br>Efficient Portfolio Optimization<br>via Causal Dynamics"] Input["Input Data<br>Asset Returns & Sensitivities"] Method["Key Methodology<br>Commonality Principle &<br>Bayesian Networks"] Process["Computational Process<br>Embedding Sensitivity Space<br>via Conformal Map"] Forecast["Forecasting<br>SDEs on Common Causal<br>Manifold (Tangent Bundles)"] Optimize["Optimization<br>Trajectory-wide Diversification<br>via Distance Matrix"] Outcome["Key Outcomes<br>Common Causal Manifolds &<br>Risk Management Framework"] Goal --> Input Input --> Method Method --> Process Process --> Forecast Forecast --> Optimize Optimize --> Outcome
Cited References (141)
- Portfolio Selection (1952)
- Liquidity Preference as Behavior Towards Risk (1958) — link
- CAPITAL ASSET PRICES: A THEORY OF MARKET EQUILIBRIUM UNDER CONDITIONS OF RISK (1964)
- The Valuation of Risk Assets and the Selection of Risky Investments in Stock Portfolios and Capital Budgets (1965)
- Learning Bayesian networks from correlated data (2008)
- An equilibrium characterization of the term structure (1977) — link
- The arbitrage theory of capital asset pricing (1976) — link
- The Determination of Financial Structure: The Incentive-Signalling Approach (1977) — link
and 133 more
- SECURITY PRICES, RISK, AND MAXIMAL GAINS FROM DIVERSIFICATION (1965) — link
- Asset Allocation (1991) — link
- Efficient Capital Markets: A Review of Theory and Empirical Work (1970) — link
- A critique of the asset pricing theory’s tests Part I: On past and potential testability of the theory (1977) — link
- Theory of Rational Option Pricing (1973)
- Option traders use (very) sophisticated heuristics, never the Black–Scholes–Merton formula (2011) — link
- Clustering Financial Time Series: How Long is Enough? (2016) — link
- Building Diversified Portfolios that Outperform Out-of-Sample (2016)
- Hierarchical PCA and Modeling Asset Correlations (2020) — link
- Estimation of Markov regime-switching regression models with endogenous switching (2008) — link
- Dynamic portfolio optimization across hidden market regimes (2018) — link
- Portfolio optimization based on network topology (2019) — link
- Fund2Vec: Mutual Funds Similarity using Graph Learning (2021) — link
- Random matrix theory for portfolio optimization: a stability approach (2004)
- Random matrix theory and financial correlations (1999) — link
- Random matrix approach to cross correlations in financial data (2002) — link
- Exponential Weighting and Random-Matrix-Theory-Based Filtering of Financial Covariance Matrices for Portfolio Optimization (2004) — link
- Global Portfolio Optimization (1992) — link
- Using the Black-Litterman Global Asset Allocation Model: Three (1998)
- A demystification of the Black–Litterman model: Managing quantitative and traditional portfolio construction (2000) — link
- Black-Litterman + 1: Generalizing to the Two Factor Case (2005)
- Coherent Asset Allocation and Diversification in the Presence of Stress Events (2011) — link
- Differential Machine Learning (2020) — link
- An artificial neural network approach to spatial habitat modelling with interspecific interaction (1999)
- A Comparison of Neural Network and Expert Systems Algorithms with Common Multivariate Procedures for Analysis of Social Science Data (1991) — link
- An accurate comparison of methods for quantifying variable importance in artificial neural networks using simulated data (2004) — link
- Developing an empirical model of phytoplankton primary production: a neural network case study (1999)
- NeuralSens: Sensitivity Analysis of Neural Networks (2021) — link
- Approximation by superpositions of a sigmoidal function (1989)
- Aplicación de técnicas de redes neuronales artificiales al diagnostico de procesos industriales (1996)
- The Direction of Time (1956)
- The False Strategy Theorem: A Financial Application of Experimental Mathematics (2021) — link
- The Generalized Dynamic Factor Model: Representation Theory (2001)
- CAUSALITY: MODELS, REASONING, AND INFERENCE, by Judea Pearl, Cambridge University Press, 2000 (2003)
- Measures on the closed subspaces of a Hilbert space (1975)
- Investment science : David G. Luenberger, ISBN 0-19-510809-4 New York, 1998, price in US: US 70 (1998)
- The topology of ridge systems. (1979)
- An Unsupervised Learning Framework for Marketneutral Portfolio (2022) — link
- Minimax and Biobjective Portfolio Selection Based on Collaborative Neurodynamic Optimization (2021) — link
- Decentralized Robust Portfolio Optimization Based on Cooperative-Competitive Multiagent Systems (2021) — link
- Computing a nearest symmetric positive semidefinite matrix (1988) — link
- Combined Clustering and Multi-Criteria Approach for Portfolio Selection (2019)
- Hierarchical risk parity: portfolio optimization[Unpublished bachelor’s thesis] (2021) — link
- Pricing Interest-Rate-Derivative Securities (1990) — link
- The Self-Organized Criticality Paradigm in Economics & Finance (2024) — link
- Self-fulfilling prophecies, quasi nonergodicity, and wealth inequality (2023) — link
- The inelastic market hypothesis: a microstructural interpretation (2022) — link
- In Search of the Origins of Financial Fluctuations: The Inelastic Markets Hypothesis (2020) — link
- When Can Statistical Theories Be Causally Closed? (2004)
- On Reichenbach’s common cause principle (1999)
- Marketron games: Self-propelling stocks vs dumb money and metastable dynamics of the good, bad, and ugly markets (2025) — link
- The Cross-Section of Expected Stock Returns (1992)
- Quantitative Portfolio Optimization: Advanced Techniques and Applications (2025)
- Towards automating causal discovery in financial markets and beyond (2023)
- Causal discovery in financial markets: A framework for nonstationary time-series data (2024) — link
- Capital asset prices: A theory of market equilibrium under conditions of risk (1964)
- The valuation of risk assets and the selection of risky investments in stock portfolios and capital budgets (1965) — link
- The arbitrage theory of capital asset pricing (1976) — link
- The determination of financial structure: The incentive-signalling approach (1977) — link
- The Direction of Time (1956)
- Reichenbachian Common Cause Systems (2004)
- Schur Complementary Allocation: A Unification of Hierarchical Risk Parity and Minimum Variance Portfolios (2024) — link
- The Hierarchical Equal Risk Contribution Portfolio (2018) — link
- Convex Optimization (2004)
- Numerical Optimization (2006)
- Deep Learning (2016)
- Deep learning for financial applications: A survey (2020)
- Conditional value-at-risk for general loss distributions (2002) — link
- Style Investing and Institutional Investors (2008)
- Market Microstructure: Confronting Many Viewpoints (2012)
- Trading and Exchanges: Market Microstructure for Practitioners (2003)
- The Microstructure of the ‘Flash Crash’: Flow Toxicity, Liquidity Crashes, and the Probability of Informed Trading (2011) — link
- Blockchain and Distributed Ledgers: Mathematics, Technology, and Economics (2021)
- Largest Quant Firms List (Ranked) (2025) — link
- Technical Analysis and Chart Interpretations: A Comprehensive Guide to Understanding Established Trading Tactics for Ultimate Profit (2016) — link
- Trades, Quotes and Prices: Financial Markets Under the Microscope (2018) — link
- Efficient capital markets: A review of theory and empirical work (1970)
- From efficient markets theory to behavioral finance (2003)
- The efficient market hypothesis and its critics (2003)
- Thinking, Fast and Slow (2011)
- Causal Factor Investing: Can Factor Investing Become Scientific? (2023)
- Space and Time (1923)
- The Foundation of the General Theory of Relativity (1916)
- A Distributional Approach to Time-Varying Sensitivity (1967) — link
- The Direction of Time (1956)
- Causality: Models, Reasoning and Inference (2009)
- Reichenbach’s common cause principle: Formal and philosophical aspects (2004)
- Portfolio optimization based on neural networks sensitivities from assets dynamics respect common drivers (2023) — link
- Artificial Intelligence in Finance (Aifi) Bootcamp February 2024 - Workshop Presentation - Portfolio optimization based on neural networks sensitivities from assets dynamics respect common drivers & A Portfolio’s Common Causal Conditional Risk-neutral PDE (2024) — link
- Causal Network Representations in Factor Investing (2025) — link
- Machine Learning for Factor Investing: Python Version (2020)
- Optimal projection filters with information geometry (2024) — link
- Common Causal Sensitivity Based Portfolio Optimization AIFI Winter Bootcamp 2025 (2025) — link
- A Review of Two Decades of Correlations, Hierarchies, Networks and Clustering in Financial Markets (2021) — link
- The Case for Causal Factor Investing (2024) — link
- Mathematical systems theory: Causality (1967) — link
- Risk, Return, and Equilibrium: Empirical Tests (1973)
- Do Stock Prices Move Too Much to be Justified by Subsequent Changes in Dividends? (1981)
- An Intertemporal Capital Asset Pricing Model (1973)
- Portfolio Selection (1952)
- Portfolio Selection: Efficient Diversification of Investments (1959)
- Elements (1956)
- Geometry: Euclid and Beyond (2000)
- Continuous-Time Finance (1992)
- RiskMetrics: Technical Document (1996)
- Projections of SDEs onto Submanifolds (2022) — link
- Integrating prediction in mean-variance portfolio optimization (2023)
- An overview on deep learning-based approximation methods for partial differential equations (2023) — link
- Man vs. Machine Learning: The Term Structure of Earnings Expectations and Conditional Biases (2020)
- Meilleures approximations et médianes conditionnelles (1985) — link
- The Importance of the Loss Function in Option Valuation (2004)
- Large Time-Varying Correlation Matrices with Applications to Finance (2004)
- Applications of Reinforcement Learning (2020) — link
- Stochastic Portfolio Theory (2002) — link
- The Geometry of Causality (2023) — link
- Higher-order moments in portfolio selection problems: A comprehensive literature review (2024) — link
- Forecasting portfolio variance: a new decomposition approach (2023) — link
- Modern Perspectives on Reinforcement Learning in Finance (2019)
- Stochastic PDE Projection on Manifolds: Assumed-Density and Galerkin Filters (2015)
- Shortcomings of Mean‐Variance Analysis (2015) — link
- Overfitting in portfolio optimization (2023)
- A Portfolio’s Common Causal Conditional Risk-neutral PDE (2024) — link
- Stochastic Partial Differential Equations and Portfolio Choice (2010) — link
- Risk-sensitive benchmarked asset management with expert forecasts (2021) — link
- A Distributional Approach to Time-Varying Sensitivity (1967)
- Machine Learning Advances for Time Series Forecasting (2023)
- Estimated Correlation Matrices and Portfolio Optimization (2004) — link
- Estimating and Forecasting Dynamic Correlation Matrices: A Nonlinear Common Factor Approach (2021) — link
- Risk-Sensitive Portfolio Optimization with Full and Partial Information (2004)
- Sensitivity Analysis of Minimum Variance Portfolios (2013) — link
- The Hierarchical Approach to Portfolio Management (2003) — link
- Properties of the BFGS method on Riemannian manifolds (2012)
- Probability Theory: A Comprehensive Course (2007) — link
0 of 141 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.