Paper: arXiv 2505.10099

Authors: Sarat Moka, Matias Quiroz, Vali Asimit, Samuel Muller

Abstract

Portfolio optimization involves selecting asset weights to minimize a risk-reward objective, such as the portfolio variance in the classical minimum-variance framework. Sparse portfolio selection extends this by imposing a cardinality constraint: only $k$ assets from a universe of $p$ may be included. The standard approach models this problem as a mixed-integer quadratic program and relies on commercial solvers to find the optimal solution. However, the computational costs of such methods increase exponentially with $k$ and $p$, making them too slow for problems of even moderate size. We propose a fast and scalable gradient-based approach that transforms the combinatorial sparse selection problem into a constrained continuous optimization task via Boolean relaxation, while preserving equivalence with the original problem on the set of binary points. Our algorithm employs a tunable parameter that transmutes the auxiliary objective from a convex to a concave function. This allows a stable convex starting point, followed by a controlled path toward a sparse binary solution as the tuning parameter increases and the objective moves toward concavity. In practice, our method matches commercial solvers in asset selection for most instances and, in rare instances, the solution differs by a few assets whilst showing a negligible error in portfolio variance.

Complexity vs Empirical Score

  • Math Complexity: 8.5/10
  • Empirical Rigor: 3.0/10
  • Quadrant: Lab Rats — theoretically deep, empirically untested

Why this score: The paper employs advanced mathematical concepts like Boolean relaxation, convex-concave duality, and Frank-Wolfe algorithms, indicating high math complexity, but presents only theoretical guarantees and synthetic/real-world dataset experiments without code or detailed backtesting, placing it in the Lab Rats quadrant.

Research Flowchart

  flowchart TD
  A["Research Goal: Fast Sparse Minimum-Variance Portfolio Selection"] --> B["Methodology: Boolean Relaxation & Gradient Optimization"]
  B --> C["Input: p Assets, Data, Constraint k"]
  C --> D{"Algorithm"}
  D --> E["Phase 1: Tune Parameter λ<br/>Convex Objective"]
  E --> F["Phase 2: Increase λ<br/>Path to Concavity"]
  F --> G["Sparse Binary Solution<br/>(Portfolio Weights)"]
  G --> H["Outcome: Matches Commercial Solvers<br/>Scalable & Fast"]

Cited References (67)

  1. The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation (2020)
  2. Group COMBSS: Group Selection via Continuous Optimization (2024) — link
  3. A concave optimization-based approach for sparse portfolio selection (2012)
  4. Conditional gradient algorithmsfor rank-one matrix approximations with a sparsity constraint (2013)
  5. Cccp is F rank- W olfe in disguise (2022)
  6. Revisiting F rank- W olfe: P rojection-free sparse convex optimization (2013)
  7. An algorithm for quadratic programming (1956)
  8. Risk Budgeting under General Risk Measures (2024)
and 59 more
  1. Linear-Cost Vecchia Approximation of Multivariate Normal Probabilities (2023) — link
  2. COMBSS : best subset selection via continuous optimization (2024)
  3. Heuristics for cardinality constrained portfolio optimisation (2000)
  4. Analytical nonlinear shrinkage of large-dimensional covariance matrices (2020)
  5. On the Inverse of the Sum of Matrices (1981) — link
  6. Selection of the Best Subset in Regression Analysis (1967)
  7. The Discarding of Variables in Multivariate Analysis (1967)
  8. Fast Matrix Square Roots with Applications to Gaussian Processes and Bayesian Optimization (2020) — link
  9. Preconditioning Kernel Matrices (2016)
  10. Algebra (2011)
  11. Analysis of the symmetric Lanczos algorithm with reorthogonalization methods (1984) — link
  12. Extended Lanczos bidiagonalization algorithm for low rank approximation and its applications (2016) — link
  13. Best subset selection via a modern optimization lens (2016) — link
  14. Regression Shrinkage and Selection Via the Lasso (1996) — link
  15. bestsubset: Tools for best subset selection in regression (2018)
  16. Best subset, forward stepwise or lasso? Analysis and recommendations based on extensive comparisons (2020)
  17. Extended Comparisons of Best Subset Selection, Forward Stepwise Selection, and the Lasso (2017) — link
  18. Bounds for the probability generating functional of a G ibbs point process (2014) — link
  19. High-dimensional variable selection via low-dimensional adaptive learning (2021) — link
  20. Stochastic comparison of point random fields (1997)
  21. Spatial birth-and-death processes (1977)
  22. Fast approximation of the intensity of Gibbs point processes (2012) — link
  23. On the FKG -inequality for measures on a partially ordered space (1977) — link
  24. Introduction to the Theory of Gibbs Point Processes (2019) — link
  25. Adam: A Method for Stochastic Optimization (2015)
  26. leaps: Regression Subset Selection (2020)
  27. Convex optimization (2004)
  28. Statistical learning with sparsity (2015)
  29. Sparse and stable M arkowitz portfolios (2009)
  30. Iterative methods for sparse linear systems (2003)
  31. Introduction to Risk Parity and Budgeting (2013)
  32. Constructing optimal sparse portfolios using regularization methods (2015)
  33. A generalized approach to portfolio optimization: Improving performance by constraining portfolio norms (2009)
  34. Vast portfolio selection with gross-exposure constraints (2012)
  35. A First Course in Optimization Theory (1996)
  36. Matrix Analysis (2012)
  37. On nonnegative unbiased estimators (2015)
  38. Unbiased estimation of the reciprocal mean for non-negative random variables (2020)
  39. The correlated pseudomarginal method (2018)
  40. The block pseudo-marginal sampler (2016) — link
  41. A survey of M onte C arlo methods for parameter estimation (2020)
  42. Efficient implementation of M arkov chain M onte C arlo when using an unbiased likelihood estimator (2015)
  43. On some properties of M arkov chain M onte C arlo simulation methods based on the particle filter (2012)
  44. The pseudo-marginal approach for efficient Monte Carlo computations (2009)
  45. Vector Differential Calculus in Statistics (2002)
  46. Complex portfolio selection via convex mixed-integer quadratic programming: A survey (2019)
  47. Positive definite matrices (2009)
  48. IBM ILOG CPLEX O ptimization S tudio (2024) — link
  49. Gurobi Optimizer Reference Manual (2024) — link
  50. An Automatic Method of Solving Discrete Programming Problems (1960)
  51. Portfolio selection (1952)
  52. Minimum-variance portfolio composition (2011)
  53. Optimal cardinality constrained portfolio selection (2013)
  54. A scalable algorithm for sparse portfolio selection (2022)
  55. The arbitrage theory of capital asset pricing (1976)
  56. Risk budgeting under general risk measures (2025)
  57. Honey, I Shrunk the Sample Covariance Matrix (2004)
  58. A unified approach to mixed-integer optimization problems with logical constraints (2021)
  59. Cardinality minimization, constraints, and regularization: a survey (2024)

0 of 67 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.