Paper: arXiv 2510.02986

Authors: Jian’an Zhang

Abstract

Transaction costs and regime shifts are major reasons why paper portfolios fail in live trading. We introduce FR-LUX (Friction-aware, Regime-conditioned Learning under eXecution costs), a reinforcement learning framework that learns after-cost trading policies and remains robust across volatility-liquidity regimes. FR-LUX integrates three ingredients: (i) a microstructure-consistent execution model combining proportional and impact costs, directly embedded in the reward; (ii) a trade-space trust region that constrains changes in inventory flow rather than logits, yielding stable low-turnover updates; and (iii) explicit regime conditioning so the policy specializes to LL/LH/HL/HH states without fragmenting the data. On a 4 x 5 grid of regimes and cost levels with multiple random seeds, FR-LUX achieves the top average Sharpe ratio with narrow bootstrap confidence intervals, maintains a flatter cost-performance slope than strong baselines, and attains superior risk-return efficiency for a given turnover budget. Pairwise scenario-level improvements are strictly positive and remain statistically significant after multiple-testing corrections. We provide formal guarantees on optimality under convex frictions, monotonic improvement under a KL trust region, long-run turnover bounds and induced inaction bands due to proportional costs, positive value advantage for regime-conditioned policies, and robustness to cost misspecification. The methodology is implementable: costs are calibrated from standard liquidity proxies, scenario-level inference avoids pseudo-replication, and all figures and tables are reproducible from released artifacts.

Complexity vs Empirical Score

  • Math Complexity: 8.5/10
  • Empirical Rigor: 8.0/10
  • Quadrant: Holy Grail — high math complexity, high empirical rigor

Why this score: The paper presents advanced mathematical formulations including MDP modeling, convex optimization theory, and formal proofs for policy improvement, scoring high on math complexity. It also demonstrates strong empirical rigor with a comprehensive backtest framework on 20 scenarios, robust statistical inference (Romano-Wolf corrections), and reproducible artifacts.

Research Flowchart

  flowchart TD
  A["Research Goal<br>How to build robust, implementable trading policies<br>that account for execution costs and market regimes?"] --> B["Methodology: FR-LUX Framework<br>(Friction-aware, Regime-conditioned RL)"]
  B --> C["Key Components<br>1. Microstructure Cost Model (Proportional + Impact)<br>2. Trade-Space Trust Region (Inventory Flow Constraints)<br>3. Explicit Regime Conditioning (LL/LH/HL/HH)"]
  C --> D["Data & Inputs<br>• Multi-regime scenarios (4x5 grid)<br>• Calibrated transaction costs<br>• Liquidity proxies"]
  D --> E["Computational Process<br>Reinforcement Learning Optimization<br>with Cost-Aware Rewards & Trust Region"]
  E --> F["Key Findings & Outcomes<br>• Top Sharpe with tight confidence intervals<br>• Flatter cost-performance slope vs. baselines<br>• Positive, significant scenario improvements<br>• Theoretical guarantees (optimality, robustness)"]
  F --> G["Outcome: Implementable, Robust Portfolio Policies<br>Reproducible artifacts released"]

Cited References (52)

  1. Portfolio Selection (1952)
  2. Optimal Execution of Portfolio Transactions (2001)
  3. Continuous Auctions and Insider Trading (1985)
  4. Illiquidity and Stock Returns: Cross-Section and Time-Series Effects (2002)
  5. Liquidity Risk and Expected Stock Returns (2003)
  6. Trading Costs and Returns for U.S. Equities: Estimating Effective Costs from Daily Data (2009) — link
  7. Do Liquidity Measures Measure Liquidity? (2009)
  8. What Are the Best Liquidity Proxies for Global Research? (2017)
and 44 more
  1. Optimal Trading Strategy and Supply/Demand Dynamics (2013)
  2. Dynamic Trading with Predictable Returns and Transaction Costs (2013) — link
  3. A Taxonomy of Anomalies and Their Trading Costs (2016)
  4. Volatility-Managed Portfolios (2017) — link
  5. Nonlinear Shrinkage of the Covariance Matrix for Portfolio Selection: Markowitz Meets Goldilocks (2017)
  6. Comparing Asset Pricing Models (2018)
  7. Model Comparison with Sharpe Ratios (2020) — link
  8. Empirical Asset Pricing via Machine Learning (2020)
  9. Dissecting Characteristics Nonparametrically (2020)
  10. Shrinking the Cross Section (2020)
  11. Deep Learning in Asset Pricing (2024) — link
  12. Importance of Transaction Costs for Asset Allocation in Foreign Exchange Markets (2024) — link
  13. Size Discount and Size Penalty: Trading Costs in Bond Markets (2024) — link
  14. International Asset Allocation with Regime Shifts (2002)
  15. Parametric Portfolio Policies: Exploiting Characteristics in the Cross-Section of Equity Returns (2009)
  16. A Reality Check for Data Snooping (2000)
  17. Exact and Approximate Stepdown Methods for Multiple Hypothesis Testing (2005)
  18. The Statistics of Sharpe Ratios (2002)
  19. Approximately Optimal Approximate Reinforcement Learning (2002)
  20. Trust Region Policy Optimization (2015)
  21. Proximal Policy Optimization Algorithms (2017)
  22. Constrained Policy Optimization (2017)
  23. A Transaction-Cost Perspective on the Multitude of Firm Characteristics (2020)
  24. A Review of Reinforcement Learning in Financial Applications — → 2411.12746
  25. Machine Learning and International Stock Returns (2025) — link
  26. Markowitz portfolios under transaction costs (2025) — link
  27. A Review of Reinforcement Learning in Financial Applications — → 2411.12746
  28. Liquidity Regimes and Optimal Dynamic Asset Allocation (2020) — link
  29. Algorithmic and High-Frequency Trading (2015)
  30. High-Dimensional Continuous Control Using Generalized Advantage Estimation (2016)
  31. Algorithms for CVaR Optimization in MDPs (2014)
  32. Efficient Risk-Averse Reinforcement Learning (2022)
  33. Optimization of Conditional Value-at-Risk (2000)
  34. Conditional Value-at-Risk for General Loss Distributions (2002)
  35. Expected Shortfall: A Natural Coherent Alternative to Value at Risk (2002)
  36. Efficient Projections onto the $\ell_1$-Ball for Learning in High Dimensions (2008)
  37. Projection onto the Probability Simplex: An Efficient Algorithm with a Simple Proof, and an Application (2013)
  38. Adaptive Mixtures of Local Experts (1991)
  39. Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer (2017)
  40. Markov Decision Processes: Discrete Stochastic Dynamic Programming (1994)
  41. Safe Policy Iteration (2013)
  42. Infinite Dimensional Analysis: A Hitchhiker’s Guide (2006)
  43. Elements of Information Theory (2006)
  44. Nonlinear Programming (1999)

2 of 52 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.