Paper: arXiv 2501.07508

Abstract

This paper applies deep reinforcement learning (DRL) to optimize liquidity provisioning in Uniswap v3, a decentralized finance (DeFi) protocol implementing an automated market maker (AMM) model with concentrated liquidity. We model the liquidity provision task as a Markov Decision Process (MDP) and train an active liquidity provider (LP) agent using the Proximal Policy Optimization (PPO) algorithm. The agent dynamically adjusts liquidity positions by using information about price dynamics to balance fee maximization and impermanent loss mitigation. We use a rolling window approach for training and testing, reflecting realistic market conditions and regime shifts. This study compares the data-driven performance of the DRL-based strategy against common heuristics adopted by small retail LP actors that do not systematically modify their liquidity positions. By promoting more efficient liquidity management, this work aims to make DeFi markets more accessible and inclusive for a broader range of participants. Through a data-driven approach to liquidity management, this work seeks to contribute to the ongoing development of more efficient and user-friendly DeFi markets.

Complexity vs Empirical Score

  • Math Complexity: 7.0/10
  • Empirical Rigor: 8.0/10
  • Quadrant: Holy Grail — high math complexity, high empirical rigor

Why this score: The paper employs advanced mathematical concepts like Markov Decision Processes, Proximal Policy Optimization, and Loss-Versus-Rebalancing modeling, indicating high math complexity. It uses a rolling window approach on real-world market data for training and testing, with a concrete comparison against heuristics, demonstrating high empirical rigor.

Research Flowchart

  flowchart TD
  A["Research Goal:\nOptimize Liquidity Provision in Uniswap v3\nfor Improved DeFi Accessibility"] --> B["Model Formulation:\nMarkov Decision Process (MDP)"]
  B --> C["Core Methodology:\nDeep Reinforcement Learning (PPO Algorithm)"]
  C --> D["Data Inputs:\nHistorical Price Dynamics\nMarket Regime Shifts"]
  D --> E["Computational Process:\nActive LP Agent Training via Rolling Window"]
  E --> F["Key Findings:\nDRL Strategy Outperforms Static Heuristics\nFee Maximization & Impermanent Loss Mitigation"]

Cited References (33)

  1. Risks and returns of uniswap v3 liquidity providers (2022) — link
  2. Uniswap v3 core (2021)
  3. Automated Market Making and Loss-Versus-Rebalancing (2023) — link
  4. Decentralized finance (2020)
  5. The technology of decentralized finance (DeFi) (2024)
  6. Complexity-Approximation Trade-offs in Exchange Mechanisms: AMMs vs. LOBs (2023)
  7. Impermanent loss in uniswap v3 (2021) — link
  8. Concentrated liquidity in automated market makers (2021)
and 25 more
  1. Cyclic arbitrage in decentralized exchanges (2022)
  2. TA-Lib: Technical Analysis Library in Python
  3. Etherscan Gas Tracker
  4. Proximal policy optimization algorithms (2017) — link
  5. Simulation-based optimization of Markov reward processes (2001) — link
  6. Policy Gradient Methods for Reinforcement Learning with Function Approximation (2000)
  7. Sok: Decentralized finance (defi) (2022)
  8. Sok: Decentralized exchanges (dex) with automated market maker (amm) protocols (2023)
  9. The costs of swapping on the uniswap protocol — → 2309.13648
  10. An empirical study of market inefficiencies in Uniswap and SushiSwap (2022)
  11. Decentralized exchange: The uniswap automated market maker (2021)
  12. Strategic liquidity provision in uniswap v3 (2021) — link
  13. Adaptive Liquidity Provision in Uniswap V3 with Deep Reinforcement Learning (2023) — link
  14. Just-in-time liquidity on the uniswap protocol (2022)
  15. Backtesting Framework for Concentrated Liquidity Market Makers on Uniswap V3 Decentralized Exchange — → 2410.09983
  16. Uniswap: Impermanent loss and risk profile of a liquidity provider (2021) — link
  17. Automated market makers: A practical guide to decentralized exchanges and cryptocurrency trading (2023)
  18. dydx: A standard for decentralized margin trading and derivatives (2018)
  19. The Role of Decentralized Finance (DeFi) in Reshaping Global Financial Inclusion: Opportunities and Risks (2024)
  20. Training language models to follow instructions with human feedback (2022)
  21. Delve into PPO: Implementation Matters for Stable RLHF (2023)
  22. Decentralized Finance and Automated Market Making: Predictable Loss and Optimal Liquidity Provision (2024)
  23. Uniswap liquidity provision: An online learning approach (2023)
  24. Differential Liquidity Provision in Uniswap v3 and Implications for Contract Design (2022)
  25. Liquidity Math in Uniswap v3 (2021)

2 of 33 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.