Paper: arXiv 2503.12305

Abstract

We develop a mathematical model for intraday dispatch of co-located wind-battery energy assets. Focusing on the primary objective of firming grid-side actual production vis-a-vis the preset day-ahead hourly generation targets, we conduct a comprehensive study of the resulting stochastic control problem across different firming formulations and wind generation dynamics. Among others, we provide a closed-form solution in the special case of a quadratic objective and linear dynamics, as well as design a novel adaptation of a Gaussian Process-based Regression Monte Carlo algorithm for our setting. Extensions studied include an asymmetric loss function for peak shaving, capturing the cost of battery cycling, and the role of battery duration. In the applied portion of our work, we calibrate our model to a collection of 140+ wind-battery assets in Texas, benchmarking the economic benefits of firming based on outputs of a realistic unit commitment and economic dispatch solver.

Complexity vs Empirical Score

  • Math Complexity: 8.5/10
  • Empirical Rigor: 7.5/10
  • Quadrant: Holy Grail — high math complexity, high empirical rigor

Why this score: The paper employs advanced stochastic control, SDEs, Gaussian Processes, and derives closed-form solutions under specific conditions, indicating high mathematical density. It also demonstrates high empirical rigor through calibration to 140+ real wind-battery assets in Texas and benchmarking against a realistic unit commitment solver.

Research Flowchart

  flowchart TD
  A["Research Goal: Optimal Intraday Battery Dispatch<br>for Co-located Wind-Battery Assets"] --> B{"Methodology: Stochastic Control Formulations"};
  B --> C["Primary: Firming w.r.t. Day-Ahead Targets"];
  B --> D["Extensions: Peak Shaving & Battery Cycling"];
  C & D --> E{"Solution Approaches"};
  E --> F["Closed-Form Solution: Quadratic Objective"];
  E --> G["Algorithm: GP-Adapted Regret Monte Carlo"];
  H["Data: 140+ Texas Wind-Battery Assets"] --> I["Calibration & Simulation"];
  F & G & I --> J{"Benchmarking"};
  J --> K["Economic Analysis: Unit Commitment & Economic Dispatch Solver"];
  K --> L["Key Findings: Economic Benefits of Firming & Optimal Dispatch Strategies"];

Cited References (94)

  1. Regression M onte C arlo for Microgrid Management (2019) — link
  2. Model-Free reinforcement learning with continuous action in practice (2012) — link
  3. Partial differential equation methods for stochastic dynamic optimization: an application to wind power generation with energy storage (2017) — link
  4. Integrating Sequential Hypothesis Testing into Adversarial Games: A Sun Zi-Inspired Framework (2025) — link
  5. 2023 Special Report on Battery Storage (2024)
  6. A model predictive control approach to the problem of wind power smoothing with controlled battery storage (2010) — link
  7. Valuing American Options by Simulation: A Simple Least-Squares Approach (2001)
  8. Simulation Methods for Stochastic Storage Problems: A Statistical Learning Perspective (2020) — link
and 86 more
  1. A toolbox on the distribution of the maximum of G aussian process (2013)
  2. Regress-Later M onte C arlo for Optimal Inventory Control with applications in energy (2018) — link
  3. Deep Learning Approximation for Stochastic Control Problems (2016)
  4. Solving high-dimensional partial differential equations using deep learning (2018) — link
  5. Deep backward schemes for high-dimensional nonlinear PDEs (2020)
  6. Deep Neural Networks Algorithms for Stochastic Control Problems on Finite Horizon: Numerical Applications ( 2022) — link
  7. A Multi-Factor Battery Cycle Life Prediction Methodology for Optimal Battery Management (2015) — link
  8. Optimal Battery Aging: An Adaptive Weights Dynamic Programming Algorithm (2018) — link
  9. Optimal operation of energy storage systems considering forecasts and battery degradation (2016)
  10. Defining a degradation cost function for optimal control of a battery energy storage system (2013) — link
  11. Trading with propagators and constraints: applications to optimal execution and battery storage (2024)
  12. Novel battery degradation cost formulation for optimal scheduling of battery energy storage systems (2022) — link
  13. Optimal Battery Control Under Cycle Aging Mechanisms in Pay for Performance Settings (2019) — link
  14. Equivalence of four-point and three-point rainflow cycle counting algorithms (2008)
  15. DGM: A deep learning algorithm for solving partial differential equations (2018)
  16. Extensions of the deep Galerkin method (2022) — link
  17. Deep Neural Networks Algorithms for Stochastic Control Problems on Finite Horizon: Numerical Applications (2021)
  18. Valuation of energy storage: an optimal switching approach (2010) — link
  19. Regression Monte Carlo for Impulse Control (2022) — link
  20. An alternative optimal strategy for stochastic model predictive control of a residential battery energy management system with solar photovoltaic (2021) — link
  21. Probabilistic spatiotemporal modeling of day-ahead wind power generation with input-warped Gaussian processes (2025) — link
  22. Self-Supervised Primal-Dual Learning for Constrained Optimization (2022)
  23. End-to-End Constrained Optimization Learning: A Survey (2021)
  24. Learning Constrained Optimization with Deep Augmented Lagrangian Methods (2024)
  25. DC3 : A learning method for optimization with hard constraints (2021)
  26. Enhancing Battery Storage Energy Arbitrage With Deep Reinforcement Learning and Time-Series Forecasting (2024)
  27. Stochastic predictive control of battery energy storage for wind farm dispatching: Using probabilistic wind power forecasts (2015) — link
  28. A stochastic continuous time model for microgrid energy management (2016) — link
  29. Optimal Dispatch of Hybrid Renewable–Battery Storage Resources: A Stochastic Control Approach (2024) — link
  30. Comparison of least squares M onte C arlo methods with applications to energy real options (2017) — link
  31. Optimal operation of a grid-connected battery energy storage system over its lifetime (2023) — link
  32. Scenario-based stochastic optimal operation of wind, photovoltaic, pump-storage hybrid system in frequency- based pricing (2015) — link
  33. Optimal Management of a Wind Power Plant with Storage Capacity (2018)
  34. Price impact and long-term profitability of energy storage — → 2410.12495
  35. Statistical learning for probability-constrained stochastic optimal control (2021) — link
  36. Hybrid Resources: Challenges, Implications, Opportunities, and Innovation (2021) — link
  37. Cooperation of Wind Power and Battery Storage to Provide Frequency Regulation in Power Markets (2017) — link
  38. Stochastic optimization of the daily operation of wind farm and pumped-hydro-storage plant (2012) — link
  39. A Price-Maker/Price-Taker Model for the Operation of Battery Storage Systems in Electricity Markets (2019) — link
  40. An energy storage assessment: Using optimal control strategies to capture multiple services (2015) — link
  41. Optimal Bidding Strategy of Battery Storage in Power Markets Considering Performance-Based Regulation and Battery Cycle Life (2016) — link
  42. Energy Storage Arbitrage Under Day-Ahead and Real-Time Price Uncertainty (2018) — link
  43. Control method evaluation for battery energy storage system utilized in renewable smoothing (2013) — link
  44. Using Battery Storage for Peak Shaving and Frequency Regulation: Joint Optimization for Superlinear Gains (2018) — link
  45. Gaussian processes for machine learning. (2006)
  46. A class of stochastic optimal control problems with state constraint (2002)
  47. Viscosity Solutions of Second Order Fully Nonlinear Elliptic Equations with State Constraints (1994)
  48. Hybrid Distributed Wind and Battery Energy Storage Systems (2022) — link
  49. Energy storage systems: a review (2022) — link
  50. Stochastic control with state constraints via the F okker– P lanck equation. Application to renewable energy plants with batteries (2024) — link
  51. Nonlinear Elliptic Equations with Singular Boundary Conditions and Stochastic Control with State Constraints. I. The Model Problem. (1989)
  52. Continuous-time Stochastic Control and Optimization with Financial Applications (2009)
  53. Deep Fictitious Play for Finding M arkovian N ash Equilibrium in Multi-Agent Games (2020) — link
  54. Unlocking the Flexibility of Hybrid Resources (2022)
  55. Battery Energy Storage Scheduling for Optimal Load Variance Minimization (2018)
  56. KrigHedge: Gaussian Process Surrogates for Delta Hedging (2021) — link
  57. Dynamic Programming (2010)
  58. Probabilistic Forecasts of Wind Power Generation by Stochastic Differential Equation Models (2016) — link
  59. Quantifying uncertainty with a derivative tracking SDE model and application to wind power forecast data (2021) — link
  60. Approximate Dynamic Programming: Solving the curses of dimensionality (2007)
  61. Energy Storage Price Arbitrage via Opportunity Value Function Prediction (2023) — link
  62. Reinforcement Learning Based Demand Charge Minimization Using Energy Storage (2023) — link
  63. Optimal Energy Storage Scheduling for Wind Curtailment Reduction and Energy Arbitrage: A Deep Reinforcement Learning Approach (2023)
  64. Multi-service battery energy storage system optimization and control (2022)
  65. Co-optimizing battery storage for the frequency regulation and energy arbitrage using multi-scale dynamic programming (2016)
  66. 2H 2023 Energy Storage Market Outlook (2023)
  67. A stochastic optimal control solution to the energy management of a microgrid with storage and renewables (2016) — link
  68. Today in Energy: U.S . battery storage capacity expected to nearly double in 2024 (2024)
  69. Creation of synthetic electric grid models for transient stability studies (2017)
  70. Educational Applications of Large Synthetic Power Grids (2019) — link
  71. Policy iteration for Hamilton - Jacobi - Bellman equations with control constraints (2020)
  72. A consumption-investment model with state-dependent lower bound constraint on consumption (2021)
  73. Solving the Hamilton - Jacobi - Bellman equation for a stochastic system with state constraints (2014) — link
  74. Viscosity Solutions (2006) — link
  75. Learning HJB Viscosity Solutions with PINNs for Continuous - Time Reinforcement Learning
  76. HJB Optimal Feedback Control with Deep Differential Value Functions and Action Constraints (2020)
  77. Grid Forming Technology: Bulk Power System Reliability Considerations (2021) — link
  78. Solvability of Differential R iccati Equations and Applications to Algorithmic Trading with Signals (2022)
  79. Optimal strategies for wind turbine environmental curtailment (2020) — link
  80. Maximum Hands-Off Control: A Paradigm of Control Effort Minimization (2016) — link
  81. Stochastic $L_1$ -optimal control via forward and backward sampling (2018) — link
  82. Learning Deep Stochastic Optimal Control Policies using Forward-Backward SDEs (2021)
  83. State-Constrained Stochastic Optimal Control Problems via Reachability Approach (2016) — link
  84. State Constrained Stochastic Optimal Control for Continuous and Hybrid Dynamical Systems Using DFBSDE (2023)
  85. Hybrid power plants: Status of operating and proposed plants, 2024 edition (2024) — link
  86. Utilities report batteries are mos commonly used for arbitrage and grid stability (2024)

1 of 94 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.