Paper: arXiv 2503.12305
Abstract
We develop a mathematical model for intraday dispatch of co-located wind-battery energy assets. Focusing on the primary objective of firming grid-side actual production vis-a-vis the preset day-ahead hourly generation targets, we conduct a comprehensive study of the resulting stochastic control problem across different firming formulations and wind generation dynamics. Among others, we provide a closed-form solution in the special case of a quadratic objective and linear dynamics, as well as design a novel adaptation of a Gaussian Process-based Regression Monte Carlo algorithm for our setting. Extensions studied include an asymmetric loss function for peak shaving, capturing the cost of battery cycling, and the role of battery duration. In the applied portion of our work, we calibrate our model to a collection of 140+ wind-battery assets in Texas, benchmarking the economic benefits of firming based on outputs of a realistic unit commitment and economic dispatch solver.
Complexity vs Empirical Score
- Math Complexity: 8.5/10
- Empirical Rigor: 7.5/10
- Quadrant: Holy Grail — high math complexity, high empirical rigor
Why this score: The paper employs advanced stochastic control, SDEs, Gaussian Processes, and derives closed-form solutions under specific conditions, indicating high mathematical density. It also demonstrates high empirical rigor through calibration to 140+ real wind-battery assets in Texas and benchmarking against a realistic unit commitment solver.
Research Flowchart
flowchart TD
A["Research Goal: Optimal Intraday Battery Dispatch<br>for Co-located Wind-Battery Assets"] --> B{"Methodology: Stochastic Control Formulations"};
B --> C["Primary: Firming w.r.t. Day-Ahead Targets"];
B --> D["Extensions: Peak Shaving & Battery Cycling"];
C & D --> E{"Solution Approaches"};
E --> F["Closed-Form Solution: Quadratic Objective"];
E --> G["Algorithm: GP-Adapted Regret Monte Carlo"];
H["Data: 140+ Texas Wind-Battery Assets"] --> I["Calibration & Simulation"];
F & G & I --> J{"Benchmarking"};
J --> K["Economic Analysis: Unit Commitment & Economic Dispatch Solver"];
K --> L["Key Findings: Economic Benefits of Firming & Optimal Dispatch Strategies"];
Cited References (94)
- Regression M onte C arlo for Microgrid Management (2019) — link
- Model-Free reinforcement learning with continuous action in practice (2012) — link
- Partial differential equation methods for stochastic dynamic optimization: an application to wind power generation with energy storage (2017) — link
- Integrating Sequential Hypothesis Testing into Adversarial Games: A Sun Zi-Inspired Framework (2025) — link
- 2023 Special Report on Battery Storage (2024)
- A model predictive control approach to the problem of wind power smoothing with controlled battery storage (2010) — link
- Valuing American Options by Simulation: A Simple Least-Squares Approach (2001)
- Simulation Methods for Stochastic Storage Problems: A Statistical Learning Perspective (2020) — link
and 86 more
- A toolbox on the distribution of the maximum of G aussian process (2013)
- Regress-Later M onte C arlo for Optimal Inventory Control with applications in energy (2018) — link
- Deep Learning Approximation for Stochastic Control Problems (2016)
- Solving high-dimensional partial differential equations using deep learning (2018) — link
- Deep backward schemes for high-dimensional nonlinear PDEs (2020)
- Deep Neural Networks Algorithms for Stochastic Control Problems on Finite Horizon: Numerical Applications ( 2022) — link
- A Multi-Factor Battery Cycle Life Prediction Methodology for Optimal Battery Management (2015) — link
- Optimal Battery Aging: An Adaptive Weights Dynamic Programming Algorithm (2018) — link
- Optimal operation of energy storage systems considering forecasts and battery degradation (2016)
- Defining a degradation cost function for optimal control of a battery energy storage system (2013) — link
- Trading with propagators and constraints: applications to optimal execution and battery storage (2024)
- Novel battery degradation cost formulation for optimal scheduling of battery energy storage systems (2022) — link
- Optimal Battery Control Under Cycle Aging Mechanisms in Pay for Performance Settings (2019) — link
- Equivalence of four-point and three-point rainflow cycle counting algorithms (2008)
- DGM: A deep learning algorithm for solving partial differential equations (2018)
- Extensions of the deep Galerkin method (2022) — link
- Deep Neural Networks Algorithms for Stochastic Control Problems on Finite Horizon: Numerical Applications (2021)
- Valuation of energy storage: an optimal switching approach (2010) — link
- Regression Monte Carlo for Impulse Control (2022) — link
- An alternative optimal strategy for stochastic model predictive control of a residential battery energy management system with solar photovoltaic (2021) — link
- Probabilistic spatiotemporal modeling of day-ahead wind power generation with input-warped Gaussian processes (2025) — link
- Self-Supervised Primal-Dual Learning for Constrained Optimization (2022)
- End-to-End Constrained Optimization Learning: A Survey (2021)
- Learning Constrained Optimization with Deep Augmented Lagrangian Methods (2024)
- DC3 : A learning method for optimization with hard constraints (2021)
- Enhancing Battery Storage Energy Arbitrage With Deep Reinforcement Learning and Time-Series Forecasting (2024)
- Stochastic predictive control of battery energy storage for wind farm dispatching: Using probabilistic wind power forecasts (2015) — link
- A stochastic continuous time model for microgrid energy management (2016) — link
- Optimal Dispatch of Hybrid Renewable–Battery Storage Resources: A Stochastic Control Approach (2024) — link
- Comparison of least squares M onte C arlo methods with applications to energy real options (2017) — link
- Optimal operation of a grid-connected battery energy storage system over its lifetime (2023) — link
- Scenario-based stochastic optimal operation of wind, photovoltaic, pump-storage hybrid system in frequency- based pricing (2015) — link
- Optimal Management of a Wind Power Plant with Storage Capacity (2018)
- Price impact and long-term profitability of energy storage — → 2410.12495
- Statistical learning for probability-constrained stochastic optimal control (2021) — link
- Hybrid Resources: Challenges, Implications, Opportunities, and Innovation (2021) — link
- Cooperation of Wind Power and Battery Storage to Provide Frequency Regulation in Power Markets (2017) — link
- Stochastic optimization of the daily operation of wind farm and pumped-hydro-storage plant (2012) — link
- A Price-Maker/Price-Taker Model for the Operation of Battery Storage Systems in Electricity Markets (2019) — link
- An energy storage assessment: Using optimal control strategies to capture multiple services (2015) — link
- Optimal Bidding Strategy of Battery Storage in Power Markets Considering Performance-Based Regulation and Battery Cycle Life (2016) — link
- Energy Storage Arbitrage Under Day-Ahead and Real-Time Price Uncertainty (2018) — link
- Control method evaluation for battery energy storage system utilized in renewable smoothing (2013) — link
- Using Battery Storage for Peak Shaving and Frequency Regulation: Joint Optimization for Superlinear Gains (2018) — link
- Gaussian processes for machine learning. (2006)
- A class of stochastic optimal control problems with state constraint (2002)
- Viscosity Solutions of Second Order Fully Nonlinear Elliptic Equations with State Constraints (1994)
- Hybrid Distributed Wind and Battery Energy Storage Systems (2022) — link
- Energy storage systems: a review (2022) — link
- Stochastic control with state constraints via the F okker– P lanck equation. Application to renewable energy plants with batteries (2024) — link
- Nonlinear Elliptic Equations with Singular Boundary Conditions and Stochastic Control with State Constraints. I. The Model Problem. (1989)
- Continuous-time Stochastic Control and Optimization with Financial Applications (2009)
- Deep Fictitious Play for Finding M arkovian N ash Equilibrium in Multi-Agent Games (2020) — link
- Unlocking the Flexibility of Hybrid Resources (2022)
- Battery Energy Storage Scheduling for Optimal Load Variance Minimization (2018)
- KrigHedge: Gaussian Process Surrogates for Delta Hedging (2021) — link
- Dynamic Programming (2010)
- Probabilistic Forecasts of Wind Power Generation by Stochastic Differential Equation Models (2016) — link
- Quantifying uncertainty with a derivative tracking SDE model and application to wind power forecast data (2021) — link
- Approximate Dynamic Programming: Solving the curses of dimensionality (2007)
- Energy Storage Price Arbitrage via Opportunity Value Function Prediction (2023) — link
- Reinforcement Learning Based Demand Charge Minimization Using Energy Storage (2023) — link
- Optimal Energy Storage Scheduling for Wind Curtailment Reduction and Energy Arbitrage: A Deep Reinforcement Learning Approach (2023)
- Multi-service battery energy storage system optimization and control (2022)
- Co-optimizing battery storage for the frequency regulation and energy arbitrage using multi-scale dynamic programming (2016)
- 2H 2023 Energy Storage Market Outlook (2023)
- A stochastic optimal control solution to the energy management of a microgrid with storage and renewables (2016) — link
- Today in Energy: U.S . battery storage capacity expected to nearly double in 2024 (2024)
- Creation of synthetic electric grid models for transient stability studies (2017)
- Educational Applications of Large Synthetic Power Grids (2019) — link
- Policy iteration for Hamilton - Jacobi - Bellman equations with control constraints (2020)
- A consumption-investment model with state-dependent lower bound constraint on consumption (2021)
- Solving the Hamilton - Jacobi - Bellman equation for a stochastic system with state constraints (2014) — link
- Viscosity Solutions (2006) — link
- Learning HJB Viscosity Solutions with PINNs for Continuous - Time Reinforcement Learning
- HJB Optimal Feedback Control with Deep Differential Value Functions and Action Constraints (2020)
- Grid Forming Technology: Bulk Power System Reliability Considerations (2021) — link
- Solvability of Differential R iccati Equations and Applications to Algorithmic Trading with Signals (2022)
- Optimal strategies for wind turbine environmental curtailment (2020) — link
- Maximum Hands-Off Control: A Paradigm of Control Effort Minimization (2016) — link
- Stochastic $L_1$ -optimal control via forward and backward sampling (2018) — link
- Learning Deep Stochastic Optimal Control Policies using Forward-Backward SDEs (2021)
- State-Constrained Stochastic Optimal Control Problems via Reachability Approach (2016) — link
- State Constrained Stochastic Optimal Control for Continuous and Hybrid Dynamical Systems Using DFBSDE (2023)
- Hybrid power plants: Status of operating and proposed plants, 2024 edition (2024) — link
- Utilities report batteries are mos commonly used for arbitrage and grid stability (2024)
1 of 94 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.