Paper: arXiv 2405.17070
Abstract
Accurate mid-term (weeks to one year) hourly electricity load forecasts are essential for strategic decision-making in power plant operation, ensuring supply security and grid stability, planning and building energy storage systems, and energy trading. While numerous models effectively predict short-term (hours to a few days) hourly load, mid-term forecasting solutions remain scarce. In mid-term load forecasting, capturing the multifaceted characteristics of load, including daily, weekly and annual seasonal patterns, as well as autoregressive effects, weather and holiday impacts, and socio-economic non-stationarities, presents significant modeling challenges. To address these challenges, we propose a novel forecasting method using Generalized Additive Models (GAMs) built from interpretable P-splines that is enhanced with autoregressive post-processing. This model incorporates smoothed temperatures, Error-Trend-Seasonal (ETS) modeled and persistently forecasted non-stationary socio-economic states, a nuanced representation of effects from vacation periods, fixed date and weekday holidays, and seasonal information as inputs. The proposed model is evaluated using load data from 24 European countries over more than 9 years (2015-2024). This analysis demonstrates that the model not only has significantly enhanced forecasting accuracy compared to state-of-the-art methods but also offers valuable insights into the influence of individual components on predicted load, given its full interpretability. Achieving performance akin to day-ahead Transmission System Operator (TSO) forecasts, with computation times of just a few seconds for several years of hourly data, underscores the potential of the model for practical application in the power system industry.
Complexity vs Empirical Score
- Math Complexity: 4.5/10
- Empirical Rigor: 8.5/10
- Quadrant: Street Traders — practical and empirical, lighter on theory
Why this score: The paper employs interpretable Generalized Additive Models (GAMs) with P-splines, which is a standard but moderately complex statistical technique, and focuses heavily on practical application with extensive multi-country, multi-year backtesting, performance benchmarks against TSO forecasts, and computational efficiency.
Research Flowchart
flowchart TD
A["Research Goal<br>Develop Accurate &<br>Interpretable Mid-Term<br>Hourly Load Forecasting"] --> B["Data Collection & Input<br>9+ Years (2015-24)<br>24 European Countries"]
B --> C{"Core Methodology<br>Generalized Additive Models with P-Splines"}
C --> D["Input Features Processing"]
D --> E["Smoothed Temperatures"]
D --> F["ETS Modeled Socio-Economic<br>States (Forecasted persistently)"]
D --> G["Holiday Effects<br>Fixed date & Weekday"]
D --> H["Seasonal Information<br>Daily, Weekly, Annual"]
E & F & G & H --> C
C --> I["Autoregressive<br>Post-Processing"]
I --> J["Key Outcomes & Findings"]
J --> K["Significantly Enhanced<br>Forecasting Accuracy"]
J --> L["Full Interpretability<br>Insights into individual<br>component impacts"]
J --> M["Computational Efficiency<br>Seconds for years of<br>hourly data"]
J --> N["Performance comparable<br>to Day-Ahead TSO Forecasts"]
style A fill:#e1f5fe
style J fill:#f3e5f5
style C fill:#fff3e0
Cited References (71)
- Short Term Electric Load Forecasting (2012)
- GEFCom2012: Electric load forecasting and backcasting with semi-parametric models (2013) — link
- Trends and cycles in economic time series: A Bayesian approach (2006) — link
- Short-Term Load Forecasting With Seasonal Decomposition Using Evolution for Parameter Tuning (2015) — link
- Local Short and Middle Term Electricity Load Forecasting With Semi-Parametric Additive Models (2014) — link
- Generalized Additive Models for Large Data Sets (2014) — link
- The evaluation of extrapolative forecasting methods (1992) — link
- Are fluctuations in energy variables permanent or transitory? A survey of the literature on the integration properties of energy consumption and production (2012) — link
and 63 more
- Seasonal climate forecasts for medium-term electricity demand forecasting (2014) — link
- On the asymmetry of the symmetric MAPE (1999) — link
- Trends and random walks in macroeconmic time series (1982) — link
- Comparing Predictive Accuracy (1995) — link
- Long Term Probabilistic Load Forecasting and Normalization With Hourly Information (2013) — link
- A study of outliers in the exponential smoothing approach to forecasting (2011) — link
- A unit root model for trending time-series energy variables (2014) — link
- Medium term system load forecasting with a dynamic artificial neural network model (2005) — link
- Testing of unit root and other nonstationary hypotheses in macroeconomic time series (1997) — link
- Short-Term Load Forecasting Based on a Semi-Parametric Additive Model (2011) — link
- Further evidence on breaking trend functions in macroeconomic variables (1997) — link
- Global Energy Forecasting Competition 2012 (2013) — link
- Generalized Additive Models: An Introduction With R (2007) — link
- Explaining Cointegration Analysis: Part II (2001) — link
- Load Forecasting Using Support Vector Machines: A Study on EUNITE Competition 2001 (2004) — link
- A note on the Mean Absolute Scaled Error (2015) — link
- Probabilistic electric load forecasting: A tutorial review (2016) — link
- Additive models and robust aggregation for GEFCom2014 probabilistic electric load and electricity price forecasting (2016) — link
- Lasso estimation for GEFCom2014 probabilistic electric load forecasting (2016) — link
- Probabilistic energy forecasting: Global Energy Forecasting Competition 2014 and beyond (2016) — link
- GEFCom2014 probabilistic electric load forecasting using time series and semi-parametric regression models (2016) — link
- Relative Humidity for Load Forecasting Models (2016) — link
- Benchmarking robustness of load forecasting models under data integrity attacks (2017) — link
- Long term load forecasting with hourly predictions based on long-short-term-memory networks (2018) — link
- Modeling public holidays in load forecasting: a German case study (2018) — link
- Short term load forecasting and the effect of temperature at the low voltage level (2018) — link
- Optimal Deep Learning LSTM Model for Electric Load Forecasting using Feature Selection and Genetic Algorithm: Comparison with Machine Learning Approaches † (2018) — link
- Forecasting principles and practice
- Creating a proof-of-concept climate service to assess future renewable energy mixes in Europe: An overview of the C3S ECEM project (2018) — link
- Quantile regression for the qualifying match of GEFCom2017 probabilistic load forecasting (2018) — link
- Enhanced Deep Networks for Short-Term and Medium-Term Load Forecasting (2018) — link
- Global energy forecasting competition 2017: Hierarchical probabilistic load forecasting (2019) — link
- Combining Weather Stations for Electric Load Forecasting (2019) — link
- Making and Evaluating Point Forecasts (2009) — link
- Changes in electricity demand pattern in Europe due to COVID-19 shutdowns (2020) — link
- The impact of different COVID-19 containment measures on electricity consumption in Europe (2020) — link
- How to model European electricity load profiles using artificial neural networks (2020) — link
- Adaptive Methods for Short-Term Electricity Load Forecasting During COVID-19 Lockdown in France (2021) — link
- N-BEATS neural network for mid-term electricity load forecasting (2021) — link
- Texts in Statistical Science (2018) — link
- Forecasting: theory and practice (2022) — link
- The non-linear link between electricity consumption and temperature in Europe: A threshold panel approach (2008) — link
- Comparing Predictive Accuracy (1994) — link
- Practical Smoothing (2021) — link
- Probabilistic Forecasting of Regional Net-load with Conditional Extremes and Gridded NWP (2022) — link
- Probabilistic Forecasting of Regional Net-Load With Conditional Extremes and Gridded NWP (2021) — link
- Modeling Energy Demand—A Systematic Literature Review (2021) — link
- Global changes in electricity consumption during COVID-19 (2021) — link
- State-Space Models for Online Post-Covid Electricity Load Forecasting Competition (2022) — link
- A data-driven knowledge-based system with reasoning under uncertain evidence for regional long-term hourly load forecasting (2022) — link
- Smoothed Bernstein Online Aggregation for Short-Term Load Forecasting in IEEE DataPort Competition on Day-Ahead Electricity Demand Forecasting: Post-COVID Paradigm (2022) — link
- Intelligence based Accurate Medium and Long Term Load Forecasting System (2022) — link
- Introduction to Time Series and Forecasting (2016) — link
- Generalized Additive Models (2006) — link
- Probabilistic forecasting method for mid-term hourly load time series based on an improved temporal fusion transformer model (2022) — link
- Adaptive Probabilistic Forecasting of Electricity (Net-)Load (2023) — link
- High-Resolution Load Forecasting on Multiple Time Scales Using Long Short-Term Memory and Support Vector Machine (2023) — link
- Modelling the unit root properties of electricity data—A general note on time-domain applications (2023) — link
- Incorporating air temperature into mid-term electricity load forecasting models using time-series regressions and neural networks (2023) — link
- Forecasting and Analytics with the Augmented Dynamic Adaptive Model (ADAM) (2023) — link
- Using weather data in energy time series forecasting: the benefit of input data transformations (2023) — link
- Carbon Monitor Power-Simulators (CMP-SIM v1.0) across countries: a data-driven approach to simulate daily power generation (2024) — link
- Influence of population mobility on electricity consumption in seven U.S. cities during the COVID-19 pandemic (2024) — link
0 of 71 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.