Paper: arXiv 2405.17070

Abstract

Accurate mid-term (weeks to one year) hourly electricity load forecasts are essential for strategic decision-making in power plant operation, ensuring supply security and grid stability, planning and building energy storage systems, and energy trading. While numerous models effectively predict short-term (hours to a few days) hourly load, mid-term forecasting solutions remain scarce. In mid-term load forecasting, capturing the multifaceted characteristics of load, including daily, weekly and annual seasonal patterns, as well as autoregressive effects, weather and holiday impacts, and socio-economic non-stationarities, presents significant modeling challenges. To address these challenges, we propose a novel forecasting method using Generalized Additive Models (GAMs) built from interpretable P-splines that is enhanced with autoregressive post-processing. This model incorporates smoothed temperatures, Error-Trend-Seasonal (ETS) modeled and persistently forecasted non-stationary socio-economic states, a nuanced representation of effects from vacation periods, fixed date and weekday holidays, and seasonal information as inputs. The proposed model is evaluated using load data from 24 European countries over more than 9 years (2015-2024). This analysis demonstrates that the model not only has significantly enhanced forecasting accuracy compared to state-of-the-art methods but also offers valuable insights into the influence of individual components on predicted load, given its full interpretability. Achieving performance akin to day-ahead Transmission System Operator (TSO) forecasts, with computation times of just a few seconds for several years of hourly data, underscores the potential of the model for practical application in the power system industry.

Complexity vs Empirical Score

  • Math Complexity: 4.5/10
  • Empirical Rigor: 8.5/10
  • Quadrant: Street Traders — practical and empirical, lighter on theory

Why this score: The paper employs interpretable Generalized Additive Models (GAMs) with P-splines, which is a standard but moderately complex statistical technique, and focuses heavily on practical application with extensive multi-country, multi-year backtesting, performance benchmarks against TSO forecasts, and computational efficiency.

Research Flowchart

  flowchart TD
  A["Research Goal<br>Develop Accurate &<br>Interpretable Mid-Term<br>Hourly Load Forecasting"] --> B["Data Collection & Input<br>9+ Years (2015-24)<br>24 European Countries"]
  
  B --> C{"Core Methodology<br>Generalized Additive Models with P-Splines"}
  
  C --> D["Input Features Processing"]
  
  D --> E["Smoothed Temperatures"]
  D --> F["ETS Modeled Socio-Economic<br>States (Forecasted persistently)"]
  D --> G["Holiday Effects<br>Fixed date & Weekday"]
  D --> H["Seasonal Information<br>Daily, Weekly, Annual"]
  
  E & F & G & H --> C
  
  C --> I["Autoregressive<br>Post-Processing"]
  
  I --> J["Key Outcomes & Findings"]
  
  J --> K["Significantly Enhanced<br>Forecasting Accuracy"]
  J --> L["Full Interpretability<br>Insights into individual<br>component impacts"]
  J --> M["Computational Efficiency<br>Seconds for years of<br>hourly data"]
  J --> N["Performance comparable<br>to Day-Ahead TSO Forecasts"]
  
  style A fill:#e1f5fe
  style J fill:#f3e5f5
  style C fill:#fff3e0

Cited References (71)

  1. Short Term Electric Load Forecasting (2012)
  2. GEFCom2012: Electric load forecasting and backcasting with semi-parametric models (2013) — link
  3. Trends and cycles in economic time series: A Bayesian approach (2006) — link
  4. Short-Term Load Forecasting With Seasonal Decomposition Using Evolution for Parameter Tuning (2015) — link
  5. Local Short and Middle Term Electricity Load Forecasting With Semi-Parametric Additive Models (2014) — link
  6. Generalized Additive Models for Large Data Sets (2014) — link
  7. The evaluation of extrapolative forecasting methods (1992) — link
  8. Are fluctuations in energy variables permanent or transitory? A survey of the literature on the integration properties of energy consumption and production (2012) — link
and 63 more
  1. Seasonal climate forecasts for medium-term electricity demand forecasting (2014) — link
  2. On the asymmetry of the symmetric MAPE (1999) — link
  3. Trends and random walks in macroeconmic time series (1982) — link
  4. Comparing Predictive Accuracy (1995) — link
  5. Long Term Probabilistic Load Forecasting and Normalization With Hourly Information (2013) — link
  6. A study of outliers in the exponential smoothing approach to forecasting (2011) — link
  7. A unit root model for trending time-series energy variables (2014) — link
  8. Medium term system load forecasting with a dynamic artificial neural network model (2005) — link
  9. Testing of unit root and other nonstationary hypotheses in macroeconomic time series (1997) — link
  10. Short-Term Load Forecasting Based on a Semi-Parametric Additive Model (2011) — link
  11. Further evidence on breaking trend functions in macroeconomic variables (1997) — link
  12. Global Energy Forecasting Competition 2012 (2013) — link
  13. Generalized Additive Models: An Introduction With R (2007) — link
  14. Explaining Cointegration Analysis: Part II (2001) — link
  15. Load Forecasting Using Support Vector Machines: A Study on EUNITE Competition 2001 (2004) — link
  16. A note on the Mean Absolute Scaled Error (2015) — link
  17. Probabilistic electric load forecasting: A tutorial review (2016) — link
  18. Additive models and robust aggregation for GEFCom2014 probabilistic electric load and electricity price forecasting (2016) — link
  19. Lasso estimation for GEFCom2014 probabilistic electric load forecasting (2016) — link
  20. Probabilistic energy forecasting: Global Energy Forecasting Competition 2014 and beyond (2016) — link
  21. GEFCom2014 probabilistic electric load forecasting using time series and semi-parametric regression models (2016) — link
  22. Relative Humidity for Load Forecasting Models (2016) — link
  23. Benchmarking robustness of load forecasting models under data integrity attacks (2017) — link
  24. Long term load forecasting with hourly predictions based on long-short-term-memory networks (2018) — link
  25. Modeling public holidays in load forecasting: a German case study (2018) — link
  26. Short term load forecasting and the effect of temperature at the low voltage level (2018) — link
  27. Optimal Deep Learning LSTM Model for Electric Load Forecasting using Feature Selection and Genetic Algorithm: Comparison with Machine Learning Approaches † (2018) — link
  28. Forecasting principles and practice
  29. Creating a proof-of-concept climate service to assess future renewable energy mixes in Europe: An overview of the C3S ECEM project (2018) — link
  30. Quantile regression for the qualifying match of GEFCom2017 probabilistic load forecasting (2018) — link
  31. Enhanced Deep Networks for Short-Term and Medium-Term Load Forecasting (2018) — link
  32. Global energy forecasting competition 2017: Hierarchical probabilistic load forecasting (2019) — link
  33. Combining Weather Stations for Electric Load Forecasting (2019) — link
  34. Making and Evaluating Point Forecasts (2009) — link
  35. Changes in electricity demand pattern in Europe due to COVID-19 shutdowns (2020) — link
  36. The impact of different COVID-19 containment measures on electricity consumption in Europe (2020) — link
  37. How to model European electricity load profiles using artificial neural networks (2020) — link
  38. Adaptive Methods for Short-Term Electricity Load Forecasting During COVID-19 Lockdown in France (2021) — link
  39. N-BEATS neural network for mid-term electricity load forecasting (2021) — link
  40. Texts in Statistical Science (2018) — link
  41. Forecasting: theory and practice (2022) — link
  42. The non-linear link between electricity consumption and temperature in Europe: A threshold panel approach (2008) — link
  43. Comparing Predictive Accuracy (1994) — link
  44. Practical Smoothing (2021) — link
  45. Probabilistic Forecasting of Regional Net-load with Conditional Extremes and Gridded NWP (2022) — link
  46. Probabilistic Forecasting of Regional Net-Load With Conditional Extremes and Gridded NWP (2021) — link
  47. Modeling Energy Demand—A Systematic Literature Review (2021) — link
  48. Global changes in electricity consumption during COVID-19 (2021) — link
  49. State-Space Models for Online Post-Covid Electricity Load Forecasting Competition (2022) — link
  50. A data-driven knowledge-based system with reasoning under uncertain evidence for regional long-term hourly load forecasting (2022) — link
  51. Smoothed Bernstein Online Aggregation for Short-Term Load Forecasting in IEEE DataPort Competition on Day-Ahead Electricity Demand Forecasting: Post-COVID Paradigm (2022) — link
  52. Intelligence based Accurate Medium and Long Term Load Forecasting System (2022) — link
  53. Introduction to Time Series and Forecasting (2016) — link
  54. Generalized Additive Models (2006) — link
  55. Probabilistic forecasting method for mid-term hourly load time series based on an improved temporal fusion transformer model (2022) — link
  56. Adaptive Probabilistic Forecasting of Electricity (Net-)Load (2023) — link
  57. High-Resolution Load Forecasting on Multiple Time Scales Using Long Short-Term Memory and Support Vector Machine (2023) — link
  58. Modelling the unit root properties of electricity data—A general note on time-domain applications (2023) — link
  59. Incorporating air temperature into mid-term electricity load forecasting models using time-series regressions and neural networks (2023) — link
  60. Forecasting and Analytics with the Augmented Dynamic Adaptive Model (ADAM) (2023) — link
  61. Using weather data in energy time series forecasting: the benefit of input data transformations (2023) — link
  62. Carbon Monitor Power-Simulators (CMP-SIM v1.0) across countries: a data-driven approach to simulate daily power generation (2024) — link
  63. Influence of population mobility on electricity consumption in seven U.S. cities during the COVID-19 pandemic (2024) — link

0 of 71 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.