Paper: arXiv 2501.01278

Abstract

This work aims to implement Long Short-Term Memory mixture density networks (LSTM-MDNs) for Value-at-Risk forecasting and compare their performance with established models (historical simulation, CMM, and GARCH) using a defined backtesting procedure. The focus was on the neural network’s ability to capture volatility clustering and its real-world applicability. Three architectures were tested: a 2-component mixture density network, a regularized 2-component model (Arimond et al., 2020), and a 3-component mixture model, the latter being tested for the first time in Value-at-Risk forecasting. Backtesting was performed on three stock indices (FTSE 100, S&P 500, EURO STOXX 50) over two distinct two-year periods (2017-2018 as a calm period, 2021-2022 as turbulent). Model performance was assessed through unconditional coverage and independence assumption tests. The neural network’s ability to handle volatility clustering was validated via correlation analysis and graphical evaluation. Results show limited success for the neural network approach. LSTM-MDNs performed poorly for 2017/2018 but outperformed benchmark models in 2021/2022. The LSTM mechanism allowed the neural network to capture volatility clustering similarly to GARCH models. However, several issues were identified: the need for proper model initialization and reliance on large datasets for effective learning. The findings suggest that while LSTM-MDNs provide adequate risk forecasts, further research and adjustments are necessary for stable performance.

Complexity vs Empirical Score

  • Math Complexity: 5.5/10
  • Empirical Rigor: 6.0/10
  • Quadrant: Holy Grail — high math complexity, high empirical rigor

Why this score: The paper uses advanced neural network architectures (LSTM, Mixture Density Networks) and statistical backtesting frameworks, balancing mathematical theory with practical implementation on real financial data across multiple market regimes.

Research Flowchart

  flowchart TD
A["Research Goal<br>Forecast VaR using LSTM-MDNs<br>vs. Benchmarks (Hist. Sim, CMM, GARCH)"] --> B["Methodology<br>Test 3 Architectures: 2-comp, Reg-2-comp, 3-comp<br>Backtest via Unconditional Coverage & Independence"]
A --> C["Data/Inputs<br>3 Indices: FTSE 100, S&P 500, EURO STOXX 50<br>2 Periods: Calm (2017-18), Turbulent (2021-22)"]
B & C --> D["Computation<br>Train LSTM-MDNs & Benchmarks<br>Calculate VaR & Correlations"]
D --> E["Key Findings & Outcomes<br>Poor Performance (2017/2018)<br>Outperformed Benchmarks (2021/2022)<br>LSTM captured volatility clustering (like GARCH)<br>Issue: Needs large data & proper initialization"]

Cited References (92)

  1. Neural Networks and Value at risk (2020) — link
  2. Value at Risk Estimation with Neural Networks: A Recurrent Mixture Density Approach (2021)
  3. Machine learning for financial risk management: a survey (2020)
  4. Machine learning techniques for anti-money laundering (AML) solutions in suspicious transaction detection: a review (2018)
  5. Machine learning applications in healthcare sector: An overview (2022)
  6. The Present and Future of Financial Risk Management (2005) — link
  7. Basel 2.5: potential benefits and unintended consequences (2013)
  8. Good and bad uncertainty: Macroeconomic and financial market implications (2015)
and 84 more
  1. History of Value-at-Risk (2002)
  2. GARCHNet: Value-at-Risk Forecasting with GARCH Models Based on Neural Networks (2023)
  3. Value at risk models in finance (2001)
  4. Value-at-risk support vector machine: stability to outliers (2014)
  5. Encoded Value-at-Risk: A machine learning approach for portfolio risk measurement (2022)
  6. Mixture density networks (1994)
  7. The real effects of financial markets (2012)
  8. Volatility and correlation forecasting (2006)
  9. The econometrics of financial markets (1998)
  10. Volatility clustering in financial markets: empirical facts and agent-based models (2007)
  11. Characterization of financial time series (2011)
  12. Autoregressive conditional heteroscedasticity with estimates of the variance of United Kingdom inflation (1982)
  13. Generalized autoregressive conditional heteroskedasticity (1986)
  14. Evaluation of Basel III revision of quantitative standards for implementation of internal models for market risk (2012)
  15. Implementing value at risk (2000)
  16. An evaluation of the effectiveness of Value-at-Risk (VaR) models for Australian banks under Basel III (2016)
  17. A Comparison between Historical Simulation and GARCH Model for Estimating Value-at-Risk: Case of Indian Stock Exchange (2017)
  18. The level and quality of Value-at-Risk disclosure by commercial banks (2010)
  19. Stylized facts of financial time series and three popular models of volatility (2010)
  20. Modelling volatility of stock returns: Is GARCH (1, 1) enough (2014)
  21. A forecast comparison of volatility models: does anything beat a GARCH (1, 1)? (2005)
  22. Backtesting (2008)
  23. A review of backtesting and backtesting procedures (2005)
  24. Techniques for Verifying the Accuracy of Risk Measurement Models (1995)
  25. Evaluating interval forecasts (1998)
  26. Modelling naira/dollar exchange rate volatility: Application of GARCH and asymmetric models (2009)
  27. Artificial neural network (2013)
  28. The perceptron: a probabilistic model for information storage and organization in the brain. (1958)
  29. Vanilla feedforward neural networks as a discretization of dynamic systems (2022) — link
  30. Activation functions in neural networks (2017)
  31. How to Choose an Activation Function for Deep Learning (2021)
  32. How to Choose an Activation Function for Deep Learning (2021)
  33. A review on weight initialization strategies for neural networks (2022)
  34. Cme 323: Distributed algorithms and optimization, spring 2015 (2015)
  35. Adam: A method for stochastic optimization (2014) — link
  36. Why tanh: choosing a sigmoidal function (1992)
  37. A Gentle Introduction to the Rectified Linear Unit (ReLU) (2019) — link
  38. CORDIC based implementation of the softmax activation function (2020)
  39. Fast and accurate deep network learning by exponential linear units (elus) (2015) — link
  40. Parametric exponential linear unit for deep convolutional neural networks (2017)
  41. Dying relu and initialization: Theory and numerical examples (2019) — link
  42. How do mixture density RNNs predict the future? (2019) — link
  43. Gaussian mixture models. (2009)
  44. Mixture density networks for distribution and uncertainty estimation (2017)
  45. Gaussian Mixture Models Part 1: Mixture Density Networks (2020) — link
  46. Chapter 10, Sequence Modeling: Recurrent and Recursive Nets (2016)
  47. Fundamentals Of Neural Networks: Architectures, Algorithms, and Applications.., New Jersey, USA: Prenctice-Hall (1994)
  48. Generating sequences with recurrent neural networks (2013) — link
  49. Long short-term memory (1997)
  50. LSTMs Explained: A Complete, Technically Accurate, Conceptual Guide with Keras (2020) — link
  51. Understanding LSTM networks (2015) — link
  52. Towards movement generation with audio features (2020) — link
  53. Coronavirus disease (covid-19) pandemic (2023) — link
  54. Circular economy impact analysis on stock performances: an empirical comparison with the euro stoxx 50 \textregistered ESG index (2022)
  55. Trust and stock market volatility during the COVID-19 crisis (2021)
  56. Deep learning (2016)
  57. Effects of hidden layers on the efficiency of neural networks (2020)
  58. Empirical asset pricing via machine learning (2020)
  59. On the optimal number of hidden nodes in a neural network (1998)
  60. Components of bull and bear markets: bull corrections and bear rallies (2012)
  61. Regime switching in stock market returns (1997)
  62. Clustering financial time series: New insights from an extended hidden Markov model (2015)
  63. The loss surfaces of multilayer networks (2015)
  64. On the saddle point problem for non-convex optimization (2014) — link
  65. Second-order optimization for non-convex machine learning: An empirical study (2020)
  66. An empirical analysis of data requirements for financial forecasting with neural networks (2001)
  67. Understanding the role of nonlinearity in training dynamics of contrastive learning (2022) — link
  68. On weight initialization in deep neural networks (2017) — link
  69. All you need is a good init (2015) — link
  70. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification (2015)
  71. Understanding the difficulty of training deep feedforward neural networks (2010)
  72. Financial Time Series Data Augmentation with Generative Adversarial Networks and extended Intertemporal Return Plots (2022) — link
  73. Evaluating data augmentation for financial time series classification (2020) — link
  74. Street View - Estimating Global Investor Views with Reverse Optimization (2020) — link
  75. Quantitative risk management: concepts, techniques and tools-revised edition (2015)
  76. Estimating value at risk: LSTM vs. GARCH (2022) — link
  77. Efficient Monte Carlo methods for value-at-risk (2000)
  78. Small sample size effects in statistical pattern recognition: Recommendations for practitioners (1991)
  79. R: A Language and Environment for Statistical Computing (2021) — link
  80. tseries: Time Series Analysis and Computational Finance (2020) — link
  81. Rmetrics - Autoregressive Conditional Heteroskedastic Modelling (2022) — link
  82. Python 3 Reference Manual (2009)
  83. Keras (2015) — link
  84. TensorFlow : Large-Scale Machine Learning on Heterogeneous Systems (2015) — link

0 of 92 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.