Paper: arXiv 2410.17266

Abstract

Stock portfolios are often exposed to rare consequential events (e.g., 2007 global financial crisis, 2020 COVID-19 stock market crash), as they do not have enough historical information to learn from. Large Language Models (LLMs) now present a possible tool to tackle this problem, as they can generalize across their large corpus of training data and perform zero-shot reasoning on new events, allowing them to detect possible portfolio crash events without requiring specific training data. However, detecting portfolio crashes is a complex problem that requires more than reasoning abilities. Investors need to dynamically process the impact of each new piece of information found in news articles, analyze the relational network of impacts across different events and portfolio stocks, as well as understand the temporal context between impacts across time-steps, in order to obtain the aggregated impact on the target portfolio. In this work, we propose an algorithmic framework named Temporal Relational Reasoning (TRR). It seeks to emulate the spectrum of human cognitive capabilities used for complex problem-solving, which include brainstorming, memory, attention and reasoning. Through extensive experiments, we show that TRR is able to outperform state-of-the-art techniques on detecting stock portfolio crashes, and demonstrate how each of the proposed components help to contribute to its performance through an ablation study. Additionally, we further explore the possible applications of TRR by extending it to other related complex problems, such as the detection of possible global crisis events in Macroeconomics.

Complexity vs Empirical Score

  • Math Complexity: 5.0/10
  • Empirical Rigor: 7.5/10
  • Quadrant: Holy Grail — high math complexity, high empirical rigor

Why this score: The paper involves complex graph algorithms (PageRank, temporal graph reasoning) and advanced LLM prompting techniques, indicating moderate-to-high mathematical and algorithmic complexity. It demonstrates strong empirical rigor through extensive experiments, ablation studies, and comparisons against state-of-the-art models across multiple time periods and portfolios, though it lacks explicit code/data disclosure or statistical metrics.

Research Flowchart

  flowchart TD
  A["Research Goal:<br>Detect Stock Portfolio Crashes<br>using LLMs without specific training"] --> B["Core Methodology:<br>Temporal Relational Reasoning TRR Framework"];
  B --> C{"Inputs"};
  C --> C1["Portfolio Constituents"];
  C --> C2["News Feeds / Events"];
  C --> C3["Historical Context"];
  C --> D["Computational Process:<br>Dynamic Impact Processing"];
  D --> E["Temporal Analysis:<br>Impacts across time-steps"];
  E --> F["Relational Analysis:<br>Network of impacts across events/stocks"];
  F --> G["LLM Zero-Shot Reasoning:<br>Emulating human cognition<br>Attention & Memory"];
  G --> H["Key Outcomes"];
  H --> H1["High Accuracy<br>Portfolio Crash Detection"];
  H --> H2["State-of-the-art<br>Performance"];
  H --> H3["Generalizability<br>e.g., Macro-Economic Crises"];

Cited References (86)

  1. Diffusion Variational Autoencoder for Tackling Stochasticity in Multi-Step Regression Stock Price Prediction — → 2309.00073
  2. Learning to Generate Explainable Stock Predictions using Self-Reflective Large Language Models — → 2402.03659
  3. Portfolio Selection (1952) — link
  4. Building diversified portfolios that outperform out of sample (2016)
  5. The Black Swan: The Impact of the Highly Improbable (2007) — link
  6. Global governance and systemic risk in the 21st century: Lessons from the financial crisis (2010)
  7. COVID-19 pandemic and connectedness across financial markets (2021)
  8. Large language models are zero-shot reasoners (2022)
and 78 more
  1. Chain-of-thought prompting elicits reasoning in large language models (2022)
  2. Tree of thoughts: Deliberate problem solving with large language models (2024)
  3. Graph of thoughts: Solving elaborate problems with large language models (2024)
  4. Think-on-graph: Deep and responsible reasoning of large language model with knowledge graph (2024)
  5. Knowledge-augmented language model prompting for zero-shot knowledge graph question answering (2023) — link
  6. StructGPT: A General Framework for Large Language Model to Reason over Structured Data (2023)
  7. Report on a general problem solving program (1959)
  8. Modeling Event Implications via Multi-faceted Entity Representations (2022)
  9. On the binding problem in artificial neural networks (2020) — link
  10. Listening to chaotic whispers: A deep learning framework for news-oriented stock trend prediction (2018)
  11. Stock movement prediction from tweets and historical prices (2018)
  12. LLM4DyG: Can Large Language Models Solve Spatial-Temporal Problems on Dynamic Graphs? (2024)
  13. Large Language Models Can Learn Temporal Reasoning (2024)
  14. Memorybank: Enhancing large language models with long-term memory (2024)
  15. The pagerank citation ranking: Bringing order to the web (1999)
  16. The fading affect bias: But what the hell is it for? (2009)
  17. Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition (2000)
  18. Funding liquidity, market liquidity and TED spread: A two-regime model (2017)
  19. Deep learning for event-driven stock prediction (2015)
  20. Syntactic processing using the generalized perceptron and beam search (2011)
  21. Knowledge-driven event embedding for stock prediction (2016)
  22. Freebase: a collaboratively created graph database for structuring human knowledge (2008)
  23. Wikidata: a free collaborative knowledgebase (2014)
  24. ChatGPT informed graph neural network for stock movement prediction — → 2306.03763
  25. Harnessing the power of llms in practice: A survey on chatgpt and beyond (2023)
  26. Language models are few-shot learners (2020)
  27. Limited investor attention and biased reactions to information: Evidence from the COVID-19 pandemic (2023)
  28. Limited investor attention and stock market misreactions to accounting information (2011)
  29. On collective memory (2020)
  30. Studying how the past is remembered: towards computational history through large scale text mining (2011)
  31. "U ber das ged "a chtnis: untersuchungen zur experimentellen psychologie (1885)
  32. Patterns of temporal variation in online media (2011)
  33. Accelerating dynamics of collective attention (2019)
  34. The universal decay of collective memory and attention (2019)
  35. Forecasting sales by exponentially weighted moving averages (1960)
  36. RiskMetrics: Technical Document (1996) — link
  37. Weighted pagerank algorithm (2004)
  38. Interconnectedness risk and active portfolio management (2017)
  39. Making large language models perform better in knowledge graph completion (2023) — link
  40. Back to the future: Towards explainable temporal reasoning with large language models (2024)
  41. Using structured events to predict stock price movement: An empirical investigation (2014)
  42. Temporal relational ranking for stock prediction (2019)
  43. Deep attentive learning for stock movement prediction from social media text and company correlations (2020)
  44. Knowledge graph-based event embedding framework for financial quantitative investments (2020)
  45. Modeling extreme events in time series prediction (2019)
  46. Country and Sector Bets: Should They Be Neutralized in Global Factor Portfolios? (2019)
  47. International momentum strategies (1998)
  48. Sparse index tracking portfolio with sector neutrality (2022)
  49. Extreme value at risk and expected shortfall during financial crisis (2010)
  50. A survey on performance metrics for object-detection algorithms (2020)
  51. Using deep-learning algorithms to simultaneously identify right and left ventricular dysfunction from the electrocardiogram (2022)
  52. Patterns of panic: Financial crisis language in historical newspapers (2018)
  53. Coordinated bubbles and crashes (2020)
  54. Extracting model-free volatility from option prices: An examination of the VIX index (2007)
  55. Recovering expectations of consumption growth from an equilibrium model of the term structure of interest rates (1986)
  56. Timeline of a financial crisis: Introduction to the special issue (2014)
  57. Lessons from the Greek crisis (2016)
  58. The interactions between COVID-19 cases in the USA, the VIX index and major stock markets (2021)
  59. Which popular predictor is more useful to forecast international stock markets during the coronavirus pandemic: VIX vs EPU? (2020)
  60. Chatdb: Augmenting llms with databases as their symbolic memory (2023) — link
  61. Self-supervised graph learning for recommendation (2021)
  62. Macrofinancial history and the new business cycle facts (2017)
  63. When is a liability not a liability? Textual analysis, dictionaries, and 10-Ks (2011)
  64. The investor fear gauge (2000)
  65. Understanding the VIX (2009)
  66. The unprecedented stock market reaction to COVID-19 (2020)
  67. On single point forecasts for fat-tailed variables (2022)
  68. Scaling in financial prices: I. Tails and dependence (2001)
  69. Structured, Complex and Time-complete Temporal Event Forecasting (2023) — link
  70. On the dangers of stochastic parrots: Can language models be too big? (2021)
  71. Leading indicators of crisis incidence: Evidence from developed countries (2013)
  72. Value-at-risk and market crashes (2000)
  73. Crash aversion and the cross-section of expected stock returns worldwide (2016)
  74. Enhancing Financial Market Predictions: Causality-Driven Feature Selection (2024) — link
  75. On calibration of modern neural networks (2017)
  76. FinBERT: Financial Sentiment Analysis with Pre-trained Language Models (2019) — link
  77. Optimal versus naive diversification: How inefficient is the 1/N portfolio strategy? (2009)
  78. GPT-3.5-turbo — OpenAI Platform Documentation (2023)

3 of 86 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.