Detection of financial opportunities in micro-blogging data with a stacked classification system

Paper: arXiv 2404.07224

Abstract

Micro-blogging sources such as the Twitter social network provide valuable real-time data for market prediction models. Investors’ opinions in this network follow the fluctuations of the stock markets and often include educated speculations on market opportunities that may have impact on the actions of other investors. In view of this, we propose a novel system to detect positive predictions in tweets, a type of financial emotions which we term “opportunities” that are akin to “anticipation” in Plutchik’s theory. Specifically, we seek a high detection precision to present a financial operator a substantial amount of such tweets while differentiating them from the rest of financial emotions in our system. We achieve it with a three-layer stacked Machine Learning classification system with sophisticated features that result from applying Natural Language Processing techniques to extract valuable linguistic information. Experimental results on a dataset that has been manually annotated with financial emotion and ticker occurrence tags demonstrate that our system yields satisfactory and competitive performance in financial opportunity detection, with precision values up to 83%. This promising outcome endorses the usability of our system to support investors’ decision making.

Complexity vs Empirical Score

• Math Complexity: 3.5/10
• Empirical Rigor: 7.0/10
• Quadrant: Street Traders — practical and empirical, lighter on theory

Why this score: The paper uses standard ML/NLP techniques without advanced mathematical derivations, but employs a structured empirical approach with a manually annotated dataset, feature engineering, and precision metrics (up to 83%), making it data-driven and practical for trading applications.

Research Flowchart

  flowchart TD
  A["Research Goal<br>Detect 'Opportunities'<br>in Financial Tweets"] --> B["Data<br>Manually Annotated Dataset<br>Tweets w/ Emotion & Ticker Tags"]
  B --> C["Feature Engineering<br>Linguistic & Semantic Feature Extraction"]
  C --> D["Stacked ML System<br>Three-Layer Classification Architecture"]
  D --> E["Experimental Evaluation<br>Performance Testing"]
  E --> F{"Key Findings & Outcomes"}
  F --> G["Precision up to 83%<br>High Detection Specificity"]
  F --> H["System Usability<br>Supports Investor Decision Making"]

Cited References (75)

1. The circumplex as a general model of the structure of emotions and personality. (2004) — link
2. Using Deep Convolutional Neural Network for Emotion Detection on a Physiological Signals Dataset (AMIGOS) (2019) — link
3. Unravelling Small Sample Size Problems in the Deep Learning World (2020) — link
4. EmoNet: Fine-Grained Emotion Detection with Gated Recurrent Neural Networks (2017) — link
5. Sequence classification for credit-card fraud detection (2018) — link
6. A linked data approach to sentiment and emotion analysis of Twitter in the financial domain (2014)
7. How emotions influence behavior in financial markets: a conceptual analysis and emotion-based account of buy-sell preferences (2020) — link
8. The role of emotion in P2P microfinance funding: A sentiment analysis approach (2020) — link

0 of 75 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.