Paper: arXiv 2311.10756
Abstract
Firm disclosures about future prospects are crucial for corporate valuation and compliance with global regulations, such as the EU’s MAR and the US’s SEC Rule 10b-5 and RegFD. To comply with disclosure obligations, issuers must identify nonpublic information with potential material impact on security prices as only new, relevant and unexpected information materially affects prices in efficient markets. Financial analysts, assumed to represent public knowledge on firms’ earnings prospects, face limitations in offering comprehensive coverage and unbiased estimates. This study develops a neural network to forecast future firm earnings, using four decades of financial data, addressing analysts’ coverage gaps and potentially revealing hidden insights. The model avoids selectivity and survivorship biases as it allows for missing data. Furthermore, the model is able to produce both fiscal-year-end and quarterly earnings predictions. Its performance surpasses benchmark models from the academic literature by a wide margin and outperforms analysts’ forecasts for fiscal-year-end earnings predictions.
Complexity vs Empirical Score
- Math Complexity: 7.5/10
- Empirical Rigor: 7.0/10
- Quadrant: Holy Grail — high math complexity, high empirical rigor
Why this score: The paper uses advanced recurrent neural networks (RNN/LSTM) with detailed architecture specifications and statistical evaluation metrics, indicating high mathematical complexity; it also employs a large-scale dataset spanning four decades, handles missing data to avoid biases, and provides rigorous out-of-sample testing with multiple benchmarks, showing high empirical rigor.
Research Flowchart
flowchart TD
A["Research Goal: Predict Future Firm Earnings"] --> B["Methodology: Recurrent Neural Network Model"]
B --> C["Data: Four Decades of Financial Data"]
C --> D["Process: Training RNN with Missing Data Handling"]
D --> E{"Evaluate Predictions"}
E --> F["Outcome: Predictions Surpass Academic Benchmarks"]
E --> G["Outcome: Outperforms Analyst Forecasts for Fiscal-Year-End"]
Cited References (139)
- Batch normalization: Accelerating deep network training by reducing internal covariate shift (2015)
- Cumulated gain-based evaluation of IR techniques (2002)
- Decoupled weight decay regularization (2017)
- MosaicBERT: How to Train BERT with a Lunch Money Budget (2023)
- Asynchronous pipeline for processing huge corpora on medium to low resource infrastructures (2019)
- GermanQuAD and GermanDPR: Improving non-English question answering and passage retrieval (2021)
- ChatGPT (2023)
- One million posts: A data set of german online discussions (2017)
and 131 more
- Gottbert: a pure german language model (2020)
- Fine-grained classification of offensive language (2018)
- Finbert: pre-trained model on sec filings for financial natural language tasks (2019)
- German’s next language model (2020)
- Flaubert: Unsupervised language model pre-training for french (2019) — link
- CamemBERT: a tasty French language model (2019)
- Bertje: A dutch bert model (2019) — link
- GLUE: A multi-task benchmark and analysis platform for natural language understanding (2018)
- The Effects of In-domain Corpus Size on pre-training BERT (2022)
- Publicly available clinical BERT embeddings (2019)
- Domain-specific language model pretraining for biomedical natural language processing (2021)
- exBERT: Extending pre-trained models with domain-specific vocabulary under constrained training resources (2020)
- Cost-effective selection of pretraining data: A case study of pretraining BERT on social media (2020)
- FiNER: Financial numeric entity recognition for XBRL tagging (2022)
- Finbert: A pretrained language model for financial communications (2020)
- LEGAL-BERT: The muppets straight out of law school (2020)
- Clinicalbert: Modeling clinical notes and predicting hospital readmission (2019)
- BioBERT: a pre-trained biomedical language representation model for biomedical text mining (2020)
- SciBERT: A pretrained language model for scientific text (2019)
- Language models are few-shot learners (2020)
- Xlnet: Generalized autoregressive pretraining for language understanding (2019)
- Universal language model fine-tuning for text classification (2018) — link
- Sentence-bert: Sentence embeddings using siamese bert-networks (2019) — link
- Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillation (2020) — link
- Bert: Pre-training of deep bidirectional transformers for language understanding (2018)
- Roberta: A robustly optimized bert pretraining approach (2019)
- Attention is all you need (2017)
- A large annotated corpus for learning natural language inference (2015) — link
- A broad-coverage challenge corpus for sentence understanding through inference (2017) — link
- Task-oriented intrinsic evaluation of semantic textual similarity (2016)
- Universal sentence encoder (2018) — link
- Supervised learning of universal sentence representations from natural language inference data (2017) — link
- Learning distributed representations of sentences from unlabelled data (2016) — link
- Distributed representations of words and phrases and their compositionality (2013)
- Glove: Global vectors for word representation (2014)
- Enriching word vectors with subword information (2017)
- Bag of tricks for efficient text classification (2016)
- Skip-thought vectors (2015)
- Distributed representations of sentences and documents (2014)
- Fine-tune BERT for extractive summarization (2019) — link
- From image descriptions to visual denotations: New similarity metrics for semantic inference over event descriptions (2014)
- Semeval-2017 task 1: Semantic textual similarity-multilingual and cross-lingual focused evaluation (2017) — link
- Learning distributed representations of sentences from unlabelled data (2016) — link
- Long short-term memory (1997)
- Learning phrase representations using RNN encoder-decoder for statistical machine translation (2014)
- Learning natural language inference using bidirectional LSTM model and inner-attention (2016) — link
- A structured self-attentive sentence embedding (2017) — link
- Self-adaptive hierarchical sentence model (2015) — link
- Deep unordered composition rivals syntactic methods for text classification (2015)
- Unsupervised cross-lingual representation learning at scale (2019) — link
- Wikimatrix: Mining 135m parallel sentences in 1620 language pairs from wikipedia (2019) — link
- Europarl: A parallel corpus for statistical machine translation (2005)
- JW300: A wide-coverage parallel corpus for low-resource languages (2019)
- Opensubtitles2016: Extracting large parallel corpora from movie and tv subtitles (2016)
- Good debt or bad debt: Detecting semantic orientations in economic texts (2014)
- Semeval-2017 task 5: Fine-grained sentiment analysis on financial microblogs and news (2017)
- Massively multilingual sentence embeddings for zero-shot cross-lingual transfer and beyond (2019)
- Margin-based parallel corpus mining with multilingual sentence embeddings (2018) — link
- Unsupervised data augmentation for consistency training (2019) — link
- Eda: Easy data augmentation techniques for boosting performance on text classification tasks (2019) — link
- The adjustment of stock prices to new information (1969)
- Efficient capital markets: A review of theory and empirical work (1970)
- After-hours stock prices and post-crash hangovers (1991)
- Price discovery and the international flow of information (2002)
- Liquidity provision and specialist trading in NYSE-listed non-US stocks (2002)
- Price discovery and trading after hours (2003)
- Liquidity externalities and adverse selection: Evidence from trading after hours (2004)
- Internationally cross-listed stock prices during overlapping trading hours: price discovery and exchange rate effects (2005)
- Arbitrage opportunities in the depositary receipts market: Myth or reality? (2005)
- Price determinants of American Depositary Receipts (ADR): a cross-sectional analysis of panel data (2006)
- Cross-listing, price discovery and the informativeness of the trading process (2006)
- Modeling around-the-clock price discovery for cross-listed stocks using state space methods (2007)
- The choice of trading venue and relative price impact of institutional trading: ADRs versus the underlying securities in their local markets (2011)
- Information content of earnings announcements: Evidence from after-hours trading (2012)
- One security, many markets: Determining the contributions to price discovery (1995)
- Intraday stock price effects of ad hoc disclosures: the German case (2007)
- The intraday speed of adjustment of stock prices to earnings and dividend announcements (1984)
- Intradaily price-volume adjustments of NYSE stocks to unexpected earnings (1988)
- Announcement effects of new equity issues and the use of intraday price data (1988)
- Information content and the speed of stock price adjustment (1985)
- Intraday volatility and trading volume after takeover announcements (1997)
- Volume, volatility, and New York stock exchange trading halts (1994)
- Investor reaction to financial disclosures across topics: An application of latent Dirichlet allocation (2018)
- Latent dirichlet allocation (2003)
- Which news moves stock prices? A textual analysis (2013)
- Market reaction to corporate press releases (2013)
- Disclosure timing, information asymmetry, and stock returns: Evidence from 8-K filing texts (2015)
- Aligning books and movies: Towards story-like visual explanations by watching movies and reading books (2015)
- Robust measures of earnings surprises (2019)
- Glue: A multi-task benchmark and analysis platform for natural language understanding (2018)
- Know what you don’t know: Unanswerable questions for SQuAD (2018)
- When is a liability not a liability? Textual analysis, dictionaries, and 10-Ks (2011)
- Single Firm/Single Event-Analyses: Robust Inference in Litigation (2019)
- Adam: A method for stochastic optimization (2014)
- A re-examination of analysts’ superiority over time-series forecasts of annual earnings (2012)
- Forecasting profitability and earnings (2000)
- The implied cost of capital: A new approach (2012)
- Evaluating cross-sectional forecasting models for implied cost of capital (2014)
- Incorporating Quarterly Earnings Information into Cross-Sectional Earnings Forecast Models (2019)
- Earnings forecasts: the case for combining analysts estimates with a cross-sectional model (2021)
- Dividend policy, growth, and the valuation of shares (1961)
- Why do accruals predict earnings? (2019)
- A systematic analysis of performance measures for classification tasks (2009)
- Capital markets research in accounting (2001)
- Automated earnings forecasts: Beat analysts or combine and conquer? (2018)
- Uncertainty resolution and the theory of depreciation measurement (1996)
- Earnings Prediction with Deep Leaning (2020)
- Individual comparisons by ranking methods (1992)
- On a test of whether one of two random variables is stochastically larger than the other (1947)
- Good debt or bad debt: Detecting semantic orientations in economic texts (2014)
- Gold-standard for topic-specific sentiment analysis of economic texts (2014)
- Semeval-2017 task 5: Fine-grained sentiment analysis on financial microblogs and news (2017)
- SEntFiN 1.0: Entity-aware sentiment analysis for financial news (2022)
- Finqa: A dataset of numerical reasoning over financial data (2021)
- FiNER: Financial Numeric Entity Recognition for XBRL Tagging (2022)
- Measuring nominal scale agreement among many raters. (1971)
- A coefficient of agreement for nominal scales (1960)
- An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers (1977)
- Some simple effective approximations to the 2-poisson model for probabilistic weighted retrieval (1994)
- Market reaction to corporate press releases (2013)
- Which news moves stock prices? A textual analysis (2013)
- Analysis of how underlying topics in financial news affect stock prices using latent dirichlet allocation (2016)
- Do US stock markets typically overreact to corporate news stories? (2006)
- Investor reaction to financial disclosures across topics: An application of latent Dirichlet allocation (2021)
- Latent dirichlet allocation (2003)
- Measuring LDA topic stability from clusters of replicated runs (2018)
- Deep contextualized word representations. arXiv 2018 (2018) — link
- Super-convergence: Very fast training of neural networks using large learning rates (2019)
- Cyclical learning rates for training neural networks (2017)
- Do analysts’ earnings forecasts incorporate information in prior stock price changes? (1991)
- Analysts’ forecasts as earnings expectations (1988)
0 of 139 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.