Paper: arXiv 2411.03402
Abstract
Corporate Greenhouse Gas (GHG) emission targets are important metrics in sustainable investing [“12, 16”]. To provide a comprehensive view of company emission objectives, we propose an approach to source these metrics from company public disclosures. Without automation, curating these metrics manually is a labor-intensive process that requires combing through lengthy corporate sustainability disclosures that often do not follow a standard format. Furthermore, the resulting dataset needs to be validated thoroughly by Subject Matter Experts (SMEs), further lengthening the time-to-market. We introduce the Climate Artificial Intelligence for Corporate Decarbonization Metrics Extraction (CAI) model and pipeline, a novel approach utilizing Large Language Models (LLMs) to extract and validate linked metrics from corporate disclosures. We demonstrate that the process improves data collection efficiency and accuracy by automating data curation, validation, and metric scoring from public corporate disclosures. We further show that our results are agnostic to the choice of LLMs. This framework can be applied broadly to information extraction from textual data.
Complexity vs Empirical Score
- Math Complexity: 3.0/10
- Empirical Rigor: 7.5/10
- Quadrant: Street Traders — practical and empirical, lighter on theory
Why this score: The paper focuses on practical NLP pipeline implementation and business process automation rather than theoretical finance, with some reported accuracy metrics and model comparison, placing it in the Street Traders quadrant.
Research Flowchart
flowchart TD
A["<b>Research Goal</b><br/>Automate extraction of corporate<br/>decarbonization metrics from disclosures"] --> B["<b>Data Input</b><br/>Corporate Sustainability<br/>Disclosures (Text)"]
B --> C["<b>LLM Pipeline</b><br/>Climate AI CAI Model"]
C --> D["<b>Extraction Process</b><br/>1. Locate emission targets<br/>2. Extract linked metrics<br/>3. Validate data"]
D --> E["<b>Validation</b><br/>Subject Matter Expert<br/>SME Review & Comparison"]
E --> F{"<b>Key Findings</b>"}
F --> G["<b>Outcome 1</b><br/>Improved data collection<br/>efficiency & accuracy"]
F --> H["<b>Outcome 2</b><br/>Model agnostic to<br/>choice of LLM"]
F --> I["<b>Outcome 3</b><br/>Scalable framework for<br/>textual information extraction"]
Cited References (35)
- Lost in the Middle: How Language Models Use Long Contexts (2023) — link
- Managing carbon aspirations: The influence of corporate climate change targets on environmental performance (2019)
- Aligning corporate greenhouse-gas emissions targets with climate goals (2015)
- How to Prompt? Opportunities and Challenges of Zero- and Few-Shot Learning for Human-AI Interaction in Creative Applications of Generative Models (2022) — link
- Glitter or Gold? Deriving Structured Insights from Sustainability Reports via Large Language Models (2024) — link
- ClimateBERT-NetZero: Detecting and Assessing Net Zero and Reduction Targets (2023) — link
- Pareto Optimal Learning for Estimating Large Language Model Errors (2024) — link
- Selective Annotation Makes Language Models Better Few-Shot Learners (2022) — link
and 27 more
- System 2 Attention (is something you might need too) (2023) — link
- Retrieval-Augmented Generation for Large Language Models: A Survey (2024) — link
- RoBERTa: A Robustly Optimized BERT Pretraining Approach (2019) — link
- ESGReveal: An LLM-based approach for extracting structured data from ESG reports (2023) — link
- Hallucination is Inevitable: An Innate Limitation of Large Language Models (2024) — link
- The Mann-Whitney U: A Test for Assessing Whether Two Independent Samples Come from the Same Distribution (2008) — link
- Parent Document Retriever (2023) — link
- The Transformer model family (2023) — link
- Autoregressive models (2023) — link
- What Are Autoregressive Models? How They Work and Example (2022) — link
- SBTi CORPORATE NEAR-TERM CRITERIA (2024) — link
- SBTi Criteria and Recommendations (2021) — link
- An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuning (2024) — link
- Attention Is All You Need (2023) — link
- Methodology: Developing an investible universe of climate adaptation and resilience companies (2023) — link
- ChatClimate (2023) — link
- PaLM 2 Technical Report (2023) — link
- ClimateQ&A: Bridging the gap between climate scientists and the general public (2024) — link
- Learning to Extract Structured Entities Using Language Models (2024) — link
- Information extraction meets the semantic web: a survey. Semantic Web (2020) — link
- ClimateBert: A Pretrained Language Model for Climate-Related Text (2022) — link
- Assessing the quality of information extraction (2024) — link
- Project Gaia: Enabling climate risk analysis using generative AI (2024) — link
- Limitations of information extraction methods and techniques forheterogeneous unstructured big data (2019) — link
- Challenges in information extraction from text for knowledge management (2001)
- Systematic Literature Review of Information Extraction From Textual Data: Recent Methods, Applications, Trends, and Challenges (2023) — link
- CHATREPORT: Democratizing Sustainability Disclosure Analysis through LLM-based Tools (2023) — link
0 of 35 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.