Paper: arXiv 2411.03402

Abstract

Corporate Greenhouse Gas (GHG) emission targets are important metrics in sustainable investing [“12, 16”]. To provide a comprehensive view of company emission objectives, we propose an approach to source these metrics from company public disclosures. Without automation, curating these metrics manually is a labor-intensive process that requires combing through lengthy corporate sustainability disclosures that often do not follow a standard format. Furthermore, the resulting dataset needs to be validated thoroughly by Subject Matter Experts (SMEs), further lengthening the time-to-market. We introduce the Climate Artificial Intelligence for Corporate Decarbonization Metrics Extraction (CAI) model and pipeline, a novel approach utilizing Large Language Models (LLMs) to extract and validate linked metrics from corporate disclosures. We demonstrate that the process improves data collection efficiency and accuracy by automating data curation, validation, and metric scoring from public corporate disclosures. We further show that our results are agnostic to the choice of LLMs. This framework can be applied broadly to information extraction from textual data.

Complexity vs Empirical Score

  • Math Complexity: 3.0/10
  • Empirical Rigor: 7.5/10
  • Quadrant: Street Traders — practical and empirical, lighter on theory

Why this score: The paper focuses on practical NLP pipeline implementation and business process automation rather than theoretical finance, with some reported accuracy metrics and model comparison, placing it in the Street Traders quadrant.

Research Flowchart

  flowchart TD
  A["<b>Research Goal</b><br/>Automate extraction of corporate<br/>decarbonization metrics from disclosures"] --> B["<b>Data Input</b><br/>Corporate Sustainability<br/>Disclosures (Text)"]
  B --> C["<b>LLM Pipeline</b><br/>Climate AI CAI Model"]
  C --> D["<b>Extraction Process</b><br/>1. Locate emission targets<br/>2. Extract linked metrics<br/>3. Validate data"]
  D --> E["<b>Validation</b><br/>Subject Matter Expert<br/>SME Review & Comparison"]
  E --> F{"<b>Key Findings</b>"}
  F --> G["<b>Outcome 1</b><br/>Improved data collection<br/>efficiency & accuracy"]
  F --> H["<b>Outcome 2</b><br/>Model agnostic to<br/>choice of LLM"]
  F --> I["<b>Outcome 3</b><br/>Scalable framework for<br/>textual information extraction"]

Cited References (35)

  1. Lost in the Middle: How Language Models Use Long Contexts (2023) — link
  2. Managing carbon aspirations: The influence of corporate climate change targets on environmental performance (2019)
  3. Aligning corporate greenhouse-gas emissions targets with climate goals (2015)
  4. How to Prompt? Opportunities and Challenges of Zero- and Few-Shot Learning for Human-AI Interaction in Creative Applications of Generative Models (2022) — link
  5. Glitter or Gold? Deriving Structured Insights from Sustainability Reports via Large Language Models (2024) — link
  6. ClimateBERT-NetZero: Detecting and Assessing Net Zero and Reduction Targets (2023) — link
  7. Pareto Optimal Learning for Estimating Large Language Model Errors (2024) — link
  8. Selective Annotation Makes Language Models Better Few-Shot Learners (2022) — link
and 27 more
  1. System 2 Attention (is something you might need too) (2023) — link
  2. Retrieval-Augmented Generation for Large Language Models: A Survey (2024) — link
  3. RoBERTa: A Robustly Optimized BERT Pretraining Approach (2019) — link
  4. ESGReveal: An LLM-based approach for extracting structured data from ESG reports (2023) — link
  5. Hallucination is Inevitable: An Innate Limitation of Large Language Models (2024) — link
  6. The Mann-Whitney U: A Test for Assessing Whether Two Independent Samples Come from the Same Distribution (2008) — link
  7. Parent Document Retriever (2023) — link
  8. The Transformer model family (2023) — link
  9. Autoregressive models (2023) — link
  10. What Are Autoregressive Models? How They Work and Example (2022) — link
  11. SBTi CORPORATE NEAR-TERM CRITERIA (2024) — link
  12. SBTi Criteria and Recommendations (2021) — link
  13. An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuning (2024) — link
  14. Attention Is All You Need (2023) — link
  15. Methodology: Developing an investible universe of climate adaptation and resilience companies (2023) — link
  16. ChatClimate (2023) — link
  17. PaLM 2 Technical Report (2023) — link
  18. ClimateQ&A: Bridging the gap between climate scientists and the general public (2024) — link
  19. Learning to Extract Structured Entities Using Language Models (2024) — link
  20. Information extraction meets the semantic web: a survey. Semantic Web (2020) — link
  21. ClimateBert: A Pretrained Language Model for Climate-Related Text (2022) — link
  22. Assessing the quality of information extraction (2024) — link
  23. Project Gaia: Enabling climate risk analysis using generative AI (2024) — link
  24. Limitations of information extraction methods and techniques forheterogeneous unstructured big data (2019) — link
  25. Challenges in information extraction from text for knowledge management (2001)
  26. Systematic Literature Review of Information Extraction From Textual Data: Recent Methods, Applications, Trends, and Challenges (2023) — link
  27. CHATREPORT: Democratizing Sustainability Disclosure Analysis through LLM-based Tools (2023) — link

0 of 35 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.