Paper: arXiv 2510.15993

Authors: Fernando Spadea, Oshani Seneviratne

Abstract

Most financial recommendation systems often fail to account for key behavioral and regulatory factors, leading to advice that is misaligned with user preferences, difficult to interpret, or unlikely to be followed. We present FLARKO (Financial Language-model for Asset Recommendation with Knowledge-graph Optimization), a novel framework that integrates Large Language Models (LLMs), Knowledge Graphs (KGs), and Kahneman-Tversky Optimization (KTO) to generate asset recommendations that are both profitable and behaviorally aligned. FLARKO encodes users’ transaction histories and asset trends as structured KGs, providing interpretable and controllable context for the LLM. To demonstrate the adaptability of our approach, we develop and evaluate both a centralized architecture (CenFLARKO) and a federated variant (FedFLARKO). To our knowledge, this is the first demonstration of combining KTO for fine-tuning of LLMs for financial asset recommendation. We also present the first use of structured KGs to ground LLM reasoning over behavioral financial data in a federated learning (FL) setting. Evaluated on the FAR-Trans dataset, FLARKO consistently outperforms state-of-the-art recommendation baselines on behavioral alignment and joint profitability, while remaining interpretable and resource-efficient.

Complexity vs Empirical Score

  • Math Complexity: 5.5/10
  • Empirical Rigor: 7.0/10
  • Quadrant: Holy Grail — high math complexity, high empirical rigor

Why this score: The paper combines advanced concepts (KTO, knowledge graphs, federated learning, LLM fine-tuning) with substantial empirical evaluation on a specific dataset, clear performance metrics, and multi-model comparisons.

Research Flowchart

  flowchart TD
  A["Research Goal"] --> B["Develop FLARKO Framework"]
  B --> C["Input Data"]
  C --> D["KG & LLM Integration"]
  D --> E["Apply KTO for Alignment"]
  E --> F["Centralized vs. Federated"]
  F --> G["Key Outcomes & Findings"]
  
  subgraph C ["Input Data"]
      C1["FAR-Trans Dataset"]
      C2["User Transaction History"]
      C3["Asset Trends"]
  end
  
  subgraph G ["Outcomes"]
      G1["Superior Behavioral Alignment"]
      G2["Joint Profitability"]
      G3["Interpretable Recommendations"]
      G4["Resource Efficient"]
  end

Cited References (104)

  1. Federated fine-tuning of large language models: Kahneman-Tversky vs. direct preference optimization (2025)
  2. Bursting the Filter Bubble with Knowledge Graph Inversion (2025)
  3. Avoiding Over-Personalization with Rule-Guided Knowledge Graph Adaptation for LLM Recommendations (2025) — link
  4. On the opportunities and risks of foundation models (2021) — link
  5. Universal language model fine-tuning for text classification (2018) — link
  6. Federated multi-task learning (2017)
  7. Advances and open problems in federated learning (2021)
  8. Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervision (2023)
and 96 more
  1. Illustrating Reinforcement Learning from Human Feedback (RLHF) (2022)
  2. Last Layer Re-Training is Sufficient for Robustness to Spurious Correlations (2022)
  3. Policy shaping: Integrating human feedback with reinforcement learning (2013)
  4. Direct preference optimization: your language model is secretly a reward model (2023)
  5. LLaMA: Open and Efficient Foundation Language Models (2023)
  6. Language models are few-shot learners (2020)
  7. What Would Elsa Do? Freezing Layers During Transformer Fine-Tuning (2019)
  8. Parameter-efficient fine-tuning of large-scale pre-trained language models (2023)
  9. L o RA +: Efficient Low Rank Adaptation of Large Models (2024) — link
  10. KTO: Model Alignment as Prospect Theoretic Optimization (2024)
  11. Improving Weak-to-Strong Generalization with Scalable Oversight and Ensemble Learning (2024)
  12. Empirical Analysis of the Strengths and Weaknesses of PEFT Techniques for LLMs (2023)
  13. WRENCH: A Comprehensive Benchmark for Weak Supervision (2021)
  14. Deep reinforcement learning from human preferences (2017)
  15. Fine-Tuning Language Models from Human Preferences (2019)
  16. Sequence tutor: Conservative fine-tuning of sequence generation models with kl-control (2017)
  17. Direct preference optimization (DPO) (2023) — link
  18. Freezing layers of your deep learning model - the proper way of doing it (2023) — link
  19. BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models (2022)
  20. Compacter: Efficient low-rank hypercomplex adapter layers (2021)
  21. Openfedllm: Training large language models on decentralized private data via federated learning (2024)
  22. FedLLM-Bench: Realistic Benchmarks for Federated Learning of Large Language Models (2024) — link
  23. Universal and transferable adversarial attacks on aligned language models (2023) — link
  24. Judging llm-as-a-judge with mt-bench and chatbot arena (2023)
  25. Vicuna: An open-source chatbot impressing gpt-4 with 90%* chatgpt quality (2023)
  26. Communication-efficient learning of deep networks from decentralized data (2017)
  27. Federated optimization in heterogeneous networks (2020)
  28. Scaffold: Stochastic controlled averaging for federated learning (2020)
  29. Measuring the effects of non-identical data distribution for federated visual classification (2019) — link
  30. Adaptive Federated Optimization
  31. JudgeLM: Fine-tuned Large Language Models are Scalable Judges (2023) — link
  32. Stanford Alpaca: An Instruction-following LLaMA model (2023)
  33. TRL: Transformer Reinforcement Learning (2020)
  34. Measuring massive multitask language understanding (2020) — link
  35. Towards deep conversational recommendations (2018)
  36. Learning hierarchy-aware knowledge graph embeddings for link prediction (2020)
  37. Learning attention-based embeddings for relation prediction in knowledge graphs (2019) — link
  38. Representing text for joint embedding of text and knowledge bases (2015)
  39. Llm-assisted knowledge graph engineering: Experiments with chatgpt (2023)
  40. Unveiling User Preferences: A Knowledge Graph and LLM-Driven Approach for Conversational Recommendation (2024) — link
  41. KTOTrainer (2024)
  42. ReDial Dataset (2024)
  43. Qwen3-0.6B (2024)
  44. Fede: Embedding knowledge graphs in federated setting (2021)
  45. FedKGRec: privacy-preserving federated knowledge graph aware recommender system (2024)
  46. Flower: A friendly federated learning research framework (2020) — link
  47. The dual echo chamber: Modeling social media polarization for interventional recommending (2021)
  48. Mitigating Filter Bubbles within Deep Recommender Systems (2022) — link
  49. Calibrating noise to sensitivity in private data analysis (2006)
  50. Privacy-preserving cross-domain recommendation with federated graph learning (2024)
  51. Food.com Recipes and Interactions (2019) — link
  52. Recommender systems based on neuro-symbolic knowledge graph embeddings encoding first-order logic rules (2024)
  53. Bursting filter bubble: Enhancing serendipity recommendations with aligned large language models (2025) — link
  54. The filter bubble: What the Internet is hiding from you (2011)
  55. Exploring the filter bubble: the effect of using recommender systems on content diversity (2014)
  56. How the machine ‘thinks’: Understanding opacity in machine learning algorithms (2016)
  57. Recommender systems and their ethical challenges (2020)
  58. A survey of serendipity in recommender systems (2016)
  59. Diversity, serendipity, novelty, and coverage: a survey and empirical analysis of beyond-accuracy objectives in recommender systems (2016)
  60. Ripplenet: Propagating user preferences on the knowledge graph for recommender systems (2018)
  61. Kgat: Knowledge graph attention network for recommendation (2019)
  62. Harnessing Deep Neural Networks with Logic Rules (2016)
  63. Adaptive Personalized Knowledge Graph Summarization
  64. Explainable recommendation: A survey and new perspectives (2020)
  65. Adaptive Constraint Relaxation in Personalized Nutrition Recommendations: An LLM-Driven Knowledge Graph Retrieval Approach (2025)
  66. FAR-Trans: An Investment Dataset for Financial Asset Recommendation (2024) — link
  67. Stock Recommendations for Individual Investors: A Temporal Graph Network Approach with Mean-Variance Efficient Sampling (2024)
  68. Gemma 3 technical report (2025) — link
  69. Yarn: Efficient context window extension of large language models (2023) — link
  70. Knowledge graphs (2021)
  71. Findkg: Dynamic knowledge graphs with large language models for detecting global trends in financial markets (2024)
  72. Finbert: A pre-trained financial language representation model for financial text mining (2021)
  73. Bloomberggpt: A large language model for finance (2023) — link
  74. Fingpt: Democratizing internet-scale data for financial large language models (2023) — link
  75. Investlm: A large language model for investment using financial domain instruction tuning — → 2309.13064
  76. Finllama: Llm-based financial sentiment analysis for algorithmic trading (2024)
  77. Recommender Systems meet Finance: A literature review (2016)
  78. Effects of data sparsity on recommender systems based on collaborative filtering (2018)
  79. Facing the cold start problem in recommender systems (2014)
  80. Dynamic Risk Prediction in Financial-Production Systems Using Temporal Self-Attention and Adaptive Autoregressive Models (2025)
  81. Portfolio theory: as I still see it (2010)
  82. An Expert System for Financial Planners (1987)
  83. Insights into alignment: Evaluating dpo and its variants across multiple tasks (2024) — link
  84. JSON-LD 1.0 (2014)
  85. Lightgbm: A highly efficient gradient boosting decision tree (2017)
  86. Lightgcn: Simplifying and powering graph convolution network for recommendation (2020)
  87. Neural collaborative filtering vs. matrix factorization revisited (2020)
  88. Trust your neighbors: A comprehensive survey of neighborhood-based methods for recommender systems (2021)
  89. R. Fast algorithms for mining association rules (1994)
  90. Retrieval-augmented generation for knowledge-intensive nlp tasks (2020)
  91. Gemini: a family of highly capable multimodal models (2023) — link
  92. Lora: Low-rank adaptation of large language models. (2022)
  93. Artificial intelligence and fintech: An overview of opportunities and risks for banking, investments, and microfinance (2021)
  94. Blockchain-based Framework for Scalable and Incentivized Federated Learning (2025)
  95. Fed-RD: Privacy-preserving federated learning for financial crime detection (2024)
  96. A differentially private blockchain-based approach for vertical federated learning (2024)

1 of 104 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.