Paper: arXiv 2610.10407

Authors: Yizhen Xie, Mengyang Liu

Abstract

As option markets grow and AI advances, agentic systems for option trading are gaining increasing attention. Language-model-based agents can reason over contextual information such as news, but option trading presents a particularly challenging decision problem: a single stock can have thousands of contracts, and the agent must decide both which contracts to trade and how to combine them. Existing approaches often sidestep this complexity by restricting the policy to a fixed strategy structure, such as a straddle, limiting their ability to switch strategies as market conditions change. We present SOTA (Stock Options Trading Agents), an agentic trading framework for structured option-strategy selection. SOTA abstracts the large option universe into strategy-level decisions while deterministic resolvers handle portfolio implementation. We develop SOTA by post-training Qwen3.8-27B with supervised fine-tuning followed by reinforcement learning. SOTA is evaluated on options on nine large-cap U.S. equities and SPY against rule-based and machine-learning strategy selectors in the same trading environment. Over a six-month out-of-sample period, SOTA earns an 18.3% total return with a Sharpe ratio of 1.60 and a maximum drawdown of 8.96%. We also document an asymmetric role of news: news improves frontier-teacher trajectories, but retaining news during reinforcement learning reduces out-of-sample return from 18.3% to -2.7%.

Complexity vs Empirical Score

  • Math Complexity: 6.5/10
  • Empirical Rigor: 8.0/10
  • Quadrant: Holy Grail — high math complexity, high empirical rigor

Why this score: This paper presents a novel approach to option trading using LLM agents, addressing the complex decision space effectively. The empirical results are strong and well-documented, demonstrating significant outperformance against baselines. The methodology is clearly outlined, suggesting good reproducibility.

Research Flowchart

  flowchart TD
    A[Research Goal: Develop Agentic System for Optimal Option Trading] --> B{Key Methodology Steps};
    B --> C[Data/Inputs: Historical Option Data, News, LLM (Qwen3.8-27B)];
    C --> D[Computational Processes: SFT, RL (on Qwen3.8-27B)];
    D --> E[SOTA: Structured Option-Strategy Selection Framework];
    E --> F{Key Findings/Outcomes};
    F --> G[18.3% Total Return, Sharpe Ratio 1.60, Max Drawdown 8.96%];
    F --> H[News improves teacher trajectories, but hurts RL OOS return];

Cited References (85)

  1. ReAct : Synergizing Reasoning and Acting in Language Models (2023)
  2. Toolformer: Language Models Can Teach Themselves to Use Tools (2023)
  3. Inferring Trade Direction from Intraday Data (1991) — link
  4. AgentBench : Evaluating LLM s as Agents (2024)
  5. $\tau$-bench : A Benchmark for Tool-Agent-User Interaction in Real-World Domains (2025)
  6. LiveBench : A Challenging, Contamination-Limited LLM Benchmark (2025)
  7. Self-Instruct: Aligning Language Models with Self-Generated Instructions (2023) — link
  8. Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes (2023) — link
and 77 more
  1. LoRA : Low-Rank Adaptation of Large Language Models (2022)
  2. DeepSeekMath : Pushing the Limits of Mathematical Reasoning in Open Language Models (2024) — link
  3. HybridFlow : A Flexible and Efficient RLHF Framework (2025) — link
  4. FinGPT : Open-Source Financial Large Language Models — → 2306.06031
  5. InvestLM : A Large Language Model for Investment Using Financial Domain Instruction Tuning — → 2309.13064
  6. FinMem : A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Design (2025) — link
  7. A Multimodal Foundation Agent for Financial Trading: Tool-Augmented, Diversified, and Generalist (2024) — link
  8. FinCon : A Synthesized LLM Multi-Agent System with Conceptual Verbal Reinforcement for Enhanced Financial Decision Making (2024)
  9. TradingAgents : Multi-Agents LLM Financial Trading Framework — → 2412.20138
  10. When AI Meets Finance ( StockAgent ): A Benchmark for Simulating Large Language Model Behaviors in Controlled Trading Environments (2026) — link
  11. StockBench : Can LLM Agents Trade Stocks Profitably in Real-World Markets? (2025) — link
  12. FinanceHarness : Autonomous Financial Deep Research Framework (2026) — link
  13. FinRobot : An Open-Source AI Agent Platform for Financial Applications Using Large Language Models — → 2405.14767
  14. FinRL-Meta : Market Environments and Benchmarks for Data-Driven Financial Reinforcement Learning (2022)
  15. Deep Hedging (2019) — link
  16. QLBS : Q-Learner in the Black–Scholes(–Merton) Worlds (2020)
  17. Demand-Based Option Pricing (2009) — link
  18. Bid, Ask and Transaction Prices in a Specialist Market with Heterogeneously Informed Traders (1985) — link
  19. Option Volume and Stock Prices: Evidence on Where Informed Traders Trade (1998) — link
  20. The Information in Option Volume for Future Stock Prices (2006) — link
  21. Post-‘87 Crash Fears in the S&P 500 Futures Option Market (2000) — link
  22. Survivorship Bias and Attrition Effects in Measures of Performance Persistence (1999) — link
  23. Options Strategies Quick Guide (2025)
  24. Cboe Strategy Benchmark Indices (2026)
  25. OPHR : Mastering Volatility Trading with Multi-Agent Deep Reinforcement Learning (2025)
  26. Prices of State-Contingent Claims Implicit in Option Prices (1978)
  27. Stock Return Characteristics, Skew Laws, and the Differential Pricing of Individual Equity Options (2003)
  28. The Pricing of Options and Corporate Liabilities (1973)
  29. Variance Risk Premiums (2009)
  30. Expected Option Returns (2001)
  31. Cross-Section of Option Returns and Volatility (2009)
  32. Cross Section of Option Returns and Idiosyncratic Stock Volatility (2013)
  33. Optimal Delta Hedging for Options (2017)
  34. Option Pricing and Replication with Transactions Costs (1985)
  35. Optimal Replication of Contingent Claims under Transaction Costs (1989)
  36. An Asymptotic Analysis of an Optimal Hedging Model for Option Pricing with Transaction Costs (1997)
  37. European Option Pricing and Hedging with Both Fixed and Proportional Transaction Costs (2006)
  38. Deep Hedging: Continuous Reinforcement Learning for Hedging of General Portfolios across Multiple Risk Aversions (2022)
  39. Generalized Autoregressive Conditional Heteroskedasticity (1986) — link
  40. Time Series Momentum (2012) — link
  41. DeepVol : Volatility Forecasting from High-Frequency Data with Dilated Causal Convolutions (2024) — link
  42. Theory of Rational Option Pricing (1973)
  43. A Closed-Form Solution for Options with Stochastic Volatility with Applications to Bond and Currency Options (1993)
  44. Jumps and Stochastic Volatility: Exchange Rate Processes Implicit in Deutsche Mark Options (1996)
  45. The Variance Gamma Process and Option Pricing (1998)
  46. Empirical Performance of Alternative Option Pricing Models (1997)
  47. Deep Bellman Hedging (2022) — link
  48. Deep Learning for Options Trading: An End-To-End Approach (2024)
  49. Dynamic Replication and Hedging: A Reinforcement Learning Approach (2019)
  50. Generalized Autoregressive Conditional Heteroskedasticity (1986)
  51. Retail Trading in Options and the Rise of the Big Three Wholesalers (2023) — link
  52. Skewness and Kurtosis in S&P 500 Index Returns Implied by Option Prices (1996) — link
  53. Risk-Neutral Skewness: Evidence from Stock Options (2002) — link
  54. Implied Volatility Functions: Empirical Tests (1998) — link
  55. Dynamics of Implied Volatility Surfaces (2002) — link
  56. The Implied Volatility Smirk (2008) — link
  57. The Relation between Implied and Realized Volatility (1998) — link
  58. Delta-Hedged Gains and the Negative Market Volatility Risk Premium (2003) — link
  59. Volatility Information Trading in the Option Market (2008) — link
  60. The Skew Risk Premium in the Equity Index Market (2013) — link
  61. Optimal Positioning in Derivative Securities (2001) — link
  62. Reinforcement Learning: An Introduction (2018)
  63. Human-Level Control through Deep Reinforcement Learning (2015) — link
  64. Cryptocurrency Portfolio Management with Deep Reinforcement Learning (2017) — link
  65. Deep Reinforcement Learning for Automated Stock Trading: An Ensemble Strategy (2020) — link
  66. Deep Reinforcement Learning for Active High Frequency Trading (2021) — link
  67. EarnHFT : Efficient Hierarchical Reinforcement Learning for High Frequency Trading (2024) — link
  68. MacroHFT : Memory Augmented Context-Aware Reinforcement Learning on High Frequency Trading (2024) — link
  69. Distilling the Knowledge in a Neural Network (2015) — link
  70. Assessing Look-Ahead Bias in Stock Return Predictions Generated by GPT Sentiment Analysis — → 2309.17322
  71. Training Language Models to Follow Instructions with Human Feedback (2022)
  72. Reinforcement Learning for Options Trading (2021) — link
  73. An Intelligent Option Trading System Based on Heatmap Analysis via PON/POD Yields (2024) — link
  74. Effective Options Trading Strategies Based on Volatility Forecasting Recruiting Investor Sentiment (2011) — link
  75. Option Return Predictability with Machine Learning and Big Data (2023) — link
  76. Empirical Deep Hedging (2023) — link
  77. The Information in Option Volume for Future Stock Prices (2006) — link

5 of 85 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.