Paper: arXiv 2610.10407
Authors: Yizhen Xie, Mengyang Liu
Abstract
As option markets grow and AI advances, agentic systems for option trading are gaining increasing attention. Language-model-based agents can reason over contextual information such as news, but option trading presents a particularly challenging decision problem: a single stock can have thousands of contracts, and the agent must decide both which contracts to trade and how to combine them. Existing approaches often sidestep this complexity by restricting the policy to a fixed strategy structure, such as a straddle, limiting their ability to switch strategies as market conditions change. We present SOTA (Stock Options Trading Agents), an agentic trading framework for structured option-strategy selection. SOTA abstracts the large option universe into strategy-level decisions while deterministic resolvers handle portfolio implementation. We develop SOTA by post-training Qwen3.8-27B with supervised fine-tuning followed by reinforcement learning. SOTA is evaluated on options on nine large-cap U.S. equities and SPY against rule-based and machine-learning strategy selectors in the same trading environment. Over a six-month out-of-sample period, SOTA earns an 18.3% total return with a Sharpe ratio of 1.60 and a maximum drawdown of 8.96%. We also document an asymmetric role of news: news improves frontier-teacher trajectories, but retaining news during reinforcement learning reduces out-of-sample return from 18.3% to -2.7%.
Complexity vs Empirical Score
- Math Complexity: 6.5/10
- Empirical Rigor: 8.0/10
- Quadrant: Holy Grail — high math complexity, high empirical rigor
Why this score: This paper presents a novel approach to option trading using LLM agents, addressing the complex decision space effectively. The empirical results are strong and well-documented, demonstrating significant outperformance against baselines. The methodology is clearly outlined, suggesting good reproducibility.
Research Flowchart
flowchart TD
A[Research Goal: Develop Agentic System for Optimal Option Trading] --> B{Key Methodology Steps};
B --> C[Data/Inputs: Historical Option Data, News, LLM (Qwen3.8-27B)];
C --> D[Computational Processes: SFT, RL (on Qwen3.8-27B)];
D --> E[SOTA: Structured Option-Strategy Selection Framework];
E --> F{Key Findings/Outcomes};
F --> G[18.3% Total Return, Sharpe Ratio 1.60, Max Drawdown 8.96%];
F --> H[News improves teacher trajectories, but hurts RL OOS return];
Cited References (85)
- ReAct : Synergizing Reasoning and Acting in Language Models (2023)
- Toolformer: Language Models Can Teach Themselves to Use Tools (2023)
- Inferring Trade Direction from Intraday Data (1991) — link
- AgentBench : Evaluating LLM s as Agents (2024)
- $\tau$-bench : A Benchmark for Tool-Agent-User Interaction in Real-World Domains (2025)
- LiveBench : A Challenging, Contamination-Limited LLM Benchmark (2025)
- Self-Instruct: Aligning Language Models with Self-Generated Instructions (2023) — link
- Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes (2023) — link
and 77 more
- LoRA : Low-Rank Adaptation of Large Language Models (2022)
- DeepSeekMath : Pushing the Limits of Mathematical Reasoning in Open Language Models (2024) — link
- HybridFlow : A Flexible and Efficient RLHF Framework (2025) — link
- FinGPT : Open-Source Financial Large Language Models — → 2306.06031
- InvestLM : A Large Language Model for Investment Using Financial Domain Instruction Tuning — → 2309.13064
- FinMem : A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Design (2025) — link
- A Multimodal Foundation Agent for Financial Trading: Tool-Augmented, Diversified, and Generalist (2024) — link
- FinCon : A Synthesized LLM Multi-Agent System with Conceptual Verbal Reinforcement for Enhanced Financial Decision Making (2024)
- TradingAgents : Multi-Agents LLM Financial Trading Framework — → 2412.20138
- When AI Meets Finance ( StockAgent ): A Benchmark for Simulating Large Language Model Behaviors in Controlled Trading Environments (2026) — link
- StockBench : Can LLM Agents Trade Stocks Profitably in Real-World Markets? (2025) — link
- FinanceHarness : Autonomous Financial Deep Research Framework (2026) — link
- FinRobot : An Open-Source AI Agent Platform for Financial Applications Using Large Language Models — → 2405.14767
- FinRL-Meta : Market Environments and Benchmarks for Data-Driven Financial Reinforcement Learning (2022)
- Deep Hedging (2019) — link
- QLBS : Q-Learner in the Black–Scholes(–Merton) Worlds (2020)
- Demand-Based Option Pricing (2009) — link
- Bid, Ask and Transaction Prices in a Specialist Market with Heterogeneously Informed Traders (1985) — link
- Option Volume and Stock Prices: Evidence on Where Informed Traders Trade (1998) — link
- The Information in Option Volume for Future Stock Prices (2006) — link
- Post-‘87 Crash Fears in the S&P 500 Futures Option Market (2000) — link
- Survivorship Bias and Attrition Effects in Measures of Performance Persistence (1999) — link
- Options Strategies Quick Guide (2025)
- Cboe Strategy Benchmark Indices (2026)
- OPHR : Mastering Volatility Trading with Multi-Agent Deep Reinforcement Learning (2025)
- Prices of State-Contingent Claims Implicit in Option Prices (1978)
- Stock Return Characteristics, Skew Laws, and the Differential Pricing of Individual Equity Options (2003)
- The Pricing of Options and Corporate Liabilities (1973)
- Variance Risk Premiums (2009)
- Expected Option Returns (2001)
- Cross-Section of Option Returns and Volatility (2009)
- Cross Section of Option Returns and Idiosyncratic Stock Volatility (2013)
- Optimal Delta Hedging for Options (2017)
- Option Pricing and Replication with Transactions Costs (1985)
- Optimal Replication of Contingent Claims under Transaction Costs (1989)
- An Asymptotic Analysis of an Optimal Hedging Model for Option Pricing with Transaction Costs (1997)
- European Option Pricing and Hedging with Both Fixed and Proportional Transaction Costs (2006)
- Deep Hedging: Continuous Reinforcement Learning for Hedging of General Portfolios across Multiple Risk Aversions (2022)
- Generalized Autoregressive Conditional Heteroskedasticity (1986) — link
- Time Series Momentum (2012) — link
- DeepVol : Volatility Forecasting from High-Frequency Data with Dilated Causal Convolutions (2024) — link
- Theory of Rational Option Pricing (1973)
- A Closed-Form Solution for Options with Stochastic Volatility with Applications to Bond and Currency Options (1993)
- Jumps and Stochastic Volatility: Exchange Rate Processes Implicit in Deutsche Mark Options (1996)
- The Variance Gamma Process and Option Pricing (1998)
- Empirical Performance of Alternative Option Pricing Models (1997)
- Deep Bellman Hedging (2022) — link
- Deep Learning for Options Trading: An End-To-End Approach (2024)
- Dynamic Replication and Hedging: A Reinforcement Learning Approach (2019)
- Generalized Autoregressive Conditional Heteroskedasticity (1986)
- Retail Trading in Options and the Rise of the Big Three Wholesalers (2023) — link
- Skewness and Kurtosis in S&P 500 Index Returns Implied by Option Prices (1996) — link
- Risk-Neutral Skewness: Evidence from Stock Options (2002) — link
- Implied Volatility Functions: Empirical Tests (1998) — link
- Dynamics of Implied Volatility Surfaces (2002) — link
- The Implied Volatility Smirk (2008) — link
- The Relation between Implied and Realized Volatility (1998) — link
- Delta-Hedged Gains and the Negative Market Volatility Risk Premium (2003) — link
- Volatility Information Trading in the Option Market (2008) — link
- The Skew Risk Premium in the Equity Index Market (2013) — link
- Optimal Positioning in Derivative Securities (2001) — link
- Reinforcement Learning: An Introduction (2018)
- Human-Level Control through Deep Reinforcement Learning (2015) — link
- Cryptocurrency Portfolio Management with Deep Reinforcement Learning (2017) — link
- Deep Reinforcement Learning for Automated Stock Trading: An Ensemble Strategy (2020) — link
- Deep Reinforcement Learning for Active High Frequency Trading (2021) — link
- EarnHFT : Efficient Hierarchical Reinforcement Learning for High Frequency Trading (2024) — link
- MacroHFT : Memory Augmented Context-Aware Reinforcement Learning on High Frequency Trading (2024) — link
- Distilling the Knowledge in a Neural Network (2015) — link
- Assessing Look-Ahead Bias in Stock Return Predictions Generated by GPT Sentiment Analysis — → 2309.17322
- Training Language Models to Follow Instructions with Human Feedback (2022)
- Reinforcement Learning for Options Trading (2021) — link
- An Intelligent Option Trading System Based on Heatmap Analysis via PON/POD Yields (2024) — link
- Effective Options Trading Strategies Based on Volatility Forecasting Recruiting Investor Sentiment (2011) — link
- Option Return Predictability with Machine Learning and Big Data (2023) — link
- Empirical Deep Hedging (2023) — link
- The Information in Option Volume for Future Stock Prices (2006) — link
5 of 85 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.