Paper: arXiv 2407.16566

Abstract

The non-identifiability issue has been frequently reported in social simulation works, where different parameters of an agent-based simulation model yield indistinguishable simulated time series data under certain discrepancy metrics. This issue largely undermines the simulation fidelity yet lacks dedicated investigations. This paper theoretically demonstrates that incorporating multiple time series data features during the model calibration phase can exponentially alleviate non-identifiability as the number of features increases. To implement this theoretical finding, a maximization-based aggregation function is proposed based on existing discrepancy metrics to form a new calibration objective function. For verification, the task of calibrating the Financial Market Simulation (FMS), a typical yet complex social simulation, is considered. Empirical studies confirm the significant improvements in alleviating the non-identifiability of calibration tasks. Furthermore, as a model-agnostic method, it achieves much higher simulation fidelity of the chosen FMS model on both synthetic and real market data. Moreover, it is both theoretically and empirically analyzed that as long as the features are selected and not linearly correlated, they can contribute to alleviation, which demonstrates the robustness of the proposed objective. Hence, this work is expected to provide not only a rigorous understanding of non-identifiability in social simulation but also an off-the-shelf high-fidelity calibration objective function for FMS.

Complexity vs Empirical Score

  • Math Complexity: 7.5/10
  • Empirical Rigor: 4.0/10
  • Quadrant: Lab Rats — theoretically deep, empirically untested

Why this score: The paper contains significant theoretical derivations and proofs regarding non-identifiability and aggregation functions, indicating high mathematical density. However, the empirical validation, while mentioned on synthetic and real data, appears more methodological and lacks detailed implementation code, backtest results, or statistical metrics typical of fully deployment-ready work.

Research Flowchart

  flowchart TD
  A["Research Goal<br>Alleviate non-identifiability in<br>Financial Market Simulation calibration"] --> B["Input: Multivariate Time Series Data"]
  B --> C["Key Methodology<br>High-fidelity Calibration Objective<br>Maximization-based aggregation of multiple discrepancy metrics"]
  C --> D{"Computation<br>Calibrate FMS Model using<br>Proposed Objective Function"}
  D --> E["Key Outcomes"]
  
  E --> F["Theoretical Proof: Exponential reduction in non-identifiability<br>as feature count increases"]
  E --> G["Empirical Results: Higher simulation fidelity<br>on synthetic & real market data"]
  E --> H["Robustness: Effective with non-linearly<br>correlated features"]

Cited References (71)

  1. QuantFactor REINFORCE: Mining Steady Formulaic Alpha Factors with Variance-bounded REINFORCE — → 2409.05144
  2. Rhine: A regime-switching model with nonlinear representation for discovering and forecasting regimes in financial markets (2024)
  3. KAN4Drift: Are KAN Effective for Identifying and Tracking Concept Drift in Time Series? (2024)
  4. A survey of explainable artificial intelligence (XAI) in financial time series forecasting (2024) — link
  5. Kolmogorov-arnold networks for time series: Bridging predictive power and interpretability (2024) — link
  6. Predict stock prices using supervised learning algorithms and particle swarm optimization algorithm (2023)
  7. Hybrid of jellyfish and particle swarm optimization algorithm-based support vector machine for stock market trend prediction (2024)
  8. A deep learning integrated framework for predicting stock index price and fluctuation via singular spectrum analysis and particle swarm optimization (2024)
and 63 more
  1. Social simulation in the social sciences: A brief overview (2014)
  2. Visual Information Extraction with Lixto (2001)
  3. A critical guide to empirical validation of agent-based models in economics: Methodologies, procedures, and open problems (2007)
  4. Automatic calibration of dynamic and heterogeneous parameters in agent-based models (2021)
  5. Agent-based modelling in economics (2015)
  6. The economy needs agent-based modelling (2009)
  7. An overview of the KL-ONE knowledge representation system (1985)
  8. Complexity results for nonmonotonic logics (1992)
  9. Hypertree Decompositions and Tractable Queries (2002)
  10. Foundations of a functional approach to knowledge representation (1984)
  11. A logic of implicit and explicit belief (1984)
  12. On the compilability and expressive power of propositional planning formalisms (2000)
  13. IJCAI Camera Ready Submission
  14. Integrating explanation and prediction in computational social science (2021)
  15. A calibration procedure for analyzing stock price dynamics in an agent-based framework (2015)
  16. Deeplob: Deep convolutional neural networks for limit order books (2019)
  17. OCET: One-Dimensional Convolution Embedding Transformer for Stock Trend Prediction (2022)
  18. Particle swarm optimization (PSO). A tutorial (2015)
  19. Meltdown modelling (2009)
  20. Understanding flash crash contagion and systemic risk: A micro–macro agent-based approach (2019)
  21. Reducing the time complexity of the derandomized evolution strategy with covariance matrix adaptation (CMA-ES) (2003)
  22. On the problem of calibrating an agent based model for financial markets (2013)
  23. Calibrating high frequency trading data to agent based models using approximate Bayesian computation (2021)
  24. Agent-based modeling in economics and finance: Past, present, and future (2022)
  25. A simulation analysis of the microstructure of double auction markets (2002)
  26. Empirical properties of asset returns: stylized facts and statistical issues (2001)
  27. Econophysics review: I. Empirical facts (2011)
  28. Artificial economic life: a simple model of a stockmarket (1994)
  29. Get real: Realism metrics for robust limit order book market simulations (2020)
  30. Market microstructure: A survey (2000)
  31. Statistical properties of stock order books: empirical results and models (2002)
  32. Efficient capital markets: A review of theory and empirical work (1970)
  33. Generating realistic stock market order streams (2020)
  34. Towards realistic market simulations: a generative adversarial networks approach (2021)
  35. Learning to simulate realistic limit order book markets from data as a World Agent (2022)
  36. Efficient Calibration of Multi-Agent Simulation Models from Output Series with Bayesian Optimization (2022)
  37. A practical, accurate, information criterion for nth order markov processes (2017)
  38. A comparison of economic agent-based model calibration methods (2020)
  39. Estimation of ergodic agent-based models by simulated minimum distance (2015)
  40. Bayesian estimation of agent-based models (2017)
  41. Kolmogorov–smirnov test: Overview (2014)
  42. Scalable global optimization via local Bayesian optimization (2019)
  43. Multi-agent-based order book model of financial markets (2006)
  44. Fast Agent-Based Simulation Framework with Applications to Reinforcement Learning and the Study of Trading Latency Effects (2021)
  45. Abides: Towards high-fidelity market simulation for ai research (2019) — link
  46. Strategic agent-based modeling of financial markets (2017)
  47. The predictive power of zero intelligence in financial markets (2005)
  48. Can a zero-intelligence plus model explain the stylized facts of financial time series data? (2012)
  49. Agent-based modeling for complex financial systems (2018)
  50. SimLOB: Learning Representations of Limited Order Book for Financial Market Simulation (2024) — link
  51. How to evaluate trading strategies: Single agent market replay or multiple agent interactive simulation? (2019) — link
  52. Limit Order Book Simulations: A Review (2024) — link
  53. Agent-based economic models and econometrics (2012)
  54. Benchmark dataset for mid-price forecasting of limit order book data with machine learning methods (2018)
  55. Can agent-based models probe market microstructure? (2018)
  56. Estimation of financial agent-based models with simulated maximum likelihood (2017)
  57. An information theoretic criterion for empirical validation of simulation models (2018)
  58. Particle swarm optimization (1995)
  59. Agent-based model calibration using machine learning surrogates (2018)
  60. A modified particle swarm optimizer (1998)
  61. On wasserstein two-sample testing and related families of nonparametric tests (2017)
  62. Towards calibrating financial market simulators with high-frequency data (2025, doi:10.23919/CSMS.2025.0002)
  63. Agent-based modeling in economics and finance: Past, present, and future (2025)

1 of 71 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.