Table of Contents
Fetching ...

Polynomial time algorithm for optimal stopping with fixed accuracy

David A. Goldberg, Yilun Chen

TL;DR

This paper proves the existence of a polynomial-time (in horizon $T$ and dimension $D$) algorithm for high-dimensional, path-dependent optimal stopping with fixed accuracy $\epsilon$, given access to an efficient simulator. It introduces a novel expansion of the optimal value into a sum of nested conditional-expectation terms, $\textsc{opt} = \sum_{k=1}^{\infty} L_k$ with $L_k = \mathbb{E}[\max_t Z^k_t]$, and shows that truncating after $O(1/\epsilon)$ terms yields an $\epsilon$-approximation. The algorithmically implemented approach uses Monte Carlo simulations to estimate these expansion terms, achieving polynomial-time complexity in $T$ and $D$ under either bounded rewards or mild concentration assumptions, albeit with constants that render the method impractical for very small $\epsilon$. The Bermudan max call is analyzed as a concrete instance, demonstrating that the assumptions hold and the method applies in a standard financial benchmarking setting. Overall, the work lays a theoretical foundation for PTAS-like guarantees in complex, high-dimensional OS problems and opens avenues for practical, scalable extensions.

Abstract

The problem of high-dimensional path-dependent optimal stopping (OS) is important to multiple academic communities and applications. Modern OS tasks often have a large number of decision epochs, and complicated non-Markovian dynamics, making them especially challenging. Standard approaches, often relying on ADP, duality, deep learning and other heuristics, have shown strong empirical performance, yet have limited rigorous guarantees (which may scale exponentially in the problem parameters and/or require previous knowledge of basis functions or additional continuity assumptions). Although past work has placed these problems in the framework of computational complexity and polynomial-time approximability, those analyses were limited to simple one-dimensional problems. For long-horizon complex OS problems, is a polynomial time solution even theoretically possible? We prove that given access to an efficient simulator of the underlying information process, and fixed accuracy epsilon, there exists an algorithm that returns an epsilon-optimal solution (both stopping policies and approximate optimal values) with computational complexity scaling polynomially in the time horizon and underlying dimension. Like the first polynomial-time (approximation) algorithms for several other well-studied problems, our theoretical guarantees are polynomial yet impractical. Our approach is based on a novel expansion for the optimal value which may be of independent interest.

Polynomial time algorithm for optimal stopping with fixed accuracy

TL;DR

This paper proves the existence of a polynomial-time (in horizon and dimension ) algorithm for high-dimensional, path-dependent optimal stopping with fixed accuracy , given access to an efficient simulator. It introduces a novel expansion of the optimal value into a sum of nested conditional-expectation terms, with , and shows that truncating after terms yields an -approximation. The algorithmically implemented approach uses Monte Carlo simulations to estimate these expansion terms, achieving polynomial-time complexity in and under either bounded rewards or mild concentration assumptions, albeit with constants that render the method impractical for very small . The Bermudan max call is analyzed as a concrete instance, demonstrating that the assumptions hold and the method applies in a standard financial benchmarking setting. Overall, the work lays a theoretical foundation for PTAS-like guarantees in complex, high-dimensional OS problems and opens avenues for practical, scalable extensions.

Abstract

The problem of high-dimensional path-dependent optimal stopping (OS) is important to multiple academic communities and applications. Modern OS tasks often have a large number of decision epochs, and complicated non-Markovian dynamics, making them especially challenging. Standard approaches, often relying on ADP, duality, deep learning and other heuristics, have shown strong empirical performance, yet have limited rigorous guarantees (which may scale exponentially in the problem parameters and/or require previous knowledge of basis functions or additional continuity assumptions). Although past work has placed these problems in the framework of computational complexity and polynomial-time approximability, those analyses were limited to simple one-dimensional problems. For long-horizon complex OS problems, is a polynomial time solution even theoretically possible? We prove that given access to an efficient simulator of the underlying information process, and fixed accuracy epsilon, there exists an algorithm that returns an epsilon-optimal solution (both stopping policies and approximate optimal values) with computational complexity scaling polynomially in the time horizon and underlying dimension. Like the first polynomial-time (approximation) algorithms for several other well-studied problems, our theoretical guarantees are polynomial yet impractical. Our approach is based on a novel expansion for the optimal value which may be of independent interest.

Paper Structure

This paper contains 54 sections, 22 theorems, 75 equations.

Key Result

Theorem 1

$\textsc{opt} = \sum_{k=1}^{\infty} E[\max_{t = 1,\ldots,T} Z^k_t].$

Theorems & Definitions (24)

  • Theorem 1
  • Theorem 2
  • Lemma 1
  • Lemma 2
  • Remark 1
  • Lemma 3: Lower bound
  • Theorem 3: Optimal value approximation
  • Theorem 4: Optimal stopping policy
  • Theorem 5: Optimal value approximation for unbounded rewards
  • Theorem 6: Optimal stopping policy for unbounded rewards
  • ...and 14 more