Table of Contents
Fetching ...

Subgame Optimal and Prior-Independent Online Algorithms

Jason Hartline, Aleck Johnsen, Anant Shah

TL;DR

The paper advances beyond-worst-case analysis for online algorithms by introducing subgame optimality and prior-independence, illustrating their value with the finite-horizon ski-rental problem. It develops a game-theoretic framework that connects worst-case, subgame-optimal, and prior-independent perspectives, and provides both analytic characterizations and computational schemes. A key contribution is showing how to compute near-optimal prior-independent algorithms via a four-property framework (Small-Cover, Efficient Best Response, Efficient Utility Computation, Bounded Best Response Utility), yielding a polynomial-time approximation scheme. Empirical results demonstrate that subgame-optimal and prior-independent algorithms can outperform traditional worst-case methods in realistic, non-worst-case inputs. The work offers a cohesive methodology for robust online algorithm design with practical implications for systems where inputs are uncertain yet exhibit structure beyond pure worst-case behavior.

Abstract

This paper takes a game theoretic approach to the design and analysis of online algorithms and illustrates the approach on the finite-horizon ski-rental problem. This approach allows beyond worst-case analysis of online algorithms. First, we define "subgame optimality" which is stronger than worst case optimality in that it requires the algorithm to take advantage of an adversary not playing a worst case input. Algorithms only focusing on the worst case can be far from subgame optimal. Second, we consider prior-independent design and analysis of online algorithms, where rather than choosing a worst case input, the adversary chooses a worst case independent and identical distribution over inputs. Prior-independent online algorithms are generally analytically intractable; instead we give a fully polynomial time approximation scheme to compute them. Highlighting the potential improvement from these paradigms for the finite-horizon ski-rental problem, we empirically compare worst-case, subgame optimal, and prior-independent algorithms in the prior-independent framework.

Subgame Optimal and Prior-Independent Online Algorithms

TL;DR

The paper advances beyond-worst-case analysis for online algorithms by introducing subgame optimality and prior-independence, illustrating their value with the finite-horizon ski-rental problem. It develops a game-theoretic framework that connects worst-case, subgame-optimal, and prior-independent perspectives, and provides both analytic characterizations and computational schemes. A key contribution is showing how to compute near-optimal prior-independent algorithms via a four-property framework (Small-Cover, Efficient Best Response, Efficient Utility Computation, Bounded Best Response Utility), yielding a polynomial-time approximation scheme. Empirical results demonstrate that subgame-optimal and prior-independent algorithms can outperform traditional worst-case methods in realistic, non-worst-case inputs. The work offers a cohesive methodology for robust online algorithm design with practical implications for systems where inputs are uncertain yet exhibit structure beyond pure worst-case behavior.

Abstract

This paper takes a game theoretic approach to the design and analysis of online algorithms and illustrates the approach on the finite-horizon ski-rental problem. This approach allows beyond worst-case analysis of online algorithms. First, we define "subgame optimality" which is stronger than worst case optimality in that it requires the algorithm to take advantage of an adversary not playing a worst case input. Algorithms only focusing on the worst case can be far from subgame optimal. Second, we consider prior-independent design and analysis of online algorithms, where rather than choosing a worst case input, the adversary chooses a worst case independent and identical distribution over inputs. Prior-independent online algorithms are generally analytically intractable; instead we give a fully polynomial time approximation scheme to compute them. Highlighting the potential improvement from these paradigms for the finite-horizon ski-rental problem, we empirically compare worst-case, subgame optimal, and prior-independent algorithms in the prior-independent framework.
Paper Structure (30 sections, 31 theorems, 122 equations, 3 figures, 1 algorithm)

This paper contains 30 sections, 31 theorems, 122 equations, 3 figures, 1 algorithm.

Key Result

Lemma 3.1

Any mixed Nash equilibrium in SRP-R is a mixed Nash equilibrium in SRP.

Figures (3)

  • Figure 1: The time horizon is fixed at $T=9$. The stopping cost is varied continuously from $[1,T]$. The figure plots the approximation ratio of each algorithm against the worst-case distribution of the adversary in the prior-independent framework.
  • Figure 2: \ref{['fig:parta']} plots the prior-independent ratio as a function of integral $T$ for a fixed $B=4$. \ref{['fig:partb']} plots the prior-independent ratio as a function of continuous $B$ for a fixed $T=9$. Compare these values to the worst-case ratio for the finite-horizon ski-rental problem as derived in \ref{['s:sub-gameoptalgs']}.
  • Figure 3: The time horizon is fixed at $T=9$. The stopping cost is varied continuously from $[1,T]$. The figure plots the approximation ratio of each algorithm against the worst-case distribution of the adversary in the prior-independent framework.

Theorems & Definitions (71)

  • Definition 1
  • Definition 2
  • Definition 3: Subgame Optimal Algorithm
  • Definition 4: Subgame Optimal Benchmark
  • Definition 5
  • Lemma 3.1
  • Lemma 3.2
  • Corollary 3.3
  • Corollary 3.4
  • Lemma 3.5
  • ...and 61 more