Table of Contents
Fetching ...

More Information is Not Always Better: Connections between Zero-Sum Local Nash Equilibria in Feedback and Open-Loop Information Patterns

Kushagra Gupta, Ross Allen, David Fridovich-Keil, Ufuk Topcu

TL;DR

The paper addresses how local FBNE and OLNE relate in two-agent zero-sum dynamic games beyond linear-quadratic settings, where global equilibria may not exist. It employs a KKT-based analysis to relate first- and second-order optimality conditions across information structures. The main contributions show that (i) local FBNE trajectories satisfy both first- and second-order necessary conditions for local OLNE, (ii) local OLNE trajectories satisfy the first-order necessary conditions for local FBNE, and (iii) FBNE sufficiency implies OLNE in the local setting; these links extend to constrained cases under strict complementarity. This work provides a theoretical bridge enabling OLNE-focused solvers to yield FBNE in nonconvex, nonlinear dynamics, with practical relevance for actuator-bounded and other constrained systems.

Abstract

Non-cooperative dynamic game theory provides a principled approach to modeling sequential decision-making among multiple noncommunicative agents. A key focus has been on finding Nash equilibria in two-agent zero-sum dynamic games under various information structures. A well-known result states that in linear-quadratic games, unique Nash equilibria under feedback and open-loop information structures yield identical trajectories. Motivated by two key perspectives -- (i) many real-world problems extend beyond linear-quadratic settings and lack unique equilibria, making only local Nash equilibria computable, and (ii) local open-loop Nash equilibria (OLNE) are easier to compute than local feedback Nash equilibria (FBNE) -- it is natural to ask whether a similar result holds for local equilibria in zero-sum games. To this end, we establish that for a broad class of zero-sum games with potentially nonconvex-nonconcave objectives and nonlinear dynamics: (i) the state/control trajectory of a local FBNE satisfies local OLNE first-order optimality conditions, and vice versa, (ii) a local FBNE trajectory satisfies local OLNE second-order necessary conditions, (iii) a local FBNE trajectory satisfying feedback sufficiency conditions also constitutes a local OLNE, and (iv) with additional hard constraints on agents' actuations, a local FBNE where strict complementarity holds also satisfies local OLNE first-order optimality conditions, and vice versa.

More Information is Not Always Better: Connections between Zero-Sum Local Nash Equilibria in Feedback and Open-Loop Information Patterns

TL;DR

The paper addresses how local FBNE and OLNE relate in two-agent zero-sum dynamic games beyond linear-quadratic settings, where global equilibria may not exist. It employs a KKT-based analysis to relate first- and second-order optimality conditions across information structures. The main contributions show that (i) local FBNE trajectories satisfy both first- and second-order necessary conditions for local OLNE, (ii) local OLNE trajectories satisfy the first-order necessary conditions for local FBNE, and (iii) FBNE sufficiency implies OLNE in the local setting; these links extend to constrained cases under strict complementarity. This work provides a theoretical bridge enabling OLNE-focused solvers to yield FBNE in nonconvex, nonlinear dynamics, with practical relevance for actuator-bounded and other constrained systems.

Abstract

Non-cooperative dynamic game theory provides a principled approach to modeling sequential decision-making among multiple noncommunicative agents. A key focus has been on finding Nash equilibria in two-agent zero-sum dynamic games under various information structures. A well-known result states that in linear-quadratic games, unique Nash equilibria under feedback and open-loop information structures yield identical trajectories. Motivated by two key perspectives -- (i) many real-world problems extend beyond linear-quadratic settings and lack unique equilibria, making only local Nash equilibria computable, and (ii) local open-loop Nash equilibria (OLNE) are easier to compute than local feedback Nash equilibria (FBNE) -- it is natural to ask whether a similar result holds for local equilibria in zero-sum games. To this end, we establish that for a broad class of zero-sum games with potentially nonconvex-nonconcave objectives and nonlinear dynamics: (i) the state/control trajectory of a local FBNE satisfies local OLNE first-order optimality conditions, and vice versa, (ii) a local FBNE trajectory satisfies local OLNE second-order necessary conditions, (iii) a local FBNE trajectory satisfying feedback sufficiency conditions also constitutes a local OLNE, and (iv) with additional hard constraints on agents' actuations, a local FBNE where strict complementarity holds also satisfies local OLNE first-order optimality conditions, and vice versa.

Paper Structure

This paper contains 12 sections, 2 theorems, 32 equations.

Key Result

Theorem 1

Consider a two-agent zero-sum dynamic game with $K$ stages and dynamics constraints. Then:

Theorems & Definitions (5)

  • Remark 1
  • Theorem 1
  • proof
  • Theorem 2
  • proof