Table of Contents
Fetching ...

Decision Diagram-Based Branch-and-Bound with Caching for Dominance and Suboptimality Detection

Vianney Coppé, Xavier Gillard, Pierre Schaus

TL;DR

The paper addresses the overhead of repeated work in decision diagram (DD)-based branch-and-bound (B&B) for discrete optimization modeled via dynamic programming (DP). It introduces a Cache of expansion thresholds θ(u|B̄) derived from relaxed DDs, combining dominance-based θ_d and pruning-based θ_p to decide when to expand DP states that share the same σ(u). This caching enables warm-starting and stronger pruning across successive approximate DDs, yielding substantial reductions in DD node expansions and faster solution times on challenging instances such as TSPTW, PSP, and SRFLP, sometimes surpassing state-of-the-art MIP performance. The approach is evaluated on three problems, demonstrates memory-time trade-offs, and discusses static vs dynamic variable orderings, with implications for parallelization and further improvements.

Abstract

The branch-and-bound algorithm based on decision diagrams introduced by Bergman et al. in 2016 is a framework for solving discrete optimization problems with a dynamic programming formulation. It works by compiling a series of bounded-width decision diagrams that can provide lower and upper bounds for any given subproblem. Eventually, every part of the search space will be either explored or pruned by the algorithm, thus proving optimality. This paper presents new ingredients to speed up the search by exploiting the structure of dynamic programming models. The key idea is to prevent the repeated expansion of nodes corresponding to the same dynamic programming states by querying expansion thresholds cached throughout the search. These thresholds are based on dominance relations between partial solutions previously found and on the pruning inequalities of the filtering techniques introduced by Gillard et al. in 2021. Computational experiments show that the pruning brought by this caching mechanism allows significantly reducing the number of nodes expanded by the algorithm. This results in more benchmark instances of difficult optimization problems being solved in less time while using narrower decision diagrams.

Decision Diagram-Based Branch-and-Bound with Caching for Dominance and Suboptimality Detection

TL;DR

The paper addresses the overhead of repeated work in decision diagram (DD)-based branch-and-bound (B&B) for discrete optimization modeled via dynamic programming (DP). It introduces a Cache of expansion thresholds θ(u|B̄) derived from relaxed DDs, combining dominance-based θ_d and pruning-based θ_p to decide when to expand DP states that share the same σ(u). This caching enables warm-starting and stronger pruning across successive approximate DDs, yielding substantial reductions in DD node expansions and faster solution times on challenging instances such as TSPTW, PSP, and SRFLP, sometimes surpassing state-of-the-art MIP performance. The approach is evaluated on three problems, demonstrates memory-time trade-offs, and discusses static vs dynamic variable orderings, with implications for parallelization and further improvements.

Abstract

The branch-and-bound algorithm based on decision diagrams introduced by Bergman et al. in 2016 is a framework for solving discrete optimization problems with a dynamic programming formulation. It works by compiling a series of bounded-width decision diagrams that can provide lower and upper bounds for any given subproblem. Eventually, every part of the search space will be either explored or pruned by the algorithm, thus proving optimality. This paper presents new ingredients to speed up the search by exploiting the structure of dynamic programming models. The key idea is to prevent the repeated expansion of nodes corresponding to the same dynamic programming states by querying expansion thresholds cached throughout the search. These thresholds are based on dominance relations between partial solutions previously found and on the pruning inequalities of the filtering techniques introduced by Gillard et al. in 2021. Computational experiments show that the pruning brought by this caching mechanism allows significantly reducing the number of nodes expanded by the algorithm. This results in more benchmark instances of difficult optimization problems being solved in less time while using narrower decision diagrams.
Paper Structure (37 sections, 3 theorems, 20 equations, 9 figures, 5 algorithms)

This paper contains 37 sections, 3 theorems, 20 equations, 9 figures, 5 algorithms.

Key Result

Proposition 1

Given a relaxed DD $\overline{\mathcal{B}}$, exact nodes $u_1 \in \overline{\mathcal{B}}$, $u_2 \in Leaves_d(u_1 \mid \overline{\mathcal{B}})$, $u_1' \notin \overline{\mathcal{B}}$ such that $\sigma(u_1') = \sigma(u_1)$, and a path $p_1: r\rightsquigarrow u_1'$, if $v(p_1) > \theta_{id}(u_1\mid u_2,

Figures (9)

  • Figure 1: (a) A BKP instance and (b) the corresponding exact DD. The value inside each node corresponds to its state -- the remaining capacity -- and the annotation on the left gives the value of the longest path that reaches it. For clarity, only arc values are present. The longest path is highlighted in bold.
  • Figure 2: (a) A restricted and (b) a relaxed DD for the BKP instance of \ref{['fig:exact-dd']}(a) with $W=3$. Merged nodes are circled twice and relaxed nodes are colored in gray.
  • Figure 3: Flowchart of the DD-based B&B algorithm.
  • Figure 4: (a) A restricted and (b) a relaxed DD for the BKP instance of \ref{['fig:exact-dd']}(a) with $W=3$. The LocBs are annotated in gray on the left of each node. Pruning decisions are detailed below the filtered nodes.
  • Figure 5: Relaxed DDs with $W=3$ for the BKP instance of \ref{['fig:exact-dd']} rooted at nodes (a) $a_2$ and (b) $a_1$. Nodes of the relaxed DD (a) are annotated with their dominance threshold, where applicable. The relaxed DD (b) is compiled with respect to the dominance thresholds computed in (a).
  • ...and 4 more figures

Theorems & Definitions (19)

  • Example 1
  • Example 2
  • Example 3
  • Definition 1: Exact cutset
  • Example 4
  • Definition 2: Local bound
  • Example 5
  • Definition 3: Dominance
  • Definition 4: Individual dominance threshold
  • Proposition 1
  • ...and 9 more