Table of Contents
Fetching ...

A simple inverse power method for balanced graph cut

Sihong Shao, Chuan Yang

TL;DR

This work tackles the NP-hard balanced graph cut by replacing the challenging inner subproblem of the inverse power method with a closed-form, analytically solvable subproblem, and coupling it with a boundary-detected subgradient to guarantee local convergence. The authors introduce the simple inverse power (SIP) method and its θ-variant SIP_θ, plus SIP-perturb as a local breakout strategy, yielding strong computational efficiency and competitive solution quality on Cheeger and Sparsest cuts. They establish rigorous convergence properties and demonstrate substantial speedups over IP and improved performance versus Gurobi in extensive G-set experiments. The approach leverages a novel continuous formulation via Lovász extensions, enabling efficient iteration and potential extensions to broader combinatorial–continuous mappings with practical impact in graph clustering and partitioning tasks.

Abstract

The existing inverse power ($\mathbf{IP}$) method for solving the balanced graph cut lacks local convergence and its inner subproblem requires a nonsmooth convex solver. To address these issues, we develop a simple inverse power ($\mathbf{SIP}$) method using a novel equivalent continuous formulation of the balanced graph cut, and its inner subproblem allows an explicit analytic solution, which is the biggest advantage over $\mathbf{IP}$ and constitutes the main reason why we call it $\mathit{simple}$. By fully exploiting the closed-form of the inner subproblem solution, we design a boundary-detected subgradient selection with which $\mathbf{SIP}$ is proved to be locally converged. We show that $\mathbf{SIP}$ is also applicable to a new ternary valued $θ$-balanced cut which reduces to the balanced cut when $θ=1$. When $\mathbf{SIP}$ reaches its local optimum, we seamlessly transfer to solve the $θ$-balanced cut within exactly the same iteration algorithm framework and thus obtain $\mathbf{SIP}$-$\mathbf{perturb}$ -- an efficient local breakout improvement of $\mathbf{SIP}$, which transforms some ``partitioned" vertices back to the ``un-partitioned" ones through the adjustable $θ$. Numerical experiments on G-set for Cheeger cut and Sparsest cut demonstrate that $\mathbf{SIP}$ is significantly faster than $\mathbf{IP}$ while maintaining approximate solutions of comparable quality, and $\mathbf{SIP}$-$\mathbf{perturb}$ outperforms $\mathtt{Gurobi}$ in terms of both computational cost and solution quality.

A simple inverse power method for balanced graph cut

TL;DR

This work tackles the NP-hard balanced graph cut by replacing the challenging inner subproblem of the inverse power method with a closed-form, analytically solvable subproblem, and coupling it with a boundary-detected subgradient to guarantee local convergence. The authors introduce the simple inverse power (SIP) method and its θ-variant SIP_θ, plus SIP-perturb as a local breakout strategy, yielding strong computational efficiency and competitive solution quality on Cheeger and Sparsest cuts. They establish rigorous convergence properties and demonstrate substantial speedups over IP and improved performance versus Gurobi in extensive G-set experiments. The approach leverages a novel continuous formulation via Lovász extensions, enabling efficient iteration and potential extensions to broader combinatorial–continuous mappings with practical impact in graph clustering and partitioning tasks.

Abstract

The existing inverse power () method for solving the balanced graph cut lacks local convergence and its inner subproblem requires a nonsmooth convex solver. To address these issues, we develop a simple inverse power () method using a novel equivalent continuous formulation of the balanced graph cut, and its inner subproblem allows an explicit analytic solution, which is the biggest advantage over and constitutes the main reason why we call it . By fully exploiting the closed-form of the inner subproblem solution, we design a boundary-detected subgradient selection with which is proved to be locally converged. We show that is also applicable to a new ternary valued -balanced cut which reduces to the balanced cut when . When reaches its local optimum, we seamlessly transfer to solve the -balanced cut within exactly the same iteration algorithm framework and thus obtain - -- an efficient local breakout improvement of , which transforms some ``partitioned" vertices back to the ``un-partitioned" ones through the adjustable . Numerical experiments on G-set for Cheeger cut and Sparsest cut demonstrate that is significantly faster than while maintaining approximate solutions of comparable quality, and - outperforms in terms of both computational cost and solution quality.
Paper Structure (10 sections, 7 theorems, 65 equations, 6 figures, 3 tables)

This paper contains 10 sections, 7 theorems, 65 equations, 6 figures, 3 tables.

Key Result

Lemma 2.1

\newlabellem:subgradient0 For any $\hbox{\boldmath$x$}\in\mathbb{R}^n$ and its induced ternary vector $\hbox{\boldmath$y$}=\hbox{\boldmath$1$}_{V_0^+(\hbox{\boldmath$x$}),V_0^-(\hbox{\boldmath$x$})}$, $\partial f^L(\hbox{\boldmath$x$})\subseteq\partial f^L(\hbox{\boldmath$y$})$ holds for any conve

Figures (6)

  • Figure 1: The flowchart of $\mathbf{SIP}$-$\mathbf{perturb}$ --- an efficient local breakout improvement of $\mathbf{SIP}$ for the balanced cut problem \ref{['prob:balance']}. $\mathbf{SIP}$-$\mathbf{perturb}$ takes turns applying two iterative schemes $\mathbf{SIP}$\ref{['iter1-cheeger_2']} and $\mathbf{SIP}_{\theta}$\ref{['iter2-cheeger_2']}, where $\mathbf{SIP}_{\theta}$ serves as the local breakout technique for $\mathbf{SIP}$. $B(\hbox{\boldmath$x$})$ and $T(\hbox{\boldmath$x$})$ denote the objective functions of the equivalent continuous formulations for $h(G)$\ref{['conti2-prob:balance']} and $h_{\theta}(G)$\ref{['conti-theta:balance']}, respectively. $T_{\theta}$ gives the total rounds of applying $\mathbf{SIP}_{\theta}$. That is, \mathbf{SIP}\text{-}\mathbf{perturb}=\underbrace{(\mathbf{SIP}\rightarrow\mathbf{SIP}_{\theta})\rightarrow\cdots\rightarrow(\mathbf{SIP}\rightarrow\mathbf{SIP}_{\theta})}_{T_{\theta}\text{ rounds}}\rightarrow\mathbf{SIP}.Finally, $\mathbf{SIP}$-$\mathbf{perturb}$ outputs the best solution generated from all $T_{\theta}+1$ rounds of $\mathbf{SIP}$.
  • Figure 1: The minimum, mean, and maximum objective function values obtained by 40 runs of $\mathbf{SIP}$. The dotted lines present the corresponding values generated by $\mathbf{IP}$.
  • Figure 2: Fast convergence of $\mathbf{SIP}$: Histograms of the relative errors (see Eq. \ref{['eq:relative1']}) for all $40\times 30$ runs.
  • Figure 3: The $\theta$-balanced cut values $h_{\theta}(G)$ on $P_{10}$, $C_{10}$ and $K_{10}$. Here $\theta$ increase from $0$ to $1$ with a fixed step of $0.01$ and the weight $\mu_i$ on any $i\in V$ is $d_i$, the degree of the $i$-th vertex.
  • Figure 4: $h_{0}(G)$ (left) v.s.$h_{\frac{1}{2}}(G)$ (center) v.s.$h_{1}(G)\equiv h(G)$ (right) on the Petersen graph: An example of the partitions $(V_1, V_2)\in\mathop{\mathrm{\mathrm{TC\,}}}\limits(V)$ for $V$ is displayed in the red bullets ($V_1$), blue circles ($V_2$) and orange squares ($(V_1\cup V_2)^c$). The dotted green lines represent $E(V_1,V_2)$, while $E(V_1\cup V_2,(V_1\cup V_2)^c)$ are shown in the dashed purple lines. We have $|(V_1\cup V_2)^c|=8$, $3$ and $0$ for $\theta=0$, $\frac{1}{2}$ and $1$, respectively, while the corresponding values of $h_{\theta}(G)$ are $0$, $\frac{3}{10}$ and $\frac{5}{15}$.
  • ...and 1 more figures

Theorems & Definitions (18)

  • Lemma 2.1
  • Proof 1
  • Proof 2
  • Theorem 2.2: global convergence
  • Proof 3
  • Lemma 3.1
  • Proof 4
  • Lemma 3.2
  • Proof 5
  • Remark 3.3
  • ...and 8 more