Submodular Maximization under Supermodular Constraint: Greedy Guarantees

TL;DR

The Greedy-Ratio-Marginal in conjunction with binary search leads to a bicriteria approximation for the dual problem -- minimizing a supermodular function under a lower bound constraint on a submodular function.

Abstract

Motivated by a wide range of applications in data mining and machine learning, we consider the problem of maximizing a submodular function subject to supermodular cost constraints. In contrast to the well-understood setting of cardinality and matroid constraints, where greedy algorithms admit strong guarantees, the supermodular constraint regime remains poorly understood -- guarantees for greedy methods and other efficient algorithmic paradigms are largely open. We study this family of fundamental optimization problems under an upper-bound constraint on a supermodular cost function with curvature parameter $γ$. Our notion of supermodular curvature is less restrictive than prior definitions, substantially expanding the class of admissible cost functions. We show that our greedy algorithm that iteratively includes elements maximizing the ratio of the objective and constraint functions, achieves a $\left(1 - e^{-(1-γ)}\right)$-approximation before stopping. We prove that this approximation is indeed tight for this algorithm. Further, if the objective function has a submodular curvature $c$, then we show that the bound further improves to $\left(1 - (1- (1-c)(1-γ))^{1/(1-c)}\right)$, which can be further improved by continuing to violate the constraint. Finally, we show that the Greedy-Ratio-Marginal in conjunction with binary search leads to a bicriteria approximation for the dual problem -- minimizing a supermodular function under a lower bound constraint on a submodular function. We conduct a number of experiments on a simulation of LLM agents debating over multiple rounds -- the task is to select a subset of agents to maximize correctly answered questions. Our algorithm outperforms all other greedy heuristics, and on smaller problems, it achieves the same performance as the optimal set found by exhaustive search.

Figures (8)

• Figure 1: Instance of max cover with supermodular cost.
• Figure 2: Comparison with 100 agents and 1000 questions with the "Global View" model.
• Figure 3: Comparison with 100 agents and 1000 questions with the "Local View" model.
• Figure 4: Comparison including the optimal solution for 15 agents and 100 questions.
• Figure 5: Instance of max cover with supermodular cost.

Theorems & Definitions (29)

• proposition 1: Approximation Intractability
• theorem 1: Greedy Overflow Characterization
• theorem 2: Bicriteria Approximation with Curvature
• proof
• corollary 1
• proof
• corollary 2: Greedy Approximation for Strict Supermodular Curvature
• theorem 3: Tightness of Greedy Approximation
• proof : Proof idea
• theorem 4