Table of Contents
Fetching ...

Symmetry breaking for inductive logic programming

Andrew Cropper, David M. Cerna, Matti Järvisalo

TL;DR

This work addresses the inefficiency caused by syntactic symmetries in ILP hypothesis spaces by introducing a variable-ordering–based symmetry-breaking method for body-variant rules. Implemented inside the Popper ILP system via an ASP encoding, the approach prunes redundant rules while remaining sound, though incomplete due to GI-hardness. Empirical evaluation across visual reasoning, game-playing, and real-world domains shows substantial reductions in solving times (sometimes from over an hour to tens of seconds) and meaningful learning-time improvements, particularly as task complexity grows. The method bridges ILP and constraint programming, yielding practical speedups and highlighting both the potential and the limitations of incomplete symmetry breaking in ILP.

Abstract

The goal of inductive logic programming is to search for a hypothesis that generalises training data and background knowledge. The challenge is searching vast hypothesis spaces, which is exacerbated because many logically equivalent hypotheses exist. To address this challenge, we introduce a method to break symmetries in the hypothesis space. We implement our idea in answer set programming. Our experiments on multiple domains, including visual reasoning and game playing, show that our approach can reduce solving times from over an hour to just 17 seconds.

Symmetry breaking for inductive logic programming

TL;DR

This work addresses the inefficiency caused by syntactic symmetries in ILP hypothesis spaces by introducing a variable-ordering–based symmetry-breaking method for body-variant rules. Implemented inside the Popper ILP system via an ASP encoding, the approach prunes redundant rules while remaining sound, though incomplete due to GI-hardness. Empirical evaluation across visual reasoning, game-playing, and real-world domains shows substantial reductions in solving times (sometimes from over an hour to tens of seconds) and meaningful learning-time improvements, particularly as task complexity grows. The method bridges ILP and constraint programming, yielding practical speedups and highlighting both the potential and the limitations of incomplete symmetry breaking in ILP.

Abstract

The goal of inductive logic programming is to search for a hypothesis that generalises training data and background knowledge. The challenge is searching vast hypothesis spaces, which is exacerbated because many logically equivalent hypotheses exist. To address this challenge, we introduce a method to break symmetries in the hypothesis space. We implement our idea in answer set programming. Our experiments on multiple domains, including visual reasoning and game playing, show that our approach can reduce solving times from over an hour to just 17 seconds.

Paper Structure

This paper contains 24 sections, 8 theorems, 9 equations, 4 figures.

Key Result

Proposition 1

The body-variant problem is GI-hardArvindDKT15 reduce graph isomorphism to hypergraph isomorphism. Using this reduction we can extend our reduction from binary to n-ary predicates..

Figures (4)

  • Figure 1: Positive (E$^+$ ) and negative (E$^-$) Zendo examples.
  • Figure 2: Solving time difference (minutes) with symmetry breaking. The tasks are ordered by improvement.
  • Figure 3: Solving times (minutes) of Popper with and without (baseline) symmetry breaking on one trains task. We vary the number of variables allowed in a rule and thus the size of the hypothesis space.
  • Figure 4: Learning time difference (minutes) with symmetry breaking. The tasks are ordered by improvement.

Theorems & Definitions (38)

  • Definition 1: ILP input
  • Definition 2: Cost function
  • Definition 3: Optimal hypothesis
  • Definition 4: Hypothesis space reduction problem
  • Definition 5: Body variant
  • Example 1
  • Definition 6: Body-variant problem
  • Proposition 1: Body-variant hardness
  • proof : Proof (sketch)
  • Definition 7: Hypothesis variant
  • ...and 28 more