Inference of Abstraction for Grounded Predicate Logic
Hiroyuki Kido
TL;DR
The paper tackles how to ground predicate logic in data to achieve meaningful abstraction by introducing a data-to-model-to-formula joint distribution that treats formulas as abstractions of models and models as abstractions of data. It formalizes data support models, models support formulas, and a predicate-reasoning mechanism that yields empirical and probabilistic generalizations of logical consequence, including reasoning from possible and impossible information with a tunable parameter $\mu\in[0.5,1]$. The key contributions include a concrete probabilistic framework for predicative abstraction, a derivation of conditional-independence properties, and demonstrations of empirical-consequence generalization and two-mode applicability to simple tasks, along with proofs. The work offers a novel lens on symbol grounding and tractable predicate reasoning, and outlines directions for integrating learning of the mapping from data to models and vocabulary design for creative abstraction.
Abstract
An important open question in AI is what simple and natural principle enables a machine to reason logically for meaningful abstraction with grounded symbols. This paper explores a conceptually new approach to combining probabilistic reasoning and predicative symbolic reasoning over data. We return to the era of reasoning with a full joint distribution before the advent of Bayesian networks. We then discuss that a full joint distribution over models of exponential size in propositional logic and of infinite size in predicate logic should be simply derived from a full joint distribution over data of linear size. We show that the same process is not only enough to generalise the logical consequence relation of predicate logic but also to provide a new perspective to rethink well-known limitations such as the undecidability of predicate logic, the symbol grounding problem and the principle of explosion. The reproducibility of this theoretical work is fully demonstrated by the included proofs.
