Logo
ScienceStack
Table of Contents
Fetching ...
Sign In

A Mathematical Theory of Understanding

Bahar Taşkesen

Abstract

Generative AI has transformed the economics of information production, making explanations, proofs, examples, and analyses available at very low cost. Yet the value of information still depends on whether downstream users can absorb and act on it. A signal conveys meaning only to a learner with the structural capacity to decode it: an explanation that clarifies a concept for one user may be indistinguishable from noise to another who lacks the relevant prerequisites. This paper develops a mathematical model of that learner-side bottleneck. We model the learner as a mind, an abstract learning system characterized by a prerequisite structure over concepts. A mind may represent a human learner, an artificial learner such as a neural network, or any agent whose ability to interpret signals depends on previously acquired concepts. Teaching is modeled as sequential communication with a latent target. Because instructional signals are usable only when the learner has acquired the prerequisites needed to parse them, the effective communication channel depends on the learner's current state of knowledge and becomes more informative as learning progresses. The model yields two limits on the speed of learning and adoption: a structural limit determined by prerequisite reachability and an epistemic limit determined by uncertainty about the target. The framework implies threshold effects in training and capability acquisition. When the teaching horizon lies below the prerequisite depth of the target, additional instruction cannot produce successful completion of teaching; once that depth is reached, completion becomes feasible. Across heterogeneous learners, a common broadcast curriculum can be slower than personalized instruction by a factor linear in the number of learner types.

A Mathematical Theory of Understanding

Abstract

Generative AI has transformed the economics of information production, making explanations, proofs, examples, and analyses available at very low cost. Yet the value of information still depends on whether downstream users can absorb and act on it. A signal conveys meaning only to a learner with the structural capacity to decode it: an explanation that clarifies a concept for one user may be indistinguishable from noise to another who lacks the relevant prerequisites. This paper develops a mathematical model of that learner-side bottleneck. We model the learner as a mind, an abstract learning system characterized by a prerequisite structure over concepts. A mind may represent a human learner, an artificial learner such as a neural network, or any agent whose ability to interpret signals depends on previously acquired concepts. Teaching is modeled as sequential communication with a latent target. Because instructional signals are usable only when the learner has acquired the prerequisites needed to parse them, the effective communication channel depends on the learner's current state of knowledge and becomes more informative as learning progresses. The model yields two limits on the speed of learning and adoption: a structural limit determined by prerequisite reachability and an epistemic limit determined by uncertainty about the target. The framework implies threshold effects in training and capability acquisition. When the teaching horizon lies below the prerequisite depth of the target, additional instruction cannot produce successful completion of teaching; once that depth is reached, completion becomes feasible. Across heterogeneous learners, a common broadcast curriculum can be slower than personalized instruction by a factor linear in the number of learner types.
Paper Structure (26 sections, 35 theorems, 123 equations, 2 figures)

This paper contains 26 sections, 35 theorems, 123 equations, 2 figures.

Table of Contents

  1. Introduction
  2. Related literature.
  3. Notation and conventions.
  4. Understanding as a Closure System
  5. Derivations and Equivalence
  6. Ordered and Unordered Information
  7. Reachable acquired concept sets
  8. Teaching and Learning Dynamics
  9. A Stochastic Model of Teaching
  10. Dynamics.
  11. The Epistemic Arrow of Time
  12. Information-theoretic quantities.
  13. Prerequisites and the Relativity of Randomness
  14. Speed Limits of Teaching
  15. Identification and state-dependent capacity
  16. ...and 11 more sections

Key Result

Lemma 2.7

If $\mathcal{K} \subseteq \mathcal{K}'$, then $\Phi_\mathfrak{m}(\mathcal{K}) \subseteq \Phi_\mathfrak{m}(\mathcal{K}')$.

Figures (2)

  • Figure 1: Derivation trees for $d$ (multiplication) from $\mathcal{K} = \{a\}$ (counting) in the two minds of \ref{['ex:arithmetic-minds']}. Each tree is read bottom-up: leaves are concepts already known; each internal node is derived from its children by the expansion rule shown alongside. The root $d$ is the concept being derived. Both trees witness that $d$ belongs to the corresponding understanding closure of $\{a\}$, but through different intermediate paths.
  • Figure 2: The reachable family $\mathbb K_\mathfrak{m}$ for a mind with axiom set $\mathcal{A}_\mathfrak{m}=\{a\}$ and expansion rules $\{a\}\Rightarrow b$, $\{a\}\Rightarrow c$, $\{b,c\}\Rightarrow d$. The concept $d$ becomes reachable only at $\{a,b,c\}$, where both prerequisites are present. Sets such as $\{a,b,d\}$ are structurally unreachable.

Theorems & Definitions (79)

  • Definition 2.1: Concept space
  • Definition 2.2: Mind
  • Remark 2.3
  • Example 2.4: Two minds learning arithmetic
  • Example 2.5: Two minds learning text editing on a computer
  • Definition 2.6: One-step expansion
  • Lemma 2.7: Monotonicity
  • Definition 2.8
  • Remark 2.9
  • Proposition 2.10: Existence and characterization
  • ...and 69 more