Table of Contents
Fetching ...

A Dynamical View of the Question of Why

Mehdi Fatemi, Sindhu Gowda

TL;DR

The paper develops a process-based framework for causation in dynamical systems, reframing causal questions as RL problems over diffusion/MDP dynamics. By introducing grit $\Gamma_B$ and reachability $\Lambda_B$ and proving two fundamental lemmas, it provides a principled way to quantify how events contribute to future outcomes and to decompose this influence across state and action components. The approach yields formal causation criteria (including sufficiency and necessity notions) that separate true causal effects from mere correlations, and it demonstrates practical applicability through Pong and a Type-1 Diabetes simulator without requiring explicit structural models. This work advances causal inference in time-evolving systems, enabling data-driven discovery of cause-effect relations in complex, high-dimensional processes with potential broad impact across engineering and biomedical domains.

Abstract

We address causal reasoning in multivariate time series data generated by stochastic processes. Existing approaches are largely restricted to static settings, ignoring the continuity and emission of variations across time. In contrast, we propose a learning paradigm that directly establishes causation between events in the course of time. We present two key lemmas to compute causal contributions and frame them as reinforcement learning problems. Our approach offers formal and computational tools for uncovering and quantifying causal relationships in diffusion processes, subsuming various important settings such as discrete-time Markov decision processes. Finally, in fairly intricate experiments and through sheer learning, our framework reveals and quantifies causal links, which otherwise seem inexplicable.

A Dynamical View of the Question of Why

TL;DR

The paper develops a process-based framework for causation in dynamical systems, reframing causal questions as RL problems over diffusion/MDP dynamics. By introducing grit and reachability and proving two fundamental lemmas, it provides a principled way to quantify how events contribute to future outcomes and to decompose this influence across state and action components. The approach yields formal causation criteria (including sufficiency and necessity notions) that separate true causal effects from mere correlations, and it demonstrates practical applicability through Pong and a Type-1 Diabetes simulator without requiring explicit structural models. This work advances causal inference in time-evolving systems, enabling data-driven discovery of cause-effect relations in complex, high-dimensional processes with potential broad impact across engineering and biomedical domains.

Abstract

We address causal reasoning in multivariate time series data generated by stochastic processes. Existing approaches are largely restricted to static settings, ignoring the continuity and emission of variations across time. In contrast, we propose a learning paradigm that directly establishes causation between events in the course of time. We present two key lemmas to compute causal contributions and frame them as reinforcement learning problems. Our approach offers formal and computational tools for uncovering and quantifying causal relationships in diffusion processes, subsuming various important settings such as discrete-time Markov decision processes. Finally, in fairly intricate experiments and through sheer learning, our framework reveals and quantifies causal links, which otherwise seem inexplicable.
Paper Structure (39 sections, 14 theorems, 35 equations, 3 figures, 1 table)

This paper contains 39 sections, 14 theorems, 35 equations, 3 figures, 1 table.

Key Result

Lemma 1

Let $[T, T']$ be the duration of event $B$'s occurrence, and the state only admits $\textbf{x}_B$ at $t=T'$ (all states that admit $\textbf{x}_B$ are terminal). Define two MDPs $M_{\Gamma}$ and $M_{\Lambda}$ identical to $M$ with their rewards being zero if $B$ does not happen. Otherwise, $R_{\Gamma

Figures (3)

  • Figure 1: Atari game of Pong.$\nabla\Gamma$ is shown from red ($\ge 1$) to blue ($\le -1$). Probing $g$ and $\Gamma(\textbf{x})$ at frames 49 to 51 reveals the cause of losing score. Moreover, a sufficient cause is realized at frame 51.
  • Figure 2: Diabetes simulator. Cause events are depicted with $*$ markers and the effect event $B$ (BG $< 70$) with $\blacktriangle$ marker. The simulation ends when event $B$ happens. The last two lines are change of grit computed from $V_{\Gamma}$ directly and from decomposition lemma (which are consistent).
  • Figure 3: Diabetes simulator. Individual contributions of each signal towards the total grit.

Theorems & Definitions (24)

  • Definition 1: Causation
  • Lemma 1: Value Lemma
  • Lemma 2: Decomposition Lemma
  • Proposition 1: Unity Proposition
  • Proposition 2: Null Proposition
  • Proposition 3
  • Proposition 4: Causation
  • Proposition 5: Sufficient Causation
  • Proposition 6: Necessary Causation
  • Lemma 1: Value Lemma
  • ...and 14 more