Table of Contents
Fetching ...

Kernel Single Proxy Control for Deterministic Confounding

Liyuan Xu, Arthur Gretton

TL;DR

This work tackles causal effect estimation under unobserved confounding when only a single proxy is available, showing that deterministic confounding enables recovery of the dose-response f_struct(a). It develops two kernel-based estimators, SKPV (two-stage regression) and SPMMR (maximum moment restriction), and proves their consistency, extending proxy causal learning to continuous treatments. By identifying a bridge function h_0 whose partial average over the proxy yields f_struct, the paper connects single-proxy methods to the broader PCL framework and demonstrates practical stability and numerical advantages. Empirical results on synthetic benchmarks, including high-dimensional proxies and sensitivity analyses, indicate robust recovery of causal effects even when deterministic assumptions are relaxed to bounded noise or informative-outcome conditions, highlighting the approach’s practical relevance for causal inference with limited proxies.

Abstract

We consider the problem of causal effect estimation with an unobserved confounder, where we observe a single proxy variable that is associated with the confounder. Although it has been shown that the recovery of an average causal effect is impossible in general from a single proxy variable, we show that causal recovery is possible if the outcome is generated deterministically. This generalizes existing work on causal methods with a single proxy variable to the continuous treatment setting. We propose two kernel-based methods for this setting: the first based on the two-stage regression approach, and the second based on a maximum moment restriction approach. We prove that both approaches can consistently estimate the causal effect, and we empirically demonstrate that we can successfully recover the causal effect on challenging synthetic benchmarks.

Kernel Single Proxy Control for Deterministic Confounding

TL;DR

This work tackles causal effect estimation under unobserved confounding when only a single proxy is available, showing that deterministic confounding enables recovery of the dose-response f_struct(a). It develops two kernel-based estimators, SKPV (two-stage regression) and SPMMR (maximum moment restriction), and proves their consistency, extending proxy causal learning to continuous treatments. By identifying a bridge function h_0 whose partial average over the proxy yields f_struct, the paper connects single-proxy methods to the broader PCL framework and demonstrates practical stability and numerical advantages. Empirical results on synthetic benchmarks, including high-dimensional proxies and sensitivity analyses, indicate robust recovery of causal effects even when deterministic assumptions are relaxed to bounded noise or informative-outcome conditions, highlighting the approach’s practical relevance for causal inference with limited proxies.

Abstract

We consider the problem of causal effect estimation with an unobserved confounder, where we observe a single proxy variable that is associated with the confounder. Although it has been shown that the recovery of an average causal effect is impossible in general from a single proxy variable, we show that causal recovery is possible if the outcome is generated deterministically. This generalizes existing work on causal methods with a single proxy variable to the continuous treatment setting. We propose two kernel-based methods for this setting: the first based on the two-stage regression approach, and the second based on a maximum moment restriction approach. We prove that both approaches can consistently estimate the causal effect, and we empirically demonstrate that we can successfully recover the causal effect on challenging synthetic benchmarks.
Paper Structure (41 sections, 16 theorems, 101 equations, 7 figures)

This paper contains 41 sections, 16 theorems, 101 equations, 7 figures.

Key Result

Theorem 3.1

Given assum:structuralassum:completeness-confounderassum:deterministic-confounding and assu:cond-exp-compactnessassu:cond-exp-L2assu:cond-exp-compactness presented in sec:existence-of-bridge-function, then there exists a bridge function $h_0(a,w)$ such that

Figures (7)

  • Figure 1: Causal graphs with proxy variables. Here, the bidirectional arrows mean that we allow an arrow in either direction, or even a common ancestor variable; and the thick arrow indicates a deterministic relationship between the variables.
  • Figure 2: Results for experiments. The red dotted line shows the error of the regression $\|\mathbb{E}_{}\left[Y|A\right]- f_\mathrm{struct}(A)\|^2$.
  • Figure 3: Plot of $\widetilde{\sin}_N(\pi U/2)$
  • Figure 4: Result for sensitivity analysis on informative assumption.The red dotted line shows the error of the regression $\|\mathbb{E}_{}\left[Y|A\right]- f_\mathrm{struct}(A)\|^2$.
  • Figure 5: Typical causal graph for the single proxy variable with observable confounder $X$. Here, the bidirectional arrows mean that we allow an arrow in either direction, or even a common ancestor variable; and the thick arrow indicates a deterministic relationship between the variables.
  • ...and 2 more figures

Theorems & Definitions (21)

  • Theorem 3.1
  • Proposition 3.2
  • proof
  • Theorem 3.3
  • Theorem 3.4
  • Theorem 4.1
  • Theorem 4.2
  • Proposition 4.3
  • Proposition 4.4
  • Theorem A.6
  • ...and 11 more