Table of Contents
Fetching ...

Uniform inference for kernel instrumental variable regression

Marvin Lob, Rahul Singh, Suhas Vijaykumar

TL;DR

The paper develops a practical, nonparametric inference framework for kernel instrumental variable regression (KIV) by deriving valid and sharp uniform confidence bands. It introduces an anti-symmetric Gaussian multiplier bootstrap that requires only a single run of the KIV estimator, preserving the closed-form kernel structure. Central to the theory are low effective dimension, source and link smoothness conditions, and a strong instrument assumption, which together enable nonasymptotic Gaussian and bootstrap couplings in an ill-posed inverse problem. The results yield $ ext{H}_x$-norm confidence sets that translate into uniform sup-norm bands, providing researchers with reliable inference for nonlinear causal relationships estimated by KIV across nonstandard data types. This work thus substantially enhances the practical uptake of kernel methods for causal analysis in the social and biomedical sciences.

Abstract

Instrumental variable regression is a foundational tool for causal analysis across the social and biomedical sciences. Recent advances use kernel methods to estimate nonparametric causal relationships, with general data types, while retaining a simple closed-form expression. Empirical researchers ultimately need reliable inference on causal estimates; however, uniform confidence sets for the method remain unavailable. To fill this gap, we develop valid and sharp confidence sets for kernel instrumental variable regression, allowing general nonlinearities and data types. Computationally, our bootstrap procedure requires only a single run of the kernel instrumental variable regression estimator. Theoretically, it relies on the same key assumptions. Overall, we provide a practical procedure for inference that substantially increases the value of kernel methods for causal analysis.

Uniform inference for kernel instrumental variable regression

TL;DR

The paper develops a practical, nonparametric inference framework for kernel instrumental variable regression (KIV) by deriving valid and sharp uniform confidence bands. It introduces an anti-symmetric Gaussian multiplier bootstrap that requires only a single run of the KIV estimator, preserving the closed-form kernel structure. Central to the theory are low effective dimension, source and link smoothness conditions, and a strong instrument assumption, which together enable nonasymptotic Gaussian and bootstrap couplings in an ill-posed inverse problem. The results yield -norm confidence sets that translate into uniform sup-norm bands, providing researchers with reliable inference for nonlinear causal relationships estimated by KIV across nonstandard data types. This work thus substantially enhances the practical uptake of kernel methods for causal analysis in the social and biomedical sciences.

Abstract

Instrumental variable regression is a foundational tool for causal analysis across the social and biomedical sciences. Recent advances use kernel methods to estimate nonparametric causal relationships, with general data types, while retaining a simple closed-form expression. Empirical researchers ultimately need reliable inference on causal estimates; however, uniform confidence sets for the method remain unavailable. To fill this gap, we develop valid and sharp confidence sets for kernel instrumental variable regression, allowing general nonlinearities and data types. Computationally, our bootstrap procedure requires only a single run of the kernel instrumental variable regression estimator. Theoretically, it relies on the same key assumptions. Overall, we provide a practical procedure for inference that substantially increases the value of kernel methods for causal analysis.

Paper Structure

This paper contains 53 sections, 66 theorems, 312 equations, 3 tables, 2 algorithms.

Key Result

Theorem 3.1

For $\chi \in(0,1)$, define $\hat{t}_\chi$ by $\mathbb{P}\left(\|\mathfrak{B}\| > \hat{t}_\chi \middle| D\right)= \chi$. Suppose the data have low effective dimensions, i.e. $\nu_s(S_x)\asymp \omega_x s^{-1/(\rho_x-1)}$ and $\nu_s(S_z) \asymp \omega_z s^{-1/(\rho_z -1)}$. Suppose smoothness and str

Theorems & Definitions (129)

  • Example 2.1: Linear kernel
  • Example 2.2: Polynomial kernel
  • Example 2.3: Preference kernel
  • Definition 2.1: Validity
  • Definition 2.2: Sharpness
  • Definition 2.3: Local width
  • Theorem 3.1: Valid and sharp confidence sets
  • Corollary 3.1: Uniform confidence sets
  • Proposition 3.1: Bias upper bound
  • Theorem 3.2: Gaussian approximation
  • ...and 119 more