Table of Contents
Fetching ...

Estimation and Inference for Causal Explainability

Weihan Zhang, Zijun Gao

TL;DR

This work develops a semi-parametric framework to estimate and infer causal explainability quantified by Causal ANOVA quantities $\xi$, under independent treatments. It introduces efficient influence functions and a one-step correction estimator that exploits independence to achieve lower asymptotic variance than standard approaches, while remaining robust to nuisance estimation through cross-fitting. For degenerate nulls where explainability is zero, the authors propose a randomization-based procedure and a sequential inference strategy that preserves valid coverage without requiring data-splitting or noise injection. The methods are demonstrated via simulations and a real immigration conjoint dataset, revealing nonzero explainability for multiple attributes and a notable interaction between Job Plan and Job Experience, highlighting the practical impact for scientific explanation and policy analysis.

Abstract

Understanding how much each variable contributes to an outcome is a central question across disciplines. A causal view of explainability is favorable for its ability in uncovering underlying mechanisms and generalizing to new contexts. Based on a family of causal explainability quantities, we develop methods for their estimation and inference. In particular, we construct a one-step correction estimator using semi-parametric efficiency theory, which explicitly leverages the independence structure of variables to reduce the asymptotic variance. For a null hypothesis on the boundary, i.e., zero explainability, we show its equivalence to Fisher's sharp null, which motivates a randomization-based inference procedure. Finally, we illustrate the empirical efficacy of our approach through simulations as well as an immigration experiment dataset, where we investigate how features and their interactions shape public opinion toward admitting immigrants.

Estimation and Inference for Causal Explainability

TL;DR

This work develops a semi-parametric framework to estimate and infer causal explainability quantified by Causal ANOVA quantities , under independent treatments. It introduces efficient influence functions and a one-step correction estimator that exploits independence to achieve lower asymptotic variance than standard approaches, while remaining robust to nuisance estimation through cross-fitting. For degenerate nulls where explainability is zero, the authors propose a randomization-based procedure and a sequential inference strategy that preserves valid coverage without requiring data-splitting or noise injection. The methods are demonstrated via simulations and a real immigration conjoint dataset, revealing nonzero explainability for multiple attributes and a notable interaction between Job Plan and Job Experience, highlighting the practical impact for scientific explanation and policy analysis.

Abstract

Understanding how much each variable contributes to an outcome is a central question across disciplines. A causal view of explainability is favorable for its ability in uncovering underlying mechanisms and generalizing to new contexts. Based on a family of causal explainability quantities, we develop methods for their estimation and inference. In particular, we construct a one-step correction estimator using semi-parametric efficiency theory, which explicitly leverages the independence structure of variables to reduce the asymptotic variance. For a null hypothesis on the boundary, i.e., zero explainability, we show its equivalence to Fisher's sharp null, which motivates a randomization-based inference procedure. Finally, we illustrate the empirical efficacy of our approach through simulations as well as an immigration experiment dataset, where we investigate how features and their interactions shape public opinion toward admitting immigrants.
Paper Structure (39 sections, 20 theorems, 125 equations, 5 figures, 7 tables, 3 algorithms)

This paper contains 39 sections, 20 theorems, 125 equations, 5 figures, 7 tables, 3 algorithms.

Key Result

Proposition 1

Under assu:independent and assu:additive.independent.error, for any $\mathcal{S} \subseteq [K]$, defi:total.independent is identifiable and admits the form,

Figures (5)

  • Figure 1: Comparison of bias (left panel), estimated standard deviation times sample size (mid panel), and coverage rate (right panel; significance level $\alpha = 0.05$). $\varphi_{{\text{EIF}}}$-based method in blue, $\varphi_{{\text{IF}}}$-based method in gold. True nuisance functions are used. Results aggregated over $1000$ trials.
  • Figure 2: Comparison using estimated nuisance functions (details in the caption of \ref{['fig:simulation1']}). Results aggregated over $100$ trials.
  • Figure 3: Total and interaction explainability of immigrant attributes for admission.
  • Figure 4: Influence functions of total and interaction explainabilities: zeroth-order, first-order, second-order interaction terms are highlighted in red, blue, and white, respectively. The dependence is derived from the inclusion-exclusion principle and the linearity of influence functions.
  • Figure 5: Comparison of bias (left panel), estimated standard deviation times sample size (mid panel), and coverage rate (right panel; significance level $\alpha = 0.05$) with varying noise magnitude. $\varphi_{{\text{EIF}}}$-based method in blue, $\varphi_{{\text{IF}}}$-based method in gold. True nuisance functions are used. Results aggregated over $1000$ trials.

Theorems & Definitions (39)

  • Definition 1: Total explainability
  • Definition 2: Interaction explainability
  • Proposition 1
  • Corollary 1
  • Proposition 2
  • Remark 1
  • Proposition 3: One-step correction estimator based on $\varphi_{{\text{IF}}}$
  • Proposition 4: One-step correction estimator based on $\varphi_{{\text{EIF}}}$
  • Corollary 2
  • Proposition 5
  • ...and 29 more