Time Series Treatment Effects Analysis with Always-Missing Controls
Juan Shu, Qiyu Han, George Chen, Xihao Cao, Kangming Luo, Dan Pallotta, Shivam Agrawal, Yuping Lu, Xiaoyu Zhang, Jawad Mansoor, Jyoti Anand
TL;DR
This paper tackles causal inference in time series when the control group is unobservable during treatment, such as holiday periods. The authors introduce a predictive-model–based synthetic-control framework with a temporal adaptive loss to recover counterfactual outcomes $\hat{Y}_{i,t}(0)$ from non-treatment periods and compute treatment effects $\hat{\delta}_t$. Under a baseline AR(1) process, they establish asymptotic normality: $\sqrt{N}(\hat{\delta}-\delta)\xrightarrow{d} \mathcal{N}(\mathbf{0},\Sigma)$ with diagonal $\Sigma$ and $\Sigma_{t,t}=\sigma^2/(1-\phi^2)$. Empirical validation on Walmart M5 data shows accurate holiday-effect estimation and robust consistency across years. The framework generalizes to other time-series causal-inference settings lacking observable controls.
Abstract
Estimating treatment effects in time series data presents a significant challenge, especially when the control group is always unobservable. For example, in analyzing the effects of Christmas on retail sales, we lack direct observation of what would have occurred in late December without the Christmas impact. To address this, we try to recover the control group in the event period while accounting for confounders and temporal dependencies. Experimental results on the M5 Walmart retail sales data demonstrate robust estimation of the potential outcome of the control group as well as accurate predicted holiday effect. Furthermore, we provided theoretical guarantees for the estimated treatment effect, proving its consistency and asymptotic normality. The proposed methodology is applicable not only to this always-missing control scenario but also in other conventional time series causal inference settings.
