A Self-explainable Model of Long Time Series by Extracting Informative Structured Causal Patterns
Ziqian Wang, Yuxiao Cheng, Jinli Suo
TL;DR
<3-5 sentence high-level summary> EXCAP tackles the challenge of making long time-series models explainable by jointly learning temporally coherent segment-level explanations and causally grounded predictions. It introduces a three-component architecture—attention-based segmenter, encoder, and interpretable causal decoder guided by a pre-trained graph—augmented with latent-space aggregation losses and a staged optimization schedule. The approach provides theoretical guarantees on temporal continuity, faithfulness, and efficiency, and demonstrates superior interpretability alongside competitive predictive performance on classification and forecasting benchmarks. The framework scales linearly with sequence length and holds promise for high-stakes domains requiring trustworthy and actionable explanations.
Abstract
Explainability is essential for neural networks that model long time series, yet most existing explainable AI methods only produce point-wise importance scores and fail to capture temporal structures such as trends, cycles, and regime changes. This limitation weakens human interpretability and trust in long-horizon models. To address these issues, we identify four key requirements for interpretable time-series modeling: temporal continuity, pattern-centric explanation, causal disentanglement, and faithfulness to the model's inference process. We propose EXCAP, a unified framework that satisfies all four requirements. EXCAP combines an attention-based segmenter that extracts coherent temporal patterns, a causally structured decoder guided by a pre-trained causal graph, and a latent aggregation mechanism that enforces representation stability. Our theoretical analysis shows that EXCAP provides smooth and stable explanations over time and is robust to perturbations in causal masks. Extensive experiments on classification and forecasting benchmarks demonstrate that EXCAP achieves strong predictive accuracy while generating coherent and causally grounded explanations. These results show that EXCAP offers a principled and scalable approach to interpretable modeling of long time series with relevance to high-stakes domains such as healthcare and finance.
