Table of Contents
Fetching ...

TimeX++: Learning Time-Series Explanations with Information Bottleneck

Zichuan Liu, Tianchun Wang, Jimeng Shi, Xu Zheng, Zhuomin Chen, Lei Song, Wenqian Dong, Jayantha Obeysekera, Farhad Shirani, Dongsheng Luo

TL;DR

TimeX++ tackles the need for interpretable explanations in time-series models by casting explainability as an information-theoretic problem and introducing a practical IB-based objective that avoids trivial solutions. The framework uses a parametric network to generate explanation-embedded, label-preserving, and in-distribution instances, enabling faithful explanations. Empirical validation on synthetic and real-world datasets, including an environmental case study, shows TimeX++ consistently outperforms baselines in explanation quality. The work delivers a scalable, practical approach to time-series explainability and provides open-source code for reproduction.

Abstract

Explaining deep learning models operating on time series data is crucial in various applications of interest which require interpretable and transparent insights from time series signals. In this work, we investigate this problem from an information theoretic perspective and show that most existing measures of explainability may suffer from trivial solutions and distributional shift issues. To address these issues, we introduce a simple yet practical objective function for time series explainable learning. The design of the objective function builds upon the principle of information bottleneck (IB), and modifies the IB objective function to avoid trivial solutions and distributional shift issues. We further present TimeX++, a novel explanation framework that leverages a parametric network to produce explanation-embedded instances that are both in-distributed and label-preserving. We evaluate TimeX++ on both synthetic and real-world datasets comparing its performance against leading baselines, and validate its practical efficacy through case studies in a real-world environmental application. Quantitative and qualitative evaluations show that TimeX++ outperforms baselines across all datasets, demonstrating a substantial improvement in explanation quality for time series data. The source code is available at \url{https://github.com/zichuan-liu/TimeXplusplus}.

TimeX++: Learning Time-Series Explanations with Information Bottleneck

TL;DR

TimeX++ tackles the need for interpretable explanations in time-series models by casting explainability as an information-theoretic problem and introducing a practical IB-based objective that avoids trivial solutions. The framework uses a parametric network to generate explanation-embedded, label-preserving, and in-distribution instances, enabling faithful explanations. Empirical validation on synthetic and real-world datasets, including an environmental case study, shows TimeX++ consistently outperforms baselines in explanation quality. The work delivers a scalable, practical approach to time-series explainability and provides open-source code for reproduction.

Abstract

Explaining deep learning models operating on time series data is crucial in various applications of interest which require interpretable and transparent insights from time series signals. In this work, we investigate this problem from an information theoretic perspective and show that most existing measures of explainability may suffer from trivial solutions and distributional shift issues. To address these issues, we introduce a simple yet practical objective function for time series explainable learning. The design of the objective function builds upon the principle of information bottleneck (IB), and modifies the IB objective function to avoid trivial solutions and distributional shift issues. We further present TimeX++, a novel explanation framework that leverages a parametric network to produce explanation-embedded instances that are both in-distributed and label-preserving. We evaluate TimeX++ on both synthetic and real-world datasets comparing its performance against leading baselines, and validate its practical efficacy through case studies in a real-world environmental application. Quantitative and qualitative evaluations show that TimeX++ outperforms baselines across all datasets, demonstrating a substantial improvement in explanation quality for time series data. The source code is available at \url{https://github.com/zichuan-liu/TimeXplusplus}.
Paper Structure (19 sections, 4 theorems, 1 equation, 1 figure, 1 table, 1 algorithm)

This paper contains 19 sections, 4 theorems, 1 equation, 1 figure, 1 table, 1 algorithm.

Key Result

Proposition 2.2

If $f$ is injective mapping a set $X$ to another set $Y$, the cardinality of $Y$ is at least as large as that of $X$

Figures (1)

  • Figure 1: Historical locations and number of accepted papers for International Machine Learning Conferences (ICML 1993 -- ICML 2008) and International Workshops on Machine Learning (ML 1988 -- ML 1992). At the time this figure was produced, the number of accepted papers for ICML 2008 was unknown and instead estimated.

Theorems & Definitions (7)

  • Definition 2.1
  • Proposition 2.2
  • proof
  • Lemma 2.3
  • Theorem 2.4
  • Corollary 2.5
  • Remark 2.7