Table of Contents
Fetching ...

Task-oriented Time Series Imputation Evaluation via Generalized Representers

Zhixian Wang, Linxiao Yang, Liang Sun, Qingsong Wen, Yi Wang

TL;DR

This paper proposes an efficient downstream task-oriented time series imputation evaluation approach by combining time series imputation with neural network models used for downstream tasks, and the gain of different imputation strategies on downstream tasks is estimated without retraining.

Abstract

Time series analysis is widely used in many fields such as power energy, economics, and transportation, including different tasks such as forecasting, anomaly detection, classification, etc. Missing values are widely observed in these tasks, and often leading to unpredictable negative effects on existing methods, hindering their further application. In response to this situation, existing time series imputation methods mainly focus on restoring sequences based on their data characteristics, while ignoring the performance of the restored sequences in downstream tasks. Considering different requirements of downstream tasks (e.g., forecasting), this paper proposes an efficient downstream task-oriented time series imputation evaluation approach. By combining time series imputation with neural network models used for downstream tasks, the gain of different imputation strategies on downstream tasks is estimated without retraining, and the most favorable imputation value for downstream tasks is given by combining different imputation strategies according to the estimated gain.

Task-oriented Time Series Imputation Evaluation via Generalized Representers

TL;DR

This paper proposes an efficient downstream task-oriented time series imputation evaluation approach by combining time series imputation with neural network models used for downstream tasks, and the gain of different imputation strategies on downstream tasks is estimated without retraining.

Abstract

Time series analysis is widely used in many fields such as power energy, economics, and transportation, including different tasks such as forecasting, anomaly detection, classification, etc. Missing values are widely observed in these tasks, and often leading to unpredictable negative effects on existing methods, hindering their further application. In response to this situation, existing time series imputation methods mainly focus on restoring sequences based on their data characteristics, while ignoring the performance of the restored sequences in downstream tasks. Considering different requirements of downstream tasks (e.g., forecasting), this paper proposes an efficient downstream task-oriented time series imputation evaluation approach. By combining time series imputation with neural network models used for downstream tasks, the gain of different imputation strategies on downstream tasks is estimated without retraining, and the most favorable imputation value for downstream tasks is given by combining different imputation strategies according to the estimated gain.

Paper Structure

This paper contains 36 sections, 20 equations, 9 figures, 11 tables, 1 algorithm.

Figures (9)

  • Figure 1: The correlation and accuracy comparison between the estimation of imputation value gain and actual gain (MSE$\downarrow$), where INF (section \ref{['INF']}) represents our modified Influence Function, Seq-sim represents our original method, and Seg-N represents the acceleration method divided by N segments. The horizontal axis here represents selecting the sample with the highest x% influence based on the absolute value of the estimation.
  • Figure 2: Visualization of simulated data
  • Figure 3: The correlation and accuracy comparison between the estimation of our original method and the acceleration method.
  • Figure 4: Visualization of forecasting result on AIR
  • Figure 5: Visualization of forecasting result on ELECTRICITY
  • ...and 4 more figures

Theorems & Definitions (2)

  • Remark 1
  • Remark 1