Table of Contents
Fetching ...

SAGDFN: A Scalable Adaptive Graph Diffusion Forecasting Network for Multivariate Time Series Forecasting

Yue Jiang, Xiucheng Li, Yile Chen, Shuai Liu, Weilong Kong, Antonis F. Lentzakis, Gao Cong

TL;DR

SAGDFN targets scalable multivariate time series forecasting by learning a slim, data-driven graph diffusion structure. It combines Significant Neighbors Sampling with Sparse Spatial Multi-Head Attention to produce a compact adjacency matrix, reducing diffusion complexity from $O(N^2)$ to $O(NM)$ while mitigating noise through $\alpha$-Entmax. An Encoder-Decoder forecasting backbone with OneStepFastGConv enables end-to-end temporal-spatial modeling, achieving state-of-the-art or strong results on large-scale datasets without relying on predefined graphs. The approach demonstrates clear practical impact for real-world, thousands-of-sensors forecasting scenarios by offering both high accuracy and manageable computational resources.

Abstract

Time series forecasting is essential for our daily activities and precise modeling of the complex correlations and shared patterns among multiple time series is essential for improving forecasting performance. Spatial-Temporal Graph Neural Networks (STGNNs) are widely used in multivariate time series forecasting tasks and have achieved promising performance on multiple real-world datasets for their ability to model the underlying complex spatial and temporal dependencies. However, existing studies have mainly focused on datasets comprising only a few hundred sensors due to the heavy computational cost and memory cost of spatial-temporal GNNs. When applied to larger datasets, these methods fail to capture the underlying complex spatial dependencies and exhibit limited scalability and performance. To this end, we present a Scalable Adaptive Graph Diffusion Forecasting Network (SAGDFN) to capture complex spatial-temporal correlation for large-scale multivariate time series and thereby, leading to exceptional performance in multivariate time series forecasting tasks. The proposed SAGDFN is scalable to datasets of thousands of nodes without the need of prior knowledge of spatial correlation. Extensive experiments demonstrate that SAGDFN achieves comparable performance with state-of-the-art baselines on one real-world dataset of 207 nodes and outperforms all state-of-the-art baselines by a significant margin on three real-world datasets of 2000 nodes.

SAGDFN: A Scalable Adaptive Graph Diffusion Forecasting Network for Multivariate Time Series Forecasting

TL;DR

SAGDFN targets scalable multivariate time series forecasting by learning a slim, data-driven graph diffusion structure. It combines Significant Neighbors Sampling with Sparse Spatial Multi-Head Attention to produce a compact adjacency matrix, reducing diffusion complexity from to while mitigating noise through -Entmax. An Encoder-Decoder forecasting backbone with OneStepFastGConv enables end-to-end temporal-spatial modeling, achieving state-of-the-art or strong results on large-scale datasets without relying on predefined graphs. The approach demonstrates clear practical impact for real-world, thousands-of-sensors forecasting scenarios by offering both high accuracy and manageable computational resources.

Abstract

Time series forecasting is essential for our daily activities and precise modeling of the complex correlations and shared patterns among multiple time series is essential for improving forecasting performance. Spatial-Temporal Graph Neural Networks (STGNNs) are widely used in multivariate time series forecasting tasks and have achieved promising performance on multiple real-world datasets for their ability to model the underlying complex spatial and temporal dependencies. However, existing studies have mainly focused on datasets comprising only a few hundred sensors due to the heavy computational cost and memory cost of spatial-temporal GNNs. When applied to larger datasets, these methods fail to capture the underlying complex spatial dependencies and exhibit limited scalability and performance. To this end, we present a Scalable Adaptive Graph Diffusion Forecasting Network (SAGDFN) to capture complex spatial-temporal correlation for large-scale multivariate time series and thereby, leading to exceptional performance in multivariate time series forecasting tasks. The proposed SAGDFN is scalable to datasets of thousands of nodes without the need of prior knowledge of spatial correlation. Extensive experiments demonstrate that SAGDFN achieves comparable performance with state-of-the-art baselines on one real-world dataset of 207 nodes and outperforms all state-of-the-art baselines by a significant margin on three real-world datasets of 2000 nodes.
Paper Structure (19 sections, 7 equations, 4 figures, 10 tables, 2 algorithms)

This paper contains 19 sections, 7 equations, 4 figures, 10 tables, 2 algorithms.

Figures (4)

  • Figure 1: The overall architecture of the proposed SAGDFN framework. The Significant Neighbors Sampling module (green) and the Sparse Spatial Multi-Head Attention module (yellow) learn the slim adjacency matrix (pink) which will be employed in each OneStepFastGConv cell (orange).
  • Figure 2: Diffusion threshold M for Sensor 883 of London2000 dataset.
  • Figure 3: Hyper-parameter study.
  • Figure 4: Visualizations on the METR-LA & CARPARK1918 datasets.

Theorems & Definitions (5)

  • Example 1
  • Example 2
  • Definition 1
  • Definition 2
  • Definition 3