Table of Contents
Fetching ...

SelfGNN: Self-Supervised Graph Neural Networks for Sequential Recommendation

Yuxi Liu, Lianghao Xia, Chao Huang

TL;DR

SelfGNN tackles the dual challenges of noisy short-term behaviors and missing cross-user short-term signals in sequential recommendation by integrating short-term collaborative graphs with multi-level long-term sequence modeling. It introduces interval-based short-term graphs encoded by GCNs, interval-level GRU attention, and instance-level self-attention to capture both periodic and item-level dynamics, augmented by a personalized denoising self-supervision that aligns short- and long-term views using user-specific weights. Empirical results on four real-world datasets show SelfGNN consistently surpasses state-of-the-art baselines in HR and NDCG, with ablations confirming the value of each component, especially the SAL-based noise denoising. The approach offers practical robustness to data sparsity and noise, underscoring the benefits of combining dynamic graph signals with self-supervised denoising for personalized, reliable sequential recommendations.

Abstract

Sequential recommendation effectively addresses information overload by modeling users' temporal and sequential interaction patterns. To overcome the limitations of supervision signals, recent approaches have adopted self-supervised learning techniques in recommender systems. However, there are still two critical challenges that remain unsolved. Firstly, existing sequential models primarily focus on long-term modeling of individual interaction sequences, overlooking the valuable short-term collaborative relationships among the behaviors of different users. Secondly, real-world data often contain noise, particularly in users' short-term behaviors, which can arise from temporary intents or misclicks. Such noise negatively impacts the accuracy of both graph and sequence models, further complicating the modeling process. To address these challenges, we propose a novel framework called Self-Supervised Graph Neural Network (SelfGNN) for sequential recommendation. The SelfGNN framework encodes short-term graphs based on time intervals and utilizes Graph Neural Networks (GNNs) to learn short-term collaborative relationships. It captures long-term user and item representations at multiple granularity levels through interval fusion and dynamic behavior modeling. Importantly, our personalized self-augmented learning structure enhances model robustness by mitigating noise in short-term graphs based on long-term user interests and personal stability. Extensive experiments conducted on four real-world datasets demonstrate that SelfGNN outperforms various state-of-the-art baselines. Our model implementation codes are available at https://github.com/HKUDS/SelfGNN.

SelfGNN: Self-Supervised Graph Neural Networks for Sequential Recommendation

TL;DR

SelfGNN tackles the dual challenges of noisy short-term behaviors and missing cross-user short-term signals in sequential recommendation by integrating short-term collaborative graphs with multi-level long-term sequence modeling. It introduces interval-based short-term graphs encoded by GCNs, interval-level GRU attention, and instance-level self-attention to capture both periodic and item-level dynamics, augmented by a personalized denoising self-supervision that aligns short- and long-term views using user-specific weights. Empirical results on four real-world datasets show SelfGNN consistently surpasses state-of-the-art baselines in HR and NDCG, with ablations confirming the value of each component, especially the SAL-based noise denoising. The approach offers practical robustness to data sparsity and noise, underscoring the benefits of combining dynamic graph signals with self-supervised denoising for personalized, reliable sequential recommendations.

Abstract

Sequential recommendation effectively addresses information overload by modeling users' temporal and sequential interaction patterns. To overcome the limitations of supervision signals, recent approaches have adopted self-supervised learning techniques in recommender systems. However, there are still two critical challenges that remain unsolved. Firstly, existing sequential models primarily focus on long-term modeling of individual interaction sequences, overlooking the valuable short-term collaborative relationships among the behaviors of different users. Secondly, real-world data often contain noise, particularly in users' short-term behaviors, which can arise from temporary intents or misclicks. Such noise negatively impacts the accuracy of both graph and sequence models, further complicating the modeling process. To address these challenges, we propose a novel framework called Self-Supervised Graph Neural Network (SelfGNN) for sequential recommendation. The SelfGNN framework encodes short-term graphs based on time intervals and utilizes Graph Neural Networks (GNNs) to learn short-term collaborative relationships. It captures long-term user and item representations at multiple granularity levels through interval fusion and dynamic behavior modeling. Importantly, our personalized self-augmented learning structure enhances model robustness by mitigating noise in short-term graphs based on long-term user interests and personal stability. Extensive experiments conducted on four real-world datasets demonstrate that SelfGNN outperforms various state-of-the-art baselines. Our model implementation codes are available at https://github.com/HKUDS/SelfGNN.
Paper Structure (30 sections, 17 equations, 7 figures, 4 tables, 1 algorithm)

This paper contains 30 sections, 17 equations, 7 figures, 4 tables, 1 algorithm.

Figures (7)

  • Figure 1: Illustrative examples reflecting collaborative relations (between $u_1$ and $u_2$ in first period, between $u_2$ and $u_3$ in second period), temporal intents ($u_2$ adopting $i_3$), interest shift ($u_3$), and user with variable interests ($u_4$).
  • Figure 2: Overall framework of the proposed SelfGNN model.
  • Figure 3: Workflow of the personalized SSL paradigm.
  • Figure 4: Relative performance degradation w.r.t noise ratio.
  • Figure 5: Performance w.r.t interaction degrees.
  • ...and 2 more figures