Table of Contents
Fetching ...

Self-supervised Contrastive Learning for Implicit Collaborative Filtering

Shipeng Song, Bin Liu, Fei Teng, Tianrui Li

TL;DR

A simple self-supervised contrastive learning framework that leverages positive feature augmentation and negative label augmentation to improve the self-supervisory signal is proposed and theoretical analysis demonstrates that the learning method is equivalent to maximizing the likelihood estimation with latent variables representing user interest centers.

Abstract

Contrastive learning-based recommendation algorithms have significantly advanced the field of self-supervised recommendation, particularly with BPR as a representative ranking prediction task that dominates implicit collaborative filtering. However, the presence of false-positive and false-negative examples in recommendation systems hampers accurate preference learning. In this study, we propose a simple self-supervised contrastive learning framework that leverages positive feature augmentation and negative label augmentation to improve the self-supervisory signal. Theoretical analysis demonstrates that our learning method is equivalent to maximizing the likelihood estimation with latent variables representing user interest centers. Additionally, we establish an efficient negative label augmentation technique that samples unlabeled examples with a probability linearly dependent on their relative ranking positions, enabling efficient augmentation in constant time complexity. Through validation on multiple datasets, we illustrate the significant improvements our method achieves over the widely used BPR optimization objective while maintaining comparable runtime.

Self-supervised Contrastive Learning for Implicit Collaborative Filtering

TL;DR

A simple self-supervised contrastive learning framework that leverages positive feature augmentation and negative label augmentation to improve the self-supervisory signal is proposed and theoretical analysis demonstrates that the learning method is equivalent to maximizing the likelihood estimation with latent variables representing user interest centers.

Abstract

Contrastive learning-based recommendation algorithms have significantly advanced the field of self-supervised recommendation, particularly with BPR as a representative ranking prediction task that dominates implicit collaborative filtering. However, the presence of false-positive and false-negative examples in recommendation systems hampers accurate preference learning. In this study, we propose a simple self-supervised contrastive learning framework that leverages positive feature augmentation and negative label augmentation to improve the self-supervisory signal. Theoretical analysis demonstrates that our learning method is equivalent to maximizing the likelihood estimation with latent variables representing user interest centers. Additionally, we establish an efficient negative label augmentation technique that samples unlabeled examples with a probability linearly dependent on their relative ranking positions, enabling efficient augmentation in constant time complexity. Through validation on multiple datasets, we illustrate the significant improvements our method achieves over the widely used BPR optimization objective while maintaining comparable runtime.
Paper Structure (19 sections, 2 theorems, 21 equations, 3 figures, 3 tables, 1 algorithm)

This paper contains 19 sections, 2 theorems, 21 equations, 3 figures, 3 tables, 1 algorithm.

Key Result

lemma 1

Defining the likelihood of preferring positive examples over negative examples as a sigmoid function, denoted as $p(\succ;\theta) = \sigma(\cdot)$ in the context of BPR Steffen:2009:UAI. Then the solution obtained from Eq. eq:theta is equivalent to maximizing the likelihood estimation for the latent

Figures (3)

  • Figure 1: Various applications of contrastive learning.
  • Figure 2: Impact of different values of $M$.
  • Figure 3: Impact of different values of $\alpha$.

Theorems & Definitions (2)

  • lemma 1
  • lemma 2