Transferable Sequential Recommendation via Vector Quantized Meta Learning

TL;DR

A vector quantized meta learning for transferable sequential recommenders (MetaRec) without requiring additional modalities or shared information across domains, which leverages user-item interactions from multiple source domains to improve the target domain performance.

Abstract

While sequential recommendation achieves significant progress on capturing user-item transition patterns, transferring such large-scale recommender systems remains challenging due to the disjoint user and item groups across domains. In this paper, we propose a vector quantized meta learning for transferable sequential recommenders (MetaRec). Without requiring additional modalities or shared information across domains, our approach leverages user-item interactions from multiple source domains to improve the target domain performance. To solve the input heterogeneity issue, we adopt vector quantization that maps item embeddings from heterogeneous input spaces to a shared feature space. Moreover, our meta transfer paradigm exploits limited target data to guide the transfer of source domain knowledge to the target domain (i.e., learn to transfer). In addition, MetaRec adaptively transfers from multiple source tasks by rescaling meta gradients based on the source-target domain similarity, enabling selective learning to improve recommendation performance. To validate the effectiveness of our approach, we perform extensive experiments on benchmark datasets, where MetaRec consistently outperforms baseline methods by a considerable margin.

Figures (2)

• Figure 1: Scheme of our vector quantization module. The item embeddings $z_{e}$ is split into $H$ heads and projected separately.
• Figure 2: The proposed MetaRec. The left subfigure demonstrates how vector quantization is applied on sequential recommenders. The right subfigure illustrates meta transfer using multiple source domains and gradient rescaling.