Generative Large Recommendation Models: Emerging Trends in LLMs for Recommendation

TL;DR

The paper addresses the rapid rise of generative large recommendation models and the need to systematically study them beyond traditional LLM-enhanced methods. It surveys the state of generative LLM-enabled recommender approaches, focusing on scaling laws, data quality, user-behavior mining, and efficiency in training and inference. By detailing challenges and preliminary explorations, it outlines future research directions, including data-centric strategies, representation enhancements, and incremental updates, to make large-scale generative models practical for real-world recommendations. The work aims to guide both researchers and practitioners in deploying, evaluating, and advancing generative large recommendation models, with potential for substantial impact on personalization at scale.

Abstract

In the era of information overload, recommendation systems play a pivotal role in filtering data and delivering personalized content. Recent advancements in feature interaction and user behavior modeling have significantly enhanced the recall and ranking processes of these systems. With the rise of large language models (LLMs), new opportunities have emerged to further improve recommendation systems. This tutorial explores two primary approaches for integrating LLMs: LLMs-enhanced recommendations, which leverage the reasoning capabilities of general LLMs, and generative large recommendation models, which focus on scaling and sophistication. While the former has been extensively covered in existing literature, the latter remains underexplored. This tutorial aims to fill this gap by providing a comprehensive overview of generative large recommendation models, including their recent advancements, challenges, and potential research directions. Key topics include data quality, scaling laws, user behavior mining, and efficiency in training and inference. By engaging with this tutorial, participants will gain insights into the latest developments and future opportunities in the field, aiding both academic research and practical applications. The timely nature of this exploration supports the rapid evolution of recommendation systems, offering valuable guidance for researchers and practitioners alike.