Enhancing Playback Performance in Video Recommender Systems with an On-Device Gating and Ranking Framework
Yunfei Yang, Zhenghao Qi, Honghuan Wu, Qi Song, Tieyao Zhang, Hao Li, Yimin Tu, Kaiqiao Zhan, Ben Wang
TL;DR
This work addresses playback instability in video recommender systems by moving gating and ranking to the user device. It introduces GRF, a two-stage on-device framework with a gate to flag potential choppy items and a ranking module to substitute them with locally cached videos, coordinating with the cloud RS and a dynamic cache update mechanism. Extensive offline evaluations and online A/B tests on Kwai demonstrate strong gains in both playback stability and engagement, including notable improvements under poor networks and in retention. The results support the viability of on-device, network-free adjustments to enhance user experience in large-scale video platforms and point to broader applicability in edge-enabled RS scenarios.
Abstract
Video recommender systems (RSs) have gained increasing attention in recent years. Existing mainstream RSs focus on optimizing the matching function between users and items. However, we noticed that users frequently encounter playback issues such as slow loading or stuttering while browsing the videos, especially in weak network conditions, which will lead to a subpar browsing experience, and may cause users to leave, even when the video content and recommendations are superior. It is quite a serious issue, yet easily overlooked. To tackle this issue, we propose an on-device Gating and Ranking Framework (GRF) that cooperates with server-side RS. Specifically, we utilize a gate model to identify videos that may have playback issues in real-time, and then we employ a ranking model to select the optimal result from a locally-cached pool to replace the stuttering videos. Our solution has been fully deployed on Kwai, a large-scale short video platform with hundreds of millions of users globally. Moreover, it significantly enhances video playback performance and improves overall user experience and retention rates.
