Front-Loaded or Balanced? The Mechanism through Which Review Order Affects Overall Ratings in Premium Service Settings

TL;DR

This paper investigates how the order of evaluation inputs—rating-first versus review-first—shapes consumer ratings in premium service contexts. It combines exploratory analyses of real platforms (Yelp vs Letterboxd) with three controlled experiments to test the main effect, mediating mechanisms, and a service-quality moderator. Findings show that rating-first interfaces elevate overall ratings in high-quality service contexts through reduced cognitive effort and heightened affective heuristics, with service quality modulating both direct and indirect paths. The results offer theoretical insights into online rating formation and practical guidance for designing evaluation interfaces that enhance rating authenticity and credibility.

Abstract

In the increasingly prevalent landscape of high-quality service contexts, whether consumer evaluation interfaces adopt a rating-first or review-first sequence has become a critical factor shaping rating authenticity and feedback quality. While prior research has primarily examined review content and sentiment, systematic investigation into how evaluation order influences rating outcomes remains limited. Through exploratory analyses, we find that Letterboxd -- which employs a review-first, rating-after mechanism -- exhibits a more centralized rating distribution with fewer extreme scores, whereas Yelp -- which adopts a rating-first, review-after mechanism -- shows a pronounced bimodal distribution with more polarized ratings. Three controlled experiments further demonstrate that in high-quality service contexts, a rating-first (vs. review-first) interface significantly elevates consumers' overall ratings. Mechanism analyses indicate that cognitive effort and affective heuristics serve as dual pathways: a rating-first (vs. review-first) sequence reduces cognitive effort and heightens affective heuristics, thereby increasing rating scores. Moreover, service quality moderates this process. When service quality is low, the rating-first (vs. review-first) sequence instead leads to lower ratings. This research reveals the psychological mechanisms through which evaluation order affects consumer ratings via cognitive and affective pathways. It extends theoretical understanding of online rating formation and offers practical implications for optimizing platform interface design to enhance rating authenticity and credibility.

Figures (7)

• Figure 1: Research Framework
• Figure 2: Schematic Diagram of Two Platform App Interfaces
• Figure 3: Rating Distribution on Yelp
• Figure 4: Rating Distribution on Letterboxd
• Figure 5: Consumers' Overall Ratings (Rating-First vs. Review-First)