Advertising in AI systems: Society must be vigilant
Menghua Wu, Yujia Bao
TL;DR
The paper analyzes how commercial incentives could shape generative AI outputs, arguing that unlike static ads, generative advertisements can dynamically influence each interaction via sponsorship-conditioned content. It proposes a framework treating AI systems as advertising platforms, with four design principles—Faithfulness, Utility, Privacy, and Provenance—and an implementation approach that uses tool-call patterns to integrate and audit sponsor content. It also outlines two debiasing strategies, direct debiasing and multi-sampling with aggregation, to recover ad-free outputs, and discusses open questions around regulation, user autonomy, transparency, and evaluation. The work aims to guide researchers and platforms toward transparent, user-centered management of commercial content in AI systems, balancing monetization with safety and trust by formalizing metrics and provenance for sponsorship effects.
Abstract
AI systems have increasingly become our gateways to the Internet. We argue that just as advertising has driven the monetization of web search and social media, so too will commercial incentives shape the content served by AI. Unlike traditional media, however, the outputs of these systems are dynamic, personalized, and lack clear provenance -- raising concerns for transparency and regulation. In this paper, we envision how commercial content could be delivered through generative AI-based systems. Based on the requirements of key stakeholders -- advertisers, consumers, and platforms -- we propose design principles for commercially-influenced AI systems. We then outline high-level strategies for end users to identify and mitigate commercial biases from model outputs. Finally, we conclude with open questions and a call to action towards these goals.
