Table of Contents
Fetching ...

Being Considerate as a Pathway Towards Pluralistic Alignment for Agentic AI

Parand A. Alamdari, Toryn Q. Klassen, Rodrigo Toro Icarte, Sheila A. McIlraith

TL;DR

It is shown how being considerate of the future wellbeing and agency of other (human) agents can promote a form of pluralistic alignment.

Abstract

Pluralistic alignment is concerned with ensuring that an AI system's objectives and behaviors are in harmony with the diversity of human values and perspectives. In this paper we study the notion of pluralistic alignment in the context of agentic AI, and in particular in the context of an agent that is trying to learn a policy in a manner that is mindful of the values and perspective of others in the environment. To this end, we show how being considerate of the future wellbeing and agency of other (human) agents can promote a form of pluralistic alignment.

Being Considerate as a Pathway Towards Pluralistic Alignment for Agentic AI

TL;DR

It is shown how being considerate of the future wellbeing and agency of other (human) agents can promote a form of pluralistic alignment.

Abstract

Pluralistic alignment is concerned with ensuring that an AI system's objectives and behaviors are in harmony with the diversity of human values and perspectives. In this paper we study the notion of pluralistic alignment in the context of agentic AI, and in particular in the context of an agent that is trying to learn a policy in a manner that is mindful of the values and perspective of others in the environment. To this end, we show how being considerate of the future wellbeing and agency of other (human) agents can promote a form of pluralistic alignment.

Paper Structure

This paper contains 6 sections, 5 equations, 1 figure.

Figures (1)

  • Figure 1: Different caring coefficients lead to different paths. Inconsiderate agents trample the flowers. Super considerate agents build a fence to protect the flowers.