A computational framework for human values
Nardine Osman, Mark d'Inverno
TL;DR
This work introduces a formal, taxonomy-based framework for representing human values and grounding them in computable properties to support value-aligned AI. By modeling values as abstract concepts connected to leaf property nodes and organizing them into context-sensitive taxonomies with coherence-enforcing aggregation, the approach enables explicit reasoning about value importance and alignment. The framework also addresses how values evolve across contexts and how individuals and collectives can hold and aggregate values, using bottom-up or top-down implementations and a quantitative alignment measure $\mathcal{A}(e,\mathcal{V}_c)$ that weights property satisfaction by importance. Through the uHelp running example, the paper demonstrates practical grounding, context adaptation, and alignment computation, illustrating potential applications in domains such as healthcare and participatory design. Overall, the framework provides a formal, interdisciplinary foundation for designing AI systems whose behavior is provably aligned with human values, while outlining directions for future research and deployment.
Abstract
In the diverse array of work investigating the nature of human values from psychology, philosophy and social sciences, there is a clear consensus that values guide behaviour. More recently, a recognition that values provide a means to engineer ethical AI has emerged. Indeed, Stuart Russell proposed shifting AI's focus away from simply ``intelligence'' towards intelligence ``provably aligned with human values''. This challenge -- the value alignment problem -- with others including an AI's learning of human values, aggregating individual values to groups, and designing computational mechanisms to reason over values, has energised a sustained research effort. Despite this, no formal, computational definition of values has yet been proposed. We address this through a formal conceptual framework rooted in the social sciences, that provides a foundation for the systematic, integrated and interdisciplinary investigation into how human values can support designing ethical AI.
