Scarce Resource Allocations That Rely On Machine Learning Should Be Randomized
Shomik Jain, Kathleen Creel, Ashia Wilson
TL;DR
The paper tackles fairness in scarce resource allocations governed by ML where deterministic decisions may perpetuate inequities. It proposes stochastic procedures grounded in Broome's theory of claims, chiefly weighted lotteries (BF) and partial BF variants, to respect individual claims under uncertainty and across multiple decision-makers. The authors develop a formal framework for known and unknown claims, and demonstrate that small amounts of randomization can substantially reduce systemic exclusion rate with limited utility loss, via simulations and two real-data examples (Swiss unemployment and Census income). They provide practical guidelines, discuss scope and ethics, and supply code to implement these methods.
Abstract
Contrary to traditional deterministic notions of algorithmic fairness, this paper argues that fairly allocating scarce resources using machine learning often requires randomness. We address why, when, and how to randomize by proposing stochastic procedures that more adequately account for all of the claims that individuals have to allocations of social goods or opportunities.
