Safe Decentralized Multi-Agent Control using Black-Box Predictors, Conformal Decision Policies, and Control Barrier Functions
Sacha Huriot, Hussein Sibai
TL;DR
The paper tackles safe control in decentralized multi-agent systems with uncertain black-box trajectory predictors. It combines control barrier functions (CBFs) with conformal decision theory (CDT) to adapt safety constraints based on observed prediction errors, by introducing a conformal variable $\lambda$ as a slack in the CBF constraints. A formal long-term risk bound is established, ensuring the average loss between the constrained and ground-truth safety specifications remains bounded, with guarantees that can be tightened by adjusting $\lambda$. Experimental validation on the Stanford Drone Dataset demonstrates that the proposed conformal CBF framework reduces safety violations and collisions while maintaining task progress, across various hyperparameters. Overall, the approach provides a robust, theory-grounded mechanism to reconcile accuracy-limited predictions with safety requirements in real-time multi-agent navigation.
Abstract
We address the challenge of safe control in decentralized multi-agent robotic settings, where agents use uncertain black-box models to predict other agents' trajectories. We use the recently proposed conformal decision theory to adapt the restrictiveness of control barrier functions-based safety constraints based on observed prediction errors. We use these constraints to synthesize controllers that balance between the objectives of safety and task accomplishment, despite the prediction errors. We provide an upper bound on the average over time of the value of a monotonic function of the difference between the safety constraint based on the predicted trajectories and the constraint based on the ground truth ones. We validate our theory through experimental results showing the performance of our controllers when navigating a robot in the multi-agent scenes in the Stanford Drone Dataset.
