Table of Contents
Fetching ...

RESFL: An Uncertainty-Aware Framework for Responsible Federated Learning by Balancing Privacy, Fairness and Utility in Autonomous Vehicles

Dawood Wasif, Terrence J. Moore, Jin-Hee Cho

TL;DR

RESFL addresses the tension between privacy, fairness, and utility in autonomous-vehicle federated learning by integrating adversarial privacy disentanglement with uncertainty-guided fairness-aware aggregation. By employing an evidential neural network, RESFL quantifies epistemic uncertainty and defines an Uncertainty Fairness Metric (UFM) to weight client updates, prioritizing contributions with lower fairness disparities and higher confidence. The framework leverages a gradient reversal layer to suppress sensitive attribute leakage during training, improving both privacy protection and fairness. Empirical results on FACET and CARLA demonstrate that RESFL achieves competitive detection accuracy while reducing demographic disparities, lowering privacy-attack success rates, and exhibiting greater robustness under adverse weather conditions, making it well-suited for real-world AV deployments.

Abstract

Autonomous vehicles (AVs) increasingly rely on Federated Learning (FL) to enhance perception models while preserving privacy. However, existing FL frameworks struggle to balance privacy, fairness, and robustness, leading to performance disparities across demographic groups. Privacy-preserving techniques like differential privacy mitigate data leakage risks but worsen fairness by restricting access to sensitive attributes needed for bias correction. This work explores the trade-off between privacy and fairness in FL-based object detection for AVs and introduces RESFL, an integrated solution optimizing both. RESFL incorporates adversarial privacy disentanglement and uncertainty-guided fairness-aware aggregation. The adversarial component uses a gradient reversal layer to remove sensitive attributes, reducing privacy risks while maintaining fairness. The uncertainty-aware aggregation employs an evidential neural network to weight client updates adaptively, prioritizing contributions with lower fairness disparities and higher confidence. This ensures robust and equitable FL model updates. We evaluate RESFL on the FACET dataset and CARLA simulator, assessing accuracy, fairness, privacy resilience, and robustness under varying conditions. RESFL improves detection accuracy, reduces fairness disparities, and lowers privacy attack success rates while demonstrating superior robustness to adversarial conditions compared to other approaches.

RESFL: An Uncertainty-Aware Framework for Responsible Federated Learning by Balancing Privacy, Fairness and Utility in Autonomous Vehicles

TL;DR

RESFL addresses the tension between privacy, fairness, and utility in autonomous-vehicle federated learning by integrating adversarial privacy disentanglement with uncertainty-guided fairness-aware aggregation. By employing an evidential neural network, RESFL quantifies epistemic uncertainty and defines an Uncertainty Fairness Metric (UFM) to weight client updates, prioritizing contributions with lower fairness disparities and higher confidence. The framework leverages a gradient reversal layer to suppress sensitive attribute leakage during training, improving both privacy protection and fairness. Empirical results on FACET and CARLA demonstrate that RESFL achieves competitive detection accuracy while reducing demographic disparities, lowering privacy-attack success rates, and exhibiting greater robustness under adverse weather conditions, making it well-suited for real-world AV deployments.

Abstract

Autonomous vehicles (AVs) increasingly rely on Federated Learning (FL) to enhance perception models while preserving privacy. However, existing FL frameworks struggle to balance privacy, fairness, and robustness, leading to performance disparities across demographic groups. Privacy-preserving techniques like differential privacy mitigate data leakage risks but worsen fairness by restricting access to sensitive attributes needed for bias correction. This work explores the trade-off between privacy and fairness in FL-based object detection for AVs and introduces RESFL, an integrated solution optimizing both. RESFL incorporates adversarial privacy disentanglement and uncertainty-guided fairness-aware aggregation. The adversarial component uses a gradient reversal layer to remove sensitive attributes, reducing privacy risks while maintaining fairness. The uncertainty-aware aggregation employs an evidential neural network to weight client updates adaptively, prioritizing contributions with lower fairness disparities and higher confidence. This ensures robust and equitable FL model updates. We evaluate RESFL on the FACET dataset and CARLA simulator, assessing accuracy, fairness, privacy resilience, and robustness under varying conditions. RESFL improves detection accuracy, reduces fairness disparities, and lowers privacy attack success rates while demonstrating superior robustness to adversarial conditions compared to other approaches.

Paper Structure

This paper contains 77 sections, 7 theorems, 63 equations, 4 figures, 5 tables, 1 algorithm.

Key Result

theorem 1

For a model trained on data from $G$ sensitive groups, the epistemic uncertainty $(\sigma^2_{\mathrm{epistemic}})^{(g)}$ for group $g$ is inversely proportional to the effective sample size $n_{\text{eff}}^{(g)}$ and the signal-to-noise ratio (SNR) of the corresponding data, under mild regularity co

Figures (4)

  • Figure 1: The Monk Skin Tone (MST) scale pathiraja2024fairness ranges from MST=1, representing the lightest skin tone, to MST=10, representing the darkest skin tone.
  • Figure 2: Sample visualization of weather conditions (Cloud, Rain, and Fog) at increasing intensity levels (0%, 25%, 50%, 75%, 100%) using the CARLA simulation, illustrating how environmental severity gradually impacts visibility and scene clarity.
  • Figure 3: Comparison of accuracy (mAP) across Monk Skin Tones using FedAvg and RESFL on the FACET dataset: The results show that RESFL improves fairness by maintaining consistent accuracy across skin tones, reducing the performance disparity observed in FedAvg, which suffers a significant drop for darker skin tones.
  • Figure 4: Performance comparison of four state-of-the-art FL methods and RESFL across three weather conditions (Cloud, Rain, Fog) at 0%–100% intensity. Rows represent performance metrics (accuracy, fairness, resilience to privacy, and fairness attacks), and columns correspond to weather conditions.

Theorems & Definitions (7)

  • theorem 1
  • corollary 1
  • theorem 2
  • theorem 3
  • theorem 4
  • theorem 5
  • theorem 6