Table of Contents
Fetching ...

Robust Federated Learning in Unreliable Wireless Networks: A Client Selection Approach

Yanmeng Wang, Wenkai Ji, Jian Zhou, Fu Xiao, Tsung-Hui Chang

TL;DR

This work addresses federated learning over unreliable wireless networks where data are non-i.i.d. across clients. It reveals that transmission failures distort effective label distributions, biasing convergence, and introduces FedCote, a client-selection scheme that aligns the effective label distribution with the global distribution without reconfiguring wireless resources. The authors provide a theoretical convergence analysis showing how label- and feature-related heterogeneity interact with failures, and demonstrate empirically that FedCote significantly improves robustness on MNIST and CIFAR-10; they also propose FedCote-II to reduce computational burden with minimal performance loss. Overall, FedCote offers a practical, plug-and-play remedy for robust FL in commercial wireless networks, with online scheduling for dynamic environments and reduced-complexity variants for scalability.

Abstract

Federated learning (FL) has emerged as a promising distributed learning paradigm for training deep neural networks (DNNs) at the wireless edge, but its performance can be severely hindered by unreliable wireless transmission and inherent data heterogeneity among clients. Existing solutions primarily address these challenges by incorporating wireless resource optimization strategies, often focusing on uplink resource allocation across clients under the assumption of homogeneous client-server network standards. However, these approaches overlooked the fact that mobile clients may connect to the server via diverse network standards (e.g., 4G, 5G, Wi-Fi) with customized configurations, limiting the flexibility of server-side modifications and restricting applicability in real-world commercial networks. This paper presents a novel theoretical analysis about how transmission failures in unreliable networks distort the effective label distributions of local samples, causing deviations from the global data distribution and introducing convergence bias in FL. Our analysis reveals that a carefully designed client selection strategy can mitigate biases induced by network unreliability and data heterogeneity. Motivated by this insight, we propose FedCote, a client selection approach that optimizes client selection probabilities without relying on wireless resource scheduling. Experimental results demonstrate the robustness of FedCote in DNN-based classification tasks under unreliable networks with frequent transmission failures.

Robust Federated Learning in Unreliable Wireless Networks: A Client Selection Approach

TL;DR

This work addresses federated learning over unreliable wireless networks where data are non-i.i.d. across clients. It reveals that transmission failures distort effective label distributions, biasing convergence, and introduces FedCote, a client-selection scheme that aligns the effective label distribution with the global distribution without reconfiguring wireless resources. The authors provide a theoretical convergence analysis showing how label- and feature-related heterogeneity interact with failures, and demonstrate empirically that FedCote significantly improves robustness on MNIST and CIFAR-10; they also propose FedCote-II to reduce computational burden with minimal performance loss. Overall, FedCote offers a practical, plug-and-play remedy for robust FL in commercial wireless networks, with online scheduling for dynamic environments and reduced-complexity variants for scalability.

Abstract

Federated learning (FL) has emerged as a promising distributed learning paradigm for training deep neural networks (DNNs) at the wireless edge, but its performance can be severely hindered by unreliable wireless transmission and inherent data heterogeneity among clients. Existing solutions primarily address these challenges by incorporating wireless resource optimization strategies, often focusing on uplink resource allocation across clients under the assumption of homogeneous client-server network standards. However, these approaches overlooked the fact that mobile clients may connect to the server via diverse network standards (e.g., 4G, 5G, Wi-Fi) with customized configurations, limiting the flexibility of server-side modifications and restricting applicability in real-world commercial networks. This paper presents a novel theoretical analysis about how transmission failures in unreliable networks distort the effective label distributions of local samples, causing deviations from the global data distribution and introducing convergence bias in FL. Our analysis reveals that a carefully designed client selection strategy can mitigate biases induced by network unreliability and data heterogeneity. Motivated by this insight, we propose FedCote, a client selection approach that optimizes client selection probabilities without relying on wireless resource scheduling. Experimental results demonstrate the robustness of FedCote in DNN-based classification tasks under unreliable networks with frequent transmission failures.

Paper Structure

This paper contains 58 sections, 18 theorems, 75 equations, 9 figures, 11 tables, 2 algorithms.

Key Result

Proposition 1

The difference between local and global gradients can be bounded by two separate terms: Here, term (ineq:nabla Fi - Fa) captures data feature-related heterogeneity, where the deviation between local and global gradients within a class, $\| \nabla F_{i,c} ({\mathbf{w}}) - \nabla F_{g,c} ({\mathbf{w}}) \|^2$, is influenced by the sample data characteristics such as local data insufficien

Figures (9)

  • Figure 1: FL in unreliable wireless networks with transmission failures.
  • Figure 2: FL performance on unbalanced MNIST datasets under transmission failures (N = 20, K = 10, unbalanced ratio = 0.9).
  • Figure 3: Comparison of the values of $G^2$ and ${\sum}_{c=1}^C {\sum}_{i = 1}^N p_i \alpha_{i,c} V_{i,c}^2$.
  • Figure 4: Ratio of ${G^2}$ to $\qquad$${{\sum}_{c=1}^C {\sum}_{i = 1}^N p_i \alpha_{i,c} V_{i,c}^2}$.
  • Figure 5: Value of $V_{i,c}^2$ per client with respect to $p_i \alpha_{i,c}$ (markers consistent with Fig. \ref{['fig:G Vic ratio MNIST CIFAR-10']}).
  • ...and 4 more figures

Theorems & Definitions (21)

  • Proposition 1
  • Corollary 1
  • Lemma 1
  • Theorem 1
  • Corollary 2
  • Remark 1
  • Remark 2
  • Proposition 2
  • Proposition 3
  • Remark 3
  • ...and 11 more