Dual-Segment Clustering Strategy for Hierarchical Federated Learning in Heterogeneous Wireless Environments

TL;DR

A novel dual-segment clustering strategy that jointly addresses communication and data heterogeneity in FL is proposed by defining a new signal-to-noise ratio (SNR) matrix and information quantity matrix to capture the communication and data heterogeneity, respectively.

Abstract

Non-independent and identically distributed (Non- IID) data adversely affects federated learning (FL) while heterogeneity in communication quality can undermine the reliability of model parameter transmission, potentially degrading wireless FL convergence. This paper proposes a novel dual-segment clustering (DSC) strategy that jointly addresses communication and data heterogeneity in FL. This is achieved by defining a new signal-to-noise ratio (SNR) matrix and information quantity matrix to capture the communication and data heterogeneity, respectively. The celebrated affinity propagation algorithm is leveraged to iteratively refine the clustering of clients based on the newly defined matrices effectively enhancing model aggregation in heterogeneous environments. The convergence analysis and experimental results show that the DSC strategy can improve the convergence rate of wireless FL and demonstrate superior accuracy in heterogeneous environments compared to classical clustering methods.

Figures (5)

• Figure 1: The workflow of the proposed DSC-FL, where each group is expected to contain as many labels as possible, while the communication quality of each client is similar.
• Figure 2: MNIST
• Figure 3: Fashion-MNIST
• Figure 5: MNIST
• Figure 6: Fashion-MNIST