FedCLS: Class-Aware Federated Learning in a Heterogeneous Environment
- Authors
- Bhatti, Dost Muhammad Saqib; Nam, Haewoon
- Issue Date
- Jun-2023
- Publisher
- Institute of Electrical and Electronics Engineers Inc.
- Keywords
- deep neural networks; distributed learning; Federated learning; Heterogeneous network; unbiased aggregation
- Citation
- IEEE Transactions on Network and Service Management, v.20, no.2, pp 1 - 12
- Pages
- 12
- Indexed
- SCOPUS
- Journal Title
- IEEE Transactions on Network and Service Management
- Volume
- 20
- Number
- 2
- Start Page
- 1
- End Page
- 12
- URI
- https://scholarworks.bwise.kr/erica/handle/2021.sw.erica/113123
- DOI
- 10.1109/TNSM.2023.3278023
- ISSN
- 1932-4537
- Abstract
- Federated learning is an approach of training the global model on the server by utilizing the personal data of the end users while data privacy is preserved. The users, referred to as clients, are responsible for performing local training using their respective datasets. Once trained, the clients forward their local models to the server, where the models are aggregated to update the global model. Practically, the datasets of clients have different classes of labels regardless of the number of samples. In other words, the data is non-independent and identically distributed (non-iid) among clients in terms of classes of labels, which creates heterogeneity among them. Hence, the local model weights updated by clients result in a broad variation due to heterogeneity among their local datasets. Thus, the process of aggregating the diversified local models of clients has a valuable impact in performance of global training. When the server aggregates the local models by calculating weighted average based solely on the number of samples available at the clients, the aggregation process may misguide global training process. To address this issue, our paper proposes a novel reweighting method called FedCLS that performs based on the volume and variance of local datasets among clients. By taking into account the heterogeneity of data for aggregation in federated learning, the proposed method aims to achieve the minimum global point. The simulation results show that the proposed method achieves 28% performance improvement compared to the conventional federated learning methods. IEEE
- Files in This Item
-
Go to Link
- Appears in
Collections - COLLEGE OF ENGINEERING SCIENCES > SCHOOL OF ELECTRICAL ENGINEERING > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.