Cargando…

Joint Client Selection and CPU Frequency Control in Wireless Federated Learning Networks with Power Constraints

Federated learning (FL) represents a distributed machine learning approach that eliminates the necessity of transmitting privacy-sensitive local training samples. However, within wireless FL networks, resource heterogeneity introduces straggler clients, thereby decelerating the learning process. Add...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhou, Zhaohui, Shi, Shijie, Wang, Fasong, Zhang, Yanbin, Li, Yitong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10453361/
https://www.ncbi.nlm.nih.gov/pubmed/37628213
http://dx.doi.org/10.3390/e25081183
_version_ 1785095918152843264
author Zhou, Zhaohui
Shi, Shijie
Wang, Fasong
Zhang, Yanbin
Li, Yitong
author_facet Zhou, Zhaohui
Shi, Shijie
Wang, Fasong
Zhang, Yanbin
Li, Yitong
author_sort Zhou, Zhaohui
collection PubMed
description Federated learning (FL) represents a distributed machine learning approach that eliminates the necessity of transmitting privacy-sensitive local training samples. However, within wireless FL networks, resource heterogeneity introduces straggler clients, thereby decelerating the learning process. Additionally, the learning process is further slowed due to the non-independent and identically distributed (non-IID) nature of local training samples. Coupled with resource constraints during the learning process, there arises an imperative need for optimizing client selection and resource allocation strategies to mitigate these challenges. While numerous studies have made strides in this regard, few have considered the joint optimization of client selection and computational power (i.e., CPU frequency) for both clients and the edge server during each global iteration. In this paper, we initially define a cost function encompassing learning latency and non-IID characteristics. Subsequently, we pose a joint client selection and CPU frequency control problem that minimizes the time-averaged cost function subject to long-term power constraints. By utilizing Lyapunov optimization theory, the long-term optimization problem is transformed into a sequence of short-term problems. Finally, an algorithm is proposed to determine the optimal client selection decision and corresponding optimal CPU frequency for both the selected clients and the server. Theoretical analysis provides performance guarantees and our simulation results substantiate that our proposed algorithm outperforms comparative algorithms in terms of test accuracy while maintaining low power consumption.
format Online
Article
Text
id pubmed-10453361
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-104533612023-08-26 Joint Client Selection and CPU Frequency Control in Wireless Federated Learning Networks with Power Constraints Zhou, Zhaohui Shi, Shijie Wang, Fasong Zhang, Yanbin Li, Yitong Entropy (Basel) Article Federated learning (FL) represents a distributed machine learning approach that eliminates the necessity of transmitting privacy-sensitive local training samples. However, within wireless FL networks, resource heterogeneity introduces straggler clients, thereby decelerating the learning process. Additionally, the learning process is further slowed due to the non-independent and identically distributed (non-IID) nature of local training samples. Coupled with resource constraints during the learning process, there arises an imperative need for optimizing client selection and resource allocation strategies to mitigate these challenges. While numerous studies have made strides in this regard, few have considered the joint optimization of client selection and computational power (i.e., CPU frequency) for both clients and the edge server during each global iteration. In this paper, we initially define a cost function encompassing learning latency and non-IID characteristics. Subsequently, we pose a joint client selection and CPU frequency control problem that minimizes the time-averaged cost function subject to long-term power constraints. By utilizing Lyapunov optimization theory, the long-term optimization problem is transformed into a sequence of short-term problems. Finally, an algorithm is proposed to determine the optimal client selection decision and corresponding optimal CPU frequency for both the selected clients and the server. Theoretical analysis provides performance guarantees and our simulation results substantiate that our proposed algorithm outperforms comparative algorithms in terms of test accuracy while maintaining low power consumption. MDPI 2023-08-09 /pmc/articles/PMC10453361/ /pubmed/37628213 http://dx.doi.org/10.3390/e25081183 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Zhou, Zhaohui
Shi, Shijie
Wang, Fasong
Zhang, Yanbin
Li, Yitong
Joint Client Selection and CPU Frequency Control in Wireless Federated Learning Networks with Power Constraints
title Joint Client Selection and CPU Frequency Control in Wireless Federated Learning Networks with Power Constraints
title_full Joint Client Selection and CPU Frequency Control in Wireless Federated Learning Networks with Power Constraints
title_fullStr Joint Client Selection and CPU Frequency Control in Wireless Federated Learning Networks with Power Constraints
title_full_unstemmed Joint Client Selection and CPU Frequency Control in Wireless Federated Learning Networks with Power Constraints
title_short Joint Client Selection and CPU Frequency Control in Wireless Federated Learning Networks with Power Constraints
title_sort joint client selection and cpu frequency control in wireless federated learning networks with power constraints
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10453361/
https://www.ncbi.nlm.nih.gov/pubmed/37628213
http://dx.doi.org/10.3390/e25081183
work_keys_str_mv AT zhouzhaohui jointclientselectionandcpufrequencycontrolinwirelessfederatedlearningnetworkswithpowerconstraints
AT shishijie jointclientselectionandcpufrequencycontrolinwirelessfederatedlearningnetworkswithpowerconstraints
AT wangfasong jointclientselectionandcpufrequencycontrolinwirelessfederatedlearningnetworkswithpowerconstraints
AT zhangyanbin jointclientselectionandcpufrequencycontrolinwirelessfederatedlearningnetworkswithpowerconstraints
AT liyitong jointclientselectionandcpufrequencycontrolinwirelessfederatedlearningnetworkswithpowerconstraints