Cargando…

Wireless Network Optimization for Federated Learning with Model Compression in Hybrid VLC/RF Systems †

In this paper, the optimization of network performance to support the deployment of federated learning (FL) is investigated. In particular, in the considered model, each user owns a machine learning (ML) model by training through its own dataset, and then transmits its ML parameters to a base statio...

Descripción completa

Detalles Bibliográficos
Autores principales: Huang, Wuwei, Yang, Yang, Chen, Mingzhe, Liu, Chuanhong, Feng, Chunyan, Poor, H. Vincent
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8622686/
https://www.ncbi.nlm.nih.gov/pubmed/34828111
http://dx.doi.org/10.3390/e23111413
_version_ 1784605751815176192
author Huang, Wuwei
Yang, Yang
Chen, Mingzhe
Liu, Chuanhong
Feng, Chunyan
Poor, H. Vincent
author_facet Huang, Wuwei
Yang, Yang
Chen, Mingzhe
Liu, Chuanhong
Feng, Chunyan
Poor, H. Vincent
author_sort Huang, Wuwei
collection PubMed
description In this paper, the optimization of network performance to support the deployment of federated learning (FL) is investigated. In particular, in the considered model, each user owns a machine learning (ML) model by training through its own dataset, and then transmits its ML parameters to a base station (BS) which aggregates the ML parameters to obtain a global ML model and transmits it to each user. Due to limited radio frequency (RF) resources, the number of users that participate in FL is restricted. Meanwhile, each user uploading and downloading the FL parameters may increase communication costs thus reducing the number of participating users. To this end, we propose to introduce visible light communication (VLC) as a supplement to RF and use compression methods to reduce the resources needed to transmit FL parameters over wireless links so as to further improve the communication efficiency and simultaneously optimize wireless network through user selection and resource allocation. This user selection and bandwidth allocation problem is formulated as an optimization problem whose goal is to minimize the training loss of FL. We first use a model compression method to reduce the size of FL model parameters that are transmitted over wireless links. Then, the optimization problem is separated into two subproblems. The first subproblem is a user selection problem with a given bandwidth allocation, which is solved by a traversal algorithm. The second subproblem is a bandwidth allocation problem with a given user selection, which is solved by a numerical method. The ultimate user selection and bandwidth allocation are obtained by iteratively compressing the model and solving these two subproblems. Simulation results show that the proposed FL algorithm can improve the accuracy of object recognition by up to 16.7% and improve the number of selected users by up to 68.7%, compared to a conventional FL algorithm using only RF.
format Online
Article
Text
id pubmed-8622686
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-86226862021-11-27 Wireless Network Optimization for Federated Learning with Model Compression in Hybrid VLC/RF Systems † Huang, Wuwei Yang, Yang Chen, Mingzhe Liu, Chuanhong Feng, Chunyan Poor, H. Vincent Entropy (Basel) Article In this paper, the optimization of network performance to support the deployment of federated learning (FL) is investigated. In particular, in the considered model, each user owns a machine learning (ML) model by training through its own dataset, and then transmits its ML parameters to a base station (BS) which aggregates the ML parameters to obtain a global ML model and transmits it to each user. Due to limited radio frequency (RF) resources, the number of users that participate in FL is restricted. Meanwhile, each user uploading and downloading the FL parameters may increase communication costs thus reducing the number of participating users. To this end, we propose to introduce visible light communication (VLC) as a supplement to RF and use compression methods to reduce the resources needed to transmit FL parameters over wireless links so as to further improve the communication efficiency and simultaneously optimize wireless network through user selection and resource allocation. This user selection and bandwidth allocation problem is formulated as an optimization problem whose goal is to minimize the training loss of FL. We first use a model compression method to reduce the size of FL model parameters that are transmitted over wireless links. Then, the optimization problem is separated into two subproblems. The first subproblem is a user selection problem with a given bandwidth allocation, which is solved by a traversal algorithm. The second subproblem is a bandwidth allocation problem with a given user selection, which is solved by a numerical method. The ultimate user selection and bandwidth allocation are obtained by iteratively compressing the model and solving these two subproblems. Simulation results show that the proposed FL algorithm can improve the accuracy of object recognition by up to 16.7% and improve the number of selected users by up to 68.7%, compared to a conventional FL algorithm using only RF. MDPI 2021-10-27 /pmc/articles/PMC8622686/ /pubmed/34828111 http://dx.doi.org/10.3390/e23111413 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Huang, Wuwei
Yang, Yang
Chen, Mingzhe
Liu, Chuanhong
Feng, Chunyan
Poor, H. Vincent
Wireless Network Optimization for Federated Learning with Model Compression in Hybrid VLC/RF Systems †
title Wireless Network Optimization for Federated Learning with Model Compression in Hybrid VLC/RF Systems †
title_full Wireless Network Optimization for Federated Learning with Model Compression in Hybrid VLC/RF Systems †
title_fullStr Wireless Network Optimization for Federated Learning with Model Compression in Hybrid VLC/RF Systems †
title_full_unstemmed Wireless Network Optimization for Federated Learning with Model Compression in Hybrid VLC/RF Systems †
title_short Wireless Network Optimization for Federated Learning with Model Compression in Hybrid VLC/RF Systems †
title_sort wireless network optimization for federated learning with model compression in hybrid vlc/rf systems †
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8622686/
https://www.ncbi.nlm.nih.gov/pubmed/34828111
http://dx.doi.org/10.3390/e23111413
work_keys_str_mv AT huangwuwei wirelessnetworkoptimizationforfederatedlearningwithmodelcompressioninhybridvlcrfsystems
AT yangyang wirelessnetworkoptimizationforfederatedlearningwithmodelcompressioninhybridvlcrfsystems
AT chenmingzhe wirelessnetworkoptimizationforfederatedlearningwithmodelcompressioninhybridvlcrfsystems
AT liuchuanhong wirelessnetworkoptimizationforfederatedlearningwithmodelcompressioninhybridvlcrfsystems
AT fengchunyan wirelessnetworkoptimizationforfederatedlearningwithmodelcompressioninhybridvlcrfsystems
AT poorhvincent wirelessnetworkoptimizationforfederatedlearningwithmodelcompressioninhybridvlcrfsystems