Cargando…

On Training Neural Network Decoders of Rate Compatible Polar Codes via Transfer Learning

Neural network decoders (NNDs) for rate-compatible polar codes are studied in this paper. We consider a family of rate-compatible polar codes which are constructed from a single polar coding sequence as defined by 5G new radios. We propose a transfer learning technique for training multiple NNDs of...

Descripción completa

Detalles Bibliográficos
Autores principales: Lee, Hyunjae, Seo, Eun Young, Ju, Hyosang, Kim, Sang-Hyo
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7516978/
https://www.ncbi.nlm.nih.gov/pubmed/33286269
http://dx.doi.org/10.3390/e22050496
_version_ 1783587122832211968
author Lee, Hyunjae
Seo, Eun Young
Ju, Hyosang
Kim, Sang-Hyo
author_facet Lee, Hyunjae
Seo, Eun Young
Ju, Hyosang
Kim, Sang-Hyo
author_sort Lee, Hyunjae
collection PubMed
description Neural network decoders (NNDs) for rate-compatible polar codes are studied in this paper. We consider a family of rate-compatible polar codes which are constructed from a single polar coding sequence as defined by 5G new radios. We propose a transfer learning technique for training multiple NNDs of the rate-compatible polar codes utilizing their inclusion property. The trained NND for a low rate code is taken as the initial state of NND training for the next smallest rate code. The proposed method provides quicker training as compared to separate learning of the NNDs according to numerical results. We additionally show that an underfitting problem of NND training due to low model complexity can be solved by transfer learning techniques.
format Online
Article
Text
id pubmed-7516978
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-75169782020-11-09 On Training Neural Network Decoders of Rate Compatible Polar Codes via Transfer Learning Lee, Hyunjae Seo, Eun Young Ju, Hyosang Kim, Sang-Hyo Entropy (Basel) Article Neural network decoders (NNDs) for rate-compatible polar codes are studied in this paper. We consider a family of rate-compatible polar codes which are constructed from a single polar coding sequence as defined by 5G new radios. We propose a transfer learning technique for training multiple NNDs of the rate-compatible polar codes utilizing their inclusion property. The trained NND for a low rate code is taken as the initial state of NND training for the next smallest rate code. The proposed method provides quicker training as compared to separate learning of the NNDs according to numerical results. We additionally show that an underfitting problem of NND training due to low model complexity can be solved by transfer learning techniques. MDPI 2020-04-25 /pmc/articles/PMC7516978/ /pubmed/33286269 http://dx.doi.org/10.3390/e22050496 Text en © 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Lee, Hyunjae
Seo, Eun Young
Ju, Hyosang
Kim, Sang-Hyo
On Training Neural Network Decoders of Rate Compatible Polar Codes via Transfer Learning
title On Training Neural Network Decoders of Rate Compatible Polar Codes via Transfer Learning
title_full On Training Neural Network Decoders of Rate Compatible Polar Codes via Transfer Learning
title_fullStr On Training Neural Network Decoders of Rate Compatible Polar Codes via Transfer Learning
title_full_unstemmed On Training Neural Network Decoders of Rate Compatible Polar Codes via Transfer Learning
title_short On Training Neural Network Decoders of Rate Compatible Polar Codes via Transfer Learning
title_sort on training neural network decoders of rate compatible polar codes via transfer learning
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7516978/
https://www.ncbi.nlm.nih.gov/pubmed/33286269
http://dx.doi.org/10.3390/e22050496
work_keys_str_mv AT leehyunjae ontrainingneuralnetworkdecodersofratecompatiblepolarcodesviatransferlearning
AT seoeunyoung ontrainingneuralnetworkdecodersofratecompatiblepolarcodesviatransferlearning
AT juhyosang ontrainingneuralnetworkdecodersofratecompatiblepolarcodesviatransferlearning
AT kimsanghyo ontrainingneuralnetworkdecodersofratecompatiblepolarcodesviatransferlearning