Cargando…
On Training Neural Network Decoders of Rate Compatible Polar Codes via Transfer Learning
Neural network decoders (NNDs) for rate-compatible polar codes are studied in this paper. We consider a family of rate-compatible polar codes which are constructed from a single polar coding sequence as defined by 5G new radios. We propose a transfer learning technique for training multiple NNDs of...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7516978/ https://www.ncbi.nlm.nih.gov/pubmed/33286269 http://dx.doi.org/10.3390/e22050496 |
_version_ | 1783587122832211968 |
---|---|
author | Lee, Hyunjae Seo, Eun Young Ju, Hyosang Kim, Sang-Hyo |
author_facet | Lee, Hyunjae Seo, Eun Young Ju, Hyosang Kim, Sang-Hyo |
author_sort | Lee, Hyunjae |
collection | PubMed |
description | Neural network decoders (NNDs) for rate-compatible polar codes are studied in this paper. We consider a family of rate-compatible polar codes which are constructed from a single polar coding sequence as defined by 5G new radios. We propose a transfer learning technique for training multiple NNDs of the rate-compatible polar codes utilizing their inclusion property. The trained NND for a low rate code is taken as the initial state of NND training for the next smallest rate code. The proposed method provides quicker training as compared to separate learning of the NNDs according to numerical results. We additionally show that an underfitting problem of NND training due to low model complexity can be solved by transfer learning techniques. |
format | Online Article Text |
id | pubmed-7516978 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-75169782020-11-09 On Training Neural Network Decoders of Rate Compatible Polar Codes via Transfer Learning Lee, Hyunjae Seo, Eun Young Ju, Hyosang Kim, Sang-Hyo Entropy (Basel) Article Neural network decoders (NNDs) for rate-compatible polar codes are studied in this paper. We consider a family of rate-compatible polar codes which are constructed from a single polar coding sequence as defined by 5G new radios. We propose a transfer learning technique for training multiple NNDs of the rate-compatible polar codes utilizing their inclusion property. The trained NND for a low rate code is taken as the initial state of NND training for the next smallest rate code. The proposed method provides quicker training as compared to separate learning of the NNDs according to numerical results. We additionally show that an underfitting problem of NND training due to low model complexity can be solved by transfer learning techniques. MDPI 2020-04-25 /pmc/articles/PMC7516978/ /pubmed/33286269 http://dx.doi.org/10.3390/e22050496 Text en © 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Lee, Hyunjae Seo, Eun Young Ju, Hyosang Kim, Sang-Hyo On Training Neural Network Decoders of Rate Compatible Polar Codes via Transfer Learning |
title | On Training Neural Network Decoders of Rate Compatible Polar Codes via Transfer Learning |
title_full | On Training Neural Network Decoders of Rate Compatible Polar Codes via Transfer Learning |
title_fullStr | On Training Neural Network Decoders of Rate Compatible Polar Codes via Transfer Learning |
title_full_unstemmed | On Training Neural Network Decoders of Rate Compatible Polar Codes via Transfer Learning |
title_short | On Training Neural Network Decoders of Rate Compatible Polar Codes via Transfer Learning |
title_sort | on training neural network decoders of rate compatible polar codes via transfer learning |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7516978/ https://www.ncbi.nlm.nih.gov/pubmed/33286269 http://dx.doi.org/10.3390/e22050496 |
work_keys_str_mv | AT leehyunjae ontrainingneuralnetworkdecodersofratecompatiblepolarcodesviatransferlearning AT seoeunyoung ontrainingneuralnetworkdecodersofratecompatiblepolarcodesviatransferlearning AT juhyosang ontrainingneuralnetworkdecodersofratecompatiblepolarcodesviatransferlearning AT kimsanghyo ontrainingneuralnetworkdecodersofratecompatiblepolarcodesviatransferlearning |