Cargando…
Learning to Classify DWDM Optical Channels from Tiny and Imbalanced Data
Applying machine learning algorithms for assessing the transmission quality in optical networks is associated with substantial challenges. Datasets that could provide training instances tend to be small and heavily imbalanced. This requires applying imbalanced compensation techniques when using bina...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8623617/ https://www.ncbi.nlm.nih.gov/pubmed/34828202 http://dx.doi.org/10.3390/e23111504 |
_version_ | 1784605975424008192 |
---|---|
author | Cichosz, Paweł Kozdrowski, Stanisław Sujecki, Sławomir |
author_facet | Cichosz, Paweł Kozdrowski, Stanisław Sujecki, Sławomir |
author_sort | Cichosz, Paweł |
collection | PubMed |
description | Applying machine learning algorithms for assessing the transmission quality in optical networks is associated with substantial challenges. Datasets that could provide training instances tend to be small and heavily imbalanced. This requires applying imbalanced compensation techniques when using binary classification algorithms, but it also makes one-class classification, learning only from instances of the majority class, a noteworthy alternative. This work examines the utility of both these approaches using a real dataset from a Dense Wavelength Division Multiplexing network operator, gathered through the network control plane. The dataset is indeed of a very small size and contains very few examples of “bad” paths that do not deliver the required level of transmission quality. Two binary classification algorithms, random forest and extreme gradient boosting, are used in combination with two imbalance handling methods, instance weighting and synthetic minority class instance generation. Their predictive performance is compared with that of four one-class classification algorithms: One-class SVM, one-class naive Bayes classifier, isolation forest, and maximum entropy modeling. The one-class approach turns out to be clearly superior, particularly with respect to the level of classification precision, making it possible to obtain more practically useful models. |
format | Online Article Text |
id | pubmed-8623617 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-86236172021-11-27 Learning to Classify DWDM Optical Channels from Tiny and Imbalanced Data Cichosz, Paweł Kozdrowski, Stanisław Sujecki, Sławomir Entropy (Basel) Article Applying machine learning algorithms for assessing the transmission quality in optical networks is associated with substantial challenges. Datasets that could provide training instances tend to be small and heavily imbalanced. This requires applying imbalanced compensation techniques when using binary classification algorithms, but it also makes one-class classification, learning only from instances of the majority class, a noteworthy alternative. This work examines the utility of both these approaches using a real dataset from a Dense Wavelength Division Multiplexing network operator, gathered through the network control plane. The dataset is indeed of a very small size and contains very few examples of “bad” paths that do not deliver the required level of transmission quality. Two binary classification algorithms, random forest and extreme gradient boosting, are used in combination with two imbalance handling methods, instance weighting and synthetic minority class instance generation. Their predictive performance is compared with that of four one-class classification algorithms: One-class SVM, one-class naive Bayes classifier, isolation forest, and maximum entropy modeling. The one-class approach turns out to be clearly superior, particularly with respect to the level of classification precision, making it possible to obtain more practically useful models. MDPI 2021-11-13 /pmc/articles/PMC8623617/ /pubmed/34828202 http://dx.doi.org/10.3390/e23111504 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Cichosz, Paweł Kozdrowski, Stanisław Sujecki, Sławomir Learning to Classify DWDM Optical Channels from Tiny and Imbalanced Data |
title | Learning to Classify DWDM Optical Channels from Tiny and Imbalanced Data |
title_full | Learning to Classify DWDM Optical Channels from Tiny and Imbalanced Data |
title_fullStr | Learning to Classify DWDM Optical Channels from Tiny and Imbalanced Data |
title_full_unstemmed | Learning to Classify DWDM Optical Channels from Tiny and Imbalanced Data |
title_short | Learning to Classify DWDM Optical Channels from Tiny and Imbalanced Data |
title_sort | learning to classify dwdm optical channels from tiny and imbalanced data |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8623617/ https://www.ncbi.nlm.nih.gov/pubmed/34828202 http://dx.doi.org/10.3390/e23111504 |
work_keys_str_mv | AT cichoszpaweł learningtoclassifydwdmopticalchannelsfromtinyandimbalanceddata AT kozdrowskistanisław learningtoclassifydwdmopticalchannelsfromtinyandimbalanceddata AT sujeckisławomir learningtoclassifydwdmopticalchannelsfromtinyandimbalanceddata |