Cargando…
4320 Acral, Head and Neck Melanoma Subtype Classification Performance Using A Convolutional Neural Network (CNN) Trained On a Public Dataset
OBJECTIVES/GOALS: Composition of demographics or image types in publicly available datasets may detract from deep learning (DL) diagnosis performance of underrepresented melanoma subtypes. We evaluate a DL model’s performance on melanoma subtypes (acral; head and neck) that have known association wi...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Cambridge University Press
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8823341/ http://dx.doi.org/10.1017/cts.2020.165 |
_version_ | 1784646781519265792 |
---|---|
author | Shah, Payal Arya, Sameer Rangel, Lauren Aphinyanaphongs, Yindalon |
author_facet | Shah, Payal Arya, Sameer Rangel, Lauren Aphinyanaphongs, Yindalon |
author_sort | Shah, Payal |
collection | PubMed |
description | OBJECTIVES/GOALS: Composition of demographics or image types in publicly available datasets may detract from deep learning (DL) diagnosis performance of underrepresented melanoma subtypes. We evaluate a DL model’s performance on melanoma subtypes (acral; head and neck) that have known association with poor prognosis. METHODS/STUDY POPULATION: We trained a CNN using a single InceptionV3 model for 30 epochs on dermoscopic images of pigmented lesions from the International Skin Imaging Collaboration (ISIC). The ISIC 2018 challenge training set had 10008 total images, with 1113 total nevi, 6705 total melanomas, 97 acral nevi, 10 acral melanomas, 256 head and neck (H&N) nevi, and 164 H&N melanomas. The non-acral test set had 117 melanomas and 200 nevi. The acral test set had 201 melanomas and 161 nevi. The H&N test set had 199 melanomas and 128 nevi. Area under the receiver operating curve (AUC) was calculated. The model was retrained with acral lesion oversampling (10x) and performance on the acral test set was re-evaluated. RESULTS/ANTICIPATED RESULTS: The model performed on the non-acral test with an AUC of 80.5%, on the acral test with an AUC of 76.3%, and on the head and neck test with an AUC of 83.8% After oversampling acral lesions within the training set, the model showed nearly the same performance as without oversampling on acral lesions: AUC of 75.6%. DISCUSSION/SIGNIFICANCE OF IMPACT: Diagnosis of high-risk melanoma subsets (acral; H&N) remains reliable despite underrepresentation during training, increasing validity for broad implementation of DL technology. Datasets for individual subtypes may not be warranted as findings suggest features may be learned from other skin lesions. |
format | Online Article Text |
id | pubmed-8823341 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | Cambridge University Press |
record_format | MEDLINE/PubMed |
spelling | pubmed-88233412022-02-18 4320 Acral, Head and Neck Melanoma Subtype Classification Performance Using A Convolutional Neural Network (CNN) Trained On a Public Dataset Shah, Payal Arya, Sameer Rangel, Lauren Aphinyanaphongs, Yindalon J Clin Transl Sci Data Science/Biostatistics/Informatics OBJECTIVES/GOALS: Composition of demographics or image types in publicly available datasets may detract from deep learning (DL) diagnosis performance of underrepresented melanoma subtypes. We evaluate a DL model’s performance on melanoma subtypes (acral; head and neck) that have known association with poor prognosis. METHODS/STUDY POPULATION: We trained a CNN using a single InceptionV3 model for 30 epochs on dermoscopic images of pigmented lesions from the International Skin Imaging Collaboration (ISIC). The ISIC 2018 challenge training set had 10008 total images, with 1113 total nevi, 6705 total melanomas, 97 acral nevi, 10 acral melanomas, 256 head and neck (H&N) nevi, and 164 H&N melanomas. The non-acral test set had 117 melanomas and 200 nevi. The acral test set had 201 melanomas and 161 nevi. The H&N test set had 199 melanomas and 128 nevi. Area under the receiver operating curve (AUC) was calculated. The model was retrained with acral lesion oversampling (10x) and performance on the acral test set was re-evaluated. RESULTS/ANTICIPATED RESULTS: The model performed on the non-acral test with an AUC of 80.5%, on the acral test with an AUC of 76.3%, and on the head and neck test with an AUC of 83.8% After oversampling acral lesions within the training set, the model showed nearly the same performance as without oversampling on acral lesions: AUC of 75.6%. DISCUSSION/SIGNIFICANCE OF IMPACT: Diagnosis of high-risk melanoma subsets (acral; H&N) remains reliable despite underrepresentation during training, increasing validity for broad implementation of DL technology. Datasets for individual subtypes may not be warranted as findings suggest features may be learned from other skin lesions. Cambridge University Press 2020-07-29 /pmc/articles/PMC8823341/ http://dx.doi.org/10.1017/cts.2020.165 Text en © The Association for Clinical and Translational Science 2020 https://creativecommons.org/licenses/by/4.0/This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Data Science/Biostatistics/Informatics Shah, Payal Arya, Sameer Rangel, Lauren Aphinyanaphongs, Yindalon 4320 Acral, Head and Neck Melanoma Subtype Classification Performance Using A Convolutional Neural Network (CNN) Trained On a Public Dataset |
title | 4320 Acral, Head and Neck Melanoma Subtype Classification Performance Using A Convolutional Neural Network (CNN) Trained On a Public Dataset |
title_full | 4320 Acral, Head and Neck Melanoma Subtype Classification Performance Using A Convolutional Neural Network (CNN) Trained On a Public Dataset |
title_fullStr | 4320 Acral, Head and Neck Melanoma Subtype Classification Performance Using A Convolutional Neural Network (CNN) Trained On a Public Dataset |
title_full_unstemmed | 4320 Acral, Head and Neck Melanoma Subtype Classification Performance Using A Convolutional Neural Network (CNN) Trained On a Public Dataset |
title_short | 4320 Acral, Head and Neck Melanoma Subtype Classification Performance Using A Convolutional Neural Network (CNN) Trained On a Public Dataset |
title_sort | 4320 acral, head and neck melanoma subtype classification performance using a convolutional neural network (cnn) trained on a public dataset |
topic | Data Science/Biostatistics/Informatics |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8823341/ http://dx.doi.org/10.1017/cts.2020.165 |
work_keys_str_mv | AT shahpayal 4320acralheadandneckmelanomasubtypeclassificationperformanceusingaconvolutionalneuralnetworkcnntrainedonapublicdataset AT aryasameer 4320acralheadandneckmelanomasubtypeclassificationperformanceusingaconvolutionalneuralnetworkcnntrainedonapublicdataset AT rangellauren 4320acralheadandneckmelanomasubtypeclassificationperformanceusingaconvolutionalneuralnetworkcnntrainedonapublicdataset AT aphinyanaphongsyindalon 4320acralheadandneckmelanomasubtypeclassificationperformanceusingaconvolutionalneuralnetworkcnntrainedonapublicdataset |