Cargando…

4320 Acral, Head and Neck Melanoma Subtype Classification Performance Using A Convolutional Neural Network (CNN) Trained On a Public Dataset

OBJECTIVES/GOALS: Composition of demographics or image types in publicly available datasets may detract from deep learning (DL) diagnosis performance of underrepresented melanoma subtypes. We evaluate a DL model’s performance on melanoma subtypes (acral; head and neck) that have known association wi...

Descripción completa

Detalles Bibliográficos
Autores principales: Shah, Payal, Arya, Sameer, Rangel, Lauren, Aphinyanaphongs, Yindalon
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Cambridge University Press 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8823341/
http://dx.doi.org/10.1017/cts.2020.165
_version_ 1784646781519265792
author Shah, Payal
Arya, Sameer
Rangel, Lauren
Aphinyanaphongs, Yindalon
author_facet Shah, Payal
Arya, Sameer
Rangel, Lauren
Aphinyanaphongs, Yindalon
author_sort Shah, Payal
collection PubMed
description OBJECTIVES/GOALS: Composition of demographics or image types in publicly available datasets may detract from deep learning (DL) diagnosis performance of underrepresented melanoma subtypes. We evaluate a DL model’s performance on melanoma subtypes (acral; head and neck) that have known association with poor prognosis. METHODS/STUDY POPULATION: We trained a CNN using a single InceptionV3 model for 30 epochs on dermoscopic images of pigmented lesions from the International Skin Imaging Collaboration (ISIC). The ISIC 2018 challenge training set had 10008 total images, with 1113 total nevi, 6705 total melanomas, 97 acral nevi, 10 acral melanomas, 256 head and neck (H&N) nevi, and 164 H&N melanomas. The non-acral test set had 117 melanomas and 200 nevi. The acral test set had 201 melanomas and 161 nevi. The H&N test set had 199 melanomas and 128 nevi. Area under the receiver operating curve (AUC) was calculated. The model was retrained with acral lesion oversampling (10x) and performance on the acral test set was re-evaluated. RESULTS/ANTICIPATED RESULTS: The model performed on the non-acral test with an AUC of 80.5%, on the acral test with an AUC of 76.3%, and on the head and neck test with an AUC of 83.8% After oversampling acral lesions within the training set, the model showed nearly the same performance as without oversampling on acral lesions: AUC of 75.6%. DISCUSSION/SIGNIFICANCE OF IMPACT: Diagnosis of high-risk melanoma subsets (acral; H&N) remains reliable despite underrepresentation during training, increasing validity for broad implementation of DL technology. Datasets for individual subtypes may not be warranted as findings suggest features may be learned from other skin lesions.
format Online
Article
Text
id pubmed-8823341
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher Cambridge University Press
record_format MEDLINE/PubMed
spelling pubmed-88233412022-02-18 4320 Acral, Head and Neck Melanoma Subtype Classification Performance Using A Convolutional Neural Network (CNN) Trained On a Public Dataset Shah, Payal Arya, Sameer Rangel, Lauren Aphinyanaphongs, Yindalon J Clin Transl Sci Data Science/Biostatistics/Informatics OBJECTIVES/GOALS: Composition of demographics or image types in publicly available datasets may detract from deep learning (DL) diagnosis performance of underrepresented melanoma subtypes. We evaluate a DL model’s performance on melanoma subtypes (acral; head and neck) that have known association with poor prognosis. METHODS/STUDY POPULATION: We trained a CNN using a single InceptionV3 model for 30 epochs on dermoscopic images of pigmented lesions from the International Skin Imaging Collaboration (ISIC). The ISIC 2018 challenge training set had 10008 total images, with 1113 total nevi, 6705 total melanomas, 97 acral nevi, 10 acral melanomas, 256 head and neck (H&N) nevi, and 164 H&N melanomas. The non-acral test set had 117 melanomas and 200 nevi. The acral test set had 201 melanomas and 161 nevi. The H&N test set had 199 melanomas and 128 nevi. Area under the receiver operating curve (AUC) was calculated. The model was retrained with acral lesion oversampling (10x) and performance on the acral test set was re-evaluated. RESULTS/ANTICIPATED RESULTS: The model performed on the non-acral test with an AUC of 80.5%, on the acral test with an AUC of 76.3%, and on the head and neck test with an AUC of 83.8% After oversampling acral lesions within the training set, the model showed nearly the same performance as without oversampling on acral lesions: AUC of 75.6%. DISCUSSION/SIGNIFICANCE OF IMPACT: Diagnosis of high-risk melanoma subsets (acral; H&N) remains reliable despite underrepresentation during training, increasing validity for broad implementation of DL technology. Datasets for individual subtypes may not be warranted as findings suggest features may be learned from other skin lesions. Cambridge University Press 2020-07-29 /pmc/articles/PMC8823341/ http://dx.doi.org/10.1017/cts.2020.165 Text en © The Association for Clinical and Translational Science 2020 https://creativecommons.org/licenses/by/4.0/This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Data Science/Biostatistics/Informatics
Shah, Payal
Arya, Sameer
Rangel, Lauren
Aphinyanaphongs, Yindalon
4320 Acral, Head and Neck Melanoma Subtype Classification Performance Using A Convolutional Neural Network (CNN) Trained On a Public Dataset
title 4320 Acral, Head and Neck Melanoma Subtype Classification Performance Using A Convolutional Neural Network (CNN) Trained On a Public Dataset
title_full 4320 Acral, Head and Neck Melanoma Subtype Classification Performance Using A Convolutional Neural Network (CNN) Trained On a Public Dataset
title_fullStr 4320 Acral, Head and Neck Melanoma Subtype Classification Performance Using A Convolutional Neural Network (CNN) Trained On a Public Dataset
title_full_unstemmed 4320 Acral, Head and Neck Melanoma Subtype Classification Performance Using A Convolutional Neural Network (CNN) Trained On a Public Dataset
title_short 4320 Acral, Head and Neck Melanoma Subtype Classification Performance Using A Convolutional Neural Network (CNN) Trained On a Public Dataset
title_sort 4320 acral, head and neck melanoma subtype classification performance using a convolutional neural network (cnn) trained on a public dataset
topic Data Science/Biostatistics/Informatics
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8823341/
http://dx.doi.org/10.1017/cts.2020.165
work_keys_str_mv AT shahpayal 4320acralheadandneckmelanomasubtypeclassificationperformanceusingaconvolutionalneuralnetworkcnntrainedonapublicdataset
AT aryasameer 4320acralheadandneckmelanomasubtypeclassificationperformanceusingaconvolutionalneuralnetworkcnntrainedonapublicdataset
AT rangellauren 4320acralheadandneckmelanomasubtypeclassificationperformanceusingaconvolutionalneuralnetworkcnntrainedonapublicdataset
AT aphinyanaphongsyindalon 4320acralheadandneckmelanomasubtypeclassificationperformanceusingaconvolutionalneuralnetworkcnntrainedonapublicdataset