Cargando…
Classification of (18)F-Flutemetamol scans in cognitively normal older adults using machine learning trained with neuropathology as ground truth
PURPOSE: End-of-life studies have validated the binary visual reads of (18)F-labeled amyloid PET tracers as an accurate tool for the presence or absence of increased neuritic amyloid plaque density. In this study, the performance of a support vector machine (SVM)-based classifier will be tested agai...
Autores principales: | , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Springer Berlin Heidelberg
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9399207/ https://www.ncbi.nlm.nih.gov/pubmed/35522322 http://dx.doi.org/10.1007/s00259-022-05808-7 |
_version_ | 1784772472001789952 |
---|---|
author | Reinartz, Mariska Luckett, Emma Susanne Schaeverbeke, Jolien De Meyer, Steffi Adamczuk, Katarzyna Thal, Dietmar Rudolf Van Laere, Koen Dupont, Patrick Vandenberghe, Rik |
author_facet | Reinartz, Mariska Luckett, Emma Susanne Schaeverbeke, Jolien De Meyer, Steffi Adamczuk, Katarzyna Thal, Dietmar Rudolf Van Laere, Koen Dupont, Patrick Vandenberghe, Rik |
author_sort | Reinartz, Mariska |
collection | PubMed |
description | PURPOSE: End-of-life studies have validated the binary visual reads of (18)F-labeled amyloid PET tracers as an accurate tool for the presence or absence of increased neuritic amyloid plaque density. In this study, the performance of a support vector machine (SVM)-based classifier will be tested against pathological ground truths and its performance determined in cognitively healthy older adults. METHODS: We applied SVM with a linear kernel to an (18)F-Flutemetamol end-of-life dataset to determine the regions with the highest feature weights in a data-driven manner and to compare between two different pathological ground truths: based on neuritic amyloid plaque density or on amyloid phases, respectively. We also trained and tested classifiers based on the 10% voxels with the highest amplitudes of feature weights for each of the two neuropathological ground truths. Next, we tested the classifiers’ diagnostic performance in the asymptomatic Alzheimer’s disease (AD) phase, a phase of interest for future drug development, in an independent dataset of cognitively intact older adults, the Flemish Prevent AD Cohort-KU Leuven (F-PACK). A regression analysis was conducted between the Centiloid (CL) value in a composite volume of interest (VOI), as index for amyloid load, and the distance to the hyperplane for each of the two classifiers, based on the two pathological ground truths. A receiver operating characteristic analysis was also performed to determine the CL threshold that optimally discriminates between neuritic amyloid plaque positivity versus negativity, or amyloid phase positivity versus negativity, within F-PACK. RESULTS: The classifiers yielded adequate specificity and sensitivity within the end-of-life dataset (neuritic amyloid plaque density classifier: specificity of 90.2% and sensitivity of 83.7%; amyloid phase classifier: specificity of 98.4% and sensitivity of 84.0%). The regions with the highest feature weights corresponded to precuneus, caudate, anteromedial prefrontal, and also posterior inferior temporal and inferior parietal cortex. In the cognitively normal cohort, the correlation coefficient between CL and distance to the hyperplane was −0.66 for the classifier trained with neuritic amyloid plaque density, and −0.88 for the classifier trained with amyloid phases. This difference was significant. The optimal CL cut-off for discriminating positive versus negative scans was CL = 48–51 for the different classifiers (area under the curve (AUC) = 99.9%), except for the classifier trained with amyloid phases and based on the 10% voxels with highest feature weights. There the cut-off was CL = 26 (AUC = 99.5%), which closely matched the CL threshold for discriminating phases 0–2 from 3–5 based on the end-of-life dataset and the neuropathological ground truth. DISCUSSION: Among a set of neuropathologically validated classifiers trained with end-of-life cases, transfer to a cognitively normal population works best for a classifier trained with amyloid phases and using only voxels with the highest amplitudes of feature weights. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s00259-022-05808-7. |
format | Online Article Text |
id | pubmed-9399207 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Springer Berlin Heidelberg |
record_format | MEDLINE/PubMed |
spelling | pubmed-93992072022-08-25 Classification of (18)F-Flutemetamol scans in cognitively normal older adults using machine learning trained with neuropathology as ground truth Reinartz, Mariska Luckett, Emma Susanne Schaeverbeke, Jolien De Meyer, Steffi Adamczuk, Katarzyna Thal, Dietmar Rudolf Van Laere, Koen Dupont, Patrick Vandenberghe, Rik Eur J Nucl Med Mol Imaging Original Article PURPOSE: End-of-life studies have validated the binary visual reads of (18)F-labeled amyloid PET tracers as an accurate tool for the presence or absence of increased neuritic amyloid plaque density. In this study, the performance of a support vector machine (SVM)-based classifier will be tested against pathological ground truths and its performance determined in cognitively healthy older adults. METHODS: We applied SVM with a linear kernel to an (18)F-Flutemetamol end-of-life dataset to determine the regions with the highest feature weights in a data-driven manner and to compare between two different pathological ground truths: based on neuritic amyloid plaque density or on amyloid phases, respectively. We also trained and tested classifiers based on the 10% voxels with the highest amplitudes of feature weights for each of the two neuropathological ground truths. Next, we tested the classifiers’ diagnostic performance in the asymptomatic Alzheimer’s disease (AD) phase, a phase of interest for future drug development, in an independent dataset of cognitively intact older adults, the Flemish Prevent AD Cohort-KU Leuven (F-PACK). A regression analysis was conducted between the Centiloid (CL) value in a composite volume of interest (VOI), as index for amyloid load, and the distance to the hyperplane for each of the two classifiers, based on the two pathological ground truths. A receiver operating characteristic analysis was also performed to determine the CL threshold that optimally discriminates between neuritic amyloid plaque positivity versus negativity, or amyloid phase positivity versus negativity, within F-PACK. RESULTS: The classifiers yielded adequate specificity and sensitivity within the end-of-life dataset (neuritic amyloid plaque density classifier: specificity of 90.2% and sensitivity of 83.7%; amyloid phase classifier: specificity of 98.4% and sensitivity of 84.0%). The regions with the highest feature weights corresponded to precuneus, caudate, anteromedial prefrontal, and also posterior inferior temporal and inferior parietal cortex. In the cognitively normal cohort, the correlation coefficient between CL and distance to the hyperplane was −0.66 for the classifier trained with neuritic amyloid plaque density, and −0.88 for the classifier trained with amyloid phases. This difference was significant. The optimal CL cut-off for discriminating positive versus negative scans was CL = 48–51 for the different classifiers (area under the curve (AUC) = 99.9%), except for the classifier trained with amyloid phases and based on the 10% voxels with highest feature weights. There the cut-off was CL = 26 (AUC = 99.5%), which closely matched the CL threshold for discriminating phases 0–2 from 3–5 based on the end-of-life dataset and the neuropathological ground truth. DISCUSSION: Among a set of neuropathologically validated classifiers trained with end-of-life cases, transfer to a cognitively normal population works best for a classifier trained with amyloid phases and using only voxels with the highest amplitudes of feature weights. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s00259-022-05808-7. Springer Berlin Heidelberg 2022-05-06 2022 /pmc/articles/PMC9399207/ /pubmed/35522322 http://dx.doi.org/10.1007/s00259-022-05808-7 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Original Article Reinartz, Mariska Luckett, Emma Susanne Schaeverbeke, Jolien De Meyer, Steffi Adamczuk, Katarzyna Thal, Dietmar Rudolf Van Laere, Koen Dupont, Patrick Vandenberghe, Rik Classification of (18)F-Flutemetamol scans in cognitively normal older adults using machine learning trained with neuropathology as ground truth |
title | Classification of (18)F-Flutemetamol scans in cognitively normal older adults using machine learning trained with neuropathology as ground truth |
title_full | Classification of (18)F-Flutemetamol scans in cognitively normal older adults using machine learning trained with neuropathology as ground truth |
title_fullStr | Classification of (18)F-Flutemetamol scans in cognitively normal older adults using machine learning trained with neuropathology as ground truth |
title_full_unstemmed | Classification of (18)F-Flutemetamol scans in cognitively normal older adults using machine learning trained with neuropathology as ground truth |
title_short | Classification of (18)F-Flutemetamol scans in cognitively normal older adults using machine learning trained with neuropathology as ground truth |
title_sort | classification of (18)f-flutemetamol scans in cognitively normal older adults using machine learning trained with neuropathology as ground truth |
topic | Original Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9399207/ https://www.ncbi.nlm.nih.gov/pubmed/35522322 http://dx.doi.org/10.1007/s00259-022-05808-7 |
work_keys_str_mv | AT reinartzmariska classificationof18fflutemetamolscansincognitivelynormalolderadultsusingmachinelearningtrainedwithneuropathologyasgroundtruth AT luckettemmasusanne classificationof18fflutemetamolscansincognitivelynormalolderadultsusingmachinelearningtrainedwithneuropathologyasgroundtruth AT schaeverbekejolien classificationof18fflutemetamolscansincognitivelynormalolderadultsusingmachinelearningtrainedwithneuropathologyasgroundtruth AT demeyersteffi classificationof18fflutemetamolscansincognitivelynormalolderadultsusingmachinelearningtrainedwithneuropathologyasgroundtruth AT adamczukkatarzyna classificationof18fflutemetamolscansincognitivelynormalolderadultsusingmachinelearningtrainedwithneuropathologyasgroundtruth AT thaldietmarrudolf classificationof18fflutemetamolscansincognitivelynormalolderadultsusingmachinelearningtrainedwithneuropathologyasgroundtruth AT vanlaerekoen classificationof18fflutemetamolscansincognitivelynormalolderadultsusingmachinelearningtrainedwithneuropathologyasgroundtruth AT dupontpatrick classificationof18fflutemetamolscansincognitivelynormalolderadultsusingmachinelearningtrainedwithneuropathologyasgroundtruth AT vandenbergherik classificationof18fflutemetamolscansincognitivelynormalolderadultsusingmachinelearningtrainedwithneuropathologyasgroundtruth |