Cargando…
MACE for Diagnosis of Dementia and MCI: Examining Cut-Offs and Predictive Values
The definition of test cut-offs is a critical determinant of many paired and unitary measures of diagnostic or screening test accuracy, such as sensitivity and specificity, positive and negative predictive values, and correct classification accuracy. Revision of test cut-offs from those defined in i...
Autor principal: | |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2019
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6627673/ https://www.ncbi.nlm.nih.gov/pubmed/31064141 http://dx.doi.org/10.3390/diagnostics9020051 |
_version_ | 1783434791885996032 |
---|---|
author | Larner, Andrew J. |
author_facet | Larner, Andrew J. |
author_sort | Larner, Andrew J. |
collection | PubMed |
description | The definition of test cut-offs is a critical determinant of many paired and unitary measures of diagnostic or screening test accuracy, such as sensitivity and specificity, positive and negative predictive values, and correct classification accuracy. Revision of test cut-offs from those defined in index studies is frowned upon as a potential source of bias, seemingly accepting any biases present in the index study, for example related to sample bias. Data from a large pragmatic test accuracy study examining the Mini-Addenbrooke’s Cognitive Examination (MACE) were interrogated to determine optimal test cut-offs for the diagnosis of dementia and mild cognitive impairment (MCI) using either the maximal Youden index or the maximal correct classification accuracy. Receiver operating characteristic (ROC) and precision recall (PR) curves for dementia and MCI were also plotted, and MACE predictive values across a range of disease prevalences were calculated. Optimal cut-offs were found to be a point lower than those defined in the index study. MACE had good metrics for the area under the ROC curve and for the effect size (Cohen’s d) for both dementia and MCI diagnosis, but PR curves suggested the superiority for MCI diagnosis. MACE had high negative predictive value at all prevalences, suggesting that a MACE test score above either cut-off excludes dementia and MCI in any setting. |
format | Online Article Text |
id | pubmed-6627673 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2019 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-66276732019-07-23 MACE for Diagnosis of Dementia and MCI: Examining Cut-Offs and Predictive Values Larner, Andrew J. Diagnostics (Basel) Article The definition of test cut-offs is a critical determinant of many paired and unitary measures of diagnostic or screening test accuracy, such as sensitivity and specificity, positive and negative predictive values, and correct classification accuracy. Revision of test cut-offs from those defined in index studies is frowned upon as a potential source of bias, seemingly accepting any biases present in the index study, for example related to sample bias. Data from a large pragmatic test accuracy study examining the Mini-Addenbrooke’s Cognitive Examination (MACE) were interrogated to determine optimal test cut-offs for the diagnosis of dementia and mild cognitive impairment (MCI) using either the maximal Youden index or the maximal correct classification accuracy. Receiver operating characteristic (ROC) and precision recall (PR) curves for dementia and MCI were also plotted, and MACE predictive values across a range of disease prevalences were calculated. Optimal cut-offs were found to be a point lower than those defined in the index study. MACE had good metrics for the area under the ROC curve and for the effect size (Cohen’s d) for both dementia and MCI diagnosis, but PR curves suggested the superiority for MCI diagnosis. MACE had high negative predictive value at all prevalences, suggesting that a MACE test score above either cut-off excludes dementia and MCI in any setting. MDPI 2019-05-06 /pmc/articles/PMC6627673/ /pubmed/31064141 http://dx.doi.org/10.3390/diagnostics9020051 Text en © 2019 by the author. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Larner, Andrew J. MACE for Diagnosis of Dementia and MCI: Examining Cut-Offs and Predictive Values |
title | MACE for Diagnosis of Dementia and MCI: Examining Cut-Offs and Predictive Values |
title_full | MACE for Diagnosis of Dementia and MCI: Examining Cut-Offs and Predictive Values |
title_fullStr | MACE for Diagnosis of Dementia and MCI: Examining Cut-Offs and Predictive Values |
title_full_unstemmed | MACE for Diagnosis of Dementia and MCI: Examining Cut-Offs and Predictive Values |
title_short | MACE for Diagnosis of Dementia and MCI: Examining Cut-Offs and Predictive Values |
title_sort | mace for diagnosis of dementia and mci: examining cut-offs and predictive values |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6627673/ https://www.ncbi.nlm.nih.gov/pubmed/31064141 http://dx.doi.org/10.3390/diagnostics9020051 |
work_keys_str_mv | AT larnerandrewj macefordiagnosisofdementiaandmciexaminingcutoffsandpredictivevalues |