Cargando…

Setting minimum clinical performance specifications for tests based on disease prevalence and minimum acceptable positive and negative predictive values: Practical considerations applied to COVID-19 testing

OBJECTIVES: Several guidelines for the evaluation of laboratory tests for severe acute respiratory syndrome-coronavirus-2 (SARS-CoV-2) infection have recommended establishing an a priori definition of minimum clinical performance specifications before test selection and method evaluation. METHODS: U...

Descripción completa

Detalles Bibliográficos
Autores principales: Loh, Tze Ping, Lord, Sarah J, Bell, Katy, Bohn, Mary Kathryn, Lim, Chun Yee, Markus, Corey, Fares Taie, Hernan, Adeli, Khosrow, Lippi, Giuseppe, Sandberg, Sverre, Horvath, Andrea
Formato: Online Artículo Texto
Lenguaje:English
Publicado: The Canadian Society of Clinical Chemists. Published by Elsevier Inc. 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7678449/
https://www.ncbi.nlm.nih.gov/pubmed/33227233
http://dx.doi.org/10.1016/j.clinbiochem.2020.11.003
_version_ 1783612157323116544
author Loh, Tze Ping
Lord, Sarah J
Bell, Katy
Bohn, Mary Kathryn
Lim, Chun Yee
Markus, Corey
Fares Taie, Hernan
Adeli, Khosrow
Lippi, Giuseppe
Sandberg, Sverre
Horvath, Andrea
author_facet Loh, Tze Ping
Lord, Sarah J
Bell, Katy
Bohn, Mary Kathryn
Lim, Chun Yee
Markus, Corey
Fares Taie, Hernan
Adeli, Khosrow
Lippi, Giuseppe
Sandberg, Sverre
Horvath, Andrea
author_sort Loh, Tze Ping
collection PubMed
description OBJECTIVES: Several guidelines for the evaluation of laboratory tests for severe acute respiratory syndrome-coronavirus-2 (SARS-CoV-2) infection have recommended establishing an a priori definition of minimum clinical performance specifications before test selection and method evaluation. METHODS: Using positive (PPV) and negative predictive values (NPV), we constructed a spreadsheet tool for determining the minimum clinical specificity (conditional on NPV or PPV, sensitivity and prevalence) and minimum clinical sensitivity (conditional on NPV or PPV, specificity and prevalence) of tests. RESULTS: At a prevalence of 1%, there are no minimum sensitivity requirements to achieve a desired NPV of 60%-95% for a given clinical specificity above 20%. It is not possible to achieve 60–95% PPV even with 100% clinical sensitivity, except when the clinical specificity is near 100%. The opposite trend is seen in high prevalence settings (60%), where a relatively low minimum clinical sensitivity is required to achieve a desired PPV for a given clinical specificity, and a higher minimum clinical specificity is required to achieve a desired NPV for a given clinical sensitivity. DISCUSSION: The selection of laboratory tests and the testing strategy for SARS-CoV-2 involves delicate trade-offs between NPV and PPV based on prevalence and clinical sensitivity and clinical specificity. Practitioners and health authorities should carefully consider the clinical scenarios under which the test result will be used and select the most appropriate testing strategy that fulfils the a priori defined clinical performance specification.
format Online
Article
Text
id pubmed-7678449
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher The Canadian Society of Clinical Chemists. Published by Elsevier Inc.
record_format MEDLINE/PubMed
spelling pubmed-76784492020-11-23 Setting minimum clinical performance specifications for tests based on disease prevalence and minimum acceptable positive and negative predictive values: Practical considerations applied to COVID-19 testing Loh, Tze Ping Lord, Sarah J Bell, Katy Bohn, Mary Kathryn Lim, Chun Yee Markus, Corey Fares Taie, Hernan Adeli, Khosrow Lippi, Giuseppe Sandberg, Sverre Horvath, Andrea Clin Biochem Article OBJECTIVES: Several guidelines for the evaluation of laboratory tests for severe acute respiratory syndrome-coronavirus-2 (SARS-CoV-2) infection have recommended establishing an a priori definition of minimum clinical performance specifications before test selection and method evaluation. METHODS: Using positive (PPV) and negative predictive values (NPV), we constructed a spreadsheet tool for determining the minimum clinical specificity (conditional on NPV or PPV, sensitivity and prevalence) and minimum clinical sensitivity (conditional on NPV or PPV, specificity and prevalence) of tests. RESULTS: At a prevalence of 1%, there are no minimum sensitivity requirements to achieve a desired NPV of 60%-95% for a given clinical specificity above 20%. It is not possible to achieve 60–95% PPV even with 100% clinical sensitivity, except when the clinical specificity is near 100%. The opposite trend is seen in high prevalence settings (60%), where a relatively low minimum clinical sensitivity is required to achieve a desired PPV for a given clinical specificity, and a higher minimum clinical specificity is required to achieve a desired NPV for a given clinical sensitivity. DISCUSSION: The selection of laboratory tests and the testing strategy for SARS-CoV-2 involves delicate trade-offs between NPV and PPV based on prevalence and clinical sensitivity and clinical specificity. Practitioners and health authorities should carefully consider the clinical scenarios under which the test result will be used and select the most appropriate testing strategy that fulfils the a priori defined clinical performance specification. The Canadian Society of Clinical Chemists. Published by Elsevier Inc. 2021-02 2020-11-20 /pmc/articles/PMC7678449/ /pubmed/33227233 http://dx.doi.org/10.1016/j.clinbiochem.2020.11.003 Text en © 2020 The Canadian Society of Clinical Chemists. Published by Elsevier Inc. All rights reserved. Since January 2020 Elsevier has created a COVID-19 resource centre with free information in English and Mandarin on the novel coronavirus COVID-19. The COVID-19 resource centre is hosted on Elsevier Connect, the company's public news and information website. Elsevier hereby grants permission to make all its COVID-19-related research that is available on the COVID-19 resource centre - including this research content - immediately available in PubMed Central and other publicly funded repositories, such as the WHO COVID database with rights for unrestricted research re-use and analyses in any form or by any means with acknowledgement of the original source. These permissions are granted for free by Elsevier for as long as the COVID-19 resource centre remains active.
spellingShingle Article
Loh, Tze Ping
Lord, Sarah J
Bell, Katy
Bohn, Mary Kathryn
Lim, Chun Yee
Markus, Corey
Fares Taie, Hernan
Adeli, Khosrow
Lippi, Giuseppe
Sandberg, Sverre
Horvath, Andrea
Setting minimum clinical performance specifications for tests based on disease prevalence and minimum acceptable positive and negative predictive values: Practical considerations applied to COVID-19 testing
title Setting minimum clinical performance specifications for tests based on disease prevalence and minimum acceptable positive and negative predictive values: Practical considerations applied to COVID-19 testing
title_full Setting minimum clinical performance specifications for tests based on disease prevalence and minimum acceptable positive and negative predictive values: Practical considerations applied to COVID-19 testing
title_fullStr Setting minimum clinical performance specifications for tests based on disease prevalence and minimum acceptable positive and negative predictive values: Practical considerations applied to COVID-19 testing
title_full_unstemmed Setting minimum clinical performance specifications for tests based on disease prevalence and minimum acceptable positive and negative predictive values: Practical considerations applied to COVID-19 testing
title_short Setting minimum clinical performance specifications for tests based on disease prevalence and minimum acceptable positive and negative predictive values: Practical considerations applied to COVID-19 testing
title_sort setting minimum clinical performance specifications for tests based on disease prevalence and minimum acceptable positive and negative predictive values: practical considerations applied to covid-19 testing
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7678449/
https://www.ncbi.nlm.nih.gov/pubmed/33227233
http://dx.doi.org/10.1016/j.clinbiochem.2020.11.003
work_keys_str_mv AT lohtzeping settingminimumclinicalperformancespecificationsfortestsbasedondiseaseprevalenceandminimumacceptablepositiveandnegativepredictivevaluespracticalconsiderationsappliedtocovid19testing
AT lordsarahj settingminimumclinicalperformancespecificationsfortestsbasedondiseaseprevalenceandminimumacceptablepositiveandnegativepredictivevaluespracticalconsiderationsappliedtocovid19testing
AT bellkaty settingminimumclinicalperformancespecificationsfortestsbasedondiseaseprevalenceandminimumacceptablepositiveandnegativepredictivevaluespracticalconsiderationsappliedtocovid19testing
AT bohnmarykathryn settingminimumclinicalperformancespecificationsfortestsbasedondiseaseprevalenceandminimumacceptablepositiveandnegativepredictivevaluespracticalconsiderationsappliedtocovid19testing
AT limchunyee settingminimumclinicalperformancespecificationsfortestsbasedondiseaseprevalenceandminimumacceptablepositiveandnegativepredictivevaluespracticalconsiderationsappliedtocovid19testing
AT markuscorey settingminimumclinicalperformancespecificationsfortestsbasedondiseaseprevalenceandminimumacceptablepositiveandnegativepredictivevaluespracticalconsiderationsappliedtocovid19testing
AT farestaiehernan settingminimumclinicalperformancespecificationsfortestsbasedondiseaseprevalenceandminimumacceptablepositiveandnegativepredictivevaluespracticalconsiderationsappliedtocovid19testing
AT adelikhosrow settingminimumclinicalperformancespecificationsfortestsbasedondiseaseprevalenceandminimumacceptablepositiveandnegativepredictivevaluespracticalconsiderationsappliedtocovid19testing
AT lippigiuseppe settingminimumclinicalperformancespecificationsfortestsbasedondiseaseprevalenceandminimumacceptablepositiveandnegativepredictivevaluespracticalconsiderationsappliedtocovid19testing
AT sandbergsverre settingminimumclinicalperformancespecificationsfortestsbasedondiseaseprevalenceandminimumacceptablepositiveandnegativepredictivevaluespracticalconsiderationsappliedtocovid19testing
AT horvathandrea settingminimumclinicalperformancespecificationsfortestsbasedondiseaseprevalenceandminimumacceptablepositiveandnegativepredictivevaluespracticalconsiderationsappliedtocovid19testing