Cargando…

The power metric: a new statistically robust enrichment-type metric for virtual screening applications with early recovery capability

A new metric for the evaluation of model performance in the field of virtual screening and quantitative structure–activity relationship applications is described. This metric has been termed the power metric and is defined as the fraction of the true positive rate divided by the sum of the true posi...

Descripción completa

Detalles Bibliográficos
Autores principales: Lopes, Julio Cesar Dias, dos Santos, Fábio Mendes, Martins-José, Andrelly, Augustyns, Koen, De Winter, Hans
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer International Publishing 2017
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5289935/
https://www.ncbi.nlm.nih.gov/pubmed/28203291
http://dx.doi.org/10.1186/s13321-016-0189-4
_version_ 1782504560846176256
author Lopes, Julio Cesar Dias
dos Santos, Fábio Mendes
Martins-José, Andrelly
Augustyns, Koen
De Winter, Hans
author_facet Lopes, Julio Cesar Dias
dos Santos, Fábio Mendes
Martins-José, Andrelly
Augustyns, Koen
De Winter, Hans
author_sort Lopes, Julio Cesar Dias
collection PubMed
description A new metric for the evaluation of model performance in the field of virtual screening and quantitative structure–activity relationship applications is described. This metric has been termed the power metric and is defined as the fraction of the true positive rate divided by the sum of the true positive and false positive rates, for a given cutoff threshold. The performance of this metric is compared with alternative metrics such as the enrichment factor, the relative enrichment factor, the receiver operating curve enrichment factor, the correct classification rate, Matthews correlation coefficient and Cohen’s kappa coefficient. The performance of this new metric is found to be quite robust with respect to variations in the applied cutoff threshold and ratio of the number of active compounds to the total number of compounds, and at the same time being sensitive to variations in model quality. It possesses the correct characteristics for its application in early-recognition virtual screening problems.
format Online
Article
Text
id pubmed-5289935
institution National Center for Biotechnology Information
language English
publishDate 2017
publisher Springer International Publishing
record_format MEDLINE/PubMed
spelling pubmed-52899352017-02-15 The power metric: a new statistically robust enrichment-type metric for virtual screening applications with early recovery capability Lopes, Julio Cesar Dias dos Santos, Fábio Mendes Martins-José, Andrelly Augustyns, Koen De Winter, Hans J Cheminform Research Article A new metric for the evaluation of model performance in the field of virtual screening and quantitative structure–activity relationship applications is described. This metric has been termed the power metric and is defined as the fraction of the true positive rate divided by the sum of the true positive and false positive rates, for a given cutoff threshold. The performance of this metric is compared with alternative metrics such as the enrichment factor, the relative enrichment factor, the receiver operating curve enrichment factor, the correct classification rate, Matthews correlation coefficient and Cohen’s kappa coefficient. The performance of this new metric is found to be quite robust with respect to variations in the applied cutoff threshold and ratio of the number of active compounds to the total number of compounds, and at the same time being sensitive to variations in model quality. It possesses the correct characteristics for its application in early-recognition virtual screening problems. Springer International Publishing 2017-02-02 /pmc/articles/PMC5289935/ /pubmed/28203291 http://dx.doi.org/10.1186/s13321-016-0189-4 Text en © The Author(s) 2017 Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
spellingShingle Research Article
Lopes, Julio Cesar Dias
dos Santos, Fábio Mendes
Martins-José, Andrelly
Augustyns, Koen
De Winter, Hans
The power metric: a new statistically robust enrichment-type metric for virtual screening applications with early recovery capability
title The power metric: a new statistically robust enrichment-type metric for virtual screening applications with early recovery capability
title_full The power metric: a new statistically robust enrichment-type metric for virtual screening applications with early recovery capability
title_fullStr The power metric: a new statistically robust enrichment-type metric for virtual screening applications with early recovery capability
title_full_unstemmed The power metric: a new statistically robust enrichment-type metric for virtual screening applications with early recovery capability
title_short The power metric: a new statistically robust enrichment-type metric for virtual screening applications with early recovery capability
title_sort power metric: a new statistically robust enrichment-type metric for virtual screening applications with early recovery capability
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5289935/
https://www.ncbi.nlm.nih.gov/pubmed/28203291
http://dx.doi.org/10.1186/s13321-016-0189-4
work_keys_str_mv AT lopesjuliocesardias thepowermetricanewstatisticallyrobustenrichmenttypemetricforvirtualscreeningapplicationswithearlyrecoverycapability
AT dossantosfabiomendes thepowermetricanewstatisticallyrobustenrichmenttypemetricforvirtualscreeningapplicationswithearlyrecoverycapability
AT martinsjoseandrelly thepowermetricanewstatisticallyrobustenrichmenttypemetricforvirtualscreeningapplicationswithearlyrecoverycapability
AT augustynskoen thepowermetricanewstatisticallyrobustenrichmenttypemetricforvirtualscreeningapplicationswithearlyrecoverycapability
AT dewinterhans thepowermetricanewstatisticallyrobustenrichmenttypemetricforvirtualscreeningapplicationswithearlyrecoverycapability
AT lopesjuliocesardias powermetricanewstatisticallyrobustenrichmenttypemetricforvirtualscreeningapplicationswithearlyrecoverycapability
AT dossantosfabiomendes powermetricanewstatisticallyrobustenrichmenttypemetricforvirtualscreeningapplicationswithearlyrecoverycapability
AT martinsjoseandrelly powermetricanewstatisticallyrobustenrichmenttypemetricforvirtualscreeningapplicationswithearlyrecoverycapability
AT augustynskoen powermetricanewstatisticallyrobustenrichmenttypemetricforvirtualscreeningapplicationswithearlyrecoverycapability
AT dewinterhans powermetricanewstatisticallyrobustenrichmenttypemetricforvirtualscreeningapplicationswithearlyrecoverycapability