Cargando…
CellBench: R/Bioconductor software for comparing single-cell RNA-seq analysis methods
MOTIVATION: Bioinformatic analysis of single-cell gene expression data is a rapidly evolving field. Hundreds of bespoke methods have been developed in the past few years to deal with various aspects of single-cell analysis and consensus on the most appropriate methods to use under different settings...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Oxford University Press
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7141847/ https://www.ncbi.nlm.nih.gov/pubmed/31778143 http://dx.doi.org/10.1093/bioinformatics/btz889 |
_version_ | 1783519270772146176 |
---|---|
author | Su, Shian Tian, Luyi Dong, Xueyi Hickey, Peter F Freytag, Saskia Ritchie, Matthew E |
author_facet | Su, Shian Tian, Luyi Dong, Xueyi Hickey, Peter F Freytag, Saskia Ritchie, Matthew E |
author_sort | Su, Shian |
collection | PubMed |
description | MOTIVATION: Bioinformatic analysis of single-cell gene expression data is a rapidly evolving field. Hundreds of bespoke methods have been developed in the past few years to deal with various aspects of single-cell analysis and consensus on the most appropriate methods to use under different settings is still emerging. Benchmarking the many methods is therefore of critical importance and since analysis of single-cell data usually involves multi-step pipelines, effective evaluation of pipelines involving different combinations of methods is required. Current benchmarks of single-cell methods are mostly implemented with ad-hoc code that is often difficult to reproduce or extend, and exhaustive manual coding of many combinations is infeasible in most instances. Therefore, new software is needed to manage pipeline benchmarking. RESULTS: The CellBench R software facilitates method comparisons in either a task-centric or combinatorial way to allow pipelines of methods to be evaluated in an effective manner. CellBench automatically runs combinations of methods, provides facilities for measuring running time and delivers output in tabular form which is highly compatible with tidyverse R packages for summary and visualization. Our software has enabled comprehensive benchmarking of single-cell RNA-seq normalization, imputation, clustering, trajectory analysis and data integration methods using various performance metrics obtained from data with available ground truth. CellBench is also amenable to benchmarking other bioinformatics analysis tasks. AVAILABILITY AND IMPLEMENTATION: Available from https://bioconductor.org/packages/CellBench. |
format | Online Article Text |
id | pubmed-7141847 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | Oxford University Press |
record_format | MEDLINE/PubMed |
spelling | pubmed-71418472020-04-13 CellBench: R/Bioconductor software for comparing single-cell RNA-seq analysis methods Su, Shian Tian, Luyi Dong, Xueyi Hickey, Peter F Freytag, Saskia Ritchie, Matthew E Bioinformatics Applications Notes MOTIVATION: Bioinformatic analysis of single-cell gene expression data is a rapidly evolving field. Hundreds of bespoke methods have been developed in the past few years to deal with various aspects of single-cell analysis and consensus on the most appropriate methods to use under different settings is still emerging. Benchmarking the many methods is therefore of critical importance and since analysis of single-cell data usually involves multi-step pipelines, effective evaluation of pipelines involving different combinations of methods is required. Current benchmarks of single-cell methods are mostly implemented with ad-hoc code that is often difficult to reproduce or extend, and exhaustive manual coding of many combinations is infeasible in most instances. Therefore, new software is needed to manage pipeline benchmarking. RESULTS: The CellBench R software facilitates method comparisons in either a task-centric or combinatorial way to allow pipelines of methods to be evaluated in an effective manner. CellBench automatically runs combinations of methods, provides facilities for measuring running time and delivers output in tabular form which is highly compatible with tidyverse R packages for summary and visualization. Our software has enabled comprehensive benchmarking of single-cell RNA-seq normalization, imputation, clustering, trajectory analysis and data integration methods using various performance metrics obtained from data with available ground truth. CellBench is also amenable to benchmarking other bioinformatics analysis tasks. AVAILABILITY AND IMPLEMENTATION: Available from https://bioconductor.org/packages/CellBench. Oxford University Press 2020-04-01 2019-11-28 /pmc/articles/PMC7141847/ /pubmed/31778143 http://dx.doi.org/10.1093/bioinformatics/btz889 Text en © The Author(s) 2019. Published by Oxford University Press. http://creativecommons.org/licenses/by/4.0/ This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Applications Notes Su, Shian Tian, Luyi Dong, Xueyi Hickey, Peter F Freytag, Saskia Ritchie, Matthew E CellBench: R/Bioconductor software for comparing single-cell RNA-seq analysis methods |
title |
CellBench: R/Bioconductor software for comparing single-cell RNA-seq analysis methods |
title_full |
CellBench: R/Bioconductor software for comparing single-cell RNA-seq analysis methods |
title_fullStr |
CellBench: R/Bioconductor software for comparing single-cell RNA-seq analysis methods |
title_full_unstemmed |
CellBench: R/Bioconductor software for comparing single-cell RNA-seq analysis methods |
title_short |
CellBench: R/Bioconductor software for comparing single-cell RNA-seq analysis methods |
title_sort | cellbench: r/bioconductor software for comparing single-cell rna-seq analysis methods |
topic | Applications Notes |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7141847/ https://www.ncbi.nlm.nih.gov/pubmed/31778143 http://dx.doi.org/10.1093/bioinformatics/btz889 |
work_keys_str_mv | AT sushian cellbenchrbioconductorsoftwareforcomparingsinglecellrnaseqanalysismethods AT tianluyi cellbenchrbioconductorsoftwareforcomparingsinglecellrnaseqanalysismethods AT dongxueyi cellbenchrbioconductorsoftwareforcomparingsinglecellrnaseqanalysismethods AT hickeypeterf cellbenchrbioconductorsoftwareforcomparingsinglecellrnaseqanalysismethods AT freytagsaskia cellbenchrbioconductorsoftwareforcomparingsinglecellrnaseqanalysismethods AT ritchiematthewe cellbenchrbioconductorsoftwareforcomparingsinglecellrnaseqanalysismethods |