Cargando…
Crowdsourcing for translational research: analysis of biomarker expression using cancer microarrays
BACKGROUND: Academic pathology suffers from an acute and growing lack of workforce resource. This especially impacts on translational elements of clinical trials, which can require detailed analysis of thousands of tissue samples. We tested whether crowdsourcing – enlisting help from the public – is...
Autores principales: | , , , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group
2017
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5243992/ https://www.ncbi.nlm.nih.gov/pubmed/27959886 http://dx.doi.org/10.1038/bjc.2016.404 |
_version_ | 1782496615604420608 |
---|---|
author | Lawson, Jonathan Robinson-Vyas, Rupesh J McQuillan, Janette P Paterson, Andy Christie, Sarah Kidza-Griffiths, Matthew McDuffus, Leigh-Anne Moutasim, Karwan A Shaw, Emily C Kiltie, Anne E Howat, William J Hanby, Andrew M Thomas, Gareth J Smittenaar, Peter |
author_facet | Lawson, Jonathan Robinson-Vyas, Rupesh J McQuillan, Janette P Paterson, Andy Christie, Sarah Kidza-Griffiths, Matthew McDuffus, Leigh-Anne Moutasim, Karwan A Shaw, Emily C Kiltie, Anne E Howat, William J Hanby, Andrew M Thomas, Gareth J Smittenaar, Peter |
author_sort | Lawson, Jonathan |
collection | PubMed |
description | BACKGROUND: Academic pathology suffers from an acute and growing lack of workforce resource. This especially impacts on translational elements of clinical trials, which can require detailed analysis of thousands of tissue samples. We tested whether crowdsourcing – enlisting help from the public – is a sufficiently accurate method to score such samples. METHODS: We developed a novel online interface to train and test lay participants on cancer detection and immunohistochemistry scoring in tissue microarrays. Lay participants initially performed cancer detection on lung cancer images stained for CD8, and we measured how extending a basic tutorial by annotated example images and feedback-based training affected cancer detection accuracy. We then applied this tutorial to additional cancer types and immunohistochemistry markers – bladder/ki67, lung/EGFR, and oesophageal/CD8 – to establish accuracy compared with experts. Using this optimised tutorial, we then tested lay participants' accuracy on immunohistochemistry scoring of lung/EGFR and bladder/p53 samples. RESULTS: We observed that for cancer detection, annotated example images and feedback-based training both improved accuracy compared with a basic tutorial only. Using this optimised tutorial, we demonstrate highly accurate (>0.90 area under curve) detection of cancer in samples stained with nuclear, cytoplasmic and membrane cell markers. We also observed high Spearman correlations between lay participants and experts for immunohistochemistry scoring (0.91 (0.78, 0.96) and 0.97 (0.91, 0.99) for lung/EGFR and bladder/p53 samples, respectively). CONCLUSIONS: These results establish crowdsourcing as a promising method to screen large data sets for biomarkers in cancer pathology research across a range of cancers and immunohistochemical stains. |
format | Online Article Text |
id | pubmed-5243992 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2017 |
publisher | Nature Publishing Group |
record_format | MEDLINE/PubMed |
spelling | pubmed-52439922017-01-25 Crowdsourcing for translational research: analysis of biomarker expression using cancer microarrays Lawson, Jonathan Robinson-Vyas, Rupesh J McQuillan, Janette P Paterson, Andy Christie, Sarah Kidza-Griffiths, Matthew McDuffus, Leigh-Anne Moutasim, Karwan A Shaw, Emily C Kiltie, Anne E Howat, William J Hanby, Andrew M Thomas, Gareth J Smittenaar, Peter Br J Cancer Molecular Diagnostics BACKGROUND: Academic pathology suffers from an acute and growing lack of workforce resource. This especially impacts on translational elements of clinical trials, which can require detailed analysis of thousands of tissue samples. We tested whether crowdsourcing – enlisting help from the public – is a sufficiently accurate method to score such samples. METHODS: We developed a novel online interface to train and test lay participants on cancer detection and immunohistochemistry scoring in tissue microarrays. Lay participants initially performed cancer detection on lung cancer images stained for CD8, and we measured how extending a basic tutorial by annotated example images and feedback-based training affected cancer detection accuracy. We then applied this tutorial to additional cancer types and immunohistochemistry markers – bladder/ki67, lung/EGFR, and oesophageal/CD8 – to establish accuracy compared with experts. Using this optimised tutorial, we then tested lay participants' accuracy on immunohistochemistry scoring of lung/EGFR and bladder/p53 samples. RESULTS: We observed that for cancer detection, annotated example images and feedback-based training both improved accuracy compared with a basic tutorial only. Using this optimised tutorial, we demonstrate highly accurate (>0.90 area under curve) detection of cancer in samples stained with nuclear, cytoplasmic and membrane cell markers. We also observed high Spearman correlations between lay participants and experts for immunohistochemistry scoring (0.91 (0.78, 0.96) and 0.97 (0.91, 0.99) for lung/EGFR and bladder/p53 samples, respectively). CONCLUSIONS: These results establish crowdsourcing as a promising method to screen large data sets for biomarkers in cancer pathology research across a range of cancers and immunohistochemical stains. Nature Publishing Group 2017-01-17 2016-12-13 /pmc/articles/PMC5243992/ /pubmed/27959886 http://dx.doi.org/10.1038/bjc.2016.404 Text en Copyright © 2017 The Author(s) http://creativecommons.org/licenses/by/4.0/ This work is licensed under the Creative Commons Attribution 4.0 International License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ |
spellingShingle | Molecular Diagnostics Lawson, Jonathan Robinson-Vyas, Rupesh J McQuillan, Janette P Paterson, Andy Christie, Sarah Kidza-Griffiths, Matthew McDuffus, Leigh-Anne Moutasim, Karwan A Shaw, Emily C Kiltie, Anne E Howat, William J Hanby, Andrew M Thomas, Gareth J Smittenaar, Peter Crowdsourcing for translational research: analysis of biomarker expression using cancer microarrays |
title | Crowdsourcing for translational research: analysis of biomarker expression using cancer microarrays |
title_full | Crowdsourcing for translational research: analysis of biomarker expression using cancer microarrays |
title_fullStr | Crowdsourcing for translational research: analysis of biomarker expression using cancer microarrays |
title_full_unstemmed | Crowdsourcing for translational research: analysis of biomarker expression using cancer microarrays |
title_short | Crowdsourcing for translational research: analysis of biomarker expression using cancer microarrays |
title_sort | crowdsourcing for translational research: analysis of biomarker expression using cancer microarrays |
topic | Molecular Diagnostics |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5243992/ https://www.ncbi.nlm.nih.gov/pubmed/27959886 http://dx.doi.org/10.1038/bjc.2016.404 |
work_keys_str_mv | AT lawsonjonathan crowdsourcingfortranslationalresearchanalysisofbiomarkerexpressionusingcancermicroarrays AT robinsonvyasrupeshj crowdsourcingfortranslationalresearchanalysisofbiomarkerexpressionusingcancermicroarrays AT mcquillanjanettep crowdsourcingfortranslationalresearchanalysisofbiomarkerexpressionusingcancermicroarrays AT patersonandy crowdsourcingfortranslationalresearchanalysisofbiomarkerexpressionusingcancermicroarrays AT christiesarah crowdsourcingfortranslationalresearchanalysisofbiomarkerexpressionusingcancermicroarrays AT kidzagriffithsmatthew crowdsourcingfortranslationalresearchanalysisofbiomarkerexpressionusingcancermicroarrays AT mcduffusleighanne crowdsourcingfortranslationalresearchanalysisofbiomarkerexpressionusingcancermicroarrays AT moutasimkarwana crowdsourcingfortranslationalresearchanalysisofbiomarkerexpressionusingcancermicroarrays AT shawemilyc crowdsourcingfortranslationalresearchanalysisofbiomarkerexpressionusingcancermicroarrays AT kiltieannee crowdsourcingfortranslationalresearchanalysisofbiomarkerexpressionusingcancermicroarrays AT howatwilliamj crowdsourcingfortranslationalresearchanalysisofbiomarkerexpressionusingcancermicroarrays AT hanbyandrewm crowdsourcingfortranslationalresearchanalysisofbiomarkerexpressionusingcancermicroarrays AT thomasgarethj crowdsourcingfortranslationalresearchanalysisofbiomarkerexpressionusingcancermicroarrays AT smittenaarpeter crowdsourcingfortranslationalresearchanalysisofbiomarkerexpressionusingcancermicroarrays |