Cargando…

Empiric Methods to Account for Pre-analytical Variability in Digital Histopathology in Frontotemporal Lobar Degeneration

Digital pathology is increasingly prominent in neurodegenerative disease research, but variability in immunohistochemical staining intensity between staining batches prevents large-scale comparative studies. Here we provide a statistically rigorous method to account for staining batch effects in a l...

Descripción completa

Detalles Bibliográficos
Autores principales: Giannini, Lucia A. A., Xie, Sharon X., Peterson, Claire, Zhou, Cecilia, Lee, Edward B., Wolk, David A., Grossman, Murray, Trojanowski, John Q., McMillan, Corey T., Irwin, David J.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6616086/
https://www.ncbi.nlm.nih.gov/pubmed/31333403
http://dx.doi.org/10.3389/fnins.2019.00682
_version_ 1783433440665796608
author Giannini, Lucia A. A.
Xie, Sharon X.
Peterson, Claire
Zhou, Cecilia
Lee, Edward B.
Wolk, David A.
Grossman, Murray
Trojanowski, John Q.
McMillan, Corey T.
Irwin, David J.
author_facet Giannini, Lucia A. A.
Xie, Sharon X.
Peterson, Claire
Zhou, Cecilia
Lee, Edward B.
Wolk, David A.
Grossman, Murray
Trojanowski, John Q.
McMillan, Corey T.
Irwin, David J.
author_sort Giannini, Lucia A. A.
collection PubMed
description Digital pathology is increasingly prominent in neurodegenerative disease research, but variability in immunohistochemical staining intensity between staining batches prevents large-scale comparative studies. Here we provide a statistically rigorous method to account for staining batch effects in a large sample of brain tissue with frontotemporal lobar degeneration with tau inclusions (FTLD-Tau, N = 39) or TDP-43 inclusions (FTLD-TDP, N = 53). We analyzed the relationship between duplicate measurements of digital pathology, i.e., percent area occupied by pathology (%AO) for grey matter (GM) and white matter (WM), from two distinct staining batches. We found a significant difference in duplicate measurements from distinct staining batches in FTLD-Tau (mean difference: GM = 1.13 ± 0.44, WM = 1.28 ± 0.56; p < 0.001) and FTLD-TDP (GM = 0.95 ± 0.66, WM = 0.90 ± 0.77; p < 0.001), and these measurements were linearly related (R-squared [Rsq]: FTLD-Tau GM = 0.92, WM = 0.92; FTLD-TDP GM = 0.75, WM = 0.78; p < 0.001 all). We therefore used linear regression to transform %AO from distinct staining batches into equivalent values. Using a train-test set design, we examined transformation prerequisites (i.e., Rsq) from linear-modeling in training sets, and we applied equivalence factors (i.e., beta, intercept) to independent testing sets to determine transformation outcomes (i.e., intraclass correlation coefficient [ICC]). First, random iterations (×100) of linear regression showed that smaller training sets (N = 12–24), feasible for prospective use, have acceptable transformation prerequisites (mean Rsq: FTLD-Tau ≥0.9; FTLD-TDP ≥0.7). When cross-validated on independent complementary testing sets, in FTLD-Tau, N = 12 training sets resulted in 100% of GM and WM transformations with optimal transformation outcomes (ICC ≥ 0.8), while in FTLD-TDP N = 24 training sets resulted in optimal ICC in testing sets (GM = 72%, WM = 98%). We therefore propose training sets of N = 12 in FTLD-Tau and N = 24 in FTLD-TDP for prospective transformations. Finally, the transformation enabled us to significantly reduce batch-related difference in duplicate measurements in FTLD-Tau (GM/WM: p < 0.001 both) and FTLD-TDP (GM/WM: p < 0.001 both), and to decrease the necessary sample size estimated in a power analysis in FTLD-Tau (GM:-40%; WM: -34%) and FTLD-TDP (GM: -20%; WM: -30%). Finally, we tested generalizability of our approach using a second, open-source, image analysis platform and found similar results. We concluded that a small sample of tissue stained in duplicate can be used to account for pre-analytical variability such as staining batch effects, thereby improving methods for future studies.
format Online
Article
Text
id pubmed-6616086
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-66160862019-07-22 Empiric Methods to Account for Pre-analytical Variability in Digital Histopathology in Frontotemporal Lobar Degeneration Giannini, Lucia A. A. Xie, Sharon X. Peterson, Claire Zhou, Cecilia Lee, Edward B. Wolk, David A. Grossman, Murray Trojanowski, John Q. McMillan, Corey T. Irwin, David J. Front Neurosci Neuroscience Digital pathology is increasingly prominent in neurodegenerative disease research, but variability in immunohistochemical staining intensity between staining batches prevents large-scale comparative studies. Here we provide a statistically rigorous method to account for staining batch effects in a large sample of brain tissue with frontotemporal lobar degeneration with tau inclusions (FTLD-Tau, N = 39) or TDP-43 inclusions (FTLD-TDP, N = 53). We analyzed the relationship between duplicate measurements of digital pathology, i.e., percent area occupied by pathology (%AO) for grey matter (GM) and white matter (WM), from two distinct staining batches. We found a significant difference in duplicate measurements from distinct staining batches in FTLD-Tau (mean difference: GM = 1.13 ± 0.44, WM = 1.28 ± 0.56; p < 0.001) and FTLD-TDP (GM = 0.95 ± 0.66, WM = 0.90 ± 0.77; p < 0.001), and these measurements were linearly related (R-squared [Rsq]: FTLD-Tau GM = 0.92, WM = 0.92; FTLD-TDP GM = 0.75, WM = 0.78; p < 0.001 all). We therefore used linear regression to transform %AO from distinct staining batches into equivalent values. Using a train-test set design, we examined transformation prerequisites (i.e., Rsq) from linear-modeling in training sets, and we applied equivalence factors (i.e., beta, intercept) to independent testing sets to determine transformation outcomes (i.e., intraclass correlation coefficient [ICC]). First, random iterations (×100) of linear regression showed that smaller training sets (N = 12–24), feasible for prospective use, have acceptable transformation prerequisites (mean Rsq: FTLD-Tau ≥0.9; FTLD-TDP ≥0.7). When cross-validated on independent complementary testing sets, in FTLD-Tau, N = 12 training sets resulted in 100% of GM and WM transformations with optimal transformation outcomes (ICC ≥ 0.8), while in FTLD-TDP N = 24 training sets resulted in optimal ICC in testing sets (GM = 72%, WM = 98%). We therefore propose training sets of N = 12 in FTLD-Tau and N = 24 in FTLD-TDP for prospective transformations. Finally, the transformation enabled us to significantly reduce batch-related difference in duplicate measurements in FTLD-Tau (GM/WM: p < 0.001 both) and FTLD-TDP (GM/WM: p < 0.001 both), and to decrease the necessary sample size estimated in a power analysis in FTLD-Tau (GM:-40%; WM: -34%) and FTLD-TDP (GM: -20%; WM: -30%). Finally, we tested generalizability of our approach using a second, open-source, image analysis platform and found similar results. We concluded that a small sample of tissue stained in duplicate can be used to account for pre-analytical variability such as staining batch effects, thereby improving methods for future studies. Frontiers Media S.A. 2019-07-03 /pmc/articles/PMC6616086/ /pubmed/31333403 http://dx.doi.org/10.3389/fnins.2019.00682 Text en Copyright © 2019 Giannini, Xie, Peterson, Zhou, Lee, Wolk, Grossman, Trojanowski, McMillan and Irwin. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Giannini, Lucia A. A.
Xie, Sharon X.
Peterson, Claire
Zhou, Cecilia
Lee, Edward B.
Wolk, David A.
Grossman, Murray
Trojanowski, John Q.
McMillan, Corey T.
Irwin, David J.
Empiric Methods to Account for Pre-analytical Variability in Digital Histopathology in Frontotemporal Lobar Degeneration
title Empiric Methods to Account for Pre-analytical Variability in Digital Histopathology in Frontotemporal Lobar Degeneration
title_full Empiric Methods to Account for Pre-analytical Variability in Digital Histopathology in Frontotemporal Lobar Degeneration
title_fullStr Empiric Methods to Account for Pre-analytical Variability in Digital Histopathology in Frontotemporal Lobar Degeneration
title_full_unstemmed Empiric Methods to Account for Pre-analytical Variability in Digital Histopathology in Frontotemporal Lobar Degeneration
title_short Empiric Methods to Account for Pre-analytical Variability in Digital Histopathology in Frontotemporal Lobar Degeneration
title_sort empiric methods to account for pre-analytical variability in digital histopathology in frontotemporal lobar degeneration
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6616086/
https://www.ncbi.nlm.nih.gov/pubmed/31333403
http://dx.doi.org/10.3389/fnins.2019.00682
work_keys_str_mv AT gianniniluciaaa empiricmethodstoaccountforpreanalyticalvariabilityindigitalhistopathologyinfrontotemporallobardegeneration
AT xiesharonx empiricmethodstoaccountforpreanalyticalvariabilityindigitalhistopathologyinfrontotemporallobardegeneration
AT petersonclaire empiricmethodstoaccountforpreanalyticalvariabilityindigitalhistopathologyinfrontotemporallobardegeneration
AT zhoucecilia empiricmethodstoaccountforpreanalyticalvariabilityindigitalhistopathologyinfrontotemporallobardegeneration
AT leeedwardb empiricmethodstoaccountforpreanalyticalvariabilityindigitalhistopathologyinfrontotemporallobardegeneration
AT wolkdavida empiricmethodstoaccountforpreanalyticalvariabilityindigitalhistopathologyinfrontotemporallobardegeneration
AT grossmanmurray empiricmethodstoaccountforpreanalyticalvariabilityindigitalhistopathologyinfrontotemporallobardegeneration
AT trojanowskijohnq empiricmethodstoaccountforpreanalyticalvariabilityindigitalhistopathologyinfrontotemporallobardegeneration
AT mcmillancoreyt empiricmethodstoaccountforpreanalyticalvariabilityindigitalhistopathologyinfrontotemporallobardegeneration
AT irwindavidj empiricmethodstoaccountforpreanalyticalvariabilityindigitalhistopathologyinfrontotemporallobardegeneration