Cargando…

Toward Establishing Internal Validity for Correlated Gene Expression Measures in Imaging Genomics of Functional Networks: Why Distance Corrections and External Face Validity Alone Fall Short. Reply to “Distance Is Not Everything in Imaging Genomics of Functional Networks: Reply to a Commentary on Correlated Gene Expression Supports Synchronous Activity in Brain Networks”

The primary claim of the Richiardi et al. (2015) Science article is that a measure of correlated gene expression, significant strength fraction (SSF), is related to resting state fMRI (rsfMRI) networks. However, there is still debate about this claim and whether spatial proximity, in the form of con...

Descripción completa

Detalles Bibliográficos
Autores principales: Pantazatos, Spiro P., Schmidt, Mike F.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7227731/
https://www.ncbi.nlm.nih.gov/pubmed/32457571
http://dx.doi.org/10.3389/fnins.2020.00433
_version_ 1783534548199407616
author Pantazatos, Spiro P.
Schmidt, Mike F.
author_facet Pantazatos, Spiro P.
Schmidt, Mike F.
author_sort Pantazatos, Spiro P.
collection PubMed
description The primary claim of the Richiardi et al. (2015) Science article is that a measure of correlated gene expression, significant strength fraction (SSF), is related to resting state fMRI (rsfMRI) networks. However, there is still debate about this claim and whether spatial proximity, in the form of contiguous clusters, accounts entirely, or only partially, for SSF (Pantazatos and Li, 2017; Richiardi et al., 2017). Here, 13 distributed networks were simulated by combining 34 contiguous clusters randomly placed throughout cortex, with resulting edge distance distributions similar to rsfMRI networks. Cluster size was modulated (6–15 mm radius) to test its influence on SSF false positive rate (SSF-FPR) among the simulated “noise” networks. The contribution of rsfMRI networks on SSF-FPR was examined by comparing simulated networks whose clusters were sampled from: (1) all 1,777 cortical tissue samples, (2) all samples, but with non-rsfMRI cluster centers, and (3) only 1,276 non-rsfMRI samples. Results show that SSF-FPR is influenced only by cluster size (r > 0.9, p < 0.001), not by rsfMRI samples. Simulations using 14 mm radius clusters most resembled rsfMRI networks. When thresholding at p < 10(–4), the SSF-FPR was 0.47. Genes that maximize SF have high global spatial autocorrelation. In conclusion, SSF is unrelated to rsfMRI networks. The main conclusion of Richiardi et al. (2015) is based on a finding that is ∼50% likely to be a false positive, not <0.01% as originally reported in the article (Richiardi et al., 2015). We discuss why distance corrections alone and external face validity are insufficient to establish a trustworthy relationship between correlated gene expression measures and rsfMRI networks, and propose more rigorous approaches to preclude common pitfalls in related studies.
format Online
Article
Text
id pubmed-7227731
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-72277312020-05-25 Toward Establishing Internal Validity for Correlated Gene Expression Measures in Imaging Genomics of Functional Networks: Why Distance Corrections and External Face Validity Alone Fall Short. Reply to “Distance Is Not Everything in Imaging Genomics of Functional Networks: Reply to a Commentary on Correlated Gene Expression Supports Synchronous Activity in Brain Networks” Pantazatos, Spiro P. Schmidt, Mike F. Front Neurosci Neuroscience The primary claim of the Richiardi et al. (2015) Science article is that a measure of correlated gene expression, significant strength fraction (SSF), is related to resting state fMRI (rsfMRI) networks. However, there is still debate about this claim and whether spatial proximity, in the form of contiguous clusters, accounts entirely, or only partially, for SSF (Pantazatos and Li, 2017; Richiardi et al., 2017). Here, 13 distributed networks were simulated by combining 34 contiguous clusters randomly placed throughout cortex, with resulting edge distance distributions similar to rsfMRI networks. Cluster size was modulated (6–15 mm radius) to test its influence on SSF false positive rate (SSF-FPR) among the simulated “noise” networks. The contribution of rsfMRI networks on SSF-FPR was examined by comparing simulated networks whose clusters were sampled from: (1) all 1,777 cortical tissue samples, (2) all samples, but with non-rsfMRI cluster centers, and (3) only 1,276 non-rsfMRI samples. Results show that SSF-FPR is influenced only by cluster size (r > 0.9, p < 0.001), not by rsfMRI samples. Simulations using 14 mm radius clusters most resembled rsfMRI networks. When thresholding at p < 10(–4), the SSF-FPR was 0.47. Genes that maximize SF have high global spatial autocorrelation. In conclusion, SSF is unrelated to rsfMRI networks. The main conclusion of Richiardi et al. (2015) is based on a finding that is ∼50% likely to be a false positive, not <0.01% as originally reported in the article (Richiardi et al., 2015). We discuss why distance corrections alone and external face validity are insufficient to establish a trustworthy relationship between correlated gene expression measures and rsfMRI networks, and propose more rigorous approaches to preclude common pitfalls in related studies. Frontiers Media S.A. 2020-05-08 /pmc/articles/PMC7227731/ /pubmed/32457571 http://dx.doi.org/10.3389/fnins.2020.00433 Text en Copyright © 2020 Pantazatos and Schmidt. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Pantazatos, Spiro P.
Schmidt, Mike F.
Toward Establishing Internal Validity for Correlated Gene Expression Measures in Imaging Genomics of Functional Networks: Why Distance Corrections and External Face Validity Alone Fall Short. Reply to “Distance Is Not Everything in Imaging Genomics of Functional Networks: Reply to a Commentary on Correlated Gene Expression Supports Synchronous Activity in Brain Networks”
title Toward Establishing Internal Validity for Correlated Gene Expression Measures in Imaging Genomics of Functional Networks: Why Distance Corrections and External Face Validity Alone Fall Short. Reply to “Distance Is Not Everything in Imaging Genomics of Functional Networks: Reply to a Commentary on Correlated Gene Expression Supports Synchronous Activity in Brain Networks”
title_full Toward Establishing Internal Validity for Correlated Gene Expression Measures in Imaging Genomics of Functional Networks: Why Distance Corrections and External Face Validity Alone Fall Short. Reply to “Distance Is Not Everything in Imaging Genomics of Functional Networks: Reply to a Commentary on Correlated Gene Expression Supports Synchronous Activity in Brain Networks”
title_fullStr Toward Establishing Internal Validity for Correlated Gene Expression Measures in Imaging Genomics of Functional Networks: Why Distance Corrections and External Face Validity Alone Fall Short. Reply to “Distance Is Not Everything in Imaging Genomics of Functional Networks: Reply to a Commentary on Correlated Gene Expression Supports Synchronous Activity in Brain Networks”
title_full_unstemmed Toward Establishing Internal Validity for Correlated Gene Expression Measures in Imaging Genomics of Functional Networks: Why Distance Corrections and External Face Validity Alone Fall Short. Reply to “Distance Is Not Everything in Imaging Genomics of Functional Networks: Reply to a Commentary on Correlated Gene Expression Supports Synchronous Activity in Brain Networks”
title_short Toward Establishing Internal Validity for Correlated Gene Expression Measures in Imaging Genomics of Functional Networks: Why Distance Corrections and External Face Validity Alone Fall Short. Reply to “Distance Is Not Everything in Imaging Genomics of Functional Networks: Reply to a Commentary on Correlated Gene Expression Supports Synchronous Activity in Brain Networks”
title_sort toward establishing internal validity for correlated gene expression measures in imaging genomics of functional networks: why distance corrections and external face validity alone fall short. reply to “distance is not everything in imaging genomics of functional networks: reply to a commentary on correlated gene expression supports synchronous activity in brain networks”
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7227731/
https://www.ncbi.nlm.nih.gov/pubmed/32457571
http://dx.doi.org/10.3389/fnins.2020.00433
work_keys_str_mv AT pantazatosspirop towardestablishinginternalvalidityforcorrelatedgeneexpressionmeasuresinimaginggenomicsoffunctionalnetworkswhydistancecorrectionsandexternalfacevalidityalonefallshortreplytodistanceisnoteverythinginimaginggenomicsoffunctionalnetworksreplytoacommentaryoncor
AT schmidtmikef towardestablishinginternalvalidityforcorrelatedgeneexpressionmeasuresinimaginggenomicsoffunctionalnetworkswhydistancecorrectionsandexternalfacevalidityalonefallshortreplytodistanceisnoteverythinginimaginggenomicsoffunctionalnetworksreplytoacommentaryoncor