Cargando…

Equitable modelling of brain imaging by counterfactual augmentation with morphologically constrained 3D deep generative models

We describe CounterSynth, a conditional generative model of diffeomorphic deformations that induce label-driven, biologically plausible changes in volumetric brain images. The model is intended to synthesise counterfactual training data augmentations for downstream discriminative modelling tasks whe...

Descripción completa

Detalles Bibliográficos
Autores principales: Pombo, Guilherme, Gray, Robert, Cardoso, M. Jorge, Ourselin, Sebastien, Rees, Geraint, Ashburner, John, Nachev, Parashkev
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Elsevier 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10591114/
https://www.ncbi.nlm.nih.gov/pubmed/36542907
http://dx.doi.org/10.1016/j.media.2022.102723
_version_ 1785124155819032576
author Pombo, Guilherme
Gray, Robert
Cardoso, M. Jorge
Ourselin, Sebastien
Rees, Geraint
Ashburner, John
Nachev, Parashkev
author_facet Pombo, Guilherme
Gray, Robert
Cardoso, M. Jorge
Ourselin, Sebastien
Rees, Geraint
Ashburner, John
Nachev, Parashkev
author_sort Pombo, Guilherme
collection PubMed
description We describe CounterSynth, a conditional generative model of diffeomorphic deformations that induce label-driven, biologically plausible changes in volumetric brain images. The model is intended to synthesise counterfactual training data augmentations for downstream discriminative modelling tasks where fidelity is limited by data imbalance, distributional instability, confounding, or underspecification, and exhibits inequitable performance across distinct subpopulations. Focusing on demographic attributes, we evaluate the quality of synthesised counterfactuals with voxel-based morphometry, classification and regression of the conditioning attributes, and the Fréchet inception distance. Examining downstream discriminative performance in the context of engineered demographic imbalance and confounding, we use UK Biobank and OASIS magnetic resonance imaging data to benchmark CounterSynth augmentation against current solutions to these problems. We achieve state-of-the-art improvements, both in overall fidelity and equity. The source code for CounterSynth is available at https://github.com/guilherme-pombo/CounterSynth.
format Online
Article
Text
id pubmed-10591114
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Elsevier
record_format MEDLINE/PubMed
spelling pubmed-105911142023-10-24 Equitable modelling of brain imaging by counterfactual augmentation with morphologically constrained 3D deep generative models Pombo, Guilherme Gray, Robert Cardoso, M. Jorge Ourselin, Sebastien Rees, Geraint Ashburner, John Nachev, Parashkev Med Image Anal Article We describe CounterSynth, a conditional generative model of diffeomorphic deformations that induce label-driven, biologically plausible changes in volumetric brain images. The model is intended to synthesise counterfactual training data augmentations for downstream discriminative modelling tasks where fidelity is limited by data imbalance, distributional instability, confounding, or underspecification, and exhibits inequitable performance across distinct subpopulations. Focusing on demographic attributes, we evaluate the quality of synthesised counterfactuals with voxel-based morphometry, classification and regression of the conditioning attributes, and the Fréchet inception distance. Examining downstream discriminative performance in the context of engineered demographic imbalance and confounding, we use UK Biobank and OASIS magnetic resonance imaging data to benchmark CounterSynth augmentation against current solutions to these problems. We achieve state-of-the-art improvements, both in overall fidelity and equity. The source code for CounterSynth is available at https://github.com/guilherme-pombo/CounterSynth. Elsevier 2023-02 /pmc/articles/PMC10591114/ /pubmed/36542907 http://dx.doi.org/10.1016/j.media.2022.102723 Text en © 2022 The Authors https://creativecommons.org/licenses/by/4.0/This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Pombo, Guilherme
Gray, Robert
Cardoso, M. Jorge
Ourselin, Sebastien
Rees, Geraint
Ashburner, John
Nachev, Parashkev
Equitable modelling of brain imaging by counterfactual augmentation with morphologically constrained 3D deep generative models
title Equitable modelling of brain imaging by counterfactual augmentation with morphologically constrained 3D deep generative models
title_full Equitable modelling of brain imaging by counterfactual augmentation with morphologically constrained 3D deep generative models
title_fullStr Equitable modelling of brain imaging by counterfactual augmentation with morphologically constrained 3D deep generative models
title_full_unstemmed Equitable modelling of brain imaging by counterfactual augmentation with morphologically constrained 3D deep generative models
title_short Equitable modelling of brain imaging by counterfactual augmentation with morphologically constrained 3D deep generative models
title_sort equitable modelling of brain imaging by counterfactual augmentation with morphologically constrained 3d deep generative models
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10591114/
https://www.ncbi.nlm.nih.gov/pubmed/36542907
http://dx.doi.org/10.1016/j.media.2022.102723
work_keys_str_mv AT pomboguilherme equitablemodellingofbrainimagingbycounterfactualaugmentationwithmorphologicallyconstrained3ddeepgenerativemodels
AT grayrobert equitablemodellingofbrainimagingbycounterfactualaugmentationwithmorphologicallyconstrained3ddeepgenerativemodels
AT cardosomjorge equitablemodellingofbrainimagingbycounterfactualaugmentationwithmorphologicallyconstrained3ddeepgenerativemodels
AT ourselinsebastien equitablemodellingofbrainimagingbycounterfactualaugmentationwithmorphologicallyconstrained3ddeepgenerativemodels
AT reesgeraint equitablemodellingofbrainimagingbycounterfactualaugmentationwithmorphologicallyconstrained3ddeepgenerativemodels
AT ashburnerjohn equitablemodellingofbrainimagingbycounterfactualaugmentationwithmorphologicallyconstrained3ddeepgenerativemodels
AT nachevparashkev equitablemodellingofbrainimagingbycounterfactualaugmentationwithmorphologicallyconstrained3ddeepgenerativemodels