Cargando…
Validate your white matter tractography algorithms with a reappraised ISMRM 2015 Tractography Challenge scoring system
Since 2015, research groups have sought to produce the ne plus ultra of tractography algorithms using the ISMRM 2015 Tractography Challenge as evaluation. In particular, since 2017, machine learning has made its entrance into the tractography world. The ISMRM 2015 Tractography Challenge is the most...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9911766/ https://www.ncbi.nlm.nih.gov/pubmed/36759653 http://dx.doi.org/10.1038/s41598-023-28560-w |
_version_ | 1784885061165776896 |
---|---|
author | Renauld, Emmanuelle Théberge, Antoine Petit, Laurent Houde, Jean-Christophe Descoteaux, Maxime |
author_facet | Renauld, Emmanuelle Théberge, Antoine Petit, Laurent Houde, Jean-Christophe Descoteaux, Maxime |
author_sort | Renauld, Emmanuelle |
collection | PubMed |
description | Since 2015, research groups have sought to produce the ne plus ultra of tractography algorithms using the ISMRM 2015 Tractography Challenge as evaluation. In particular, since 2017, machine learning has made its entrance into the tractography world. The ISMRM 2015 Tractography Challenge is the most used phantom during tractography validation, although it contains limitations. Here, we offer a new scoring system for this phantom, where segmentation of the bundles is now based on manually defined regions of interest rather than on bundle recognition. Bundles are now more reliably segmented, offering more representative metrics for future users. New code is available online. Scores of the initial 96 submissions to the challenge are updated. Overall, conclusions from the 2015 challenge are confirmed with the new scoring, but individual tractogram scores have changed, and the data is much improved at the bundle- and streamline-level. This work also led to the production of a ground truth tractogram with less broken or looping streamlines and of an example of processed data, all available on the Tractometer website. This enhanced scoring system and new data should continue helping researchers develop and evaluate the next generation of tractography techniques. |
format | Online Article Text |
id | pubmed-9911766 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-99117662023-02-11 Validate your white matter tractography algorithms with a reappraised ISMRM 2015 Tractography Challenge scoring system Renauld, Emmanuelle Théberge, Antoine Petit, Laurent Houde, Jean-Christophe Descoteaux, Maxime Sci Rep Article Since 2015, research groups have sought to produce the ne plus ultra of tractography algorithms using the ISMRM 2015 Tractography Challenge as evaluation. In particular, since 2017, machine learning has made its entrance into the tractography world. The ISMRM 2015 Tractography Challenge is the most used phantom during tractography validation, although it contains limitations. Here, we offer a new scoring system for this phantom, where segmentation of the bundles is now based on manually defined regions of interest rather than on bundle recognition. Bundles are now more reliably segmented, offering more representative metrics for future users. New code is available online. Scores of the initial 96 submissions to the challenge are updated. Overall, conclusions from the 2015 challenge are confirmed with the new scoring, but individual tractogram scores have changed, and the data is much improved at the bundle- and streamline-level. This work also led to the production of a ground truth tractogram with less broken or looping streamlines and of an example of processed data, all available on the Tractometer website. This enhanced scoring system and new data should continue helping researchers develop and evaluate the next generation of tractography techniques. Nature Publishing Group UK 2023-02-09 /pmc/articles/PMC9911766/ /pubmed/36759653 http://dx.doi.org/10.1038/s41598-023-28560-w Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Article Renauld, Emmanuelle Théberge, Antoine Petit, Laurent Houde, Jean-Christophe Descoteaux, Maxime Validate your white matter tractography algorithms with a reappraised ISMRM 2015 Tractography Challenge scoring system |
title | Validate your white matter tractography algorithms with a reappraised ISMRM 2015 Tractography Challenge scoring system |
title_full | Validate your white matter tractography algorithms with a reappraised ISMRM 2015 Tractography Challenge scoring system |
title_fullStr | Validate your white matter tractography algorithms with a reappraised ISMRM 2015 Tractography Challenge scoring system |
title_full_unstemmed | Validate your white matter tractography algorithms with a reappraised ISMRM 2015 Tractography Challenge scoring system |
title_short | Validate your white matter tractography algorithms with a reappraised ISMRM 2015 Tractography Challenge scoring system |
title_sort | validate your white matter tractography algorithms with a reappraised ismrm 2015 tractography challenge scoring system |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9911766/ https://www.ncbi.nlm.nih.gov/pubmed/36759653 http://dx.doi.org/10.1038/s41598-023-28560-w |
work_keys_str_mv | AT renauldemmanuelle validateyourwhitemattertractographyalgorithmswithareappraisedismrm2015tractographychallengescoringsystem AT thebergeantoine validateyourwhitemattertractographyalgorithmswithareappraisedismrm2015tractographychallengescoringsystem AT petitlaurent validateyourwhitemattertractographyalgorithmswithareappraisedismrm2015tractographychallengescoringsystem AT houdejeanchristophe validateyourwhitemattertractographyalgorithmswithareappraisedismrm2015tractographychallengescoringsystem AT descoteauxmaxime validateyourwhitemattertractographyalgorithmswithareappraisedismrm2015tractographychallengescoringsystem |