Cargando…

On the importance of predictor choice, modelling technique, and number of pseudo‐absences for bioclimatic envelope model performance

Bioclimatic envelope models are commonly used to assess the influence of climate change on species' distributions and biodiversity patterns. Understanding how methodological choices influence these models is critical for a comprehensive evaluation of the estimated impacts. Here we systematicall...

Descripción completa

Detalles Bibliográficos
Autores principales: Čengić, Mirza, Rost, Jasmijn, Remenska, Daniela, Janse, Jan H., Huijbregts, Mark A. J., Schipper, Aafke M.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: John Wiley and Sons Inc. 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7663074/
https://www.ncbi.nlm.nih.gov/pubmed/33209289
http://dx.doi.org/10.1002/ece3.6859
_version_ 1783609542460833792
author Čengić, Mirza
Rost, Jasmijn
Remenska, Daniela
Janse, Jan H.
Huijbregts, Mark A. J.
Schipper, Aafke M.
author_facet Čengić, Mirza
Rost, Jasmijn
Remenska, Daniela
Janse, Jan H.
Huijbregts, Mark A. J.
Schipper, Aafke M.
author_sort Čengić, Mirza
collection PubMed
description Bioclimatic envelope models are commonly used to assess the influence of climate change on species' distributions and biodiversity patterns. Understanding how methodological choices influence these models is critical for a comprehensive evaluation of the estimated impacts. Here we systematically assess the performance of bioclimatic envelope models in relation to the selection of predictors, modeling technique, and pseudo‐absences. We considered (a) five different predictor sets, (b) seven commonly used modeling techniques and an ensemble model, and (c) three sets of pseudo‐absences (1,000 pseudo‐absences, 10,000 pseudo‐absences, and the same as the number of presences). For each combination of predictor set, modeling technique, and pseudo‐absence set, we fitted bioclimatic envelope models for 300 species of mammals, amphibians, and freshwater fish, and evaluated the predictive performance of the models using the true skill statistic (TSS), based on a spatially independent test set as well as cross‐validation. On average across the species, model performance was mostly influenced by the choice of predictor set, followed by the choice of modeling technique. The number of the pseudo‐absences did not have a strong effect on the model performance. Based on spatially independent testing, ensemble models based on species‐specific nonredundant predictor sets revealed the highest predictive performance. In contrast, the Random Forest technique yielded the highest model performance in cross‐validation but had the largest decrease in model performance when transferred to a different spatial context, thus highlighting the need for spatially independent model evaluation. We recommend building bioclimatic envelope models according to an ensemble modeling approach based on a nonredundant set of bioclimatic predictors, preferably selected for each modeled species.
format Online
Article
Text
id pubmed-7663074
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher John Wiley and Sons Inc.
record_format MEDLINE/PubMed
spelling pubmed-76630742020-11-17 On the importance of predictor choice, modelling technique, and number of pseudo‐absences for bioclimatic envelope model performance Čengić, Mirza Rost, Jasmijn Remenska, Daniela Janse, Jan H. Huijbregts, Mark A. J. Schipper, Aafke M. Ecol Evol Original Research Bioclimatic envelope models are commonly used to assess the influence of climate change on species' distributions and biodiversity patterns. Understanding how methodological choices influence these models is critical for a comprehensive evaluation of the estimated impacts. Here we systematically assess the performance of bioclimatic envelope models in relation to the selection of predictors, modeling technique, and pseudo‐absences. We considered (a) five different predictor sets, (b) seven commonly used modeling techniques and an ensemble model, and (c) three sets of pseudo‐absences (1,000 pseudo‐absences, 10,000 pseudo‐absences, and the same as the number of presences). For each combination of predictor set, modeling technique, and pseudo‐absence set, we fitted bioclimatic envelope models for 300 species of mammals, amphibians, and freshwater fish, and evaluated the predictive performance of the models using the true skill statistic (TSS), based on a spatially independent test set as well as cross‐validation. On average across the species, model performance was mostly influenced by the choice of predictor set, followed by the choice of modeling technique. The number of the pseudo‐absences did not have a strong effect on the model performance. Based on spatially independent testing, ensemble models based on species‐specific nonredundant predictor sets revealed the highest predictive performance. In contrast, the Random Forest technique yielded the highest model performance in cross‐validation but had the largest decrease in model performance when transferred to a different spatial context, thus highlighting the need for spatially independent model evaluation. We recommend building bioclimatic envelope models according to an ensemble modeling approach based on a nonredundant set of bioclimatic predictors, preferably selected for each modeled species. John Wiley and Sons Inc. 2020-10-16 /pmc/articles/PMC7663074/ /pubmed/33209289 http://dx.doi.org/10.1002/ece3.6859 Text en © 2020 The Authors. Ecology and Evolution published by John Wiley & Sons Ltd This is an open access article under the terms of the http://creativecommons.org/licenses/by/4.0/ License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.
spellingShingle Original Research
Čengić, Mirza
Rost, Jasmijn
Remenska, Daniela
Janse, Jan H.
Huijbregts, Mark A. J.
Schipper, Aafke M.
On the importance of predictor choice, modelling technique, and number of pseudo‐absences for bioclimatic envelope model performance
title On the importance of predictor choice, modelling technique, and number of pseudo‐absences for bioclimatic envelope model performance
title_full On the importance of predictor choice, modelling technique, and number of pseudo‐absences for bioclimatic envelope model performance
title_fullStr On the importance of predictor choice, modelling technique, and number of pseudo‐absences for bioclimatic envelope model performance
title_full_unstemmed On the importance of predictor choice, modelling technique, and number of pseudo‐absences for bioclimatic envelope model performance
title_short On the importance of predictor choice, modelling technique, and number of pseudo‐absences for bioclimatic envelope model performance
title_sort on the importance of predictor choice, modelling technique, and number of pseudo‐absences for bioclimatic envelope model performance
topic Original Research
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7663074/
https://www.ncbi.nlm.nih.gov/pubmed/33209289
http://dx.doi.org/10.1002/ece3.6859
work_keys_str_mv AT cengicmirza ontheimportanceofpredictorchoicemodellingtechniqueandnumberofpseudoabsencesforbioclimaticenvelopemodelperformance
AT rostjasmijn ontheimportanceofpredictorchoicemodellingtechniqueandnumberofpseudoabsencesforbioclimaticenvelopemodelperformance
AT remenskadaniela ontheimportanceofpredictorchoicemodellingtechniqueandnumberofpseudoabsencesforbioclimaticenvelopemodelperformance
AT jansejanh ontheimportanceofpredictorchoicemodellingtechniqueandnumberofpseudoabsencesforbioclimaticenvelopemodelperformance
AT huijbregtsmarkaj ontheimportanceofpredictorchoicemodellingtechniqueandnumberofpseudoabsencesforbioclimaticenvelopemodelperformance
AT schipperaafkem ontheimportanceofpredictorchoicemodellingtechniqueandnumberofpseudoabsencesforbioclimaticenvelopemodelperformance