Cargando…

Decomposition of the mean absolute error (MAE) into systematic and unsystematic components

When evaluating the performance of quantitative models, dimensioned errors often are characterized by sums-of-squares measures such as the mean squared error (MSE) or its square root, the root mean squared error (RMSE). In terms of quantifying average error, however, absolute-value-based measures su...

Descripción completa

Detalles Bibliográficos
Autores principales: Robeson, Scott M., Willmott, Cort J.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9937461/
https://www.ncbi.nlm.nih.gov/pubmed/36800326
http://dx.doi.org/10.1371/journal.pone.0279774
_version_ 1784890429052813312
author Robeson, Scott M.
Willmott, Cort J.
author_facet Robeson, Scott M.
Willmott, Cort J.
author_sort Robeson, Scott M.
collection PubMed
description When evaluating the performance of quantitative models, dimensioned errors often are characterized by sums-of-squares measures such as the mean squared error (MSE) or its square root, the root mean squared error (RMSE). In terms of quantifying average error, however, absolute-value-based measures such as the mean absolute error (MAE) are more interpretable than MSE or RMSE. Part of that historical preference for sums-of-squares measures is that they are mathematically amenable to decomposition and one can then form ratios, such as those based on separating MSE into its systematic and unsystematic components. Here, we develop and illustrate a decomposition of MAE into three useful submeasures: (1) bias error, (2) proportionality error, and (3) unsystematic error. This three-part decomposition of MAE is preferable to comparable decompositions of MSE because it provides more straightforward information on the nature of the model-error distribution. We illustrate the properties of our new three-part decomposition using a long-term reconstruction of streamflow for the Upper Colorado River.
format Online
Article
Text
id pubmed-9937461
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-99374612023-02-18 Decomposition of the mean absolute error (MAE) into systematic and unsystematic components Robeson, Scott M. Willmott, Cort J. PLoS One Research Article When evaluating the performance of quantitative models, dimensioned errors often are characterized by sums-of-squares measures such as the mean squared error (MSE) or its square root, the root mean squared error (RMSE). In terms of quantifying average error, however, absolute-value-based measures such as the mean absolute error (MAE) are more interpretable than MSE or RMSE. Part of that historical preference for sums-of-squares measures is that they are mathematically amenable to decomposition and one can then form ratios, such as those based on separating MSE into its systematic and unsystematic components. Here, we develop and illustrate a decomposition of MAE into three useful submeasures: (1) bias error, (2) proportionality error, and (3) unsystematic error. This three-part decomposition of MAE is preferable to comparable decompositions of MSE because it provides more straightforward information on the nature of the model-error distribution. We illustrate the properties of our new three-part decomposition using a long-term reconstruction of streamflow for the Upper Colorado River. Public Library of Science 2023-02-17 /pmc/articles/PMC9937461/ /pubmed/36800326 http://dx.doi.org/10.1371/journal.pone.0279774 Text en © 2023 Robeson, Willmott https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Robeson, Scott M.
Willmott, Cort J.
Decomposition of the mean absolute error (MAE) into systematic and unsystematic components
title Decomposition of the mean absolute error (MAE) into systematic and unsystematic components
title_full Decomposition of the mean absolute error (MAE) into systematic and unsystematic components
title_fullStr Decomposition of the mean absolute error (MAE) into systematic and unsystematic components
title_full_unstemmed Decomposition of the mean absolute error (MAE) into systematic and unsystematic components
title_short Decomposition of the mean absolute error (MAE) into systematic and unsystematic components
title_sort decomposition of the mean absolute error (mae) into systematic and unsystematic components
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9937461/
https://www.ncbi.nlm.nih.gov/pubmed/36800326
http://dx.doi.org/10.1371/journal.pone.0279774
work_keys_str_mv AT robesonscottm decompositionofthemeanabsoluteerrormaeintosystematicandunsystematiccomponents
AT willmottcortj decompositionofthemeanabsoluteerrormaeintosystematicandunsystematiccomponents