Cargando…
Cognition‐Enhanced Machine Learning for Better Predictions with Limited Data
The fields of machine learning (ML) and cognitive science have developed complementary approaches to computationally modeling human behavior. ML's primary concern is maximizing prediction accuracy; cognitive science's primary concern is explaining the underlying mechanisms. Cross‐talk betw...
Autores principales: | , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
John Wiley and Sons Inc.
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9786646/ https://www.ncbi.nlm.nih.gov/pubmed/34529347 http://dx.doi.org/10.1111/tops.12574 |
_version_ | 1784858336106119168 |
---|---|
author | Sense, Florian Wood, Ryan Collins, Michael G. Fiechter, Joshua Wood, Aihua Krusmark, Michael Jastrzembski, Tiffany Myers, Christopher W. |
author_facet | Sense, Florian Wood, Ryan Collins, Michael G. Fiechter, Joshua Wood, Aihua Krusmark, Michael Jastrzembski, Tiffany Myers, Christopher W. |
author_sort | Sense, Florian |
collection | PubMed |
description | The fields of machine learning (ML) and cognitive science have developed complementary approaches to computationally modeling human behavior. ML's primary concern is maximizing prediction accuracy; cognitive science's primary concern is explaining the underlying mechanisms. Cross‐talk between these disciplines is limited, likely because the tasks and goals usually differ. The domain of e‐learning and knowledge acquisition constitutes a fruitful intersection for the two fields’ methodologies to be integrated because accurately tracking learning and forgetting over time and predicting future performance based on learning histories are central to developing effective, personalized learning tools. Here, we show how a state‐of‐the‐art ML model can be enhanced by incorporating insights from a cognitive model of human memory. This was done by exploiting the predictive performance equation's (PPE) narrow but highly specialized domain knowledge with regard to the temporal dynamics of learning and forgetting. Specifically, the PPE was used to engineer timing‐related input features for a gradient‐boosted decision trees (GBDT) model. The resulting PPE‐enhanced GBDT outperformed the default GBDT, especially under conditions in which limited data were available for training. Results suggest that integrating cognitive and ML models could be particularly productive if the available data are too high‐dimensional to be explained by a cognitive model but not sufficiently large to effectively train a modern ML algorithm. Here, the cognitive model's insights pertaining to only one aspect of the data were enough to jump‐start the ML model's ability to make predictions—a finding that holds promise for future explorations. |
format | Online Article Text |
id | pubmed-9786646 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | John Wiley and Sons Inc. |
record_format | MEDLINE/PubMed |
spelling | pubmed-97866462022-12-27 Cognition‐Enhanced Machine Learning for Better Predictions with Limited Data Sense, Florian Wood, Ryan Collins, Michael G. Fiechter, Joshua Wood, Aihua Krusmark, Michael Jastrzembski, Tiffany Myers, Christopher W. Top Cogn Sci Article The fields of machine learning (ML) and cognitive science have developed complementary approaches to computationally modeling human behavior. ML's primary concern is maximizing prediction accuracy; cognitive science's primary concern is explaining the underlying mechanisms. Cross‐talk between these disciplines is limited, likely because the tasks and goals usually differ. The domain of e‐learning and knowledge acquisition constitutes a fruitful intersection for the two fields’ methodologies to be integrated because accurately tracking learning and forgetting over time and predicting future performance based on learning histories are central to developing effective, personalized learning tools. Here, we show how a state‐of‐the‐art ML model can be enhanced by incorporating insights from a cognitive model of human memory. This was done by exploiting the predictive performance equation's (PPE) narrow but highly specialized domain knowledge with regard to the temporal dynamics of learning and forgetting. Specifically, the PPE was used to engineer timing‐related input features for a gradient‐boosted decision trees (GBDT) model. The resulting PPE‐enhanced GBDT outperformed the default GBDT, especially under conditions in which limited data were available for training. Results suggest that integrating cognitive and ML models could be particularly productive if the available data are too high‐dimensional to be explained by a cognitive model but not sufficiently large to effectively train a modern ML algorithm. Here, the cognitive model's insights pertaining to only one aspect of the data were enough to jump‐start the ML model's ability to make predictions—a finding that holds promise for future explorations. John Wiley and Sons Inc. 2021-09-16 2022-10 /pmc/articles/PMC9786646/ /pubmed/34529347 http://dx.doi.org/10.1111/tops.12574 Text en Published 2021. This article is a U.S. Government work and is in the public domain in the USA. Topics in Cognitive Science published by Wiley Periodicals LLC on behalf of Cognitive Science Society. https://creativecommons.org/licenses/by/4.0/This is an open access article under the terms of the http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Article Sense, Florian Wood, Ryan Collins, Michael G. Fiechter, Joshua Wood, Aihua Krusmark, Michael Jastrzembski, Tiffany Myers, Christopher W. Cognition‐Enhanced Machine Learning for Better Predictions with Limited Data |
title | Cognition‐Enhanced Machine Learning for Better Predictions with Limited Data |
title_full | Cognition‐Enhanced Machine Learning for Better Predictions with Limited Data |
title_fullStr | Cognition‐Enhanced Machine Learning for Better Predictions with Limited Data |
title_full_unstemmed | Cognition‐Enhanced Machine Learning for Better Predictions with Limited Data |
title_short | Cognition‐Enhanced Machine Learning for Better Predictions with Limited Data |
title_sort | cognition‐enhanced machine learning for better predictions with limited data |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9786646/ https://www.ncbi.nlm.nih.gov/pubmed/34529347 http://dx.doi.org/10.1111/tops.12574 |
work_keys_str_mv | AT senseflorian cognitionenhancedmachinelearningforbetterpredictionswithlimiteddata AT woodryan cognitionenhancedmachinelearningforbetterpredictionswithlimiteddata AT collinsmichaelg cognitionenhancedmachinelearningforbetterpredictionswithlimiteddata AT fiechterjoshua cognitionenhancedmachinelearningforbetterpredictionswithlimiteddata AT woodaihua cognitionenhancedmachinelearningforbetterpredictionswithlimiteddata AT krusmarkmichael cognitionenhancedmachinelearningforbetterpredictionswithlimiteddata AT jastrzembskitiffany cognitionenhancedmachinelearningforbetterpredictionswithlimiteddata AT myerschristopherw cognitionenhancedmachinelearningforbetterpredictionswithlimiteddata |