Cargando…

Cognition‐Enhanced Machine Learning for Better Predictions with Limited Data

The fields of machine learning (ML) and cognitive science have developed complementary approaches to computationally modeling human behavior. ML's primary concern is maximizing prediction accuracy; cognitive science's primary concern is explaining the underlying mechanisms. Cross‐talk betw...

Descripción completa

Detalles Bibliográficos
Autores principales: Sense, Florian, Wood, Ryan, Collins, Michael G., Fiechter, Joshua, Wood, Aihua, Krusmark, Michael, Jastrzembski, Tiffany, Myers, Christopher W.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: John Wiley and Sons Inc. 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9786646/
https://www.ncbi.nlm.nih.gov/pubmed/34529347
http://dx.doi.org/10.1111/tops.12574
_version_ 1784858336106119168
author Sense, Florian
Wood, Ryan
Collins, Michael G.
Fiechter, Joshua
Wood, Aihua
Krusmark, Michael
Jastrzembski, Tiffany
Myers, Christopher W.
author_facet Sense, Florian
Wood, Ryan
Collins, Michael G.
Fiechter, Joshua
Wood, Aihua
Krusmark, Michael
Jastrzembski, Tiffany
Myers, Christopher W.
author_sort Sense, Florian
collection PubMed
description The fields of machine learning (ML) and cognitive science have developed complementary approaches to computationally modeling human behavior. ML's primary concern is maximizing prediction accuracy; cognitive science's primary concern is explaining the underlying mechanisms. Cross‐talk between these disciplines is limited, likely because the tasks and goals usually differ. The domain of e‐learning and knowledge acquisition constitutes a fruitful intersection for the two fields’ methodologies to be integrated because accurately tracking learning and forgetting over time and predicting future performance based on learning histories are central to developing effective, personalized learning tools. Here, we show how a state‐of‐the‐art ML model can be enhanced by incorporating insights from a cognitive model of human memory. This was done by exploiting the predictive performance equation's (PPE) narrow but highly specialized domain knowledge with regard to the temporal dynamics of learning and forgetting. Specifically, the PPE was used to engineer timing‐related input features for a gradient‐boosted decision trees (GBDT) model. The resulting PPE‐enhanced GBDT outperformed the default GBDT, especially under conditions in which limited data were available for training. Results suggest that integrating cognitive and ML models could be particularly productive if the available data are too high‐dimensional to be explained by a cognitive model but not sufficiently large to effectively train a modern ML algorithm. Here, the cognitive model's insights pertaining to only one aspect of the data were enough to jump‐start the ML model's ability to make predictions—a finding that holds promise for future explorations.
format Online
Article
Text
id pubmed-9786646
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher John Wiley and Sons Inc.
record_format MEDLINE/PubMed
spelling pubmed-97866462022-12-27 Cognition‐Enhanced Machine Learning for Better Predictions with Limited Data Sense, Florian Wood, Ryan Collins, Michael G. Fiechter, Joshua Wood, Aihua Krusmark, Michael Jastrzembski, Tiffany Myers, Christopher W. Top Cogn Sci Article The fields of machine learning (ML) and cognitive science have developed complementary approaches to computationally modeling human behavior. ML's primary concern is maximizing prediction accuracy; cognitive science's primary concern is explaining the underlying mechanisms. Cross‐talk between these disciplines is limited, likely because the tasks and goals usually differ. The domain of e‐learning and knowledge acquisition constitutes a fruitful intersection for the two fields’ methodologies to be integrated because accurately tracking learning and forgetting over time and predicting future performance based on learning histories are central to developing effective, personalized learning tools. Here, we show how a state‐of‐the‐art ML model can be enhanced by incorporating insights from a cognitive model of human memory. This was done by exploiting the predictive performance equation's (PPE) narrow but highly specialized domain knowledge with regard to the temporal dynamics of learning and forgetting. Specifically, the PPE was used to engineer timing‐related input features for a gradient‐boosted decision trees (GBDT) model. The resulting PPE‐enhanced GBDT outperformed the default GBDT, especially under conditions in which limited data were available for training. Results suggest that integrating cognitive and ML models could be particularly productive if the available data are too high‐dimensional to be explained by a cognitive model but not sufficiently large to effectively train a modern ML algorithm. Here, the cognitive model's insights pertaining to only one aspect of the data were enough to jump‐start the ML model's ability to make predictions—a finding that holds promise for future explorations. John Wiley and Sons Inc. 2021-09-16 2022-10 /pmc/articles/PMC9786646/ /pubmed/34529347 http://dx.doi.org/10.1111/tops.12574 Text en Published 2021. This article is a U.S. Government work and is in the public domain in the USA. Topics in Cognitive Science published by Wiley Periodicals LLC on behalf of Cognitive Science Society. https://creativecommons.org/licenses/by/4.0/This is an open access article under the terms of the http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.
spellingShingle Article
Sense, Florian
Wood, Ryan
Collins, Michael G.
Fiechter, Joshua
Wood, Aihua
Krusmark, Michael
Jastrzembski, Tiffany
Myers, Christopher W.
Cognition‐Enhanced Machine Learning for Better Predictions with Limited Data
title Cognition‐Enhanced Machine Learning for Better Predictions with Limited Data
title_full Cognition‐Enhanced Machine Learning for Better Predictions with Limited Data
title_fullStr Cognition‐Enhanced Machine Learning for Better Predictions with Limited Data
title_full_unstemmed Cognition‐Enhanced Machine Learning for Better Predictions with Limited Data
title_short Cognition‐Enhanced Machine Learning for Better Predictions with Limited Data
title_sort cognition‐enhanced machine learning for better predictions with limited data
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9786646/
https://www.ncbi.nlm.nih.gov/pubmed/34529347
http://dx.doi.org/10.1111/tops.12574
work_keys_str_mv AT senseflorian cognitionenhancedmachinelearningforbetterpredictionswithlimiteddata
AT woodryan cognitionenhancedmachinelearningforbetterpredictionswithlimiteddata
AT collinsmichaelg cognitionenhancedmachinelearningforbetterpredictionswithlimiteddata
AT fiechterjoshua cognitionenhancedmachinelearningforbetterpredictionswithlimiteddata
AT woodaihua cognitionenhancedmachinelearningforbetterpredictionswithlimiteddata
AT krusmarkmichael cognitionenhancedmachinelearningforbetterpredictionswithlimiteddata
AT jastrzembskitiffany cognitionenhancedmachinelearningforbetterpredictionswithlimiteddata
AT myerschristopherw cognitionenhancedmachinelearningforbetterpredictionswithlimiteddata