Cargando…
Remote Data Collection During a Pandemic: A New Approach for Assessing and Coding Multisensory Attention Skills in Infants and Young Children
In early 2020, in-person data collection dramatically slowed or was completely halted across the world as many labs were forced to close due to the COVID-19 pandemic. Developmental researchers who assess looking time (especially those who rely heavily on in-lab eye-tracking or live coding techniques...
Autores principales: | , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8815727/ https://www.ncbi.nlm.nih.gov/pubmed/35126224 http://dx.doi.org/10.3389/fpsyg.2021.731618 |
_version_ | 1784645301594750976 |
---|---|
author | Eschman, Bret Todd, James Torrence Sarafraz, Amin Edgar, Elizabeth V. Petrulla, Victoria McNew, Myriah Gomez, William Bahrick, Lorraine E. |
author_facet | Eschman, Bret Todd, James Torrence Sarafraz, Amin Edgar, Elizabeth V. Petrulla, Victoria McNew, Myriah Gomez, William Bahrick, Lorraine E. |
author_sort | Eschman, Bret |
collection | PubMed |
description | In early 2020, in-person data collection dramatically slowed or was completely halted across the world as many labs were forced to close due to the COVID-19 pandemic. Developmental researchers who assess looking time (especially those who rely heavily on in-lab eye-tracking or live coding techniques) were forced to re-think their methods of data collection. While a variety of remote or online platforms are available for gathering behavioral data outside of the typical lab setting, few are specifically designed for collecting and processing looking time data in infants and young children. To address these challenges, our lab developed several novel approaches for continuing data collection and coding for a remotely administered audiovisual looking time protocol. First, we detail a comprehensive approach for successfully administering the Multisensory Attention Assessment Protocol (MAAP), developed by our lab to assess multisensory attention skills (MASks; duration of looking, speed of shifting/disengaging, accuracy of audiovisual matching). The MAAP is administered from a distance (remotely) by using Zoom, Gorilla Experiment Builder, an internet connection, and a home computer. This new data collection approach has the advantage that participants can be tested in their homes. We discuss challenges and successes in implementing our approach for remote testing and data collection during an ongoing longitudinal project. Second, we detail an approach for estimating gaze direction and duration collected remotely from webcam recordings using a post processing toolkit (OpenFace) and demonstrate its effectiveness and precision. However, because OpenFace derives gaze estimates without translating them to an external frame of reference (i.e., the participant's screen), we developed a machine learning (ML) approach to overcome this limitation. Thus, third, we trained a ML algorithm [(artificial neural network (ANN)] to classify gaze estimates from OpenFace with respect to areas of interest (AOI) on the participant's screen (i.e., left, right, and center). We then demonstrate reliability between this approach and traditional coding approaches (e.g., coding gaze live). The combination of OpenFace and ML will provide a method to automate the coding of looking time for data collected remotely. Finally, we outline a series of best practices for developmental researchers conducting remote data collection for looking time studies. |
format | Online Article Text |
id | pubmed-8815727 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-88157272022-02-05 Remote Data Collection During a Pandemic: A New Approach for Assessing and Coding Multisensory Attention Skills in Infants and Young Children Eschman, Bret Todd, James Torrence Sarafraz, Amin Edgar, Elizabeth V. Petrulla, Victoria McNew, Myriah Gomez, William Bahrick, Lorraine E. Front Psychol Psychology In early 2020, in-person data collection dramatically slowed or was completely halted across the world as many labs were forced to close due to the COVID-19 pandemic. Developmental researchers who assess looking time (especially those who rely heavily on in-lab eye-tracking or live coding techniques) were forced to re-think their methods of data collection. While a variety of remote or online platforms are available for gathering behavioral data outside of the typical lab setting, few are specifically designed for collecting and processing looking time data in infants and young children. To address these challenges, our lab developed several novel approaches for continuing data collection and coding for a remotely administered audiovisual looking time protocol. First, we detail a comprehensive approach for successfully administering the Multisensory Attention Assessment Protocol (MAAP), developed by our lab to assess multisensory attention skills (MASks; duration of looking, speed of shifting/disengaging, accuracy of audiovisual matching). The MAAP is administered from a distance (remotely) by using Zoom, Gorilla Experiment Builder, an internet connection, and a home computer. This new data collection approach has the advantage that participants can be tested in their homes. We discuss challenges and successes in implementing our approach for remote testing and data collection during an ongoing longitudinal project. Second, we detail an approach for estimating gaze direction and duration collected remotely from webcam recordings using a post processing toolkit (OpenFace) and demonstrate its effectiveness and precision. However, because OpenFace derives gaze estimates without translating them to an external frame of reference (i.e., the participant's screen), we developed a machine learning (ML) approach to overcome this limitation. Thus, third, we trained a ML algorithm [(artificial neural network (ANN)] to classify gaze estimates from OpenFace with respect to areas of interest (AOI) on the participant's screen (i.e., left, right, and center). We then demonstrate reliability between this approach and traditional coding approaches (e.g., coding gaze live). The combination of OpenFace and ML will provide a method to automate the coding of looking time for data collected remotely. Finally, we outline a series of best practices for developmental researchers conducting remote data collection for looking time studies. Frontiers Media S.A. 2022-01-21 /pmc/articles/PMC8815727/ /pubmed/35126224 http://dx.doi.org/10.3389/fpsyg.2021.731618 Text en Copyright © 2022 Eschman, Todd, Sarafraz, Edgar, Petrulla, McNew, Gomez and Bahrick. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Psychology Eschman, Bret Todd, James Torrence Sarafraz, Amin Edgar, Elizabeth V. Petrulla, Victoria McNew, Myriah Gomez, William Bahrick, Lorraine E. Remote Data Collection During a Pandemic: A New Approach for Assessing and Coding Multisensory Attention Skills in Infants and Young Children |
title | Remote Data Collection During a Pandemic: A New Approach for Assessing and Coding Multisensory Attention Skills in Infants and Young Children |
title_full | Remote Data Collection During a Pandemic: A New Approach for Assessing and Coding Multisensory Attention Skills in Infants and Young Children |
title_fullStr | Remote Data Collection During a Pandemic: A New Approach for Assessing and Coding Multisensory Attention Skills in Infants and Young Children |
title_full_unstemmed | Remote Data Collection During a Pandemic: A New Approach for Assessing and Coding Multisensory Attention Skills in Infants and Young Children |
title_short | Remote Data Collection During a Pandemic: A New Approach for Assessing and Coding Multisensory Attention Skills in Infants and Young Children |
title_sort | remote data collection during a pandemic: a new approach for assessing and coding multisensory attention skills in infants and young children |
topic | Psychology |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8815727/ https://www.ncbi.nlm.nih.gov/pubmed/35126224 http://dx.doi.org/10.3389/fpsyg.2021.731618 |
work_keys_str_mv | AT eschmanbret remotedatacollectionduringapandemicanewapproachforassessingandcodingmultisensoryattentionskillsininfantsandyoungchildren AT toddjamestorrence remotedatacollectionduringapandemicanewapproachforassessingandcodingmultisensoryattentionskillsininfantsandyoungchildren AT sarafrazamin remotedatacollectionduringapandemicanewapproachforassessingandcodingmultisensoryattentionskillsininfantsandyoungchildren AT edgarelizabethv remotedatacollectionduringapandemicanewapproachforassessingandcodingmultisensoryattentionskillsininfantsandyoungchildren AT petrullavictoria remotedatacollectionduringapandemicanewapproachforassessingandcodingmultisensoryattentionskillsininfantsandyoungchildren AT mcnewmyriah remotedatacollectionduringapandemicanewapproachforassessingandcodingmultisensoryattentionskillsininfantsandyoungchildren AT gomezwilliam remotedatacollectionduringapandemicanewapproachforassessingandcodingmultisensoryattentionskillsininfantsandyoungchildren AT bahricklorrainee remotedatacollectionduringapandemicanewapproachforassessingandcodingmultisensoryattentionskillsininfantsandyoungchildren |