Cargando…

2506: Using Amazon’s Mechanical Turk as a tool for a global survey: Lessons learned from a large-scale implementation

OBJECTIVES/SPECIFIC AIMS: To share lessons learned from implementing a health survey to a global sample of mTWs. METHODS/STUDY POPULATION: mTWs were paid $0.50 for taking a 15 minute survey to ascertain attitudes and intentions toward participating in genetic research. Two phases included: pilot sur...

Descripción completa

Detalles Bibliográficos
Autores principales: Demment, Margaret, Fernandez, Diana, Li, Dongmei, Groth, Susan, Dozier, Ann, Chang, Jack, Dye, Tim
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Cambridge University Press 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6798724/
http://dx.doi.org/10.1017/cts.2017.83
_version_ 1783460122991788032
author Demment, Margaret
Fernandez, Diana
Li, Dongmei
Groth, Susan
Dozier, Ann
Chang, Jack
Dye, Tim
author_facet Demment, Margaret
Fernandez, Diana
Li, Dongmei
Groth, Susan
Dozier, Ann
Chang, Jack
Dye, Tim
author_sort Demment, Margaret
collection PubMed
description OBJECTIVES/SPECIFIC AIMS: To share lessons learned from implementing a health survey to a global sample of mTWs. METHODS/STUDY POPULATION: mTWs were paid $0.50 for taking a 15 minute survey to ascertain attitudes and intentions toward participating in genetic research. Two phases included: pilot survey targeting 7 global regions and a large-scale implementation in English in United States, India, and other countries and in Spanish in Spanish speaking countries. Administrative and descriptive information were collected and analyzed by region/country including: completions by location, demographics, time to complete, and survey satisfaction. RESULTS/ANTICIPATED RESULTS: There are 4 key lessons: (1) MTurk is fast. The US sample (n=505) accrual took <2 days and the Indian sample (n=505) took 11 days, while the response from other countries (n=118) generally exceeded 30 days. (2) Using Amazon country specification was the best way to ensure responses from specific countries and regions. (3) Demographic differences exist in mTWs between countries. For example, US mTWs were significantly more likely female (60.1%) compared with India (30.2%) and other countries (34.2%). (4) mTWs found the survey understandable/acceptable. mTWs reported high understandability and acceptability of the survey, which did not vary significantly across countries or by language. DISCUSSION/SIGNIFICANCE OF IMPACT: mTurk provides an efficient platform for survey research from diverse US and Indian samples. In other countries and in Spanish, the mTurk mechanism yielded a smaller sample more slowly but was still effective.
format Online
Article
Text
id pubmed-6798724
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher Cambridge University Press
record_format MEDLINE/PubMed
spelling pubmed-67987242019-10-28 2506: Using Amazon’s Mechanical Turk as a tool for a global survey: Lessons learned from a large-scale implementation Demment, Margaret Fernandez, Diana Li, Dongmei Groth, Susan Dozier, Ann Chang, Jack Dye, Tim J Clin Transl Sci Biomedical Informatics/Health Informatics OBJECTIVES/SPECIFIC AIMS: To share lessons learned from implementing a health survey to a global sample of mTWs. METHODS/STUDY POPULATION: mTWs were paid $0.50 for taking a 15 minute survey to ascertain attitudes and intentions toward participating in genetic research. Two phases included: pilot survey targeting 7 global regions and a large-scale implementation in English in United States, India, and other countries and in Spanish in Spanish speaking countries. Administrative and descriptive information were collected and analyzed by region/country including: completions by location, demographics, time to complete, and survey satisfaction. RESULTS/ANTICIPATED RESULTS: There are 4 key lessons: (1) MTurk is fast. The US sample (n=505) accrual took <2 days and the Indian sample (n=505) took 11 days, while the response from other countries (n=118) generally exceeded 30 days. (2) Using Amazon country specification was the best way to ensure responses from specific countries and regions. (3) Demographic differences exist in mTWs between countries. For example, US mTWs were significantly more likely female (60.1%) compared with India (30.2%) and other countries (34.2%). (4) mTWs found the survey understandable/acceptable. mTWs reported high understandability and acceptability of the survey, which did not vary significantly across countries or by language. DISCUSSION/SIGNIFICANCE OF IMPACT: mTurk provides an efficient platform for survey research from diverse US and Indian samples. In other countries and in Spanish, the mTurk mechanism yielded a smaller sample more slowly but was still effective. Cambridge University Press 2018-05-10 /pmc/articles/PMC6798724/ http://dx.doi.org/10.1017/cts.2017.83 Text en © The Association for Clinical and Translational Science 2018 http://creativecommons.org/licenses/by/4.0/ This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Biomedical Informatics/Health Informatics
Demment, Margaret
Fernandez, Diana
Li, Dongmei
Groth, Susan
Dozier, Ann
Chang, Jack
Dye, Tim
2506: Using Amazon’s Mechanical Turk as a tool for a global survey: Lessons learned from a large-scale implementation
title 2506: Using Amazon’s Mechanical Turk as a tool for a global survey: Lessons learned from a large-scale implementation
title_full 2506: Using Amazon’s Mechanical Turk as a tool for a global survey: Lessons learned from a large-scale implementation
title_fullStr 2506: Using Amazon’s Mechanical Turk as a tool for a global survey: Lessons learned from a large-scale implementation
title_full_unstemmed 2506: Using Amazon’s Mechanical Turk as a tool for a global survey: Lessons learned from a large-scale implementation
title_short 2506: Using Amazon’s Mechanical Turk as a tool for a global survey: Lessons learned from a large-scale implementation
title_sort 2506: using amazon’s mechanical turk as a tool for a global survey: lessons learned from a large-scale implementation
topic Biomedical Informatics/Health Informatics
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6798724/
http://dx.doi.org/10.1017/cts.2017.83
work_keys_str_mv AT demmentmargaret 2506usingamazonsmechanicalturkasatoolforaglobalsurveylessonslearnedfromalargescaleimplementation
AT fernandezdiana 2506usingamazonsmechanicalturkasatoolforaglobalsurveylessonslearnedfromalargescaleimplementation
AT lidongmei 2506usingamazonsmechanicalturkasatoolforaglobalsurveylessonslearnedfromalargescaleimplementation
AT grothsusan 2506usingamazonsmechanicalturkasatoolforaglobalsurveylessonslearnedfromalargescaleimplementation
AT dozierann 2506usingamazonsmechanicalturkasatoolforaglobalsurveylessonslearnedfromalargescaleimplementation
AT changjack 2506usingamazonsmechanicalturkasatoolforaglobalsurveylessonslearnedfromalargescaleimplementation
AT dyetim 2506usingamazonsmechanicalturkasatoolforaglobalsurveylessonslearnedfromalargescaleimplementation