Cargando…
2506: Using Amazon’s Mechanical Turk as a tool for a global survey: Lessons learned from a large-scale implementation
OBJECTIVES/SPECIFIC AIMS: To share lessons learned from implementing a health survey to a global sample of mTWs. METHODS/STUDY POPULATION: mTWs were paid $0.50 for taking a 15 minute survey to ascertain attitudes and intentions toward participating in genetic research. Two phases included: pilot sur...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Cambridge University Press
2018
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6798724/ http://dx.doi.org/10.1017/cts.2017.83 |
_version_ | 1783460122991788032 |
---|---|
author | Demment, Margaret Fernandez, Diana Li, Dongmei Groth, Susan Dozier, Ann Chang, Jack Dye, Tim |
author_facet | Demment, Margaret Fernandez, Diana Li, Dongmei Groth, Susan Dozier, Ann Chang, Jack Dye, Tim |
author_sort | Demment, Margaret |
collection | PubMed |
description | OBJECTIVES/SPECIFIC AIMS: To share lessons learned from implementing a health survey to a global sample of mTWs. METHODS/STUDY POPULATION: mTWs were paid $0.50 for taking a 15 minute survey to ascertain attitudes and intentions toward participating in genetic research. Two phases included: pilot survey targeting 7 global regions and a large-scale implementation in English in United States, India, and other countries and in Spanish in Spanish speaking countries. Administrative and descriptive information were collected and analyzed by region/country including: completions by location, demographics, time to complete, and survey satisfaction. RESULTS/ANTICIPATED RESULTS: There are 4 key lessons: (1) MTurk is fast. The US sample (n=505) accrual took <2 days and the Indian sample (n=505) took 11 days, while the response from other countries (n=118) generally exceeded 30 days. (2) Using Amazon country specification was the best way to ensure responses from specific countries and regions. (3) Demographic differences exist in mTWs between countries. For example, US mTWs were significantly more likely female (60.1%) compared with India (30.2%) and other countries (34.2%). (4) mTWs found the survey understandable/acceptable. mTWs reported high understandability and acceptability of the survey, which did not vary significantly across countries or by language. DISCUSSION/SIGNIFICANCE OF IMPACT: mTurk provides an efficient platform for survey research from diverse US and Indian samples. In other countries and in Spanish, the mTurk mechanism yielded a smaller sample more slowly but was still effective. |
format | Online Article Text |
id | pubmed-6798724 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2018 |
publisher | Cambridge University Press |
record_format | MEDLINE/PubMed |
spelling | pubmed-67987242019-10-28 2506: Using Amazon’s Mechanical Turk as a tool for a global survey: Lessons learned from a large-scale implementation Demment, Margaret Fernandez, Diana Li, Dongmei Groth, Susan Dozier, Ann Chang, Jack Dye, Tim J Clin Transl Sci Biomedical Informatics/Health Informatics OBJECTIVES/SPECIFIC AIMS: To share lessons learned from implementing a health survey to a global sample of mTWs. METHODS/STUDY POPULATION: mTWs were paid $0.50 for taking a 15 minute survey to ascertain attitudes and intentions toward participating in genetic research. Two phases included: pilot survey targeting 7 global regions and a large-scale implementation in English in United States, India, and other countries and in Spanish in Spanish speaking countries. Administrative and descriptive information were collected and analyzed by region/country including: completions by location, demographics, time to complete, and survey satisfaction. RESULTS/ANTICIPATED RESULTS: There are 4 key lessons: (1) MTurk is fast. The US sample (n=505) accrual took <2 days and the Indian sample (n=505) took 11 days, while the response from other countries (n=118) generally exceeded 30 days. (2) Using Amazon country specification was the best way to ensure responses from specific countries and regions. (3) Demographic differences exist in mTWs between countries. For example, US mTWs were significantly more likely female (60.1%) compared with India (30.2%) and other countries (34.2%). (4) mTWs found the survey understandable/acceptable. mTWs reported high understandability and acceptability of the survey, which did not vary significantly across countries or by language. DISCUSSION/SIGNIFICANCE OF IMPACT: mTurk provides an efficient platform for survey research from diverse US and Indian samples. In other countries and in Spanish, the mTurk mechanism yielded a smaller sample more slowly but was still effective. Cambridge University Press 2018-05-10 /pmc/articles/PMC6798724/ http://dx.doi.org/10.1017/cts.2017.83 Text en © The Association for Clinical and Translational Science 2018 http://creativecommons.org/licenses/by/4.0/ This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Biomedical Informatics/Health Informatics Demment, Margaret Fernandez, Diana Li, Dongmei Groth, Susan Dozier, Ann Chang, Jack Dye, Tim 2506: Using Amazon’s Mechanical Turk as a tool for a global survey: Lessons learned from a large-scale implementation |
title | 2506: Using Amazon’s Mechanical Turk as a tool for a global survey: Lessons learned from a large-scale implementation |
title_full | 2506: Using Amazon’s Mechanical Turk as a tool for a global survey: Lessons learned from a large-scale implementation |
title_fullStr | 2506: Using Amazon’s Mechanical Turk as a tool for a global survey: Lessons learned from a large-scale implementation |
title_full_unstemmed | 2506: Using Amazon’s Mechanical Turk as a tool for a global survey: Lessons learned from a large-scale implementation |
title_short | 2506: Using Amazon’s Mechanical Turk as a tool for a global survey: Lessons learned from a large-scale implementation |
title_sort | 2506: using amazon’s mechanical turk as a tool for a global survey: lessons learned from a large-scale implementation |
topic | Biomedical Informatics/Health Informatics |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6798724/ http://dx.doi.org/10.1017/cts.2017.83 |
work_keys_str_mv | AT demmentmargaret 2506usingamazonsmechanicalturkasatoolforaglobalsurveylessonslearnedfromalargescaleimplementation AT fernandezdiana 2506usingamazonsmechanicalturkasatoolforaglobalsurveylessonslearnedfromalargescaleimplementation AT lidongmei 2506usingamazonsmechanicalturkasatoolforaglobalsurveylessonslearnedfromalargescaleimplementation AT grothsusan 2506usingamazonsmechanicalturkasatoolforaglobalsurveylessonslearnedfromalargescaleimplementation AT dozierann 2506usingamazonsmechanicalturkasatoolforaglobalsurveylessonslearnedfromalargescaleimplementation AT changjack 2506usingamazonsmechanicalturkasatoolforaglobalsurveylessonslearnedfromalargescaleimplementation AT dyetim 2506usingamazonsmechanicalturkasatoolforaglobalsurveylessonslearnedfromalargescaleimplementation |