Comparing Amazon’s Mechanical Turk Platform to Conventional Data Collection Methods in the Health and Medical Research Literature

Karoline Mortensen,Taylor L. Hughes
DOI: https://doi.org/10.1007/s11606-017-4246-0
IF: 5.7
2018-01-04
Journal of General Internal Medicine
Abstract:BackgroundThe goal of this article is to conduct an assessment of the peer-reviewed primary literature with study objectives to analyze Amazon.com’s Mechanical Turk (MTurk) as a research tool in a health services research and medical context.MethodsSearches of Google Scholar and PubMed databases were conducted in February 2017. We screened article titles and abstracts to identify relevant articles that compare data from MTurk samples in a health and medical context to another sample, expert opinion, or other gold standard. Full-text manuscript reviews were conducted for the 35 articles that met the study criteria.ResultsThe vast majority of the studies supported the use of MTurk for a variety of academic purposes.DiscussionThe literature overwhelmingly concludes that MTurk is an efficient, reliable, cost-effective tool for generating sample responses that are largely comparable to those collected via more conventional means. Caveats include survey responses may not be generalizable to the US population.
medicine, general & internal,health care sciences & services
What problem does this paper attempt to address?