Search Articles

View query in Help articles search

Search Results (1 to 10 of 11 Results)

Download search results: CSV END BibTex RIS


Comparing Health Survey Data Cost and Quality Between Amazon’s Mechanical Turk and Ipsos’ KnowledgePanel: Observational Study

Comparing Health Survey Data Cost and Quality Between Amazon’s Mechanical Turk and Ipsos’ KnowledgePanel: Observational Study

In this study, we used Amazon’s MTurk as an example of a well-known, inexpensive, fast, easily accessible convenience panel that can be used for data collection. As we note later, although data collection methods on MTurk have improved since, we used the methods recommended at the start of our data collection (August 2021). Therefore, hereafter, what we have labeled as MTurk data should be considered to represent a somewhat lower quality than what is possible now. MTurk was launched in 2005 [18,19,22].

Patricia M Herman, Mary E Slaughter, Nabeel Qureshi, Tarek Azzam, David Cella, Ian D Coulter, Graham DiGuiseppi, Maria Orlando Edelen, Arie Kapteyn, Anthony Rodriguez, Max Rubinstein, Ron D Hays

J Med Internet Res 2024;26:e63032

Dropout in a Longitudinal Survey of Amazon Mechanical Turk Workers With Low Back Pain: Observational Study

Dropout in a Longitudinal Survey of Amazon Mechanical Turk Workers With Low Back Pain: Observational Study

Survey attrition has been noted as a critical concern with using MTurk [4]. Still, there is limited information about the effects of survey attrition in longitudinal studies using MTurk and the extent to which it limits the inferences that can be drawn [18]. Previous research has shown that nonresponse patterns vary by survey population and survey type in MTurk.

Nabeel Qureshi, Ron D Hays, Patricia M Herman

Interact J Med Res 2024;13:e58771

The Rutgers Omnibus Study: Protocol for Quarterly Web-Based Surveys to Promote Rapid Tobacco Research

The Rutgers Omnibus Study: Protocol for Quarterly Web-Based Surveys to Promote Rapid Tobacco Research

Omnibus participants are recruited from among eligible workers on MTurk using the MTurk Toolkit by Cloud Research (formerly known as Turk Prime), in order to enhance control over data quality [7]. Cloud Research regularly monitors MTurk worker engagement in order to identify individuals who are most likely to provide high-quality data.

Michelle T Bover Manderski, William J Young, Ollie Ganz, Cristine D Delnevo

JMIR Res Protoc 2024;13:e58203

Response Consistency of Crowdsourced Web-Based Surveys on Type 1 Diabetes

Response Consistency of Crowdsourced Web-Based Surveys on Type 1 Diabetes

Amazon Mechanical Turk (MTurk), a confidential web-based crowdsourcing platform with more than half a million registered workers [2], may serve as an alternative route for cost-effectively surveying large samples of patients with T1 D receiving care in geographically dispersed health care environments. In this study, we tested the feasibility of using MTurk to gather reliable information from people living with T1 D.

Yu Kuei Lin, Sean Newman, John Piette

J Med Internet Res 2023;25:e43593

Effects of Excluding Those Who Report Having “Syndomitis” or “Chekalism” on Data Quality: Longitudinal Health Survey of a Sample From Amazon’s Mechanical Turk

Effects of Excluding Those Who Report Having “Syndomitis” or “Chekalism” on Data Quality: Longitudinal Health Survey of a Sample From Amazon’s Mechanical Turk

Amazon’s Mechanical Turk (MTurk) is a crowdsourcing platform that includes a pool of “workers” willing to complete tasks for low levels of compensation [1]. The extent to which MTurk and other convenience-based samples are representative of the general population [2] or subgroups of the population [3] is a concern in many studies. Most MTurk participants are young, White, male, and highly educated, but report relatively poor mental health [4,5].

Ron D Hays, Nabeel Qureshi, Patricia M Herman, Anthony Rodriguez, Arie Kapteyn, Maria Orlando Edelen

J Med Internet Res 2023;25:e46421

Assessing Interventions on Crowdsourcing Platforms to Nudge Patients for Engagement Behaviors in Primary Care Settings: Randomized Controlled Trial

Assessing Interventions on Crowdsourcing Platforms to Nudge Patients for Engagement Behaviors in Primary Care Settings: Randomized Controlled Trial

We used a crowdsourcing platform, Amazon Mechanical Turk (MTurk), to conduct the experiment. The experiment used “role-playing” methodologies in marketing science [12,13] and neuroscience [14-16] to study the impact of different nudging strategies in simulated scenarios. The targeted behavior in the experiment was bringing medicines to a primary care visit.

Kay-Yut Chen, Yan Lang, Yuan Zhou, Ludmila Kosmari, Kathryn Daniel, Ayse Gurses, Yan Xiao

J Med Internet Res 2023;25:e41431

The Benefits of Crowdsourcing to Seed and Align an Algorithm in an mHealth Intervention for African American and Hispanic Adults: Survey Study

The Benefits of Crowdsourcing to Seed and Align an Algorithm in an mHealth Intervention for African American and Hispanic Adults: Survey Study

Amazon Mechanical Turk (MTurk) has become increasingly popular as a crowdsourcing platform for conducting web-based research involving surveys, as MTurk facilitates access to a large and diverse participant population at a relatively low cost to investigators [21-23]. MTurk functions as a web-based labor market where registered workers complete web-based Human Intelligence Tasks (HITs) to be paid.

Neil Jay Sehgal, Shuo Huang, Neil Mason Johnson, John Dickerson, Devlon Jackson, Cynthia Baur

J Med Internet Res 2022;24(6):e30216

Rise in Use of Digital Mental Health Tools and Technologies in the United States During the COVID-19 Pandemic: Survey Study

Rise in Use of Digital Mental Health Tools and Technologies in the United States During the COVID-19 Pandemic: Survey Study

MTurk allows researchers to collect a large amount of quality data quickly and for relatively little cost [19-21]. On MTurk, requesters are people who post or request tasks (eg, surveys) to be completed, whereas workers are people who are paid for task completion. Requesters can customize the tasks to be available to certain MTurk workers. MTurk workers are able to read descriptions of tasks and select the tasks they are interested in.

Dara H Sorkin, Emily A Janio, Elizabeth V Eikey, Margaret Schneider, Katelyn Davis, Stephen M Schueller, Nicole A Stadnick, Kai Zheng, Martha Neary, David Safani, Dana B Mukamel

J Med Internet Res 2021;23(4):e26994

The Promise and Pitfalls of Using Crowdsourcing in Research Prioritization for Back Pain: Cross-Sectional Surveys

The Promise and Pitfalls of Using Crowdsourcing in Research Prioritization for Back Pain: Cross-Sectional Surveys

We conducted 2 cross-sectional surveys via MTurk: the first in January 2016 targeting those with back pain, and the second in August 2016 targeting those without back pain (Figure 1), limiting the MTurk sample to only those residing in the United States. The University of Washington Human Subjects Division provided ethical approval for this study prior to administration of the surveys. Mechanical Turk (MTurk) enrollment.

Matthew A Bartek, Anjali R Truitt, Sierra Widmer-Rodriguez, Jordan Tuia, Zoya A Bauer, Bryan A Comstock, Todd C Edwards, Sarah O Lawrence, Sarah E Monsell, Donald L Patrick, Jeffrey G Jarvik, Danielle C Lavallee

J Med Internet Res 2017;19(10):e341