Abstract:Background: The Internet provides tremendous opportunities for innovative research, but few publications on the use of the Internet for recruiting study participants exist. This paper summarizes our experiences from 2 studies in which we attempted to recruit teenagers on the Internet for a questionnaire study to evaluate a smoking-cessation website. Objective: To evaluate strategies of recruiting teenagers for the evaluation of a smoking-cessation website through the Internet. Methods: In Study 1 (Defined Community Recruitment), we sent invitation emails to registered members of a youth health website, CyberIsle. A total of 3801 email addresses were randomly divided into 2 groups. In the first group, emails indicated that the first 30 respondents would receive a Can dollars 20 electronic gift certificate for use at an online bookstore if they would go to the Smoking Zine website and respond to a short survey. For the second group, the email also indicated that respondents would receive an additional Can dollars 10 gift certificate if they referred their friends to the study. Reminder emails were sent 10 days after the sending of the initial invitation email. In Study 2 (Open Recruitment), we posted invitation messages on Web discussion boards, Usenet forums, and one specialized recruitment website, and attempted a snowball recruiting strategy. When potential participants arrived at the study site, they were automatically randomized into either the higher incentives group (Can dollars 15 electronic gift certificate) or lower incentive group (Can dollars 5 gift certificate). Results: In Study 1 (defined community recruitment), 2109 emails were successfully delivered. Only 5 subjects (0.24%), including 1 referred by a friend, passed the recruitment process and completed the questionnaire; a further 6 individuals visited the information page of the study but did not complete the study. In Study 2 (open recruitment), the number of users seeing the advertisement is unknown. A total of 35 users arrived at the website, of whom 14 participants were recruited (8 from the Can dollars 15 gift certificate group and 6 from the Can dollars 5 gift certificate group). Another 5 were recruited from the general Internet community (3 from discussion boards and 2 from the Research Volunteers website). The remaining 9 participants were recruited through friend referrals with the snowball strategy. Conclusions: Overall, the recruitment rate was disappointingly low. In our case, recruitment using Internet technologies including email, electronic discussion boards, Usenet forums, and websites did not prove to be an effective approach for soliciting young subjects to participate in our research. Possible reasons are discussed, including the participants' perspective. A major challenge is to differentiate trustable and legitimate messages from spam and fraudulent misinformation on the Internet. From the researchers' perspective, approaches are needed to engage larger samples, to verify participants' attributes, and to evaluate and adjust for potential biases associated with Internet recruitment.

The BBC internet study: general methodology

Study protocol for a randomized controlled trial to evaluate a web-based comprehensive sexual health and media literacy education program for high school students

What over 1,000,000 participants tell us about online research protocols

Software Engineering User Study Recruitment on Prolific: An Experience Report

Service user experiences of using internet-based testing for sexually transmitted infections (STIs): a qualitative study

Cross-Cultural Comparison of Women Students' Attitudes Toward the Internet and Usage: China and the United Kingdom

Factors Associated With Intention to Use Internet-Based Testing for Sexually Transmitted Infections Among Men Who Have Sex With Men

Evaluating the Impact of a Dutch Sexual Health Intervention for Adolescents: Think-Aloud and Semistructured Interview Study

Health estimate differences between six independent web surveys: different web surveys, different results?

Challenges of internet recruitment: a case study with disappointing results

A Web-Based, Respondent-Driven Sampling Survey Among Men Who Have Sex With Men (Kai Noi): Description of Methods and Characteristics

A New Model of Social Class? Findings from the BBC’s Great British Class Survey Experiment

Evaluation of Biases in Self-reported Demographic and Psychometric Information: Traditional versus Facebook-based Surveys

Data quality in online human-subjects research: Comparisons between MTurk, Prolific, CloudResearch, Qualtrics, and SONA

Experiences of respondent-driven sampling in online research among men who have sex with men in other countries (literature review)

Online Independent Versus Laboratory-Based Stop-Signal Task Performance: A Within-Subjects Counterbalanced Comparison Study (Preprint)

Research behind a webcam: an exploration of virtual interviewing with children and young people

Reach of GetCheckedOnline among gay, bisexual, transgender and queer men and Two-Spirit people and correlates of use 5 years after program launch in British Columbia, Canada

How Well Do My Results Generalize Now? The External Validity of Online Privacy and Security Surveys

An exploration of factors related to dissemination of and exposure to internet-delivered behavior change interventions aimed at adults: a Delphi study approach

Conducting Perception Research over the Internet: a Tutorial Review