Abstract:Background: Ecological momentary assessment (EMA) assesses individuals' current experiences, behaviors, and moods as they occur in real time and in their natural environment. EMA studies, particularly those of longer duration, are complex and require an infrastructure to support the data flow and monitoring of EMA completion. Objective: Our objective is to provide a practical guide to developing and implementing an EMA study, with a focus on the methods and logistics of conducting such a study. Methods: The EMPOWER study was a 12-month study that used EMA to examine the triggers of lapses and relapse following intentional weight loss. We report on several studies that informed the implementation of the EMPOWER study: (1) a series of pilot studies, (2) the EMPOWER study's infrastructure, (3) training of study participants in use of smartphones and the EMA protocol and, (4) strategies used to enhance adherence to completing EMA surveys. Results: The study enrolled 151 adults and had 87.4% (132/151) retention rate at 12 months. Our learning experiences in the development of the infrastructure to support EMA assessments for the 12-month study spanned several topic areas. Included were the optimal frequency of EMA prompts to maximize data collection without overburdening participants; the timing and scheduling of EMA prompts; technological lessons to support a longitudinal study, such as proper communication between the Android smartphone, the Web server, and the database server; and use of a phone that provided access to the system's functionality for EMA data collection to avoid loss of data and minimize the impact of loss of network connectivity. These were especially important in a 1-year study with participants who might travel. It also protected the data collection from any server-side failure. Regular monitoring of participants' response to EMA prompts was critical, so we built in incentives to enhance completion of EMA surveys. During the first 6 months of the 12-month study interval, adherence to completing EMA surveys was high, with 88.3% (66,978/75,888) completion of random assessments and around 90% (23,411/25,929 and 23,343/26,010) completion of time-contingent assessments, despite the duration of EMA data collection and challenges with implementation. Conclusions: This work informed us of the necessary preliminary steps to plan and prepare a longitudinal study using smartphone technology and the critical elements to ensure participant engagement in the potentially burdensome protocol, which spanned 12 months. While this was a technology-supported and -programmed study, it required close oversight to ensure all elements were functioning correctly, particularly once human participants became involved.

ESMira: A decentralized open-source application for collecting experience sampling data

Assessing psychological variables on mobile devices: an introduction to the experience sampling app ESM-Quest

Mobile-Based Experience Sampling for Behaviour Research

Development of an open-source solution to facilitate the use of one-button wearables in experience sampling designs

SEMA3: A free smartphone platform for daily life surveys

Ecological Momentary Assessment in Behavioral Research: Addressing Technological and Human Participant Challenges

ESMvis: a tool for visualizing individual Experience Sampling Method (ESM) data

Building an ecological momentary assessment smartphone app for 4- to 10-year-old children: A pilot study

The experience sampling methodology as a digital clinical tool for more person-centered mental health care: an implementation research agenda

Investigating experiences of people with advanced breast or lung cancer in their natural context: protocol for an experience sampling study

The Experience sampling method in psychiatry: a state-of-the-art lecture

Introducing FRED: Software for Generating Feedback Reports for Ecological Momentary Assessment Data

Strategies, processes, outcomes, and costs of implementing experience sampling-based monitoring in routine mental health care in four European countries: study protocol for the IMMERSE effectiveness-implementation study

m-Path: an easy-to-use and highly tailorable platform for ecological momentary assessment and intervention in behavioral research and clinical practice

A Web-Based Application for Personalized Ecological Momentary Assessment in Psychiatric Care: User-Centered Development of the PETRA Application

Corona Health -- A Study- and Sensor-based Mobile App Platform Exploring Aspects of the COVID-19 Pandemic

Reintroducing the Effortless Assessment Research System (EARS)

Smartphone-Based Experience Sampling in People With Mild Cognitive Impairment: Feasibility and Usability Study (Preprint)

Development of Privacy Features on Anecdata.org, a Free Citizen Science Platform for Collecting Datasets for Climate Change and Related Projects

Context-sensitive ecological momentary assessments; integrating real-time exposure measurements, data-analytics and health assessment using a smartphone application

Mobile Experience Sampling Method: Capturing the Daily Life of Elders.