Abstract:Background Internet-delivered mental health (eMental Health) interventions produce treatment effects similar to those observed in face-to-face treatment. However, there is a large degree of variation in treatment effects observed from program to program, and eMental Health interventions remain somewhat of a black box in terms of the mechanisms by which they exert their therapeutic benefit. Trials of eMental Health interventions typically use large sample sizes and therefore provide an ideal context within which to systematically investigate the therapeutic benefit of specific program features. Furthermore, the growth and impact of mobile phone technology within eMental Health interventions provides an opportunity to examine associations between symptom improvement and the use of program features delivered across computer and mobile phone platforms. Objective The objective of this study was to identify the patterns of program usage associated with treatment outcome in a randomized controlled trial (RCT) of a fully automated, mobile phone- and Web-based self-help program, “myCompass”, for individuals with mild-to-moderate symptoms of depression, anxiety, and/or stress. The core features of the program include interactive psychotherapy modules, a symptom tracking feature, short motivational messages, symptom tracking reminders, and a diary, with many of these features accessible via both computer and mobile phone. Methods Patterns of program usage were recorded for 231 participants with mild-to-moderate depression, anxiety, and/or stress, and who were randomly allocated to receive access to myCompass for seven weeks during the RCT. Depression, anxiety, stress, and functional impairment were examined at baseline and at eight weeks. Results Log data indicated that the most commonly used components were the short motivational messages (used by 68.4%, 158/231 of participants) and the symptom tracking feature (used by 61.5%, 142/231 of participants). Further, after controlling for baseline symptom severity, increased use of these alert features was associated with significant improvements in anxiety and functional impairment. Associations between use of symptom tracking reminders and improved treatment outcome remained significant after controlling for frequency of symptom tracking. Although correlations were not statistically significant, reminders received via SMS (ie, text message) were more strongly associated with symptom reduction than were reminders received via email. Conclusions These findings indicate that alerts may be an especially potent component of eMental Health interventions, both via their association with enhanced program usage, as well as independently. Although there was evidence of a stronger association between symptom improvement and use of alerts via the mobile phone platform, the degree of overlap between use of email and SMS alerts may have precluded identification of alert delivery modalities that were most strongly associated with symptom reduction. Future research using random assignment to computer and mobile delivery is needed to fully determine the most ideal platform for delivery of this and other features of online interventions. Trial Registration Australian New Zealand Clinical Trials Registry (ACTRN): 12610000625077; http://www.anzctr.org.au/TrialSearch.aspx? (Archived by WebCite http://www.webcitation.org/6WPqHK0mQ).

Conducting mobile-enabled ecological momentary intervention research in positive psychology: key considerations and recommended practices

Building an ecological momentary assessment smartphone app for 4- to 10-year-old children: A pilot study

A control theoretic approach to evaluate and inform ecological momentary interventions

Mobile-based ecological momentary assessment and intervention: bibliometric analysis

Mobile mental health: Review of the emerging field and proof of concept study

The Use of Mobile Assessments for Monitoring Mental Health in Youth: Umbrella Review

Using mobile phone sensor technology for mental health research: Integrated analysis to identify hidden challenges and potential solutions

Investigating Best Practices for Ecological Momentary Assessment: Nationwide Factorial Experiment

Clinicians' Concerns About Mobile Ecological Momentary Assessment Tools Designed for Emerging Psychiatric Problems: Prospective Acceptability Assessment of the MEmind App

Improving Engagement and Efficacy of mHealth Micro-Interventions for Stress Coping: an In-The-Wild Study

Design Considerations in Development of a Mobile Health Intervention Program: The TEXT ME and TEXTMEDS Experience

Breaking Open the Black Box: Isolating the Most Potent Features of a Web and Mobile Phone-Based Intervention for Depression, Anxiety, and Stress

Assessing the Effectiveness and Utility of a Mindfulness-Based Ecological Momentary Intervention in College Students

Mobile Crowdsensing in Ecological Momentary Assessment mHealth Studies: A Systematic Review and Analysis

Mobile Ecological Momentary Diet Assessment Methods for Behavioral Research: Systematic Review

Beyond Mobile Apps: A Survey of Technologies for Mental Well-being

Acceptability and Feasibility of an Ecological Momentary Intervention for Managing Emotional Distress Among Psychiatric Inpatients at Risk for Suicide

Working mechanisms of the use and acceptability of ecological momentary interventions: a realist evaluation of a guided self-help ecological momentary intervention targeting self-esteem

m-Path: an easy-to-use and highly tailorable platform for ecological momentary assessment and intervention in behavioral research and clinical practice

Identifying Person-Specific Drivers of Depression in Adolescents: Protocol for a Smartphone-Based Ecological Momentary Assessment and Passive Sensing Study

Effectiveness of an app-based intervention to improve well-being through cultivating positive thinking and positive emotions in an adult sample: study protocol for a randomized controlled trial