Abstract:Background Internet-delivered mental health (eMental Health) interventions produce treatment effects similar to those observed in face-to-face treatment. However, there is a large degree of variation in treatment effects observed from program to program, and eMental Health interventions remain somewhat of a black box in terms of the mechanisms by which they exert their therapeutic benefit. Trials of eMental Health interventions typically use large sample sizes and therefore provide an ideal context within which to systematically investigate the therapeutic benefit of specific program features. Furthermore, the growth and impact of mobile phone technology within eMental Health interventions provides an opportunity to examine associations between symptom improvement and the use of program features delivered across computer and mobile phone platforms. Objective The objective of this study was to identify the patterns of program usage associated with treatment outcome in a randomized controlled trial (RCT) of a fully automated, mobile phone- and Web-based self-help program, “myCompass”, for individuals with mild-to-moderate symptoms of depression, anxiety, and/or stress. The core features of the program include interactive psychotherapy modules, a symptom tracking feature, short motivational messages, symptom tracking reminders, and a diary, with many of these features accessible via both computer and mobile phone. Methods Patterns of program usage were recorded for 231 participants with mild-to-moderate depression, anxiety, and/or stress, and who were randomly allocated to receive access to myCompass for seven weeks during the RCT. Depression, anxiety, stress, and functional impairment were examined at baseline and at eight weeks. Results Log data indicated that the most commonly used components were the short motivational messages (used by 68.4%, 158/231 of participants) and the symptom tracking feature (used by 61.5%, 142/231 of participants). Further, after controlling for baseline symptom severity, increased use of these alert features was associated with significant improvements in anxiety and functional impairment. Associations between use of symptom tracking reminders and improved treatment outcome remained significant after controlling for frequency of symptom tracking. Although correlations were not statistically significant, reminders received via SMS (ie, text message) were more strongly associated with symptom reduction than were reminders received via email. Conclusions These findings indicate that alerts may be an especially potent component of eMental Health interventions, both via their association with enhanced program usage, as well as independently. Although there was evidence of a stronger association between symptom improvement and use of alerts via the mobile phone platform, the degree of overlap between use of email and SMS alerts may have precluded identification of alert delivery modalities that were most strongly associated with symptom reduction. Future research using random assignment to computer and mobile delivery is needed to fully determine the most ideal platform for delivery of this and other features of online interventions. Trial Registration Australian New Zealand Clinical Trials Registry (ACTRN): 12610000625077; http://www.anzctr.org.au/TrialSearch.aspx? (Archived by WebCite http://www.webcitation.org/6WPqHK0mQ).

The long shadow of early-change patterns: a 3-year follow-up after the use of a web-based intervention for mild to moderate depressive symptoms

Early change in specific depression symptoms and later outcome in internet-delivered psychotherapy for depression: A cohort study and cross-lagged network analysis

Efficacy of a Guided Web-Based Self-Management Intervention for Depression or Dysthymia: Randomized Controlled Trial With a 12-Month Follow-Up Using an Active Control Condition

The efficacy of automated feedback after internet-based depression screening (DISCOVER): an observer-masked, three-armed, randomised controlled trial in Germany

A randomized controlled trial of internet-based therapy in depression

Preventing Depression in Adults With Subthreshold Depression: Health-Economic Evaluation Alongside a Pragmatic Randomized Controlled Trial of a Web-Based Intervention

The Evaluation of the GET.ON Nationwide Web-Only Treatment Service for Depression- and Stress-Related Symptoms: Naturalistic Trial

Evaluation of the online-based self-help programme "Selfapy" in patients with unipolar depression: study protocol for a randomized, blinded parallel group dismantling study

How to improve reward sensitivity - Predictors of long-term effects of a randomized controlled online intervention trial

Predictors of cognitive remediation therapy improvement in (partially) remitted unipolar depression

Identifying predictors of a favourable outcome for outpatients with a persistent depressive disorder treated with Cognitive Behavioural Analysis System of Psychotherapy: A prospective cohort study

How effective is a web-based mental health intervention (“deprexis”) if started at psychiatric routine inpatient treatment of major depressive disorder? A pragmatic parallel-group randomized controlled trial

Promises and risks of web-based interventions in the treatment of depression

Breaking Open the Black Box: Isolating the Most Potent Features of a Web and Mobile Phone-Based Intervention for Depression, Anxiety, and Stress

Online Self-Help as an Add-On to Inpatient Psychotherapy: Efficacy of a New Blended Treatment Approach

Extending access to a web-based mental health intervention: who wants more, what happens to use over time, and is it helpful? Results of a concealed, randomized controlled extension study

Adherence predictors in an Internet-based Intervention program for depression

The Chronic Conditions Course: A Randomised Controlled Trial of an Internet-Delivered Transdiagnostic Psychological Intervention for People with Chronic Health Conditions

Long-Term Results of a Web-Based Guided Self-Help Intervention for Employees With Depressive Symptoms: Randomized Controlled Trial

Does recruitment source moderate treatment effectiveness? A subgroup analysis from the EVIDENT study, a randomised controlled trial of an internet intervention for depressive symptoms

The Relationship Between Symptom Change and Use of a Web-Based Self-Help Intervention for Parents of Children With Externalizing Behavior Disorders: Exploratory Study