Abstract:Background: SMS text messaging is an inexpensive, private, and scalable technology-mediated assessment mode that can alleviate many barriers faced by the safety net population to receive depression screening. Some existing studies suggest that technology-mediated assessment encourages self-disclosure of sensitive health information such as depressive symptoms while other studies show the opposite effect. Objective: This study aimed to evaluate the validity of using SMS text messaging to screen depression and related conditions, including anxiety and functional disability, in a low-income, culturally diverse safety net primary care population. Methods: This study used a randomized design with 4 study groups that permuted the order of SMS text messaging and the gold standard interview (INTW) assessment. The participants for this study were recruited from the participants of the prior Diabetes-Depression Care-management Adoption Trial (DCAT). Depression was screened by using the 2-item and 8-item Patient Health Questionnaire (PHQ-2 and PHQ-8, respectively). Anxiety was screened by using the 2-item Generalized Anxiety Disorder scale (GAD-2), and functional disability was assessed by using the Sheehan Disability Scale (SDS). Participants chose to take up the assessment in English or Spanish. Internal consistency and test-retest reliability were evaluated by using Cronbach alpha and intraclass correlation coefficient (ICC), respectively. Concordance was evaluated by using an ICC, a kappa statistic, an area under the receiver operating characteristic curve (AUROC), sensitivity, and specificity. A regression analysis was conducted to examine the association between the participant characteristics and the differences in the scores between the SMS text messaging and INTW assessment modes. Results: Overall, 206 participants (average age 57.1 [SD 9.18] years; females: 119/206, 57.8%) were enrolled. All measurements except the SMS text messaging-assessed PHQ-2 showed Cronbach alpha values ≥.70, indicating acceptable to good internal consistency. All measurements except the INTW-assessed SDS had ICC values ≥0.75, indicating good to excellent test-retest reliability. For concordance, the PHQ-8 had an ICC of 0.73 and AUROC of 0.93, indicating good concordance. The kappa statistic, sensitivity, and specificity for major depression (PHQ-8 ≥8) were 0.43, 0.60, and 0.86, respectively. The concordance of the shorter PHQ-2, GAD-2, and SDS scales was poor to fair. The regression analysis revealed that a higher level of personal depression stigma was associated with reporting higher SMS text messaging-assessed PHQ-8 and GAD-2 scores than the INTW-assessed scores. The analysis also determined that the differences in the scores were associated with marital status and personality traits. Conclusions: Depression screening conducted using the longer PHQ-8 scale via SMS text messaging demonstrated good internal consistency, test-retest reliability, and concordance with the gold standard INTW assessment mode. However, care must be taken when deploying shorter scales via SMS text messaging. Further regression analysis supported that a technology-mediated assessment, such as SMS text messaging, may create a private space with less pressure from the personal depression stigma and therefore encourage self-disclosure of depressive symptoms. Trial registration: ClinicalTrials.gov NCT01781013; https://clinicaltrials.gov/ct2/show/NCT01781013. International registered report identifier (irrid): RR2-10.2196/12392.

Secure Messaging Intervention in Patients Starting New Antidepressant to Promote Adherence: Pilot Randomized Controlled Trial

An SMS text messaging intervention to improve clinical engagement in early psychosis: A pilot randomized-controlled trial

Automated Text Messaging as an Adjunct to Cognitive Behavioral Therapy for Depression: A Clinical Trial

Testing Mechanisms of Change for Text Message-Delivered Cognitive Behavioral Therapy: Randomized Clinical Trial for Young Adult Depression

Comparing Email Versus Text Messaging as Delivery Platforms for Supporting Patients With Major Depressive Disorder: Noninferiority Randomized Controlled Trial

Patient engagement programs for recognition and initial treatment of depression in primary care: a randomized trial

Examining a Fully Automated Mobile-Based Behavioral Activation Intervention in Depression: Randomized Controlled Trial

Pilot study of psychotherapeutic text messaging for depression

HealthySMS Text Messaging System Adjunct to Adolescent Group Cognitive Behavioral Therapy in the Context of COVID-19 (Let's Text!): Pilot Feasibility and Acceptability Study

Improving adherence in mental health service users with severe mental illness in South Africa: a pilot randomized controlled trial of a treatment partner and text message intervention vs. treatment as usual

Text Messaging as a Screening Tool for Depression and Related Conditions in Underserved, Predominantly Minority Safety Net Primary Care Patients: Validity Study

The Evaluation of a Web-Based Intervention (Deprexis) to Decrease Depression and Restore Functioning in Veterans: Protocol for a Randomized Controlled Trial

An Automated Text Messaging Intervention to Reduce Substance Use Self-Stigma (Project RESTART): Protocol for a Feasibility and Acceptability Pilot Study

Internet and Telephone Support for Discontinuing Long-Term Antidepressants

Breaking Open the Black Box: Isolating the Most Potent Features of a Web and Mobile Phone-Based Intervention for Depression, Anxiety, and Stress

Reducing readmission rates for individuals discharged from acute psychiatric care in Alberta using peer and text message support: Protocol for an innovative supportive program

Daily Short Message Service Reminders Increase Treatment Compliance and Efficacy in Outpatients with Functional Dyspepsia: a Prospective Randomized Controlled Trial.

To Text or Not to Text: Electronic Message Intervention to Improve Treatment Adherence Versus Matched Historical Controls

A randomized controlled trial testing theory‐driven enhancements to increase the efficacy of and engagement in a brief cognitive‐behavioural therapy text‐message intervention for co‐occurring posttraumatic stress disorder symptoms and alcohol misuse

Evaluating the Efficacy of a Digital Therapeutic (CT-152) as an Adjunct to Antidepressant Treatment in Adults With Major Depressive Disorder: Protocol for the MIRAI Remote Study

The Appalachia Mind Health Initiative (AMHI): A pragmatic clinical trial of adjunctive internet-based Cognitive Behavior Therapy for treating major depressive disorder among primary care patients