Abstract:Background: SMS text messaging is an inexpensive, private, and scalable technology-mediated assessment mode that can alleviate many barriers faced by the safety net population to receive depression screening. Some existing studies suggest that technology-mediated assessment encourages self-disclosure of sensitive health information such as depressive symptoms while other studies show the opposite effect. Objective: This study aimed to evaluate the validity of using SMS text messaging to screen depression and related conditions, including anxiety and functional disability, in a low-income, culturally diverse safety net primary care population. Methods: This study used a randomized design with 4 study groups that permuted the order of SMS text messaging and the gold standard interview (INTW) assessment. The participants for this study were recruited from the participants of the prior Diabetes-Depression Care-management Adoption Trial (DCAT). Depression was screened by using the 2-item and 8-item Patient Health Questionnaire (PHQ-2 and PHQ-8, respectively). Anxiety was screened by using the 2-item Generalized Anxiety Disorder scale (GAD-2), and functional disability was assessed by using the Sheehan Disability Scale (SDS). Participants chose to take up the assessment in English or Spanish. Internal consistency and test-retest reliability were evaluated by using Cronbach alpha and intraclass correlation coefficient (ICC), respectively. Concordance was evaluated by using an ICC, a kappa statistic, an area under the receiver operating characteristic curve (AUROC), sensitivity, and specificity. A regression analysis was conducted to examine the association between the participant characteristics and the differences in the scores between the SMS text messaging and INTW assessment modes. Results: Overall, 206 participants (average age 57.1 [SD 9.18] years; females: 119/206, 57.8%) were enrolled. All measurements except the SMS text messaging-assessed PHQ-2 showed Cronbach alpha values ≥.70, indicating acceptable to good internal consistency. All measurements except the INTW-assessed SDS had ICC values ≥0.75, indicating good to excellent test-retest reliability. For concordance, the PHQ-8 had an ICC of 0.73 and AUROC of 0.93, indicating good concordance. The kappa statistic, sensitivity, and specificity for major depression (PHQ-8 ≥8) were 0.43, 0.60, and 0.86, respectively. The concordance of the shorter PHQ-2, GAD-2, and SDS scales was poor to fair. The regression analysis revealed that a higher level of personal depression stigma was associated with reporting higher SMS text messaging-assessed PHQ-8 and GAD-2 scores than the INTW-assessed scores. The analysis also determined that the differences in the scores were associated with marital status and personality traits. Conclusions: Depression screening conducted using the longer PHQ-8 scale via SMS text messaging demonstrated good internal consistency, test-retest reliability, and concordance with the gold standard INTW assessment mode. However, care must be taken when deploying shorter scales via SMS text messaging. Further regression analysis supported that a technology-mediated assessment, such as SMS text messaging, may create a private space with less pressure from the personal depression stigma and therefore encourage self-disclosure of depressive symptoms. Trial registration: ClinicalTrials.gov NCT01781013; https://clinicaltrials.gov/ct2/show/NCT01781013. International registered report identifier (irrid): RR2-10.2196/12392.

Predictors of Participation in a Perinatal Text Message Screening Protocol for Maternal Depression and Anxiety: Prospective Cohort Study

Text Messaging as a Screening Tool for Depression and Related Conditions in Underserved, Predominantly Minority Safety Net Primary Care Patients: Validity Study

Impact of an SMS Advice Programme on Maternal and Newborn Health in Rural China: Study Protocol for a Quasi-Randomised Controlled Trial.

Comprehensive intervention during pregnancy based on short message service to prevent or alleviate depression in pregnant women: A quasi-experimental study

Teaching by texting to promote positive health behaviours in pregnancy: a protocol for a randomised controlled trial of SmartMom

Evaluation of Repeated Web-Based Screening for Predicting Postpartum Depression: Prospective Cohort Study

Effectiveness of a Postpartum Text Message Program (Essential Coaching for Every Mother) on Maternal Psychosocial Outcomes: Protocol for a Randomized Controlled Trial (Preprint)

The Necessity and Acceptability of Text Message Therapy to Peripartum Mothers

Pilot study of psychotherapeutic text messaging for depression

Digital phenotyping of depression during pregnancy using self-report data

HealthySMS Text Messaging System Adjunct to Adolescent Group Cognitive Behavioral Therapy in the Context of COVID-19 (Let's Text!): Pilot Feasibility and Acceptability Study

Effectiveness of a Postpartum Text Message Program (Essential Coaching for Every Mother) on Maternal Psychosocial Outcomes: Protocol for a Randomized Controlled Trial

Risk Identification in Perinatal Health Care Settings via Technology-Based Recruitment Methods: Comparative Study

Small Steps over time: A longitudinal usability test of an automated interactive text messaging intervention to support self-management of depression and anxiety symptoms

Using Smartphone-Based Psychoeducation to Reduce Postnatal Depression Among First-Time Mothers: Randomized Controlled Trial

Effectiveness of the “Essential Coaching for Every Mother” postpartum text message program on maternal psychosocial outcomes: A randomized controlled trial

Testing a Behavioral Activation Gaming App for Depression During Pregnancy: Multimethod Pilot Study

Improving Maternal Depression Screening in the Neonatal Intensive Care Unit

Acceptability and Feasibility of Text Message Interface to Assess Parents' Real-time PICU Experiences

Prevalence and factors associated with antenatal depressive symptoms across trimesters: a study of 110,584 pregnant women covered by a mobile app-based screening programme in Shenzhen, China

Effect of peer support on prevention of postnatal depression among high risk women: multisite randomised controlled trial