Abstract:BACKGROUND In recent years, there has been an increase in symptoms of depression, anxiety, and other mental illnesses in college student populations alongside a steady rise in the demand for counseling services. Digital mental health programs, such as those delivered through mobile apps, can add to the array of available services but must be tested for usability and acceptability before implementation. OBJECTIVE This study aims to examine how students used IntelliCare for College Students over an 8-week period to examine the preliminary associations between app use and psychosocial targets and to gather user feedback about usability issues that need to be remedied before a larger implementation study. METHODS IntelliCare for College Students is an app-based platform that provides symptom assessments with personalized feedback, information about campus resources, lessons on mental health and wellness topics, and access to the suite of interactive skill–focused IntelliCare apps. A total of 20 students were recruited to participate in an 8-week study. To test for a broad range of potential users, we recruited a mixed sample of students with elevated symptoms of depression or anxiety and students without elevated symptoms. Participants completed psychosocial questionnaires at baseline, week 4, and week 8. Participants also completed user feedback interviews at weeks 4 and 8 in which they provided feedback on their experience using the app and suggestions for changes they would like to be made to the app. RESULTS Of the 20 students who downloaded the app, 19 completed the study, indicating a high rate of retention. Over the study period, participants completed an average of 5.85 (SD 2.1; range 1-8) symptom assessments. Significant improvements were observed in the Anxiety Literacy Questionnaire scores (Z=−2.006; P =.045) and in the frequency with which participants used both cognitive (Z=−2.091; P =.04) and behavioral (Z=−2.249; P =.03) coping skills. In the feedback interviews, we identified a high degree of usability with minor bugs in the app software, which were quickly fixed. Furthermore, in feedback interviews, we identified that users found the app to be convenient and appreciated the ability to use the program in short bursts of time. CONCLUSIONS The findings indicate that the IntelliCare for College Students program was perceived as largely usable and engaging. Although the program demonstrated usability and preliminary benefits to students, further testing is needed to determine its clinical utility among college students. CLINICALTRIAL ClinicalTrials.gov NCT04035577; https://clinicaltrials.gov/ct2/show/NCT04035577

Validating an Internalizing Psychopathology Screener for Use with College Students

Internalizing psychopathology and its links to suicidal ideation, dysfunctional attitudes, and help-seeking readiness in a national sample of college students

Screening for Adolescent Problematic Internet Use: Validation of the Problematic and Risky Internet Use Screening Scale (PRIUSS)

Systematic Integration of Multi-Informant Externalizing Ratings in Clinical Settings

Having a Trusted Adult in School: Concurrent and Predictive Relations With Internalizing Problems Across Development

Validation of an Instrument for Detecting Problematic Internet Use in Adolescents

Performance of the Personality Inventory for Youth validity scales

Additional Evidence of Predictive Validity of SRSS-IE Scores With Elementary Students

Validity of the Self-Harm Behavior Questionnaire with Diverse Adolescents

Psychosocial Competencies Among Clinic-Referred and Community-Based Children: Known-Groups Validity of the Psychosocial Strengths Inventory for Children and Adolescents (PSICA)

Validation of a Brief Internet-Based Self-Report Measure of Maladaptive Personality and Interpersonal Schema: Confirmatory Factor Analysis

Exploring a dual-factor mental health screening model with children in grades 5-10

Validation of the Social Media Disorder Scale in Adolescents: Findings From a Large-Scale Nationally Representative Sample

Validity of the Strengths and Difficulties Questionnaire for Screening and Diagnosis in Western Australian Adolescents

Examining an App-Based Mental Health Self-Care Program, IntelliCare for College Students: Single-Arm Pilot Study (Preprint)

An Analysis of SRSS-IE Externalizing Cut Scores to Facilitate Data-Informed Decision-Making in K–12 Schools

Validation of the ACSID-11 for consistent screening of specific internet use disorders based on ICD-11 criteria for gaming disorder: A multitrait-multimethod approach

Psychometric properties of the Child and Adolescent PsychProfiler v5: a measure for screening 14 of the most common DSM-5 disorders

Assessing Problematic Social Media Use in Adolescents by Parental Ratings: Development and Validation of the Social Media Disorder Scale for Parents (SMDS-P)

Developing and Validating a Computerized Adaptive Test to Measure Broad and Specific Factors of Internalizing in a Community Sample

The Persian Self-Report Version of the Antisocial Process Screening Device (APSD-P): A Psychometric Evaluation