Effectiveness of a chatbot in improving the mental wellbeing of health workers in Malawi during the COVID-19 pandemic: A randomized, controlled trial

Eckhard F. Kleinau,Tilinao Lamba,Wanda Jaskiewicz,Katy Gorentz,Ines Hungerbuehler,Donya Rahimi,Demoubly Kokota,Limbika Maliwichi,Edister S. Jamu,Alex Zumazuma,Mariana Negrão,Raphael Mota,Yasmine Khouri,Michael Kapps

DOI: https://doi.org/10.1101/2023.01.24.23284959

2024-03-11

Abstract:We conducted a randomized, controlled trial (RCT) to investigate our hypothesis that the interactive chatbot, Vitalk, is more effective in improving mental wellbeing and resilience outcomes of health workers in Malawi than the passive use of Internet resources. For our 2-arm, 8-week, parallel RCT (ISRCTN Registry: trial ID ), we recruited participants from 8 professional cadres from public and private healthcare facilities. The treatment arm used Vitalk; the control arm received links to Internet resources. The research team was blinded to the assignment. Of 1,584 participants randomly assigned to the treatment and control arms, 215 participants in the treatment and 296 in the control group completed baseline and endline anxiety assessments. Six assessments provided outcome measures for: anxiety (GAD-7); depression (PHQ-9); burnout (OLBI); loneliness (ULCA); resilience (RS-14); and resilience-building activities. We analyzed effectiveness using mixed-effects linear models, effect size estimates, and reliable change in risk levels. Results support our hypothesis. Difference-in-differences estimators showed that Vitalk reduced: depression (−0.68 [95% CI −1.15 to −0.21]); anxiety (−0.44 [95% CI −0.88 to 0.01]); and burnout (−0.58 [95% CI −1.32 to 0.15]). Changes in resilience (1.47 [95% CI 0.05 to 2.88]) and resilience-building activities (1.22 [95% CI 0.56 to 1.87]) were significantly greater in the treatment group. Our RCT produced a medium effect size for the treatment and a small effect size for the control group. This is the first RCT of a mental health app for healthcare workers during the COVID-19 pandemic in Southern Africa combining multiple mental wellbeing outcomes and measuring resilience and resilience-building activities. A substantial number of participants could have benefited from mental health support (1 in 8 reported anxiety and depression; 3 in 4 suffered burnout; and 1 in 4 had low resilience). Such help is not readily available in Malawi. Vitalk has the potential to fill this gap.

Health Systems and Quality Improvement

What problem does this paper attempt to address?

### Problems the Paper Attempts to Solve

This paper aims to explore whether the interactive chatbot Vitalk can more effectively improve the mental health and resilience of healthcare workers during the pandemic in Malawi through a randomized controlled trial (RCT) compared to passive use of internet resources. Specifically, the study hypothesizes that Vitalk can effectively reduce work-related anxiety, depression, burnout, and loneliness among healthcare workers, and enhance their resilience and resilience-building behaviors.

### Background

1. **Stress on Healthcare Workers**: Even under normal circumstances, medical work is highly stressful. During the pandemic, healthcare workers face greater stress, including life-and-death decisions, physical exhaustion, lack of protective equipment, and fear of infection.
2. **Prevalence of Mental Health Issues**: Globally, many healthcare workers suffer from depression, anxiety, and burnout. For example, a systematic review found that 24% of healthcare workers suffer from anxiety, 21% from depression, and 37% feel psychological stress.
3. **Current Situation in Malawi**: Mental health support for healthcare workers in Malawi is very limited, with only 0.02 psychologists, 0.01 psychiatrists, and 0.04 occupational therapists per 100,000 people. Additionally, mental health professionals are often assigned to other duties, such as obstetric services, further exacerbating the problem.

### Research Objectives

1. **Hypothesis Verification**: Verify through an RCT whether Vitalk, as a virtual mental health assistant, can effectively improve the mental health and resilience of healthcare workers.
2. **Effectiveness Evaluation**: Evaluate the effectiveness of Vitalk in reducing anxiety, depression, burnout, and loneliness, and in enhancing resilience and resilience-building behaviors.
3. **Filling Research Gaps**: This is the first RCT on a mental health application for healthcare workers in sub-Saharan Africa, combining multiple mental health outcomes and resilience measurements.

### Methods

1. **Study Design**: 2-group parallel RCT over 8 weeks, including baseline assessment, intervention period, mid-term assessment, and end-of-study assessment.
2. **Participants**: Healthcare workers from 8 different professions recruited from public and private medical institutions in Malawi.
3. **Interventions**:
- **Treatment Group**: Use the Vitalk chatbot daily for 8 weeks.
- **Control Group**: Passive use of internet resources, including Mental Health Foundation, WHO mental health resources, etc.
4. **Assessment Tools**: Standardized mental health and resilience assessment tools, including PHQ-9 (depression), GAD-7 (anxiety), OLBI (burnout), UCLA Loneliness Scale, RS-14 (resilience), and Resilience Building Activities Scale.

### Results

1. **Primary Outcomes**: Vitalk significantly reduced depression (-0.68 [95% CI -1.15 to -0.21]), anxiety (-0.44 [95% CI -0.88 to 0.01]), and burnout (-0.58 [95% CI -1.32 to 0.15]), and significantly improved resilience and resilience-building activities.
2. **Effect Size**: The effect size for the treatment group was moderate, while for the control group it was small.

### Conclusion

1. **Effectiveness**: Vitalk showed significant effectiveness in improving the mental health and resilience of healthcare workers.
2. **Potential Impact**: Vitalk has the potential to fill the gap in mental health support in Malawi, especially during the pandemic.

### Significance

1. **Policy Recommendations**: It is recommended to promote the use of mental health applications like Vitalk in similarly resource-limited environments.
2. **Future Research**: Further research is needed to study the applicability and long-term effects of Vitalk in different cultures and contexts.