Abstract:Background: In an effort to increase vaccination coverage in low-resource settings, digital tools have been introduced to better track immunization records, improve data management practices, and provide improved access to vaccination coverage data for decision-making. Despite the potential of these electronic systems to improve the provision of health services, few digital health interventions have been institutionalized at scale in low- and middle-income countries. Objective: In this paper, we aimed to describe how health care workers in Kenya had integrated an electronic immunization registry into their immunization clinic workflows and to use these findings to inform the development of a refined program theory on the registry's usability. Methods: Informed by realist methodology, we developed a program theory to explain usability of the electronic immunization registry. We designed a qualitative study based on our theory to describe the barriers and facilitators influencing data entry and use. Qualitative data were collected through semistructured interviews with users and workflow observations of immunization clinic sessions. Our findings were summarized by context-mechanism-outcome relationships formed after analyzing our key themes across interviews and workflow observations. Using these relationships, we were able to identify common rules for future implementers. Results: Across the 12 facilities included in our study, 19 health care workers were interviewed, and 58 workflow sessions were observed. The common rules developed from our qualitative findings are as follows: rule 1-ensure that the users complete training to build familiarity with the system, understand the value of the system and data, and know where to find support; rule 2-confirm that the system captures all data needed for users to provide routine health care services and is easy to navigate; rule 3-identify work-arounds for poor network, system performance, and too few staff or resources; and rule 4-make users aware of expected changes to their workflow, and how these changes might differ over time and by facility size or number of patients. Upon study completion, we revised the program theory to reflect the importance of the goals and workflows of electronic immunization registries aligning with reality. Conclusions: We created a deeper understanding of the underlying mechanisms for usability of the registry. We found that the electronic immunization registry had high acceptability among users; however, there were numerous barriers to using the system, even under ideal conditions, causing a misalignment between the system and the reality of the users' workflows and their environment. Human-centered design and human-factors methods can assist during pilot stages to better align systems with users' needs and again after scale-up to ensure that interventions are suitable for all user settings.

Determinants to immunization information system implementation in independent community pharmacies in rural Alabama

Factors Associated with the Implementation of Pediatric Immunization Services: A Survey of Community Pharmacies

Immunization information systems to increase vaccination rates: a community guide systematic review

The potential for centralized reminder/recall to increase immunization rates: A national survey of immunization information systems (IIS) managers

Community chain pharmacists' perceptions of increased technicians' involvement in the immunization process

Barriers and facilitators of the use of clinical informatics resources to facilitate pharmacogenomic implementation in resource-limited settings

Forward and backward transitions in pharmacy-based immunization services

A cross-sectional survey exploring organizational readiness to implement community pharmacy-based opioid counseling and naloxone services in rural versus urban settings in Alabama

Community pharmacists' knowledge, beliefs, and perceived barriers toward vaccination services at community pharmacies: A cross-sectional study from Saudi Arabia

Exploring pharmacists' perceptions regarding influenza and streptococcal testing within a chain pharmacy

Preparing community pharmacy teams for health information exchange (HIE)

Barriers to Childhood Immunisation and Local Strategies in Four Districts in South Africa: A Qualitative Study

Vaccination equity and the role of community pharmacy in the United States: A qualitative study

Evaluation of the Impact of an Innovative Immunization Practice Model Designed to Improve Population Health: Results of the Project IMPACT Immunizations Pilot

How school nurses can benefit from immunization information systems: information exchange to keep students in school and ready to learn

Considerations of Australian community pharmacists in the provision and implementation of cognitive pharmacy services: a qualitative study

Integration of a Digital Health Intervention Into Immunization Clinic Workflows in Kenya: Qualitative, Realist Evaluation of Technology Usability

Development and validation of a survey instrument to measure factors that influence pharmacist adoption of prescribing in Alberta, Canada

A qualitative assessment of a community pharmacy cognitive pharmaceutical services program, using a work system approach

"But then that's another barrier": A qualitative study of parent and provider perspectives on rural versus urban disparities in adolescent vaccination

Assessment of community pharmacists' knowledge, attitudes and their willingness to provide vaccination services in Saudi Arabia