Abstract:The ubiquity of mobile devices has made it possible for clinical decision‐support systems (CDSS) to become available to healthcare providers on handheld devices at the point‐of‐care, including in low‐ and middle‐income countries. The use of CDSS by providers can potentially improve adherence to treatment protocols and patient outcomes. However, the evidence on the effect of the use of CDSS on mobile devices needs to be synthesized. This review was carried out to support a World Health Organization (WHO) guideline that aimed to inform investments on the use of decision‐support tools on digital devices to strengthen primary healthcare. To assess the effects of digital clinical decision‐support systems (CDSS) accessible via mobile devices by primary healthcare providers in the context of primary care settings. We searched CENTRAL, MEDLINE, Embase, Global Index Medicus, POPLINE, and two trial registries from 1 January 2000 to 9 October 2020. We conducted a grey literature search using mHealthevidence.org and issued a call for papers through popular digital health communities of practice. Finally, we conducted citation searches of included studies. Study design: we included randomized trials, including full‐text studies, conference abstracts, and unpublished data irrespective of publication status or language of publication. Types of participants: we included studies of all cadres of healthcare providers, including lay health workers and other individuals (administrative, managerial, and supervisory staff) involved in the delivery of primary healthcare services using clinical decision‐support tools; and studies of clients or patients receiving care from primary healthcare providers using digital decision‐support tools. Types of interventions: we included studies comparing digital CDSS accessible via mobile devices with non‐digital CDSS or no intervention, in the context of primary care. CDSS could include clinical protocols, checklists, and other job‐aids which supported risk prioritization of patients. Mobile devices included mobile phones of any type (but not analogue landline telephones), as well as tablets, personal digital assistants, and smartphones. We excluded studies where digital CDSS were used on laptops or integrated with electronic medical records or other types of longitudinal tracking of clients. A machine learning classifier that gave each record a probability score of being a randomized trial screened all search results. Two review authors screened titles and abstracts of studies with more than 10% probability of being a randomized trial, and one review author screened those with less than 10% probability of being a randomized trial. We followed standard methodological procedures expected by Cochrane and the Effective Practice and Organisation of Care group. We used the GRADE approach to assess the certainty of the evidence for the most important outcomes. Eight randomized trials across varying healthcare contexts in the USA,. India, China, Guatemala, Ghana, and Kenya, met our inclusion criteria. A range of healthcare providers (facility and community‐based, formally trained, and lay workers) used digital CDSS. Care was provided for the management of specific conditions such as cardiovascular disease, gastrointestinal risk assessment, and maternal and child health. The certainty of evidence ranged from very low to moderate, and we often downgraded evidence for risk of bias and imprecision. We are uncertain of the effect of this intervention on providers' adherence to recommended practice due to the very low certainty evidence (2 studies, 185 participants). The effect of the intervention on patients' and clients' health behaviours such as smoking and treatment adherence is mixed, with substantial variation across outcomes for similar types of behaviour (2 studies, 2262 participants). The intervention probably makes little or no difference to smoking rates among people at risk of cardiovascular disease but probably increases other types of desired behaviour among patients, such as adherence to treatment. The effect of the intervention on patients'/clients' health status and well‐being is also mixed (5 studies, 69,767 participants). It probably makes little or no difference to some types of health outcomes, but we are uncertain about other health outcomes, including maternal and neonatal deaths, due to very low‐certainty evidence. The intervention may slightly improve patient or client acceptability and satisfaction (1 study, 187 participants). We found no studies that reported the time between the presentation of an illness and appropriate management, provider acceptability or satisfaction, resource use, or unintended consequences. We are uncertain about the effectiveness of mobile phone‐based decision‐support tools on several outcomes, including adherence to recommended practice. None of the studies had a quality of care framework and f -Abstract Truncated-

Electronic Integrated Management of Childhood Illness (eIMCI): a randomized controlled trial to evaluate an electronic clinical decision-making support system for management of sick children in primary health care facilities in South Africa

Digitalizing Clinical Guidelines: Experiences in the Development of Clinical Decision Support Algorithms for Management of Childhood Illness in Resource-Constrained Settings

Adherence to integrated management of childhood illness (IMCI) guidelines by community health workers in Kano State, Nigeria through use of a clinical decision support (CDS) platform

E-IMNCI: a novel clinical diagnostic support system approach to strengthen effectiveness and quality of IMNCI implementation in India

Quality of care when using a digital clinical decision support algorithm to manage sick children at primary care health facilities in Tanzania: a cross-sectional cluster randomized controlled trial (DYNAMIC study)

The Tools for Integrated Management of Childhood Illness (TIMCI) study protocol: a multi-country mixed-method evaluation of pulse oximetry and clinical decision support algorithms

Cost of Installing and Operating an Electronic Clinical Decision Support System for Maternal Health Care: Case of Tanzania Rural Primary Health Centres

204: THE ROLE OF IMCI PROGRAM IN THE RATIONALIZATION OF MEDICAMENT USE IN PEDIATRICS

Decision-support tools via mobile devices to improve quality of care in primary healthcare settings.

Key challenges of health care workers in implementing the integrated management of childhood illnesses (IMCI) program: a scoping review

Evaluation of an electronic clinical decision support algorithm to improve primary care management of acute febrile illness in rural Cambodia: protocol for a cluster-randomised trial

The Systematic Medical Appraisal, Referral and Treatment (SMART) Mental Health Project: Development and Testing of Electronic Decision Support System and Formative Research to Understand Perceptions about Mental Health in Rural India

Integrated Management of Childhood Illness implementation in Nepal: understanding strategies, context, and outcomes

Reusable Generic Clinical Decision Support System Module for Immunization Recommendations in Resource-Constraint Settings

Development and implementation of a mobile device-based pediatric electronic decision support tool as part of a national practice standardization project

Electronic monitoring device informed interventions for treatment adherence and clinical outcomes in children and adolescents: A systematic review

Lessons learned from the development and implementation of an electronic paediatric emergency and acute care database in Lilongwe, Malawi

Integrated care as a means to improve primary care delivery for adults and adolescents in the developing world: a critical analysis of Integrated Management of Adolescent and Adult Illness (IMAI)

Healthcare systems collaborating to implement a shared decision-making tool in the electronic health record and build evidence on its adoption and use

Conducting a Representative National Randomized Control Trial of Tailored Clinical Decision Support for Nurses Remotely: Methods and Implications.

Computerized clinical decision support systems for drug prescribing and management: a decision-maker-researcher partnership systematic review