Abstract:Background: Evidence-informed policymaking is more likely if organisations have cultures that promote research use and invest in resources that facilitate staff engagement with research. Measures of organisations' research use culture and capacity are needed to assess current capacity, identify opportunities for improvement, and examine the impact of capacity-building interventions. The aim of the current study was to develop a comprehensive system to measure and score organisations' capacity to engage with and use research in policymaking, which we entitled ORACLe (Organisational Research Access, Culture, and Leadership). Method: We used a multifaceted approach to develop ORACLe. Firstly, we reviewed the available literature to identify key domains of organisational tools and systems that may facilitate research use by staff. We interviewed senior health policymakers to verify the relevance and applicability of these domains. This information was used to generate an interview schedule that focused on seven key domains of organisational capacity. The interview was pilot-tested within four Australian policy agencies. A discrete choice experiment (DCE) was then undertaken using an expert sample to establish the relative importance of these domains. This data was used to produce a scoring system for ORACLe. Results: The ORACLe interview was developed, comprised of 23 questions addressing seven domains of organisational capacity and tools that support research use, including (1) documented processes for policymaking; (2) leadership training; (3) staff training; (4) research resources (e.g. database access); and systems to (5) generate new research, (6) undertake evaluations, and (7) strengthen relationships with researchers. From the DCE data, a conditional logit model was estimated to calculate total scores that took into account the relative importance of the seven domains. The model indicated that our expert sample placed the greatest importance on domains (2), (3) and (4). Conclusion: We utilised qualitative and quantitative methods to develop a system to assess and score organisations' capacity to engage with and apply research to policy. Our measure assesses a broad range of capacity domains and identifies the relative importance of these capacities. ORACLe data can be used by organisations keen to increase their use of evidence to identify areas for further development.

Developing Administrative Capacity: An Agenda For Research And Practice

An agenda for the study of Public Administration in Developing Countries

Developing an Index of National Research Capacity

Organizational capacity building: Addressing a research and practice gap

Measuring capacity building in communities: a review of the literature

Policy capacity matters for capacity development: comparing teacher in-service training and career advancement in basic education systems of India and China

Measuring Policy Capacity Through Governance Indices

Challenges and strategies in developing nursing research capacity: a review of the literature

Health research capacity development in low and middle income countries: reality or rhetoric? A systematic meta-narrative review of the qualitative literature

Assessing the Effectiveness of Capacity-Building Initiatives: Seven Issues for the Field

The Administrative Capacity of New Types of Governance

Indigenizing African Development Capacity

Building Research Capacity in Social Work: Process and Issues

Exploring evidence use and capacity for health services management and planning in Swiss health administrations: A mixed-method interview study

The development of ORACLe: a measure of an organisation's capacity to engage in evidence-informed health policy

Developing Theory to Guide Building Practitioners’ Capacity to Implement Evidence-Based Interventions

Institutional Capacity-building in Urban Planning and Policy-making for Sustainable Development: Success or Failure?

Understanding Evaluation Policy and Organizational Capacity for Evaluation: An Interview Study

Methodological Problems of Assessing the Effectiveness of Public Administration of Socio-Economic Development

Being a Public Manager in Times of Crisis: the Art of Managing Stakeholders, Political Masters, and Collaborative Networks

Nurturing Development Administration in South African Local Government