Abstract:BACKGROUND An increasing number of software companies work according to the agile software development method, which is difficult to integrate with user-centered design (UCD) practices. Log file analysis may provide opportunities for integrating UCD practices in the agile process. However, research within health care information technology mostly has a theoretical approach and is often focused on the researcher’s interpretation of log file analyses. OBJECTIVE We aimed to propose a systematic approach to log file analysis in this study and present this to developers to explore how they react and interpret this approach in the context of a real-world health care information system, in an attempt to answer the following question: How may log file analyses contribute to increasing the match between the health care system and its users, within the agile development method, according to agile team members? METHODS This study comprised 2 phases to answer the research question. In the first phase, log files were collected from a health care information system and subsequently analyzed (summarizing sequential patterns, heat mapping, and clustering). In the second phase, the results of these analyses are presented to agile professionals during a focus group interview. The interpretations of the agile professionals are analyzed by open axial coding. RESULTS Log file data of 17,924 user sessions and, in total, 176,678 activities were collected. We found that the Patient Timeline is mainly visited, with 23,707 (23,707/176,678; 13.42%) visits in total. The main unique user session occurred in 5.99% (1074/17,924) of all user sessions, and this comprised Insert Measurement Values for Patient and Patient Timeline, followed by the page Patient Settings and, finally, Patient Treatment Plan. In the heat map, we found that users often navigated to the pages Insert Measurement Values and Load Messages Collaborate. Finally, in the cluster analysis, we found 5 clusters, namely, the Information-seeking cluster, the Collaborative cluster, the Mixed cluster, the Administrative cluster, and the Patient-oriented cluster. We found that the interpretations of these results by agile professionals are related to stating hypotheses (n=34), comparing paths (n=31), benchmarking (n=22), and prioritizing (n=17). CONCLUSIONS We found that analyzing log files provides agile professionals valuable insights into users’ behavior. Therefore, we argue that log file analyses should be used within agile development to inform professionals about users’ behavior. In this way, further UCD research can be informed by these results, making the methods less labor intensive. Moreover, we argue that these translations to an approach for further UCD research will be carried out by UCD specialists, as they are able to infer which goals the user had when going through these paths when looking at the log data.

Using electronic health record audit log data for research: insights from early efforts

Using EHR Audit Trail Logs to Analyze Clinical Workflow: A Case Study from Community-Based Ambulatory Clinics.

Using the electronic health record to provide audit and feedback in medical student clerkships

A Scalable and Extensible Logical Data Model of Electronic Health Record Audit Logs for Temporal Data Mining (RNteract): Model Conceptualization and Formulation

Feasibility analysis of conducting observational studies with the electronic health record

A Qualitative Study of Physicians' Views on the Reuse of Electronic Health Record Data for Secondary Analysis

Clinical outcome prediction using observational supervision with electronic health records and audit logs

A narrative review on the validity of electronic health record-based research in epidemiology

A Measure of the Impact on Real-Time Patient Care of Evidence-based Medicine Logs

Exploring How Professionals Within Agile Health Care Informatics Perceive Visualizations of Log File Analyses: Observational Study Followed by a Focus Group Interview (Preprint)

Evaluating the Effectiveness of Auditing Rules for Electronic Health Record Systems

Conceptualizing Machine Learning for Dynamic Information Retrieval of Electronic Health Record Notes

Thought Leader Perspectives on the Benefits, Barriers, and Enablers for Routinely Collected Electronic Health Data to Support Professional Development: Qualitative Study

Using Electronic Health Record Data for Occupational Therapy Health Services Research: Invited Commentary

Electronic Medical Records As a Replacement for Prospective Research Data Collection in Postoperative Pain and Opioid Response Studies

Optimising the use of electronic medical records for large scale research in psychiatry

Explaining Variability in Electronic Health Record Effort in Primary Care Ambulatory Encounters

Exploring How Professionals Within Agile Health Care Informatics Perceive Visualizations of Log File Analyses: Observational Study Followed by a Focus Group Interview

Unlocking the Potential of Secondary Data for Public Health Research: Retrospective Study With a Novel Clinical Platform

Approach to machine learning for extraction of real-world data variables from electronic health records

Allied health professionals' experiences and lessons learned in response to a big bang electronic medical record implementation: A prospective observational study