Abstract:IntroductionRegulations are increasing the scope of activities that fall under the remit of drug safety. Currently, individual case safety report (ICSR) collection and collation is done manually, requiring pharmacovigilance professionals to perform many transactional activities before data are available for assessment and aggregated analyses. For a biopharmaceutical company to meet its responsibilities to patients and regulatory bodies regarding the safe use and distribution of its products, improved business processes must be implemented to drive the industry forward in the best interest of patients globally. Augmented intelligent capabilities have already demonstrated success in capturing adverse events from diverse data sources. It has potential to provide a scalable solution for handling the ever-increasing ICSR volumes experienced within the industry by supporting pharmacovigilance professionals’ decision-making.ObjectiveThe aim of this study was to train and evaluate a consortium of cognitive services to identify key characteristics of spontaneous ICSRs satisfying an acceptable level of accuracy determined by considering business requirements and effective use in a real-world setting. The results of this study will serve as supporting evidence for or against implementing augmented intelligence in case processing to increase operational efficiency and data quality consistency.MethodsA consortium of ten cognitive services to augment aspects of ICSR processing were identified and trained through deep-learning approaches. The input data for model training were 20,000 ICSRs received by Celgene drug safety over a 2-year period. The data were manually made machine-readable through the process of transcription, which converts images into text. The machine-readable documents were manually annotated for pharmacovigilance data elements to facilitate the training and testing of the cognitive services. Once trained by cognitive developers, the cognitive services’ output was reviewed by pharmacovigilance subject-matter experts against the accepted ground-truth for correctness and completeness. To be considered adequately trained and functional, each cognitive service was required to reach a threshold of F1 or accuracy score ≥ 75%.ResultsAll ten cognitive services under development have reached an evaluative score ≥ 75% for spontaneous ICSRs.ConclusionAll cognitive services under development have achieved the minimum evaluative threshold to be considered adequately trained, demonstrating how machine-learning and natural language processing techniques together provide accurate outputs that may augment pharmacovigilance professionals’ processing of spontaneous ICSRs quickly and accurately. The intention of augmented intelligence is not to replace the pharmacovigilance professional, but rather support them in their consistent decision-making so that they may better handle the overwhelming amount of data otherwise manually curated and monitored for ongoing drug surveillance requirements. Through this supported decision-making, pharmacovigilance professionals may have more time to apply their knowledge in assessing the case rather than spending it performing transactional tasks to simply capture the pertinent data within a safety database. By capturing data consistently and efficiently, we begin to build a corpus of data upon which analyses may be conducted and insights gleaned. Cognitive services may be key to an organization’s transformation to more proactive decision-making needed to meet regulatory requirements and enhance patient safety.

Sweet's syndrome in a woman with chronic dermatophytic infection

Analysis of a Pharmacist-Led Adverse Drug Event Management Model for Pharmacovigilance in an Academic Medical Center Hospital in China

Sorting Through the Safety Data Haystack: Using Machine Learning to Identify Individual Case Safety Reports in Social-Digital Media

Training Augmented Intelligent Capabilities for Pharmacovigilance: Applying Deep-learning Approaches to Individual Case Safety Report Processing

Development and Validation of a Deep Learning Model for Detection of Allergic Reactions Using Safety Event Reports Across Hospitals

Leveraging Machine Learning to Facilitate Individual Case Causality Assessment of Adverse Drug Reactions

Developing A Deep Learning Natural Language Processing Algorithm For Automated Reporting Of Adverse Drug Reactions

An innovative method to strengthen evidence for potential drug safety signals using Electronic Health Records

A Prediction Model to Identify Clinically Relevant Medication Discrepancies at the Emergency Department (MED-REC Predictor): Development and Validation Study

Streamlining Considerations for Safety Measures: A Predictive Model for Addition of Clinically Significant Adverse Reactions to Japanese Drug Package Inserts

Discovering clinical drug-drug interactions with known pharmacokinetics mechanisms using spontaneous reporting systems and electronic health records

Automatic assessment of adverse drug reaction reports with interactive visual exploration

Evaluation of a simplified pharmacovigilance tool for general practitioners: 5 years of insight

Multivariate generalized mixed-effects models for screening multiple adverse drug reactions in spontaneous reporting systems

Effectiveness of the Expanded Programme on Immunization.

A discovery and verification approach to pharmacovigilance using electronic healthcare data

Statistical Signal Detection Algorithm in Safety Data: A Proprietary Method Compared to Industry Standard Methods

Prediction of adverse drug reactions using demographic and non-clinical drug characteristics in FAERS data

Detect adverse drug reactions for drug Atorvastatin

Statistical Techniques for Signal Generation

A Machine-Learning Algorithm to Optimise Automated Adverse Drug Reaction Detection from Clinical Coding