Abstract:IntroductionRegulations are increasing the scope of activities that fall under the remit of drug safety. Currently, individual case safety report (ICSR) collection and collation is done manually, requiring pharmacovigilance professionals to perform many transactional activities before data are available for assessment and aggregated analyses. For a biopharmaceutical company to meet its responsibilities to patients and regulatory bodies regarding the safe use and distribution of its products, improved business processes must be implemented to drive the industry forward in the best interest of patients globally. Augmented intelligent capabilities have already demonstrated success in capturing adverse events from diverse data sources. It has potential to provide a scalable solution for handling the ever-increasing ICSR volumes experienced within the industry by supporting pharmacovigilance professionals’ decision-making.ObjectiveThe aim of this study was to train and evaluate a consortium of cognitive services to identify key characteristics of spontaneous ICSRs satisfying an acceptable level of accuracy determined by considering business requirements and effective use in a real-world setting. The results of this study will serve as supporting evidence for or against implementing augmented intelligence in case processing to increase operational efficiency and data quality consistency.MethodsA consortium of ten cognitive services to augment aspects of ICSR processing were identified and trained through deep-learning approaches. The input data for model training were 20,000 ICSRs received by Celgene drug safety over a 2-year period. The data were manually made machine-readable through the process of transcription, which converts images into text. The machine-readable documents were manually annotated for pharmacovigilance data elements to facilitate the training and testing of the cognitive services. Once trained by cognitive developers, the cognitive services’ output was reviewed by pharmacovigilance subject-matter experts against the accepted ground-truth for correctness and completeness. To be considered adequately trained and functional, each cognitive service was required to reach a threshold of F1 or accuracy score ≥ 75%.ResultsAll ten cognitive services under development have reached an evaluative score ≥ 75% for spontaneous ICSRs.ConclusionAll cognitive services under development have achieved the minimum evaluative threshold to be considered adequately trained, demonstrating how machine-learning and natural language processing techniques together provide accurate outputs that may augment pharmacovigilance professionals’ processing of spontaneous ICSRs quickly and accurately. The intention of augmented intelligence is not to replace the pharmacovigilance professional, but rather support them in their consistent decision-making so that they may better handle the overwhelming amount of data otherwise manually curated and monitored for ongoing drug surveillance requirements. Through this supported decision-making, pharmacovigilance professionals may have more time to apply their knowledge in assessing the case rather than spending it performing transactional tasks to simply capture the pertinent data within a safety database. By capturing data consistently and efficiently, we begin to build a corpus of data upon which analyses may be conducted and insights gleaned. Cognitive services may be key to an organization’s transformation to more proactive decision-making needed to meet regulatory requirements and enhance patient safety.

Will the future of pharmacovigilance be more automated?

Artificial intelligence in pharmacovigilance - Opportunities and challenges

Automation in pharmacovigilance: artificial intelligence and machine learning for patient safety

Artificial Intelligence in Pharmacovigilance: An Introduction to Terms, Concepts, Applications, and Limitations

Artificial Intelligence and the Future of the Drug Safety Professional

Artificial Intelligence Within Pharmacovigilance: A Means to Identify Cognitive Services and the Framework for Their Validation

Algorithmovigilance , lessons from pharmacovigilance

Transforming Pharmacovigilance Using Gen AI: Innovations in Aggregate Reporting, Signal Detection, and Safety Surveillance

Empowering Pharmacovigilance: Unleashing the Potential of Generative AI in Drug Safety Monitoring

Leveraging Generative AI for Drug Safety and Pharmacovigilance

Training Augmented Intelligent Capabilities for Pharmacovigilance: Applying Deep-learning Approaches to Individual Case Safety Report Processing

A review on artificial intelligence and machine learning used in pharmaceutical research

Safeguarding Patients in the AI Era: Ethics at the Forefront of Pharmacovigilance

The potential and pitfalls of artificial intelligence in clinical pharmacology

Pharmacovigilance and Biomedical Informatics: A Model for Future Development

Artificial Intelligence for Drug Toxicity and Safety

Using Machine Learning for Pharmacovigilance: A Systematic Review

Artificial intelligence integration in the drug lifecycle and in regulatory science: policy implications, challenges and opportunities

Artificial intelligence-powered pharmacovigilance: A review of machine and deep learning in clinical text-based adverse drug event detection for benchmark datasets

The evolution of the Pharmacovigilance department in the pharmaceutical industry: results of an Italian national survey

AI and the future of pharmaceutical research