Abstract:A striking contrast runs through the last 60 years of biopharmaceutical discovery, research, and development. Huge scientific and technological gains should have increased the quality of academic science and raised industrial R&D efficiency. However, academia faces a "reproducibility crisis"; inflation-adjusted industrial R&D costs per novel drug increased nearly 100 fold between 1950 and 2010; and drugs are more likely to fail in clinical development today than in the 1970s. The contrast is explicable only if powerful headwinds reversed the gains and/or if many "gains" have proved illusory. However, discussions of reproducibility and R&D productivity rarely address this point explicitly. The main objectives of the primary research in this paper are: (a) to provide quantitatively and historically plausible explanations of the contrast; and (b) identify factors to which R&D efficiency is sensitive. We present a quantitative decision-theoretic model of the R&D process. The model represents therapeutic candidates (e.g., putative drug targets, molecules in a screening library, etc.) within a "measurement space", with candidates' positions determined by their performance on a variety of assays (e.g., binding affinity, toxicity, in vivo efficacy, etc.) whose results correlate to a greater or lesser degree. We apply decision rules to segment the space, and assess the probability of correct R&D decisions. We find that when searching for rare positives (e.g., candidates that will successfully complete clinical development), changes in the predictive validity of screening and disease models that many people working in drug discovery would regard as small and/or unknowable (i.e., an 0.1 absolute change in correlation coefficient between model output and clinical outcomes in man) can offset large (e.g., 10 fold, even 100 fold) changes in models' brute-force efficiency. We also show how validity and reproducibility correlate across a population of simulated screening and disease models. We hypothesize that screening and disease models with high predictive validity are more likely to yield good answers and good treatments, so tend to render themselves and their diseases academically and commercially redundant. Perhaps there has also been too much enthusiasm for reductionist molecular models which have insufficient predictive validity. Thus we hypothesize that the average predictive validity of the stock of academically and industrially "interesting" screening and disease models has declined over time, with even small falls able to offset large gains in scientific knowledge and brute-force efficiency. The rate of creation of valid screening and disease models may be the major constraint on R&D productivity.

Impact of a five-dimensional framework on R&D productivity at AstraZeneca

How to improve R&D productivity: the pharmaceutical industry's grand challenge

The endless frontier? The recent increase of R&D productivity in pharmaceuticals

When R&D Spending Is Not Enough: The Critical Role Of Culture When You Really Want To Innovate

Changing R&D models in research-based pharmaceutical companies

R&D implementation in a department of laboratory medicine and pathology: a systematic review based on pharmaceutical companies

A Conceptual Framework for Ranking R&D Projects

Analysis of pharma R&D productivity - a new perspective needed

Optimizing the R&D Process Using Spin-Outs: Case Studies from the Pharmaceutical Industry

When Quality Beats Quantity: Decision Theory, Drug Discovery, and the Reproducibility Crisis

Big Pharma, little science? A bibliometric perspective on big pharma's R&D decline

P.O.L.A.R. Star: A New Framework Developed and Applied by One Mid-Sized Pharmaceutical Company to Drive Digital Transformation in R&D

Measuring R&D Effectiveness—I

Can adaptive clinical trials help to solve the productivity crisis of the pharmaceutical industry? - a scenario analysis

The Value of Improving the Productivity of the Drug Development Process

Determinants of radical drug innovation: a systematic literature review

Managing innovation performance: Results from an industry‐spanning explorative study on R&D key measures

Efficiency, effectiveness and productivity in pharmaceutical R&D

Key productivity factors in drug discovery and development projects

Exploring open source as a strategy to enhance R&D productivity

Risk-based decision framework based on R-numbers and best-worst method and its application to research and development project selection