Abstract:A striking contrast runs through the last 60 years of biopharmaceutical discovery, research, and development. Huge scientific and technological gains should have increased the quality of academic science and raised industrial R&D efficiency. However, academia faces a "reproducibility crisis"; inflation-adjusted industrial R&D costs per novel drug increased nearly 100 fold between 1950 and 2010; and drugs are more likely to fail in clinical development today than in the 1970s. The contrast is explicable only if powerful headwinds reversed the gains and/or if many "gains" have proved illusory. However, discussions of reproducibility and R&D productivity rarely address this point explicitly. The main objectives of the primary research in this paper are: (a) to provide quantitatively and historically plausible explanations of the contrast; and (b) identify factors to which R&D efficiency is sensitive. We present a quantitative decision-theoretic model of the R&D process. The model represents therapeutic candidates (e.g., putative drug targets, molecules in a screening library, etc.) within a "measurement space", with candidates' positions determined by their performance on a variety of assays (e.g., binding affinity, toxicity, in vivo efficacy, etc.) whose results correlate to a greater or lesser degree. We apply decision rules to segment the space, and assess the probability of correct R&D decisions. We find that when searching for rare positives (e.g., candidates that will successfully complete clinical development), changes in the predictive validity of screening and disease models that many people working in drug discovery would regard as small and/or unknowable (i.e., an 0.1 absolute change in correlation coefficient between model output and clinical outcomes in man) can offset large (e.g., 10 fold, even 100 fold) changes in models' brute-force efficiency. We also show how validity and reproducibility correlate across a population of simulated screening and disease models. We hypothesize that screening and disease models with high predictive validity are more likely to yield good answers and good treatments, so tend to render themselves and their diseases academically and commercially redundant. Perhaps there has also been too much enthusiasm for reductionist molecular models which have insufficient predictive validity. Thus we hypothesize that the average predictive validity of the stock of academically and industrially "interesting" screening and disease models has declined over time, with even small falls able to offset large gains in scientific knowledge and brute-force efficiency. The rate of creation of valid screening and disease models may be the major constraint on R&D productivity.

Economy of scales in R&D with block-busters

Scaling laws of strategic behaviour and size heterogeneity in agent dynamics

When Quality Beats Quantity: Decision Theory, Drug Discovery, and the Reproducibility Crisis

Economic returns of research: the Pareto law and its implications

The Dynamics of Book Sales: Endogenous versus Exogenous Shocks in Complex Networks

The Emergence of Heterogeneous Scaling in Research Institutions

Large-deviation theory of increasing returns

Big Pharma, little science? A bibliometric perspective on big pharma's R&D decline

Quantification of the evolution of firm size distributions due to mergers and acquisitions

Identifying Technology Spillovers and Product Market Rivalry

The Size Variance Relationship of Business Firm Growth Rates

Determination of Pareto exponents in economic models driven by Markov multiplicative processes

Large Deviations Theory of Increasing Returns

A simple model suggesting economically rational sample-size choice drives irreproducibility

Predicted and Verified Deviations from Zipf's law in Ecology of Competing Products

Scaling laws and a general theory for the growth of public companies

A transactional theory of fluctuations in company size

Measuring the efficiency of large pharmaceutical companies: an industry analysis

Empirical Methods for Dynamic Power Law Distributions in the Social Sciences

Statistical Properties of Business Firms Structure and Growth

Quantifying the Ease of Scientific Discovery