Meta-analysis of permeability literature data shows possibilities and limitations of popular methods

Karel Berka,Kateřina Storchmannová,Martin Balouch,Jakub Juračka,František Štěpánek
DOI: https://doi.org/10.26434/chemrxiv-2024-ndc8k-v2
2024-08-30
Abstract:Permeability is an important molecular property in drug discovery, as it co-determines pharmacokinetics whenever a drug crosses the phospholipid bilayer, e.g., into the cell, in the gastrointestinal tract or across the blood-brain barrier. Many methods for the determination of permeability have been developed, including cell line assays, cell-free model systems like PAMPA mimicking, e.g., gastrointestinal epithelia or the skin, as well as the Black lipid membrane (BLM) and sub-micrometer liposomes. Furthermore, many in silico approaches have been developed for permeability prediction. Meta-analysis of publicly available databases for permeability data (MolMeDB and ChEMBL) was performed to establish their usability. Firstly, experimental data can only be measured between thresholds for the lowest and highest permeation rate obtainable within physical boundaries. These thresholds vary strongly between methods. Secondly, computed data do not obey these thresholds but, on the other hand, can produce incorrect results. Thirdly, even for the same method and molecule, there is often a strong discrepancy between individual measured values. These differences are based not only on the statistics but also on the varying approaches and evaluation of the measured data. Thus, when working with in-house measured or published permeability data, we recommend to be cautious with their interpretation.
Chemistry
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is to evaluate and compare the effectiveness and limitations of different permeability measurement methods, especially in the study of molecular passive permeability during the drug discovery process. Specifically, the paper focuses on the following aspects: 1. **Comparison and Interpretation of Methods**: Through the method of meta - analysis, the paper compares the performance of four experimental methods (PAMPA, CACO - 2, MDCK, BLM/Liposomes) and two computational methods (PerMM and COSMOperm) in measuring molecular permeability. The purpose is to understand the correlations among these methods, as well as their reliability and limitations in practical applications. 2. **Reproducibility and Consistency of Data**: The paper analyzes the reproducibility and consistency of different methods when measuring the same molecule, and explores the causes of data variation, such as differences in experimental conditions and irregular data reporting. 3. **Scope of Application and Limitations of Methods**: The paper discusses the physical and chemical limitations of each method, such as the measurement range and diffusion limitations of different methods, and points out the issues that need to be noted when using these methods. 4. **Standardization and Integration of Data**: The paper proposes how to standardize and integrate data among different methods, so as to make better use of the existing permeability data and improve the efficiency of drug research and development. ### Specific Problem Analysis - **Comparison of Methods**: - The paper shows the correlations among different methods by calculating the correlation coefficients (such as \( R^2 \)) between different methods. For example, the correlation between CACO - 2 and MDCK is very strong (\( R^2=0.82 \)), while the correlation between CACO - 2 and intrinsic PAMPA is relatively weak (\( R^2 = 0.03 \)). - The author also quantifies the differences among different methods by calculating the mean absolute error (MAE), further verifying the reliability and limitations of these methods. - **Reproducibility and Consistency of Data**: - The paper analyzes the multiple measurement results of several common molecules in the PAMPA method, and finds that even for the same method, the measurement results in different laboratories or at different time points may also have large differences. - The author emphasizes the importance of distinguishing between apparent permeability and intrinsic permeability, because these two permeabilities may differ by several orders of magnitude in numerical value. - **Scope of Application and Limitations of Methods**: - The paper points out that different methods have different measurement ranges and physical limitations. For example, the PAMPA method is affected by diffusion limitations, while the BLM method is not. - The author also discusses the advantages and limitations of computational methods (such as PerMM and COSMOperm). These methods can predict the intrinsic permeability of molecules, but they need high - quality experimental data for verification. - **Standardization and Integration of Data**: - The paper suggests that when using permeability data, the source, experimental conditions and measurement methods of the data should be clearly reported, so that other researchers can better understand and use these data. - The author also proposes some methods for data standardization, such as calculating the mean and median to reduce data variation. In conclusion, through the systematic comparison and analysis of multiple permeability measurement methods, this paper aims to provide more reliable permeability data and more effective research tools for researchers in the field of drug research and development.