Abstract:Three-dimensional (3D) deep molecular generative models offer the advantage of goal-directed generation based on 3D-dependent properties, such as binding affinity for structure-based design within binding pockets. Traditional benchmarks created to evaluate SMILES or molecular graphs generators, such as GuacaMol or MOSES, are limited to evaluate 3D generators as they do not assess the quality of the generated molecular conformation. In this work, we hence developed GenBench3D, which implements a new benchmark for models producing molecules within a binding pocket. Our main contribution is the Validity3D metric, evaluating the conformation quality using the likelihood of bond lengths and valence angles based on reference values observed in the Cambridge Structural Database. The LiGAN, 3D-SBDD, Pocket2Mol, TargetDiff, DiffSBDD and ResGen models were benchmarked. We show that only between 0% and 11% of generated molecules have valid conformations. Performing local relaxation of generated molecules in the pocket considerably improved the Validity3D for all models by a minimum increase of 40%. For LiGAN, 3D-SBDD, or TargetDiff, the set of valid relaxed molecules shows on average higher Vina score (i.e. worse) than the set of raw generated molecules, indicating that the binding affinity of raw generated molecules might be overestimated. Using the other scoring functions, that give higher importance to ligand strain, only yield improved scores when using valid relaxed molecules. Using valid relaxed molecules, TargetDiff and Pocket2Mol show better median Vina, Glide and Gold PLP scores than other models. We have publicly released GenBench3D on GitHub for broader use: <a class="link-external link-https" href="https://github.com/bbaillif/genbench3d" rel="external noopener nofollow">this https URL</a>

How good are current pocket based 3D generative models? : The benchmark set and evaluation of protein pocket based 3D molecular generative models

How good are current pocket based 3D generative models? : The benchmark set and evaluation on protein pocket based 3D molecular generative models

Pocket2Mol: Efficient Molecular Sampling Based on 3D Protein Pockets.

ProteinInvBench: Benchmarking Protein Inverse Folding on Diverse Tasks, Models, and Metrics.

Benchmarking structure-based three-dimensional molecular generative models using GenBench3D: ligand conformation quality matters

Advances in Deep Learning-Based 3D Molecular Generative Models

Efficient Generation of Protein Pockets with PocketGen

A pocket-based 3D molecule generative model fueled by experimental electron density

In-Pocket 3D Graphs Enhance Ligand-Target Compatibility in Generative Small-Molecule Creation

Generalized Protein Pocket Generation with Prior-Informed Flow Matching

PocketFlow is a data-and-knowledge-driven structure-based molecular generative model

Benchmarking Generated Poses: How Rational is Structure-based Drug Design with Generative Models?

Towards Robust Evaluation of Protein Generative Models: A Systematic Analysis of Metrics

ResGen is a pocket-aware 3D molecular generation model based on parallel multiscale modelling

Pocket-specific 3D Molecule Generation by Fragment-based Autoregressive Diffusion Models

3D Molecular Pocket-based Generation with Token-only Large Language Model

Learning Subpocket Prototypes for Generalizable Structure-based Drug Design

Interface-aware molecular generative framework for protein-protein interaction modulators

A biologically-inspired multi-modal evaluation of molecular generative machine learning

PIDiff: Physics informed diffusion model for protein pocket-specific 3D molecular generation

Generation of 3D molecules in pockets via a language model