MOL-MOE: Learning Drug Molecular Characterization Based on Mixture of Expert Mechanism

Xiang Zhang,Chenliang Qian,Jie Xia,Fan Yang
DOI: https://doi.org/10.1007/978-981-97-5131-0_20
2024-01-01
Abstract:Identifying new drugs with potential targets holds paramount significance in clinical medicine. Hence, the development of precise molecular property prediction methods to enable accurate drug screening is urgently needed to reduce the time and resource consumption associated with traditional experiments. In this article, we introduce a novel MOL-MOE model that leverages sparse and efficient modeling techniques to predict the properties of chemical molecules. Specifically, we incorporate the concept of a Mixture of Experts (MOE) to route atoms with distinct features to specific experts for processing, thereby enhancing the model’s feature induction capabilities within the domain. To mitigate overly unique atomic features, we utilize the cross-attention mechanism in the transformer to integrate correlation information between atoms and their surrounding functional groups. This enables comprehensive consideration of the local environmental information of molecules when selecting experts. Finally, our proposed method is used to screen drug molecules targeting dual-specificity tyrosine phosphorylation-regulated kinase 1A (DYRK1A), and in comparison to existing methods, MOL-MOE demonstrated superior performance, achieving an AUC of 0.866 and MCC of 0.578, thus substantiating the effectiveness of the proposed method.
What problem does this paper attempt to address?