PrescDRL: deep reinforcement learning for herbal prescription planning in treatment of chronic diseases

Kuo Yang,Zecong Yu,Xin Su,Fengjin Zhang,Xiong He,Ning Wang,Qiguang Zheng,Feidie Yu,Tiancai Wen,Xuezhong Zhou
DOI: https://doi.org/10.1186/s13020-024-01005-w
IF: 4.546
2024-10-17
Chinese Medicine
Abstract:Treatment planning for chronic diseases is a critical task in medical artificial intelligence, particularly in traditional Chinese medicine (TCM). However, generating optimized sequential treatment strategies for patients with chronic diseases in different clinical encounters remains a challenging issue that requires further exploration. In this study, we proposed a TCM herbal prescription planning framework based on deep reinforcement learning for chronic disease treatment (PrescDRL). PrescDRL is a sequential herbal prescription optimization model that focuses on long-term effectiveness rather than achieving maximum reward at every step, thereby ensuring better patient outcomes. We constructed a high-quality benchmark dataset for sequential diagnosis and treatment of diabetes and evaluated PrescDRL against this benchmark. Our results showed that PrescDRL achieved a higher curative effect, with the single-step reward improving by 117% and 153% compared to doctors. Furthermore, PrescDRL outperformed the benchmark in prescription prediction, with precision improving by 40.5% and recall improving by 63%. Overall, our study demonstrates the potential of using artificial intelligence to improve clinical intelligent diagnosis and treatment in TCM.
pharmacology & pharmacy,integrative & complementary medicine
What problem does this paper attempt to address?