A survey of machine learning techniques in medical applications

M. Keramy,K. Jahanian,R. Sani,A. Agha,I. Dehzangy,M. Yan,H. Rokni

2024-07-30

Abstract:In recent years, machine learning (ML) has emerged as a powerful tool for solving a wide range of problems, including medical decision-making. The exponential growth of medical data over the past two decades has surpassed the capacity for manual analysis, prompting increased interest in automated data analysis and processing. ML algorithms, capable of learning from data with minimal human intervention, are particularly well-suited for medical data analysis and interpretation. One significant advantage of ML is the reduced cost of collecting labeled training data necessary for supervised learning. While numerous studies have explored the applications of ML in medicine, this survey specifically focuses on the use of ML across various medical research fields. We provide a comprehensive technical overview of existing studies on ML applications in medicine, highlighting the strengths and limitations of these approaches. Additionally, we discuss potential research directions for future exploration. These include the development of more sophisticated reward functions, as the accuracy of the reward function is crucial for ML performance, the integration of ML with other techniques, and the application of ML to new and emerging areas in genomics research. Finally, we summarize our findings and present the current state of the field and the future outlook for ML in medical application.

Genomics,Artificial Intelligence,Machine Learning,Quantitative Methods

What problem does this paper attempt to address?

The main problem this paper attempts to address is the various challenges and applications of machine learning (particularly reinforcement learning) in medical applications. Specifically:

1. **Applications of Reinforcement Learning in Genomics**:
- The paper highlights various applications of reinforcement learning in genomics research, including gene regulatory network (GRNs) modeling, genome assembly, sequence alignment, etc. The application of reinforcement learning in this field aims to improve the efficiency and accuracy of data analysis through automation and optimization methods.

2. **Control of Gene Regulatory Networks (GRNs)**:
- In GRNs, reinforcement learning is used to control gene expression states to achieve specific biological goals. For example, adjusting gene expression levels to treat diseases. The paper discusses different methods in detail, such as dynamic programming, Q-learning, Fitted Q Iteration (FQI), etc., and compares their performance in different scenarios.

3. **Sequence Alignment and Rearrangement**:
- For the alignment of DNA, RNA, or protein sequences, the paper proposes some deep reinforcement learning-based methods (such as DQNalign), which can outperform traditional algorithms when sequence similarity is below 80%.

4. **Future Research Directions**:
- The paper also explores future development directions of reinforcement learning in medical applications, including the development of more complex reward functions, integration with other technologies, and applications in new fields of genomics.

In summary, this paper aims to provide a comprehensive overview of the current status and potential applications of reinforcement learning in medical data processing and analysis, emphasizing its important role in genomics research and pointing out possible future research paths.