Abstract:With the rapid progress in Natural Language Processing (NLP), Pre-trained Language Models (PLM) such as BERT, BioBERT, and ChatGPT have shown great potential in various medical NLP tasks. This paper surveys the cutting-edge achievements in applying PLMs to various medical NLP tasks. Specifically, we first brief PLMS and outline the research of PLMs in medicine. Next, we categorise and discuss the types of tasks in medical NLP, covering text summarisation, question-answering, machine translation, sentiment analysis, named entity recognition, information extraction, medical education, relation extraction, and text mining. For each type of task, we first provide an overview of the basic concepts, the main methodologies, the advantages of applying PLMs, the basic steps of applying PLMs application, the datasets for training and testing, and the metrics for task evaluation. Subsequently, a summary of recent important research findings is presented, analysing their motivations, strengths vs weaknesses, similarities vs differences, and discussing potential limitations. Also, we assess the quality and influence of the research reviewed in this paper by comparing the citation count of the papers reviewed and the reputation and impact of the conferences and journals where they are published. Through these indicators, we further identify the most concerned research topics currently. Finally, we look forward to future research directions, including enhancing models' reliability, explainability, and fairness, to promote the application of PLMs in clinical practice. In addition, this survey also collect some download links of some model codes and the relevant datasets, which are valuable references for researchers applying NLP techniques in medicine and medical professionals seeking to enhance their expertise and healthcare service through AI technology.

A Survey of Sentiment Analysis Based on Pretrained Language Models.

Sentiment Analysis in the Era of Large Language Models: A Reality Check

Sentiment Analysis: Comprehensive Reviews, Recent Advances, and Open Challenges

Sentiment-Aware Word and Sentence Level Pre-training for Sentiment Analysis

The Model Arena for Cross-lingual Sentiment Analysis: A Comparative Study in the Era of Large Language Models

A Survey of Sentiment Analysis: Approaches, Datasets, and Future Research

Survey of sentiment classification

A Language Modeling Approach to Sentiment Analysis

A Comparative Study of Different Pre-trained Language Models for Sentiment Analysis of Human-Computer Negotiation Dialogue

A Survey of Cross-lingual Sentiment Analysis: Methodologies, Models and Evaluations

Do Large Language Models Possess Sensitive to Sentiment?

Pre-trained Large Language Models for Financial Sentiment Analysis

AB-LaBSE: Uyghur Sentiment Analysis Via the Pre-Training Model with BiLSTM

The Biases of Pre-Trained Language Models: An Empirical Study on Prompt-Based Sentiment Analysis and Emotion Detection

Large Language Models Meet Text-Centric Multimodal Sentiment Analysis: A Survey

A Survey of Sentiment Analysis Based on Machine Learning

Pre-trained language models in medicine: A survey

Exploring Sentiment Analysis Techniques in Natural Language Processing: A Comprehensive Review

Comprehensive Study on Sentiment Analysis: From Rule-based to modern LLM based system

SentiLR: Linguistic Knowledge Enhanced Language Representation for Sentiment Analysis

A Survey of Sentiment Analysis Based on Deep Learning