Abstract:Background: Few-shot learning (FSL) is a class of machine learning methods that require small numbers of labeled instances for training. With many medical topics having limited annotated text-based data in practical settings, FSL-based natural language processing (NLP) holds substantial promise. We aimed to conduct a review to explore the current state of FSL methods for medical NLP. Methods: We searched for articles published between January 2016 and October 2022 using PubMed/Medline, Embase, ACL Anthology, and IEEE Xplore Digital Library. We also searched the preprint servers (e.g., arXiv, medRxiv, and bioRxiv) via Google Scholar to identify the latest relevant methods. We included all articles that involved FSL and any form of medical text. We abstracted articles based on the data source, target task, training set size, primary method(s)/approach(es), and evaluation metric(s). Results: Fifty-one articles met our inclusion criteria-all published after 2018, and most since 2020 (42/51; 82%). Concept extraction/named entity recognition was the most frequently addressed task (21/51; 41%), followed by text classification (16/51; 31%). Thirty-two (61%) articles reconstructed existing datasets to fit few-shot scenarios, and MIMIC-III was the most frequently used dataset (10/51; 20%). 77% of the articles attempted to incorporate prior knowledge to augment the small datasets available for training. Common methods included FSL with attention mechanisms (20/51; 39%), prototypical networks (11/51; 22%), meta-learning (7/51; 14%), and prompt-based learning methods, the latter being particularly popular since 2021. Benchmarking experiments demonstrated relative underperformance of FSL methods on biomedical NLP tasks. Conclusion: Despite the potential for FSL in biomedical NLP, progress has been limited. This may be attributed to the rarity of specialized data, lack of standardized evaluation criteria, and the underperformance of FSL methods on biomedical topics. The creation of publicly-available specialized datasets for biomedical FSL may aid method development by facilitating comparative analyses.

A survey on machine learning from few samples

Learning from Very Few Samples: A Survey.

Generalizing from a Few Examples: A Survey on Few-Shot Learning

A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunities

A Survey of Few-Shot Learning: An Effective Method for Intrusion Detection

A survey on few-shot class-incremental learning

Toward Green and Human-Like Artificial Intelligence: A Complete Survey on Contemporary Few-Shot Learning Approaches

Few-shot learning for medical text: A review of advances, trends, and opportunities

Deep Learning for Cross-Domain Few-Shot Visual Recognition: A Survey

Towards Few-Shot Learning in the Open World: A Review and Beyond

Zero-shot and Few-shot Learning with Knowledge Graphs: A Comprehensive Survey

A Survey of Few-Shot Learning for Radio Frequency Fingerprint Identification

Learning with few samples in deep learning for image classification, a mini-review

Semantic-based Selection, Synthesis, and Supervision for Few-shot Learning

Learning from Few Examples: A Summary of Approaches to Few-Shot Learning

Few-shot learning for medical text: A systematic review

Few Samples Learning Based on Granular Neural Networks

A Survey of Learning on Small Data: Generalization, Optimization, and Challenge

FewJoint: A Few-shot Learning Benchmark for Joint Language Understanding