Abstract:The literature has witnessed the success of leveraging Pre-trained Language Models (PLMs) and Transfer Learning (TL) algorithms to a wide range of Natural Language Processing (NLP) applications, yet it is not easy to build an easy-to-use and scalable TL toolkit for this purpose. To bridge this gap, the EasyTransfer platform is designed to develop deep TL algorithms for NLP applications. EasyTransfer is backended with a high-performance and scalable engine for efficient training and inference, and also integrates comprehensive deep TL algorithms, to make the development of industrial-scale TL applications easier. In EasyTransfer, the built-in data and model parallelism strategies, combined with AI compiler optimization, show to be 4.0x faster than the community version of distributed training. EasyTransfer supports various NLP models in the ModelZoo, including mainstream PLMs and multi-modality models. It also features various in-house developed TL algorithms, together with the AppZoo for NLP applications. The toolkit is convenient for users to quickly start model training, evaluation, and online deployment. EasyTransfer is currently deployed at Alibaba to support a variety of business scenarios, including item recommendation, personalized search, conversational question answering, etc. Extensive experiments on real-world datasets and online applications show that EasyTransfer is suitable for online production with cutting-edge performance for various applications. The source code of EasyTransfer is released at Github (<a class="link-external link-https" href="https://github.com/alibaba/EasyTransfer" rel="external noopener nofollow">this https URL</a>).

EasyNLP: A Comprehensive and Easy-to-use Toolkit for Natural Language Processing

EasyTransfer -- A Simple and Scalable Deep Transfer Learning Platform for NLP Applications

N-LTP: A Open-source Neural Chinese Language Technology Platform with Pretrained Models.

N-LTP: an Open-source Neural Language Technology Platform for Chinese

EduNLP: Towards a Unified and Modularized Library for Educational Resources

LibN3L: A Lightweight Package for Neural NLP.

HugNLP: A Unified and Comprehensive Library for Natural Language Processing

FudanNLP: A Toolkit for Chinese Natural Language Processing.

YATO: Yet Another deep learning based Text analysis Open toolkit

OpenUE: an Open Toolkit of Universal Extraction from Text

Deep Learning and Machine Learning -- Natural Language Processing: From Theory to Application

FudanNLP: A Toolkit for Chinese Natural Language Processing with Online Learning Algorithms

CMULAB: An Open-Source Framework for Training and Deployment of Natural Language Processing Models

NLP Workbench: Efficient and Extensible Integration of State-of-the-art Text Mining Tools

Light Pre-Trained Chinese Language Model for NLP Tasks.

EasyEdit: An Easy-to-use Knowledge Editing Framework for Large Language Models

When Few-Shot Learning Meets Large-Scale Knowledge-Enhanced Pre-training: Alibaba at FewCLUE

Fasthan: A BERT-based Joint Many-Task Toolkit for Chinese NLP

DataLab: A Unified Platform for LLM-Powered Business Intelligence

DeepKE: A Deep Learning Based Knowledge Extraction Toolkit for Knowledge Base Population

ELIT: Emory Language and Information Toolkit