Fine-tuning BERT-based models for Plant Health Bulletin Classification

Shufan Jiang,Rafael Angarita,Stephane Cormier,Francis Rousseaux
DOI: https://doi.org/10.48550/arXiv.2102.00838
2021-01-29
Abstract:In the era of digitization, different actors in agriculture produce numerous data. Such data contains already latent historical knowledge in the domain. This knowledge enables us to precisely study natural hazards within global or local aspects, and then improve the risk prevention tasks and augment the yield, which helps to tackle the challenge of growing population and changing alimentary habits. In particular, French Plants Health Bulletins (BSV, for its name in French Bulletin de Sant{é} du V{é}g{é}tal) give information about the development stages of phytosanitary risks in agricultural production. However, they are written in natural language, thus, machines and human cannot exploit them as efficiently as it could be. Natural language processing (NLP) technologies aim to automatically process and analyze large amounts of natural language data. Since the 2010s, with the increases in computational power and parallelization, representation learning and deep learning methods became widespread in NLP. Recent advancements Bidirectional Encoder Representations from Transformers (BERT) inspire us to rethink of knowledge representation and natural language understanding in plant health management domain. The goal in this work is to propose a BERT-based approach to automatically classify the BSV to make their data easily indexable. We sampled 200 BSV to finetune the pretrained BERT language models and classify them as pest or/and disease and we show preliminary results.
Computation and Language
What problem does this paper attempt to address?
The problem this paper attempts to address is: how to use BERT-based deep learning models to automatically classify French plant health bulletins (Bulletin de Santé du Végétal, BSV) in order to manage and utilize the information in these bulletins more effectively. Specifically, the goals of the paper include: 1. **Improve data searchability**: By automatically classifying BSV, making its data easier to index and retrieve. 2. **Enhance risk prevention tasks**: By classifying BSV, better understanding and predicting plant health risks, thereby improving the efficiency and safety of agricultural production. 3. **Reduce the need for manual annotation**: Using natural language processing techniques to reduce reliance on manual annotation, increasing the automation of information extraction. The paper mentions that existing methods like PestObserver, although capable of partially classifying BSV, have issues such as incomplete labels, reliance on manual annotation, and rule definition. Therefore, the authors hope to improve these shortcomings by introducing the BERT model to achieve more efficient and accurate text classification.