Plant Leaf Disease Identification by Parameter-Efficient Transformer with Adapter

Xingshi Xu,Guangyuan Yang,Yunfei Wang,Yuying Shang,Zhixin Hua,Zheng Wang,Huaibo Song
DOI: https://doi.org/10.1016/j.engappai.2024.109466
2024-01-01
Abstract:Accurate identification of plant disease is of crucial importance for agricultural production. Existing research often tailor dedicated leaf disease recognition models for each plant species to achieve superior recognition accuracy and robustness. However, these approaches are labour-intensive and time-consuming. In addition, when integrating multiple models on a single device, numerous model parameters need to be stored. To address the aforementioned problems, a model named PDNet was designed for the identification of plant leaf disease, advancing the concept of using the same network with almost the same weights for different plant species. First, an Adapter block was utilized to implement a parameter-efficient training. The proposed method could add only 1.39% additional parameters when developing a new model for a specific leaf disease identification task, significantly outperforming the existing 100% fully fine-tuned models. Moreover, to enhance the identification accuracy, Overlapping patch embedding (OPE) was introduced into PDNet to avoid the destruction of essential information on plant leaves. Subsequently, Angular Softmax Loss (A-Softmax Loss) was employed to achieve finegrained recognition of similar diseases. The proposed method on six plant disease datasets achieved the identification accuracies of 95.16%, 96.74%, 98.26%, 91.16%, 98.67% and 99.58%, respectively. It demonstrated excellent performance under Few-Shot conditions. The recognition accuracy remained above 75% with only three training samples for each disease. This study provides a novel method and paradigm for plant leaf disease identification, offering valuable insights for the field.
What problem does this paper attempt to address?