Abstract:Tomato leaf disease control in the field of smart agriculture urgently requires attention and reinforcement. This paper proposes a method called LAFANet for image-text retrieval, which integrates image and text information for joint analysis of multimodal data, helping agricultural practitioners to provide more comprehensive and in-depth diagnostic evidence to ensure the quality and yield of tomatoes. First, we focus on six common tomato leaf disease images and text descriptions, creating a Tomato Leaf Disease Image-Text Retrieval Dataset (TLDITRD), introducing image-text retrieval into the field of tomato leaf disease retrieval. Then, utilizing ViT and BERT models, we extract detailed image features and sequences of textual features, incorporating contextual information from image-text pairs. To address errors in image-text retrieval caused by complex backgrounds, we propose Learnable Fusion Attention (LFA) to amplify the fusion of textual and image features, thereby extracting substantial semantic insights from both modalities. To delve further into the semantic connections across various modalities, we propose a False Negative Elimination-Adversarial Negative Selection (FNE-ANS) approach. This method aims to identify adversarial negative instances that specifically target false negatives within the triplet function, thereby imposing constraints on the model. To bolster the model's capacity for generalization and precision, we propose Adversarial Regularization (AR). This approach involves incorporating adversarial perturbations during model training, thereby fortifying its resilience and adaptability to slight variations in input data. Experimental results show that, compared with existing ultramodern models, LAFANet outperformed existing models on TLDITRD dataset, with top1, top5, and top10 reaching 83.3% and 90.0%, and top1, top5, and top10 reaching 80.3%, 93.7%, and 96.3%. LAFANet offers fresh technical backing and algorithmic insights for the retrieval of tomato leaf disease through image-text correlation.

DISCRIMINATING LEAVES AFFECTED WITH TOMATO YELLOW LEAF CURL THROUGH FLUORESCENCE IMAGING USING TEXTURE AND LEAF VEIN FEATURES

Diseased leaves using texture and leaf vein features in fluorescence image

Early Detection and Classification of Tobacco Leaves Inoculated with Tobacco Mosaic Virus Based on Hyperspectral Imaging Technique

Discrimination of Tomato Yellow Leaf Curl Disease Using Hyperspectral Imaging

Monoclonal Antibodies Against the Whitefly-Transmitted Tomato Yellow Leaf Curl Virus and Their Application in Virus Detection

Detection of early blight and late blight diseases on tomato leaves using hyperspectral imaging

Laboratory and UAV-Based Identification and Classification of Tomato Yellow Leaf Curl, Bacterial Spot, and Target Spot Diseases in Tomato Utilizing Hyperspectral Imaging and Machine Learning

Tomato Leaf Diseases Classification Based on Leaf Images: A Comparison between Classical Machine Learning and Deep Learning Methods

Application of Multispectral Reflectance for Early Detection of Tomato Disease

Study on the Early Detection of Early Blight on Tomato Leaves Using Hyperspectral Imaging Technique Based on Spectroscopy and Texture

Hyperspectral Imaging for Classification of Healthy and Gray Mold Diseased Tomato Leaves with Different Infection Severities

High-Accuracy Tomato Leaf Disease Image-Text Retrieval Method Utilizing LAFANet

Research on Distinguishing Tomato Seedling Infected with Early Blight Disease by Electronic Nose

Diagnosis of corn leaf diseases by FTIR spectroscopy combined with machine learning

Identification of early blight disease degree of tomato leaf using spectral reflectance

A Precise Image-Based Tomato Leaf Disease Detection Approach Using PLPNet

Discrimination of Different Types Damage of Tomato Seedling by Electronic Nose

An Effective Integrated Machine Learning Framework for Identifying Severity of Tomato Yellow Leaf Curl Virus and Their Experimental Validation

Classification of tomato leaf images for detection of plant disease using conformable polynomials image features

Image processing based system for the detection, identification and treatment of tomato leaf diseases.

Early detection and spectral signature identification of tomato fungal diseases (Alternaria alternata, Alternaria solani, Botrytis cinerea, and Fusarium oxysporum) by RGB and hyperspectral image analysis and machine learning