Chili Pepper Disease Diagnosis via Image Reconstruction Using GrabCut and Generative Adversarial Serial Autoencoder

Jongwook Si,Sungyoung Kim
2023-06-21
Abstract:With the recent development of smart farms, researchers are very interested in such fields. In particular, the field of disease diagnosis is the most important factor. Disease diagnosis belongs to the field of anomaly detection and aims to distinguish whether plants or fruits are normal or abnormal. The problem can be solved by binary or multi-classification based on CNN, but it can also be solved by image reconstruction. However, due to the limitation of the performance of image generation, SOTA's methods propose a score calculation method using a latent vector error. In this paper, we propose a network that focuses on chili peppers and proceeds with background removal through Grabcut. It shows high performance through image-based score calculation method. Due to the difficulty of reconstructing the input image, the difference between the input and output images is large. However, the serial autoencoder proposed in this paper uses the difference between the two fake images except for the actual input as a score. We propose a method of generating meaningful images using the GAN structure and classifying three results simultaneously by one discriminator. The proposed method showed higher performance than previous researches, and image-based scores showed the best performanc
Computer Vision and Pattern Recognition,Image and Video Processing
What problem does this paper attempt to address?
### Problems Addressed by the Paper The paper aims to address the issue of diagnosing pepper diseases. Specifically, the goal of the paper is to use computer vision technology to inspect the state of crops (particularly peppers) to distinguish whether they are diseased. #### Main Contributions: 1. **Proposed a new GAN-based framework**: Detecting crop anomalies through errors in image reconstruction. 2. **New method of serial autoencoders**: Diagnosing normal and diseased states through two reconstructed images, with performance surpassing previous studies. 3. **Application of background removal technology**: Using the Grabcut algorithm in the field of image processing to remove the background of pepper images, reducing misclassification results. ### Method Overview 1. **Preprocessing**: Using the Grabcut algorithm to remove the background of pepper images. 2. **Generative Adversarial Network (GAN) structure**: Including two serially connected autoencoders as the generator and a discriminator to distinguish between real input images and generated images. 3. **Loss function design**: Including adversarial loss, reconstruction loss, and latent loss to optimize the performance of the entire framework. 4. **Testing phase**: Judging whether the input image is normal or diseased by calculating the difference score between the generated images. ### Experimental Results 1. **Dataset**: Using the "Outdoor Crop Disease Diagnosis Image" dataset provided by AIHub, containing only pepper-related data. 2. **Performance evaluation**: Demonstrating significant performance improvement on normal and diseased images by comparing the F1 scores of different methods (such as CAE, Ganomaly, etc.). 3. **Ablation study**: Analyzing the effects of different score calculation methods, verifying the effectiveness of serial autoencoders and the image error method.