Abstract:In complex environments, overlapping leaves and uneven light can make pixels of leaf edges difficult to identify, resulting in a poor segmentation performance of the target leaf. In addition, the pixel ratio imbalance between the background area and the target area is the main reason that undermines the accuracy of spot extraction. To address these problems, a novel two-stage DeepLabv3+ with adaptive loss is proposed for the segmentation of apple leaf disease images in complex scenes. The proposed adaptive loss adds a modulation factor to the cross-entropy (CE) loss that can reduce the weight of losses generated by easily classified pixels. Therefore, it allows the model to focus more on hard-to-classify pixels during learning, thus improving segmentation accuracy. The novel two-stage model, consisting of Leaf-DeepLabv3+ and Disease-DeepLabv3+, is named LD-DeepLabv3+. In the first stage of the proposed model, Leaf-DeepLabv3+ is employed to extract the leaves from the complex environment. At this stage, the receptive field block (RFB) and the reverse attention (RA) module are introduced to improve the perception ability of the model for different sizes of blades and their edges. Then, the Disease-DeepLabv3+ is designed to segment disease spots from the erased background leaf images in the second stage of the proposed model. In the Disease-DeepLabv3+, the rates of the dilated convolution in atrous spatial pyramid pooling (ASPP) are adjusted to make it more suitable for extracting smaller targets, and the channel attention block (CAB) is introduced to highlight significant spot information and suppress unimportant information. The experimental results show that the proposed method, which combines LD-DeepLabv3+ with the adaptive loss, reaches 98.70% intersection over union (IoU) for leaf segmentation and 86.56% IoU for spot extraction. Compared with the two-stage model DUNet, the proposed method improves the segmentation accuracy of leaves and spots by 0.93% and 4.27%, respectively. Moreover, the total number of parameters and floating points of operations of the proposed method are only 16.96% and 18.25% of those of DUNet, respectively. Hence, the proposed method can provide an effective solution to extract leaves and disease spots in complex environments and has lower computational costs. This makes it suitable for deployment on mobile devices for applications in agriculture.

A novel labeling strategy to improve apple seedling segmentation using BlendMask for online grading

A Method of Apple Image Segmentation Based on Color-Texture Fusion Feature and Machine Learning

Real-Time Grading of Defect Apples Using Semantic Segmentation Combination with a Pruned YOLO V4 Network

Deep Learning Based Segmentation for Automated Training of Apple Trees on Trellis Wires

Apple detection and instance segmentation in natural environments using an improved Mask Scoring R-CNN Model

Fusion of Mask RCNN and Attention Mechanism for Instance Segmentation of Apples under Complex Background

A Method for Multi-Target Segmentation of Bud-Stage Apple Trees Based on Improved YOLOv8

DeepMDSCBA: an Improved Semantic Segmentation Model Based on DeepLabV3+ for Apple Images

Combining SUN-based Visual Attention Model and Saliency Contour Detection Algorithm for Apple Image Segmentation

Canopy Segmentation Using ResNet for Mechanical Harvesting of Apples

SE-Mask R-CNN: an Improved Mask R-CNN for Apple Detection and Segmentation

Segmentation of Foreground Apple Targets by Fusing Visual Attention Mechanism and Growth Rules of Seed Points

Multi-Feature Patch-Based Segmentation Technique in the Gray-Centered RGB Color Space for Improved Apple Target Recognition

A novel approach for apple leaf disease image segmentation in complex scenes based on two-stage DeepLabv3+ with adaptive loss

Apple Grading Based on Multi-Dimensional View Processing and Deep Learning

An Image Rendering-Based Identification Method for Apples with Different Growth Forms

Deep learning image segmentation and extraction of blueberry fruit traits associated with harvestability and yield

A Method of Segmenting Apples Based on Gray-Centered RGB Color Space

Early Identification and Localization Algorithm for Weak Seedlings Based on Phenotype Detection and Machine Learning

High-throughput instance segmentation and shape restoration of overlapping vegetable seeds based on sim2real method

Machine vision based segmentation algorithm for rice seedling