Abstract:When monitoring crop growth using top-down images of the plant canopies, leaves in agricultural fields appear very dense and significantly overlap each other. Moreover, the image can be affected by external conditions such as background environment and light intensity, impacting the effectiveness of image segmentation. To address the challenge of segmenting dense and overlapping plant leaves under natural lighting conditions, this study employed a Bilayer Convolutional Network (BCNet) method for accurate leaf segmentation across various lighting environments. The major contributions of this study are as follows: (1) Utilized Fully Convolutional Object Detection (FCOS) for plant leaf detection, incorporating ResNet-50 with the Convolutional Block Attention Module (CBAM) and Feature Pyramid Network (FPN) to enhance Region of Interest (RoI) feature extraction from canopy top-view images. (2) Extracted the sub-region of the RoI based on the position of the detection box, using this region as input for the BCNet, ensuring precise segmentation. (3) Utilized instance segmentation of canopy top-view images using BCNet, improving segmentation accuracy. (4) Applied the Varifocal Loss Function to improve the classification loss function in FCOS, leading to better performance metrics. The experimental results on cucumber canopy top-view images captured in glass greenhouse and plastic greenhouse environments show that our method is highly effective. For cucumber leaves at different growth stages and under various lighting conditions, the Precision, Recall and Average Precision (AP) metrics for object recognition are 97%, 94% and 96.57%, respectively. For instance segmentation, the Precision, Recall and Average Precision (AP) metrics are 87%, 83% and 84.71%, respectively. Our algorithm outperforms commonly used deep learning algorithms such as Faster R-CNN, Mask R-CNN, YOLOv4 and PANet, showcasing its superior capability in complex agricultural settings. The results of this study demonstrate the potential of our method for accurate recognition and segmentation of highly overlapping leaves in diverse agricultural environments, significantly contributing to the application of deep learning algorithms in smart agriculture.

PLANT LEAF SEGMENTATION USING A REFINED FULLY CONVOLUTIONAL NETWORK

Multi-Scale and Multi-Branch Convolutional Neural Network for Retinal Image Segmentation

An Approach for Plant Leaf Image Segmentation Based on YOLOV8 and the Improved DEEPLABV3

Method of plant leaf recognition based on improved deep convolutional neural network.

Cucumber Leaf Segmentation Based on Bilayer Convolutional Network

Leaf Segmentation Using Modified YOLOv8-Seg Models

Image Segmentation of Liver CT Based on Fully Convolutional Network.

Local refinement mechanism for improved plant leaf segmentation in cluttered backgrounds

Improved Image Segmentation Algorithms based on Convolutional Neural Networks

Automated and accurate segmentation of leaf venation networks via deep learning

Instance Segmentation and Classification Method for Plant Leaf Images Based on ISC-MRCNN and APS-DCCNN

A Leaf Vein Extraction Method Based On Snakes Technique

Convolutional Neural Network Application On Leaf Classification

Plant Leaf Identification Via A Growing Convolution Neural Network With Progressive Sample Learning

Accurate Recognition Method of Plant Leaves Based on Multi-Feature Fusion

Leaf Classification Utilizing A Convolutional Neural Network With A Structure Of Single Connected Layer

Plant Leaf Recognition Based On Small Datasets Using Deep Learning Algorithm

Leaf Segmentation and Classification with a Complicated Background Using Deep Learning

Segmentation of Leaf Images Based on the Active Contours

A Multiscale Fusion Convolutional Neural Network for Plant Leaf Recognition

PlantNet: A dual-function point cloud segmentation network for multiple plant species