Abstract:When monitoring crop growth using top-down images of the plant canopies, leaves in agricultural fields appear very dense and significantly overlap each other. Moreover, the image can be affected by external conditions such as background environment and light intensity, impacting the effectiveness of image segmentation. To address the challenge of segmenting dense and overlapping plant leaves under natural lighting conditions, this study employed a Bilayer Convolutional Network (BCNet) method for accurate leaf segmentation across various lighting environments. The major contributions of this study are as follows: (1) Utilized Fully Convolutional Object Detection (FCOS) for plant leaf detection, incorporating ResNet-50 with the Convolutional Block Attention Module (CBAM) and Feature Pyramid Network (FPN) to enhance Region of Interest (RoI) feature extraction from canopy top-view images. (2) Extracted the sub-region of the RoI based on the position of the detection box, using this region as input for the BCNet, ensuring precise segmentation. (3) Utilized instance segmentation of canopy top-view images using BCNet, improving segmentation accuracy. (4) Applied the Varifocal Loss Function to improve the classification loss function in FCOS, leading to better performance metrics. The experimental results on cucumber canopy top-view images captured in glass greenhouse and plastic greenhouse environments show that our method is highly effective. For cucumber leaves at different growth stages and under various lighting conditions, the Precision, Recall and Average Precision (AP) metrics for object recognition are 97%, 94% and 96.57%, respectively. For instance segmentation, the Precision, Recall and Average Precision (AP) metrics are 87%, 83% and 84.71%, respectively. Our algorithm outperforms commonly used deep learning algorithms such as Faster R-CNN, Mask R-CNN, YOLOv4 and PANet, showcasing its superior capability in complex agricultural settings. The results of this study demonstrate the potential of our method for accurate recognition and segmentation of highly overlapping leaves in diverse agricultural environments, significantly contributing to the application of deep learning algorithms in smart agriculture.

Crop Extraction Based on Ultra-Simple Neural Network Modeling in the Normalized Rgb and CIE Lab* Color Spaces

Cropnet: Deep Spatial-Temporal-Spectral Feature Learning Network for Crop Classification from Time-Series Multi-Spectral Images

Crop Segmentation from Images by Morphology Modeling in the CIE Lab* Color Space

A Novel Denoising Autoencoder Assisted Segmentation Algorithm for Cotton Field

Rethinking the Crop Row Detection Pipeline: an End-to-end Method for Crop Row Detection Based on Row-Column Attention

Multiclass Crop Interpretation Via a Lightweight Attentive Feature Fusion Network Using Vehicle-view Images

Region-based Colour Modelling for Joint Crop and Maize Tassel Segmentation

InstaCropNet: an Efficient Unet-Based Architecture for Precise Crop Row Detection in Agricultural Applications

Accurate Crop Row Recognition of Maize at the Seedling Stage Using Lightweight Network

Crop Classification Based On Lightened Convolutional Neural Networks In Multispectral Images

Crop Segmentation of Unmanned Aerial Vehicle Imagery Using Edge Enhancement Network

Lightweight Deep Learning Models for High-Precision Rice Seedling Segmentation from UAV-Based Multispectral Images

Joint Crop and Tassel Segmentation in the Wild

CCTNet: Coupled CNN and Transformer Network for Crop Segmentation of Remote Sensing Images.

Fully Convolutional Network for Rice Seedling and Weed Image Segmentation at the Seedling Stage in Paddy Fields.

Utilizing Convolutional Neural Networks (CNN) and U-Net Architecture for Precise Crop and Weed Segmentation in Agricultural Imagery: A Deep Learning Approach

Cucumber Leaf Segmentation Based on Bilayer Convolutional Network

Recognition Method of Corn and Rice Crop Growth State Based on Computer Image Processing Technology

Segmenting Purple Rapeseed Leaves in the Field from UAV RGB Imagery Using Deep Learning as an Auxiliary Means for Nitrogen Stress Detection

Pixel Level Segmentation of Early-Stage In-Bag Rice Root for Its Architecture Analysis.

Segmentation algorithm based on color feature for green crop plants

Crop Extraction Based on Ultra-Simple Neural Network Modeling in the Normalized Rgb and CIE L*a*b* Color Spaces