Abstract:When monitoring crop growth using top-down images of the plant canopies, leaves in agricultural fields appear very dense and significantly overlap each other. Moreover, the image can be affected by external conditions such as background environment and light intensity, impacting the effectiveness of image segmentation. To address the challenge of segmenting dense and overlapping plant leaves under natural lighting conditions, this study employed a Bilayer Convolutional Network (BCNet) method for accurate leaf segmentation across various lighting environments. The major contributions of this study are as follows: (1) Utilized Fully Convolutional Object Detection (FCOS) for plant leaf detection, incorporating ResNet-50 with the Convolutional Block Attention Module (CBAM) and Feature Pyramid Network (FPN) to enhance Region of Interest (RoI) feature extraction from canopy top-view images. (2) Extracted the sub-region of the RoI based on the position of the detection box, using this region as input for the BCNet, ensuring precise segmentation. (3) Utilized instance segmentation of canopy top-view images using BCNet, improving segmentation accuracy. (4) Applied the Varifocal Loss Function to improve the classification loss function in FCOS, leading to better performance metrics. The experimental results on cucumber canopy top-view images captured in glass greenhouse and plastic greenhouse environments show that our method is highly effective. For cucumber leaves at different growth stages and under various lighting conditions, the Precision, Recall and Average Precision (AP) metrics for object recognition are 97%, 94% and 96.57%, respectively. For instance segmentation, the Precision, Recall and Average Precision (AP) metrics are 87%, 83% and 84.71%, respectively. Our algorithm outperforms commonly used deep learning algorithms such as Faster R-CNN, Mask R-CNN, YOLOv4 and PANet, showcasing its superior capability in complex agricultural settings. The results of this study demonstrate the potential of our method for accurate recognition and segmentation of highly overlapping leaves in diverse agricultural environments, significantly contributing to the application of deep learning algorithms in smart agriculture.

MFC-CNN: an Automatic Grading Scheme for Light Stress Levels of Lettuce (lactuca Sativa L.) Leaves

Automatic monitoring of lettuce fresh weight by multi-modal fusion based deep learning

Multimodal Data Fusion for Precise Lettuce Phenotype Estimation Using Deep Learning Algorithms

Automatic Non-Destructive Multiple Lettuce Traits Prediction Based on DeepLabV3+

Growth monitoring of greenhouse lettuce based on a convolutional neural network

Crop leaf disease grade identification based on an improved convolutional neural network

A Global Feature Fusion Network for Lettuce Growth Trait Detection

A Light-Weight CNN Based Multi-Task Architecture for Apple Maturity and Disease Classification

Image-Based High-Throughput Detection and Phenotype Evaluation Method for Multiple Lettuce Varieties

Improving Lettuce Fresh Weight Estimation Accuracy Through RGB-D Fusion

MFCIS: an automatic leaf-based identification pipeline for plant cultivars using deep learning and persistent homology

Leafy vegetable freshness identification using hyperspectral imaging with deep learning approaches

Growing period classification of DC using GL-CNN.

Crop Classification Based On Lightened Convolutional Neural Networks In Multispectral Images

LAI Estimation of Cucumber Crop Based on Improved Fully Convolutional Network

Precision Detection of Salt Stress in Soybean Seedlings Based on Deep Learning and Chlorophyll Fluorescence Imaging

Automatic Counting of Lettuce Using an Improved YOLOv5s with Multiple Lightweight Strategies

Plant Leaf Recognition Based On Small Datasets Using Deep Learning Algorithm

Multi-Input Convolutional Neural Network for Flower Grading

Agricultural development driven by the digital economy: improved EfficientNet vegetable quality grading

Cucumber Leaf Segmentation Based on Bilayer Convolutional Network