Abstract:As a fruit with high economic value, strawberry has a short ripeness period, and harvesting at an incorrect time will seriously affect the quality of strawberries, thereby reducing economic benefits. Therefore, the timing of its harvesting is very demanding. A fine ripeness recognition can provide more accurate crop information, and guide strawberry harvest management more timely and effectively. This study proposes a fine recognition method for field strawberry ripeness that combines deep learning and image processing. The method is divided into three stages: In the first stage, self-calibrated convolutions are added to the Mask R-CNN backbone network to improve the model performance, and then the model is used to extract the strawberry target in the image. In the second stage, the strawberry target is divided into four sub-regions by region segmentation method, and the color feature values of B, G, L, a and S channels are extracted for each sub-region. In the third stage, the strawberry ripeness is classified according to the color feature values and the results are visualized. Experimental results show that with the incorporation of self-calibrated convolutions into the Mask R-CNN, the model's performance has been substantially enhanced, leading to increased robustness against diverse occlusion interferences. As a result, the final average precision (AP) has improved to 0.937, representing a significant increase of 0.039 compared to the previous version. The strawberry ripeness classification effect is the best on the SVM classifier, and the accuracy under the combined channel BGLaS reaches 0.866. The classification results are better than common manual feature extraction methods and AlexNet, ResNet18 models. In order to clarify the role of the region segmentation method, the contribution of different sub-regions to each ripeness is also explored. The comprehensive results demonstrate that the proposed method enables the evaluation of six distinct ripeness levels of strawberries in the complex field environment. This method can provide accurate decision support for strawberry refined planting management.

Integrated Fruit Ripeness Assessment System Based on an Artificial Olfactory Sensor and Deep Learning

Olfactory Visualization Sensing Array Made with CelluMOFs to Predict Fruit Ripeness Using Deep Learning

Design of a Multi-Function Experimental System for Online Internal Quality Evaluation of Fruits

Application of Visible/Near-Infrared Spectroscopy Combined with Machine Vision Technique to Evaluate the Ripeness of Melons ( Cucumis melo L.)

Olfactory Visualization Sensor Based on Densely Connected Convolutional Networks for In-Situ Fruit Ripeness Prediction

Apple Ripeness Identification Using Deep Learning

Evaluation of peach quality indices using an electronic nose by MLR, QPST and BP network

DeepFruits: A Fruit Detection System Using Deep Neural Networks

Portable Food‐Freshness Prediction Platform Based on Colorimetric Barcode Combinatorics and Deep Convolutional Neural Networks

Development of a Dual MOS Electronic Nose/Camera System for Improving Fruit Ripeness Classification

Ripeness Prediction of Postharvest Kiwifruit Using a MOS E-Nose Combined with Chemometrics

Strawberry Ripeness Detection Using Deep Learning Models

Evaluation of Peach Quality Attribute Using an Electronic Nose

Application of Electronic Nose and Statistical Analysis to Predict Quality Indices of Peach

Non-Destructive Estimation of Physicochemical Properties and Detection of Ripeness Level of Apples Using Machine Vision

Fruit Detection Research Based on Near-Infrared Spectroscopy and Lightweight Neural Network

Assessment of 'Golden Delicious' Apples Using an Electronic Nose and Machine Learning to Determine Ripening Stages

The Novel Combination of Nano Vector Network Analyzer and Machine Learning for Fruit Identification and Ripeness Grading

A fine recognition method of strawberry ripeness combining Mask R-CNN and region segmentation

Fruit ripeness identification using YOLOv8 model

Predicting the Quality of Tangerines Using the GCNN-LSTM-AT Network Based on Vis-NIR Spectroscopy