Abstract:The tea industry is one of China's most important industries. The picking of famous tea still relies on manual methods, with low efficiency, labor shortages and high labor costs, which restrict the development of the tea industry. These labor-intensive picking methods urgently need to be transformed into intelligent and automated picking. In response to difficulties in identification of tea buds and positioning of picking points, this study took the one bud with one leaf grade of the Fuyun 6 tea species under complex background as the research object, and proposed a method based on deep learning, combining object detection and semantic segmentation networks, to first detect the tea buds, then segment the picking area from the tea bud detection box, and then obtain the picking point from the picking area. An improved YOLOX-tiny model and an improved PSP-net model were used to detect tea buds and their picking areas, respectively; the two models were combined at the inference end, and the centroid of the picking area was taken as the picking point. The YOLOX-tiny model for tea bud detection was modified by replacing its activation function with the Mish function and using a content-aware reassembly of feature module to implement the upsampling operation. The detection effects of the YOLOX-tiny model were improved, and the mean average precision and recall rate of the improved model reached 97.42% and 95.09%, respectively. This study also proposed an improved PSP-net semantic segmentation model for segmenting the picking area inside a detection box. The PSP-net was modified by replacing its backbone network with the lightweight network MobileNetV2 and by replacing conventional convolution in its feature fusion part with Omni-Dimensional Dynamic Convolution. The model's lightweight characteristics were significantly improved and its segmentation accuracy for the picking area was also improved. The mean intersection over union and mean pixel accuracy of the improved PSP-net model are 88.83% and 92.96%, respectively, while its computation and parameter amounts are reduced by 95.71% and 96.10%, respectively, compared to the original PSP-net. The method proposed in this study achieves a mean intersection over union and mean pixel accuracy of 83.27% and 86.51% for the overall picking area segmentation, respectively, and the detecting rate of picking point identification reaches 95.6%. Moreover, its detection speed satisfies the requirements of real-time detection, providing a theoretical basis for the automated picking of famous tea.

An improved model based on YOLOX for detection of tea sprouts in natural environment

Tea-YOLOv8s: A Tea Bud Detection Model Based on Deep Learning and Computer Vision

Detection of Small Foreign Objects in Pu-erh Sun-Dried Green Tea: an Enhanced YOLOv8 Neural Network Model Based on Deep Learning

Small object detection algorithm incorporating swin transformer for tea buds

Small target tea bud detection based on improved YOLOv5 in complex background

YOLOX target detection model can identify and classify several types of tea buds with similar characteristics

T-YOLO: a lightweight and efficient detection model for nutrient buds in complex tea-plantation environments

Research on Tea Trees Germination Density Detection Based on Improved YOLOv5

An RGB‐D object detection model with high‐generalization ability applied to tea harvesting robot for outdoor cross‐variety tea shoots detection

Edge Device Detection of Tea Leaves with One Bud and Two Leaves Based on ShuffleNetv2-YOLOv5-Lite-E

Improved YOLOv8 and SAHI Model for the Collaborative Detection of Small Targets at the Micro Scale: A Case Study of Pest Detection in Tea

Tea Bud and Picking Point Detection Based on Deep Learning

TBC-YOLOv7: a refined YOLOv7-based algorithm for tea bud grading detection

YOLO-Tea: A Tea Disease Detection Model Improved by YOLOv5

Tea Bud Detection Based on Multi-Scale Convolutional Block Attention Module

A Tea Buds Counting Method Based on YOLOv5 and Kalman Filter Tracking Algorithm

An improved YOLOv7 model based on Swin Transformer and Trident Pyramid Networks for accurate tomato detection

Tea chrysanthemum detection under unstructured environments using the TC-YOLO model

Rapid and Accurate Identification of Grass Seedlings in Agricultural Fields Based on Optimized YOLOX Model

Detection and classification of tea buds based on deep learning

YOLOv8-RMDA: Lightweight YOLOv8 Network for Early Detection of Small Target Diseases in Tea