Research on A Binocular Fish Dimension Measurement Method Based on Instance Segmentation and Fish Tracking

Huanqing Liu,Feiyang Suo,Yanjun Li,Ji Xiang
DOI: https://doi.org/10.1109/ccdc55256.2022.10034386
2022-01-01
Abstract:This paper proposes a binocular fish dimension measurement method to estimate fish dimension based on instance segmentation and fish tracking. First, obtain the point cloud of the scene through binocular correction and stereo matching. To alleviate the weak texture problem of the scene and obtain more accurate stereo matching results, this paper chooses binocular camera with infrared function. Our data set contains a small number of mask data set and a large number of labeled box data set. To make more effective use of our data set, the original image is provided to YOLOv5 for target detection and SOLOv2 for instance segmentation to get the mask of the fish, the results of them are then combined to eliminate the mask that may be misrecognized. The point cloud corresponding to the fish mask is filtered according to the segmentation result and the initial point cloud, after clustering and plane fitting, the fish dimension can be calculated with PCA. The detection results are then used for target tracking, the further processing can be skipped if the fish has been detected. Experiments show that this method has achieved good results in terms of speed and measurement accuracy.
What problem does this paper attempt to address?