Key point detection method for fish size measurement based on deep learning
Yaozhen Yu,Hao Zhang,Fei Yuan
DOI: https://doi.org/10.1049/ipr2.12924
IF: 2.3
2023-09-16
IET Image Processing
Abstract:The automatic measurement of the fish size in the breeding area is of vital importance to fishery. The current imagebased methods can overcome the shortcomings of the acoustic methods, that is, high‐priced equipment and low measurement accuracy. However, these image‐based methods still have certain defects in the selection of measurement points. An automatic fish size measurement method based on key point detection is proposed here, which aimed to tackle the problem of measurement point selection and achieve accurate measurement of a single fish. This paper establishes a dataset of Fish‐Keypoints and uses a deep learning method to realize the detection of fish and its key points. Based on the binocular camera system, the three‐dimensional coordinate system was reconstructed, and the key points of the head and tail were measured to calculate the length. The detection model has achieved 85.1% accuracy for key points detection. Also, experiments to verify the proposed algorithm on land and in underwater scenes were conducted, and the relative error of the measurements for fish in the pool was around 7%. It is proved that the proposed algorithm can accurately detect the measurement points and compared to other methods, it is more accurate. Moreover, the key point detection method has a certain potential and lays a good foundation for image‐based methods to analyse the posture and skeleton of a single fish. Accurate fish size measurement in breeding areas is crucial for the fishing industry. Unlike acoustic methods with high equipment cost and low measurement accuracy, current image‐based methods offer a promising alternative. However, these image‐based methods still face challenges in selecting measurement points. To address this issue and achieve precise measurements of individual fish, this paper introduces an automatic fish size measurement method based on key point detection. We established a Fish‐Keypoints dataset and utilized deep learning techniques for the detection of fish and their key points. Using a binocular camera system, we reconstruct a three‐dimensional coordinate system to measure key points at the fish's head and tail, facilitating fish length calculation. The detection model achieves an accuracy of 85.1% in key point detection. The proposed method is tested in both land and underwater environments, demonstrating a relative measurement error of approximately 7% for fish in pools. This confirms the proposed method's ability to accurately detect measurement points, offering superior accuracy compared to other methods.
computer science, artificial intelligence,engineering, electrical & electronic,imaging science & photographic technology