Improving Buoy Detection with Deep Transfer Learning for Mussel Farm Automation

Carl McMillan,Junhong Zhao,Bing Xue,Ross Vennell,Mengjie Zhang
DOI: https://doi.org/10.1109/IVCNZ61134.2023.10343657
2024-02-26
Abstract:The aquaculture sector in New Zealand is experiencing rapid expansion, with a particular emphasis on mussel exports. As the demands of mussel farming operations continue to evolve, the integration of artificial intelligence and computer vision techniques, such as intelligent object detection, is emerging as an effective approach to enhance operational efficiency. This study delves into advancing buoy detection by leveraging deep learning methodologies for intelligent mussel farm monitoring and management. The primary objective centers on improving accuracy and robustness in detecting buoys across a spectrum of real-world scenarios. A diverse dataset sourced from mussel farms is captured and labeled for training, encompassing imagery taken from cameras mounted on both floating platforms and traversing vessels, capturing various lighting and weather conditions. To establish an effective deep learning model for buoy detection with a limited number of labeled data, we employ transfer learning techniques. This involves adapting a pre-trained object detection model to create a specialized deep learning buoy detection model. We explore different pre-trained models, including YOLO and its variants, alongside data diversity to investigate their effects on model performance. Our investigation demonstrates a significant enhancement in buoy detection performance through deep learning, accompanied by improved generalization across diverse weather conditions, highlighting the practical effectiveness of our approach.
Computer Vision and Pattern Recognition,Artificial Intelligence
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to improve the accuracy and robustness of buoy detection in mussel farms. Specifically, the research aims to improve the buoy detection method in intelligent mussel farm monitoring and management through deep learning and transfer learning techniques. The following are the key problems that the paper attempts to solve: 1. **Improve the accuracy of buoy detection**: - Traditional methods have poor buoy detection performance in complex environments (such as strong capillary waves, low contrast, etc.). - The research improves the accuracy of buoy detection by introducing deep - learning models, especially YOLO and its variants. 2. **Enhance the robustness of buoy detection**: - Buoy detection needs to maintain high performance under various weather conditions (sunny days, rainy days, foggy days, etc.). - The paper uses a diverse dataset for training and applies transfer learning techniques, enabling the model to better adapt to different environmental conditions. 3. **Address the problem of limited labeled data**: - The amount of buoy image data in mussel farms is limited, and the labeling cost is high. - The research adopts the transfer learning method, using pre - trained models (such as YOLOv7) and fine - tuning with a small amount of labeled data to overcome the problem of insufficient data. 4. **Achieve real - time detection**: - The practical application scenario requires that buoy detection can be processed quickly in real - time video streams. - The paper selects the YOLO series models because they have a fast inference speed and are suitable for real - time applications. 5. **Automate the monitoring process**: - Traditional manual monitoring methods are costly and inefficient. - By developing an intelligent buoy detection system, the buoy position can be automatically identified, assisting in the daily management and maintenance operations of the farm. ### Formula Representation To ensure the performance evaluation of the model, the paper uses the following evaluation metrics: - **mAP (mean Average Precision)**: \[ \text{mAP}=\frac{1}{N}\sum_{i = 1}^{N}\text{AP}_i \] where \(N\) is the number of classes and \(\text{AP}_i\) is the average precision of the \(i\)-th class. - **IoU (Intersection over Union)**: \[ \text{IoU}=\frac{\text{Area of Overlap}}{\text{Area of Union}} \] which is used to measure the degree of overlap between the predicted box and the ground - truth box. Through these methods and techniques, the paper successfully improves the accuracy and robustness of buoy detection, providing an effective solution for intelligent mussel farm management.