ODYSSEE: Oyster Detection Yielded by Sensor Systems on Edge Electronics

Xiaomin Lin,Vivek Mange,Arjun Suresh,Bernhard Neuberger,Aadi Palnitkar,Brendan Campbell,Alan Williams,Kleio Baxevani,Jeremy Mallette,Alhim Vera,Markus Vincze,Ioannis Rekleitis,Herbert G. Tanner,Yiannis Aloimonos
2024-09-13
Abstract:Oysters are a vital keystone species in coastal ecosystems, providing significant economic, environmental, and cultural benefits. As the importance of oysters grows, so does the relevance of autonomous systems for their detection and monitoring. However, current monitoring strategies often rely on destructive methods. While manual identification of oysters from video footage is non-destructive, it is time-consuming, requires expert input, and is further complicated by the challenges of the underwater environment. To address these challenges, we propose a novel pipeline using stable diffusion to augment a collected real dataset with realistic synthetic data. This method enhances the dataset used to train a YOLOv10-based vision model. The model is then deployed and tested on an edge platform in underwater robotics, achieving a state-of-the-art 0.657 mAP@50 for oyster detection on the Aqua2 platform.
Computer Vision and Pattern Recognition,Robotics
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is the limitations of current oyster monitoring methods. Specifically: 1. **Destructiveness of traditional monitoring methods**: Currently, many monitoring strategies rely on destructive sampling techniques (such as trawling or clamping), and these methods can cause damage to oyster reefs. 2. **Inefficiency of manual identification**: Although manual identification of oysters from videos is non - destructive, this method is very time - consuming, requires the participation of experts, and is complex to operate in an underwater environment, which limits its scale and depth. To solve these problems, the author proposes a new real - time oyster detection system based on autonomous underwater vehicles (AUVs). This system improves the existing monitoring methods in the following ways: - **Data augmentation**: Use diffusion models to generate realistic synthetic images to augment the real - data set, thereby training a more powerful YOLOv10 vision model. - **Edge computing**: Deploy the detection computation on the edge - computing platform on the AUV to achieve real - time processing and decision - making. - **Efficient monitoring**: Improve the efficiency and accuracy of oyster monitoring through automation and real - time monitoring, and reduce the dependence on manual and destructive methods. Finally, this system achieved a detection accuracy of 0.657 mAP@50 on the Aqua2 platform, significantly improving the effect of oyster detection.