Abstract:Introduction: Technological developments have facilitated the collection of large amounts of imagery from isolated deep-sea ecosystems such as abyssal nodule fields. Application of imagery as a monitoring tool in these areas of interest for deep-sea exploitation is extremely valuable. However, in order to collect a comprehensive number of species observations, thousands of images need to be analysed, especially if a high diversity is combined with low abundances such is the case in the abyssal nodule fields. As the visual interpretation of large volumes of imagery and the manual extraction of quantitative information is time-consuming and error-prone, computational detection tools may play a key role to lessen this burden. Yet, there is still no established workflow for efficient marine image analysis using deep learning–based computer vision systems for the task of fauna detection and classification. Methods: In this case study, a dataset of 2100 images from the deep-sea polymetallic nodule fields of the eastern Clarion-Clipperton Fracture zone from the SO268 expedition (2019) was selected to investigate the potential of machine learning–assisted marine image annotation workflows. The Machine Learning Assisted Image Annotation method (MAIA), provided by the BIIGLE system, was applied to different set-ups trained with manually annotated fauna data. The results computed with the different set-ups were compared to those obtained by trained marine biologists regarding accuracy (i.e. recall and precision) and time. Results: Our results show that MAIA can be applied for a general object (i.e. species) detection with satisfactory accuracy (90.1% recall and 13.4% precision), when considered as one intermediate step in a comprehensive annotation workflow. We also investigated the performance for different volumes of training data, MAIA performance tuned for individual morphological groups and the impact of sediment coverage in the training data. Discussion: We conclude that: a) steps must be taken to enable computer vision scientists to access more image data from the CCZ to improve the system's performance and b) computational species detection in combination with a posteriori filtering by marine biologists has a higher efficiency than fully manual analyses.

Automating the assessment of biofouling in images using expert agreement as a gold standard

Establishment of an antifouling performance index derived from the assessment of biofouling on typical marine sensor materials

Autonomous Visual Fish Pen Inspections for Estimating the State of Biofouling Buildup Using ROV -- Extended Abstract

Accelerating Species Recognition and Labelling of Fish From Underwater Video With Machine-Assisted Deep Learning

Deepdive: Leveraging Pre-trained Deep Learning for Deep-Sea ROV Biota Identification in the Great Barrier Reef

Automated red tide algae recognition by the color microscopic image

Multi-species Seagrass Detection and Classification from Underwater Images

Automating Deep-Sea Video Annotation Using Machine Learning

Automated Diatom Searching in the Digital Scanning Electron Microscopy Images of Drowning Cases Using the Deep Neural Networks

Automating the analysis of fish grazing behaviour from videos using image classification and optical flow

Biofouling recognition and boundary tracking control for underwater cleaning robots

How to identify biofouling species in marine and freshwater

Classification of Lakebed Geologic Substrate in Autonomously Collected Benthic Imagery Using Machine Learning

An AI-based approach for detecting cells and microbial byproducts in low volume scanning electron microscope images of biofilms

Biofouling detection and classification in Tidal Stream Turbines through soft voting ensemble transfer learning of video images

Deep learning–assisted biodiversity assessment in deep-sea benthic megafauna communities: a case study in the context of polymetallic nodule mining

Monitoring marine pollution for carbon neutrality through a deep learning method with multi-source data fusion

Biofouling Focused Learning and Observation for Wide-Area Surveillance in Tidal Stream Turbines

Coastal Fisheries Resource Monitoring Through A Deep Learning-Based Underwater Video Analysis

Enhancing shipboard oil pollution prevention: Machine learning innovations in oil discharge monitoring equipment

Recognition method of turbine pollutant adhesion in tidal stream energy generation systems based on deep learning