Abstract:Although coral reefs are special and vital marine ecosystems, massive coral degradation began to occur due to the increase in global temperatures and the intensification of human industrial activities. Coral reef protection requires accurate coral recognition because it is the foundation for learning the distribution, disease, and growth of coral reefs, hereby informing the proper ways for further action. Recently, CNNs have been applied in automated coral image classification. These classifier models, however, are difficult to be generalized from the trained coral images in a marine region (source domain) to the coral images in a different marine region (target domain) since the corals have significant within-species morphological variability among the different geographic location domains. In this paper, a novel coral recognition algorithm is introduced via knowledge transfer across domains and its advantages lie in the following aspects. (1) It simultaneously transfers corals' texture and structure features across domains thus providing useful knowledge to assist the coral recognition tasks in the target marine domain. (2) To overcome the difficulty that the confusing coral images (e.g., bleached corals) are prone to be misclassified and transfer useless or even negative information, our algorithm is equipped with the reject option for the confusing corals while adapting. These corals can be sent to an expert or a more expensive but accurate system, resulting in strengthened transferability and reliability. Furthermore, we develop a new cross-domain coral image dataset to enhance coral research. Without the label information from the target marine region, our method significantly reduces the distribution gap and domain shift among the different marine regions. In addition, CR-Cross goes a step further in tackling the challenges of missing coral data, maximizing the utilization of available coral datasets, and enhancing the reusability of both coral data and coral recognition models. A series of empirical studies show that our method remarkably outperforms a broad range of baselines.

Cross-Domain Coral Image Classification Using Dual-Stream Hierarchical Neural Networks

Development of Coral Investigation System Based on Semantic Segmentation of Single-Channel Images

CR-Cross: Cross Domain Coral Recognitions with Reject Options for Coral Conservation

Classification of Freshwater Zooplankton by Pre-trained Convolutional Neural Network in Underwater Microscopy

Taxonomic resolution of coral image classification with Convolutional Neural Network

GCU-Net: Remote Sensing Classification Method for Coral Reef Geomorphology Integrating Geospatial Cognition

Deep learning for multi-label classification of coral conditions in the Indo-Pacific via underwater photogrammetry

ML-Net: A Multi-Local Perception Network for Healthy and Bleached Coral Image Classification

Towards highly accurate coral texture images classification using deep convolutional neural networks and data augmentation

Hierarchical Classification for Automated Image Annotation of Coral Reef Benthic Structures

NOVEL APPROACHES TO ENHANCE CORAL REEFS MONITORING WITH UNDERWATER IMAGE SEGMENTATION

Satellite Remote Sensing and Bathymetry Co-Driven Deep Neural Network for Coral Reef Shallow Water Benthic Habitat Classification

Dual Stream Cross Domain Feature Fusion for Land-Oceanic Object Detection

Marine Ecosystem Monitoring: Applying Remote Sensing and AI to Track and Predict Coral Reef Health

Sparse Coral Classification Using Deep Convolutional Neural Networks

ICESat-2 and Multispectral Images Based Coral Reefs Geomorphic Zone Mapping Using a Deep Learning Approach

Duet of ViT and CNN: Multi-Scale Dual-Branch Network for Fine-Grained Image Classification of Marine Organisms

A gated cross-domain collaborative network for underwater object detection

Automated 2D, 2.5D, and 3D Segmentation of Coral Reef Pointclouds and Orthoprojections

Fine-Grained 3D Modeling and Semantic Mapping of Coral Reefs Using Photogrammetric Computer Vision and Machine Learning

Cross-domain Learning for Underwater Image Enhancement