Abstract:We present a new method for in situ high‐resolution hyperspectral mapping of the seafloor utilizing a spectrometer colocated and coregistered with a high‐resolution color stereo camera system onboard an autonomous underwater vehicle (AUV). Hyperspectral imagery data have been used extensively for mapping and distinguishing marine seafloor habitats and organisms from above‐water platforms (such as satellites and aircraft), but at low spatial resolutions and at shallow water depths (<10 m). The use of hyperspectral sensing from in‐water platforms (such as AUVs) has the potential to provide valuable habitat data in deeper waters and with high spatial resolution. Challenges faced by in‐water hyperspectral imaging include difficulties in correcting for water column effects and the spatial registration of point/line‐scan hyperspectral sensor measurements. The methods developed in this paper overcome these issues through coregistration with a high spatial resolution, stereo color camera, and precise modeling and compensation of the water column properties that attenuate hyperspectral signals. We integrated two spectrometers into our SeaBED class AUV, and one on‐board a support surface vessel to measure and estimate the effects of light passing through the water column. Spatial calibration of the spectrometers/stereo cameras and the synchronized acquisition of both sensors allowed for spatial registration of the resulting hyperspectral reflectance profiles. We demonstrate resulting hyperspectral imagery maps with a spatial resolution of 30 cm over large areas of the seafloor that are not adversely effected by above‐water conditions (such as cloud cover) that would typically prevent the use of remote‐sensing methods. Results are presented from an AUV mapping survey of a coral reef ecosystem over Pakhoi Bank on the Great Barrier Reef, Queensland, Australia, demonstrating the ability to reconstruct hyperspectral reflectance profiles for a diverse range of abiotic and biotic coverage types including sand, corals, seagrass, and algae. Profiles are then used to automatically classify different coverage types with a 10‐fold cross validation accuracy of 91.99% using a linear support vector machine (SVM).

Hyperspectral 3D Mapping of Underwater Environments

Underwater Three-Dimensional Microscope for Marine Benthic Organism Monitoring

Coregistered Hyperspectral and Stereo Image Seafloor Mapping from an Autonomous Underwater Vehicle

3d sequential image mosaicing for underwater navigation and mapping

Underwater Multi-Spectral Photometric Stereo Reconstruction From A Single Rgbd Image

Real-time Underwater 3D Reconstruction Based on Monocular Image

Three-dimensional Reconstruction of Underwater Objects from Side-Scan Sonar Images

A diver-operated hyperspectral imaging and topographic surveying system for automated mapping of benthic habitats

Integration of Hyperspectral Imagery and Sparse Sonar Data for Shallow Water Bathymetry Mapping

Predictive 3D Sonar Mapping of Underwater Environments via Object-specific Bayesian Inference

Underwater 3D Scanning System for Cultural Heritage Documentation

SkySea: Connecting Satellite, UAV and Underwater Imagery for Benthic Habitat Mapping

Real-Time Dense 3D Mapping of Underwater Environments

Large-Scale Dense 3D Mapping Using Submaps Derived From Orthogonal Imaging Sonars

Scalable Semantic 3D Mapping of Coral Reefs with Deep Learning

Fusing Concurrent Orthogonal Wide-aperture Sonar Images for Dense Underwater 3D Reconstruction

Real-time Underwater 3D Reconstruction Method Based on Stereo Camera

Multispectral Stereo-Image Fusion for 3D Hyperspectral Scene Reconstruction

Mapping Underwater Topography for Coastal Estuary Ecosystem Monitoring from Quickbird High-Resolution Multispectral Imagery

Underwater 3D Reconstruction Based on Geometric Transformation of Sonar and Depth Information

Application of Photogrammetric Computer Vision and Deep Learning in High-Resolution Underwater Mapping: A Case Study of Shallow-Water Coral Reefs