Abstract:This work aims at addressing two issues simultaneously: data compression at input space and semantic segmentation. Semantic segmentation of remotely sensed multi- or hyperspectral images through deep learning (DL) artificial neural networks (ANN) delivers as output the corresponding matrix of pixels classified elementwise, achieving competitive performance metrics. With technological progress, current remote sensing (RS) sensors have more spectral bands and higher spatial resolution than before, which means a greater number of pixels in the same area. Nevertheless, the more spectral bands and the greater number of pixels, the higher the computational complexity and the longer the processing times. Therefore, without dimensionality reduction, the classification task is challenging, particularly if large areas have to be processed. To solve this problem, our approach maps an RS-image or third-order tensor into a core tensor, representative of our input image, with the same spatial domain but with a lower number of new tensor bands using a Tucker decomposition (TKD). Then, a new input space with reduced dimensionality is built. To find the core tensor, the higher-order orthogonal iteration (HOOI) algorithm is used. A fully convolutional network (FCN) is employed afterwards to classify at the pixel domain, each core tensor. The whole framework, called here HOOI-FCN, achieves high performance metrics competitive with some RS-multispectral images (MSI) semantic segmentation state-of-the-art methods, while significantly reducing computational complexity, and thereby, processing time. We used a Sentinel-2 image data set from Central Europe as a case study, for which our framework outperformed other methods (included the FCN itself) with average pixel accuracy (PA) of 90% (computational time ∼90s) and nine spectral bands, achieving a higher average PA of 91.97% (computational time ∼36.5s), and average PA of 91.56% (computational time ∼9.5s) for seven and five new tensor bands, respectively.

A Tensor Voting Approach for the Hierarchical Segmentation of 3-D Acoustic Images

Robust 3D Segmentation for Underwater Acoustic Images

3D acousticimagesegmentationby a RANSAC-basedapproach

3D acoustic image segmentation by a RANSAC-based approach

Tensor-based Basis Function Learning for Three-Dimensional Sound Speed Fields

Spatio-Temporal Segmentation with Depth-Inferred Videos of Static Scenes

3D Audio-Visual Segmentation

Striking The Right Balance: Three-Dimensional Ocean Sound Speed Field Reconstruction Using Tensor Neural Networks

Sparse-to-Dense Depth Estimation in Videos Via High-Dimensional Tensor Voting

WSC-Trans: A 3D network model for automatic multi-structural segmentation of temporal bone CT

Fuzzy Clustering Segmentation for 3D Echocardiographic Images

OmniSeg3D: Omniversal 3D Segmentation via Hierarchical Contrastive Learning

Spectral 3D Mesh Segmentation with a Novel Single Segmentation Field.

A surface reconstruction method for highly noisy point clouds

Spectral Imagery Tensor Decomposition for Semantic Segmentation of Remote Sensing Data through Fully Convolutional Networks

Robust Segmentation of Various Anatomies in 3D Ultrasound Using Hough Forests and Learned Data Representations

View-Consistent Hierarchical 3D Segmentation Using Ultrametric Feature Fields

Audio Segment Classification Using Online Learning Based Tensor Representation Feature Discrimination

Underwater Sonar Image Segmentation by a Novel Joint Level Set Model

Tensor multi-view clustering method for natural image segmentation

Unsupervised 3-D Seismic Erratic Noise Attenuation With Robust Tensor Deep Learning