Abstract:Along with the breakthrough of convolutional neural networks, learning-based segmentation has emerged in many research works. Most of them are based on supervised learning, requiring plenty of annotated data; however, to support segmentation, a label for each pixel is required, which is obviously expensive. As a result, the issue of lacking annotated segmentation data commonly exists. Continuous learning is a promising way to deal with this issue; however, it still has high demands on human labor for annotation. What's more, privacy is highly required in segmentation data for real-world applications, which further calls for on-device learning. In this paper, we aim to resolve the above issue in an alternative way: Instead of supervised segmentation, we propose to develop efficient unsupervised segmentation that can be executed on edge devices. Based on our observation that segmentation can obtain high performance when pixels are mapped to a high-dimension space, we for the first time bring brain-inspired hyperdimensional computing (HDC) to the segmentation task. We build the HDC-based unsupervised segmentation framework, namely "SegHDC". In SegHDC, we devise a novel encoding approach that follows the Manhattan distance. A clustering algorithm is further developed on top of the encoded high-dimension vectors to obtain segmentation results. Experimental results show SegHDC can significantly surpass neural network-based unsupervised segmentation. On a standard segmentation dataset, DSB2018, SegHDC can achieve a 28.0% improvement in Intersection over Union (IoU) score; meanwhile, it achieves over 300x speedup on Raspberry PI. What's more, for a larger size image in the BBBC005 dataset, the existing approach cannot be accommodated to Raspberry PI due to out of memory; on the other hand, SegHDC can obtain segmentation results within 3 minutes while achieving a 0.9587 IoU score.

HFS: Hierarchical Feature Selection for Efficient Image Segmentation

Super-Resolution Based Patch-Free 3D Medical Image Segmentation with Self-Supervised Guidance

Patch-Free 3D Medical Image Segmentation Driven by Super-Resolution Technique and Self-Supervised Guidance

Fast Hierarchical Segmentation of High-Resolution Remote Sensing Image with Adaptive Edge Penalty

Fast and Effective Image Segmentation via Superpixels and Adaptive Thresholding.

Hierarchical Image Segmentation Based on Multi-feature Fusion and Graph Cut Optimization.

ISDNet: Integrating Shallow and Deep Networks for Efficient Ultra-high Resolution Segmentation

Super-Resolution Based Patch-Free 3D Image Segmentation with High-Frequency Guidance

Hierarchical Semantic Broadcasting Network for Real-Time Semantic Segmentation

SegHSI: Semantic Segmentation of Hyperspectral Images With Limited Labeled Pixels

An efficient hierarchical graph based image segmentation

Very Fast Semantic Image Segmentation Using Hierarchical Dilation and Feature Refining

HSNet: an Intelligent Hierarchical Semantic-Aware Network System for Real-Time Semantic Segmentation

Interactive Image Segmentation Based on Hierarchical Superpixels Initialization and Region Merging

Real-Time Hierarchical Supervoxel Segmentation Via a Minimum Spanning Tree

A robust image segmentation method using hierarchical color clustering.

Real-time Semantic Image Segmentation Via Spatial Sparsity.

Superpixel Segmentation for Hyperspectral Images Based on False Colour Composition with Colour Histogram Driving

Hierarchical Superpixel Segmentation by Parallel CRTrees Labeling.

On-Device Unsupervised Image Segmentation

Image superpixel segmentation based on hierarchical multi-level LI-SLIC