Abstract:Compression is a standard procedure for making convolutional neural networks (CNNs) adhere to some specific computing resource constraints. However, searching for a compressed architecture typically involves a series of time-consuming training/validation experiments to determine a good compromise between network size and performance accuracy. To address this, we propose an image complexity-guided network compression technique for biomedical image segmentation. Given any resource constraints, our framework utilizes data complexity and network architecture to quickly estimate a compressed model which does not require network training. Specifically, we map the dataset complexity to the target network accuracy degradation caused by compression. Such mapping enables us to predict the final accuracy for different network sizes, based on the computed dataset complexity. Thus, one may choose a solution that meets both the network size and segmentation accuracy requirements. Finally, the mapping is used to determine the convolutional layer-wise multiplicative factor for generating a compressed network. We conduct experiments using 5 datasets, employing 3 commonly-used CNN architectures for biomedical image segmentation as representative networks. Our proposed framework is shown to be effective for generating compressed segmentation networks, retaining up to ≈95% of the full-sized network segmentation accuracy, and at the same time, utilizing ≈32x fewer network trainable weights (average reduction) of the full-sized networks.

Compression of complex networks based on multiscale geometric analysis

Compressing Big Graph Data: A Relative Node Importance Approach

Multiscale Complex Network for Analyzing Experimental Multivariate Time Series

A Method Of Node Layout Of A Complex Network Based On Community Compression

Global Reconstruction of Complex Network Topology Via Structured Compressive Sensing

Compressive Network Analysis

Network Compression by Node and Edge Mergers

Social Network Compression Based on the Importance of the Community Nodes

Visual Analysis Of Geometry Constrained Large-Scale Network

Dissimilarity-based Filtering and Compression of Complex Weighted Networks

A compression optimization algorithm for community detection

Graph Structure Analysis Based On Complex Network (Vol 22, Pg 713, 2012)

Multi-Scale end-to-End Learning for Point Cloud Geometry Compression

Compressive-Sensing-Based Structure Identification for Multilayer Networks.

A community detection algorithm based on graph compression for large-scale social networks

Common Neighbor Query-Friendly Triangulation-Based Large-Scale Graph Compression

Compression of Weighted Graphs

Visual Analysis of Complex Networks and Community Structure

Multiscale dynamical embeddings of complex networks

Image Complexity Guided Network Compression for Biomedical Image Segmentation

Asymmetric Multi-Scale Dilated Attention Based Network for Remote Sensing Image Compression