Abstract:Cellular neural networks (CeNNs) have been widely adopted in image processing tasks. Recently, various hardware implementations of CeNNs have emerged in the literature, with Field Programmable Gate Array (FPGA) being one of the most popular choices due to its high flexibility and low time-to-market. However, CeNNs typically involve extensive computations in a recursive manner. As an example, to simply process an image of 1,920 × 1,080 pixels requires 4--8 Giga floating point multiplications (for 3 × 3 templates and 50–100 iterations), which needs to be done in a timely manner for real-time applications. To address this issue, in this article, we propose a compressed CeNN framework for efficient FPGA implementations. It involves various techniques, such as incremental quantization and early exit, which significantly reduces computation demands while maintaining an acceptable performance. Particularly, incremental quantization quantizes the numbers in CeNN templates to powers of two, so that complex and expensive multiplications can be converted to simple and cheap shift operations, which only require a minimum number of registers and logical elements (LEs). While a similar concept has been explored in hardware implementations of Convolutional Neural Networks (CNNs), CeNNs have completely different computation patterns, which require different quantization and implementation strategies. Experimental results on FPGAs show that incremental quantization and early exit can achieve a speedup of up to 7.8× and 8.3×, respectively, compared with the state-of-the-art implementations, while with almost no performance loss with four widely adopted applications. We also discover that different from CNNs, the optimal quantization strategies of CeNNs depend heavily on the applications. We hope that our work can serve as a pioneer in the hardware optimization of CeNNs.

Edge Segmentation: Empowering Mobile Telemedicine with Compressed Cellular Neural Networks

Efficient Segmentation Method Using Quantised and Non‐linear CeNN for Breast Tumour Classification

EdgeMedNet: Lightweight and Accurate U-Net for Implementing Efficient Medical Image Segmentation on Edge Devices

Video Surveillance on Mobile Edge Networks—A Reinforcement-Learning-Based Approach

Intelligent Video Surveillance Based on Mobile Edge Networks

Evolutionary Compression of Deep Neural Networks for Biomedical Image Segmentation

Feature Compression for Rate Constrained Object Detection on the Edge

Machine Vision Guided 3D Medical Image Compression for Efficient Transmission and Accurate Segmentation in the Clouds

Video Surveillance on Mobile Edge Networks: Exploiting Multi-Exit Network.

PIS-Net: Efficient Medical Image Segmentation Network with Multivariate Downsampling for Point-of-Care

Unsupervised Training of Neural Cellular Automata on Edge Devices

Edge Assisted Real-time Instance Segmentation on Mobile Devices

3D Remote Healthcare for Noisy CT Images in the Internet of Things Using Edge Computing

Edge-Assisted Real-Time Instance Segmentation for Resource-Limited IoT Devices

CC-NET: Image Complexity Guided Network Compression for Biomedical Image Segmentation

What Happens on the Edge, Stays on the Edge: Toward Compressive Deep Learning

Semantic Communication Enabling Robust Edge Intelligence for Time-Critical IoT Applications

LDMRes-Net: Enabling Efficient Medical Image Segmentation on IoT and Edge Platforms

Efficient Hardware Implementation of Cellular Neural Networks with Incremental Quantization and Early Exit

An improved pulse coupled neural networks model for semantic IoT

Segmentation of medical images using an attention embedded lightweight network