Abstract:As well known, fully convolutional network (FCN) becomes the state of the art for semantic segmentation in deep learning. Currently, new hardware designs for deep learning have focused on improving the speed and parallelism of processing units. This motivates memristive solutions, in which the memory units (i.e., memristors) have computing capabilities. However, designing a memristive deep learning network is challenging, since memristors work very differently from the traditional CMOS hardware. This paper proposes a complete solution to implement memristive FCN (MFCN). Voltage selectors are firstly utilized to realize max-pooling layers with the detailed MFCN deconvolution hardware circuit by the massively parallel structure, which is effective since the deconvolution kernel and the input feature are similar in size. Then, deconvolution calculation is realized by converting the image into a column matrix and converting the deconvolution kernel into a sparse matrix. Meanwhile, the convolution realization in MFCN is also studied with the traditional sliding window method rather than the large matrix theory to overcome the shortcoming of low efficiency. Moreover, the conductance values of memristors are predetermined in Tensorflow with ex-situ training method. In other words, we train MFCN in software, then download the trained parameters to the simulink system by writing memristor. The effectiveness of the designed MFCN scheme is verified with improved accuracy over some existing machine learning methods. The proposed scheme is also adapt to LFW dataset with three-classification tasks. However, the MFCN training is time consuming as the computational burden is heavy with thousands of weight parameters with just six layers. In future, it is necessary to sparsify the weight parameters and layers of the MFCN network to speed up computing.

Memristor-Based MobileNetV3 Circuit Design for Image Classification

Memristor-Based Edge Computing of ShuffleNetV2 for Image Classification

Memristive DeepLab: A hardware friendly deep CNN for semantic segmentation

Efficient Low-Bit Neural Network with Memristor-Based Reconfigurable Circuits

Memristive Fully Convolutional Network: an Accurate Hardware Image-Segmentor in Deep Learning

Hybrid Dual-Complementary Metal-Oxide-semiconductor/memristor Synapse-Based Neural Network with Its Applications in Image Super-Resolution

High-Performance Convolutional Neural Network Emulation Via Fpga-Integrated Memristive Circuitry

BETTER: Bayesian-Based Training and Lightweight Transfer Architecture for Reliable and High-Speed Memristor Neural Network Deployment

Dynamic neural network with memristive CIM and CAM for 2D and 3D vision

Semantic memory-based dynamic neural network using memristive ternary CIM and CAM for 2D and 3D vision

Performance estimation for the memristor-based computing-in-memory implementation of extremely factorized network for real-time and low-power semantic segmentation

Memristor-Based Cellular Nonlinear/Neural Network: Design, Analysis, and Applications

Color Image Edge Extraction Using Memristor-Based CNN

Memristor-Based Lstm Network For Text Classification

Pruning and quantization algorithm with applications in memristor-based convolutional neural network

Redundancy-Reduced MobileNet Acceleration on Reconfigurable Logic for ImageNet Classification

Memristor‐Based Analog Computation and Neural Network Classification with a Dot Product Engine

A Memristor-Based Processing-in-Memory Architecture for Deep Convolutional Neural Networks Approximate Computation

On-Chip Learning with Memristor-Based Neural Networks: Assessing Accuracy and Efficiency Under Device Variations, Conductance Errors, and Input Noise

Memristor-Based Design of Sparse Compact Convolutional Neural Network

In Situ Training of Feed-Forward and Recurrent Convolutional Memristor Networks