Abstract:Convolutional neural networks (CNNs) is becoming a critical role for deep learning-based computer vision applications. Through CNN we can extract meaningful information out of massive sensor data. Vision applications use this information to analyze the mainstream trends of the data and take immediate action based on these trends. However, CNN's energy consumption and bandwidth limitations make it difficult for CNN network systems to deploy in mobile systems with stringent energy limits. In this paper, we explore the simulation and the hardware method of optical convolution for low power image processing, which is inspired by the bio-image sensor Angle sensitive pixel (ASP). This optical computation method may be used to substitute the first convolution layer of the CNN network due to its energy-saving features and speed of light processing time. We adopt two-layer of customized transmission grating to perform this optical convolution computing. By generating the Talbot effect, the two-layer grating structure can perform optical convolution computation using Gabor wavelet filters, which will cause zero electrical power. We demonstrate both simulation and experiment results for optical convolution through our algorithm and prototype system, the convolution results can extract different meaningful information about the original image, which is very similar to edge filtering. This optical operation will hopefully be used to replace the first convolution layer of CNN since it can effectively reduce both the consumption of the energy power and the performing time.

FAST ALGORITHM FOR DCT DOMAIN IMAGE UP-CONVERSION

An Adaptive Deblocking Algorithm Based on DCT Domain

A novel high performance discrete cosine transform algorithm based on the stochastic computation

Optical Convolution Based Computational Method for Low-Power Image Processing

Efficient DCT-based Image Retargeting in Compressed Domain.

Fast Non-Local Algorithm for Image Denoising

A Block-Dct Based Edge Detection Algorithm

A fast algorithm of 4-point floating DCT in image/video compression

Fast algorithms for multidimensional DCT-to-DCT computation between a block and its associated subblocks

Fast Algorithm for DCT Domain Downsampling in AVS

Digital Image Correlation Based on a Fast Convolution Strategy

An Algorithm for Computing DCT Using Improved Arithmetic Fourier Transform

A fast scheme for converting DCT coefficients to H.264/AVC integer transform coefficients

Matrix Factorization for Fast DCT Algorithms

SVD Based Linear Filtering in DCT Domain.

Block DCT filtering using vector processing

EXTRACTING SIFT KEYPOINTS IN DCT DOMAIN

Discrete Cosine Transform Coefficients Based Scan Format Conversion

A Fast and Memory Efficient Algorithm for Down-Conversion of an HDTV Bitstream to an SDTV Signal

Video Transcoder in DCT-Domain Spatial Resolution Reduction Using Low-Complexity Motion Vector Refinement Algorithm

Techniques For Efficient Dct/Idct Implementation On Generic Gpu