Abstract:Convolutional neural networks (CNNs) is becoming a critical role for deep learning-based computer vision applications. Through CNN we can extract meaningful information out of massive sensor data. Vision applications use this information to analyze the mainstream trends of the data and take immediate action based on these trends. However, CNN's energy consumption and bandwidth limitations make it difficult for CNN network systems to deploy in mobile systems with stringent energy limits. In this paper, we explore the simulation and the hardware method of optical convolution for low power image processing, which is inspired by the bio-image sensor Angle sensitive pixel (ASP). This optical computation method may be used to substitute the first convolution layer of the CNN network due to its energy-saving features and speed of light processing time. We adopt two-layer of customized transmission grating to perform this optical convolution computing. By generating the Talbot effect, the two-layer grating structure can perform optical convolution computation using Gabor wavelet filters, which will cause zero electrical power. We demonstrate both simulation and experiment results for optical convolution through our algorithm and prototype system, the convolution results can extract different meaningful information about the original image, which is very similar to edge filtering. This optical operation will hopefully be used to replace the first convolution layer of CNN since it can effectively reduce both the consumption of the energy power and the performing time.

Optical Image Decomposition and Noise Filtering Based on Laguerre-Gaussian Modes

High-quality Reconstruction of an Optical Image by an Efficient Laguerre-Gaussian Mode Decomposition Method

An Improved Non-local Means Image De-noising Algorithm Using Mahalanobis Distance

Optical Convolution Based Computational Method for Low-Power Image Processing

L0 image smoothing via iterating truncated L1 gradient regularization

Exploiting Image Local and Nonlocal Consistency for Mixed Gaussian-Impulse Noise Removal

Quality Adaptive Low-Rank Based JPEG Decoding with Applications

A Multi-Scale Non-Uniformity Correction Method Based on Wavelet Decomposition and Guided Filtering for Uncooled Long Wave Infrared Camera.

Edge-Aware Volume Smoothing Using L0 Gradient Minimization

Mixed Gaussian-impulse noise removal using non-convex high-order TV penalty

Image quality enhancement using original lens via optical computing.

Joint Low-Light Image Enhancement and Denoising via a New Retinex-Based Decomposition Model

Laguerre-Gaussian transform for rotating image processing

Unveiling Advanced Frequency Disentanglement Paradigm for Low-Light Image Enhancement

Laguerre–Gaussian-Domain Rotational Image Restoration Beyond the Camera Response

Low-Light Image Enhancement via Retinex-Style Decomposition of Denoised Deep Image Prior

Lidar Full-Waveform Decomposition Based on the Empirical Mode Decomposition and Gaussian Function Model

ERD: Exponential Retinex decomposition based on weak space and hybrid nonconvex regularization and its denoising application

Low-light image enhancement based on variational image decomposition

Dual-Output Mode Analysis of Multimode Laguerre-Gaussian Beams Via Deep Learning

Image Lag Elimination Algorithm for Pulse-Sequence-Based High-Speed Image Sensor