Abstract:The computational demands of modern AI have spurred interest in optical neural networks (ONNs) which offer the potential benefits of increased speed and lower power consumption. However, current ONNs face various challenges,most significantly a limited calculation precision (typically around 4 bits) and the requirement for high-resolution signal format converters (digital-to-analogue conversions (DACs) and analogue-to-digital conversions (ADCs)). These challenges are inherent to their analog computing nature and pose significant obstacles in practical implementation. Here, we propose a digital-analog hybrid optical computing architecture for ONNs, which utilizes digital optical inputs in the form of binary words. By introducing the logic levels and decisions based on thresholding, the calculation precision can be significantly enhanced. The DACs for input data can be removed and the resolution of the ADCs can be greatly reduced. This can increase the operating speed at a high calculation precision and facilitate the compatibility with microelectronics. To validate our approach, we have fabricated a proof-of-concept photonic chip and built up a hybrid optical processor (HOP) system for neural network applications. We have demonstrated an unprecedented 16-bit calculation precision for high-definition image processing, with a pixel error rate (PER) as low as $1.8\times10^{-3}$ at an signal-to-noise ratio (SNR) of 18.2 dB. We have also implemented a convolutional neural network for handwritten digit recognition that shows the same accuracy as the one achieved by a desktop computer. The concept of the digital-analog hybrid optical computing architecture offers a methodology that could potentially be applied to various ONN implementations and may intrigue new research into efficient and accurate domain-specific optical computing architectures for neural networks.

Neighborhood Operation Binary Image Algebra and Its Optical Implementation

Neighborhood Operation Binary Image Algebra for Optical Morphological Image Processing

The Realization Of Parallel Subtraction Using Lclv In Optical Neural Network

Compact Optical Morphological Image Processor With Single Operation Mode

Neighborhood operation gray-scale image algebra for optical morphological image processing

Theory and Application of Image Neighborhood Parallel Processing.

Resource-Saving and High-Robustness Image Sensing Based on Binary Optical Computing

Developed, Binary, Image Processing in a Dual-Channel, Optical, Real-Time Morphological Processor

Direct Optical Convolution Computing Based on Arrayed Waveguide Grating Router

On-chip 4F-System Based on Concave Mirrors for Optical Neural Networks

Optical Architecture for Implementing Image-Template Operations of Image Algebra

Compact optical convolution processing unit based on multimode interference

A Parallel Photonic Chip for Nano-Second End-to-end Image Processing, Transmission, and Reconstruction

An optical neural chip for implementing complex-valued neural network

Novel gray image processing in a single operation optical morphological processor

Space-efficient optical computing with an integrated chip diffractive neural network

Integrated multi-operand optical neurons for scalable and hardware-efficient deep learning

Digital-analog hybrid matrix multiplication processor for optical neural networks

All-Optical Computing Based on Convolutional Neural Networks

When Optical Microscopy Meets All-Optical Analog Computing: A Brief Review