Abstract:The computational demands of modern AI have spurred interest in optical neural networks (ONNs) which offer the potential benefits of increased speed and lower power consumption. However, current ONNs face various challenges,most significantly a limited calculation precision (typically around 4 bits) and the requirement for high-resolution signal format converters (digital-to-analogue conversions (DACs) and analogue-to-digital conversions (ADCs)). These challenges are inherent to their analog computing nature and pose significant obstacles in practical implementation. Here, we propose a digital-analog hybrid optical computing architecture for ONNs, which utilizes digital optical inputs in the form of binary words. By introducing the logic levels and decisions based on thresholding, the calculation precision can be significantly enhanced. The DACs for input data can be removed and the resolution of the ADCs can be greatly reduced. This can increase the operating speed at a high calculation precision and facilitate the compatibility with microelectronics. To validate our approach, we have fabricated a proof-of-concept photonic chip and built up a hybrid optical processor (HOP) system for neural network applications. We have demonstrated an unprecedented 16-bit calculation precision for high-definition image processing, with a pixel error rate (PER) as low as $1.8\times10^{-3}$ at an signal-to-noise ratio (SNR) of 18.2 dB. We have also implemented a convolutional neural network for handwritten digit recognition that shows the same accuracy as the one achieved by a desktop computer. The concept of the digital-analog hybrid optical computing architecture offers a methodology that could potentially be applied to various ONN implementations and may intrigue new research into efficient and accurate domain-specific optical computing architectures for neural networks.

On-chip photoelectric hybrid convolutional accelerator based on Bragg grating array

Optical Convolution Based Computational Method for Low-Power Image Processing

A Convolutional Neural Network Accelerator Architecture with Fine-Granular Mixed Precision Configurability.

Direct Optical Convolution Computing Based on Arrayed Waveguide Grating Router

Accelerating Convolutional Processing by Harnessing Channel Shifts in Arrayed Waveguide Gratings

Photonic convolution accelerator based on a hybrid integrated multi-wavelength laser array by photonic wire bonding for real-time image classification

Parallel Photonic Convolutional Processing On-Chip with Cross-Connect Architecture and Cyclic AWGs

On-chip photonic artificial intelligence accelerator

On-chip 4F-System Based on Concave Mirrors for Optical Neural Networks

Design of a Convolutional Neural Network Accelerator Based on On-Chip Data Reordering

Compact optical convolution processing unit based on multimode interference

High Throughput Multi-Channel Parallelized Diffraction Convolutional Neural Network Accelerator

PIXEL: Photonic Neural Network Accelerator

High-energy-efficiency integrated photonic convolutional neural networks

11 TeraFLOPs per second photonic convolutional accelerator for deep learning optical neural networks

Performance evaluation of an integrated photonic convolutional neural network based on delay buffering and wavelength division multiplexing

11 Tera-OPs/s Photonic Convolutional Accelerator and Deep Optical Neural Network Based on an Integrated Kerr Soliton Crystal Microcomb

High-Speed Optical Convolutional Neural Network Accelerator with 100 Gbaud EO-polymer/Si Hybrid Optical Modulator

Digital-analog hybrid matrix multiplication processor for optical neural networks

Hybrid optical convolutional neural network with convolution kernels trained in the spatial domain

A Winograd-based Integrated Photonics Accelerator for Convolutional Neural Networks