Abstract:An emerging generative artificial intelligence (AI) based on neural networks starts to grow in popularity with a revolutionizing capability of creating new and original content. As giant generative models with millions to billions of parameters are developed, trained and maintained, a massive and energy-efficient computing power is highly required. However, conventional digital computers are struggling to keep up with the pace of the generative model improvements. In this paper, we propose and demonstrate high-throughput optical neural networks based on temporal computing. The core weighted summation operation is realized with the use of high-speed electro-optic modulation and low-speed balanced photodetection. The input data and weight are encoded in a time sequence separately and loaded on an optical signal via two electro-optic modulators sequentially. By precisely controlling the synchronization time of the data and weight loading, the matrix multiplication is performed. Followed by a balanced photodetector, the summation is conducted, thanks to the electron accumulation of the inherent electronic integrator circuit of the low-speed photodetector. Thus, the linear weighted summation operation is implemented based on temporal computing in the optical domain. With the proposed optical linear weighted summation, a fully-connected neural network and convolutional neural network are realized. Thanks to the high-speed feature of temporal computing, a high data throughput of the optical neural network is experimentally demonstrated, and the weighting coefficients can be specified on demand, which enables a strong programmability of the optical neural network. By leveraging wavelength multiplexing technology, a scalable optical neural network could be created with a massive computing power and strong reconfigurability, which holds great potential for future giant AI applications.

Wavelength-Space Domain High-Throughput Artificial Neural Networks by Parallel Photoelectric Matrix Multiplier

Parallel Photonic Acceleration Processor for Matrix-Matrix Multiplication

An Implementation of Complex-Valued Matrix-Vector Multiplication Based on MZI Array for Photonic Neural Networks

An Optical Neural Network Architecture based on Highly Parallelized WDM-Multiplier-Accumulator

Photonic Neural Networks and Its Applications

Clements-Enhanced Complex-Valued Coherent Mesh with Balanced Detection Units for Photonic Neural Networks

Hardware-implemented Photonic Neural Network for High-throughput and Low-latency Image Transmission

Easily Scalable Photonic Tensor Core Based on Tunable Units with Single Internal Phase Shifters

InP Photonic Integrated Multi-Layer Neural Networks: Architecture and Performance Analysis

Experimentally realized in situ backpropagation for deep learning in photonic neural networks

Waveguide-multiplexed photonic matrix-vector multiplication processor using multiport photodetectors

PIXEL: Photonic Neural Network Accelerator

Design and Control of a Photonic Neural Network Applied to High-Bandwidth Classification

Multi-dimensional optical neural network

Massively scalable wavelength diverse integrated photonic linear neuron

Spatially Varying Nanophotonic Neural Networks

A complete, parallel and autonomous photonic neural network in a semiconductor multimode laser

High-throughput optical neural networks based on temporal computing

Comb-based photonic neural population for parallel and nonlinear processing

An Electro-Photonic System for Accelerating Deep Neural Networks

Bitwise Neural Network Acceleration Using Silicon Photonics