Abstract:As the ultra-high frequency nature of lightwave corresponds to great potential in wideband signal processing, nextgeneration electronic information systems of surveillance, radar and communications is promised with photonic signal processing systems. However, the sophisticated photonic systems suffer from various hardware defects, which severely limit the performance of signal processing. By introducing the emerging deep learning technology into the photonic system, the hardware defects can be recovered by the trained neural networks. Using different modified neural networks, we have demonstrated high-accuracy photonic analog-to-digital converters, Brillouin instantaneous frequency measurement, and high-fidelity photonic radar receivers. The demonstrated systems with simple configurations can outperform the conventional photonic processing system with complex configurations. Note that the adoption of neural networks may cause additional time delay to the signal flow. Photonic neural network accelerators (PNNs) become a promising solution to realize real-time signal processing. We propose and experimentally demonstrate several system architectures of photonic convolutional neural networks. The photonic dot product unit architecture implements the basic operation in convolution neural networks. And an optical patching scheme is demonstrated to enhances the power efficiency of the input ports in PNNs. Performance evaluations show that the proposed PNN architectures possess potential advantages of energy efficiency and computational power. We believe that, by combining the technical advantages of photonic signal processing and PNN acceleration, intelligent photonic signal processing systems with high-performance real-time wideband signal processing capabilities can be realized. Moreover, the large-scale photonic integration technology promises the fabrication of such hybrid systems in the future.

Ultra-high Density and Nonvolatile Nanophotonic Convolution Processing Unit

Ultra‐Compact and NonVolatile Nanophotonic Neural Networks

Easily Scalable Photonic Tensor Core Based on Tunable Units with Single Internal Phase Shifters

Photonic Neural Networks and Its Applications

Clements-Enhanced Complex-Valued Coherent Mesh with Balanced Detection Units for Photonic Neural Networks

Electrically Programmable Phase-Change Photonic Memory for Optical Neural Networks with Nanoseconds in Situ Training Capability

Microcomb-based integrated photonic processing unit

Programmable low-threshold optical nonlinear activation functions for photonic neural networks

Compact optical convolution processing unit based on multimode interference

Investigations on intelligent photonic signal processing technology

Inverse design of convolutional neural networks via nanophotonic kernels

Photonic Integrated Neuro-Synaptic Core for Convolutional Spiking Neural Network

Photonic neural field on a silicon chip: large-scale, high-speed neuro-inspired computing and sensing

Efficient Hardware Configuration Method for Photonic Neural Network with Genetic Algorithm

Diffraction‐Driven Parallel Convolution Processing with Integrated Photonics

Photonic Neural Network Fabricated on Thin Film Lithium Niobate for High-Fidelity and Power-Efficient Matrix Computation

Comb-based photonic neural population for parallel and nonlinear processing

Microdisk modulator-assisted optical nonlinear activation functions for photonic neural networks

Control-free and efficient integrated photonic neural networks via hardware-aware training and pruning

11 TOPS photonic convolutional accelerator for optical neural networks

Space-efficient optical computing with an integrated chip diffractive neural network