Abstract:As the ultra-high frequency nature of lightwave corresponds to great potential in wideband signal processing, nextgeneration electronic information systems of surveillance, radar and communications is promised with photonic signal processing systems. However, the sophisticated photonic systems suffer from various hardware defects, which severely limit the performance of signal processing. By introducing the emerging deep learning technology into the photonic system, the hardware defects can be recovered by the trained neural networks. Using different modified neural networks, we have demonstrated high-accuracy photonic analog-to-digital converters, Brillouin instantaneous frequency measurement, and high-fidelity photonic radar receivers. The demonstrated systems with simple configurations can outperform the conventional photonic processing system with complex configurations. Note that the adoption of neural networks may cause additional time delay to the signal flow. Photonic neural network accelerators (PNNs) become a promising solution to realize real-time signal processing. We propose and experimentally demonstrate several system architectures of photonic convolutional neural networks. The photonic dot product unit architecture implements the basic operation in convolution neural networks. And an optical patching scheme is demonstrated to enhances the power efficiency of the input ports in PNNs. Performance evaluations show that the proposed PNN architectures possess potential advantages of energy efficiency and computational power. We believe that, by combining the technical advantages of photonic signal processing and PNN acceleration, intelligent photonic signal processing systems with high-performance real-time wideband signal processing capabilities can be realized. Moreover, the large-scale photonic integration technology promises the fabrication of such hybrid systems in the future.

Ultra‐Compact and NonVolatile Nanophotonic Neural Networks

Ultra-high Density and Nonvolatile Nanophotonic Convolution Processing Unit

Digit Recognition Based on Programmable Nanophotonic Processor

Electrically Programmable Phase-Change Photonic Memory for Optical Neural Networks with Nanoseconds in Situ Training Capability

Easily Scalable Photonic Tensor Core Based on Tunable Units with Single Internal Phase Shifters

Photonic Neural Networks and Its Applications

Clements-Enhanced Complex-Valued Coherent Mesh with Balanced Detection Units for Photonic Neural Networks

Nonlinear All-Optical Diffractive Deep Neural Network with 10.6 Μm Wavelength for Image Classification

Programmable low-threshold optical nonlinear activation functions for photonic neural networks

On-chip ultra-compact nonvolatile photonic synapse

Non-Volatile Photonic Synapse with Ultra-Low Insertion Loss for Deep Neural Network

Photonic neural field on a silicon chip: large-scale, high-speed neuro-inspired computing and sensing

On-chip Spiking Neural Networks Based on Add-Drop Ring Microresonators and Electrically Reconfigurable Phase-Change Material Photonic Switches

Investigations on intelligent photonic signal processing technology

Photonic Synapses for Image Recognition and High Density Integration of Simplified Artificial Neural Networks

Photonic Integrated Neuro-Synaptic Core for Convolutional Spiking Neural Network

Spatially Varying Nanophotonic Neural Networks

A complete, parallel and autonomous photonic neural network in a semiconductor multimode laser

End-to-End Optimization for a Compact Optical Neural Network Based on Nanostructured 2 x 2 Optical Processors

Nonlinear Germanium-Silicon Photodiode for Activation and Monitoring in Photonic Neuromorphic Networks

Optical mode division multiplexing inspired photonic neural network accelerator