Abstract:As the ultra-high frequency nature of lightwave corresponds to great potential in wideband signal processing, nextgeneration electronic information systems of surveillance, radar and communications is promised with photonic signal processing systems. However, the sophisticated photonic systems suffer from various hardware defects, which severely limit the performance of signal processing. By introducing the emerging deep learning technology into the photonic system, the hardware defects can be recovered by the trained neural networks. Using different modified neural networks, we have demonstrated high-accuracy photonic analog-to-digital converters, Brillouin instantaneous frequency measurement, and high-fidelity photonic radar receivers. The demonstrated systems with simple configurations can outperform the conventional photonic processing system with complex configurations. Note that the adoption of neural networks may cause additional time delay to the signal flow. Photonic neural network accelerators (PNNs) become a promising solution to realize real-time signal processing. We propose and experimentally demonstrate several system architectures of photonic convolutional neural networks. The photonic dot product unit architecture implements the basic operation in convolution neural networks. And an optical patching scheme is demonstrated to enhances the power efficiency of the input ports in PNNs. Performance evaluations show that the proposed PNN architectures possess potential advantages of energy efficiency and computational power. We believe that, by combining the technical advantages of photonic signal processing and PNN acceleration, intelligent photonic signal processing systems with high-performance real-time wideband signal processing capabilities can be realized. Moreover, the large-scale photonic integration technology promises the fabrication of such hybrid systems in the future.

Programmable artificial intelligence machine for wave sensing and communications

Machine-learning Reprogrammable Metasurface Imager.

A programmable diffractive deep neural network based on a digital-coding metasurface array

Intelligent Beamforming Via Physics-Inspired Neural Networks on Programmable Metasurface

Artificial Intelligence Metamaterials

A Brain-Inspired In-Memory Computing System for Neuronal Communication Via Memristive Circuits.

Key Technologies of Photonic Artificial Intelligence Chip Structure and Algorithm

Intelligent Metasurface Imager and Recognizer

Metasurface-enabled on-chip multiplexed diffractive neural networks in the visible

Metamaterial-Based Analog Recurrent Neural Network Toward Machine Intelligence

Intelligent neuromorphic computing based on nanophotonics and metamaterials

Programmable Surface Plasmonic Neural Networks for Microwave Detection and Processing

Intelligent Meta-Imagers: From Compressed to Learned Sensing

Metamaterial-Based Analog Recurrent Neural Network Toward Machine

An Integrated All-Optical Multimodal Learning Engine Built by Reconfigurable Phase-Change Meta-Atoms.

Meta-neural-network for real-time and passive deep-learning-based object recognition

Artificial Intelligence in Metamaterial Informatics for Sonic Frequency Mechanical Identification Tags

Intelligent Imaging and Sensing based on Programmable Metasurface

Investigations on intelligent photonic signal processing technology

Multiwavelength Neuromorphic Silicon Photonics

Adaptive and Flexible Model-Based AI for Deep Receivers in Dynamic Channels