Abstract:The relentless growth of Artificial Intelligence (AI) workloads has fueled the drive towards non-Von Neuman architectures and custom computing hardware. Neuromorphic photonic engines aspire to synergize the low-power and high-bandwidth credentials of light-based deployments with novel architectures, towards surpassing the computing performance of their electronic counterparts. In this paper, we review recent progress in integrated photonic neuromorphic architectures and analyze the architectural and photonic hardware-based factors that limit their performance. Subsequently, we present our approach towards transforming silicon coherent neuromorphic layouts into high-speed and high-accuracy Deep Learning (DL) engines by combining robust architectures with hardware-aware DL training. Circuit robustness is ensured through a crossbar layout that circumvents insertion loss and fidelity constraints of state-of-the-art linear optical designs. Concurrently, we employ DL training models adapted to the underlying photonic hardware, incorporating noise- and bandwidth-limitations together with the supported activation function directly into Neural Network (NN) training. We validate experimentally the high-speed and high-accuracy advantages of hardware-aware DL models when combined with robust architectures through a SiPho prototype implementing a single column of a 4:4 photonic crossbar. This was utilized as the pen-ultimate hidden layer of a NN, revealing up to 5.93 accuracy improvement at 5GMACsecaxon when noise-aware training is enforced and allowing accuracies of 99.15 and 79.8 for the MNIST and CIFAR-10 classification tasks. Channel-aware training was then demonstrated by integrating the frequency response of the photonic hardware in NN training, with its experimental validation with the MNIST dataset revealing an accuracy increase of 12.93 at a record-high rate of 25GMACsecaxon.

Neuromorphic Photonic Networks

Neuromorphic Silicon Photonics for Artificial Intelligence

Integrated Neuromorphic Photonics: Synapses, Neurons, and Neural Networks

Photonics for artificial intelligence and neuromorphic computing

Neuromorphic Photonics: 2D or Not 2D?

Photonics for Neuromorphic Computing: Fundamentals, Devices, and Opportunities

Photonic Multiplexing Techniques for Neuromorphic Computing

Research Progress on Photonic Neuromorphic Computing

Intelligent neuromorphic computing based on nanophotonics and metamaterials

Photonic Neural Networks and Its Applications

All-optical spiking neurosynaptic networks with self-learning capabilities

Recent Progress of Neuromorphic Computing Based on Silicon Photonics: Electronic–Photonic Co-Design, Device, and Architecture

High-performance Optoelectronics for Integrated Photonic Neural Networks

Progress and Prospects of Photonic Neuromorphic Computing(Invited)

Semiconductor Lasers for Photonic Neuromorphic Computing and Photonic Spiking Neural Networks: A Perspective

Neuromorphic Silicon Photonics and Hardware-Aware Deep Learning for High-Speed Inference

Recent Progress in Photonic Synapses for Neuromorphic Systems

Dynamic Electro-Optic Analog Memory for Neuromorphic Photonic Computing

Towards Silicon Photonic Neural Networks for Artificial Intelligence