Abstract:Non-von-Neumann computing architectures and Deep Learning training models have sparked a new computational era where neurons are forming the main architectural backbone and vector, matrix and tensor multiplications comprise the basic mathematical toolbox. This paradigm shift has triggered a new race among hardware technology candidates; within this frame, the field of neuromorphic photonics promises to convolve the targeted algebraic portfolio along a computational circuitry with unique speed, parallelization, and energy efficiency advantages. Fueled by the inherent energy efficient analog matrix multiply operations of optics, the staggering advances of photonic integration and the enhanced multiplexing degrees offered by light, neuromorphic photonics has stamped the resurgence of optical computing brining a unique perspective in low-energy and ultra-fast linear algebra functions. However, the field of neuromorphic photonics has relied so far on two basic architectural schemes, i.e., coherent linear optical circuits and incoherent WDM approaches, where wavelengths have still not been exploited as a new mathematical dimension. In this paper, we present a radically new approach for promoting the synergy of WDM with universal linear optics and demonstrate a new, high-fidelity crossbar-based neuromorphic photonic platform, able to support matmul with multidimensional operands. Going a step further, we introduce the concept of programmable input and weight banks, supporting in situ reconfigurability, forming in this way the first WDM-equipped universal linear optical operator and demonstrating different operational modes like matrix-by-matrix and vector-by-tensor multiplication. The benefits of our platform are highlighted in a Fully Convolutional Neural Network layout that is responsible for parity identification in the MNIST handwritten digit dataset, with physical layer simulations revealing an accuracy of ~94%, degraded by only 2% compared to respective results obtained when executed entirely by software. Finally, our in-depth analysis provides the guidelines for neuromorphic photonic processor performance improvement, revealing along the way that 4-bit quantization is sufficient for inputs, whereas the weights can be implemented with as low as 2-bits of precision, offering substantial benefits in terms of driving circuitry complexity and energy savings.

Photonic extreme learning machine by free-space optical propagation

Photonic Extreme Learning Machine based on frequency multiplexing

An array of microresonators as a Photonic Extreme Learning Machine

Optical Implementation of Neural Learning Algorithms Based on Cross-gain Modulation in a Semiconductor Optical Amplifier

Programmable Photonic Extreme Learning Machines

All-optical spiking neurosynaptic networks with self-learning capabilities

Photonic neuromorphic architecture for tens-of-task lifelong learning

Fully forward mode training for optical neural networks

Electrically Programmable Phase-Change Photonic Memory for Optical Neural Networks with Nanoseconds in Situ Training Capability

Large-Scale Optical Neural Networks based on Photoelectric Multiplication

Deep Learning with Coherent Nanophotonic Circuits

Large-scale photonic computing with nonlinear disordered media

Deep Learning with Photonic Neural Cellular Automata

WDM equipped universal linear optics for programmable neuromorphic photonic processors

Experimentally realized in situ backpropagation for deep learning in photonic neural networks

A complete, parallel and autonomous photonic neural network in a semiconductor multimode laser

An optically accelerated extreme learning machine using hot atomic vapors

A photonic complex perceptron for ultrafast data processing

Emergent self-adaptation in an integrated photonic neural network for backpropagation-free learning

Device‐System End‐to‐End Design of Photonic Neuromorphic Processor Using Reinforcement Learning

Compatible Learning for Deep Photonic Neural Network