Abstract:The recent explosive compute growth, mainly fueled by the boost of AI and DNNs, is currently instigating the demand for a novel computing paradigm that can overcome the insurmountable barriers imposed by conventional electronic computing architectures. PNNs implemented on silicon integration platforms stand out as a promising candidate to endow NN hardware, offering the potential for energy efficient and ultra-fast computations through the utilization of the unique primitives of photonics i.e. energy efficiency, THz bandwidth and low-latency. Thus far, several demonstrations have revealed the huge potential of PNNs in performing both linear and non-linear NN operations at unparalleled speed and energy consumption metrics. Transforming this potential into a tangible reality for DL applications requires, however, a deep understanding of the basic PNN principles, requirements and challenges across all constituent architectural, technological and training aspects. In this tutorial, we, initially, review the principles of DNNs along with their fundamental building blocks, analyzing also the key mathematical operations needed for their computation in a photonic hardware. Then, we investigate, through an intuitive mathematical analysis, the interdependence of bit precision and energy efficiency in analog photonic circuitry, discussing the opportunities and challenges of PNNs. Followingly, a performance overview of PNN architectures, weight technologies and activation functions is presented, summarizing their impact in speed, scalability and power consumption. Finally, we provide an holistic overview of the optics-informed NN training framework that incorporates the physical properties of photonic building blocks into the training process in order to improve the NN classification accuracy and effectively elevate neuromorphic photonic hardware into high-performance DL computational settings.

Noise-resilient and high-speed deep learning with coherent silicon photonics

Neuromorphic Silicon Photonics and Hardware-Aware Deep Learning for High-Speed Inference

Silicon Photonic Architecture for Training Deep Neural Networks with Direct Feedback Alignment

A Silicon Photonic Coherent Neuron with 10GMAC/sec processing line-rate

A Survey on Silicon Photonics for Deep Learning

Single chip photonic deep neural network with accelerated training

Experimentally realized in situ backpropagation for deep learning in photonic neural networks

Massively scalable wavelength diverse integrated photonic linear neuron

Deep Learning with Photonic Neural Cellular Automata

Channel response-aware photonic neural network accelerators for high-speed inference through bandwidth-limited optics

Deep learning with coherent VCSEL neural networks

A complete, parallel and autonomous photonic neural network in a semiconductor multimode laser

PIXEL: Photonic Neural Network Accelerator

InP Photonic Integrated Multi-Layer Neural Networks: Architecture and Performance Analysis

Programmable Tanh- and ELU-based Photonic Neurons in Optics-Informed Neural Networks

An on-chip photonic deep neural network for image classification

Multiwavelength Neuromorphic Silicon Photonics

Photonic Neural Networks and Optics-informed Deep Learning Fundamentals

BPLight-CNN: A Photonics-Based Backpropagation Accelerator for Deep Learning

Bitwise Neural Network Acceleration Using Silicon Photonics