Abstract:We propose a novel photonic accelerator architecture based on a broadcast-and-weight approach for a deep neural network through a photonic integrated cross-connect. The single neuron and the complete neural network operation are numerically simulated. The weight calibration and weighted addition are reproduced and demonstrated to behave as in the experimental measurements. A dynamic range higher than 25 dB is predicted, in line with the measurements. The weighted addition operation is also simulated and analyzed as a function of the optical crosstalk and the number of input colors involved. In particular, while an increase in optical crosstalk negatively influences the simulated error, a greater number of channels results in better performance. The iris flower classification problem is solved by implementing the weight matrix of a trained three-layer deep neural network. The performance of the corresponding photonic implementation is numerically investigated by tuning the optical crosstalk and waveguide loss, in order to anticipate energy consumption per operation. The analysis of the prediction error as a function of the optical crosstalk per layer suggests that the first layer is essential to the final accuracy. The ultimate accuracy shows a quasi-linear dependence between the prediction accuracy and the errors per layer for a normalized root mean square error lower than 0.09, suggesting that there is a maximum level of error permitted at the first layer for guaranteeing a final accuracy higher than 89%. However, it is still possible to find good local minima even for an error higher than 0.09, due to the stochastic nature of the network we are analyzing. Lower levels of path losses allow for half the power consumption at the matrix multiplication unit, for the same error level, offering opportunities for further improved performance. The good agreement between the simulations and the experiments offers a solid base for studying the scalability of this kind of network.

Higher-Accuracy Photonic Neural Networks via Duplication Schemes for Noise Reduction

Countering Variations and Thermal Effects for Accurate Optical Neural Networks.

An optical neural network using less than 1 photon per multiplication

Numerical Simulation of an InP Photonic Integrated Cross-Connect for Deep Neural Networks on Chip

Noise-Resilient Designs for Optical Neural Networks

Digital-analog hybrid matrix multiplication processor for optical neural networks

Mixed-precision quantization-aware training for photonic neural networks

Single-shot optical neural network

Noise-resilient and high-speed deep learning with coherent silicon photonics

PIXEL: Photonic Neural Network Accelerator

Silicon microring synapses enable photonic deep learning beyond 9-bit precision

Quantum-noise-limited optical neural networks operating at a few quanta per activation

Bayesian Photonic Accelerators for Energy Efficient and Noise Robust Neural Processing

InP Photonic Integrated Multi-Layer Neural Networks: Architecture and Performance Analysis

A Compact Butterfly-Style Silicon Photonic–Electronic Neural Chip for Hardware-Efficient Deep Learning

A spiking photonic neural network of 40.000 neurons, trained with rank-order coding for leveraging sparsity

Photonic Neuromorphic Accelerator for Convolutional Neural Networks based on an Integrated Reconfigurable Mesh

Noisy Machines: Understanding Noisy Neural Networks and Enhancing Robustness to Analog Hardware Errors Using Distillation

Experimentally realized in situ backpropagation for deep learning in photonic neural networks

Emulation and Modelling of Semiconductor Optical Amplifier-Based All-Optical Photonic Integrated Deep Neural Network with Arbitrary Depth.

Optimizing Coherent Integrated Photonic Neural Networks under Random Uncertainties