Abstract:We demonstrate an integrated opto-electronic (ΟΕ) device that can be programmed to provide a set of nonlinear activation functions (AFs) and present its operation within programmable tanh- and ELU-based photonic neurons at line rates up to 10 GBd. The OE activation module provides a set of well-known activation functions that are typically used in DL training models, including the tanh-, ELU- and inverted ELU-like functions. Its performance is experimentally evaluated when incorporated in a 4-input wavelength division multiplexed (WDM) photonic neuron and operating with non-deterministic data patterns, providing “noisy” tanh, ELU and inverted ELU AFs with an error-distribution that has in all cases a standard deviation of <0.49. We also evaluate the trainability of these “noisy” AFs and present for the first time an optics-informed training framework that incorporates the pattern-induced AF variations into the training process, yielding the first noise-aware training scheme where the noise emerges at the nonlinear AF NN segment. The performance analysis of the optics-informed training framework for all three AFs was carried out via Deep Learning setups suitable for classifying the Fashion MNIST and the CIFAR-10 datasets. This analysis has shown that the employment of traditional training schemes leads to significant accuracy degradations, which can be, however, almost completely waived when employing the optics-informed training framework, leading to accuracy values that are almost identical to the reference accuracy values obtained when ideal and noise-less AFs are used.

Harnessing Optoelectronic Noises in a Photonic Generative Network

Photonic diffractive generators through sampling noises from scattering media

Electrically Programmable Phase-Change Photonic Memory for Optical Neural Networks with Nanoseconds in Situ Training Capability

Scalable photonic diffractive generators through sampling noises from scattering medium

Demonstration of Quantum Generative Adversarial Network with a Silicon Photonic Chip

Quantum generative adversarial learning in photonics

Large-scale photonic computing with nonlinear disordered media

Programmable low-threshold optical nonlinear activation functions for photonic neural networks

Photonic Neural Networks and Its Applications

Efficient Hardware Configuration Method for Photonic Neural Network with Genetic Algorithm

Noise-resilient and high-speed deep learning with coherent silicon photonics

High-performance Optoelectronics for Integrated Photonic Neural Networks

Self-powered Photonic Synapses with Rapid Optical Erasing Ability for Neuromorphic Visual Perception

Seven Bit Nonvolatile Electrically Programmable Photonics Based on Phase-Change Materials for Image Recognition

Massively scalable wavelength diverse integrated photonic linear neuron

Experimentally realized in situ backpropagation for deep learning in photonic neural networks

Integrated Photonic Neural Networks: Opportunities and Challenges

Photonic probabilistic machine learning using quantum vacuum noise

Photonic Multiplexing Techniques for Neuromorphic Computing

Programmable Tanh- and ELU-based Photonic Neurons in Optics-Informed Neural Networks

A Compact Butterfly-Style Silicon Photonic–Electronic Neural Chip for Hardware-Efficient Deep Learning