Abstract:The high demand for machine intelligence of doubling every three months is driving novel hardware solutions beyond charging of electrical wires given a resurrection to application specific integrated circuit (ASIC)-based accelerators. These innovations include photonic ASICs (P-ASIC) due to prospects of performing optical linear (and also nonlinear) operations, such as multiply-accumulate for vector matrix multiplications or convolutions, without iterative architectures. Such photonic linear algebra enables picosecond delay when photonic integrated circuits are utilized, via on-the-fly mathematics. However, the neurons full function includes providing a nonlinear activation function, knowns as thresholding, to enable decision making on inferred data. Many P-ASIC solutions performing this nonlinearity in the electronic domain, which brings challenges in terms of data throughput and delay, thus breaking the optical link and introducing increased system complexity via domain crossings. This work follows the notion of utilizing enhanced light-matter-interactions to provide efficient, compact, and engineerable electro-optic neuron nonlinearity. Here, we introduce and demonstrate a novel electro-optic device to engineer the shape of this optical nonlinearity to resemble a rectifying linear unit (ReLU) - the most-commonly used nonlinear activation function in neural networks. We combine the counter-directional transfer functions from heterostructures made out of two electro-optic materials to design a diode-like nonlinear response of the device. Integrating this nonlinearity into a photonic neural network, we show how the electrostatics of this thresholders gating junction improves machine learning inference accuracy and the energy efficiency of the neural network.

Application of a reconfigurable all-optical activation unit based on optical injection into a bistable Fabry–Perot laser in multilayer perceptron neural networks

Application of Reconfigurable All-Optical Activation Unit based on Optical Injection into Bistable Fabry-Pérot Laser in Multilayer Perceptron Neural Networks

Reconfigurable All-Optical Integrated Nonlinear Activator with Switchable Response Functions for Photonic Neural Networks

Programmable low-threshold optical nonlinear activation functions for photonic neural networks

Optical ReLU-like Activation Function Based on a Semiconductor Laser with Optical Injection

Optical Nonlinear Activation Functions Based on MZI-Structure for Optical Neural Networks

All-optical nonlinear activation function based on stimulated Brillouin scattering

Optical Implementation of Neural Learning Algorithms Based on Cross-gain Modulation in a Semiconductor Optical Amplifier

All-Optical Nonlinear Activators Using Silicon-Based Waveguides and Microring Resonators for Photonic Neural Networks

All-optical Bistable Switching and Signal Regeneration in a Semiconductor Layered Distributed-Feedback/fabry–perot Structure

Reconfigurable electro-optical logic gates using a 2-layer multilayer perceptron

All-Optical Excitable Spiking Laser Neuron in InP Generic Integration Technology

All-optical neural network nonlinear activation function based on the optical bistability within a micro-ring resonator

All-Optical, Reconfigurable and Power Independent Neural Activation Function by Means of Phase Modulation

Electrically Programmable Phase-Change Photonic Memory for Optical Neural Networks with Nanoseconds in Situ Training Capability

An ITO Graphene hybrid integrated absorption modulator on Si-photonics for neuromorphic nonlinear activation

Graphene/silicon heterojunction for reconfigurable phase-relevant activation function in coherent optical neural networks

A complete, parallel and autonomous photonic neural network in a semiconductor multimode laser

InP Photonic Integrated Multi-Layer Neural Networks: Architecture and Performance Analysis