Abstract:Photonic neural networks have demonstrated their potential over the past decades, but have not yet reached the full extent of their capabilities. One reason for this lies in an essential component - the nonlinear activation function, which ensures that the neural network can perform the required arbitrary nonlinear transformation. The desired all-optical nonlinear activation function is difficult to realize, and as a result, most of the reported photonic neural networks rely on opto-electronic activation functions. Usually, the sacrifices made are the unique advantages of photonics, such as resource-efficient coherent and frequency-multiplexed information encoding. In addition, opto-electronic activation functions normally limit the photonic neural network depth by adding insertion losses. Here, we experimentally demonstrate an in-fiber photonic nonlinear activation function based on stimulated Brillouin scattering. Our design is coherent and frequency selective, making it suitable for multi-frequency neural networks. The optoacoustic activation function can be tuned continuously and all-optically between a variety of activation functions such as LeakyReLU, Sigmoid, and Quadratic. In addition, our design amplifies the input signal with gain as high as $20\,\mathrm{dB}$, compensating for insertion losses on the fly, and thus paving the way for deep optical neural networks.

Reconfigurable All-Optical Integrated Nonlinear Activator with Switchable Response Functions for Photonic Neural Networks

Programmable low-threshold optical nonlinear activation functions for photonic neural networks

Programmable All-optical Nonlinear Activation Functions Based on a Micro-ring Resonator with Phase-change Materials

Optical Nonlinear Activation Functions Based on MZI-Structure for Optical Neural Networks

All-Optical Nonlinear Activators Using Silicon-Based Waveguides and Microring Resonators for Photonic Neural Networks

Inverse-designed Integrated All-optical Nonlinear Activators for Optical Computing

All-optical nonlinear activation function based on stimulated Brillouin scattering

SOA-based All-Optical Neuron with Reconfigurable Nonlinear Activation Functions

All-optical Nonlinear Activator for Optical Neural Network with Low Threshold Power and Ultrafast Response Speed

Experimental Realization of Arbitrary Activation Functions for Optical Neural Networks

A High-Stability All-Optical Nonlinear Activator for Optical Computing

All-Optical, Reconfigurable and Power Independent Neural Activation Function by Means of Phase Modulation

Electrically Programmable Phase-Change Photonic Memory for Optical Neural Networks with Nanoseconds in Situ Training Capability

Multiplexable all-optical nonlinear activator for optical computing

All-optical neural network with nonlinear activation functions

All-optical neural network nonlinear activation function based on the optical bistability within a micro-ring resonator

Graphene/silicon heterojunction for reconfigurable phase-relevant activation function in coherent optical neural networks

Efficient Nonlinear Activation Function in Optical Neural Network

Photonic Neural Activation Function Based on High-Speed Electro-Absorption Modulated Laser

Artificial Neuron Based on Nonlinear Polarization Rotation in a Semiconductor Optical Amplifier