Abstract:Photonic neural networks have demonstrated their potential over the past decades, but have not yet reached the full extent of their capabilities. One reason for this lies in an essential component - the nonlinear activation function, which ensures that the neural network can perform the required arbitrary nonlinear transformation. The desired all-optical nonlinear activation function is difficult to realize, and as a result, most of the reported photonic neural networks rely on opto-electronic activation functions. Usually, the sacrifices made are the unique advantages of photonics, such as resource-efficient coherent and frequency-multiplexed information encoding. In addition, opto-electronic activation functions normally limit the photonic neural network depth by adding insertion losses. Here, we experimentally demonstrate an in-fiber photonic nonlinear activation function based on stimulated Brillouin scattering. Our design is coherent and frequency selective, making it suitable for multi-frequency neural networks. The optoacoustic activation function can be tuned continuously and all-optically between a variety of activation functions such as LeakyReLU, Sigmoid, and Quadratic. In addition, our design amplifies the input signal with gain as high as $20\,\mathrm{dB}$, compensating for insertion losses on the fly, and thus paving the way for deep optical neural networks.

Efficient Nonlinear Activation Function in Optical Neural Network

Optical Nonlinear Activation Functions Based on MZI-Structure for Optical Neural Networks

The Realization Of Parallel Subtraction Using Lclv In Optical Neural Network

Programmable low-threshold optical nonlinear activation functions for photonic neural networks

Reconfigurable All-Optical Integrated Nonlinear Activator with Switchable Response Functions for Photonic Neural Networks

All-optical neural network with nonlinear activation functions

Countering Variations and Thermal Effects for Accurate Optical Neural Networks.

All-optical nonlinear activation function based on stimulated Brillouin scattering

All-Optical Nonlinear Activators Using Silicon-Based Waveguides and Microring Resonators for Photonic Neural Networks

Photonic Neural Activation Function Based on High-Speed Electro-Absorption Modulated Laser

Lensless Opto-Electronic Neural Network with Quantum Dot Nonlinear Activation

All-optical neural network nonlinear activation function based on the optical bistability within a micro-ring resonator

Nonlinear Absorption of 2D Materials and Their Application in Optical Neural Networks

Lensless opto-electronic neural network with quantum dots nonlinear activation

Low-threshold All-Optical Nonlinear Activation Function Based on Injection Locking in Distributed Feedback Laser Diodes.

Optical activation function using a metamaterial waveguide for an all-optical neural network

An optical neural chip for implementing complex-valued neural network

Multi-layer Optical Convolutional Neural Network with Nonlinear Activation

Optical ReLU-like Activation Function Based on a Semiconductor Laser with Optical Injection

A High-Stability All-Optical Nonlinear Activator for Optical Computing

Free-space optical neural network based on thermal atomic nonlinearity