Abstract:With the development of artificial intelligence technology, such as artificial neural networks, the increasing demand for computing drives the upgrading of computing accelerators. It’s known that the semiconductor process is approaching physical limits and the Von Neumann architecture of storage-computing separation affects the computing efficiency, which both lead to the gradual failure of electronic devices to meet application requirements. Optical neural networks (ONNs) can take full advantage of high speed, high bandwidth, high parallelism, and low power consumption of optical transmission to overcome the deficiencies of electronic devices. In this paper, we summarize and analyze previous researches on optical neural networks according to different physical implementations. And we conclude that most studies apply the characteristics of special materials to realize the dense matrix multiplication and nonlinear activation function of ONNs. Less research focuses on the nonlinear characteristics inherent in the optical signal transmission to realize important components of traditional neural networks. ONNs show great potentials in analog computing and information processing, such as marine in-situ imaging and optical receiver of underwater optical communication. And ONN is possible to be a new generation of neural network accelerator. But the large-scale application of ONNs requires more studies in optical implementation of nonlinear activation function and loss function, and accuracy improvement of optical computing.

Nonlinear Absorption of 2D Materials and Their Application in Optical Neural Networks

Countering Variations and Thermal Effects for Accurate Optical Neural Networks.

Advances and Marine Applications of Optical Neural Network

MoS2 As Nonlinear Optical Material for Optical Neural Networks

All-optical neural network with nonlinear activation functions

Optical Neural Network with Complementary Decomposition to Overcome the Phase Insensitive Constrains

Optical neural networks: progress and challenges

Programmable low-threshold optical nonlinear activation functions for photonic neural networks

Efficient Nonlinear Activation Function in Optical Neural Network

Inverse-designed Integrated All-optical Nonlinear Activators for Optical Computing

All-Optical Recurrent Neural Network With Reconfigurable Activation Function

Experimental Realization of Arbitrary Activation Functions for Optical Neural Networks

Free-space optical neural network based on thermal atomic nonlinearity

A Review of Optical Neural Networks

Strategies for Training Optical Neural Networks

Lensless Opto-Electronic Neural Network with Quantum Dot Nonlinear Activation

Low-Depth Optical Neural Networks

Electrically Programmable Phase-Change Photonic Memory for Optical Neural Networks with Nanoseconds in Situ Training Capability

Image sensing with multilayer nonlinear optical neural networks

All-Optical Nonlinear Activators Using Silicon-Based Waveguides and Microring Resonators for Photonic Neural Networks

On-chip 4F-System Based on Concave Mirrors for Optical Neural Networks