Abstract:Diffractive deep neural networks have been introduced earlier as an optical machine learning framework that uses task-specific diffractive surfaces designed by deep learning to all-optically perform inference, achieving promising performance for object classification and imaging. Here we demonstrate systematic improvements in diffractive optical neural networks based on a differential measurement technique that mitigates the non-negativity constraint of light intensity. In this scheme, each class is assigned to a separate pair of photodetectors, behind a diffractive network, and the class inference is made by maximizing the normalized signal difference between the detector pairs. Moreover, by utilizing the inherent parallelization capability of optical systems, we reduced the signal coupling between the positive and negative detectors of each class by dividing their optical path into two jointly-trained diffractive neural networks that work in parallel. We further made use of this parallelization approach, and divided individual classes among multiple jointly-trained differential diffractive neural networks. Using this class-specific differential detection in jointly-optimized diffractive networks, our simulations achieved testing accuracies of 98.52%, 91.48% and 50.82% for MNIST, Fashion-MNIST and grayscale CIFAR-10 datasets, respectively. Similar to ensemble methods practiced in machine learning, we also independently-optimized multiple differential diffractive networks that optically project their light onto a common detector plane, and achieved testing accuracies of 98.59%, 91.06% and 51.44% for MNIST, Fashion-MNIST and grayscale CIFAR-10, respectively. Through these systematic advances in designing diffractive neural networks, the reported classification accuracies set the state-of-the-art for an all-optical neural network design.

Advances and Progress of Diffractive Deep Neural Networks

All-Optical Signal Processing of Vortex Beams with Diffractive Deep Neural Networks

Diffractive Deep Neural Network for Optical Orbital Angular Momentum Multiplexing and Demultiplexing

Optical Analog Computing Devices Designed by Deep Neural Network

All-Optical Machine Learning Using Diffractive Deep Neural Networks

Ensemble learning of diffractive optical networks

Scale-, shift- and rotation-invariant diffractive optical networks

Efficient Design Optimization for Diffractive Deep Neural Networks

In Situ Optical Backpropagation Training of Diffractive Optical Neural Networks

Deep Learning-designed Diffractive Neural Networks

<i>In situ</i> optical backpropagation training of diffractive optical neural networks

Residual D2NN: Training Diffractive Deep Neural Networks Via Learnable Light Shortcuts.

Training large-scale optoelectronic neural networks with dual-neuron optical-artificial learning

Scientific Computing with Diffractive Optical Neural Networks

Optical neural networks: progress and challenges

1-bit Quantized On-chip Hybrid Diffraction Neural Network Enabled by Authentic All-optical Fully-connected Architecture

Design of task-specific optical systems using broadband diffractive neural networks

Misalignment resilient diffractive optical networks

Real-time multi-task diffractive deep neural networks via hardware-software co-design

Class-specific Differential Detection in Diffractive Optical Neural Networks Improves Inference Accuracy

Research progress in optical neural networks: theory, applications and developments