Abstract:A plethora of research advances have emerged in the fields of optics and photonics that benefit from harnessing the power of machine learning. Specifically, there has been a revival of interest in optical computing hardware, due to its potential advantages for machine learning tasks in terms of parallelization, power efficiency and computation speed. Diffractive Deep Neural Networks (D2NNs) form such an optical computing framework, which benefits from deep learning-based design of successive diffractive layers to all-optically process information as the input light diffracts through these passive layers. D2NNs have demonstrated success in various tasks, including e.g., object classification, spectral-encoding of information, optical pulse shaping and imaging, among others. Here, we significantly improve the inference performance of diffractive optical networks using feature engineering and ensemble learning. After independently training a total of 1252 D2NNs that were diversely engineered with a variety of passive input filters, we applied a pruning algorithm to select an optimized ensemble of D2NNs that collectively improve their image classification accuracy. Through this pruning, we numerically demonstrated that ensembles of N=14 and N=30 D2NNs achieve blind testing accuracies of 61.14% and 62.13%, respectively, on the classification of CIFAR-10 test images, providing an inference improvement of >16% compared to the average performance of the individual D2NNs within each ensemble. These results constitute the highest inference accuracies achieved to date by any diffractive optical neural network design on the same dataset and might provide a significant leapfrog to extend the application space of diffractive optical image classification and machine vision systems.

Residual D2NN: Training Diffractive Deep Neural Networks Via Learnable Light Shortcuts.

All-Optical Machine Learning Using Diffractive Deep Neural Networks

Advances and Progress of Diffractive Deep Neural Networks

Diffractive Deep Neural Networks: Theories, Optimization, and Applications

Diffractive Deep Neural Networks at Visible Wavelengths

2bit Nonlinear Diffractive Deep Neural Network (2bit ND 2 NN): A quantized nonlinear all-optical diffractive deep neural network implementation

Efficient Design Optimization for Diffractive Deep Neural Networks

2Bit Nonlinear Diffractive Deep Neural Network (2bit ND2NN): A Quantized Nonlinear All-Optical Diffractive Deep Neural Network Implementation

Deep Learning-designed Diffractive Neural Networks

Scale-, shift- and rotation-invariant diffractive optical networks

Misalignment resilient diffractive optical networks

In Situ Optical Backpropagation Training of Diffractive Optical Neural Networks

Fourier-space Diffractive Deep Neural Network.

Ensemble learning of diffractive optical networks

<i>In situ</i> optical backpropagation training of diffractive optical neural networks

Pyramid-ladder Diffractive Neural Network for Visual Recognition

Multi-Wavelength Weighting Strategy of Diffractive Deep Neural Network

Recurrent diffractive deep neural networks

Resampling the Optical Transmission Matrix for Accelerating Training of Diffractive Deep Neural Network

Multiscale diffractive U-Net: a robust all-optical deep learning framework modeled with sampling and skip connections.

A Method to Improve the Computational Performance of Nonlinear All—optical Diffractive Deep Neural Network Model