Abstract:Diffractive deep neural networks have been introduced earlier as an optical machine learning framework that uses task-specific diffractive surfaces designed by deep learning to all-optically perform inference, achieving promising performance for object classification and imaging. Here we demonstrate systematic improvements in diffractive optical neural networks based on a differential measurement technique that mitigates the non-negativity constraint of light intensity. In this scheme, each class is assigned to a separate pair of photodetectors, behind a diffractive network, and the class inference is made by maximizing the normalized signal difference between the detector pairs. Moreover, by utilizing the inherent parallelization capability of optical systems, we reduced the signal coupling between the positive and negative detectors of each class by dividing their optical path into two jointly-trained diffractive neural networks that work in parallel. We further made use of this parallelization approach, and divided individual classes among multiple jointly-trained differential diffractive neural networks. Using this class-specific differential detection in jointly-optimized diffractive networks, our simulations achieved testing accuracies of 98.52%, 91.48% and 50.82% for MNIST, Fashion-MNIST and grayscale CIFAR-10 datasets, respectively. Similar to ensemble methods practiced in machine learning, we also independently-optimized multiple differential diffractive networks that optically project their light onto a common detector plane, and achieved testing accuracies of 98.59%, 91.06% and 51.44% for MNIST, Fashion-MNIST and grayscale CIFAR-10, respectively. Through these systematic advances in designing diffractive neural networks, the reported classification accuracies set the state-of-the-art for an all-optical neural network design.

Photonic Differential Privacy with Direct Feedback Alignment

Optical Analog Computing Devices Designed by Deep Neural Network

DOPPLER: Differentially Private Optimizers with Low-pass Filter for Privacy Noise Reduction

Optical training of large-scale Transformers and deep neural networks with direct feedback alignment

Discriminative Adversarial Privacy: Balancing Accuracy and Membership Privacy in Neural Networks

Differentially Private Federated Learning with an Adaptive Noise Mechanism

Class-specific Differential Detection in Diffractive Optical Neural Networks Improves Inference Accuracy

Efficient Training for the Hybrid Optical Diffractive Deep Neural Network

Optical encryption using a sparse-data-driven framework

Spectral-DP: Differentially Private Deep Learning through Spectral Perturbation and Filtering

Privacy for Fairness: Information Obfuscation for Fair Representation Learning with Local Differential Privacy

Optical Training Framework for Optical Diffractive Deep Neural Network Via Direct Feedback Alignment

Accurate Differentially Private Deep Learning on the Edge

FORESEEN: Towards Differentially Private Deep Inference for Intelligent Internet of Things

Mixed Differential Privacy in Computer Vision

Differentially-Private Deep Learning with Directional Noise

Local Differential Privacy for Deep Learning

Gain Without Pain: Offsetting DP-Injected Noises Stealthily in Cross-Device Federated Learning

Differentially Private Online Federated Learning with Correlated Noise

Private-kNN: Practical Differential Privacy for Computer Vision

Aldp-fl: an adaptive local differential privacy-based federated learning mechanism for IoT