Abstract:Deep learning has fundamentally transformed artificial intelligence, but the ever-increasing complexity in deep learning models calls for specialized hardware accelerators. Optical accelerators can potentially offer enhanced performance, scalability, and energy efficiency. However, achieving nonlinear mapping, a critical component of neural networks, remains challenging optically. Here, we introduce a design that leverages multiple scattering in a reverberating cavity to passively induce optical nonlinear random mapping, without the need for additional laser power. A key advantage emerging from our work is that we show we can perform optical data compression, facilitated by multiple scattering in the cavity, to efficiently compress and retain vital information while also decreasing data dimensionality. This allows rapid optical information processing and generation of low dimensional mixtures of highly nonlinear features. These are particularly useful for applications demanding high-speed analysis and responses such as in edge computing devices. Utilizing rapid optical information processing capabilities, our optical platforms could potentially offer more efficient and real-time processing solutions for a broad range of applications. We demonstrate the efficacy of our design in improving computational performance across tasks, including classification, image reconstruction, key-point detection, and object detection, all achieved through optical data compression combined with a digital decoder. Notably, we observed high performance, at an extreme compression ratio, for real-time pedestrian detection. Our findings pave the way for novel algorithms and architectural designs for optical computing.

Optics-free imaging of complex, non-sparse QR-codes with Deep Neural Networks

Optics-free imaging of complex, non-sparse and color QR-codes with deep neural networks

Poster: Secure Visible Light Communication based on Nonlinearity of Spatial Frequency in Light

Classification of optics-free images with deep neural networks

Ciphertext only attack on QR code optical encryption system with spatially incoherent illumination using a neural network

Transferable polychromatic optical encoder for neural networks

Spatially Varying Nanophotonic Neural Networks

Lensless Opto-Electronic Neural Network with Quantum Dot Nonlinear Activation

Image sensing with multilayer nonlinear optical neural networks

Lensless opto-electronic neural network with quantum dots nonlinear activation

Ultrafast machine vision with 2D material neural network image sensors

Free-space optical neural network based on thermal atomic nonlinearity

End-to-end Deep Neural Network for Optica L Inversion in Quantitative Photoacoustic Imaging

Photonic Advantage of Optical Encoders

Compressed Meta-Optical Encoder for Image Classification

High-accuracy data readout in multi-dimensional optical data storage using convolutional neural networks

Single-shot optical neural network

An Optical Frontend for a Convolutional Neural Network

Optical authentication scheme based on all-optical neural network

Deep Learning with Passive Optical Nonlinear Mapping

Deep learning for classification of noisy QR codes