Spatiotemporal diffractive deep neural networks

Junhe Zhou,Haoqian Pu,Jiaxin Yan

DOI: https://doi.org/10.1364/oe.494999

IF: 3.8

2024-01-06

Optics Express

Abstract:Junhe Zhou, Haoqian Pu, Jiaxin Yan A spatiotemporal diffractive deep neural network (STD2NN) is proposed for spatiotemporal signal processing. The STD2NN is formed by ... [Opt. Express 32, 1864-1877 (2024)]

optics

What problem does this paper attempt to address?

All-Optical Signal Processing of Vortex Beams with Diffractive Deep Neural Networks

Zebin Huang,Peipei Wang,Junmin Liu,Wenjie Xiong,Yanliang He,Jiangnan Xiao,Huapeng Ye,Ying Li,Shuqing Chen,Dianyuan Fan

DOI: https://doi.org/10.1103/physrevapplied.15.014037

IF: 4.6

2021-01-01

Physical Review Applied

Abstract:Vortex beams (VBs), possessing a helical phase front and carrying orbital angular momentum (OAM), have attracted considerable attention in optical communications for their mode orthogonality. A platform for achieving all-optical signal processing of VBs, however, remains elusive due to the limited light-field-manipulation capability. We introduce diffractive deep neural networks (${\mathrm{D}}^{2}$NNs) and their applications to process VBs. Exploiting the multiple-light-field-modulation ability of multilayer diffraction structures and the strong data-processing capability of deep neural networks, we reveal that ${\mathrm{D}}^{2}$NNs can manipulate multiple VBs by configuring the phase and amplitude distribution of diffractive screens. The diffraction efficiency and converted-mode purity are greater than 96%. After being trained, ${\mathrm{D}}^{2}$NNs with functions of hybrid-OAM-mode generation, identification, and conversion are obtained, and three typical types of all-optical signal-processing communication, (OAM-shift keying (OAM-SK), OAM multiplexing and demultiplexing, and OAM-mode switching) are successfully achieved. Our simulation results provide an approach that breaks the limitations of poor functionality and complex design in processing VBs, introducing the ${\mathrm{D}}^{2}$NN as a universal light-field-modulation platform.
Diffractive Deep Neural Network for Optical Orbital Angular Momentum Multiplexing and Demultiplexing

Peipei Wang,Wenjie Xiong,Zebin Huang,Yanliang He,Junmin Liu,Huapeng Ye,Jiangnan Xiao,Ying Li,Dianyuan Fan,Shuqing Chen

DOI: https://doi.org/10.1109/jstqe.2021.3077907

IF: 4.9

2022-01-01

IEEE Journal of Selected Topics in Quantum Electronics

Abstract:Vortex beams (VBs), characterized by helical phase front and orbital angular momentum (OAM), have shown perspective potential in improving communication capacity density for providing an additional multiplexing dimension. Here, we propose a diffractive deep neural network (D 2 NN) method for OAM mode multiplexing and demultiplexing. By designing the D 2 NN model and simulating light propagation through multiple diffractive screens, the phase and amplitude values can be automatically adjusted to manipulate the wavefront of light beams. Training the D 2 NN model with mode coupler and separator functions, we convert VBs into target light fields with the diffraction efficiency exceeds 97%, and the mode purities are over 97%. Constructing an OAM multiplexing link, we successfully multiplex and demultiplex two OAM channels that carry 16-QAM signals in simulation, and the demodulated bit-error-rates are below 1×10 -4 . It is anticipated that the D 2 NN can perform flexible modulation of multiple OAM modes, which may open a new avenue for high-capacity OAM communication and all-optical information processing, etc.
Fourier-space Diffractive Deep Neural Network.

Tao Yan,Jiamin Wu,Tiankuang Zhou,Hao Xie,Feng Xu,Jingtao Fan,Lu Fang,Xing Lin,Qionghai Dai

DOI: https://doi.org/10.1103/physrevlett.123.023901

IF: 8.6

2019-01-01

Physical Review Letters

Abstract:In this Letter we propose the Fourier-space diffractive deep neural network (F-D^{2}NN) for all-optical image processing that performs advanced computer vision tasks at the speed of light. The F-D^{2}NN is achieved by placing the extremely compact diffractive modulation layers at the Fourier plane or both Fourier and imaging planes of an optical system, where the optical nonlinearity is introduced from ferroelectric thin films. We demonstrated that F-D^{2}NN can be trained with deep learning algorithms for all-optical saliency detection and high-accuracy object classification.
STDNet: A Spatio-Temporal Decomposition Neural Network for Multivariate Time Series Forecasting

Zhuolun Jiang,Zefei Ning,Hao Miao,Li Wang

DOI: https://doi.org/10.26599/tst.2023.9010105

2024-02-13

Tsinghua Science & Technology

Abstract:Long-term multivariate time series forecasting is an important task in engineering applications. It helps grasp the future development trend of data in real-time, which is of great significance for a wide variety of fields. Due to the non-linear and unstable characteristics of multivariate time series, the existing methods encounter difficulties in analyzing complex high-dimensional data and capturing latent relationships between multivariates in time series, thus affecting the performance of long-term prediction. In this paper, we propose a novel time series forecasting model based on multilayer perceptron that combines spatio-temporal decomposition and doubly residual stacking, namely Spatio-Temporal Decomposition Neural Network (STDNet). We decompose the originally complex and unstable time series into two parts, temporal term and spatial term. We design temporal module based on auto-correlation mechanism to discover temporal dependencies at the sub-series level, and spatial module based on convolutional neural network and self-attention mechanism to integrate multivariate information from two dimensions, global and local, respectively. Then we integrate the results obtained from the different modules to get the final forecast. Extensive experiments on four real-world datasets show that STDNet significantly outperforms other state-of-the-art methods, which provides an effective solution for long-term time series forecasting.

computer science, information systems,engineering, electrical & electronic, software engineering
Deep Learning-designed Diffractive Neural Networks

Xing Lin,Yair Riverson,Nezih T. Yardimci,Muhammed Veli,Yi Luo,Mona Jarrahi,Aydogan Ozcan

DOI: https://doi.org/10.1364/cleo_si.2019.sf1n.2

2019-01-01

Abstract:We report deep learning-based design of diffractive neural networks. Following its fabrication, a diffractive neural network can all-optically perform user-defined tasks through diffraction. We demonstrate the applications of this framework for classification and imaging tasks.
Advances and Progress of Diffractive Deep Neural Networks

Jianmin Xiong,Zejun Zhang,Jing Xu

DOI: https://doi.org/10.1117/12.2606596

2021-01-01

Abstract:In recent years, artificial intelligence has achieved unprecedented development, and deep learning, represented by neural networks, plays an important role. After the emergence of large-scale pre-trained models with trillions of parameters, the model performance is significantly improved while the burden of computational resources and energy consumption of hardware devices are also increased simultaneously, thus limiting its application in more practical scenarios. Compared with neural networks implemented based on electronic devices, those implemented based on optical devices are called optical neural networks, which have unique properties to overcome the dilemma above. One of the most representative works of optical neural networks these years is the diffractive deep neural network (D2NN). In this paper, the research progress of D2NNs is summarized in four aspects: basic theory, further analysis, improvement, and application. Besides, it is analyzed that the common defect of D2NNs from simulation to physical fabrication, and corresponding theoretical improvement method is also proposed. Meanwhile, to further reduce the impact due to the gap between simulation and physical implementation, and to enhance the robustness of the model, the D2NN training method based on generative adversarial network (GAN) is proposed. The D2NN combines optical transmission with deep learning to achieve complex pattern recognition tasks in the optical domain at the speed of light. It is believed that under continuous research, the D2NN can play a greater role in optical communications and other fields.
Residual D2NN: Training Diffractive Deep Neural Networks Via Learnable Light Shortcuts.

Hongkun Dou,Yue Deng,Tao Yan,Huaqiang Wu,Xing Lin,Qionghai Dai

DOI: https://doi.org/10.1364/ol.389696

IF: 3.6

2020-01-01

Optics Letters

Abstract:The diffractive deep neural network (D2NN) has demonstrated its importance in performing various all-optical machine learning tasks, e.g., classification, segmentation, etc. However, deeper D2NNs that provide higher inference complexity are more difficult to train due to the problem of gradient vanishing. We introduce the residual D2NNs (Res-D2NN), which enables us to train substantially deeper diffractive networks by constructing diffractive residual learning blocks to learn the residual mapping functions. Unlike the existing plain D2NNs, Res-D2NNs contribute to the design of a learnable light shortcut to directly connect the input and output between optical layers. Such a shortcut offers a direct path for gradient backpropagation in training, which is an effective way to alleviate the gradient vanishing issue on very deep diffractive neural networks. Experimental results on image classification and pixel super-resolution demonstrate the superiority of Res-D2NNs over the existing plain D2NN architectures.
STCA: Spatio-Temporal Credit Assignment with Delayed Feedback in Deep Spiking Neural Networks

Pengjie Gu,Rong Xiao,Gang Pan,Huajin Tang

DOI: https://doi.org/10.24963/ijcai.2019/189

2019-01-01

Abstract:The temporal credit assignment problem, which aims to discover the predictive features hidden in distracting background streams with delayed feedback, remains a core challenge in biological and machine learning. To address this issue, we propose a novel spatio-temporal credit assignment algorithm called STCA for training deep spiking neural networks (DSNNs). We present a new spatiotemporal error backpropagation policy by defining a temporal based loss function, which is able to credit the network losses to spatial and temporal domains simultaneously. Experimental results on MNIST dataset and a music dataset (MedleyDB) demonstrate that STCA can achieve comparable performance with other state-of-the-art algorithms with simpler architectures. Furthermore, STCA successfully discovers predictive sensory features and shows the highest performance in the unsegmented sensory event detection tasks.
Saliency Segmentation With Fourier-Space Diffractive Deep Neural Networks

Tao Yan,Jiamin Wu,Tiankuang Zhou,Hao Xie,Feng Xu,Jingtao Fan,Lu Fang,Xing Lin,Qionghai Dai

DOI: https://doi.org/10.1364/CLEO_SI.2020.STH4M.6

2020-01-01

Abstract:We propose to apply diffractive deep neural networks ((DNN)-N-2) for solving advanced computer vision tasks and demonstrate the successful application of Fourier-space (DNN)-N-2 for all-optical saliency segmentation of both microscopic samples and macroscopic scenes. (c) 2020 The Author(s)
All-Optical Machine Learning Using Diffractive Deep Neural Networks

Xing Lin,Yair Rivenson,Nezih T. Yardimci,Muhammed Veli,Mona Jarrahi,Aydogan Ozcan

DOI: https://doi.org/10.1126/science.aat8084

2018-07-26

Abstract:We introduce an all-optical Diffractive Deep Neural Network (D2NN) architecture that can learn to implement various functions after deep learning-based design of passive diffractive layers that work collectively. We experimentally demonstrated the success of this framework by creating 3D-printed D2NNs that learned to implement handwritten digit classification and the function of an imaging lens at terahertz spectrum. With the existing plethora of 3D-printing and other lithographic fabrication methods as well as spatial-light-modulators, this all-optical deep learning framework can perform, at the speed of light, various complex functions that computer-based neural networks can implement, and will find applications in all-optical image analysis, feature detection and object classification, also enabling new camera designs and optical components that can learn to perform unique tasks using D2NNs.

Neural and Evolutionary Computing,Machine Learning,Computational Physics,Optics
Real-time multi-task diffractive deep neural networks via hardware-software co-design

Yingjie Li,Ruiyang Chen,Berardi Sensale-Rodriguez,Weilu Gao,Cunxi Yu

DOI: https://doi.org/10.1038/s41598-021-90221-7

IF: 4.6

2021-05-26

Scientific Reports

Abstract:Abstract Deep neural networks (DNNs) have substantial computational requirements, which greatly limit their performance in resource-constrained environments. Recently, there are increasing efforts on optical neural networks and optical computing based DNNs hardware, which bring significant advantages for deep learning systems in terms of their power efficiency, parallelism and computational speed. Among them, free-space diffractive deep neural networks (D 2 NNs) based on the light diffraction, feature millions of neurons in each layer interconnected with neurons in neighboring layers. However, due to the challenge of implementing reconfigurability, deploying different DNNs algorithms requires re-building and duplicating the physical diffractive systems, which significantly degrades the hardware efficiency in practical application scenarios. Thus, this work proposes a novel hardware-software co-design method that enables first-of-its-like real-time multi-task learning in D 2 2NNs that automatically recognizes which task is being deployed in real-time. Our experimental results demonstrate significant improvements in versatility, hardware efficiency, and also demonstrate and quantify the robustness of proposed multi-task D 2 NN architecture under wide noise ranges of all system components. In addition, we propose a domain-specific regularization algorithm for training the proposed multi-task architecture, which can be used to flexibly adjust the desired performance for each task.

multidisciplinary sciences
2bit Nonlinear Diffractive Deep Neural Network (2bit ND 2 NN): A quantized nonlinear all-optical diffractive deep neural network implementation

Yichen Sun,Mingli Dong,Mingxin Yu,Lianqing Zhu

DOI: https://doi.org/10.1016/j.optlastec.2024.111120

IF: 4.939

2024-05-07

Optics & Laser Technology

Abstract:To alleviate the problems of long training time and computational resource consumption in diffractive deep neural networks (D 2 NNs), we present the 2bit nonlinear diffractive deep neural network (2bit ND 2 NN) model, which employs the concept of quantized neural networks. 2bit ND 2 NN converts the phase of each diffraction layer pixel from continuous to discrete values, i.e., the five regions of 0, π/2, π, 3π/2 and 2π. We use the formulas for phase and relative thickness to determine the thickness values of the pixels. Furthermore, the phase and amplitude of neurons in the 2bit ND 2 NN model are both considered as learnable parameters. We use a revised formula to determine the size of neurons in the model, and we determine the diffraction grating spacing, the number of grating layers, the pixel size and the pixel counts through ablation experiments. Experimental results for image classification indicate that the highest accuracy achieved by 2bit ND 2 NN on the MNIST and Fashion-MNIST datasets is 97.88 % and 89.28 %, respectively..

optics,physics, applied
Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

Qi Xu,Jianxin Peng,Jiangrong Shen,Huajin Tang,Gang Pan

DOI: https://doi.org/10.1016/j.neunet.2019.08.034

IF: 7.8

2020-01-01

Neural Networks

Abstract:Neurons in the brain use an event signal, termed spike, encode temporal information for neural computation. Spiking neural networks (SNNs) take this advantage to serve as biological relevant models. However, the effective encoding of sensory information and also its integration with downstream neurons of SNNs are limited by the current shallow structures and learning algorithms. To tackle this limitation, this paper proposes a novel hybrid framework combining the feature learning ability of continuous-valued convolutional neural networks (CNNs) and SNNs, named deep CovDenseSNN, such that SNNs can make use of feature extraction ability of CNNs during the encoding stage, but still process features with unsupervised learning rule of spiking neurons. We evaluate them on MNIST and its variations to show that our model can extract and transmit more important information than existing models, especially for anti-noise ability in the noisy environment. The proposed architecture provides efficient ways to perform feature representation and recognition in a consistent temporal learning framework, which is easily adapted to neuromorphic hardware implementations and bring more biological realism into modern image classification models, with the hope that the proposed framework can inform us how sensory information is transmitted and represented in the brain.
Time-lapse image classification using a diffractive neural network

Md Sadman Sakib Rahman,Aydogan Ozcan

DOI: https://doi.org/10.1002/aisy.202200387

2022-08-23

Abstract:Diffractive deep neural networks (D2NNs) define an all-optical computing framework comprised of spatially engineered passive surfaces that collectively process optical input information by modulating the amplitude and/or the phase of the propagating light. Diffractive optical networks complete their computational tasks at the speed of light propagation through a thin diffractive volume, without any external computing power while exploiting the massive parallelism of optics. Diffractive networks were demonstrated to achieve all-optical classification of objects and perform universal linear transformations. Here we demonstrate, for the first time, a "time-lapse" image classification scheme using a diffractive network, significantly advancing its classification accuracy and generalization performance on complex input objects by using the lateral movements of the input objects and/or the diffractive network, relative to each other. In a different context, such relative movements of the objects and/or the camera are routinely being used for image super-resolution applications; inspired by their success, we designed a time-lapse diffractive network to benefit from the complementary information content created by controlled or random lateral shifts. We numerically explored the design space and performance limits of time-lapse diffractive networks, revealing a blind testing accuracy of 62.03% on the optical classification of objects from the CIFAR-10 dataset. This constitutes the highest inference accuracy achieved so far using a single diffractive network on the CIFAR-10 dataset. Time-lapse diffractive networks will be broadly useful for the spatio-temporal analysis of input signals using all-optical processors.

Optics,Computer Vision and Pattern Recognition,Neural and Evolutionary Computing
STDAN: Deformable Attention Network for Space-Time Video Super-Resolution

Hai Wang,Xiaoyu Xiang,Yapeng Tian,Wenming Yang,Qingmin Liao

DOI: https://doi.org/10.1109/TNNLS.2023.3243029

Abstract:The target of space-time video super-resolution (STVSR) is to increase the spatial-temporal resolution of low-resolution (LR) and low-frame-rate (LFR) videos. Recent approaches based on deep learning have made significant improvements, but most of them only use two adjacent frames, that is, short-term features, to synthesize the missing frame embedding, which cannot fully explore the information flow of consecutive input LR frames. In addition, existing STVSR models hardly exploit the temporal contexts explicitly to assist high-resolution (HR) frame reconstruction. To address these issues, in this article, we propose a deformable attention network called STDAN for STVSR. First, we devise a long short-term feature interpolation (LSTFI) module that is capable of excavating abundant content from more neighboring input frames for the interpolation process through a bidirectional recurrent neural network (RNN) structure. Second, we put forward a spatial-temporal deformable feature aggregation (STDFA) module, in which spatial and temporal contexts in dynamic video frames are adaptively captured and aggregated to enhance SR reconstruction. Experimental results on several datasets demonstrate that our approach outperforms state-of-the-art STVSR methods. The code is available at https://github.com/littlewhitesea/STDAN.
Delay-Embedding Spatio-Temporal Dynamic Mode Decomposition

Gyurhan Nedzhibov

DOI: https://doi.org/10.3390/math12050762

IF: 2.4

2024-03-05

Mathematics

Abstract:Spatio-temporal dynamic mode decomposition (STDMD) is an extension of dynamic mode decomposition (DMD) designed to handle spatio-temporal datasets. It extends the framework so that it can analyze data that have both spatial and temporal variations. This facilitates the extraction of spatial structures along with their temporal evolution. The STDMD method extracts temporal and spatial development information simultaneously, including wavenumber, frequencies, and growth rates, which are essential in complex dynamic systems. We provide a comprehensive mathematical framework for sequential and parallel STDMD approaches. To increase the range of applications of the presented techniques, we also introduce a generalization of delay coordinates. The extension, labeled delay-embedding STDMD allows the use of delayed data, which can be both time-delayed and space-delayed. An explicit expression of the presented algorithms in matrix form is also provided, making theoretical analysis easier and providing a solid foundation for further research and development. The novel approach is demonstrated using some illustrative model dynamics.

mathematics
Diffractive Deep Neural Network for Microwave Imaging Based on a Multi-Layer Transmitarray Antenna

Daoqi Liu,Tao Shan,Maokun Li,Fan Yang,Shenheng Xu

DOI: https://doi.org/10.23919/aces-china60289.2023.10249573

2023-01-01

Abstract:In this study, we designed a diffractive deep neural network (D 2 NN) structure using a multi-layer transmitarray antenna. Each transmitarray surface is treated as a physical neural network (NN) layer, with each element representing a neuron. The interaction between electromagnetic (EM) waves and transmitarray surfaces can be regarded as the computation of NNs. The proposed D 2 NN is applied for microwave imaging of the metal targets. Numerical results demonstrate that D 2 NN can provide reliable imaging with good similarity to the target in terms of size, shape, and position.
Optical mode manipulation using deep spatial diffractive neural networks

Zhengsen Ruan,Bowen Wang,Jinlong Zhang,Han Cao,Ming Yang,Wenrui Ma,Xun Wang,Yu Zhang,Jian Wang

DOI: https://doi.org/10.1364/OE.516593

2024-04-22

Abstract:In this paper, we investigate the theoretical models and potential applications of spatial diffractive neural network (SDNN) structures, with a particular focus on mode manipulation. Our research introduces a novel diffractive transmission simulation method that employs matrix multiplication, alongside a parameter optimization algorithm based on neural network gradient descent. This approach facilitates a comprehensive understanding of the light field manipulation capabilities inherent to SDNNs. We extend our investigation to parameter optimization for SDNNs of various scales. We achieve the demultiplexing of 5, 11 and 100 orthogonal orbital angular momentum (OAM) modes using neural networks with 4, 10 and 50 layers, respectively. Notably, the optimized 100 OAM mode demultiplexer shows an average loss of 0.52 dB, a maximum loss of 0.62 dB, and a maximum crosstalk of -28.24 dB. Further exploring the potential of SDNNs, we optimize a 10-layer structure for mode conversion applications. This optimization enables conversions from Hermite-Gaussian (HG) to Laguerre-Gaussian (LG) modes, as well as from HG to OAM modes, showing the versatility of SDNNs in mode manipulation. We propose an innovative assembly of SDNNs on a glass substrate integrated with photonic devices. A 10-layer diffractive neural network, with a size of 49 mm × 7 mm × 7 mm, effectively demultiplexes 11 orthogonal OAM modes with minimal loss and crosstalk. Similarly, a 20-layer diffractive neural network, with a size of 67 mm × 7 mm × 7 mm, serves as a highly efficient 25-channel OAM to HG mode converter, showing the potential of SDNNs in advanced optical communications.
Scale-, shift- and rotation-invariant diffractive optical networks

Deniz Mengu,Yair Rivenson,Aydogan Ozcan

DOI: https://doi.org/10.1021/acsphotonics.0c01583

2020-10-24

Abstract:Recent research efforts in optical computing have gravitated towards developing optical neural networks that aim to benefit from the processing speed and parallelism of optics/photonics in machine learning applications. Among these endeavors, Diffractive Deep Neural Networks (D2NNs) harness light-matter interaction over a series of trainable surfaces, designed using deep learning, to compute a desired statistical inference task as the light waves propagate from the input plane to the output field-of-view. Although, earlier studies have demonstrated the generalization capability of diffractive optical networks to unseen data, achieving e.g., >98% image classification accuracy for handwritten digits, these previous designs are in general sensitive to the spatial scaling, translation and rotation of the input objects. Here, we demonstrate a new training strategy for diffractive networks that introduces input object translation, rotation and/or scaling during the training phase as uniformly distributed random variables to build resilience in their blind inference performance against such object transformations. This training strategy successfully guides the evolution of the diffractive optical network design towards a solution that is scale-, shift- and rotation-invariant, which is especially important and useful for dynamic machine vision applications in e.g., autonomous cars, in-vivo imaging of biomedical specimen, among others.

Optics,Neural and Evolutionary Computing,Computational Physics
STDNet: Spatio-Temporal Decomposed Network for Video Grounding

Yuanwu Xu,Yuejie Zhang,Rui Feng,Rui-Wei Zhao,Tao Zhang,Xuequan Lu,Shang Gao

DOI: https://doi.org/10.1109/icme52920.2022.9859855

2022-01-01

Abstract:Previous methods for video grounding treated either the query or the video as a whole, while neglecting their respective semantics in the orthogonal space and time dimensions. Since spatial semantics appears frequently in a video, temporal semantics is more discriminative and deserves more attention. Based on such considerations, we propose a novel Spatio-Temporal Decomposed Network (STDNet) which decomposes the query and the video into their spatial and temporal semantics, respectively. Specifically, spatial and temporal words are selected from the query, and the video is split into two pathways. Spatial cross-modal attention is computed first and serves as prior knowledge for temporal attention. A new localization strategy is also devised which regresses the segment's start conditioned on the end and essentially breaks the independence assumption made in previous methods. Experimental results on three public benchmark datasets show that our STDNet outperforms the state-of-the-art methods.

Spatiotemporal diffractive deep neural networks

All-Optical Signal Processing of Vortex Beams with Diffractive Deep Neural Networks

Diffractive Deep Neural Network for Optical Orbital Angular Momentum Multiplexing and Demultiplexing

Fourier-space Diffractive Deep Neural Network.

STDNet: A Spatio-Temporal Decomposition Neural Network for Multivariate Time Series Forecasting

Deep Learning-designed Diffractive Neural Networks

Advances and Progress of Diffractive Deep Neural Networks

Residual D2NN: Training Diffractive Deep Neural Networks Via Learnable Light Shortcuts.

STCA: Spatio-Temporal Credit Assignment with Delayed Feedback in Deep Spiking Neural Networks

Saliency Segmentation With Fourier-Space Diffractive Deep Neural Networks

All-Optical Machine Learning Using Diffractive Deep Neural Networks

Real-time multi-task diffractive deep neural networks via hardware-software co-design

2bit Nonlinear Diffractive Deep Neural Network (2bit ND 2 NN): A quantized nonlinear all-optical diffractive deep neural network implementation

Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

Time-lapse image classification using a diffractive neural network

STDAN: Deformable Attention Network for Space-Time Video Super-Resolution

Delay-Embedding Spatio-Temporal Dynamic Mode Decomposition

Diffractive Deep Neural Network for Microwave Imaging Based on a Multi-Layer Transmitarray Antenna

Optical mode manipulation using deep spatial diffractive neural networks

Scale-, shift- and rotation-invariant diffractive optical networks

STDNet: Spatio-Temporal Decomposed Network for Video Grounding