Abstract:Fractional Fourier transform is an important branch of optical research, which has been widely used in optical encryption, optical filtering, image watermarking and other fields. The phase retrieval in the case of fractional Fourier transform is widely studied. Also, deep learning has been an intriguing method for optical computational imaging. However, in optical computational imaging, traditional deep learning methods possess some intrinsic disadvantages. In optical imaging experiments, it is often difficult to obtain sufficient quality and quantity of labeled data for training, thus leading to poor robustness of the trained neural network. Even with sufficient datasets, the training time can be particularly long. Recent years have witnessed a growing interest in physic-driven untrained neural networks for computational imaging. Here we apply such a method to study the fractional Fourier transform imaging, which combines neural networks with optical models to achieve phase retrieval of fractional Fourier transform. Different from the traditional neural network training with the original image as the target, in our network framework only a single intensity image is used for the phase retrieval of fractional Fourier transform images. The output image of the neural network will serve as an optical model through fractional Fourier transform, and then the output image of the optical model will be used as a loss function to drive the neural network training with the output image of the neural network. We have studied the fractional Fourier transform reconstruction for the cases with fractional order less than 1 and fractional order greater than 1. The simulations and experiments have shown that the network framework can implement the fractional Fourier transform reconstructions of the intensity objects and phase objects for different fraction orders, in which only 2000 iterations are needed. The experimental results show that the similarity between the reconstructed image and the original image, i.e. the number of normalized correlation coefficient, can reach 99.7%. Therefore, our work offers an efficient scheme for functional Fourier transform reconstruction with physicenhanced deep neutral network.

Fourier optical preprocessing in lieu of deep learning

Small-brain neural networks rapidly solve inverse problems with vortex Fourier encoders

Optical Convolution Based Computational Method for Low-Power Image Processing

The Integration of Neural Network and Physical Reconstruction Model for Fourier Ptychographic Microscopy

4-K-resolution Minimalist Optical System Design Based on Deep Learning.

FourierNets enable the design of highly non-local optical encoders for computational imaging

On-chip 4F-System Based on Concave Mirrors for Optical Neural Networks

Multi-layer optical Fourier neural network based on the convolution theorem

Integrated Photonic FFT for Optical Convolutions towards Efficient and High-Speed Neural Networks

Optical Convolutional Neural Networks -- Combining Silicon Photonics and Fourier Optics for Computer Vision

Wide-Field, High-Resolution Reconstruction in Computational Multi-Aperture Miniscope Using a Fourier Neural Network

Spatially Variant Deblur and Image Enhancement in a Single Multimode Fiber Imaged by Deep Learning

11 TeraFLOPs per second photonic convolutional accelerator for deep learning optical neural networks

Towards On-Chip Optical FFTs for Convolutional Neural Networks

Fourier Ptychography Based on Deep Learning

A Physics-Inspired Deep Learning Framework for an Efficient Fourier Ptychographic Microscopy Reconstruction under Low Overlap Conditions

A Fourier neuromorphic visual system based on InGaZnO synaptic transistor

All-optical Fourier neural network using partially coherent light

Memory-less scattering imaging with ultrafast convolutional optical neural networks

High Throughput Multi-Channel Parallelized Diffraction Convolutional Neural Network Accelerator

Fractional Fourier Transform Imaging Based on Untrained Neural Networks