Abstract:The optical neural network system based on the 4f system (4f-ONN) is a feasible solution for on-orbit real-time target detection and recognition on remote sensing images, as it can directly modulate and encode the two-dimensional image information. However, traditional 4f systems based on spatial light modulators (SLMs) often encounter misalignment errors during assembly due to the reflective optical path used in SLMs. Additionally, implementing electronic SLM in space-based applications introduces problems such as particle number reversal, significantly reducing the reliability of the system. To address these issues, this paper proposes the adoption of diffractive optical elements (DOEs) to construct the 4f-ONN system. The DOE-based design offers a more compact structure, enhanced reliability, and reduced energy consumption, making it highly suitable for on-orbit image processing applications. Due to the expensive and time-consuming nature of the DOE manufacturing process, a design approach for a 4f system based on DOE was pursued through software simulation in this paper. The simulation phase involved the utilization of electronic neural networks to acquire the physical parameters of the DOE mask, while incorporating the array theorem and Fraunhofer diffraction theorem to accurately calculate the physical dimensions of the DOE. The effectiveness of the adopted DOE-based 4f system was initially validated through experiments on a simple pattern dataset. Subsequently, simulation experiments were conducted on three public datasets, namely Mnist, Fashion-mnist, and QuickDraw16, to confirm the efficacy of the DOE-based 4f system in classification tasks. Lastly, target recognition experiments were performed on the GF-2 dataset, and a corresponding hardware system was developed to demonstrate the potential of the DOE-based 4f system in on-orbit image processing.

An Optical Satellite Controller Based on Diffractive Deep Neural Network.

Optical Analog Computing Devices Designed by Deep Neural Network

Control Model of Acousto-Optic Deflector、based on Radial Basis Function Neural Network

Vision-Only-Based Control of Approaching Disabled Satellites via Deep Learning

Decision-making and control with diffractive optical networks

On-chip 4F-System Based on Concave Mirrors for Optical Neural Networks

Application of a Neural Network to Store and Compute the Optical Properties of Non-Spherical Particles

Towards Constructing a DOE-based Practical Optical Neural System for Ship Recognition in Remote Sensing Images

Real-Time Optimal Control for Spacecraft Orbit Transfer Via Multiscale Deep Neural Networks

Accelerated Dual Neural Network Controller for Visual Servoing of Flexible Endoscopic Robot With Tracking Error, Joint Motion, and RCM Constraints

Neural adaptive control for a ground experiment of the space proximity operation in a six-degree-of-freedom micro-gravity simulation system

Event-triggered Model Predictive Controller with Neural Network for Autonomous Rendezvous and Proximity on Elliptical Orbits

Optimal Real-Time Approach and Capture of Uncontrolled Spacecraft

Optical mode manipulation using deep spatial diffractive neural networks

Adaptive Optical Closed-Loop Control on the Basis of Hyperparametric Optimization of Convolutional Neural Networks

<i>In situ</i> optical backpropagation training of diffractive optical neural networks

In Situ Optical Backpropagation Training of Diffractive Optical Neural Networks

Deep neural network-based robotic visual servoing for satellite target tracking

Real-Time Optimal Approach and Capture of ENVISAT Based on Neural Networks

Scale-, shift- and rotation-invariant diffractive optical networks

Learning to Plan Maneuverable and Agile Flight Trajectory with Optimization Embedded Networks