Abstract:Acoustic holography (AH) is a promising technique for precise noncontact micro-nano robotic manipulation. It encodes a three-dimensional (3D) acoustic field acting as a virtual end-effector into a two-dimensional (2D) hologram, whereby the desired acoustic field reconstruction is made possible. Most traditional methods to implement AH, such as 3D printed holographic lens and phased array of transducers (PAT), have limitations of dynamic and dexterous manipulation. Furthermore, existing iterative optimization algorithms to calculate 2D holograms have inadequate accuracy and real-time performance. To address these issues, this paper proposes a physics-based deep learning method with a novel training framework for phase-only hologram (POH) calculation enabling further pushing forward the PAT-based AH for noncontact robotic manipulation. By implementing independent control of each channel on PAT referring real-time calculated POH by a well-trained network, the desired acoustic field can be reconstructed in real-time with high fidelity. The results both on a simulated dataset and a real dataset demonstrate that our method supports accurate and dynamic reconstruction of desired acoustic field with distinct morphologies, with an average reconstruction error of 0.085 and average POH computing time of 47 milliseconds on GPU. Indeed, this work shows the future potential of AH in the field of noninvasive medical therapy, exogenous material delivery, and miniaturized industrial assembly. Note to Practitioners—This paper addresses the challenge of noncontact micro-nano robotic manipulation by PAT-based AH, an intriguing technique in bioengineering, micro-assembly, and material characterization. However, existing approaches have limited precision and real-time performance. To overcome these limitations, this paper proposes a physics-based deep learning method with a novel training framework. Our method achieves excellent accuracy and real-time performance, enabling efficient reconstruction of various complicated acoustic field morphologies for precise and dynamic acoustic manipulation. Experimental results demonstrate its high manipulation flexibility due to the independent modulation of each channel of PAT and real-time precise control due to the ultrafast calculation of the proposed deep learning method, though the method has not yet been deployed into an acoustic manipulation system and tested in practice. Future research will focus on designing physical experiments for further evaluation. Overall, the proposed method provides a novel and promising basis for desired acoustic field generation.

Multi-plane Acoustic Hologram Generation with a Physics-Enhanced Neural Network for Micro-Particle Manipulation

Multi-frequency Acoustic Hologram Generation with a Physics-Enhanced Deep Neural Network

Deep Learning-Empowered Moving Cascaded Acoustic Holography for High-Fidelity and High-Capacity Acoustic Holographic Reconstruction

Acoustic Field Visualization and Source Localization Via Physics-Informed Learning of Sparse Data with Adaptive Sampling

A Deep Learning Approach for the Fast Generation of Acoustic Holograms.

AcousNet: A Deep Learning Based Approach to Dynamic 3D Holographic Acoustic Field Generation From Phased Transducer Array

Acoustic Hologram Reconstruction With Unsupervised Neural Network

Real-time Acoustic Holography with Physics-based Deep Learning for Acoustic Robotic Manipulation.

Holographic Reconstruction With All-Acoustic Diffractive Network

Real-Time Acoustic Holography With Physics-Based Deep Learning for Robotic Manipulation

A Real Time Method Based on Deep Learning for Reconstructing Holographic Acoustic Fields from Phased Transducer Arrays

Real-time acoustic holography with physics-reinforced contrastive learning for acoustic field reconstruction

Generating Multi‐Depth 3D Holograms Using a Fully Convolutional Neural Network

Adaptive In-Focus Particle Detection and Segmentation in Holographic 3d Image with Mechanism-Guided Machine Learning

Spatial Acoustic Modulator for Projecting High-Quality Holographic Image

Near field Acoustic Holography on arbitrary shapes using Convolutional Neural Network

Hologram data extrapolation and interpolation method based on the extreme learning machine

Acoustic Holography Based On Composite Metasurface With Decoupled Modulation Of Phase And Amplitude

High-fidelity, Model-Driven Deep Learning Network for Phase-Only Computer-Generated Holography (conference Presentation)

Dynamic Acoustic Holography: One-Shot High-Precision and High-Information Methodology

Multifunctional acoustic holography based on compact acoustic geometric-phase meta-array