Abstract:Development of optical technology has enabled imaging of two-dimensional (2D) sound fields. This acousto-optic sensing enables understanding of the interaction between sound and objects such as reflection and diffraction. Moreover, it is expected to be used an advanced measurement technology for sonars in self-driving vehicles and assistive robots. However, the low sound-pressure sensitivity of the acousto-optic sensing results in high intensity of noise on images. Therefore, denoising is an essential task to visualize and analyze the sound fields. In addition to denoising, segmentation of sound and object silhouette is also required to analyze interactions between them. In this paper, we propose sound-field-images-with-object-silhouette denoising and segmentation (SoundSil-DS) that jointly perform denoising and segmentation for sound fields and object silhouettes on a visualized image. We developed a new model based on the current state-of-the-art denoising network. We also created a dataset to train and evaluate the proposed method through acoustic simulation. The proposed method was evaluated using both simulated and measured data. We confirmed that our method can applied to experimentally measured data. These results suggest that the proposed method may improve the post-processing for sound fields, such as physical model-based three-dimensional reconstruction since it can remove unwanted noise and separate sound fields and other object silhouettes. Our code is available at <a class="link-external link-https" href="https://github.com/nttcslab/soundsil-ds" rel="external noopener nofollow">this https URL</a>.

A Survey of Silhouette Detection Techniques for Non-Photorealistic Rendering

GPU accelerated rendering smooth silhouettes

Detect saliency to understand a photo

Interactive Silhouette Rendering for Point-Based Models

Silhouette Representation and Matching for 3d Pose Discrimination - A Comparative Study

Perspectives Of Non-Photorealistic Computer Graphics

Photo2Silhouette: Transferring Silhouette Photo Style for Images

Selective Image Abstraction

Point-Based Neural Scene Rendering for Street Views

Robust post-processing strategy for gait silhouette

Using Silhouette for Pose Estimation of Object with Surface of Revolution

Stylized rendering of 3D scanned real world environments

3D Silhouette Tracking with Occlusion Inference

Recent Advances on Non-Line-of-Sight Imaging: Conventional Physical Models, Deep Learning, and New Scenes

Adaptive Human Silhouette Reconstruction Based on the Exploration of Temporal Information

SRNPD: Spatial Rendering Network for Pencil Drawing Stylization

A study of how Chinese ink painting features can be applied to 3D scenes and models in real-time rendering

SoundSil-DS: Deep Denoising and Segmentation of Sound-field Images with Silhouettes

Silhouette Vectorization by Affine Scale-Space

PTGCF: Printing Texture Guided Color Fusion for Impressionism Oil Painting Style Rendering

A New Era of Indoor Scene Reconstruction: A Survey