Abstract:This paper aims at developing a faster and more accurate solution to the amodal 3D object detection problem for indoor scenarios. The solution is achieved through a novel neural network structure which takes a pair of RGB-D images as input and delivers oriented 3D bounding boxes as the output. Such network, named 3D-SSD, has two components: hierarchical feature fusion and multi-layer prediction. The hierarchical feature fusion combines multi-scale appearance and geometric features learned from RGB-D images, which is later utilized in the multi-layer prediction for object detection. Both the accuracy and the efficiency can be improved by exploiting 2.5D representations in a synergistic way. To specifically address the shape variance of different objects, a set of 3D anchor boxes with varying physical sizes are attached to every location on the prediction layers. While testing, the category scores for 3D anchor boxes are generated with adjusted positions, sizes and orientations, leading to the final detections using non-maximum suppression. Comprehensive experiments have been performed on publicly accessible dataset of SUN RGB-D and NYUV2. The results show the proposed algorithm is the first 3D detector that runs in near real-time on the challenging datasets with competitive performance to the state-of-the-art methods. The 3D-SSD gets 37.1% mAP on the SUN RGB-D dataset at around 5.6 fps, which outperforms the state-of-the-art Deep Sliding Shape by 10.2% mAP and around 109 x faster. For an efficient model setting with a rate of 9.3 fps, 3D-SSD still gets an accuracy of 37% on mAP. Further, experiments also suggest the proposed approach achieves comparable accuracy and is about 477 x faster than the state-of-art method on the NYUv2 dataset even with a smaller input image size. (C) 2019 Published by Elsevier B.V.

$M^3$-UDA: A New Benchmark for Unsupervised Domain Adaptive Fetal Cardiac Structure Detection

A Cross-Dimension Annotations Method for 3D Structural Facial Landmark Extraction

DeU-Net: Deformable U-Net for 3D Cardiac MRI Video Segmentation

DeU-Net 2.0: Enhanced deformable U-Net for 3D cardiac cine MRI segmentation

Partial Unbalanced Feature Transport for Cross-Modality Cardiac Image Segmentation

3D-SSD: Learning Hierarchical Features from RGB-D Images for Amodal 3D Object Detection

ASC: Appearance and Structure Consistency for Unsupervised Domain Adaptation in Fetal Brain MRI Segmentation

HFSCCD: A Hybrid Neural Network for Fetal Standard Cardiac Cycle Detection in Ultrasound Videos

A deep learning framework for identifying and segmenting three vessels in fetal heart ultrasound images

Uncertainty-aware domain alignment for anatomical structure segmentation

UU-Mamba: Uncertainty-aware U-Mamba for Cardiovascular Segmentation

Fetal heart ultrasound image-oriented adaptive classification deep model based on differentiable architecture search

Unsupervised Domain Adaptation for Brain Structure Segmentation Via Mutual Information Maximization Alignment

GraphEcho: Graph-Driven Unsupervised Domain Adaptation for Echocardiogram Video Segmentation

Disentangle Domain Features for Cross-Modality Cardiac Image Segmentation.

Automated cardiac segmentation of cross-modal medical images using unsupervised multi-domain adaptation and spatial neural attention structure

Diffuse-UDA: Addressing Unsupervised Domain Adaptation in Medical Image Segmentation with Appearance and Structure Aligned Diffusion Models

Segmentation of four-chamber view images in fetal ultrasound exams using a novel deep learning model ensemble method

Automatic segmentation of 15 critical anatomical labels and measurements of cardiac axis and cardiothoracic ratio in fetal four chambers using nnU-NetV2

UU-Mamba: Uncertainty-aware U-Mamba for Cardiac Image Segmentation

MAPSeg: Unified Unsupervised Domain Adaptation for Heterogeneous Medical Image Segmentation Based on 3D Masked Autoencoding and Pseudo-Labeling