Semi-supervised Learning and Feature Evaluation for RGB-D Object Recognition

Yanhua Cheng,Xin Zhao,Kaiqi Huang,Tieniu Tan

DOI: https://doi.org/10.1016/j.cviu.2015.05.007

IF: 4.886

2015-01-01

Computer Vision and Image Understanding

Abstract:•We propose a semi-supervised learning method for RGB-D object recognition.•We propose CNN-SPM-RNN to extract powerful RGB-D features.•An unbiased feature evaluation for recent RGB-D features are introduced.

What problem does this paper attempt to address?

Semi-supervised Learning for RGB-D Object Recognition.

Yanhua Cheng,Xin Zhao,Rui Cai,Zhiwei Li,Kaiqi Huang,Yong Rui

DOI: https://doi.org/10.1109/icpr.2014.412

2016-01-01

Abstract:Conventional supervised object recognition methods have been investigated for many years. Despite their successes, there are still two suffering limitations: (1) various information of an object is represented by artificial features only derived from RGB images, (2) lots of manually labeled data is required by supervised learning. To address those limitations, we propose a new semi-supervised learning framework based on RGB and depth (RGB-D) images to improve object recognition. In particular, our framework has two modules: (1) RGB and depth images are represented by convolutional-recursive neural networks to construct high level features, respectively, (2) co-training is exploited to make full use of unlabeled RGB-D instances due to the existing two independent views. Experiments on the standard RGB-D object dataset demonstrate that our method can compete against with other state-of-the-art methods with only 20% labeled data.
Improving RGB-D Face Recognition via Transfer Learning from a Pretrained 2D Network.

Xingwang Xiong,Xu Wen,Cheng Huang

DOI: https://doi.org/10.1007/978-3-030-49556-5_14

2019-01-01

Abstract:2D Face recognition has been extensively studied for decades and has reached remarkable results in recent years. However, 2D Face recognition is sensitive to variations in poses, facial expressions and illuminations. Depth images provide valuable information to help model facial boundaries and understand the global facial layout and provide low frequency patterns. Intuitively, RGB-D images are more robust to external environments than RGB images. Unfortunately, RGB-D datasets are orders of magnitude smaller than 2D datasets and insufficient to train a deep CNN model as effective as RGB-based models. To tackle these challenges, we present an RGB-D ResNet50 model which can be transferred from a pretrained RGB model and takes RGB-D images as input. We achieved an accuracy of 94.64% and won the place on 3D Face Recognition Algorithm Challenge , 2019 BenchCouncil International Artificial Intelligence System Challenges .
ACNET: Attention Based Network to Exploit Complementary Features for RGBD Semantic Segmentation.

Xinxin Hu,Kailun Yang,Lei Fei,Kaiwei Wang

DOI: https://doi.org/10.1109/icip.2019.8803025

2019-01-01

Abstract:Compared to RGB semantic segmentation, RGBD semantic segmentation can achieve better performance by taking depth information into consideration. However, it is still problematic for contemporary segmenters to effectively exploit RGBD information since the feature distributions of RGB and depth (D) images vary significantly in different scenes. In this paper, we propose an Attention Complementary Network (ACNet) that selectively gathers features from RGB and depth branches. The main contributions lie in the Attention Complementary Module (ACM) and the architecture with three parallel branches. More precisely, ACM is a channel attention-based module that extracts weighted features from RGB and depth branches. The architecture preserves the inference of the original RGB and depth branches, and enables the fusion branch at the same time. Based on the above structures, ACNet is capable of exploiting more high-quality features from different channels. We evaluate our model on SUN-RGBD and NYUDv2 datasets, and prove that our model outperforms state-of-the-art methods. In particular, a mIoU score of 48.3% on NYUDv2 test set is achieved with ResNet50. We will release our source code based on PyTorch and the trained segmentation model at https://github.com/anheidelonghu/ACNet.
Large-Margin Multi-Modal Deep Learning for RGB-D Object Recognition

Anran Wang,Jiwen Lu,Jianfei Cai,Tat-Jen Cham,Gang Wang

DOI: https://doi.org/10.1109/tmm.2015.2476655

IF: 7.3

2015-01-01

IEEE Transactions on Multimedia

Abstract:Most existing feature learning-based methods for RGB-D object recognition either combine RGB and depth data in an undifferentiated manner from the outset, or learn features from color and depth separately, which do not adequately exploit different characteristics of the two modalities or utilize the shared relationship between the modalities. In this paper, we propose a general CNN-based multi-modal learning framework for RGB-D object recognition. We first construct deep CNN layers for color and depth separately, which are then connected with a carefully designed multi-modal layer. This layer is designed to not only discover the most discriminative features for each modality, but is also able to harness the complementary relationship between the two modalities. The results of the multi-modal layer are back-propagated to update parameters of the CNN layers, and the multi-modal feature learning and the back-propagation are iteratively performed until convergence. Experimental results on two widely used RGB-D object datasets show that our method for general multi-modal learning achieves comparable performance to state-of-the-art methods specifically designed for RGB-D data.
MMSS: Multi-modal Sharable and Specific Feature Learning for RGB-D Object Recognition.

Anran Wang,Jianfei Cai,Jiwen Lu,Tat-Jen Cham

DOI: https://doi.org/10.1109/iccv.2015.134

2015-01-01

Abstract:Most of the feature-learning methods for RGB-D object recognition either learn features from color and depth modalities separately, or simply treat RGB-D as undifferentiated four-channel data, which cannot adequately exploit the relationship between different modalities. Motivated by the intuition that different modalities should contain not only some modal-specific patterns but also some shared common patterns, we propose a multi-modal feature learning framework for RGB-D object recognition. We first construct deep CNN layers for color and depth separately, and then connect them with our carefully designed multimodal layers, which fuse color and depth information by enforcing a common part to be shared by features of different modalities. In this way, we obtain features reflecting shared properties as well as modal-specific properties in different modalities. The information of the multi-modal learning frameworks is back-propagated to the early CNN layers. Experimental results show that our proposed multimodal feature learning method outperforms state-of-the-art approaches on two widely used RGB-D object benchmark datasets.
RGB×D: Learning Depth-Weighted RGB Patches for RGB-D Indoor Semantic Segmentation

Jinming Cao,Hanchao Leng,Daniel Cohen-Or,Dani Lischinski,Ying Chen,Changhe Tu,Yangyan Li

DOI: https://doi.org/10.1016/j.neucom.2021.08.009

IF: 6

2021-01-01

Neurocomputing

Abstract:Significant advances have been made in designing CNNs for RGB semantic segmentation. However, these CNNs are not widely adopted for RGB-D segmentation, due to the asymmetry between the RGB and depth modalities. Instead, dedicated architectures are designed to fuse them for effective RGB-D segmentation, wherein complex structures are often employed, resulting in much increased computational cost. In this paper, we propose a novel way to learn the fusion of RGB and depth information in an early stage. This enables our method to easily adopt existing RGB segmentation networks with minimal modification. Our method is simple yet effective to build a bridge between RGB and RGBD semantic segmentation, so as to avoid designing a far more complex network structure for RGBD segmentation. The proposed method treats RGB and depth information in an inherently asymmetric manner, and to the best of our knowledge, this is the first approach that learns to fuse them in a multiplicative manner for RGB-D segmentation; thus, we call it RGB×D. Extensive experiments and ablation studies on the challenging NYUDv2, SUN RGB-D and Cityscapes semantic segmentation benchmarks show that the proposed RGB×D offers a consistent improvement over several baselines.
Boosting RGB-D Saliency Detection by Leveraging Unlabeled RGB Images

Xiaoqiang Wang,Lei Zhu,Siliang Tang,Huazhu Fu,Ping Li,Fei Wu,Yi Yang,Yueting Zhuang

DOI: https://doi.org/10.1109/tip.2021.3139232

IF: 10.6

2022-01-01

IEEE Transactions on Image Processing

Abstract:Training deep models for RGB-D salient object detection (SOD) often requires a large number of labeled RGB-D images. However, RGB-D data is not easily acquired, which limits the development of RGB-D SOD techniques. To alleviate this issue, we present a Dual-Semi RGB-D Salient Object Detection Network (DS-Net) to leverage unlabeled RGB images for boosting RGB-D saliency detection. We first devise a depth decoupling convolutional neural network (DDCNN), which contains a depth estimation branch and a saliency detection branch. The depth estimation branch is trained with RGB-D images and then used to estimate the pseudo depth maps for all unlabeled RGB images to form the paired data. The saliency detection branch is used to fuse the RGB feature and depth feature to predict the RGB-D saliency. Then, the whole DDCNN is assigned as the backbone in a teacher-student framework for semi-supervised learning. Moreover, we also introduce a consistency loss on the intermediate attention and saliency maps for the unlabeled data, as well as a supervised depth and saliency loss for labeled data. Experimental results on seven widely-used benchmark datasets demonstrate that our DDCNN outperforms state-of-the-art methods both quantitatively and qualitatively. We also demonstrate that our semi-supervised DS-Net can further improve the performance, even when using an RGB image with the pseudo depth map.

computer science, artificial intelligence,engineering, electrical & electronic
Unsupervised Feature Learning For Rgb-D Image Classification

I-Hong Jhuo,Shenghua Gao,Liansheng Zhuang,D. T. Lee,Yi Ma

DOI: https://doi.org/10.1007/978-3-319-16865-4_18

2014-01-01

Abstract:Motivated by the success of Deep Neural Networks in computer vision, we propose a deep Regularized Reconstruction Independent Component Analysis network (R(2)ICA) for RGB-D image classification. In each layer of this network, we include a R(2)ICA as the basic building block to determine the relationship between the gray-scale and depth images corresponding to the same object or scene. Implementing commonly used local contrast normalization and spatial pooling, we gradually enhance our network to be resilient to local variance resulting in a robust image representation for RGB-D image classification. Moreover, compared with conventional handcrafted feature-based RGB-D image representation, the proposed deep R(2)ICA is a feedforward network. Hence, it is more efficient for image representation. Experimental results on three publicly available RGB-D datasets demonstrate that the proposed method consistently outperforms the state-of-the-art conventional, manually designed RGB-D image representation confirming its effectiveness for RGB-D image classification.
Performance evaluation of deep feature learning for RGB-D image/video classification

Ling Shao,Ziyun Cai,Li Liu,Ke Lu

DOI: https://doi.org/10.1016/j.ins.2017.01.013

IF: 8.1

2017-04-01

Information Sciences

Abstract:Deep Neural Networks for image/video classification have obtained much success in various computer vision applications. Existing deep learning algorithms are widely used on RGB images or video data. Meanwhile, with the development of low-cost RGB-D sensors (such as Microsoft Kinect and Xtion Pro-Live), high-quality RGB-D data can be easily acquired and used to enhance computer vision algorithms [14]. It would be interesting to investigate how deep learning can be employed for extracting and fusing features from RGB-D data. In this paper, after briefly reviewing the basic concepts of RGB-D information and four prevalent deep learning models (i.e., Deep Belief Networks (DBNs), Stacked Denoising Auto-Encoders (SDAE), Convolutional Neural Networks (CNNs) and Long Short-Term Memory (LSTM) Neural Networks), we conduct extensive experiments on five popular RGB-D datasets including three image datasets and two video datasets. We then present a detailed analysis about the comparison between the learned feature representations from the four deep learning models. In addition, a few suggestions on how to adjust hyper-parameters for learning deep neural networks are made in this paper. According to the extensive experimental results, we believe that this evaluation will provide insights and a deeper understanding of different deep learning algorithms for RGB-D feature extraction and fusion.

computer science, information systems
Multi-Modal Unsupervised Feature Learning For Rgb-D Scene Labeling

Anran Wang,Jiwen Lu,Gang Wang,Jianfei Cai,Tat-Jen Cham

DOI: https://doi.org/10.1007/978-3-319-10602-1_30

2014-01-01

Abstract:Most of the existing approaches for RGB-D indoor scene labeling employ hand-crafted features for each modality independently and combine them in a heuristic manner. There has been some attempt on directly learning features from raw RGB-D data, but the performance is not satisfactory. In this paper, we adapt the unsupervised feature learning technique for RGB-D labeling as a multi-modality learning problem. Our learning framework performs feature learning and feature encoding simultaneously which significantly boosts the performance. By stacking basic learning structure, higher-level features are derived and combined with lower-level features for better representing RGB-D data. Experimental results on the benchmark NYU depth dataset show that our method achieves competitive performance, compared with state-of-the-art.
RGB-D-Based Object Recognition Using Multimodal Convolutional Neural Networks: A Survey

Mingliang Gao,Jun Jiang,Guofeng Zou,Vijay John,Zheng Liu

DOI: https://doi.org/10.1109/access.2019.2907071

IF: 3.9

2019-01-01

IEEE Access

Abstract:Object recognition in real-world environments is one of the fundamental and key tasks in computer vision and robotics communities. With the advanced sensing technologies and low-cost depth sensors, the high-quality RGB and depth images can be recorded synchronously, and the object recognition performance can be improved by jointly exploiting them. RGB-D-based object recognition has evolved from early methods that using hand-crafted representations to the current state-of-the-art deep learning-based methods. With the undeniable success of deep learning, especially convolutional neural networks (CNNs) in the visual domain, the natural progression of deep learning research points to problems involving larger and more complex multimodal data. In this paper, we provide a comprehensive survey of recent multimodal CNNs (MMCNNs)-based approaches that have demonstrated significant improvements over previous methods. We highlight two key issues, namely, training data deficiency and multimodal fusion. In addition, we summarize and discuss the publicly available RGB-D object recognition datasets and present a comparative performance evaluation of the proposed methods on these benchmark datasets. Finally, we identify promising avenues of research in this rapidly evolving field. This survey will not only enable researchers to get a good overview of the state-of-the-art methods for RGB-D-based object recognition but also provide a reference for other multimodal machine learning applications, e.g., multimodal medical image fusion, audio-visual speech recognition, and multimedia retrieval and generation.

computer science, information systems,telecommunications,engineering, electrical & electronic
Weakly-supervised DCNN for RGB-D Object Recognition in Real-World Applications Which Lack Large-scale Annotated Training Data

Li Sun,Cheng Zhao,Rustam Stolkin

DOI: https://doi.org/10.1109/JSEN.2018.2888815

2017-03-19

Abstract:This paper addresses the problem of RGBD object recognition in real-world applications, where large amounts of annotated training data are typically unavailable. To overcome this problem, we propose a novel, weakly-supervised learning architecture (DCNN-GPC) which combines parametric models (a pair of Deep Convolutional Neural Networks (DCNN) for RGB and D modalities) with non-parametric models (Gaussian Process Classification). Our system is initially trained using a small amount of labeled data, and then automatically prop- agates labels to large-scale unlabeled data. We first run 3D- based objectness detection on RGBD videos to acquire many unlabeled object proposals, and then employ DCNN-GPC to label them. As a result, our multi-modal DCNN can be trained end-to-end using only a small amount of human annotation. Finally, our 3D-based objectness detection and multi-modal DCNN are integrated into a real-time detection and recognition pipeline. In our approach, bounding-box annotations are not required and boundary-aware detection is achieved. We also propose a novel way to pretrain a DCNN for the depth modality, by training on virtual depth images projected from CAD models. We pretrain our multi-modal DCNN on public 3D datasets, achieving performance comparable to state-of-the-art methods on Washington RGBS Dataset. We then finetune the network by further training on a small amount of annotated data from our novel dataset of industrial objects (nuclear waste simulants). Our weakly supervised approach has demonstrated to be highly effective in solving a novel RGBD object recognition application which lacks of human annotations.

Computer Vision and Pattern Recognition
Multi-modal Deep Feature Learning for RGB-D Object Detection

Xiangyang Xu,Yuncheng Li,Gangshan Wu,Jiebo Luo

DOI: https://doi.org/10.1016/j.patcog.2017.07.026

IF: 8

2017-01-01

Pattern Recognition

Abstract:•We present an approach for RGB-D object detection, which can exploit both modality-correlated and modality-specific relationships between RGB and depth images.•The shared weights strategy and a parameter-free-correlation layer are introduced to extract the modality-correlated representations.•The proposed approach can simultaneously generate RGB-D region proposals and perform region-wise RGB-D object recognition.
Multimodal deep learning for robust RGB-D object recognition

Andreas Eitel,Jost Tobias Springenberg,Luciano Spinello,Martin Riedmiller,Wolfram Burgard

DOI: https://doi.org/10.1109/iros.2015.7353446

2015-09-01

Abstract:Robust object recognition is a crucial ingredient of many, if not all, real-world robotics applications. This paper leverages recent progress on Convolutional Neural Networks (CNNs) and proposes a novel RGB-D architecture for object recognition. Our architecture is composed of two separate CNN processing streams - one for each modality - which are consecutively combined with a late fusion network. We focus on learning with imperfect sensor data, a typical problem in real-world robotics tasks. For accurate learning, we introduce a multi-stage training methodology and two crucial ingredients for handling depth data with CNNs. The first, an effective encoding of depth information for CNN s that enables learning without the need for large depth datasets. The second, a data augmentation scheme for robust learning with depth images by corrupting them with realistic noise patterns. We present state-of-the-art results on the RGB-D object dataset [15] and show recognition in challenging RGB-D real-world noisy settings.
A Semi‐supervised Network Based on Feature Embeddings for Image Classification

Raphael Elimeli Nuhoho,Chen Wenyu,Adu Asare Baffour

DOI: https://doi.org/10.1111/exsy.12908

IF: 3.3

2021-01-01

Expert Systems

Abstract:Deep learning approaches, including convolutional neural networks, are suitable for image classification tasks with well‐labelled data. Unfortunately, we do not always have sufficiently labelled data. Recent methods attempt to leverage labelled and unlabelled data using fine‐tuning or transfer learning. However, these methods rely on low‐level image features. This article departs from recent works and proposes a new semi‐supervised learning network that constitutes a convolutional branch and a neighbour cluster branch. Also, we introduce a new loss function that carefully optimizes the network according to the labelled/unlabelled data. In this way, we reduce any tendency to rely on low‐level features, which is the case in current methods. We use datasets from three different domains (hand‐written digits, natural images, and objects) to analyse the performance of our method. Experimental analysis shows that the network performs better by learning inherent discrimination features when integrating unlabelled data into the model's training process. Our proposed approach also provides strong generalization in the context of transfer learning. Finally, this study shows that the proposed loss function optimizes the network to produce more efficient feature embeddings for domain adaptation.
Self-Supervised Learning of Object Segmentation from Unlabeled RGB-D Videos

Shiyang Lu,Yunfu Deng,Abdeslam Boularias,Kostas Bekris

2023-04-10

Abstract:This work proposes a self-supervised learning system for segmenting rigid objects in RGB images. The proposed pipeline is trained on unlabeled RGB-D videos of static objects, which can be captured with a camera carried by a mobile robot. A key feature of the self-supervised training process is a graph-matching algorithm that operates on the over-segmentation output of the point cloud that is reconstructed from each video. The graph matching, along with point cloud registration, is able to find reoccurring object patterns across videos and combine them into 3D object pseudo labels, even under occlusions or different viewing angles. Projected 2D object masks from 3D pseudo labels are used to train a pixel-wise feature extractor through contrastive learning. During online inference, a clustering method uses the learned features to cluster foreground pixels into object segments. Experiments highlight the method's effectiveness on both real and synthetic video datasets, which include cluttered scenes of tabletop objects. The proposed method outperforms existing unsupervised methods for object segmentation by a large margin.

Computer Vision and Pattern Recognition,Robotics
Semi-supervised support vector learning for face recognition

Ke Lu,Xiaofei He,Jidong Zhao

DOI: https://doi.org/10.1007/11760023_16

2006-01-01

Abstract:Recently semi-supervised learning has attracted a lot of attention. Different from traditional supervised learning, semi-supervised learning makes use of both labeled and unlabeled data. In face recognition, collecting labeled examples costs human effort, while vast amounts of unlabeled data are often readily available and offer some additional information. In this paper, based on Support Vector Machine (SVM), we introduce a novel semi-supervised learning method for face recognition. The basic idea of the method is that, if two data points are close to each other, they tend to share the same label. Therefore, it is reasonable to search a projection with maximal margin and locality preserving property. We compare our method to standard SVM and transductive SVM. Experimental results show efficiency and effectiveness of our method.
Recognizing RGB Images by Learning from RGB-D Data

Lin Chen,Wen Li,Dong Xu

DOI: https://doi.org/10.1109/cvpr.2014.184

2014-01-01

Abstract:In this work, we propose a new framework for recognizing RGB images captured by the conventional cameras by leveraging a set of labeled RGB-D data, in which the depth features can be additionally extracted from the depth images. We formulate this task as a new unsupervised domain adaptation (UDA) problem, in which we aim to take advantage of the additional depth features in the source domain and also cope with the data distribution mismatch between the source and target domains. To effectively utilize the additional depth features, we seek two optimal projection matrices to map the samples from both domains into a common space by preserving as much as possible the correlations between the visual features and depth features. To effectively employ the training samples from the source domain for learning the target classifier, we reduce the data distribution mismatch by minimizing the Maximum Mean Discrepancy (MMD) criterion, which compares the data distributions for each type of feature in the common space. Based on the above two motivations, we propose a new SVM based objective function to simultaneously learn the two projection matrices and the optimal target classifier in order to well separate the source samples from different classes when using each type of feature in the common space. An efficient alternating optimization algorithm is developed to solve our new objective function. Comprehensive experiments for object recognition and gender recognition demonstrate the effectiveness of our proposed approach for recognizing RGB images by learning from RGB-D data.
Depth CNNs for RGB-D scene recognition: learning from scratch better than transferring from RGB-CNNs

Xinhang Song,Luis Herranz,Shuqiang Jiang

DOI: https://doi.org/10.48550/arXiv.1801.06797

2018-01-21

Computer Vision and Pattern Recognition

Abstract:Scene recognition with RGB images has been extensively studied and has reached very remarkable recognition levels, thanks to convolutional neural networks (CNN) and large scene datasets. In contrast, current RGB-D scene data is much more limited, so often leverages RGB large datasets, by transferring pretrained RGB CNN models and fine-tuning with the target RGB-D dataset. However, we show that this approach has the limitation of hardly reaching bottom layers, which is key to learn modality-specific features. In contrast, we focus on the bottom layers, and propose an alternative strategy to learn depth features combining local weakly supervised training from patches followed by global fine tuning with images. This strategy is capable of learning very discriminative depth-specific features with limited depth images, without resorting to Places-CNN. In addition we propose a modified CNN architecture to further match the complexity of the model and the amount of data available. For RGB-D scene recognition, depth and RGB features are combined by projecting them in a common space and further leaning a multilayer classifier, which is jointly optimized in an end-to-end network. Our framework achieves state-of-the-art accuracy on NYU2 and SUN RGB-D in both depth only and combined RGB-D data.
FSD: Fast Self-Supervised Single RGB-D to Categorical 3D Objects

Mayank Lunayach,Sergey Zakharov,Dian Chen,Rares Ambrus,Zsolt Kira,Muhammad Zubair Irshad

2023-10-20

Abstract:In this work, we address the challenging task of 3D object recognition without the reliance on real-world 3D labeled data. Our goal is to predict the 3D shape, size, and 6D pose of objects within a single RGB-D image, operating at the category level and eliminating the need for CAD models during inference. While existing self-supervised methods have made strides in this field, they often suffer from inefficiencies arising from non-end-to-end processing, reliance on separate models for different object categories, and slow surface extraction during the training of implicit reconstruction models; thus hindering both the speed and real-world applicability of the 3D recognition process. Our proposed method leverages a multi-stage training pipeline, designed to efficiently transfer synthetic performance to the real-world domain. This approach is achieved through a combination of 2D and 3D supervised losses during the synthetic domain training, followed by the incorporation of 2D supervised and 3D self-supervised losses on real-world data in two additional learning stages. By adopting this comprehensive strategy, our method successfully overcomes the aforementioned limitations and outperforms existing self-supervised 6D pose and size estimation baselines on the NOCS test-set with a 16.4% absolute improvement in mAP for 6D pose estimation while running in near real-time at 5 Hz.

Computer Vision and Pattern Recognition,Robotics

Semi-supervised Learning and Feature Evaluation for RGB-D Object Recognition

Semi-supervised Learning for RGB-D Object Recognition.

Improving RGB-D Face Recognition via Transfer Learning from a Pretrained 2D Network.

ACNET: Attention Based Network to Exploit Complementary Features for RGBD Semantic Segmentation.

Large-Margin Multi-Modal Deep Learning for RGB-D Object Recognition

MMSS: Multi-modal Sharable and Specific Feature Learning for RGB-D Object Recognition.

RGB×D: Learning Depth-Weighted RGB Patches for RGB-D Indoor Semantic Segmentation

Boosting RGB-D Saliency Detection by Leveraging Unlabeled RGB Images

Unsupervised Feature Learning For Rgb-D Image Classification

Performance evaluation of deep feature learning for RGB-D image/video classification

Multi-Modal Unsupervised Feature Learning For Rgb-D Scene Labeling

RGB-D-Based Object Recognition Using Multimodal Convolutional Neural Networks: A Survey

Weakly-supervised DCNN for RGB-D Object Recognition in Real-World Applications Which Lack Large-scale Annotated Training Data

Multi-modal Deep Feature Learning for RGB-D Object Detection

Multimodal deep learning for robust RGB-D object recognition

A Semi‐supervised Network Based on Feature Embeddings for Image Classification

Self-Supervised Learning of Object Segmentation from Unlabeled RGB-D Videos

Semi-supervised support vector learning for face recognition

Recognizing RGB Images by Learning from RGB-D Data

Depth CNNs for RGB-D scene recognition: learning from scratch better than transferring from RGB-CNNs

FSD: Fast Self-Supervised Single RGB-D to Categorical 3D Objects