Abstract:Cognitive robotic systems nowadays are intensively involving learning algorithms to achieve highly adaptive and intelligent behaviors, including actuation, sensing, perception and adaptive control. Deep learning has emerged as an effective approach in image-based robotic perception and actions. Towards cognitive robotic perception based on deep learning, this paper focuses the Constrained Restricted Boltzmann Machine (RBM) on visual images for sparse feature representation. Inspired by sparse coding, the sparse constraints are performed on the hidden layer of RBM to obtain sparse and effective feature representation from perceived visual images. The RBM with Sparse Constraint (RBMSC) is proposed with a generalized optimization problem, where the constraints are applied on the probability density of hidden units directly to obtain more sparse representation. This paper presents three novel RBM variants, namely L 1-RBM, L 2-RBM, and L 1/2-RBM constrained by L 1-norm, L 2-norm, and L 1/2-norm on RBM, respectively. A Deep Belief Network with two hidden layers is built for comparison between each RBM variants. The experiments on MNIST database (Mixed National Institute of Standards and Technology database) show that the L 1/2-RBM can obtain more sparse representation than RBM, L 1-RBM, L 2-RBM, and Sparse-RBM (SRBM) in terms of sparseness metric. For further verification, the proposed methods are still tested on MNIST Variations dataset. The recognition results from perceived images in MNIST and MNIST Variations demonstrate that our proposed constrained RBM variants are feasible for object cognitive and perception, and the proposed L 1/2-RBM and L 1-RBM outperforms RBM and SRBM in terms of object recognition.

Sparse Restricted Boltzmann Machine Based on Data Class Entropy

A New Sparse Restricted Boltzmann Machine

Cardinality restricted boltzmann machines

Sparse Group Restricted Boltzmann Machines

Gaussian Cardinality Restricted Boltzmann Machines.

Training Restricted Boltzmann Machines with Binary Synapses Using the Bayesian Learning Rule

Sparse Restricted Boltzmann Machine Based on Multiobjective Optimization.

Hyperparameters Adaptation for Restricted Boltzmann Machines Based on Free Energy

A Novel Restricted Boltzmann Machine Training Algorithm with Fast Gibbs Sampling Policy

Privacy-Preserving Restricted Boltzmann Machine

Generative and Discriminative Infinite Restricted Boltzmann Machine Training

Analysis of Different Sparsity Methods in Constrained RBM for Sparse Representation in Cognitive Robotic Perception

Enhancing performance of restricted Boltzmann machines via log-sum regularization.

Graph Regularized Restricted Boltzmann Machine

Method to Improve the Performance of Restricted Boltzmann Machines.

An Optimized Dimensionality Reduction Model for High-Dimensional Data Based on Restricted Boltzmann Machines

On the Quantitative Analysis of Sparse RBMs.

Generalized Boltzmann Machine with Deep Neural Structure.

From Class-Specific to Class-Mixture: Cascaded Feature Representations Via Restricted Boltzmann Machine Learning.

Training Deep Belief Network with Sparse Hidden Units.

Adversarial Training Methods for Boltzmann Machines