Abstract:Cognitive robotic systems nowadays are intensively involving learning algorithms to achieve highly adaptive and intelligent behaviors, including actuation, sensing, perception and adaptive control. Deep learning has emerged as an effective approach in image-based robotic perception and actions. Towards cognitive robotic perception based on deep learning, this paper focuses the Constrained Restricted Boltzmann Machine (RBM) on visual images for sparse feature representation. Inspired by sparse coding, the sparse constraints are performed on the hidden layer of RBM to obtain sparse and effective feature representation from perceived visual images. The RBM with Sparse Constraint (RBMSC) is proposed with a generalized optimization problem, where the constraints are applied on the probability density of hidden units directly to obtain more sparse representation. This paper presents three novel RBM variants, namely L 1-RBM, L 2-RBM, and L 1/2-RBM constrained by L 1-norm, L 2-norm, and L 1/2-norm on RBM, respectively. A Deep Belief Network with two hidden layers is built for comparison between each RBM variants. The experiments on MNIST database (Mixed National Institute of Standards and Technology database) show that the L 1/2-RBM can obtain more sparse representation than RBM, L 1-RBM, L 2-RBM, and Sparse-RBM (SRBM) in terms of sparseness metric. For further verification, the proposed methods are still tested on MNIST Variations dataset. The recognition results from perceived images in MNIST and MNIST Variations demonstrate that our proposed constrained RBM variants are feasible for object cognitive and perception, and the proposed L 1/2-RBM and L 1-RBM outperforms RBM and SRBM in terms of object recognition.

Sparse Group Restricted Boltzmann Machines

Enhancing performance of restricted Boltzmann machines via log-sum regularization.

Training Restricted Boltzmann Machines with Binary Synapses Using the Bayesian Learning Rule

Gaussian Cardinality Restricted Boltzmann Machines.

Sparse Restricted Boltzmann Machine Based on Data Class Entropy

A New Sparse Restricted Boltzmann Machine

Cardinality restricted boltzmann machines

Subspace Restricted Boltzmann Machine

Analysis of Different Sparsity Methods in Constrained RBM for Sparse Representation in Cognitive Robotic Perception

Generative and Discriminative Infinite Restricted Boltzmann Machine Training

Restricted Boltzmann Machine with Adaptive Local Hidden Units.

Sparse Restricted Boltzmann Machine Based on Multiobjective Optimization.

Fault Diagnosis Based on Sparse Class Gaussian Restrict Boltzmann Machine Model

Structural Restricted Boltzmann Machine for image denoising and classification

A Novel Restricted Boltzmann Machine Training Algorithm with Fast Gibbs Sampling Policy

A New Variant of Restricted Boltzmann Machine with Horizontal Connections

A Precise Method for RBMs Training Using Phased Curricula

Deep Restricted Boltzmann Networks

Learning Discriminative Representation with Signed Laplacian Restricted Boltzmann Machine

Graph Regularized Restricted Boltzmann Machine

Training Deep Belief Network with Sparse Hidden Units.