Abstract:Cognitive robotic systems nowadays are intensively involving learning algorithms to achieve highly adaptive and intelligent behaviors, including actuation, sensing, perception and adaptive control. Deep learning has emerged as an effective approach in image-based robotic perception and actions. Towards cognitive robotic perception based on deep learning, this paper focuses the Constrained Restricted Boltzmann Machine (RBM) on visual images for sparse feature representation. Inspired by sparse coding, the sparse constraints are performed on the hidden layer of RBM to obtain sparse and effective feature representation from perceived visual images. The RBM with Sparse Constraint (RBMSC) is proposed with a generalized optimization problem, where the constraints are applied on the probability density of hidden units directly to obtain more sparse representation. This paper presents three novel RBM variants, namely L 1-RBM, L 2-RBM, and L 1/2-RBM constrained by L 1-norm, L 2-norm, and L 1/2-norm on RBM, respectively. A Deep Belief Network with two hidden layers is built for comparison between each RBM variants. The experiments on MNIST database (Mixed National Institute of Standards and Technology database) show that the L 1/2-RBM can obtain more sparse representation than RBM, L 1-RBM, L 2-RBM, and Sparse-RBM (SRBM) in terms of sparseness metric. For further verification, the proposed methods are still tested on MNIST Variations dataset. The recognition results from perceived images in MNIST and MNIST Variations demonstrate that our proposed constrained RBM variants are feasible for object cognitive and perception, and the proposed L 1/2-RBM and L 1-RBM outperforms RBM and SRBM in terms of object recognition.

Sparse Restricted Boltzmann Machine Based on Multiobjective Optimization.

Hyperparameters Adaptation for Restricted Boltzmann Machines Based on Free Energy

An Adaptive Deep Belief Network With Sparse Restricted Boltzmann Machines

Restricted Boltzmann machine based algorithm for multi-objective optimization

Enhancing performance of restricted Boltzmann machines via log-sum regularization.

Parallel Design of Sparse Deep Belief Network with Multi-Objective Optimization

Cardinality restricted boltzmann machines

Training Restricted Boltzmann Machines with Binary Synapses Using the Bayesian Learning Rule

Analysis of Different Sparsity Methods in Constrained RBM for Sparse Representation in Cognitive Robotic Perception

A New Sparse Restricted Boltzmann Machine

Sparse Restricted Boltzmann Machine Based on Data Class Entropy

Method to Improve the Performance of Restricted Boltzmann Machines.

Sparse Group Restricted Boltzmann Machines

A Multiobjective Sparse Feature Learning Model for Deep Neural Networks

A Precise Method for RBMs Training Using Phased Curricula

A Novel Restricted Boltzmann Machine Training Algorithm with Fast Gibbs Sampling Policy

Generative and Discriminative Infinite Restricted Boltzmann Machine Training

Restricted Boltzmann Machine with Adaptive Local Hidden Units.

An automatic setting for training restricted boltzmann machine

Contrastive Divergence Learning of Restricted Boltzmann Machine

An Overview on Restricted Boltzmann Machines.