Association Journal of CSIAM
Supervised by Ministry of Education of PRC
Sponsored by Xi'an Jiaotong University
ISSN 1005-3085  CN 61-1269/O1

Chinese Journal of Engineering Mathematics ›› 2015, Vol. 32 ›› Issue (2): 159-173.doi: 10.3969/j.issn.1005-3085.2015.02.001

    Next Articles

Restricted Boltzmann Machines

ZHANG Chun-xia1,   JI Nan-nan2,   WANG Guan-wei3   

  1. 1- School of Mathematics and Statistics, Xi'an Jiaotong University, Xi'an 710049
    2- School of Science, Chang'an University, Xi'an 710064
    3- School of Mechatronic Engineering, Xi'an Technological University, Xi'an 710021
  • Received:2013-08-22 Accepted:2014-05-19 Online:2015-04-15 Published:2015-06-15
  • Supported by:
    The National Basic Research Program of China, 973 Program (2013CB329406); the Major Research Project of the National Natural Science Foundation of China (91230101); the National Natural Science Foundation of China (11201367); the Fundamental Research Funds for the Central Universities of China (xjj2011048).

Abstract:

A restricted Boltzmann machine (RBM) is a particular type of random neural network model which has two-layer architecture, symmetric connections and no self-feedback. The two layers in an RBM are fully connected but there are no connections within the same layer. Recently, with the advent of a fast learning algorithm for RBMs (i.e., contrastive divergence), the machine learning community set off a surge to study the theory and applications of RBMs since it has many advantages. For example, a RBM provides us an effective tool to detect features. When a feed-forward neural network is initialized with an RBM, its generalization capability can be significantly improved. A deep belief network composed of several RBMs can detect more abstract features. Due to the advantages and wide applications of RBMs in deep learning, this paper attempts to provide a introductory guide for novice. It presents a detailed introduction of basic RBM model, its representative learning algorithm, parametric settings, evaluation methods, its variants and etc. Finally, some research directions of RBMs that are deserved to be further studied are discussed.

Key words: machine learning, deep learning, restricted Boltzmann machine, contrastive divergence, Gibbs sampling

CLC Number: