A fast learning algorithm for multi-layer extreme learning machine

Jiexiong Tang, Chenwei Deng, Guang Bin Huang, Junhui Hou

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

27 Citations (Scopus)

Abstract

Extreme learning machine (ELM) is an efficient training algorithm originally proposed for single-hidden layer feedforward networks (SLFNs), of which the input weights are randomly chosen and need not to be fine-tuned. In this paper, we present a new stack architecture for ELM, to further improve the learning accuracy of ELM while maintaining its advantage of training speed. By exploiting the hidden information of ELM random feature space, a recovery-based training model is developed and incorporated into the proposed ELM stack architecture. Experimental results of the MNIST handwriting dataset demonstrate that the proposed algorithm achieves better and much faster convergence than the state-of-the-art ELM and deep learning methods.

Original languageEnglish
Title of host publication2014 IEEE International Conference on Image Processing, ICIP 2014
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages175-178
Number of pages4
ISBN (Electronic)9781479957514
DOIs
Publication statusPublished - 28 Jan 2014

Publication series

Name2014 IEEE International Conference on Image Processing, ICIP 2014

Keywords

  • Extreme learning machine (ELM)
  • deep learning
  • multi-layer training
  • sparse representation

Fingerprint

Dive into the research topics of 'A fast learning algorithm for multi-layer extreme learning machine'. Together they form a unique fingerprint.

Cite this