An improved dropout method and its application into DBN-based handwriting recognition

Guangzheng Hu, Huifang Li, Lixuan Luo, Yuanqing Xia

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

7 Citations (Scopus)

Abstract

As a typical deep learning method, Deep Belief Network (DBN) and Dropout method are usually used together for pattern recognition in case of lacking training data. Dropout training can avoid the overfitting phenomenon in deep neural network. During the testing stage, the outputs of all neurons in hidden layers are multiplied by a same factor as their actual outputs in the original Dropout method. It does not consider that the participation of a few poor-recognition models may reduce the recognition accuracy of its whole DBN model. This paper proposed an improved Dropout method, which can further increase the recognition accuracy of DBN by introducing probability statistics. The comparison of recognition results for MNIST handwritten digit database shows that the improved method can outperform the original and traditional identification methods under the same conditions.

Original languageEnglish
Title of host publicationProceedings of the 36th Chinese Control Conference, CCC 2017
EditorsTao Liu, Qianchuan Zhao
PublisherIEEE Computer Society
Pages11145-11149
Number of pages5
ISBN (Electronic)9789881563934
DOIs
Publication statusPublished - 7 Sept 2017
Event36th Chinese Control Conference, CCC 2017 - Dalian, China
Duration: 26 Jul 201728 Jul 2017

Publication series

NameChinese Control Conference, CCC
ISSN (Print)1934-1768
ISSN (Electronic)2161-2927

Conference

Conference36th Chinese Control Conference, CCC 2017
Country/TerritoryChina
CityDalian
Period26/07/1728/07/17

Keywords

  • Deep learning
  • deep belief network
  • dropout training
  • handwriting recognition

Fingerprint

Dive into the research topics of 'An improved dropout method and its application into DBN-based handwriting recognition'. Together they form a unique fingerprint.

Cite this