Big data compressed storage algorithm in rock burst experiment

Yu Zhang, Yan Ping Bai*, Zhao Yong Lv, Yongzhen Li, Zong Lei Mu

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

State Key Laboratory for GeoMechanics and Deep Underground Engineering (GDLab) has accumulated more than 500 TB data of rock burst experiment. But so far the amount of analyzed data is less than 5%. Data storage dilemma is restricting the study mechanism of rock burst. In this paper, we applied big data technology into analyze of rock burst, and makes deep analysis about characteristic of rock burst data. Basing on this, a big data based data storage systems (BDSS) for rock burst experiment was proposed. BDSS based on Hadoop for rock burst with online data loading and rapid retrieval of data. In Storage node machine cluster in BDSS, Big Data Compressed Storage Algorithm was proposed. The algorithm can provide average compressed ratio about 2.91%, which is as good as WinRAR. And at the same time, considered time for compress data, Big Data Compressed Storage Algorithm is much better than WinRAR. In one word, Experimental analysis shows that the algorithm have excellent performance in rock burst and solve the Data storage dilemma. Research work of this paper laid some foundation of rock burst.

Original languageEnglish
Pages (from-to)111-122
Number of pages12
JournalInternational Journal of Grid and Distributed Computing
Volume10
Issue number1
DOIs
Publication statusPublished - 2017
Externally publishedYes

Keywords

  • Big data
  • Compressed storage algorithm
  • Rock burst

Fingerprint

Dive into the research topics of 'Big data compressed storage algorithm in rock burst experiment'. Together they form a unique fingerprint.

Cite this