Evaluating index systems of high energy physics

Shaopeng Dai*, Wanling Gao, Biwei Xie, Minghe Yu, Jia'nan Chen, Defei Kong, Rui Han, Jinheng Li

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Citation (Scopus)

Abstract

Nowadays, more and more scientific data has been produced through high-energy physics (HEP) facilities. Even in one particle physics experiment, the generated data reaches to petabytes scale. Retrieving data from massive data occupies a large proportion of data processing in HEP. Hence, the data query latency and throughput are the most important metrics for HEP data management. Inspired by the indexing technology of databases, the technology that improves the performance of data retrieval through the HEP data indexing, becomes the mainstream in the HEP data management. In this paper, focusing on two typical index systems–MySQL and HBase–for HEP data management, which are the typical SQL and NoSQL system respectively, we evaluate them from the perspectives of overall performance, system and micro-architecture behaviors. We find that HBase achieves higher performance than MySQL with the data scale increasing.

Original languageEnglish
Title of host publicationBig Scientific Data Benchmarks, Architecture, and Systems - 1st Workshop, SDBA 2018, Revised Selected Papers
EditorsRui Ren, Chen Zheng, Jianfeng Zhan
PublisherSpringer Verlag
Pages15-26
Number of pages12
ISBN (Print)9789811359095
DOIs
Publication statusPublished - 2019
Externally publishedYes
Event1st Workshop on Big Scientific Data Benchmarks, Architecture, and Systems, SDBA 2018 - Beijing, China
Duration: 12 Jun 201812 Jun 2018

Publication series

NameCommunications in Computer and Information Science
Volume911
ISSN (Print)1865-0929

Conference

Conference1st Workshop on Big Scientific Data Benchmarks, Architecture, and Systems, SDBA 2018
Country/TerritoryChina
CityBeijing
Period12/06/1812/06/18

Keywords

  • Data management
  • Event index
  • HBase
  • High-energy physics
  • MySQL

Fingerprint

Dive into the research topics of 'Evaluating index systems of high energy physics'. Together they form a unique fingerprint.

Cite this