Distributed xml twig query processing using mapreduce

Xin Bi; Guoren Wang; Xiangguo Zhao; Zhen Zhang; Shuang Chen

doi:10.1007/978-3-319-25255-1_17

Distributed xml twig query processing using mapreduce

Xin Bi
, Guoren Wang
, Xiangguo Zhao
, Zhen Zhang
, Shuang Chen

Northeastern University China

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

3 Citations (Scopus)

Abstract

Twig query processing is one of the core operations of XML queries. Centralized holistic twig algorithms suffer great efficiency losses when large-scale XML documents are partitioned and stored in the cloud. Previous work on distributed twig query processing have some limitations, e.g., utter dependence on priori knowledge of query patterns, iteration of MapReduce jobs, etc. In this paper, our arbitrary XML partitioning and storage strategy require no knowledge of query pattern; twig queries can be efficiently processed in a single-round MapReduce job with good scalability. Extensive experiments are conducted to verify the efficiency and scalability of our algorithms.

Original language	English
Title of host publication	Web Technologies and Applications - 17th Asia-PacificWeb Conference,APWeb 2015, Proceedings
Editors	Reynold Cheng, Bin Cui, Zhenjie Zhang, Ruichu Cai, Jia Xu
Publisher	Springer Verlag
Pages	203-214
Number of pages	12
ISBN (Print)	9783319252544
DOIs	https://doi.org/10.1007/978-3-319-25255-1_17
Publication status	Published - 2015
Externally published	Yes
Event	17th Asia-PacificWeb Conference, APWeb 2015 - Guangzhou, China Duration: 18 Sept 2015 → 20 Sept 2015

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	9313
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	17th Asia-PacificWeb Conference, APWeb 2015
Country/Territory	China
City	Guangzhou
Period	18/09/15 → 20/09/15

Access to Document

10.1007/978-3-319-25255-1_17

Cite this

Bi, X., Wang, G., Zhao, X., Zhang, Z., & Chen, S. (2015). Distributed xml twig query processing using mapreduce. In R. Cheng, B. Cui, Z. Zhang, R. Cai, & J. Xu (Eds.), Web Technologies and Applications - 17th Asia-PacificWeb Conference,APWeb 2015, Proceedings (pp. 203-214). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9313). Springer Verlag. https://doi.org/10.1007/978-3-319-25255-1_17

Bi, Xin ; Wang, Guoren ; Zhao, Xiangguo et al. / Distributed xml twig query processing using mapreduce. Web Technologies and Applications - 17th Asia-PacificWeb Conference,APWeb 2015, Proceedings. editor / Reynold Cheng ; Bin Cui ; Zhenjie Zhang ; Ruichu Cai ; Jia Xu. Springer Verlag, 2015. pp. 203-214 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{bdadb523b143436c8eb1422be5edb876,

title = "Distributed xml twig query processing using mapreduce",

abstract = "Twig query processing is one of the core operations of XML queries. Centralized holistic twig algorithms suffer great efficiency losses when large-scale XML documents are partitioned and stored in the cloud. Previous work on distributed twig query processing have some limitations, e.g., utter dependence on priori knowledge of query patterns, iteration of MapReduce jobs, etc. In this paper, our arbitrary XML partitioning and storage strategy require no knowledge of query pattern; twig queries can be efficiently processed in a single-round MapReduce job with good scalability. Extensive experiments are conducted to verify the efficiency and scalability of our algorithms.",

author = "Xin Bi and Guoren Wang and Xiangguo Zhao and Zhen Zhang and Shuang Chen",

note = "Publisher Copyright: {\textcopyright} Springer International Publishing Switzerland 2015.; 17th Asia-PacificWeb Conference, APWeb 2015 ; Conference date: 18-09-2015 Through 20-09-2015",

year = "2015",

doi = "10.1007/978-3-319-25255-1\_17",

language = "English",

isbn = "9783319252544",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "203--214",

editor = "Reynold Cheng and Bin Cui and Zhenjie Zhang and Ruichu Cai and Jia Xu",

booktitle = "Web Technologies and Applications - 17th Asia-PacificWeb Conference,APWeb 2015, Proceedings",

address = "Germany",

}

Bi, X, Wang, G, Zhao, X, Zhang, Z & Chen, S 2015, Distributed xml twig query processing using mapreduce. in R Cheng, B Cui, Z Zhang, R Cai & J Xu (eds), Web Technologies and Applications - 17th Asia-PacificWeb Conference,APWeb 2015, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 9313, Springer Verlag, pp. 203-214, 17th Asia-PacificWeb Conference, APWeb 2015, Guangzhou, China, 18/09/15. https://doi.org/10.1007/978-3-319-25255-1_17

Distributed xml twig query processing using mapreduce. / Bi, Xin; Wang, Guoren; Zhao, Xiangguo et al.
Web Technologies and Applications - 17th Asia-PacificWeb Conference,APWeb 2015, Proceedings. ed. / Reynold Cheng; Bin Cui; Zhenjie Zhang; Ruichu Cai; Jia Xu. Springer Verlag, 2015. p. 203-214 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9313).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Distributed xml twig query processing using mapreduce

AU - Bi, Xin

AU - Wang, Guoren

AU - Zhao, Xiangguo

AU - Zhang, Zhen

AU - Chen, Shuang

N1 - Publisher Copyright: © Springer International Publishing Switzerland 2015.

PY - 2015

Y1 - 2015

N2 - Twig query processing is one of the core operations of XML queries. Centralized holistic twig algorithms suffer great efficiency losses when large-scale XML documents are partitioned and stored in the cloud. Previous work on distributed twig query processing have some limitations, e.g., utter dependence on priori knowledge of query patterns, iteration of MapReduce jobs, etc. In this paper, our arbitrary XML partitioning and storage strategy require no knowledge of query pattern; twig queries can be efficiently processed in a single-round MapReduce job with good scalability. Extensive experiments are conducted to verify the efficiency and scalability of our algorithms.

AB - Twig query processing is one of the core operations of XML queries. Centralized holistic twig algorithms suffer great efficiency losses when large-scale XML documents are partitioned and stored in the cloud. Previous work on distributed twig query processing have some limitations, e.g., utter dependence on priori knowledge of query patterns, iteration of MapReduce jobs, etc. In this paper, our arbitrary XML partitioning and storage strategy require no knowledge of query pattern; twig queries can be efficiently processed in a single-round MapReduce job with good scalability. Extensive experiments are conducted to verify the efficiency and scalability of our algorithms.

UR - https://www.scopus.com/pages/publications/84950284934

U2 - 10.1007/978-3-319-25255-1_17

DO - 10.1007/978-3-319-25255-1_17

M3 - Conference contribution

AN - SCOPUS:84950284934

SN - 9783319252544

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 203

EP - 214

BT - Web Technologies and Applications - 17th Asia-PacificWeb Conference,APWeb 2015, Proceedings

A2 - Cheng, Reynold

A2 - Cui, Bin

A2 - Zhang, Zhenjie

A2 - Cai, Ruichu

A2 - Xu, Jia

PB - Springer Verlag

T2 - 17th Asia-PacificWeb Conference, APWeb 2015

Y2 - 18 September 2015 through 20 September 2015

ER -

Bi X, Wang G, Zhao X, Zhang Z, Chen S. Distributed xml twig query processing using mapreduce. In Cheng R, Cui B, Zhang Z, Cai R, Xu J, editors, Web Technologies and Applications - 17th Asia-PacificWeb Conference,APWeb 2015, Proceedings. Springer Verlag. 2015. p. 203-214. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-319-25255-1_17

Distributed xml twig query processing using mapreduce

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this