A High-Performance Storage System Based with Dual RAID Engine

Jingyu Liu; Jinrong Zhang; Juan Li; Lu Liu

doi:10.1007/978-3-030-34139-8_6

A High-Performance Storage System Based with Dual RAID Engine

Jingyu Liu
, Jinrong Zhang
, Juan Li
, Lu Liu^*

^*Corresponding author for this work

School of Physics

Hebei University of Technology
Peng Cheng Laboratory

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

With the advent of the 5G, more and more applications use cloud storage to store data. Data becomes the cornerstone of the development of smart society. At the same time, these data have the characteristics of uneven generation rate, large write demand and low read requirement. The dynamic change of load during data storage has new requirements for storage architecture. This paper proposes a storage system that allocates strips in real time based on current load changes. Based on the traditional RAID layout, a dual-engine based high-performance storage system (DSH) is proposed. This system uses software and hardware co-processing architecture to implement strip allocation and address calculation. The strip allocation functions using software and the verification algorithm is implemented by hardware transfer to the FPGA through PCIE. Through experimental analysis shows that the DSH algorithm has a great advantage in saving CPU computing resources and saving disk energy consumption in the dynamic load storage environment.

Original language	English
Title of host publication	Smart Computing and Communication - 4th International Conference, SmartCom 2019, Proceedings
Editors	Meikang Qiu
Publisher	Springer
Pages	53-62
Number of pages	10
ISBN (Print)	9783030341381
DOIs	https://doi.org/10.1007/978-3-030-34139-8_6
Publication status	Published - 2019
Event	4th International Conference on Smart Computing and Communications, SmartCom 2019 - Birmingham, United Kingdom Duration: 11 Oct 2019 → 13 Oct 2019

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	11910 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	4th International Conference on Smart Computing and Communications, SmartCom 2019
Country/Territory	United Kingdom
City	Birmingham
Period	11/10/19 → 13/10/19

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

SDG 7 Affordable and Clean Energy

Keywords

Co-design
Disk array
Dynamic load
Energy-efficient storage

Access to Document

10.1007/978-3-030-34139-8_6

Cite this

Liu, J., Zhang, J., Li, J., & Liu, L. (2019). A High-Performance Storage System Based with Dual RAID Engine. In M. Qiu (Ed.), Smart Computing and Communication - 4th International Conference, SmartCom 2019, Proceedings (pp. 53-62). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11910 LNCS). Springer. https://doi.org/10.1007/978-3-030-34139-8_6

Liu, Jingyu ; Zhang, Jinrong ; Li, Juan et al. / A High-Performance Storage System Based with Dual RAID Engine. Smart Computing and Communication - 4th International Conference, SmartCom 2019, Proceedings. editor / Meikang Qiu. Springer, 2019. pp. 53-62 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{5df237e7340d46538b259f918d5ed3a9,

title = "A High-Performance Storage System Based with Dual RAID Engine",

abstract = "With the advent of the 5G, more and more applications use cloud storage to store data. Data becomes the cornerstone of the development of smart society. At the same time, these data have the characteristics of uneven generation rate, large write demand and low read requirement. The dynamic change of load during data storage has new requirements for storage architecture. This paper proposes a storage system that allocates strips in real time based on current load changes. Based on the traditional RAID layout, a dual-engine based high-performance storage system (DSH) is proposed. This system uses software and hardware co-processing architecture to implement strip allocation and address calculation. The strip allocation functions using software and the verification algorithm is implemented by hardware transfer to the FPGA through PCIE. Through experimental analysis shows that the DSH algorithm has a great advantage in saving CPU computing resources and saving disk energy consumption in the dynamic load storage environment.",

keywords = "Co-design, Disk array, Dynamic load, Energy-efficient storage",

author = "Jingyu Liu and Jinrong Zhang and Juan Li and Lu Liu",

note = "Publisher Copyright: {\textcopyright} 2019, Springer Nature Switzerland AG.; 4th International Conference on Smart Computing and Communications, SmartCom 2019 ; Conference date: 11-10-2019 Through 13-10-2019",

year = "2019",

doi = "10.1007/978-3-030-34139-8\_6",

language = "English",

isbn = "9783030341381",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer",

pages = "53--62",

editor = "Meikang Qiu",

booktitle = "Smart Computing and Communication - 4th International Conference, SmartCom 2019, Proceedings",

address = "Germany",

}

Liu, J, Zhang, J, Li, J & Liu, L 2019, A High-Performance Storage System Based with Dual RAID Engine. in M Qiu (ed.), Smart Computing and Communication - 4th International Conference, SmartCom 2019, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11910 LNCS, Springer, pp. 53-62, 4th International Conference on Smart Computing and Communications, SmartCom 2019, Birmingham, United Kingdom, 11/10/19. https://doi.org/10.1007/978-3-030-34139-8_6

A High-Performance Storage System Based with Dual RAID Engine. / Liu, Jingyu; Zhang, Jinrong; Li, Juan et al.
Smart Computing and Communication - 4th International Conference, SmartCom 2019, Proceedings. ed. / Meikang Qiu. Springer, 2019. p. 53-62 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11910 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - A High-Performance Storage System Based with Dual RAID Engine

AU - Liu, Jingyu

AU - Zhang, Jinrong

AU - Li, Juan

AU - Liu, Lu

PY - 2019

Y1 - 2019

N2 - With the advent of the 5G, more and more applications use cloud storage to store data. Data becomes the cornerstone of the development of smart society. At the same time, these data have the characteristics of uneven generation rate, large write demand and low read requirement. The dynamic change of load during data storage has new requirements for storage architecture. This paper proposes a storage system that allocates strips in real time based on current load changes. Based on the traditional RAID layout, a dual-engine based high-performance storage system (DSH) is proposed. This system uses software and hardware co-processing architecture to implement strip allocation and address calculation. The strip allocation functions using software and the verification algorithm is implemented by hardware transfer to the FPGA through PCIE. Through experimental analysis shows that the DSH algorithm has a great advantage in saving CPU computing resources and saving disk energy consumption in the dynamic load storage environment.

AB - With the advent of the 5G, more and more applications use cloud storage to store data. Data becomes the cornerstone of the development of smart society. At the same time, these data have the characteristics of uneven generation rate, large write demand and low read requirement. The dynamic change of load during data storage has new requirements for storage architecture. This paper proposes a storage system that allocates strips in real time based on current load changes. Based on the traditional RAID layout, a dual-engine based high-performance storage system (DSH) is proposed. This system uses software and hardware co-processing architecture to implement strip allocation and address calculation. The strip allocation functions using software and the verification algorithm is implemented by hardware transfer to the FPGA through PCIE. Through experimental analysis shows that the DSH algorithm has a great advantage in saving CPU computing resources and saving disk energy consumption in the dynamic load storage environment.

KW - Co-design

KW - Disk array

KW - Dynamic load

KW - Energy-efficient storage

UR - https://www.scopus.com/pages/publications/85076136805

U2 - 10.1007/978-3-030-34139-8_6

DO - 10.1007/978-3-030-34139-8_6

M3 - Conference contribution

AN - SCOPUS:85076136805

SN - 9783030341381

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 53

EP - 62

BT - Smart Computing and Communication - 4th International Conference, SmartCom 2019, Proceedings

A2 - Qiu, Meikang

PB - Springer

T2 - 4th International Conference on Smart Computing and Communications, SmartCom 2019

Y2 - 11 October 2019 through 13 October 2019

ER -

Liu J, Zhang J, Li J, Liu L. A High-Performance Storage System Based with Dual RAID Engine. In Qiu M, editor, Smart Computing and Communication - 4th International Conference, SmartCom 2019, Proceedings. Springer. 2019. p. 53-62. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-030-34139-8_6

A High-Performance Storage System Based with Dual RAID Engine

Abstract

Publication series

Conference

UN SDGs

Keywords

Access to Document

Other files and links

Fingerprint

Cite this