A method of deduplication for data remote backup

Jingyu Liu; Yu An Tan; Yuanzhang Li; Xuelan Zhang; Zexiang Zhou

doi:10.1007/978-3-642-18333-1_10

A method of deduplication for data remote backup

Jingyu Liu^*, Yu An Tan, Yuanzhang Li, Xuelan Zhang, Zexiang Zhou

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

2 Citations (Scopus)

Abstract

The paper describes the Remote Data Disaster Recovery System using Hash to identify and avoid sending duplicate data blocks between the Primary Node and the Secondary Node, thereby, to reduce the data replication network bandwidth, decrease overhead and improve network efficiency. On both nodes, some extra storage spaces (the Hash Repositories) besides data disks are used to record the Hash for each data block on data disks. We extend the data replication protocol between the Primary Node and the Secondary Node. When the data, whose Hash exists in the Hash Repository, is duplication, the block address is transferred instead of the data, and that reduces network bandwidth requirement, saves synchronization time, and improves network efficiency.

Original language	English
Title of host publication	Computer and Computing Technologies in Agriculture IV - 4th IFIP TC 12 Conference, CCTA 2010, Selected Papers
Pages	68-75
Number of pages	8
Edition	PART 1
DOIs	https://doi.org/10.1007/978-3-642-18333-1_10
Publication status	Published - 2011
Event	4th IFIP International Conference on Computer and Computing Technologies in Agriculture and the 4th Symposium on Development of Rural Information, CCTA 2010 - Nanchang, China Duration: 22 Oct 2010 → 25 Oct 2010

Publication series

Name	IFIP Advances in Information and Communication Technology
Number	PART 1
Volume	344 AICT
ISSN (Print)	1868-4238

Conference

Conference	4th IFIP International Conference on Computer and Computing Technologies in Agriculture and the 4th Symposium on Development of Rural Information, CCTA 2010
Country/Territory	China
City	Nanchang
Period	22/10/10 → 25/10/10

Keywords

Deduplication
Disaster Recovery
Duplicate Data
Hash

Access to Document

10.1007/978-3-642-18333-1_10

Cite this

Liu, J., Tan, Y. A., Li, Y., Zhang, X., & Zhou, Z. (2011). A method of deduplication for data remote backup. In Computer and Computing Technologies in Agriculture IV - 4th IFIP TC 12 Conference, CCTA 2010, Selected Papers (PART 1 ed., pp. 68-75). (IFIP Advances in Information and Communication Technology; Vol. 344 AICT, No. PART 1). https://doi.org/10.1007/978-3-642-18333-1_10

@inproceedings{049ad237234444d59160973921610fdd,

title = "A method of deduplication for data remote backup",

abstract = "The paper describes the Remote Data Disaster Recovery System using Hash to identify and avoid sending duplicate data blocks between the Primary Node and the Secondary Node, thereby, to reduce the data replication network bandwidth, decrease overhead and improve network efficiency. On both nodes, some extra storage spaces (the Hash Repositories) besides data disks are used to record the Hash for each data block on data disks. We extend the data replication protocol between the Primary Node and the Secondary Node. When the data, whose Hash exists in the Hash Repository, is duplication, the block address is transferred instead of the data, and that reduces network bandwidth requirement, saves synchronization time, and improves network efficiency.",

keywords = "Deduplication, Disaster Recovery, Duplicate Data, Hash",

author = "Jingyu Liu and Tan, {Yu An} and Yuanzhang Li and Xuelan Zhang and Zexiang Zhou",

year = "2011",

doi = "10.1007/978-3-642-18333-1_10",

language = "English",

isbn = "9783642183324",

series = "IFIP Advances in Information and Communication Technology",

number = "PART 1",

pages = "68--75",

booktitle = "Computer and Computing Technologies in Agriculture IV - 4th IFIP TC 12 Conference, CCTA 2010, Selected Papers",

edition = "PART 1",

note = "4th IFIP International Conference on Computer and Computing Technologies in Agriculture and the 4th Symposium on Development of Rural Information, CCTA 2010 ; Conference date: 22-10-2010 Through 25-10-2010",

}

Liu, J, Tan, YA , Li, Y, Zhang, X & Zhou, Z 2011, A method of deduplication for data remote backup. in Computer and Computing Technologies in Agriculture IV - 4th IFIP TC 12 Conference, CCTA 2010, Selected Papers. PART 1 edn, IFIP Advances in Information and Communication Technology, no. PART 1, vol. 344 AICT, pp. 68-75, 4th IFIP International Conference on Computer and Computing Technologies in Agriculture and the 4th Symposium on Development of Rural Information, CCTA 2010, Nanchang, China, 22/10/10. https://doi.org/10.1007/978-3-642-18333-1_10

A method of deduplication for data remote backup. / Liu, Jingyu; Tan, Yu An ; Li, Yuanzhang et al.
Computer and Computing Technologies in Agriculture IV - 4th IFIP TC 12 Conference, CCTA 2010, Selected Papers. PART 1. ed. 2011. p. 68-75 (IFIP Advances in Information and Communication Technology; Vol. 344 AICT, No. PART 1).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - A method of deduplication for data remote backup

AU - Liu, Jingyu

AU - Tan, Yu An

AU - Li, Yuanzhang

AU - Zhang, Xuelan

AU - Zhou, Zexiang

PY - 2011

Y1 - 2011

N2 - The paper describes the Remote Data Disaster Recovery System using Hash to identify and avoid sending duplicate data blocks between the Primary Node and the Secondary Node, thereby, to reduce the data replication network bandwidth, decrease overhead and improve network efficiency. On both nodes, some extra storage spaces (the Hash Repositories) besides data disks are used to record the Hash for each data block on data disks. We extend the data replication protocol between the Primary Node and the Secondary Node. When the data, whose Hash exists in the Hash Repository, is duplication, the block address is transferred instead of the data, and that reduces network bandwidth requirement, saves synchronization time, and improves network efficiency.

AB - The paper describes the Remote Data Disaster Recovery System using Hash to identify and avoid sending duplicate data blocks between the Primary Node and the Secondary Node, thereby, to reduce the data replication network bandwidth, decrease overhead and improve network efficiency. On both nodes, some extra storage spaces (the Hash Repositories) besides data disks are used to record the Hash for each data block on data disks. We extend the data replication protocol between the Primary Node and the Secondary Node. When the data, whose Hash exists in the Hash Repository, is duplication, the block address is transferred instead of the data, and that reduces network bandwidth requirement, saves synchronization time, and improves network efficiency.

KW - Deduplication

KW - Disaster Recovery

KW - Duplicate Data

KW - Hash

UR - http://www.scopus.com/inward/record.url?scp=79951656503&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-18333-1_10

DO - 10.1007/978-3-642-18333-1_10

M3 - Conference contribution

AN - SCOPUS:79951656503

SN - 9783642183324

T3 - IFIP Advances in Information and Communication Technology

SP - 68

EP - 75

BT - Computer and Computing Technologies in Agriculture IV - 4th IFIP TC 12 Conference, CCTA 2010, Selected Papers

T2 - 4th IFIP International Conference on Computer and Computing Technologies in Agriculture and the 4th Symposium on Development of Rural Information, CCTA 2010

Y2 - 22 October 2010 through 25 October 2010

ER -

A method of deduplication for data remote backup

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this