Energy aware data layout for de-duplication system

Fang Yan; Yuan Tan; Qinggang Liang; Ningning Xing; Yaolei Wang; Xiang Zhang

doi:10.1109/PDCAT.2012.72

Energy aware data layout for de-duplication system

Fang Yan
, Yuan Tan
, Qinggang Liang
, Ningning Xing
, Yaolei Wang
, Xiang Zhang

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

1 Citation (Scopus)

Abstract

Achieving power efficiency is a very critical issue in today's data centers and other information processing and storage facilities. In this paper we focus on data layout strategies for conserving energy in de-duplication storage systems. We introduce a method to find the least-cost configuration that meets known targets for de-duplication performance (as well as fault-tolerance) while archiving energy efficiency. We have built the Power-Aware De-duplication System (PADS) to reduce energy use of conventional disk based de-duplication storage systems. PADS turns on just enough disk spindles by properly estimating average chunk size, that is, we can modulate the storage disk provision according to the load fluctuation. Simultaneously, by using S-RAID[10] based data layout, disk accesses are concentrated in a part of the disks in a long time which is conducive to scheduling other disks into standby or shutdown mode. Without specialized hardware, the system can still meet performance demands. Our proposed approach reduces energy consumption of de-duplication storage system, makes de-duplication to fully integrated with the underlying storage mechanism.

Original language	English
Title of host publication	Proceedings - 13th International Conference on Parallel and Distributed Computing, Applications, and Technologies, PDCAT 2012
Pages	511-516
Number of pages	6
DOIs	https://doi.org/10.1109/PDCAT.2012.72
Publication status	Published - 2012
Event	13th International Conference on Parallel and Distributed Computing, Applications, and Technologies, PDCAT 2012 - Beijing, China Duration: 14 Dec 2012 → 16 Dec 2012

Publication series

Name	Parallel and Distributed Computing, Applications and Technologies, PDCAT Proceedings

Conference

Conference	13th International Conference on Parallel and Distributed Computing, Applications, and Technologies, PDCAT 2012
Country/Territory	China
City	Beijing
Period	14/12/12 → 16/12/12

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

SDG 7 Affordable and Clean Energy

Keywords

Energy Aware
data de-duplicaiton
data layout

Access to Document

10.1109/PDCAT.2012.72

Cite this

Yan, F., Tan, Y., Liang, Q., Xing, N., Wang, Y., & Zhang, X. (2012). Energy aware data layout for de-duplication system. In Proceedings - 13th International Conference on Parallel and Distributed Computing, Applications, and Technologies, PDCAT 2012 (pp. 511-516). Article 6589329 (Parallel and Distributed Computing, Applications and Technologies, PDCAT Proceedings). https://doi.org/10.1109/PDCAT.2012.72

@inproceedings{4470d877b0ef4ce487e07aa0985aa029,

title = "Energy aware data layout for de-duplication system",

abstract = "Achieving power efficiency is a very critical issue in today's data centers and other information processing and storage facilities. In this paper we focus on data layout strategies for conserving energy in de-duplication storage systems. We introduce a method to find the least-cost configuration that meets known targets for de-duplication performance (as well as fault-tolerance) while archiving energy efficiency. We have built the Power-Aware De-duplication System (PADS) to reduce energy use of conventional disk based de-duplication storage systems. PADS turns on just enough disk spindles by properly estimating average chunk size, that is, we can modulate the storage disk provision according to the load fluctuation. Simultaneously, by using S-RAID[10] based data layout, disk accesses are concentrated in a part of the disks in a long time which is conducive to scheduling other disks into standby or shutdown mode. Without specialized hardware, the system can still meet performance demands. Our proposed approach reduces energy consumption of de-duplication storage system, makes de-duplication to fully integrated with the underlying storage mechanism.",

keywords = "Energy Aware, data de-duplicaiton, data layout",

author = "Fang Yan and Yuan Tan and Qinggang Liang and Ningning Xing and Yaolei Wang and Xiang Zhang",

year = "2012",

doi = "10.1109/PDCAT.2012.72",

language = "English",

isbn = "9780769548791",

series = "Parallel and Distributed Computing, Applications and Technologies, PDCAT Proceedings",

pages = "511--516",

booktitle = "Proceedings - 13th International Conference on Parallel and Distributed Computing, Applications, and Technologies, PDCAT 2012",

note = "13th International Conference on Parallel and Distributed Computing, Applications, and Technologies, PDCAT 2012 ; Conference date: 14-12-2012 Through 16-12-2012",

}

Yan, F, Tan, Y, Liang, Q, Xing, N, Wang, Y & Zhang, X 2012, Energy aware data layout for de-duplication system. in Proceedings - 13th International Conference on Parallel and Distributed Computing, Applications, and Technologies, PDCAT 2012., 6589329, Parallel and Distributed Computing, Applications and Technologies, PDCAT Proceedings, pp. 511-516, 13th International Conference on Parallel and Distributed Computing, Applications, and Technologies, PDCAT 2012, Beijing, China, 14/12/12. https://doi.org/10.1109/PDCAT.2012.72

Energy aware data layout for de-duplication system. / Yan, Fang; Tan, Yuan; Liang, Qinggang et al.
Proceedings - 13th International Conference on Parallel and Distributed Computing, Applications, and Technologies, PDCAT 2012. 2012. p. 511-516 6589329 (Parallel and Distributed Computing, Applications and Technologies, PDCAT Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Energy aware data layout for de-duplication system

AU - Yan, Fang

AU - Tan, Yuan

AU - Liang, Qinggang

AU - Xing, Ningning

AU - Wang, Yaolei

AU - Zhang, Xiang

PY - 2012

Y1 - 2012

N2 - Achieving power efficiency is a very critical issue in today's data centers and other information processing and storage facilities. In this paper we focus on data layout strategies for conserving energy in de-duplication storage systems. We introduce a method to find the least-cost configuration that meets known targets for de-duplication performance (as well as fault-tolerance) while archiving energy efficiency. We have built the Power-Aware De-duplication System (PADS) to reduce energy use of conventional disk based de-duplication storage systems. PADS turns on just enough disk spindles by properly estimating average chunk size, that is, we can modulate the storage disk provision according to the load fluctuation. Simultaneously, by using S-RAID[10] based data layout, disk accesses are concentrated in a part of the disks in a long time which is conducive to scheduling other disks into standby or shutdown mode. Without specialized hardware, the system can still meet performance demands. Our proposed approach reduces energy consumption of de-duplication storage system, makes de-duplication to fully integrated with the underlying storage mechanism.

AB - Achieving power efficiency is a very critical issue in today's data centers and other information processing and storage facilities. In this paper we focus on data layout strategies for conserving energy in de-duplication storage systems. We introduce a method to find the least-cost configuration that meets known targets for de-duplication performance (as well as fault-tolerance) while archiving energy efficiency. We have built the Power-Aware De-duplication System (PADS) to reduce energy use of conventional disk based de-duplication storage systems. PADS turns on just enough disk spindles by properly estimating average chunk size, that is, we can modulate the storage disk provision according to the load fluctuation. Simultaneously, by using S-RAID[10] based data layout, disk accesses are concentrated in a part of the disks in a long time which is conducive to scheduling other disks into standby or shutdown mode. Without specialized hardware, the system can still meet performance demands. Our proposed approach reduces energy consumption of de-duplication storage system, makes de-duplication to fully integrated with the underlying storage mechanism.

KW - Energy Aware

KW - data de-duplicaiton

KW - data layout

UR - https://www.scopus.com/pages/publications/84884656727

U2 - 10.1109/PDCAT.2012.72

DO - 10.1109/PDCAT.2012.72

M3 - Conference contribution

AN - SCOPUS:84884656727

SN - 9780769548791

T3 - Parallel and Distributed Computing, Applications and Technologies, PDCAT Proceedings

SP - 511

EP - 516

BT - Proceedings - 13th International Conference on Parallel and Distributed Computing, Applications, and Technologies, PDCAT 2012

T2 - 13th International Conference on Parallel and Distributed Computing, Applications, and Technologies, PDCAT 2012

Y2 - 14 December 2012 through 16 December 2012

ER -

Yan F, Tan Y, Liang Q, Xing N, Wang Y, Zhang X. Energy aware data layout for de-duplication system. In Proceedings - 13th International Conference on Parallel and Distributed Computing, Applications, and Technologies, PDCAT 2012. 2012. p. 511-516. 6589329. (Parallel and Distributed Computing, Applications and Technologies, PDCAT Proceedings). doi: 10.1109/PDCAT.2012.72

Energy aware data layout for de-duplication system

Abstract

Publication series

Conference

UN SDGs

Keywords

Access to Document

Other files and links

Fingerprint

Cite this