Energy aware data layout for de-duplication system

Achieving power efficiency is a very critical issue in today's data centers and other information processing and storage facilities. In this paper we focus on data layout strategies for conserving energy in de-duplication storage systems. We introduce a method to find the least-cost configuration that meets known targets for de-duplication performance (as well as fault-tolerance) while archiving energy efficiency. We have built the Power-Aware De-duplication System (PADS) to reduce energy use of conventional disk based de-duplication storage systems. PADS turns on just enough disk spindles by properly estimating average chunk size, that is, we can modulate the storage disk provision according to the load fluctuation. Simultaneously, by using S-RAID[10] based data layout, disk accesses are concentrated in a part of the disks in a long time which is conducive to scheduling other disks into standby or shutdown mode. Without specialized hardware, the system can still meet performance demands. Our proposed approach reduces energy consumption of de-duplication storage system, makes de-duplication to fully integrated with the underlying storage mechanism.