A hierarchical work-stealing framework for multi-core clusters

Yizhuo Wang, Weixing Ji, Qi Zuo, Feng Shi

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Citations (Scopus)

Abstract

Work-stealing has been widely used in task-based parallel programing for dynamic load balancing. The overhead of work-stealing on distributed memory systems is much higher than that on shared memory systems. To minimize the overhead of work-stealing on a multi-core cluster, we propose a hierarchical work-stealing framework, in which work-stealing is performed inside a node before across the node boundary. Two key techniques used in our framework to reduce the inter-node steals are: a) adaptive initial partitioning for different task parallel patterns, b) centralized control for inter-node work-stealing, which improves the efficiency of victim selection and termination detection. We compare our technique to the classical work-stealing scheme and a state-of-the-art work-stealing scheme for multi-core clusters. Our technique outperforms them by 19% and 8% respectively.

Original languageEnglish
Title of host publicationProceedings - 13th International Conference on Parallel and Distributed Computing, Applications, and Technologies, PDCAT 2012
Pages350-355
Number of pages6
DOIs
Publication statusPublished - 2012
Event13th International Conference on Parallel and Distributed Computing, Applications, and Technologies, PDCAT 2012 - Beijing, China
Duration: 14 Dec 201216 Dec 2012

Publication series

NameParallel and Distributed Computing, Applications and Technologies, PDCAT Proceedings

Conference

Conference13th International Conference on Parallel and Distributed Computing, Applications, and Technologies, PDCAT 2012
Country/TerritoryChina
CityBeijing
Period14/12/1216/12/12

Keywords

  • multi-core cluster
  • task scheduling
  • work-stealing

Fingerprint

Dive into the research topics of 'A hierarchical work-stealing framework for multi-core clusters'. Together they form a unique fingerprint.

Cite this