Mapping DAG-based applications to multiclusters with background workload

Ligang He*, Stephen A. Jarvis, Daniel P. Spooner, David Bacigalupo, Guang Tan, Graham R. Nudd

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

25 Citations (Scopus)

Abstract

Before an application modelled as a Directed Acyclic Graph (DAG) is executed on a heterogeneous system, a DAG mapping policy is often enacted. After mapping, the tasks (in the DAG-based application) to be executed at each computational resource are determined. The tasks are then sent to the corresponding resources, where they are orchestrated in the pre-designed pattern to complete the work. Most DAG mapping policies in the literature assume that each computational resource is a processing node of a single processor, i.e. the tasks mapped to a resource are to be run in sequence. Our studies demonstrate that if the resource is actually a cluster with multiple processing nodes, this assumption will cause a misperception in the tasks' execution time and execution order. This will disturb the pre-designed cooperation among tasks so that the expected performance cannot be achieved. In this paper, a DAG mapping algorithm is presented for multicluster architectures. Each constituent cluster in the multicluster is shared by background workload (from other users) and has its own independent local scheduler. The multicluster DAG mapping policy is based on theoretical analysis and its performance is evaluated through extensive experimental studies. The results show that compared with conventional DAG mapping policies, the new scheme that we present can significantly improve the scheduling performance of a DAG-based application in terms of the schedule length.

Original languageEnglish
Title of host publication2005 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2005
Pages855-862
Number of pages8
DOIs
Publication statusPublished - 2005
Event2005 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2005 - Cardiff, Wales, United Kingdom
Duration: 9 May 200512 May 2005

Publication series

Name2005 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2005
Volume2

Conference

Conference2005 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2005
Country/TerritoryUnited Kingdom
CityCardiff, Wales
Period9/05/0512/05/05

ASJC Scopus subject areas

  • Engineering(all)

Fingerprint

Dive into the research topics of 'Mapping DAG-based applications to multiclusters with background workload'. Together they form a unique fingerprint.

Cite this