An Application-Level Scheduling with Task Bundling Approach for Many-Task Computing in Heterogeneous Environments

Abstract : Many-Task Computing (MTC) is a widely used computing paradigm for large-scale task-parallel processing. One of the key issues in MTC is to schedule a large number of independent tasks onto heterogeneous resources. Traditional task-level scheduling heuristics, like Min-Min, Sufferage and MaxStd, cannot readily be applied in this scenario. As most of MTC tasks are usually fine-grained, the resource management overhead would be prominent and the multi-core nodes might become hard to be fully utilized. In this paper we propose an application-level scheduling with task bundling approach that utilizes the knowledge of both applications and tasks to overcome these difficulties. Furthermore we adapt the traditional task-level heuristics to our model for MTC scheduling. Experimental results show that these application-level scheduling approaches, when equipped with task bundling, can deliver good performance for Many-Task Computing in terms of both Makespan and Flowtime.
Document type :
Conference papers
Complete list of metadatas

Cited literature [13 references]  Display  Hide  Download

https://hal.inria.fr/hal-01551355
Contributor : Hal Ifip <>
Submitted on : Friday, June 30, 2017 - 10:36:05 AM
Last modification on : Friday, December 1, 2017 - 1:09:57 AM
Long-term archiving on : Monday, January 22, 2018 - 9:34:35 PM

File

978-3-642-35606-3_1_Chapter.pd...
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Citation

Jian Xiao, Yu Zhang, Shuwei Chen, Huashan Yu. An Application-Level Scheduling with Task Bundling Approach for Many-Task Computing in Heterogeneous Environments. 9th International Conference on Network and Parallel Computing (NPC), Sep 2012, Gwangju, South Korea. pp.1-13, ⟨10.1007/978-3-642-35606-3_1⟩. ⟨hal-01551355⟩

Share

Metrics

Record views

150

Files downloads

59