Scheduling Data and Task on Data-Driven Master/Worker Platform - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2012

Scheduling Data and Task on Data-Driven Master/Worker Platform

Résumé

With data intensive applications it can be interesting to resort to a distributed storage to reach scalability and avoid data-intensive problems. Storing data permanently on computing nodes can be an interesting approach especially with the frequent use and the large volume of this data. Moreover, processing large data is a computing intensive task which encourages parallel execution. Nevertheless, data placement on computing nodes should be optimal to reach load balancing. In this work, we investigate scheduling heuristics towards the optimization of data distribution on the computing nodes. Motivated by its capacity to control perfectly the common operations associated with data management, we use BitDew: a desktop grid middleware designed for large scale data management. With BitDew, we build a Data-Driven Master/Worker Platform to carry out the distribution of Magick, the OCR application based on Dynamic Time Warping (DTW) algorithm. We evaluate the benefit of the implementation of studied scheduling heuristics to achieve load balancing with both homogeneous and heterogeneous environment. We present experimental results which demonstrate the efficiency of our approach.
Fichier non déposé

Dates et versions

hal-00757065 , version 1 (26-11-2012)

Identifiants

Citer

Mohamed Labidi, Bing Tang, Gilles Fedak, Maher Khemakem, Mohamed Jemni. Scheduling Data and Task on Data-Driven Master/Worker Platform. PDCAT 2012 - 13th International Conference on Parallel and Distributed Computing, Applications and Technologies, Dec 2012, Beijing, China. pp.593-598, ⟨10.1109/PDCAT.2012.122⟩. ⟨hal-00757065⟩
387 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More