Scheduling Data and Task on Data-Driven Master/Worker Platform

Abstract : With data intensive applications it can be interesting to resort to a distributed storage to reach scalability and avoid data-intensive problems. Storing data permanently on computing nodes can be an interesting approach especially with the frequent use and the large volume of this data. Moreover, processing large data is a computing intensive task which encourages parallel execution. Nevertheless, data placement on computing nodes should be optimal to reach load balancing. In this work, we investigate scheduling heuristics towards the optimization of data distribution on the computing nodes. Motivated by its capacity to control perfectly the common operations associated with data management, we use BitDew: a desktop grid middleware designed for large scale data management. With BitDew, we build a Data-Driven Master/Worker Platform to carry out the distribution of Magick, the OCR application based on Dynamic Time Warping (DTW) algorithm. We evaluate the benefit of the implementation of studied scheduling heuristics to achieve load balancing with both homogeneous and heterogeneous environment. We present experimental results which demonstrate the efficiency of our approach.
Type de document :
Communication dans un congrès
PDCAT 2012 - 13th International Conference on Parallel and Distributed Computing, Applications and Technologies, Dec 2012, Beijing, China. IEEE, Parallel and Distributed Computing, Applications and Technologies (PDCAT), 2012 13th International Conference on, pp.593-598, 2012, 〈10.1109/PDCAT.2012.122〉
Liste complète des métadonnées

https://hal.inria.fr/hal-00757065
Contributeur : Gilles Fedak <>
Soumis le : lundi 26 novembre 2012 - 11:13:04
Dernière modification le : vendredi 20 avril 2018 - 15:44:26

Identifiants

Collections

Citation

Mohamed Labidi, Bing Tang, Gilles Fedak, Maher Khemakem, Mohamed Jemni. Scheduling Data and Task on Data-Driven Master/Worker Platform. PDCAT 2012 - 13th International Conference on Parallel and Distributed Computing, Applications and Technologies, Dec 2012, Beijing, China. IEEE, Parallel and Distributed Computing, Applications and Technologies (PDCAT), 2012 13th International Conference on, pp.593-598, 2012, 〈10.1109/PDCAT.2012.122〉. 〈hal-00757065〉

Partager

Métriques

Consultations de la notice

709