When Network Matters: Data Center Scheduling with Network Tasks

Abstract : We consider the placement of jobs inside a data center. Traditionally, this is done by a task orchestrator without taking into account network constraints. According to recent studies, network transfers represent up to 50% of the completion time of classical jobs. Thus, network resources must be considered when placing jobs in a data center. In this paper, we propose a new scheduling framework, introducing network tasks that need to be executed on network machines alongside traditional (CPU) tasks. The model takes into account the competition between communications for the network resources, which is not considered in the formerly proposed scheduling models with communication. Network transfers inside a data center can be easily modeled in our framework. As we show, classical algorithms do not efficiently handle a limited amount of network bandwidth. We thus propose new provably efficient algorithms with the goal of minimizing the makespan in this framework. We show their efficiency and the importance of taking into consideration network capacity through extensive simulations on workflows built from Google data center traces.
Type de document :
Communication dans un congrès
INFOCOM 2019 - IEEE International Conference on Computer Communications, Apr 2019, Paris, France
Liste complète des métadonnées

https://hal.inria.fr/hal-01989755
Contributeur : Frédéric Giroire <>
Soumis le : mardi 22 janvier 2019 - 15:23:49
Dernière modification le : jeudi 7 février 2019 - 15:41:59

Fichier

infocom2019_camera_ready.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01989755, version 1

Citation

Frédéric Giroire, Nicolas Huin, Andrea Tomassilli, Stéphane Pérennes. When Network Matters: Data Center Scheduling with Network Tasks. INFOCOM 2019 - IEEE International Conference on Computer Communications, Apr 2019, Paris, France. 〈hal-01989755〉

Partager

Métriques

Consultations de la notice

47

Téléchargements de fichiers

73