Skip to Main content Skip to Navigation
Conference papers

Reducing the Human-in-the-Loop Component of the Scheduling of Large HTC Workloads

Abstract : A common characteristic to major physics experiments is an ever increasing need of computing resources to process experimental data and generate simulated data. The IN2P3 Computing Center provides its 2,500 users with about 35,000 cores and processes millions of jobs every month. This workload is composed of a vast majority of sequential jobs that corresponds to Monte-Carlo simulations and related analysis made on data produced on the Large Hadron Collider at CERN. To schedule such a workload under specic constraints, the CC-IN2P3 relied for 20 years on an in-house job and resource management system complemented by an operation team who can directly act on the decisions made by the job scheduler and modify them. This system has been replaced in 2011 but legacy rules of thumb remained. Combined to other rules motivated by production constraints, they may act against the job scheduler optimizations and force the operators to apply more corrective actions than they should. In this experience report from a production system, we describe the decisions made since the end of 2016 to either transfer some of the actions done by operators to the job scheduler or make these actions become unnecessary. The physical partitioning of resources in distinct pools has been replaced by a logical partionning that leverages scheduling queues. Then some historical constraints, such as quotas, have been relaxed. For instance, the number of concurrent jobs from a given user group allowed to access a specic resource, e.g., a storage subsystem, has been progressively increased. Finally, the computation of the fair-share by the job scheduler has been modied to be less detrimental to small groups whose jobs have a low priority. The preliminary but promising results coming from these modications constitute the beginning of a long-term activity to change the operation procedures applied to the computing infrastructure of the IN2P3 Computing Center.
Complete list of metadata

Cited literature [14 references]  Display  Hide  Download

https://hal.inria.fr/hal-01954025
Contributor : Frederic Suter <>
Submitted on : Thursday, December 13, 2018 - 2:00:03 PM
Last modification on : Friday, June 18, 2021 - 8:58:30 AM
Long-term archiving on: : Thursday, March 14, 2019 - 2:42:33 PM

File

jsspp_article.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01954025, version 1

Collections

Citation

Frédéric Azevedo, Luc Gombert, Frédéric Suter. Reducing the Human-in-the-Loop Component of the Scheduling of Large HTC Workloads. 22nd Workshop on Job Scheduling Strategies for Parallel Processing (JSSPP 2018), May 2018, Vancouver, Canada. pp.39-60. ⟨hal-01954025⟩

Share

Metrics

Record views

122

Files downloads

224