TINS: A Task-Based Dynamic Helper Core Strategy for In Situ Analytics

Estelle Dirand 1, 2 Laurent Colombet 2 Bruno Raffin 1, 2
1 DATAMOVE - Data Aware Large Scale Computing
Inria Grenoble - Rhône-Alpes, LIG - Laboratoire d'Informatique de Grenoble
Abstract : The in situ paradigm proposes to co-locate simulation and analytics on the same compute node to analyze data while still resident in the compute node memory, hence reducing the need for post-processing methods. A standard approach that proved efficient for sharing resources on each node consists in running the analytics processes on a set of dedicated cores, called helper cores, to isolate them from the simulation processes. Simulation and analytics thus run concurrently with limited interference. In this paper we show that the performance can be improved through a dynamic helper core strategy. We rely on a work stealing scheduler to implement TINS, a task-based in situ framework with an on-demand analytics isolation. The helper cores are dedicated to analytics only when analytics tasks are available. Otherwise the helper cores join the other cores for processing simulation tasks. TINS relies on the Intel R TBB library. Experiments on up to 14,336 cores run a set of representative analytics parallelized with TBB coupled with the hybrid MPI+TBB ExaStamp molecular dynamics code. TINS shows up to 40% performance improvement over various other approaches including the standard helper core.
Complete list of metadatas

Cited literature [24 references]  Display  Hide  Download

https://hal.inria.fr/hal-01730910
Contributor : Estelle Dirand <>
Submitted on : Tuesday, March 13, 2018 - 4:36:13 PM
Last modification on : Thursday, November 15, 2018 - 3:19:01 PM
Long-term archiving on : Thursday, June 14, 2018 - 4:23:12 PM

File

sca-final-version.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Estelle Dirand, Laurent Colombet, Bruno Raffin. TINS: A Task-Based Dynamic Helper Core Strategy for In Situ Analytics. SCA18 - Supercomputing Frontiers Asia 2018, Mar 2018, Singapore, Singapore. pp.159-178, ⟨10.1007/978-3-319-69953-0_10⟩. ⟨hal-01730910⟩

Share

Metrics

Record views

503

Files downloads

175