Skip to Main content Skip to Navigation
New interface
Conference papers

TINS: A Task-Based Dynamic Helper Core Strategy for In Situ Analytics

Estelle Dirand 1, 2 Laurent Colombet 2 Bruno Raffin 1, 2 
1 DATAMOVE - Data Aware Large Scale Computing
Inria Grenoble - Rhône-Alpes, LIG - Laboratoire d'Informatique de Grenoble
Abstract : The in situ paradigm proposes to co-locate simulation and analytics on the same compute node to analyze data while still resident in the compute node memory, hence reducing the need for post-processing methods. A standard approach that proved efficient for sharing resources on each node consists in running the analytics processes on a set of dedicated cores, called helper cores, to isolate them from the simulation processes. Simulation and analytics thus run concurrently with limited interference. In this paper we show that the performance can be improved through a dynamic helper core strategy. We rely on a work stealing scheduler to implement TINS, a task-based in situ framework with an on-demand analytics isolation. The helper cores are dedicated to analytics only when analytics tasks are available. Otherwise the helper cores join the other cores for processing simulation tasks. TINS relies on the Intel R TBB library. Experiments on up to 14,336 cores run a set of representative analytics parallelized with TBB coupled with the hybrid MPI+TBB ExaStamp molecular dynamics code. TINS shows up to 40% performance improvement over various other approaches including the standard helper core.
Complete list of metadata

Cited literature [24 references]  Display  Hide  Download
Contributor : Estelle Dirand Connect in order to contact the contributor
Submitted on : Tuesday, March 13, 2018 - 4:36:13 PM
Last modification on : Wednesday, July 6, 2022 - 4:23:03 AM
Long-term archiving on: : Thursday, June 14, 2018 - 4:23:12 PM


Files produced by the author(s)



Estelle Dirand, Laurent Colombet, Bruno Raffin. TINS: A Task-Based Dynamic Helper Core Strategy for In Situ Analytics. SCA18 - Supercomputing Frontiers Asia 2018, Mar 2018, Singapore, Singapore. pp.159-178, ⟨10.1007/978-3-319-69953-0_10⟩. ⟨hal-01730910⟩



Record views


Files downloads