Skip to Main content Skip to Navigation
New interface
Journal articles

Parallel Computational Steering for HPC Applications Using HDF5 Files in Distributed Shared Memory

Abstract : Interfacing a GUI driven visualization/analysis package to an HPC application enables a supercomputer to be used as an interactive instrument. We achieve this by replacing the IO layer in the HDF5 library with a custom driver which transfers data in parallel between simulation and analysis. Our implementation using ParaView as the interface, allows a flexible combination of parallel simulation, concurrent parallel analysis, and GUI client, either on the same or separate machines. Each MPI job may use different core counts or hardware configurations, allowing fine tuning of the amount of resources dedicated to each part of the workload. By making use of a distributed shared memory file, one may read data from the simulation, modify it using ParaView pipelines, write it back, to be reused by the simulation (or vice versa). This allows not only simple parameter changes, but complete remeshing of grids, or operations involving regeneration of field values over the entire domain. To avoid the problem of manually customizing the GUI for each application that is to be steered, we make use of XML templates that describe outputs from the simulation (and inputs back to it) to automatically generate GUI controls for manipulation of the simulation.
Complete list of metadata
Contributor : Aurélien Esnard Connect in order to contact the contributor
Submitted on : Tuesday, August 28, 2012 - 9:30:48 AM
Last modification on : Thursday, November 17, 2022 - 4:48:10 PM



John Biddiscombe, Jérome Soumagne, Guillaume Oger, David Guibert, Jean-Guillaume Piccinali. Parallel Computational Steering for HPC Applications Using HDF5 Files in Distributed Shared Memory. IEEE Transactions on Visualization and Computer Graphics, 2012, 18 (6), pp.852--864. ⟨10.1109/TVCG.2012.63⟩. ⟨hal-00725870⟩



Record views