Skip to Main content Skip to Navigation
Preprints, Working Papers, ...

Hybrid Statistical Estimation of Mutual Information and its Application to Information Flow

Abstract : Analysis of a probabilistic system often requires to learn the joint probability distribution of its random variables. The computation of the exact distribution is usually an exhaustive precise analysis on all executions of the system. To avoid the high computational cost of such an exhaustive search, statistical analysis has been studied to efficiently obtain approximate estimates by analyzing only a small but representative subset of the system's behavior. In this paper we propose a hybrid statistical estimation method that combines precise and statistical analyses to estimate mutual information, Shannon entropy, and conditional entropy, together with their confidence intervals. We show how to combine the analyses on different components of the system with different accuracy to obtain an estimate for the whole system. The new method performs weighted statistical analysis with different sample sizes over different components and dynamically finds their optimal sample sizes. Moreover it can reduce sample sizes by using prior knowledge about systems and a new abstraction-then-sampling technique based on qualitative analysis. To apply the method to the source code of a system, we show how to decompose the code into components and to determine the analysis method for each component by overviewing the implementation of those techniques in HyLeak tool. We demonstrate with case studies that the new method outperforms the state of the art in quantifying information leakage.
Document type :
Preprints, Working Papers, ...
Complete list of metadata

Cited literature [67 references]  Display  Hide  Download
Contributor : Fabrizio Biondi Connect in order to contact the contributor
Submitted on : Wednesday, September 12, 2018 - 10:02:57 AM
Last modification on : Monday, April 4, 2022 - 9:28:21 AM
Long-term archiving on: : Thursday, December 13, 2018 - 12:33:40 PM


Files produced by the author(s)


  • HAL Id : hal-01629033, version 2


Fabrizio Biondi, yusuke Kawamoto, Axel Legay, Louis-Marie Traonouez. Hybrid Statistical Estimation of Mutual Information and its Application to Information Flow. 2018. ⟨hal-01629033v2⟩



Record views


Files downloads