Aggregation of Statistical Data from Passive Probes: Techniques and Best Practices

Abstract : Passive probes continuously generate statistics on large number of metrics, that are possibly represented as probability mass functions (pmf). The need for consolidation of several pmfs arises in two contexts, namely: (i) whenever a central point collects and aggregates measurement of multiple disjoint vantage points, and (ii) whenever a local measurement processed at a single vantage point needs to be distributed over multiple cores of the same physical probe, in order to cope with growing link capacity.In this work, we take an experimental approach and study both cases using, whenever possible, open source software and datasets. Considering different consolidation strategies, we assess their accuracy in estimating pmf deciles (from the 10th to the 90th) of diverse metrics, obtaining general design and tuning guidelines. In our dataset, we find that Monotonic Spline Interpolation over a larger set of percentiles (e.g., adding 5th, 10th, 15th, and so on) allow fairly accurate pmf consolidation in both the multiple vantage points (median error is about 1%, maximum 30%) and local processes (median 0.1%, maximum 1%) cases.
Complete list of metadatas

Cited literature [16 references]  Display  Hide  Download
Contributor : Hal Ifip <>
Submitted on : Monday, November 14, 2016 - 2:52:20 PM
Last modification on : Tuesday, November 15, 2016 - 12:58:16 PM
Long-term archiving on : Monday, March 27, 2017 - 9:19:33 AM


Files produced by the author(s)


Distributed under a Creative Commons Attribution 4.0 International License



Silvia Colabrese, Dario Rossi, Marco Mellia. Aggregation of Statistical Data from Passive Probes: Techniques and Best Practices. 6th International Workshop on Traffic Monitoring and Analysis (TMA), Apr 2014, London, United Kingdom. pp.38-50, ⟨10.1007/978-3-642-54999-1_4⟩. ⟨hal-01396470⟩



Record views


Files downloads