On Correlated Availability in Internet Distributed Systems

Abstract : As computer networks rapidly increase in size and speed, Internet-distributed systems such as P2P, volunteer computing, and Grid systems are increasingly common. A precise and accurate characterization of Internet resources is important for the design and evaluation of such Internet-distributed systems, yet our picture of the Internet landscape is not perfectly clear. To improve this picture, we measure and characterize the time dynamics of availability in a large-scale Internet-distributed system with over 110,000 hosts. Our characterization focuses on identifying patterns of correlated availability. We determine scalable and accurate clustering techniques and distance metrics for automatically detecting significant availability patterns. By means of clustering, we identify groups of resources with correlated availability that exhibit similar time effects. Then we show how these correlated clusters of resources can be used to improve resource management for parallel applications in the context of volunteer computing.
Complete list of metadatas

Cited literature [19 references]  Display  Hide  Download

https://hal.inria.fr/hal-00953614
Contributor : Arnaud Legrand <>
Submitted on : Monday, March 10, 2014 - 4:57:59 PM
Last modification on : Wednesday, August 7, 2019 - 12:19:23 PM
Long-term archiving on : Tuesday, June 10, 2014 - 10:37:20 AM

File

kondo_grid08.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00953614, version 1

Collections

INRIA | UGA | LIG

Citation

Derrick Kondo, Artur Andrzejak, David P. Anderson. On Correlated Availability in Internet Distributed Systems. IEEE/ACM International Conference on Grid Computing (Grid), 2008, Tsukuba, Japan. ⟨hal-00953614⟩

Share

Metrics

Record views

698

Files downloads

248