| HAL-Inria | Publications, software ... of Inria's scientists |
LiveRank: How to Refresh Old Crawls
Abstract : This paper considers the problem of refreshing a crawl. More precisely, given a collection of Web pages (with hyperlinks) gathered at some time, we want to identify a significant fraction of these pages that still exist at present time. The liveness of an old page can be tested through an online query at present time. We call LiveRank a ranking of the old pages so that active nodes are more likely to appear first. The quality of a LiveRank is measured by the number of queries necessary to identify a given fraction of the alive pages when using the LiveRank order. We study different scenarios from a static setting where the LiveRank is computed before any query is made, to dynamic settings where the LiveRank can be updated as queries are processed. Our results show that building on the PageRank can lead to efficient LiveRanks for Web graphs.
Cited literature [14 references]
https://hal.inria.fr/hal-01093188
Contributor : Laurent Viennot <>
Submitted on : Wednesday, December 10, 2014 - 12:08:39 PM
Last modification on : Friday, March 27, 2020 - 3:11:48 AM
Document(s) archivé(s) le : Saturday, April 15, 2017 - 6:36:18 AM
Contributor : Laurent Viennot <>
Submitted on : Wednesday, December 10, 2014 - 12:08:39 PM
Last modification on : Friday, March 27, 2020 - 3:11:48 AM
Document(s) archivé(s) le : Saturday, April 15, 2017 - 6:36:18 AM
File
liverank2014waw.pdf
Files produced by the author(s)