I. Foster, Internet Computing and the Emerging Grid, Nature, 2000.

D. Werthimer, J. Cobb, M. Lebofsky, D. Anderson, and E. Korpela, SETI@HOME--- Massively Distributed Computing for SETI, Comput. Sci. Eng, vol.3, pp.78-83, 2001.

X. Xu, W. Z. Zhang, H. L. Zhang, B. X. Fang, and X. R. Liu, A Forwarding-Based Task Scheduling Algorithm for Distributed Web Crawling over DHTs, 2009 15th International Conference on Parallel and Distributed Systems, pp.854-859, 2009.
DOI : 10.1109/ICPADS.2009.29

A. Heydon and M. Najork, Mercator: A Scalable, Extensible Web Crawler, World Wide Web, vol.2, issue.4, pp.219-229, 1999.
DOI : 10.1023/A:1019213109274

P. Boldi, B. Codenotti, M. Santini, and S. Vigna, UbiCrawler: a scalable fully distributed Web crawler, Software: Practice and Experience, vol.34, issue.8, pp.711-726, 2004.
DOI : 10.1002/spe.587
URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.14.4239

B. T. Loo, O. Cooper, and S. Krishnamurthy, Distributed Web Crawling over DHTs, 2004.

A. Singh, M. Srivatsa, L. Liu, and T. Miller, Apoidea: A Decentralized Peer-to-Peer Architecture for Crawling the World Wide Web, the SIGIR Workshop on Distributed Information Retrieval, pp.126-142, 2004.
DOI : 10.1007/978-3-540-24610-7_10

H. T. Lee, D. Leonard, X. Wang, and D. Loguinov, IRLbot: Scaling to 6 Billion Pages and Beyond, the 17th International Conference on World Wide Web, pp.427-436, 2008.

J. Cho and H. Garcia-molina, The Evolution of the Web and Implications for an Incremental Crawler, the 26th International Conference on Very Large Data Bases (VLDB'00), pp.200-209, 2000.

E. Adar, J. Teevan, S. T. Dumais, and J. L. Elsas, The web changes everything, Proceedings of the Second ACM International Conference on Web Search and Data Mining, WSDM '09, pp.282-291, 2009.
DOI : 10.1145/1498759.1498837

J. Edwards, K. Mccurley, and J. Tomlin, An adaptive model for optimizing performance of an incremental web crawler, Proceedings of the tenth international conference on World Wide Web , WWW '01, pp.106-113, 2001.
DOI : 10.1145/371920.371960

J. Cho and H. G. Molina, Effective page refresh policies for Web crawlers, ACM Transactions on Database Systems, vol.28, issue.4, pp.390-426, 2003.
DOI : 10.1145/958942.958945
URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.3.7723

S. Pandey and C. Olston, User-centric Web crawling, Proceedings of the 14th international conference on World Wide Web , WWW '05, pp.401-411, 2005.
DOI : 10.1145/1060745.1060805
URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.161.3444

C. Olston and S. Pandey, Recrawl scheduling based on information longevity, Proceeding of the 17th international conference on World Wide Web , WWW '08, pp.437-446, 2008.
DOI : 10.1145/1367497.1367557
URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.119.7490

S. Brin and L. Page, The anatomy of a large-scale hypertextual Web search engine, Computer Networks and ISDN Systems, vol.30, issue.1-7, pp.107-117, 1998.
DOI : 10.1016/S0169-7552(98)00110-X

F. Dabek, R. Cox, F. Kaashoek, and R. Morris, Vivaldi: A Decentralized Network Coordinate System, SIGCOMM'04, pp.15-26, 2004.