Modeling the Internet and the Web School of Information and Computer Science University of California, Irvine Advanced Crawling Techniques Chapter 6.
