carldagostino.wordpress.com
Notable Crawling Techniques by Carl D’Agostino
Visit the post for more.