https://pinboard.in/u:rtlechow/public/ recent bookmarks from rtlechow 2016-09-02T17:33:58+00:00 https://www.gnu.org/software/parallel/man.html#example__breadth_first_parallel_web_crawler_mirrorer rtlechowgnu parallel wget crawler https://pinboard.in/ https://pinboard.in/u:rtlechow/b:0d82e32e21ee/ 2013-01-26T23:30:51+00:00 http://www.csstrashman.com/ rtlechowcss crawler optimization html https://pinboard.in/ https://pinboard.in/u:rtlechow/b:ceb4bff33dc3/ 2012-10-31T18:32:05+00:00 http://www.michaelnielsen.org/ddi/how-to-crawl-a-quarter-billion-webpages-in-40-hours/ rtlechowarchitecture crawler datamining web crawling https://pinboard.in/ https://pinboard.in/u:rtlechow/b:43a691c62342/ 2012-02-15T23:34:16+00:00 http://commoncrawl.org/ rtlechowcrawler opensource research web https://pinboard.in/ https://pinboard.in/u:rtlechow/b:d57e01932212/ 2011-01-05T05:02:29+00:00 http://blog.marc-seeger.de/2010/12/09/my-thesis-building-blocks-of-a-scalable-webcrawler rtlechowcrawler crawling ruby scalability web https://pinboard.in/ https://pinboard.in/u:rtlechow/b:811b1d4ced29/ 2009-02-04T16:38:31+00:00 http://www.dotnetdotcom.org/ rtlechowcrawler index dotbot crawl opendata spider graph web internet search statistics https://pinboard.in/u:rtlechow/b:1985d19b36f0/