Cottage Crawl

Common Crawl for Small Web.

Aims to crawl & archive every personal blog/website on the planet, in one place.

Local Setup

CottageCrawl generates a csv file.

cottagecrawl slashindex