Free SEO Spider

F

Download our SEO site crawler for WindowsMac or Linux. (Last updated 26 Feb 2024)

Don’t forget you’ll need Java installed for Mac & Linux (Windows doesn’t need it).

  • Find errors easily – Taking the time to filter, sort and segment exported data from your site crawls is time consuming just to find out you’ve got x number of missing titles or x number of short descriptions. Our crawl tool has smart filters built in to display the most common SEO errors you want to find during your site audit.
  • Sort out duplicates site pages – A common problem uncovered in site audits is a problem with duplicate content. Quickly identify duplicate pages in our software. Our filter will flag the problem and by simply selecting the page with duplicates click on more details you can find out which pages are duplicates of which pages so you can fix the problem.
  • Crawl more with NO Limits – Crawl more than other crawlers for free with no forced limits on how much you can crawl (the only limit is your hardware).

Tour

Crawl Export Options & Error Filter

Export options and error filters

Filter details, individual page information and error filter details

Filter details & page details

Find out which page is a duplicate of what

duplicate of what