CategorySEO Crawler

Learn more about our SEO Crawler with these related blog posts.

Beam Us Up Crawler Bug Update

We’ve updated the BUU crawler as it seems the latest version of Java broke it! It has now been updated for Windows/Linux the Mac version should be ready next week but if you are using Mac then you can actually download the Linux version and run that just look up (how to run JAR program on mac) and you should be able to do it if you dont know how.

Updated SEO Crawler: Version #355

We haven’t released a new version of our SEO site crawler in months because we’ve been hard at work on our next big project. However, today is the day for us to release a new version of our crawl tool, we hope you enjoy the updates! Be sure to let us know of other crawl features, options and bugs! Changes: Brand New Look – No more ugly interface! Memory Optimization – We...

How to Research Your Competition with a SEO Crawler

I was crawling a rival website the other day… Oh, you didn’t know you could crawl someone else’s website?  Well, you can, and it’s one of the best ways you can gain a competitive advantage.  Competitive crawling may sound like a silly contest of babies racing each other across the floor, but it’s actually an SEO strategy to ensure that you’re staying ahead of websites that you’re competing with...

APRIL FOOLS – Updated SEO Crawler: Version #401 (NEW Physical API)

*PLEASE NOTE THIS WAS AN APRIL FOOLS JOKE* We’ve updated our crawler yet again! This time with our new PHYSICAL API! Here is Chris Bawden explaining what it is and how to use it.   Download [one_third] Download Windows XP, 7, 8 [/one_third] [one_third] Download Mac OSX [/one_third] [one_third_last] Download Linux [/one_third_last] Don’t forget you’ll need Java installed on...

Updated SEO Crawler: Version #309 (No more limits)

Update: We’ve been hard at work and have a newer version of our crawler, don’t worry though we’ve updated all the download links across the site so you won’t get an old version. This is a big release for us and for you! As crawler limits have been lifted. Changes: Removed Crawler Limits – Previously you were limited to crawling 1,250 pages now there are absolutely no...