I was crawling a rival website the other day… Oh, you didn’t know you could crawl someone else’s website? Well, you can, and it’s one of the best ways you can gain a competitive advantage. Competitive crawling may sound like a silly contest of babies racing each other across the floor, but it’s actually an SEO strategy to ensure that you’re staying ahead of websites that you’re competing with...
How and Why To Configure The Crawl Rate for Spiders and Bots
[box type=’info’]Chris Bawden is a SEO celebrity in the making you can find him at: CRBawden.com check it out for more great posts. Chris had some problems recently while boldly crawling where nobody crawled before. He shares his experiences below:[/box] Web crawlers are one of the most important tools an SEO has in his or her tool bag. Crawlers are also some of the most powerful...
Understanding SEO Crawls: What’s a Parameter?
[box type=’info’]As the Technical Coordinator of the Search Marketing and Advertising team at TechSmith Corporation(if you’ve ever watched a screencast you’ve seen their software in action), a software company in Okemos, Michigan, Chris Bawden is responsible for Analytics and the technical aspects of SEO. In doing so, he spiders the website daily, so we asked him for a...