Ranking issues? Just save the spiders some time!
Are you having problems getting good rankings in the search engines? If so, you might want to read the article about crawling and indexing over at Google's official blog.
In the article they state that "many questions about website architecture, crawling and indexing, and even ranking issues can be boiled down to one central issue: How easy is it for search engines to crawl your site?
I agree, but its a little simplistic. Of course ranking issues can be the result of a URL structure that cannot be handled by spiders. But a search engine (and user) friendly website is just the basis for a website that can have the possibility to gain rankings. Getting things right when it comes to consistent URL structures, duplicate content, loopholes, etc. you only brought the website in the position to get crawled and indexed. Step 2 is making sure your pages are setup (SEO-ed) for the correct keywords to get into contact with your target.
The interesting part in the article though, is the fact that Google has a finit number of resources. Hard to believe, isnt it? But with billions and billions of pages to be crawled and recrawled every now and then, it is very important to realize that your website might only get 0,001% of the available time a spider has to visit and crawl your website. This portion will increase when you update your content more frequently or write new content for your visitors. But most of you probably will have a static website. Nonetheless, it is very important to remember that Google, or any other search engine, will not have, and not take the time to crawle every single page on your website.
So, when it comes to SEO, always think of things like:
Of course getting good rankings depends on way more factors, but by saving time for the search engines spiders, you make sure they only visit the right pages, and are able to visit them all, instead of just a portion.
Tagcloudresearch baidu twitter google wave apple viral advertising smx social internet london search engines microsoft marketing app europe street view maps ads blogger google earth search funny news business iphone analytics china tools website search engine facebook mobile android russia event streetview browser spain yandex