0845 838 7448 
Are All Your Web pages “Search Engine Spider-Friendly”? - Part Two
Jul 272007
Last time I mentioned some “problem pages” that search engines spiders won’t be able to view. The pages/documents listed in the previous post are impossible for search engine spiders to access so that it cannot get the information they contain.
Today I’ll be listing some other factors that makes web pages “spider-unfriendly”. Though these web pages are accessible to search engine spiders the way they are not that easy for spiders to “discover” so that more often that not they will be overlooked. Of course once overlooked it yields the same results as be entirely inaccessible - not being indexed and no additional info added to the search engines’ database about your site.
- URLs that make use of two or more dynamic parameters - Spiders avoid crawling web pages with such kinds of URLs since it often causes errors in programs.
- Pages that contains more than a hundred unique internal links - Though the spider will crawl this page you can almost be certain that it won’t be crawling all the other links. To make all the other pages discoverable it is better to make use of less than a hundred internal links.
- Pages that are more than three clicks/links away the home page of a website - While it is a good idea to keep the number of internal links per page to a certain level and just rely on the next pages to link to other more specialized pages make sure that no pages are too buried. Deep linking doesn’t work well in SEO since spiders tend to not visit pages that are too buried.
- Pages that require a “Session ID” or Cookie for navigation - The information stored in cookies are not always stored by spiders.
- Pages that are split into “frames” - Frames hamper the crawling process as well as result in confusion in the page rankings.
Resource: Seomoz Beginner’s Guide
Popularity: 7% [?]
Similar Posts:
No comments yet.