0845 838 7448 
Are All Your Webpages “Search Engine Spider-Friendly”?
Hyperlinks are essential for search engine spiders to be able to crawl your webpages. Without hyperlinks no one can visit your web pages unless they type in the exact URL of that page. Of course, I haven’t really seen anyone make the mistake (duh?) of not linking to the other pages within their website. However, even though you do have internal links there are times that due to the architecture or structure of the links/pages within your website the spiders are unable to crawl certain pages or at least specific parts of the pages containing important information (or even not too important ones). For your website to qualify as “spider-friendly” you need to make sure that all the data within your webpages can be reached by search engine spiders otherwise you will have lost an opportunity to add vital information in the search engines’ database that would help define what exactly can be found in your site. Remember the less info the search engines have the less chances you have of rating well.
Listed below are some “problematic” pages in terms of “spider-friendliness”.
- Pages that can be accessed only by using a select form and submit button
- Pages that can only be accessed through a drop down menu (HTML attribute)
- Documents that can only be accessed using a search box
- Documents that are blocked one purpose (via a robots meta tag or robots.txt file)
- Pages that require a login
- Pages that are re-direct before showing content - This is actually a black hat method called cloaking. Although are a few legitimate reasons for using this method your website will most probably be banned by search engines if caught doing this.
Resource: Seomoz Beginner’s Guide
Popularity: 17% [?]
Similar Posts:
[...] Are All Your Webpages “Search Engine Spider-Friendly”? [...]
[...] Text Optimization of Internal Links on Keywords in Key Placements (Header Tag, Content and Links)Are All Your Webpages “Search Engine Spider-Friendly”? - Part Two on Are All Your Webpages “Search …Gary on Most Overlooked Simple SEO Techniques to Solve On-Site Issues - Part 2Gary on Most [...]
[...] SEO Ranking Factors: Keywords | SEO Blog on Keywords in Key Placements (Title Tag and URL)Unfriendly Text Formats on Are All Your Webpages “Search Engine Spider-Friendly”?Anchor Text Optimization of Internal Links on Keywords in Key Placements (Header Tag, Content and [...]