26.4.08

Search Engines Won’t Index Your Blog: Website Problems

There are a few reasons why a website may not be indexed. First, is broken links. Search engines may stop at a broken link and assume the site is down. They may remove a site that was previously indexed.

Some websites such as Google and HotBot will not index sites with no inbound links. One way to get indexed is to link to a website or blog on a page ‘other’ than the index page.

Flash intros, videos and images may result in the spiders skipping a website. The index page must link to the rest of the site, if not – as in the case of flash intros – there is no links to the index page from the inside pages. Result, search engines will not index the site.

Most search engines will not index a free site.

Linking to a banned or benched website may result in the search engines refusing to index a site.

Submitting the site monthly can result in the site being ‘pruned’ from the database, or just not indexed in the first place.

Dynamic URLs are often overlooked. Any domain name that contains symbols and ? and &, are often ignored.

Only text is indexed. If the page has no text, then there is no index. Search engines cannot enter passwords, fill in forms, sign up for RSS, or newsletters. If the website asks people to do any of these before continuing – the sub pages will not be indexed.

Search engines will not index large pages, or ones that load slow. No web page should be more than 50k

404 message. Web hosting companies are not 100%. If the site is down when the robot comes looking then they will ignore the website.

Scripts cannot be indexed. A scripted menu is harder to index than a static one written in HTML.

Sometimes frames and scripts can make a search engine think they are at the end of the site and leave.

Template may be so complex, with far too many tags. This can make it difficult to get indexed. The webmaster may need to change templates.

What Next?

If the site is still not indexed and has a blog in it, try to manually ping the blog to a service such as pingoat.com or some of the others.

1 comment:

Anonymous said...

For the longest time, Google would not index my web site. I was very frustrated because it seemed like everything that I did I couldn't get Google to do it. This is going to sound silly, but one day, I checked my settings on WordPress and my blog was set to "Private" and voila, the next week, it was indexed. Ok, I realize that there is only a small population that actually has that problem, but I thought I would share. :)