Google Bot optimization?

[paulgl]

How to optimize a webpage for Google Bot or making it easy for G Bot to crawl and index your site?

I would like to know more about this, all your inputs are welcome.

 

[Knightrider]

Google Bot have very less time for your website , Maximize that time by placing important contents at the beginning of your web page, if you place at the bottom, it wont have enough time to go through full page, which can lead to not having your important content getting indexed.

 

[SEOPub]

There is not much you have to do really. Just make sure your site is not a piece of crap and that you do not have orphaned webpages. Avoid using Flash on your site.

What Knightrider said is mostly BS. Google does crawl entire pages. It may not do so on every visit, but it doesn't just stop after crawling half the page and never come back.

 

[markdenz]

markdenz

what is wrong with flash does it contribute negatively on seo??

 

[SEOPub]

SEOPub

Google sucks ass at reading Flash. Until recently, Google did not read it at all.

Go look at the text version of a page using Flash in Google's cache. You will likely just see a blank space.

 

[elcidofaguy]

elcidofaguy

LOL Totally Agree! This weekend I've been helping a buddy of mine who's site got hacked... and it happened sometime ago and only got noticed recently by the webhost whom took down the site... It was weird in that the hacker injected code on the footer of every page with obfuscated javascript... No one it seems could figure out what the this weird code was all about...

Cut the long story short... Its fixed now and having looked into it - I checked how Google cached the webpages e.g. text version, source code etc... What I realized was that even Google couldn't read it correctly in that it seemingly ignored it... But behind the scenes using tools such as firebug I figured out that it was some form of iframe embed with some form of redirection built into it.... I won't go into the details, suffice to say it was interesting to look at the actual infected files on the hosting account and how it rendered versus how it was cached - with that said there certainly is a dark part of the web that's pulling the wool over G's eyes...

 

[Ben Hartsuff]

If you are using wordpress get the google xml sitemap plugin. This plugin automatically does this for you

 

[adi123]

There is nothing to do something special for spiders to fetch your webpage.Just optimize your webpage according to SEO guidelines and produce some fresh content to be served.Google crawlers visit your domain as and when they would find fresh content and if all was well according to search engine rules your webpage would be sent to search engine to get indexed.

 

[Shutout]

I believe you can tell google to crawl if you use Google Webmaster Tools...

 

[arulkaruppannan]

Googlebot will index easily when a website has
no flash and javascript navigation - (If so bot cannot access)
proper sitemap
no copy content
good loading time
blocked access unwanted pages on robots.txt
Properly optimized images

 

[KVChosting]

KVChosting

Good list indeed. You are right here.