How to set up a robots.txt to control Google spider crawl my site?

[johnyplex]

Hi everyone,

I have just established a new site and I don't want google spider crawl some parts (folder, files) on my site
Are threre any ways to set up a robots.txt to control Google spider crawl my site?

for example:
I want google spider crawl all my site but not for /payment/ folder and /private_data/ folder
I don't want google spider crawl a image file like my_image_file.jpg
I don't want google spider crawl all file start with mydata

Any suggestions?

 

[Nytshade]

You can do that in the Google Webmaster Tools, if you're using wordpress there are free plugins you can use.

Hope this video will help:

 

[Hassan]

User-agent: *
Disallow: /payment/
Disallow: /private_data/
Disallow: /mydata

User-agent: Googlebot-Image
Disallow: /images/my_image_file.jpg