Should use Robot file or Code for website ?

hoangvu

New member
Joined
Jun 6, 2012
Messages
1,878
Points
0
Hi everyone,

I have 2 ways to control Google robots crawl some web pages that I didn't want to cache

Method 1:
Disallow: / your page.php
Disallow: / folder name
....
in robots.txt file

Method 2:
<meta name="robots" content="noindex,nofollow" />

embed in meta tag of your website to avoid google cache your pages.

According to you, which way I should use and it's best effective and why ?
which case we should robots.txt for our website ?

any shares ?
 
Older threads
Replies
3
Views
4,552
Replies
5
Views
5,092
Replies
8
Views
4,701
Newer threads
Replies
9
Views
3,699
Replies
5
Views
2,083
Replies
11
Views
4,404
Latest threads
Replies
0
Views
16
Replies
1
Views
48
Replies
1
Views
38
Replies
1
Views
53
Replies
2
Views
47

Latest postsNew threads

Referral contests

Referral link for :

Sponsors

Latest Blog ArticlesMost Viewed Threads

Popular tags

You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an alternative browser.

Top