Should use Robot file or Code for website ?

hoangvu

New member
Joined
Jun 6, 2012
Messages
1,844
Points
0
Hi everyone,

I have 2 ways to control Google robots crawl some web pages that I didn't want to cache

Method 1:
Disallow: / your page.php
Disallow: / folder name
....
in robots.txt file

Method 2:
<meta name="robots" content="noindex,nofollow" />

embed in meta tag of your website to avoid google cache your pages.

According to you, which way I should use and it's best effective and why ?
which case we should robots.txt for our website ?

any shares ?
 
Older threads
Replies
3
Views
4,981
Replies
5
Views
5,527
Replies
8
Views
5,195
Newer threads
Replies
9
Views
4,283
Replies
5
Views
2,496
Replies
11
Views
4,916
Latest threads
Replies
1
Views
52
Replies
1
Views
203
Replies
0
Views
216
Replies
0
Views
243
Replies
5
Views
565
Recommended threads
Replies
5
Views
2,865
Replies
3
Views
3,269
Replies
11
Views
4,916
Replies
0
Views
1,921

Referral contests

Referral link for :

Sponsors

Popular tags

You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an alternative browser.

Top