How to use the meta robots tag

hoangvu

New member
Joined
Jun 6, 2012
Messages
1,835
Points
0
Hi there,

I disabled google and other search engines crawl and indexing my site by code in robots.txt

Code:
User-agent: *
Disallow: /
but in my html template I still put

Code:
<meta name="robots" content="index,follow" />
thus Google crawled and indexed my web pages.

just want to know How to use/control the meta robots tag for Google index or following my web pages?

Thanks in advanced!
 

Jack London

New member
Joined
Jul 9, 2012
Messages
386
Points
0
Hello,

If you disable spiders crawl your web pages then you can use this robot tag:

Code:
<meta name="robots" content="index, nofollow">
Google spider will not index page, only look at page.

Code:
<meta name="robots" content="noindex, follow">
Google spider will not index/crawl pages, not look at other pages from this page.

Code:
<meta name="robots" content="noindex, nofollow">
You can switch between index/noindex and follow/nofollow depends on your requirements on web pages to control spiders crawl/index or not.

Hope it's useful to you.
 
Newer threads
Replies
23
Views
10,082
Replies
0
Views
1,870
Replies
6
Views
3,629
Recommended threads
Replies
21
Views
6,149
Replies
1
Views
6,805
Sam

Referral contests

Referral link for :

Sponsors

Popular tags

You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an alternative browser.

Top