How to fix sitemap error?

[mitali]

Hey guys, I just submit my sitemap but it gives one error like this



so please help what we do next..

 

[Marc van Leeuwen]

It showed you the answer on your image

URL restricted by robots.txt

Check this file again and make sure that it allowed search engine spiders to crawl your sites.

 

[Intuz]

I am also looking for the answer of the same query. Though my robots.txt seems ok, no URLs are blocked by it.

Why I am getting this type of error in Webmaster?

 

[mitali]

No URLs are blocked by it. We set in robots.txt
User-agent: *
Disallow: /wp-admin/

SO NOW we need to set like
User-agent: *
Allow: /

 

[CyberAlchemist]

CyberAlchemist

What is your sitemap url? does it have errors?
Have you blocked your site by robots.txt before? and you're just opened robots for google spider crawls your site recently?

 

[mitali]

my site URL is abc.com/sitemap.xml and robots.txt file include:
User-agent: *
Disallow: /wp-admin/
when submitted it gives warning message like Sitemap contains URLs which are blocked by robots.txt. and issue cont 56

 

[CyberAlchemist]

CyberAlchemist

Your sitemap.xml is ok and but you missed a line in your robots.txt file.

it is

Allow: /

under User-agent: *

your robots.txt should be

User-agent: *
Allow: / 
Disallow: /wp-admin/

Try to submit your robots.txt in Google webmaster tool and waiting for a while. It needs to take a little time to take affect.

 

[Intuz]

Intuz

I have robots.txt with

User-agent: *
Allow: /

Why I am getting this error in my sitemap?

 

[mitali]

Ok i will try like this.. Thanks

 

[malikshahid3232]

-> Go to your Permalink Settings
-> Change any value hit "Save Changes"
-> Now try to add your sitemap on Google

 

[skullofskill]

Hey there mitali, did you add any references to your Sitemap on your Robots.txt?

----------
User-Agent: *
Allow: /
Disallow:/wp-admin/

Sitemap: http://abc.com/sitemap_index.xml
----------

Totally optional of course, but just throwing it out there, and I hope that helps a little.