Testing for crawlability

[denverdonate]

For some reason Google's tools in Google Webmaster Tools aren't always able to run right then. Like if I am shown my robots.txt is blocking Google Bot and I fetch the URL, it schedules it, it's not always immediate. Do any of you use other tools for this that can test for crawlability with GoogleBot?

 

[JohnWeb]

Explain what you mean in more details. What do you mean "fetch the URL"? It schedules what?

 

[Priyanka V]

Are you talking about sitemap.xml file?

 

[jeffscott]

For some reason Google's tools in Google Webmaster Tools aren't always able to run right then. Like if I am shown my robots.txt is blocking Google Bot and I fetch the URL, it schedules it, it's not always immediate. Do any of you use other tools for this that can test for crawlability with GoogleBot?

Google search console will help you a lot in this kind of situation, because now they are continuously updating their functions, the URL Inspection feature will help you to test crawlability.

 

[emilyquirq]

emilyquirq

thanks a lot for explanation

 

[Marshbz]

Marshbz

Yes, Google search console really helps in URL inspection feature to test the crawlability

 

[JohnWeb]

Good luck improving your crawlability.