What bots are really worth letting onto your site?

Shirley_Sharp

New member
Joined
Jan 10, 2013
Messages
228
Points
0
I have known about a number of bots such as Google, Bing, Yahoo, Alexa bots, and seen the massive amounts of random bots that happen to crawl a site, I could knot know all, what bots are really worth letting onto my site? How to detect and filter them?
My first thought is that allowing bots that will help my site increase crawl rates or SEO scores on search engines. Is there any reason to allow bots or stopping them from visiting a site?
 

Elegant_Designs

New member
Joined
Nov 13, 2016
Messages
31
Points
0
Bots from Google, Bing, Yahoo and from other reputable search engines or sites such as Alexa are okay

If unknown bots are wasting resources on your website by crawling your web pages over and over again within a short period of time, it is best to block them. Some bots appearing on your analytics are just there to entice you to visit their website and usually their bounce rates are pretty high which will affect your analytics data; you should filter them out from you Google Analytics to have a cleaner data.
 
Older threads
Replies
6
Views
3,739
Replies
18
Views
8,681
Replies
13
Views
9,414
Recommended threads
Replies
2
Views
5,608
Replies
3
Views
3,353
Similar threads

Referral contests

Referral link for :

Sponsors

Popular tags

You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an alternative browser.

Top