Webmaster Sun Login
Not a member yet? Sign up

Why Bing why?

  • HOME
  • REGISTER HERE - Join us for FREE
Results 1 to 5 of 5

Thread: Why Bing why?

    Stick this thread
  1. #1
    Join Date
    Mar 2016
    2029 Larimer, Denver, Colorado 80205
    Thumbs Up/Down
    Received: 14/0
    Given: 27/0
    Thanked 4 Times in 4 Posts

    Why Bing why?

    My web-host told me to keep track of bots that keep using up my resources....and it seems Bing constantly has an army of bots constantly crawling my website!! Google crawls my websites less often and gives better results. 30 Bing bots vs 1 Google bot....
    Name:  bingbots.jpg
Views: 162
Size:  252.7 KB

  2. The Following User Says Thank You to denvercardonations For This Useful Post:
    phuoc_phuoc5 (06-09-2017)

  3. #2
    Join Date
    Jan 2015
    Blog Entries
    Thumbs Up/Down
    Received: 163/0
    Given: 106/0
    Thanked 884 Times in 562 Posts
    I'm somewhat surprised at that and my initial reaction is that a bot is attempting to masquerade as a bing bot given it is pretty easy to do so with declared user agent type. I would investigate this further with looking into your server logs with getting the IP data. You can check if it is a fake bing bot with use of bings own checker tool here.

  4. The Following 2 Users Say Thank You to elcidofaguy For This Useful Post:
    Nytshade (04-04-2016),phuoc_phuoc5 (06-09-2017)

  5. #3
    Join Date
    Nov 2015
    Thumbs Up/Down
    Received: 366/0
    Given: 556/0
    Thanked 274 Times in 199 Posts
    This definitely doesn't sound like it's a true bingbot, not at that crawl rate ratio.

    I'd definitely do as elcidofaguy stated and check to make sure it's a true bot from Bing.

    I was getting something similar about a year or so ago and it turned out to come from some Russian source.
    ►► Follow me on TWITTER and keep up with my random and informative Tweets!_

    ►► Check out my personal blog site HERE for my attempts at writing!

  6. The Following User Says Thank You to ulterios For This Useful Post:
    phuoc_phuoc5 (06-09-2017)

  7. #4
    Join Date
    Dec 2015
    W/ Sussex UK
    Thumbs Up/Down
    Received: 285/3
    Given: 87/8
    Thanked 135 Times in 97 Posts
    Do you use any kind of bot control method via htaccess file method or some other method or limit crawler traffic using robots.txt or anything?

    You can either use .htaccess or robots.txt to block them or tell them some other message like do one ya nosey git.

    The question you have to ask yourself is, should you?

    And what are the pros and cons to blocking crawler bots from accessing, crawling and indexing your site?

    Can it effect your SERP ranking by blocking bots and can it have an adverse or positive effect on your site?

    My answer to the first question is one that's based on experience of managing large sites and that is an explicit yes, you should.

    Other than the genuine crawlers you want on your site, all these others do is use up server resources and bloat your Analytics with duff data logs.

    So naturally some kind of control is needed. And for that you can use htacess file which can be a VERY POWERFUL beast of a file.

    Now obviously you don't want to block every single crawler bot from visiting your site including Google. For obvious reasons.

    If Google can't access and crawl your site, it can't index your content and thus you can't rank for content that can't be accessed.

    Thusly your rankings would be effected if Google can't even access/crawl and index your site to show to searchers.

    It's the same for Bing or any other search engine crawler bot too.

    However one can certainly apply some limitation and can indeed block certain bots from accessing/crawling your site and for good reason too.

    Especially if that bot is a bot that is for a search engine or country that your website is not even served to.

    And let's face it, there are only 2 or 3 search engines you want to be indexed in Google, Bing/Yahoo.

    Unless you're a Russian site then you might want to be indexed by Yandex too.

    Or perhaps its not even a search engine bot and is up to something much more sinister like looking for vulnerabilities or places to spam or just sites to rip.

    And in these cases where you suddenly see lots of bot activity its not too hard to find out what they are or where they're from.

    Check your Apache logfiles for starters as that will show everything you need to know including the bots string in which to use to block it with in htaccess or robots file.

    By the way, if you're looking for "A Close to perfect .htaccess file" then there's a useful block you can enter here which blocks most known bots and rippers I like to use when this starts happening sometimes.

    But don't think just putting them in the htaccess file is all you need to do. Well it is but sometimes you only need to block them for a few weeks or something and eventually they stop trying and go somewhere else haha

    You can then remove them from it or keep them in up to you but its good to have a slimline htaccess file.

    Good luck!

  8. #5
    Join Date
    Jul 2016
    Thumbs Up/Down
    Received: 7/0
    Given: 7/0
    Thanked 2 Times in 2 Posts
    Quote Originally Posted by denvercardonations View Post
    My web-host told me to keep track of bots that keep using up my resources....and it seems Bing constantly has an army of bots constantly crawling my website!! Google crawls my websites less often and gives better results. 30 Bing bots vs 1 Google bot....
    This is strange and totally different of Bing Crawler nature, this is definitely by some fake crawler designed same like Bing.
    Cross check in bing Webmasters tools. Hope you'll find some way.

Newer Threads

  1. Omer Farooq
    Omer Farooq
    Replies: 0 | Views: 737
    Last post by Omer Farooq, 04-05-2016, 10:03 AM
  2. Hawker
    Replies: 0 | Views: 1089
    Last post by Hawker, 04-05-2016, 01:44 PM
  3. Joe B. Ray
    Replies: 1 | Views: 786
    Last post by masonbrownp, 09-15-2017, 08:44 PM
  4. Hawker
    Replies: 2 | Views: 1530
    Last post by yellowmed, 06-03-2016, 08:38 AM
  5. OWF
    Replies: 10 | Views: 6552
    Last post by sumit_sharma, 05-30-2016, 11:28 AM

Older Threads

  1. Omer Farooq
    Facebook group posting?
    By Omer Farooq in forum Facebook
    Replies: 8 | Views: 1488
    Last post by Hawker, 04-08-2016, 01:14 PM
  2. Nytshade
    Replies: 8 | Views: 1049
    Last post by SEOPub, 04-04-2016, 01:34 PM
  3. dedica_manager
    Design UI \ UX
    By dedica_manager in forum Graphic Design
    Adam Yunker
    Replies: 4 | Views: 1459
    Last post by Adam Yunker, 04-15-2016, 05:02 PM
  4. Omer Farooq
    Addon domain cpanel login
    By Omer Farooq in forum Web Hosting
    Replies: 4 | Views: 902
    Last post by ElixantTechnology, 04-06-2016, 12:13 AM
  5. CyberAlchemist
    CMS vs custom platform?
    By CyberAlchemist in forum Content Management
    Ron Killian
    Replies: 7 | Views: 1545
    Last post by Ron Killian, 05-21-2016, 09:17 AM

Latest Threads

  1. UnrivaledReview
    Hoping I Can Help
    By UnrivaledReview in forum New Member Introductions
    Replies: 0 | Views: 6
    Last post by UnrivaledReview, Today, 10:37 AM
  2. Diana Bitter
    Diana Bitter
    Replies: 0 | Views: 65
    Last post by Diana Bitter, Today, 10:00 AM
  3. Hostigger
    Replies: 2 | Views: 56
    Last post by Hostigger, Today, 07:01 AM
  4. eeecentric
    Rob Whisonant
    Replies: 1 | Views: 50
    Last post by Rob Whisonant, Today, 06:06 AM

Similar Threads

  1. Shole
    Replies: 9 | Views: 2749
    Last post by markbatham, 01-30-2017, 01:17 PM
  2. Logan
    Ads in Bing
    By Logan in forum Bing
    Replies: 1 | Views: 968
    Last post by seoking, 10-28-2015, 01:20 PM
  3. Maxwell
    Replies: 16 | Views: 6473
    Last post by talukdar, 06-07-2015, 11:05 AM
  4. LazyRiches
    Does Bing still like EMD's ?
    By LazyRiches in forum Bing
    Replies: 3 | Views: 2205
    Last post by ericplotz1, 10-20-2014, 04:26 AM
  5. Jonny
    How to make SEO for Bing ?
    By Jonny in forum Bing
    Replies: 3 | Views: 2918
    Last post by zebrathemes, 03-29-2013, 01:08 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Internet Marketing Forum

Webmaster Sun is a forum where you’ll find in-depth discussions and resources to help you succeed on the web whether you are new or experienced. You’ll find it all here. With topics ranging from internet marketing, search engine optimization, social networking, make money online, web hosting, affiliate marketing as well as hands-on technical support for web design, programming and more. We are a growing community of like-minded people that is keen to help and support each other with ambitions and online endeavors. Learn and grow, make friends and contacts for life.

Come Hang Out With Us

    Facebook Twitter Webmaster Forum Google+

    Webmaster Sun Logo
Copyright ©2012 - 2017, WebmasterSun.com. All rights reserved. Internet marketing forum for internet marketers, webmasters, web hosting providers, designers and affiliate marketers.

Welcome to Webmaster Sun

The World's Number 1 Webmaster Community, SEO and Marketplace

Log in!

Continue with Facebook
Continue With Email. By signing up you indicate that you have read and agree to the Terms of Service and Privacy Policy.

Sign in Manually

Need an account? Sign up now!