Page 1 of 2 12 LastLast
Results 1 to 10 of 11

Thread: Baidu Spider

  1. #1
    Senior Member
    Points: 22,686, Level: 93
    Level completed: 34%, Points required for next Level: 664
    Overall activity: 51.0%
    Otintx's Avatar
    Join Date
    Oct 2011
    Location
    South of Texas
    Posts
    1,085
    Glock Armorer?
    No
    Glocks Owned
    Several
    Rep Power
    2

    Baidu Spider


    Does it not concern anyone in the "know" that this morning there are over 58 instances of the Baidu Spider crawling the pages of the site ?

    87 users - 6 members = 81 - 58 = > 23 real users as there are a few other "bots" checking the place out ....

    Don't know what the Baidu Spider is ?


    Headquarters

    Beijing, China


    Area served

    China
    Japan
    Thailand
    Egypt
    India


    Baiduspider






    Last edited by Otintx; 12-19-2011 at 08:32 AM.
    ... click Click BOOM ....

  2. #2
    Senior Member
    Points: 1,102, Level: 18
    Level completed: 2%, Points required for next Level: 98
    Overall activity: 0%
    Arc Angel's Avatar
    Join Date
    Mar 2011
    Posts
    125
    Glock Armorer?
    Uncertified
    Rep Power
    2
    OMG! I'm teaching Chinese Communists how to become better pistol shots! (That just seems so wrong!)
    'Max, I do this for a living!' - (Vincent In The Movie, 'Collateral')

  3. #3
    Senior Member
    Points: 22,686, Level: 93
    Level completed: 34%, Points required for next Level: 664
    Overall activity: 51.0%
    Otintx's Avatar
    Join Date
    Oct 2011
    Location
    South of Texas
    Posts
    1,085
    Glock Armorer?
    No
    Glocks Owned
    Several
    Rep Power
    2
    Glad to know that I am not the only one ....


    ... click Click BOOM ....

  4. #4
    Super Moderator
    Points: 16,933, Level: 83
    Level completed: 17%, Points required for next Level: 417
    Overall activity: 33.0%
    TheLaw's Avatar
    Join Date
    Aug 2010
    Location
    NE GA
    Posts
    4,426
    Glock Armorer?
    Will be soon!
    Glocks Owned
    17, 17OD, 17L, 19, 19c, G26, 34, 38, 23, 27
    Rep Power
    7
    Typically the majority of the users" are bots but I've never really spent that much time delving into what bots, etc.. I'm sure the Admins are on top of this.
    In honor of AW2 Jason Lawson (The Law). We'll never forget you.
    Always evolve never stop learning. (Stolen from KeithD)
    GLOCKS Owned - G17, G17OD, G17L, G19, G19c, G26, G34, G38, G23, G27

  5. #5
    Super Moderator
    Points: 16,011, Level: 81
    Level completed: 33%, Points required for next Level: 339
    Overall activity: 63.0%
    __jb's Avatar
    Join Date
    Jul 2010
    Location
    Sunshine State
    Posts
    4,283
    Glock Armorer?
    Yes
    Glocks Owned
    Help... My Glocks have started multiplying...
    Rep Power
    10
    We used to have issues with bots/spiders crawling all over the site... If you look at the "Most users ever online" stat you'll see that we had close to 1,000 users on at one time... It caused a few problems...

    Rob made some changes to limit the number of bots that could access the site at one time... Not sure if something changed... ???
    "While the anti-gunners seem very concerned about the "one life" that your firearm might take -- they are not very concerned about the lives it will save." Jon H. Gutmacher, Florida Firearms - Law, Use & Ownership.

  6. #6
    Senior Member
    Points: 3,358, Level: 36
    Level completed: 6%, Points required for next Level: 142
    Overall activity: 0%
    mvician's Avatar
    Join Date
    Mar 2010
    Location
    NW Indiana
    Posts
    373
    Glock Armorer?
    No
    Glocks Owned
    I own a 17, gen2 19, gen3 19, 20, 21, 21SF, 22, 22RTF2, 27, 29, 30, 36, LWD TimberWolf 17
    Rep Power
    3
    bots, spiders, crawlers, ect are how search engines work...
    without them cataloging the internet you wouldn't be able to find anything.

    the night there was 1000 users was probably one of the first few nights when the domain name changed to the .pro
    the spiders saw it as a new website and swarmed to catalog it.
    you deleted my avatar and sigline, put my forum name in the word filter, what next? delete my pics?

  7. #7
    Administrator
    Points: 12,366, Level: 72
    Level completed: 79%, Points required for next Level: 84
    Overall activity: 99.9%
    Rob's Avatar
    Join Date
    Mar 2010
    Location
    Eastern PA
    Posts
    1,108
    Glocks Owned
    G17, G19, G23, G27, G30 (3)
    Rep Power
    10
    There is a way to block certain bots - a lot of ppl hate the baidu one since they eat up a lot of resources.. but.. they are also the google of china - huge..

  8. #8
    Super Moderator
    Points: 16,011, Level: 81
    Level completed: 33%, Points required for next Level: 339
    Overall activity: 63.0%
    __jb's Avatar
    Join Date
    Jul 2010
    Location
    Sunshine State
    Posts
    4,283
    Glock Armorer?
    Yes
    Glocks Owned
    Help... My Glocks have started multiplying...
    Rep Power
    10
    Quote Originally Posted by mvician View Post
    bots, spiders, crawlers, ect are how search engines work...
    without them cataloging the internet you wouldn't be able to find anything.

    the night there was 1000 users was probably one of the first few nights when the domain name changed to the .pro
    the spiders saw it as a new website and swarmed to catalog it.
    Quote Originally Posted by Rob View Post
    There is a way to block certain bots - a lot of ppl hate the baidu one since they eat up a lot of resources.. but.. they are also the google of china - huge..
    There are certainly good bots and bad bots...

    I can't remember the exact issue we had back when 1,000 bots were crawling all over the site... I think it was when the site was on an older computer and it was causing the site to freeze up... I think the problem was resolved when Rob changed jobs and moved the site to one hosted at his new place of employment... Rob, do you remember anything about this?

    BTW... It's nice to see you posting again, Rob... We miss you!!!
    "While the anti-gunners seem very concerned about the "one life" that your firearm might take -- they are not very concerned about the lives it will save." Jon H. Gutmacher, Florida Firearms - Law, Use & Ownership.

  9. #9
    Senior Member
    Points: 6,334, Level: 51
    Level completed: 92%, Points required for next Level: 16
    Overall activity: 14.0%
    pistolcompetitor's Avatar
    Join Date
    Aug 2010
    Location
    Pacific NW
    Posts
    888
    Glock Armorer?
    Yes- Oct '11
    Glocks Owned
    G17 Gen4, G19 OD, G20 SF
    Rep Power
    2
    Quote Originally Posted by __jb View Post
    BTW... It's nice to see you posting again, Rob... We miss you!!!
    ^this

    +1

    Like

    "add to reputation"

    Roger that.
    ==
    If a man yells "you lie" in a room full of politicians, how do you know which person he's talking about?

  10. #10
    Senior Member
    Points: 8,519, Level: 62
    Level completed: 23%, Points required for next Level: 231
    Overall activity: 87.0%
    Tactworld45's Avatar
    Join Date
    Aug 2011
    Location
    Willow Springs, North Carolina, United States
    Posts
    1,507
    Glock Armorer?
    No
    Glocks Owned
    G21, G22, G19 gen 4, G30
    Rep Power
    2
    I agree bots can be good for site referrals as long as they don't chew up resources. I wouldn't be concerned if the site functions like it should. Not all are legite, but every site is going to see crawlers. Its normally not an issue if the hardware and software are up to date. My 2 cents.
    Don't retreat! Reload!!!

Page 1 of 2 12 LastLast

Sponsors

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  

Search tags for this page

baidu spider