Too many search bots

[cnm]

We recently installed 2.3.1 and immediately our visitors at any given time shot up from 200-300 to 600-788, with as many as 1000. This slows us up and overwhelms our rather feeble dedicated server.

I notice hundreds of Guests have IP = 74.6.*.*
Looked it up in http://www.all-nettools.com/toolbox and found

lj611725.crawl.yahoo.net (74.6.70.37)

74.6.0.0 - 74.6.255.255

Inktomi Corporation

701 First Ave

Sunnyvale, CA

US

Netblock Admin

netblockadmin@yahoo-inc.com

+1-408-349-3300

Evidently the Yahoo crawler.

I sent them an email but doubt that will have any effect.

What I'd like is an option to restrict guests from a given IP range to 50 or so concurrent sessions.

[ColdinCbus]

We recently installed 2.3.1 and immediately our visitors at any given time shot up from 200-300 to 600-788, with as many as 1000. This slows us up and overwhelms our rather feeble dedicated server.

I notice hundreds of Guests have IP = 76.6.*.*

Looked it up in

http://www.all-nettools.com/toolbox

and found Evidently the Yahoo crawler.

I sent them an email but doubt that will have any effect.

What I'd like is an option to restrict guests from a given IP range to 50 or so concurrent sessions.

Hi cnm, nothing wrong with IP.Baord or your server just the new slurp crawler setup.
http://forums.invisionpower.com/index.php?...t&p=1494157

[cnm]

I never said there was anything wrong with the board, I said I'd like an option to limit their concurrent sessions.

Thanks for the link - (I had already read that topic). Posting this new one because I am making a suggestion/request.

[Luke]

If you haven't already you should install a php cache engine on your server. It helps out quite a bit.

I would recommend xcache, eAccelerator, or APC.

[cnm]

I added 74.6.*.* to the ban filter and to my surprise, it looks like that worked. Visitors dropped from 800 to 500.
See http://forums.invisionpower.com/index.php?...t&p=1497385