Invision Community 4: SEO, prepare for v5 and dormant account notifications Matt November 11, 2024Nov 11
Posted June 20, 200717 yr When is IP.Board going to recognize Yahoo Slurp and MSNBot crawlers instead of just Googlebot, Archive.org, and AskJeeves??? Yahoo's crawler does wonders to one's Online List (i've just spotted 33 "guests" that were actually Yahoo Slurp crawlers [yahoo hasn't learned to keep all of it's crawler servers under 1 IP Address like Google has] ) :(
June 20, 200717 yr haha never noticed that. is this a new feature? SWEET!last time i asked this in the Support dept of IPS (a year or so ago) they said it was impossible to add crawlers to the crawler detecting list... :P
June 20, 200717 yr haha never noticed that. is this a new feature? SWEET!last time i asked this in the Support dept of IPS (a year or so ago) they said it was impossible to add crawlers to the crawler detecting list... :PIt has been there for quite some time now, definately in the 2.1.x releases, not sure about before.Maybe they should add a few more main ones by default. :PIs Google the only reliable search engine then IPS? :whistle:
June 20, 200717 yr To add practically every bot you can imagine... check out this topic.http://forums.invisionpower.com/index.php?showtopic=152815For the latest news...http://forums.invisionpower.com/index.php?...p;#entry1492000Which leads to: http://ipbots.info/
June 22, 200717 yr Out of 33 guests almost all are the same 2 IPs for mine and they all trace to RIPE network in the Netherlands. I wonder if that is a real spoider or this moron I know from the Netherlands who does DOS attacks on forums.
Archived
This topic is now archived and is closed to further replies.