fernis Posted October 7, 2005 Share Posted October 7, 2005 "msnbot=MSN Bot" should be included in the default list of spiders. Link to comment Share on other sites More sharing options...
Katsuma Posted May 11, 2007 Share Posted May 11, 2007 Thanks! ^_^ I will add it right now. Are there anymore that I can add? Link to comment Share on other sites More sharing options...
Andrew S. Posted May 11, 2007 Share Posted May 11, 2007 There's a whole list of search engine spiders that you can find here. :) Link to comment Share on other sites More sharing options...
WoLeRiNe` Posted May 11, 2007 Share Posted May 11, 2007 There's a whole list of search engine spiders that you can find here. :) The topic has created on Nov 4 2004, 10:47 PM.In this 2,5years, the news spiders wasn't born :D ? Link to comment Share on other sites More sharing options...
Andrew S. Posted May 11, 2007 Share Posted May 11, 2007 No, the spiders are updated, thats when the topic was officially created though is back in 2004, but Dan updated it recently. Link to comment Share on other sites More sharing options...
WoLeRiNe` Posted May 11, 2007 Share Posted May 11, 2007 update date is February 2006and new bots not updated yetas;ypn-rss.overture.com=Yahoo Publisher NetworkYahooYSMcm/1.0.0=Yahoo Publisher NetworkYahoo-MMCrawler/3.x=Yahoo Publisher NetworkYahooYSMcm/2.0.0=Yahoo Publisher NetworkandeBot=elchron.czIntelix=Microton.cz Link to comment Share on other sites More sharing options...
Axel Wers Posted May 17, 2007 Share Posted May 17, 2007 eBot=elchron.czIntelix=Microton.czYes, they are visiting my forum sometimes :D Link to comment Share on other sites More sharing options...
WoLeRiNe` Posted May 17, 2007 Share Posted May 17, 2007 ypn-rss.overture.com=Yahoo Publisher NetworkYahooYSMcm/1.0.0=Yahoo Publisher NetworkYahoo-MMCrawler/3.x=Yahoo Publisher NetworkYahooYSMcm/2.0.0=Yahoo Publisher NetworkThese bots also haven't in the files :) Link to comment Share on other sites More sharing options...
bfarber Posted May 17, 2007 Share Posted May 17, 2007 You only need to putyahoo=Yahoo Publisher NetworkThere's no need to list every individual user agent - the code above would match all instances of "Yahoo" and list it as "Yahoo Publisher Network" Link to comment Share on other sites More sharing options...
WoLeRiNe` Posted May 17, 2007 Share Posted May 17, 2007 There aren't an official site for a list of bots actual :unsure: ? Link to comment Share on other sites More sharing options...
Katsuma Posted May 17, 2007 Share Posted May 17, 2007 There aren't an official site for a list of bots actual :unsure: ?I hope not. :) I got the idea a few days ago and I don't want to have any competition. :P I just need to get some more scratch for another IPB License. ;) Link to comment Share on other sites More sharing options...
Jason H Posted May 20, 2007 Share Posted May 20, 2007 Please be careful with the bot list.. If you add ALL the bots in the online lists, you run the risk of causing problems with your forum. There's a KB article about it, but you'll get an error in class_sessions.php on some screens if the bot list is too big. I believe the limit is about 64k.Best to pick the ones you know and add them.. If you add everything, you're heading for trouble. Link to comment Share on other sites More sharing options...
WoLeRiNe` Posted May 20, 2007 Share Posted May 20, 2007 Thanks for this info Mr. Jason H Link to comment Share on other sites More sharing options...
cooldude7273 Posted May 23, 2007 Share Posted May 23, 2007 You only need to putyahoo=Yahoo Publisher NetworkThere's no need to list every individual user agent - the code above would match all instances of "Yahoo" and list it as "Yahoo Publisher Network"so yahoo=YahooWhatever would work for yahoodkjdkejdkhbot1, yahoo---d jdj454 bot2, and such like that?That'd make my day so much easier when I revamp my list! :) Link to comment Share on other sites More sharing options...
WoLeRiNe` Posted May 23, 2007 Share Posted May 23, 2007 so yahoo=YahooWhatever would work for yahoodkjdkejdkhbot1, yahoo---d jdj454 bot2, and such like that?That'd make my day so much easier when I revamp my list! :)Euh, yes i have tested andYahooYSMcm/1.0.0=Yahoo Publisher NetworkYahoo-MMCrawler/3.x=Yahoo Publisher NetworkYahooYSMcm/2.0.0=Yahoo Publisher Networkfor these bot, you can just added "yahoo=Yahoo Publisher Network". You can seen 3bots in 1 :)Thanks bfarber Link to comment Share on other sites More sharing options...
bfarber Posted May 23, 2007 Share Posted May 23, 2007 It's no problem - it's a common misunderstanding I see.IPB tries to match what is on the left to the user agent - if it matches, it displays what is on the right, and stops parsing right then.If 3 entries are put in, and all 3 have the same text on the right side of the equal sign, they will be grouped in the spider logs anyways, so you have no benefit to 3 entries that are meant to display the same. Link to comment Share on other sites More sharing options...
Recommended Posts
Archived
This topic is now archived and is closed to further replies.