June 17, 2008 in Feedback
There will be a great focus on usability and streamlining functions. The introduction of a new template engine which allows for multiple default template sets, easier skin editing, and a brand new default skin is something we are very excited about. Search engine friendly URLs will not only make your community more interesting to search engine spiders but allow for more human-friendly linking."
Search engines spiders consume a great deal of bandwidth, which costs money. It was said that the version 3.0 will make the community more interesting to search engines spiders. Will there be any way of preventing the spiders of visiting your forum, kind of a configuration in the CP, without the need to install any kind of program or modification on the forum?
You can restrict spiders from your site through the use of a robots.txt file.
It's the problem. It's not so simple. As myself, many users do not have the slightest idea how to install those programs. To be honest, all of those codes on that site looks greek to me. Invision does not provide technical support for programs from other companies. We get hand tied. So considering they are making easier for the spiders, it should be offered a feature in the control pannel to prevent them from visiting our site.
robots.txt is not something made by 'other companies', it's not something you 'install' either. There are plenty of people who are knoeledgeable about how to use a robots.txt file, if you ask someone can tell you exactly what the file needs to contain. All you need to do then is upload that file to your site's root directory.
The robots.txt file is simply a .txt file (as the extension implies) that you upload to your site. Robots (well-programmed ones at least) look for it before indexing your site, and honor the commands in it.
If you put the following in a robots.txt file it will block all spiders from your site completely
Can I ask for tech help from Invision then? ^_^
Huh? No, we can't support a robots.txt file, nor can we control the search engine spiders that are out there. ;)
What you CAN do is force spiders to belong to a specific group and deny that group access to the board. This functionality is already built in.
I simply do not understand this stuff.
Post your exact needs in a new topic in the peer-to-peer support forums, someone can tell you there exactly what you need to do. :)
This topic is now archived and is closed to further replies.
Started November 25
Started November 13
Started August 15