Jump to content

Sitemap


Guest foppolo

Recommended Posts

  • 1 month later...
  • 1 month later...

I'd would like to see support for creating Google Sitemap XML files in the next release of Invision Power Board. Especially ones that automatically gzip. It shouldn't be too hard to implement at a basic level, but no doubt you could go to town with identifying priorities for URLs, excludable URLs, etc ( see The SOFTplus GSiteCrawler at http://johannesmueller.com/gs/ )

BTW there is a mod for phpBB forum at http://codewalkers.com/seecode/559.html

I fully support the efforts of people to create mods but this sort of thing is simple enough to be included in a full release of IPB without creating bloat.

What do you reckon Matt? It's got to be worth investigating if Goooogle have done it, right?

Link to comment
Share on other sites

Maybe it's just me but when it asks which skin to force search spiders to use in the Admin CP I'd like to be able to choose to lo-fi version... I can't see why it's not an option. ;)



Yes, and ive sometimes come accross Google results that are the lo-fi version. So it scans that too in addition to the normal board. :thumbsup:
Link to comment
Share on other sites

You could determine what the search engine is allowed to see by using a robots.txt file

I don't mind whether Google sees normal topics or lo-fi but I have the following exclusions to cut down on wasted traffic. You could add to it with suitable entries to remove either regular topics or lo-fi as you see fit. I think you'll get the idea. Experiment and check your Bot Log in the Admin Control Panel.

(n.b. change the path as required by your installation)

User-agent: *
Disallow:
Disallow: /images/
Disallow: /cgi-bin/
Disallow: /forum/index.php?act=Search
Disallow: /forum/index.php?act=search
Disallow: /forum/index.php?act=Login
Disallow: /forum/index.php?act=Reg
Disallow: /forum/index.php?act=calendar
Disallow: /forum/index.php?act=Msg
Disallow: /forum/index.php?act=Mail
Disallow: /forum/index.php?act=Forward
Disallow: /forum/index.php?act=Track
Disallow: /forum/index.php?act=Post
Disallow: /forum/index.php?showuser
Disallow: /forum/index.php?act=Print
Disallow: /forum/index.php?act=ST
Disallow: /forum/index.php?act=boardrules
Disallow: /forum/index.php?act=Help
Disallow: /forum/index.php?act=Stats
Disallow: /forum/index.php?act=Members
Disallow: /forum/index.php?act=home
Disallow: /forum/index.php?act=Online
Disallow: /forum/index.php?act=SR
Disallow: /forum/index.php?act=ICQ
Disallow: /forum/index.php?act=MSN
Disallow: /forum/index.php?act=AOL
Disallow: /forum/index.php?act=AIM
Disallow: /forum/index.php?act=SC
Disallow: /forum/index.php?&act=
Disallow: /forum/index.php?s=
Disallow: /forum/index.php?act=UserCP
Disallow: /forum/index.php?act=usercp
Disallow: /forum/index.php?act=report
Disallow: /forum/index.php?act=Profile
Disallow: /forum/index.php?act=buddy
Disallow: /forum/index.php?act=legends
Disallow: /forum/index.php?CODE=04
Disallow: /forum/&debug=1$
Disallow: /forum/index.php?setskin=1
Disallow: /forum/index.php?setlanguage=1
Disallow: /forum/index.php?act=task
Disallow: /forum/index.php?act=findpost
Disallow: /forum/index.php?act=module
Disallow: /forum/index.php?automodule
Disallow: /forum/index.php?act=attach

Link to comment
Share on other sites

Archived

This topic is now archived and is closed to further replies.

  • Recently Browsing   0 members

    • No registered users viewing this page.
×
×
  • Create New...