Suggestion: Sitemap + autodiscovery through Robots.txt

[Joannes Vermorel]

All major search engines now supports Sitemaps and Sitemaps auto-discovery through Robots.txt. I would be a really nice addition to IP.Board if sitemaps were supported since it's an important piece to make the web application search engine friendly.

Best regards,
Joann

[rm5b.2bs]

I too would love to see IPB have a sitemap and/or FURL implemented as a standard feature - it would be a first for any bulletin board to have it too. :)

[sunrisecc]

I disagree especially if it a standard feature. At least make it an option. I do not allow any search engines to visit my forums. I also purge old topics on a daily basis. I do not see where a site map will help me.

[kirov]

sunrisecc, that is from your point of view, but the problem is that IPB is loosing ground at MODS, expecially at SEO, there is no sitemap generator that works with the latest IPB, there is no URL SEO (free)...

[sunrisecc]

You should re-read my post. I did state that it should be an option that can be turned off. The product should accomodate all customers and not force the latest fads on all of us - the existing customers included.

[Michael]

Completely agree with sunrisecc.

@kirovul
You accuse sunrisecc of only looking at it from his point of view, but you're doing the same thing. What does it matter if (and that's a big if, because I personally don't believe it's true) IPB is "loosing ground at MODS"? If the demand for such mods were truly there, they'd get made.

[bfarber]

Completely agree with sunrisecc.

@kirovul

You accuse sunrisecc of only looking at it from his point of view, but you're doing the same thing. What does it matter if (and that's a big if, because I personally don't believe it's true) IPB is "loosing ground at MODS"? If the demand for such mods were truly there, they'd get made.

And they have - there's the Minerva project, the CommunitySEO one, and the standard FURL that I think was updated to work with 2.2 (and would work with 2.3 just the same).

[Millar]

I would love to see this feature.

I know you often reply with the fact that it is .htaccess dependant. So just make it an option to those who have that availability.

[kirov]

sorry sunrisecc i didn't mean to sound that whay

so minerva sitemap generator crashes, FURL hasn't bean updated for 2.3 and kim seams he has abandond FURL 4

at this moment IPB doesn't have a free 100% working sitemap generator

[sunrisecc]

sorry sunrisecc i didn't mean to soud that whay

Apology accepted.

[Luke]

I disagree especially if it a standard feature. At least make it an option. I do not allow any search engines to visit my forums. I also purge old topics on a daily basis. I do not see where a site map will help me.

All you have to do is tell robots.txt to disallow and turn off the site map. Furl url's could be a standard feature, and it wouldn't stop you from having search engines leave you alone.

On the other hand, most admins WANT a search engine to accurately index their site. It's the biggest thing that gets you members in the first place: Search engine ranking.

[sunrisecc]

Have the board software always generate a site map and then disallow the search engines from viewing it? That is a lot smarter than making it an option on the first place?

I'll repeat myself to make it clear.

I disagree especially if it a standard feature. At least make it an option.

Another question. When did 'most' become a fact?

A lot of boards are private or in-house. Did you consider those boards? I think not.

[Luke]

Have the board software always generate a site map and then disallow the search engines from viewing it? That is a lot smarter than making it an option on the first place?

I'll repeat myself to make it clear.

Another question. When did 'most' become a fact?

A lot of boards are private or in-house. Did you consider those boards? I think not.

You didn't read what I said either. I said make the site map generator an option. Obviously something that is generated would have an on/off switch. The friendly url's doesn't have to be an option (instead of /index.php?act=something&var=value&me=me you have /topic_title_goes_here.html). You can disallow search engines from viewing your board if you want to.

[sunrisecc]

All you have to do is tell robots.txt to disallow and turn off the site map. Furl url's could be a standard feature, and it wouldn't stop you from having search engines leave you alone.

On the other hand, most admins WANT a search engine to accurately index their site. It's the biggest thing that gets you members in the first place: Search engine ranking.

I do not see the word 'option' anywhere. All I see is you telling me to use robots.txt. If it is an option, why would I need to use robots.txt to avoid a site map being read.

[Luke]

All you have to do is

tell robots.txt to disallow

and

turn off the site map

.

Furl url's could be a standard feature

, and it

wouldn't stop you from having search engines leave you alone

.

On the other hand, most admins WANT a search engine to accurately index their site. It's the biggest thing that gets you members in the first place: Search engine ranking.

Usually the word "turn off" implies option. Look at what I said quoted above, and use the alternating colors to see four different things.

[sunrisecc]

tell robots.txt to disallow

and turn off the site map

One noun robots.txt followed by two verbs usually implies referral back to the same noun. However if you really meant two separate ideas, then I accept it.