Jump to content

Community

Recommended Posts

  • 2 weeks later...
  • 1 month later...
  • 1 month later...
  • 1 month later...

We do not include a robots.txt in IPS4 as it is not needed. Guest links can be removed entirely for inaccessible sections, so there's nothing for search engines to exclude as they won't see it anyway. :)

Why is it relevant for Google to index for example the ?do=reportComment pages??? 

Link to post
Share on other sites
  • 11 months later...
On 03/05/2015 at 8:24 AM, Lindy said:

We do not include a robots.txt in IPS4 as it is not needed. Guest links can be removed entirely for inaccessible sections, so there's nothing for search engines to exclude as they won't see it anyway. :)

Yes there is - anything with a CSRF key in the URL will cause issues.

Link to post
Share on other sites

on the "Use recommended settings?" i'm on "manual" settings but when we take a look at the xml generated by the sitemap.php we can see clearly that the option as little   as no effect and yes we have open support incident on this  and other bug on the  sitemap, url issue etc etc... ^_^

 

 

Link to post
Share on other sites
3 hours ago, recifbox said:

on the "Use recommended settings?" i'm on "manual" settings but when we take a look at the xml generated by the sitemap.php we can see clearly that the option as little   as no effect and yes we have open support incident on this  and other bug on the  sitemap, url issue etc etc... ^_^

 

 

I think you should have created a new topic on your sitemap issue. This topic is about robots.txt started by Ilya Hoilik.

Link to post
Share on other sites
  • 1 year later...
  • Recently Browsing   0 members

    No registered users viewing this page.

×
×
  • Create New...

Important Information

We use technologies, such as cookies, to customise content and advertising, to provide social media features and to analyse traffic to the site. We also share information about your use of our site with our trusted social media, advertising and analytics partners. See more about cookies and our Privacy Policy