Jump to content

Robots.txt for IP 4+


JLS

Recommended Posts

Posted

I need some direction with a robots.txt. I need all the standard recommended stuff blocked and then I'd also like to block user profiles unless there is good reason not too. I understand they can be viewed by the public but seems a waste...

Thank you in advance for help with this :)

Posted

Cool that helped thanks.

Now, I kinda think I need to allow bots in the profiles but no-index them to get those few thousand pages removed from google. Then once removed do a no-follow. Does that sound right to you or any others reading this? Thanks

Archived

This topic is now archived and is closed to further replies.

  • Recently Browsing   0 members

    • No registered users viewing this page.
×
×
  • Create New...