loccom Posted February 7, 2019 Posted February 7, 2019 Turning tags off for Guests I want to prevent Bots using the tags system totally. Does the tag system exist in the sitemap and can it be turned off totally for guests so i can prevent it being spidered (even though indexing is turned off) thanks
opentype Posted February 7, 2019 Posted February 7, 2019 Pretty sure you would have to disable the search function.
loccom Posted February 8, 2019 Author Posted February 8, 2019 would that be disable search function for guests?
Daniel F Posted February 10, 2019 Posted February 10, 2019 On 2/8/2019 at 12:30 PM, loccom said: would that be disable search function for guests? Exactly.
loccom Posted February 11, 2019 Author Posted February 11, 2019 20 hours ago, Daniel F said: Exactly. Hmm.. that is not much fun for guests if they are doing a search, surely having the ability to remove all tags per group basis is the best way? The amount of 429 errors this is causing and I wont be the only one having this issue. Causing massive SEO problems when it reports 10,000 errors per site.
opentype Posted February 11, 2019 Posted February 11, 2019 If the server can’t handle the requests, that’s —well—a server issue. You can also add tags to your robots.txt and ask crawlers not to follow the links. It won’t guarantee that those links aren’t actually followed of course.
Recommended Posts
Archived
This topic is now archived and is closed to further replies.