Invision Community 4: SEO, prepare for v5 and dormant account notifications Matt November 11, 2024Nov 11
Posted January 28, 201411 yr Getting heaps errors from Google Crawler, how to prevent them ? For example :
January 28, 201411 yr It seems you have disabled guests to be able to see user profiles, so when google tries to crawl them it gives an error. I added this to robots.txt: Disallow: /user/
January 28, 201411 yr Author It seems you have disabled guests to be able to see user profiles, so when google tries to crawl them it gives an error. I added this to robots.txt: Disallow: /user/ Thanks mate and what about this : More than 500 errors caused by this thing :D
January 28, 201411 yr Same, google is trying to use the search, which you have blocked. I have this line in my robots.txt, should help: Disallow: /*&module=search
Archived
This topic is now archived and is closed to further replies.