rbiss Posted August 13, 2009 Share Posted August 13, 2009 My site froze everyday and had me looking for new hosting with more resources. However, we believe the yandex.ru spider has been the culprit. If you are experiencing periodic daily downtimes check the activity level of yandex.ru before upgrading your hosting. Link to comment Share on other sites More sharing options...
AlexWright Posted August 14, 2009 Share Posted August 14, 2009 Simply add: To the robots.txt file. Should keep the little bugger away.User-agent: Yandex Disallow: / Link to comment Share on other sites More sharing options...
Recommended Posts
Archived
This topic is now archived and is closed to further replies.