rbiss Posted August 13, 2009 Posted August 13, 2009 My site froze everyday and had me looking for new hosting with more resources. However, we believe the yandex.ru spider has been the culprit. If you are experiencing periodic daily downtimes check the activity level of yandex.ru before upgrading your hosting.
AlexWright Posted August 14, 2009 Posted August 14, 2009 Simply add: To the robots.txt file. Should keep the little bugger away.User-agent: Yandex Disallow: /
Recommended Posts
Archived
This topic is now archived and is closed to further replies.