Jump to content

Chinese Robots Crawling my Site


JohnCourt

Recommended Posts

Posted

Is there anything I can do about this onslaught of robots crawling my site? Can I block an entire country? I looked up the ip address and this is the information I retrieved.

  baiduspider-180-76-15-15.crawl.baidu.com

 

I thought there was a way to ban IP Address's but I cannot find the feature in ACP to do so. We are running IPB v4.1.8.1

Thanks for any help!

Posted
1 minute ago, Steve-Ray said:

Do you have access to CPanel for your site?  If so there is an option there to block ip's.

Yes sir I do. Thanks!

I will look into that option, I remember seeing it, and I completely forgot about it, thanks again!

Posted

I think that the only real way to block an ip on the active site is to Flag as Spammer but no matter what they would of had to register as a member of the site.

You are welcome and I hope that it works for you.

Posted
5 hours ago, Courtland said:

Or perhaps I could ban the domain baidu.com, is it possible?

You can stop domains in .htaccess. Something like this:

# Kill bad sites
RewriteCond %{HTTP_REFERER} baidu\.com [NC]
RewriteRule .* - [F]

Those guys don't honor the Robots.txt protocol 

 

Archived

This topic is now archived and is closed to further replies.

  • Recently Browsing   0 members

    • No registered users viewing this page.
×
×
  • Create New...