VaBeach_Guy Posted June 2, 2020 Share Posted June 2, 2020 On one of my boards, I have a particular bot that's in my online list with nearly 200 instances. I've banned the IP block (114.119.*.*) It shows as "petalbot.(with the specific IP address).aspiegel".com. Is there any better way of blocking that specific bot? Link to comment Share on other sites More sharing options...
Rhett Posted June 2, 2020 Share Posted June 2, 2020 https://aspiegel.com/petalbot Link to comment Share on other sites More sharing options...
VaBeach_Guy Posted June 2, 2020 Author Share Posted June 2, 2020 32 minutes ago, Rhett said: https://aspiegel.com/petalbot Do you think it's worth letting it crawl? Link to comment Share on other sites More sharing options...
Rhett Posted June 2, 2020 Share Posted June 2, 2020 5 minutes ago, VaBeach_Guy said: Do you think it's worth letting it crawl? No, block it via robots.txt as it shows on that link. Or ban the ip range on the server if you have access. VaBeach_Guy 1 Link to comment Share on other sites More sharing options...
VaBeach_Guy Posted June 2, 2020 Author Share Posted June 2, 2020 11 minutes ago, Rhett said: No, block it via robots.txt as it shows on that link. Or ban the ip range on the server if you have access. I hadn't thought about doing it server side, thanks. Link to comment Share on other sites More sharing options...
Recommended Posts