Posted June 2, 20205 yr On one of my boards, I have a particular bot that's in my online list with nearly 200 instances. I've banned the IP block (114.119.*.*) It shows as "petalbot.(with the specific IP address).aspiegel".com. Is there any better way of blocking that specific bot?
June 2, 20205 yr Author 32 minutes ago, Rhett said: https://aspiegel.com/petalbot Do you think it's worth letting it crawl?
June 2, 20205 yr 5 minutes ago, VaBeach_Guy said: Do you think it's worth letting it crawl? No, block it via robots.txt as it shows on that link. Or ban the ip range on the server if you have access.
June 2, 20205 yr Author 11 minutes ago, Rhett said: No, block it via robots.txt as it shows on that link. Or ban the ip range on the server if you have access. I hadn't thought about doing it server side, thanks.
Archived
This topic is now archived and is closed to further replies.