Invision Community 4: SEO, prepare for v5 and dormant account notifications By Matt Monday at 02:04 PM
marklcfc Posted November 7, 2023 Posted November 7, 2023 Been told by my hosts that this Amazon bot is making a lot of requests to my site, around 18,000 daily. Does anyone know what it is and can it be blocked?
Nathan Explosion Posted November 7, 2023 Posted November 7, 2023 9 minutes ago, marklcfc said: Does anyone know what it is https://developer.amazon.com/support/amazonbot/ Includes informaton on adding to robots.txt
marklcfc Posted November 7, 2023 Author Posted November 7, 2023 Should I be blocking this though or allowing it?
Jim M Posted November 7, 2023 Posted November 7, 2023 5 minutes ago, marklcfc said: Should I be blocking this though or allowing it? Do you want your community on those services? If so, you will need to allow it. If no, tell it no in the robots.txt file.
Recommended Posts