https://example.com/robots.txt

Where is robots.txt physically located when crawl management is set to 'Invision Community optimized'? There is no such file in the root directory. Or is it dynamically generated each time?

If you use the "optimized" option it's automatically generated. That's as long as you don't have a robots.txt file on the server itself. In that case, the request isn't rerouted and the static file is provided.

Edited February 11, 20241 yr by teraßyte