Safety1st Posted February 11 Posted February 11 https://example.com/robots.txt Where is robots.txt physically located when crawl management is set to 'Invision Community optimized'? There is no such file in the root directory. Or is it dynamically generated each time?
Solution teraßyte Posted February 11 Solution Posted February 11 (edited) If you use the "optimized" option it's automatically generated. That's as long as you don't have a robots.txt file on the server itself. In that case, the request isn't rerouted and the static file is provided. Edited February 11 by teraßyte Safety1st 1
Recommended Posts