Adding some new rules to robots.txt

[SeNioR-]

 

Pages such as those below should be included in robots.txt, google unnecessarily wastes time on them.

• https://invisioncommunity.com/pastleaders/
• https://invisioncommunity.com/languages/
• https://invisioncommunity.com/applications/ (if we set the guest to be unable to download attachments)
• https://invisioncommunity.com/tags/* (since the tags have noindex, they should be removed for guests or at least a link)
• /notifications/ 

Edited August 3, 2022 by SeNioR-