Invision Community 4: SEO, prepare for v5 and dormant account notifications Matt November 11, 2024Nov 11
Posted March 4, 20223 yr last days i see this messafe google adsense The robots.txt file did not allow access to the crawler
March 4, 20223 yr Community Expert There is nothing in the DEFAULT robots.txt that would block Google. Question 1. Are you using IPB’s auto generated robots.txt? Question 2. Have you actually LOOKED at your robots.txt to see if Google is blocked? (It’s possible there is a file there that is preventing IPB’s dynamically generated one.) Its also possible your server was having problems at the time it was accessed and Google could not open the robots.txt.
March 4, 20223 yr Author There is nothing in the DEFAULT robots.txt that would block Google. Question 1. Are you using IPB’s auto generated robots.txt? Question 2. Have you actually LOOKED at your robots.txt to see if Google is blocked? (It’s possible there is a file there that is preventing IPB’s dynamically generated one.) Its also possible your server was having problems at the time it was accessed and Google could not open the robots.txt. yes i using auto generated robots.txt i see robots.txt and google no blocked
March 4, 20223 yr Community Expert If Google was not listed it sounds like Google goofed. Which does happen!