greek_parea Posted March 4, 2022 Share Posted March 4, 2022 last days i see this messafe google adsense The robots.txt file did not allow access to the crawler Link to comment Share on other sites More sharing options...
Randy Calvert Posted March 4, 2022 Share Posted March 4, 2022 There is nothing in the DEFAULT robots.txt that would block Google. Question 1. Are you using IPB’s auto generated robots.txt? Question 2. Have you actually LOOKED at your robots.txt to see if Google is blocked? (It’s possible there is a file there that is preventing IPB’s dynamically generated one.) Its also possible your server was having problems at the time it was accessed and Google could not open the robots.txt. Link to comment Share on other sites More sharing options...
greek_parea Posted March 4, 2022 Author Share Posted March 4, 2022 5 hours ago, Randy Calvert said: There is nothing in the DEFAULT robots.txt that would block Google. Question 1. Are you using IPB’s auto generated robots.txt? Question 2. Have you actually LOOKED at your robots.txt to see if Google is blocked? (It’s possible there is a file there that is preventing IPB’s dynamically generated one.) Its also possible your server was having problems at the time it was accessed and Google could not open the robots.txt. yes i using auto generated robots.txt i see robots.txt and google no blocked Link to comment Share on other sites More sharing options...
Randy Calvert Posted March 4, 2022 Share Posted March 4, 2022 If Google was not listed it sounds like Google goofed. Which does happen! Link to comment Share on other sites More sharing options...
Recommended Posts