greek_parea Posted March 4, 2022 Posted March 4, 2022 last days i see this messafe google adsense The robots.txt file did not allow access to the crawler
Randy Calvert Posted March 4, 2022 Posted March 4, 2022 There is nothing in the DEFAULT robots.txt that would block Google. Question 1. Are you using IPB’s auto generated robots.txt? Question 2. Have you actually LOOKED at your robots.txt to see if Google is blocked? (It’s possible there is a file there that is preventing IPB’s dynamically generated one.) Its also possible your server was having problems at the time it was accessed and Google could not open the robots.txt.
greek_parea Posted March 4, 2022 Author Posted March 4, 2022 5 hours ago, Randy Calvert said: There is nothing in the DEFAULT robots.txt that would block Google. Question 1. Are you using IPB’s auto generated robots.txt? Question 2. Have you actually LOOKED at your robots.txt to see if Google is blocked? (It’s possible there is a file there that is preventing IPB’s dynamically generated one.) Its also possible your server was having problems at the time it was accessed and Google could not open the robots.txt. yes i using auto generated robots.txt i see robots.txt and google no blocked
Randy Calvert Posted March 4, 2022 Posted March 4, 2022 If Google was not listed it sounds like Google goofed. Which does happen!
Recommended Posts