Internal Redirect Errors

[-GR-]

Wanted to see if anyone else has any experience with this. I have been getting a lot of internal redirect errors with googlebot and for some reason I can't figure out how.

I set LogLevel to debug to help try and track it down. All of the urls work for me when visiting the different pages. I enabled the rewrite loglevel to 3 and it is coming from my main website. It seems to be a redirect loop when leads to the robots.txt file but I can't figure out how it would be doing a loop.

[Wed May 09 09:19:07 2012] [debug] core.c(3112): [client 66.249.71.76] r->uri = /forums/index.php

[Wed May 09 09:19:07 2012] [debug] core.c(3118): [client 66.249.71.76] redirected from r->uri = /forums/index.php

[Wed May 09 09:19:07 2012] [debug] core.c(3118): [client 66.249.71.76] redirected from r->uri = /forums/index.php

[Wed May 09 09:19:07 2012] [debug] core.c(3118): [client 66.249.71.76] redirected from r->uri = /forums/index.php

[Wed May 09 09:19:07 2012] [debug] core.c(3118): [client 66.249.71.76] redirected from r->uri = /forums/index.php

[Wed May 09 09:19:07 2012] [debug] core.c(3118): [client 66.249.71.76] redirected from r->uri = /forums/index.php

[Wed May 09 09:19:07 2012] [debug] core.c(3118): [client 66.249.71.76] redirected from r->uri = /forums/index.php

[Wed May 09 09:19:07 2012] [debug] core.c(3118): [client 66.249.71.76] redirected from r->uri = /forums/index.php

[Wed May 09 09:19:07 2012] [debug] core.c(3118): [client 66.249.71.76] redirected from r->uri = /forums/index.php

[Wed May 09 09:19:07 2012] [debug] core.c(3118): [client 66.249.71.76] redirected from r->uri = /forums/index.php

[Wed May 09 09:19:07 2012] [debug] core.c(3118): [client 66.249.71.76] redirected from r->uri = /robots.txt

I am open to suggestions on what to look for. Possibly it is because of recently switching to a new server and ip addresses being changed but I wouldn't think that would cause it.

[Gary.]

I may be wrong but I would suggest it is .htaccess related.

What I would suggest is rename the .htaccess file to .htaccessOLD Then in your forums ACP > Security > Run the .htaccess rule and and it will make a new one. Then when you login FTP you will see the new .htaccess in the forums root, Just add what you need to it by getting the information from the ACP > Search Engine .

Once it has been written check what changes are between .htaccess and .htaccessOLD.

I would think there is something different.

Regards.

Gary.

[-GR-]

It did change a little bit but it is only the 404 part.

Here is the new one:

<IfModule mod_rewrite.c>

Options -MultiViews

RewriteEngine On

RewriteBase /forums/

RewriteCond %{REQUEST_FILENAME} .*.(jpeg|jpg|gif|png)$

RewriteCond %{REQUEST_FILENAME} !-f

RewriteRule . /forums/public/404.php [L]


RewriteCond %{REQUEST_FILENAME} !-f

RewriteCond %{REQUEST_FILENAME} !-d

RewriteRule . /forums/index.php [L]

</IfModule>

Here is what was in the old one:

<IfModule mod_rewrite.c>

Options -MultiViews

RewriteEngine On

RewriteBase /forums/

RewriteCond %{REQUEST_FILENAME} !-f

RewriteCond %{REQUEST_FILENAME} !-d

RewriteRule . /forums/index.php [L]

</IfModule>

I don't think there was anything wrong with the original one but I will see how the error log looks after a while.

[-GR-]

I think somehow it is google trying to hit the root of the server for the robots.txt file for my at my dns ips.

Here is a couple of the access log entries, there are hundreds if not thousands of them:

66.249.71.76 - - [09/May/2012:10:38:19 -0400] "GET /robots.txt HTTP/1.1" 500 690

66.249.71.76 - - [09/May/2012:10:44:32 -0400] "GET /robots.txt HTTP/1.1" 500 690

66.249.71.76 - - [09/May/2012:10:50:31 -0400] "GET /robots.txt HTTP/1.1" 500 690

66.249.71.76 - - [09/May/2012:10:55:31 -0400] "GET /robots.txt HTTP/1.1" 500 690

66.249.71.76 - - [09/May/2012:11:01:00 -0400] "GET /robots.txt HTTP/1.1" 500 690

66.249.71.76 - - [09/May/2012:11:06:24 -0400] "GET /robots.txt HTTP/1.1" 500 690

66.249.71.76 - - [09/May/2012:11:11:47 -0400] "GET /robots.txt HTTP/1.1" 500 690

66.249.71.76 - - [09/May/2012:11:17:10 -0400] "GET /robots.txt HTTP/1.1" 500 690

66.249.71.76 - - [09/May/2012:11:22:32 -0400] "GET /robots.txt HTTP/1.1" 500 690

66.249.71.76 - - [09/May/2012:11:27:47 -0400] "GET /robots.txt HTTP/1.1" 500 690

66.249.71.76 - - [09/May/2012:11:33:15 -0400] "GET /robots.txt HTTP/1.1" 500 690

66.249.71.76 - - [09/May/2012:11:38:36 -0400] "GET /robots.txt HTTP/1.1" 500 690

66.249.71.76 - - [09/May/2012:11:43:57 -0400] "GET /robots.txt HTTP/1.1" 500 690

66.249.71.76 - - [09/May/2012:11:49:18 -0400] "GET /robots.txt HTTP/1.1" 500 690

66.249.71.76 - - [09/May/2012:11:54:40 -0400] "GET /robots.txt HTTP/1.1" 500 690

66.249.71.76 - - [09/May/2012:12:00:54 -0400] "GET /robots.txt HTTP/1.1" 500 -

66.249.71.76 - - [09/May/2012:12:06:16 -0400] "GET /robots.txt HTTP/1.1" 500 690

66.249.71.76 - - [09/May/2012:12:11:36 -0400] "GET /robots.txt HTTP/1.1" 500 690

66.249.71.76 - - [09/May/2012:12:16:58 -0400] "GET /robots.txt HTTP/1.1" 500 690

66.249.71.76 - - [09/May/2012:12:22:19 -0400] "GET /robots.txt HTTP/1.1" 500 690

[Grumpy]

Just make the .robots.txt file in the root.

[-GR-]

Just make the .robots.txt file in the root.

That is what I ended up doing was just touching a new robots.txt file in the root. I was still getting a couple more even after putting it there but I restarted the webserver and so far it seems alright.