Invision Community 4: SEO, prepare for v5 and dormant account notifications By Matt Monday at 02:04 PM
SJ77 Posted January 28, 2018 Posted January 28, 2018 This is happening to me. I don't know why or how to stop it. 75K+ indexed down to almost nothing. What gives? Any insight? Thanks in advance.
SJ77 Posted January 28, 2018 Author Posted January 28, 2018 The drop starts right about when I switched to https from http I look at the link http://www.MYSITE.org/forums/sitemap.php it's giving a 404 error. Can't figure out how to fix that.
Adlago Posted January 28, 2018 Posted January 28, 2018 Check your Server Engine Optimization - Sitemap. 1. URL to sitemap.php file -> 2. Use recommended settings? - Yes I had the same problem after http -> https - but after these settings everything is OK
SJ77 Posted January 28, 2018 Author Posted January 28, 2018 3 minutes ago, Adlago said: Check your Server Engine Optimization - Sitemap. 1. URL to sitemap.php file -> 2. Use recommended settings? - Yes I had the same problem after http -> https - but after these settings everything is OK I am confused because I get this error. " Please enter a valid URL for the sitemap.php file " 404 error on the page I entered.
opentype Posted January 28, 2018 Posted January 28, 2018 2 minutes ago, superj707 said: Can't figure out how to fix that. We can’t either, since you always hide your site URL. Maybe IPS support can investigate. Sitemap problems still wouldn’t explain a total loss of all indexed pages. Maybe that applies to you?https://www.wordstream.com/blog/ws/2017/08/24/google-fred-update
SJ77 Posted January 28, 2018 Author Posted January 28, 2018 1 minute ago, opentype said: We can’t either, since you always hide your site URL. Maybe IPS support can investigate. Sitemap problems still wouldn’t explain a total loss of all indexed pages. Maybe that applies to you?https://www.wordstream.com/blog/ws/2017/08/24/google-fred-update Hi thanks for sharing the link. I will check it now. I always hide the url out of respect because I don't want people to feel I am fishing for traffic.
SJ77 Posted January 28, 2018 Author Posted January 28, 2018 1 minute ago, Adlago said: Try without www no luck, I see the php file in the folder so I am really confused.
Adlago Posted January 28, 2018 Posted January 28, 2018 And do you have this file in directory forums? Check permission this file - 0644
SJ77 Posted January 28, 2018 Author Posted January 28, 2018 2 minutes ago, Adlago said: And do you have this file in directory forums? oh bloody hell, I need more coffee. Thanks mate. I added an "s" for some reason when there shouldn't be. Ok, at least that is squared away. Seems there is still another issue though going on as discussed in the thread about sitemap on large sites. Thanks again.
AlexWebsites Posted January 28, 2018 Posted January 28, 2018 I would check google webmaster tools for the correct https:// sitemap file, run the test and see what it picks up. Then check each individual sub-sitemap in webamster tools to see what it's reading in terms of how manu urls, then as @Adlago mentioned as a final check, make sure that sitemap.php file actually exists. When you switched to https, did you put an htaccess redirect from http to https?
Adlago Posted January 28, 2018 Posted January 28, 2018 Yes this work https://www.curvage.org/forum/sitemap.php
AlexWebsites Posted January 28, 2018 Posted January 28, 2018 I think you have some other issues related to indexing as well, your urls are not fully utilizing SEO built into IPS such as https://www.curvage.org/forum/index.php?/forums/topic/27578-my-wife-and-her-awesome-booty/ and you have the topic(s) shut off to guests which unless you are using a plugin, you are shutting off search engines from indexing that content.
SJ77 Posted January 28, 2018 Author Posted January 28, 2018 6 minutes ago, AlexWebsites said: When you switched to https, did you put an htaccess redirect from http to https? No because I don't run Apache. I have Nginx. http does redirect properly though. 1 minute ago, AlexWebsites said: I think you have some other issues related to indexing as well, your urls are not fully utilizing SEO built into IPS such as https://www.curvage.org/forum/index.php?/forums/topic/27578-my-wife-and-her-awesome-booty/ and you have the topic(s) shut off to guests which unless you are using a plugin, you are shutting off search engines from indexing that content. some forums are private and some are public. I would like the pages index but not the images. Do you know of a way to let the robots in for text only and keep the people out?
AlexWebsites Posted January 28, 2018 Posted January 28, 2018 2 minutes ago, SJ77 said: No because I don't run Apache. I have Nginx. http does redirect properly though. some forums are private and some are public. I would like the pages index but not the images. Do you know of a way to let the robots in for text only and keep the people out? You can try this, but its considered cloaking.
opentype Posted January 28, 2018 Posted January 28, 2018 5 minutes ago, SJ77 said: I would like the pages index but not the images. Do you know of a way to let the robots in for text only and keep the people out? You would need to deny the access for image crawlers. That is possible, although not bullet-proof of course. Certain crawlers might ignore it.
crmarks Posted January 28, 2018 Posted January 28, 2018 2 hours ago, SJ77 said: This is happening to me. I don't know why or how to stop it. 75K+ indexed down to almost nothing. What gives? Any insight? Thanks in advance. 2 hours ago, SJ77 said: The drop starts right about when I switched to https from http Your 'http://' URLs are being removed from the index and replaced by 'https://' URLs. You have to add the 'https://' version of your site to Google Webmaster tools and authenticate the domain again, their system sees secure and non-secure URLs as two separate entities. Once you add your secure URL as another site in Webmaster tools you will likely see an opposite trend in stats, as those secure pages are increasingly more indexed. No cause for alarm
David.. Posted January 28, 2018 Posted January 28, 2018 @SJ77 Yeah, you just need to add the HTTPS version to your google console now as the HTTP version will become obsolete.
SJ77 Posted January 29, 2018 Author Posted January 29, 2018 15 minutes ago, David.. said: @SJ77 Yeah, you just need to add the HTTPS version to your google console now as the HTTP version will become obsolete. maybe this would be a good time to get my site off the "forum" domain since I don't really have any SEO to screw up. I have always disliked that the site was mysite.org/forum
Recommended Posts
Archived
This topic is now archived and is closed to further replies.