Matt

Hopefully this is because the crawl efficiency improvements allowing Google to focus on the new content and not be distracted by changes to profiles, etc.

Hopefully this is because the crawl efficiency improvements allowing Google to focus on the new content and not be distracted by changes to profiles, etc.

Major milestone. Thanks IPS!
 

After updating to 4.6.8, after 2 days, I noticed that my topics are indexed much faster than before. Previously, the topic was indexed for up to a week, and now it is already in the index after a few hours.

Thanks for the feedback 🙂

We do use canonical tags heavily. However, the "do=getNewComment" style links cannot be canonicalised because they are just 301 redirects to another page.

Canonical links have a place, but they still eat up crawl budget because Google has to index the page to see the tag and then decide what to do with it.

We certainly are not telling Google "get off my site" - we are just strongly hinting to Google what we see as valuable parts of the site, and what we do not. Things like profile pages, redirect links and so on just eat up the budget for almost no return.

Unsure without investigating. It could be the way the tool was configured, the exact contents of the robots.txt, permissions on the clubs and so on.

Thanks for the feedback 🙂

We do use canonical tags heavily. However, the "do=getNewComment" style links cannot be canonicalised because they are just 301 redirects to another page.

Canonical links have a place, but they still eat up crawl budget because Google has to index the page to see the tag and then decide what to do with it.

We certainly are not telling Google "get off my site" - we are just strongly hinting to Google what we see as valuable parts of the site, and what we do not. Things like profile pages, redirect links and so on just eat up the budget for almost no return.

What are you using to monitor that metric? It generally takes weeks for Google to adjust the index after a change like this, so I'd be surprised if it was impacting page views unless there were errors, etc.

Thanks for the feedback 🙂

We do use canonical tags heavily. However, the "do=getNewComment" style links cannot be canonicalised because they are just 301 redirects to another page.

Canonical links have a place, but they still eat up crawl budget because Google has to index the page to see the tag and then decide what to do with it.

We certainly are not telling Google "get off my site" - we are just strongly hinting to Google what we see as valuable parts of the site, and what we do not. Things like profile pages, redirect links and so on just eat up the budget for almost no return.

What are you using to monitor that metric? It generally takes weeks for Google to adjust the index after a change like this, so I'd be surprised if it was impacting page views unless there were errors, etc.

What are you using to monitor that metric? It generally takes weeks for Google to adjust the index after a change like this, so I'd be surprised if it was impacting page views unless there were errors, etc.

Thanks for the feedback 🙂

We do use canonical tags heavily. However, the "do=getNewComment" style links cannot be canonicalised because they are just 301 redirects to another page.

Canonical links have a place, but they still eat up crawl budget because Google has to index the page to see the tag and then decide what to do with it.

We certainly are not telling Google "get off my site" - we are just strongly hinting to Google what we see as valuable parts of the site, and what we do not. Things like profile pages, redirect links and so on just eat up the budget for almost no return.

I like this "guru" expertise section and excellent start, keep it up 👍

Don't do it! 🙈

Hey Randy - thanks for taking the time to post. Yes, this is in our radar actually, it's something we do often for our brand clients.
Great suggestion.

Hey Randy - thanks for taking the time to post. Yes, this is in our radar actually, it's something we do often for our brand clients.
Great suggestion.

Hey Randy - thanks for taking the time to post. Yes, this is in our radar actually, it's something we do often for our brand clients.
Great suggestion.

Love this, @Matt! 

Would it be possible to ask the team to consider expanding Google Analytics integration?  For example, if GA is enabled, also add event tracking for new topics, new replies, new registrations, new gallery images posted, etc. 
There are some degree of this info available in the ACP, but it’s difficult to marry this with other GA data to properly analyze data. 

Thank you for the new moderator reporting!  It looks very promising!

very cool.... 🙂 

Cool

I've removed a lot of the 301 links for guests. As you can see from the visualisations, the before is full of red (301s) and now they are green. This is not just from the robots.txt file, this is from removing those 301 links.

I've removed a lot of the 301 links for guests. As you can see from the visualisations, the before is full of red (301s) and now they are green. This is not just from the robots.txt file, this is from removing those 301 links.

Yes 🙂 If there is an existing robots.txt file, this is detected and you are promoted to download the file so you can manually add the rules to your existing file. 

Very import update! Good job!