Very slow post adding on forum

[Sledge FTB]

2 hours ago, wegorz23 said:

we have only 4gb swap on this machine, and 32gb of RAM. In years before there was the rule that swap should be times two of RAM. It can be related? 4gb of swap is not to small?

That would be related to laptops/desktops to store your RAM in swap during sleep/standby ... not really applicable for servers. I guess your 32GB is sufficient.

[wegorz23]

Ok, so what else? One thing that we would make now is making new lxc contener and putting there newest ubuntu, and other stuff (newest versions) and try one more time with elasticsearch.

[bfarber]

Are you using Elasticsearch by chance, and primarily seeing slowness when responding to long topics (i.e. topics with more than 1000 replies)? If so, there's a change in 4.4.8 that should address the concern.

[Numbered]

Try to use a trial version of NewRelic. It seems like an external calling issue, not inside IPS (or some lags between cache/database/etc). It shows time from both of them. If he shows that you lag come from the application - then I would try to temporary disable all applications/plugins (and modules from the core too) with checks how it feels after that.

[Chris027]

14 hours ago, wegorz23 said:

Ok, so what else? One thing that we would make now is making new lxc contener and putting there newest ubuntu, and other stuff (newest versions) and try one more time with elasticsearch.

Hi wegorz23 - Nice to see you around here :~)

This an issue we have as well at Audiophile Style. The slowness is usually on an insert / when users submit a post. This started for us mostly with Elasticsearch. Some of our topics are really long (750+ pages), and have the problem even worse. 

We use Cloudflare and absolutely love it. Be careful with some of the features, they will break IPS. 

 

 

12 hours ago, bfarber said:

Are you using Elasticsearch by chance, and primarily seeing slowness when responding to long topics (i.e. topics with more than 1000 replies)? If so, there's a change in 4.4.8 that should address the concern.

Happy to read this!

[wegorz23]

20 hours ago, bfarber said:

Are you using Elasticsearch by chance, and primarily seeing slowness when responding to long topics (i.e. topics with more than 1000 replies)? If so, there's a change in 4.4.8 that should address the concern.

We are on standard search now. We had elastic for a moment, to test it, but it crushes after every few hours. My admins made some script to run it up, but users reported that they have empty Activity tab after this crashes, so we had back to standard search now. We have old Ubuntu (12.x) on this servers, so now will make new lxc contener and test it with newest Ubuntu and elastic search one more time.

7 hours ago, Chris027 said:

Hi wegorz23 - Nice to see you around here :~)

This an issue we have as well at Audiophile Style

Wow you have site about audio stuff, great 🙂 We have audiostereo.pl - the same subject, nice 🙂

 

[wegorz23]

7 hours ago, Chris027 said:

The slowness is usually on an insert / when users submit a post. This started for us mostly with Elasticsearch. Some of our topics are really long (750+ pages), and have the problem even worse. 

We use Cloudflare and absolutely love it. Be careful with some of the features, they will break IPS. 

Yes, the whole site runs good (it can be better, but is not bad), but only adding posts is slooooow. We also have big topics with 2000 and even 4000 pages. But problem also appears even on smaller - for example with 400+ pages. It is very big forum, but we have also good servers, so it should works fine.

[AtariAge]

On 11/6/2019 at 9:26 PM, Chris027 said:

We use Cloudflare and absolutely love it. Be careful with some of the features, they will break IPS. 

I am running Cloudflare and it's been a godsend, especially defending against bot attacks (had over 5,000 bots hitting the forum yesterday).  What are the features that will break IPS?

Thanks,

 ..Al

[Chris027]

11 minutes ago, AtariAge said:

I am running Cloudflare and it's been a godsend, especially defending against bot attacks (had over 5,000 bots hitting the forum yesterday).  What are the features that will break IPS?

Thanks,

 ..Al

Rocket Loader is a feature I want to use really bad but when I tried it broke IPS. 

[AtariAge]

4 minutes ago, Chris027 said:

Rocket Loader is a feature I want to use really bad but when I tried it broke IPS. 

What happens when you enable Rocket Loader?

[Daniel F]

Just now, AtariAge said:

What happens when you enable Rocket Loader?

It won't work with our software.

[AtariAge]

Just now, Daniel F said:

It won't work with our software.

LOL, okay, that's a fair answer.  🙂

[Sovereign Grace Singles]

I'm not running into any problems with RocketLoader. Months ago I did have to disable it because "reactions" would not work. Obviously some tweaking was done on the end of Cloudflare or Invision for the application to work without an issue now. Running Rocketloader should probably be tested on a site to site basis. I am seeing .1-.2 quicker load times. 

[Daniel F]

6 minutes ago, Christforums said:

I'm not running into any problems with RocketLoader. Months ago I did have to disable it because "reactions" would not work. Obviously some tweaking was done on the end of Cloudflare or Invision for the application to work without an issue now. Running Rocketloader should probably be tested on a site to site basis. I am seeing .1-.2 quicker load times. 

Interesting, thanks for the update.

[Chris027]

16 minutes ago, Christforums said:

I'm not running into any problems with RocketLoader. Months ago I did have to disable it because "reactions" would not work. Obviously some tweaking was done on the end of Cloudflare or Invision for the application to work without an issue now. Running Rocketloader should probably be tested on a site to site basis. I am seeing .1-.2 quicker load times. 

Ah, cool. Do your article view counters still work?

[Sovereign Grace Singles]

9 minutes ago, Chris027 said:

Ah, cool. Do your article view counters still work?

They appear so. Correct me if wrong but if they are not to the degree of updating immediately couldn't that be, for example, a guest time cache issue? 

Feel free to look around my site if you wish. RocketLoader is enabled. I also run Redis, PhP opcache, Amazon elastic search as well as S3 , cloudfront, and cloudflare. 

I have no issues with slow performance in way of posting etc. Actually, the Invision software running this current configuration is the best setup I've ever run:

https://gtmetrix.com/reports/www.christforums.com/rkWvgnKJ

 

[Chris027]

3 minutes ago, Christforums said:

They appear so. Correct me if wrong but if they are not to the degree of updating immediately couldn't that be, for example, a guest time cache issue? 

Feel free to look around my site if you wish. RocketLoader is enabled. I also run Redis, PhP opcache, Amazon elastic search as well as S3 , cloudfront, and cloudflare. 

I have no issues with slow performance in way of posting etc. Actually, the Invision software running this current configuration is the best setup I've ever run:

https://gtmetrix.com/reports/www.christforums.com/rkWvgnKJ

 

Thank you very much for this info. I'm working on speeding up my site and it's nice to hear you're using all this stuff without issues and with success. 

I know that these metrics sites aren't the gold standard, but have you looked into the issues presented here?

https://developers.google.com/speed/pagespeed/insights/?url=https%3A%2F%2Fwww.christforums.com%2F

 

[Sovereign Grace Singles]

20 minutes ago, Chris027 said:

Thank you very much for this info. I'm working on speeding up my site and it's nice to hear you're using all this stuff without issues and with success. 

I know that these metrics sites aren't the gold standard, but have you looked into the issues presented here?

https://developers.google.com/speed/pagespeed/insights/?url=https%3A%2F%2Fwww.christforums.com%2F

 

Yes, and as is now the test can't run due to my public referrer restrictions.  However, on that particular test the score was over 80%.

[AtariAge]

52 minutes ago, Christforums said:

Feel free to look around my site if you wish. RocketLoader is enabled. I also run Redis, PhP opcache, Amazon elastic search as well as S3 , cloudfront, and cloudflare. 

I have no issues with slow performance in way of posting etc. Actually, the Invision software running this current configuration is the best setup I've ever run:

Thanks for the update, I may have to try enabling RocketLoader to see if it works.  I'm also running Redis, self-hosted Elasticsearch, and Cloudflare.  I have MySQL sitting on another dedicated server with lots of RAM and the dedicated web server is only hosting the one site.  Unfortunately, I still get a "D" on PageSpeed and a "B" on YSlow.   Most pages in the forum do come up pretty quickly (when the site isn't being attacked by 5,000 bots like what happened yesterday), but obviously more optimization could be done.  Probably going to move MySQL to MariaDB at some point, but it's hard for me to properly test that, so I have to be careful there. 🙂

Edit: I also have no issues with slow posting, and I have over four million posts.

 ..Al

 

[Sovereign Grace Singles]

16 minutes ago, AtariAge said:

Thanks for the update, I may have to try enabling RocketLoader to see if it works.  I'm also running Redis, self-hosted Elasticsearch, and Cloudflare.  I have MySQL sitting on another dedicated server with lots of RAM and the dedicated web server is only hosting the one site.  Unfortunately, I still get a "D" on PageSpeed and a "B" on YSlow.   Most pages in the forum do come up pretty quickly (when the site isn't being attacked by 5,000 bots like what happened yesterday), but obviously more optimization could be done.  Probably going to move MySQL to MariaDB at some point, but it's hard for me to properly test that, so I have to be careful there. 🙂

Edit: I also have no issues with slow posting, and I have over four million posts.

 ..Al

 

Regarding Page Speed score I'm using this plugin by @The Old Man

Definitely saw a major improvement. That is, if "scores" from GTmetrix are realistic indicators. 

Regarding my own server, I have a server hosted that only runs 8GB of RAM. However, offloading all the database and files etc usually keeps my ram load under 30%. 

[bfarber]

As I recall, the main issue with Rocketloader were editors that were loaded into the page via AJAX inside a modal. Examples include sending a personal message to someone (the modal that allows you to write a new conversation).

If you're not having issues with it, great - but if issues do arise, we'd recommend disabling it at first to rule it out as a cause.

[Chris027]

12 minutes ago, bfarber said:

As I recall, the main issue with Rocketloader were editors that were loaded into the page via AJAX inside a modal. Examples include sending a personal message to someone (the modal that allows you to write a new conversation).

If you're not having issues with it, great - but if issues do arise, we'd recommend disabling it at first to rule it out as a cause.

Our users reported that the page would jump to awkward locations and never go to the right spot when clicking on the arrow that brings them to a quoted post. This was all over the weekend and we enabled it Friday. 

Disabled it this am. 

[TDBF]

On 11/6/2019 at 2:29 PM, bfarber said:

Are you using Elasticsearch by chance, and primarily seeing slowness when responding to long topics (i.e. topics with more than 1000 replies)? If so, there's a change in 4.4.8 that should address the concern.

This is something that would be welcomed!

We had a thread with over 2000 replies and we were getting this slowness on posting. Now we tend to let a Topic get to around 750 posts an then we close it, create a new Topic with a continuation of the original. So far it seems to work for us doing it this way, but if 4.4.8 fixes this then that would be excellent news.

[Sovereign Grace Singles]

1 hour ago, Chris027 said:

Our users reported that the page would jump to awkward locations and never go to the right spot when clicking on the arrow that brings them to a quoted post. This was all over the weekend and we enabled it Friday. 

Disabled it this am. 

I'm not having that problem. Just suggesting that if anyone tries Rocketloader that it should be tested. However, I've received great results from using it. 

[wegorz23]

Ok, I have enabled this rocker loader. But adding posts is still slow for us 😞

We gonna update to 4.4.8 now and see then.