dutchsnowden Posted January 4 Share Posted January 4 Lately I have been seeing quite a few of slow loading pages: Almost 18 seconds, while everything else is absolutely blazing fast. How to find out what is going on and what is happening? Should I try doing some maintenance for the SQL database, could be from there? What can I do about it? Link to comment Share on other sites More sharing options...
Marc Stridgen Posted January 4 Share Posted January 4 Disable all 3rd party first of all, including theme and any ads, then test again. If you still have the issue, then yes generally mysql will be the main cause. Starting slow query logging to pinpoint where exactly the issue is may be a good start. Consult with your hosting company on that Link to comment Share on other sites More sharing options...
dutchsnowden Posted January 4 Author Share Posted January 4 16 minutes ago, Marc Stridgen said: Disable all 3rd party first of all, including theme and any ads, then test again. I have zero 3rd party, zero ads. ZERO. works perfectly blazigly fast for 1h, then suddenly nothing works for another hour. Link to comment Share on other sites More sharing options...
dutchsnowden Posted January 4 Author Share Posted January 4 mysqlcheck on the database gives all tables OK. Link to comment Share on other sites More sharing options...
Marc Stridgen Posted January 4 Share Posted January 4 If its happening after an hour of it running and then suddenly having issues, then yes you would certainly need to contact your hosting company on this Link to comment Share on other sites More sharing options...
dutchsnowden Posted January 4 Author Share Posted January 4 How can I show them something that is wrong? Investigate and show them some proof the issue is from them? Link to comment Share on other sites More sharing options...
Marc Stridgen Posted January 4 Share Posted January 4 Only you can really answer the first question, as I dont know what it is you are doing at the time. In terms of proof, things are either slow or they arent really. If its slow then fast then slow then fast, the software of course hasnt changed in that time. Performance issues tend to be server related in almost all cases dutchsnowden 1 Link to comment Share on other sites More sharing options...
dutchsnowden Posted January 4 Author Share Posted January 4 Thank you @Marc Stridgen as always! Link to comment Share on other sites More sharing options...
dutchsnowden Posted January 9 Author Share Posted January 9 Just so I don't leave the situation w/o a resolution. This was in my apache2 server configuration file. # prefork MPM # StartServers: number of server processes to start # MinSpareServers: minimum number of server processes which are kept spare # MaxSpareServers: maximum number of server processes which are kept spare # MaxRequestWorkers: maximum number of server processes allowed to start # MaxConnectionsPerChild: maximum number of requests a server process serves <IfModule mpm_prefork_module> StartServers 5 MinSpareServers 5 MaxSpareServers 10 MaxRequestWorkers 150 MaxConnectionsPerChild 0 </IfModule> # vim: syntax=apache ts=4 sw=4 sts=4 sr noet after I dramatically modified them to this: # prefork MPM # StartServers: number of server processes to start # MinSpareServers: minimum number of server processes which are kept spare # MaxSpareServers: maximum number of server processes which are kept spare # MaxRequestWorkers: maximum number of server processes allowed to start # MaxConnectionsPerChild: maximum number of requests a server process serves <IfModule mpm_prefork_module> StartServers 20 MinSpareServers 20 MaxSpareServers 40 MaxRequestWorkers 1500 MaxConnectionsPerChild 1000 ServerLimit 2000 </IfModule> # vim: syntax=apache ts=4 sw=4 sts=4 sr noet Server went back to blazingly fast. In the end found out bytedance/bytespider chinese bots were killing the server w/o pretty much no warning or errors. In the end I have found a MaxRequestWorkers too low error. Then I banned from a firewall bytedance/bytespider bots. And now if I could only ban yandex bots I'd be a happy camper. AlexWebsites 1 Link to comment Share on other sites More sharing options...
Marc Stridgen Posted January 10 Share Posted January 10 Thank you for sharing dutchsnowden 1 Link to comment Share on other sites More sharing options...
loccom Posted February 10 Share Posted February 10 @dutchsnowden Hey bud, how did you get rid of the bytedance in the end?.. finding it hard to get rid of and causing me no end of problems. thanks Link to comment Share on other sites More sharing options...
dutchsnowden Posted February 10 Author Share Posted February 10 I host my server with Hetzner. They have a very basic firewall and picked up from logs the bytedance ip addresses (which were not so many) and blocked them in the hetzner firewall. I am not so happy with this solution but as a temporary step it works for now. I need to really install a good firewall with ip geocoding and everything. Link to comment Share on other sites More sharing options...
loccom Posted February 10 Share Posted February 10 1 minute ago, dutchsnowden said: I host my server with Hetzner. They have a very basic firewall and picked up from logs the bytedance ip addresses (which were not so many) and blocked them in the hetzner firewall. I am not so happy with this solution but as a temporary step it works for now. I need to really install a good firewall with ip geocoding and everything. ok bud.. i seem to have too many ip's and read they piggy back many networks including amazon aws. so its tricky. having 15 forums you can imagine they are everywhere, so need a proper solution. I have banned off ahref bot as well.. they are really bad for me. Just researching CleanTalk app which plugs in to the communties, noticed they have a firewall solution so may look in to that Link to comment Share on other sites More sharing options...
dutchsnowden Posted February 10 Author Share Posted February 10 Yes, they are a plague. For the moment my forum works ok, but I am too interested in finding a proper solution to this disease. So please come back and post if you find anything. To be honest, my server was swamped until I did this: Now even they are hitting me pretty hard seems that the hardware is handling it well, so I am waiting a better solution to completely ban the chinese plague out of my server. Link to comment Share on other sites More sharing options...
loccom Posted February 10 Share Posted February 10 i gave fiddled witht he prefork a couple of times carefully.. may give it another go as our server is pretty big should be able to handle quite a bit. Cleantalk we have banned out certain countreis from registering, that worked a treat and now get very little RU and CN if any. But need to ban them out from the server completely. Will have a go this afternoon and see how it goes. dutchsnowden 1 Link to comment Share on other sites More sharing options...
dutchsnowden Posted February 10 Author Share Posted February 10 What exactly is Cleantalk? I want also to ban everything CN and RU on my server. Link to comment Share on other sites More sharing options...
Marc Stridgen Posted February 12 Share Posted February 12 On 2/10/2024 at 12:45 PM, dutchsnowden said: ......I want also to ban everything CN and RU on my server. If you go to Members->Content Moderation->Spam Prevention->Geolocation settings, you can add countries in there that you wish to disallow. Link to comment Share on other sites More sharing options...
Alexandru Posted February 12 Share Posted February 12 (edited) Hey ! I encountered the same problem with AJAX Loading, and I looked everywhere from what It could be, nothing on the server side, nothing in settings. But by updating the version the problem fixed itself. Try upgrading your version and check again. Edited February 12 by Alexandru Link to comment Share on other sites More sharing options...
dutchsnowden Posted February 12 Author Share Posted February 12 7 hours ago, Marc Stridgen said: If you go to Members->Content Moderation->Spam Prevention->Geolocation settings, you can add countries in there that you wish to disallow. Nah, @Marc Stridgen this is for registration. Chinese bots never register, they just flood the server with request and do not respect robots.txt or any rules. Download all photos, everything. They don't care to register, they just flood it as guests. Link to comment Share on other sites More sharing options...
Jim M Posted February 12 Share Posted February 12 3 minutes ago, dutchsnowden said: Nah, @Marc Stridgen this is for registration. Chinese bots never register, they just flood the server with request and do not respect robots.txt or any rules. Download all photos, everything. They don't care to register, they just flood it as guests. You'd want to block this at the server or network-level then if you're seeing this from a particular set of bots. Link to comment Share on other sites More sharing options...
dutchsnowden Posted February 12 Author Share Posted February 12 Exactly what I was saying above. Link to comment Share on other sites More sharing options...
Recommended Posts