LiveG

Update: it 100% DDOS attack. we will resolve it in our security infrastructure.

Thank you everyone. At this moment it looks like DDOS attack. i will update.

From the last crash: [31-Mar-2024 18:13:54] WARNING: [pool www] seems busy (you may need to increase pm.start_servers, or pm.min/max_spare_servers), spawning 8 children, there are 999 idle, and 1010 total children I increase it all values dramatically, and the site still crashing..i dont understand what is going on

I have total 10240 MB of RAM. [31-Mar-2024 15:00:33] WARNING: [pool www] seems busy (you may need to increase pm.start_servers, or pm.min/max_spare_servers), spawning 32 children, there are 0 idle, and 57 total children [31-Mar-2024 15:28:46] NOTICE: exiting, bye-bye! Something i don't understand, the command you gave me show this path: /etc/php/8.0/fpm/php-fpm.conf But when i want to edit this file - i don't see all the parameter option to edit https://ibb.co/THYjxVV i can see only process.max ( i have enlarge it from 128 to 640) On the other and, when i enter /etc/php/8.0/fpm/php-fpm.conf /pool.d/wwwconf i Can see all the parameter to edit https://ibb.co/tc7vmpJ Which file should i edit?

@Randy Calvert Thank you. This is are the parameter: pm.max_children = 50000 pm.start_servers = 2 pm.min_spare_servers = 3 pm.max_spare_servers = 3 pm.max_requests = 500 How should i know the recommended value?

We start to believe its an some kind of attack

Thank you @Randy Calvert Log for php8.0-fpm in the last crash, i need to take care of it, HOPE IT WILL HELP [29-Mar-2024 22:31:09] WARNING: [pool www] seems busy (you may need to increase pm.start_servers, or pm.min/max_spare_servers), spawning 8 children, there are 0 idle, and 6 total children [29-Mar-2024 22:31:26] WARNING: [pool www] seems busy (you may need to increase pm.start_servers, or pm.min/max_spare_servers), spawning 16 children, there are 0 idle, and 7 total children [29-Mar-2024 22:31:48] WARNING: [pool www] seems busy (you may need to increase pm.start_servers, or pm.min/max_spare_servers), spawning 32 children, there are 0 idle, and 8 total children [29-Mar-2024 22:32:04] WARNING: [pool www] seems busy (you may need to increase pm.start_servers, or pm.min/max_spare_servers), spawning 32 children, there are 0 idle, and 9 total children [29-Mar-2024 22:32:06] WARNING: [pool www] seems busy (you may need to increase pm.start_servers, or pm.min/max_spare_servers), spawning 32 children, there are 0 idle, and 10 total children [29-Mar-2024 22:32:10] WARNING: [pool www] seems busy (you may need to increase pm.start_servers, or pm.min/max_spare_servers), spawning 32 children, there are 0 idle, and 11 total children [29-Mar-2024 22:32:13] WARNING: [pool www] seems busy (you may need to increase pm.start_servers, or pm.min/max_spare_servers), spawning 32 children, there are 0 idle, and 12 total children [29-Mar-2024 22:32:23] WARNING: [pool www] seems busy (you may need to increase pm.start_servers, or pm.min/max_spare_servers), spawning 32 children, there are 0 idle, and 13 total children [29-Mar-2024 22:32:49] WARNING: [pool www] seems busy (you may need to increase pm.start_servers, or pm.min/max_spare_servers), spawning 32 children, there are 0 idle, and 14 total children [29-Mar-2024 22:54:45] WARNING: [pool www] seems busy (you may need to increase pm.start_servers, or pm.min/max_spare_servers), spawning 8 children, there are 0 idle, and 6 total children

These .gz record real-time logs? Another update: the forum doesn't crash when it is in maintenance mode all day (dark for community) ; only when I open it to public it crash after couple of hours. I think this is related to the latest software version IPB has been released.

After many investigations, my server resources (CPU and RAM) suddenly skyrocketed and crashed the server. I want to record logs to a text file for investigation purposes, Please help me better understand which log I should record for the root cause undersatnding. Is it dmesg (displays kernel-related messages) ?

Is it safe to share them here? Which log in the picture attached should i tail -f when my site crashes in order to see the root cause? https://ibb.co/6XSWF6y

yes File systemphp version 8.0 Only when the forum is up Can anyone explain to me how to Capturing errors messages from the server (Linux) into log file? As i understood it could to the root cause of the periodic crashes

top command output https://ibb.co/pzvJxvg

Something use all of the memory in once https://ibb.co/h9M2169

Maybe i am under attack? My forum crashing in default theam as well My site is down for 2 days now🤔

Scan result: clean

did it.switch to my theme , few minutes later my forum crash with no system error log at all. 😞 God knows what the reason is

It's looking to appear only in front/forums/global/row. It's related to the Mark app- i think, which is no longer supported. But all the apps are disabled; why does the site keep crashing? https://ibb.co/wN4DPDv

needed to stop and run the server to make it work again in the default theme; it was not an issue with the default theme. I turned off all the apps and switched to my elegant theme, and I instantly started getting system errors; if I kept this error going for a few minutes, my forum would crash. I quickly switched back to the default theme, and the error stopped. I fond a different from default in the front/forums/global/row template, but i don't know if its related. https://ibb.co/TKjJKQv I am willing to pay developers to help escape this mess. Please pm me Error: Call to undefined method IPS\forums\Forum::hasMarkers() in /var/www/html/system/Theme/Theme.php(885) : eval()'d code:821 Stack trace: #0 /var/www/html/system/Theme/SandboxedTemplate.php(61): IPS\Theme\class_forums_front_global->row() #1 /var/www/html/system/Theme/Theme.php(885) : eval()'d code(1498): IPS\Theme\_SandboxedTemplate->__call() #2 /var/www/html/system/Theme/SandboxedTemplate.php(61): IPS\Theme\class_forums_front_widgets->topicFeed() #3 /var/www/html/system/Widget/Widget.php(234): IPS\Theme\_SandboxedTemplate->__call() #4 /var/www/html/system/Content/Widget.php(532): IPS\_Widget->output() #5 /var/www/html/system/Widget/Widget.php(833): IPS\Content\_Widget->render() #6 /var/www/html/system/Widget/Widget.php(888): IPS\_Widget->_render() #7 /var/www/html/system/Theme/Theme.php(885) : eval()'d code(19278): IPS\_Widget->__toString() #8 /var/www/html/system/Theme/SandboxedTemplate.php(61): IPS\Theme\class_core_front_global->widgetContainer() #9 /var/www/html/system/Theme/Theme.php(885) : eval()'d code(7433): IPS\Theme\_SandboxedTemplate->__call() #10 /var/www/html/system/Theme/SandboxedTemplate.php(61): IPS\Theme\class_core_front_global->globalTemplate() #11 /var/www/html/system/Dispatcher/Dispatcher.php(173): IPS\Theme\_SandboxedTemplate->__call() #12 /var/www/html/system/Dispatcher/Standard.php(113): IPS\_Dispatcher->finish() #13 /var/www/html/system/Dispatcher/Front.php(558): IPS\Dispatcher\_Standard->finish() #14 /var/www/html/system/Dispatcher/Dispatcher.php(155): IPS\Dispatcher\_Front->finish() #15 /var/www/html/index.php(13): IPS\_Dispatcher->run() #16 {main} Backtrace #0 /var/www/html/system/Theme/SandboxedTemplate.php(71): IPS\_Log::log() #1 /var/www/html/system/Theme/Theme.php(885) : eval()'d code(1498): IPS\Theme\_SandboxedTemplate->__call() #2 /var/www/html/system/Theme/SandboxedTemplate.php(61): IPS\Theme\class_forums_front_widgets->topicFeed() #3 /var/www/html/system/Widget/Widget.php(234): IPS\Theme\_SandboxedTemplate->__call() #4 /var/www/html/system/Content/Widget.php(532): IPS\_Widget->output() #5 /var/www/html/system/Widget/Widget.php(833): IPS\Content\_Widget->render() #6 /var/www/html/system/Widget/Widget.php(888): IPS\_Widget->_render() #7 /var/www/html/system/Theme/Theme.php(885) : eval()'d code(19278): IPS\_Widget->__toString() #8 /var/www/html/system/Theme/SandboxedTemplate.php(61): IPS\Theme\class_core_front_global->widgetContainer() #9 /var/www/html/system/Theme/Theme.php(885) : eval()'d code(7433): IPS\Theme\_SandboxedTemplate->__call() #10 /var/www/html/system/Theme/SandboxedTemplate.php(61): IPS\Theme\class_core_front_global->globalTemplate() #11 /var/www/html/system/Dispatcher/Dispatcher.php(173): IPS\Theme\_SandboxedTemplate->__call() #12 /var/www/html/system/Dispatcher/Standard.php(113): IPS\_Dispatcher->finish() #13 /var/www/html/system/Dispatcher/Front.php(558): IPS\Dispatcher\_Standard->finish() #14 /var/www/html/system/Dispatcher/Dispatcher.php(155): IPS\Dispatcher\_Front->finish() #15 /var/www/html/index.php(13): IPS\_Dispatcher->run() #16 {main}

At the moment its happening with the default team,every app disabled. no server resourced issues- community is offline. rested the server, doesn't help 🙄 System, logs OutOfRangeException: (0) #0 /var/www/html/system/Theme/Theme.php(401): IPS\Patterns\_ActiveRecord::load() #1 /var/www/html/applications/core/sources/ProfileFields/Field.php(150): IPS\_Theme::i() #2 /var/www/html/applications/core/sources/ProfileFields/Field.php(374): IPS\core\ProfileFields\_Field->displayValue() #3 /var/www/html/system/Member/Member.php(2247): IPS\core\ProfileFields\_Field::values() #4 /var/www/html/applications/core/extensions/core/MemberFilter/ProfileFields.php(309): IPS\_Member->profileFields() #5 /var/www/html/system/Member/GroupPromotion.php(319): IPS\core\extensions\core\MemberFilter\_ProfileFields->matches() #6 /var/www/html/system/Member/Member.php(4453): IPS\Member\_GroupPromotion->matches() #7 /var/www/html/system/Member/Member.php(445): IPS\_Member->checkGroupPromotion() #8 /var/www/html/system/Theme/Theme.php(353): IPS\_Member->save() #9 /var/www/html/system/Dispatcher/Standard.php(54): IPS\_Theme::i() #10 /var/www/html/system/Dispatcher/Front.php(759): IPS\Dispatcher\_Standard::baseCss() #11 /var/www/html/init.php(934) : eval()'d code(16): IPS\Dispatcher\_Front::baseCss() #12 /var/www/html/init.php(934) : eval()'d code(28): IPS\Dispatcher\chatbox_hook_Dispatcher_Front::baseCss() #13 /var/www/html/system/Dispatcher/Front.php(76): IPS\Dispatcher\marktopic_hook_code_dispatcher_front::baseCss() #14 /var/www/html/system/Dispatcher/Dispatcher.php(110): IPS\Dispatcher\_Front->init() #15 /var/www/html/index.php(13): IPS\_Dispatcher::i() #16 {main} backtrace /var/www/html/init.php(1036): IPS\_Log::log() #1 [internal function]: IPS\IPS::exceptionHandler() #2 {main}

Thank you. I will address the author of the team!

The default theme works. my forum works with the default theme . I Have the latest update of the theme installed. path front/forums/global/row is exactly the same as default

I will try. its difficult to do as the forum is down most of the time.. I know its update template of ipb focus theme * i cant find this path forums/front/global/row

Well, Its happening all over again. my forum is down. lots of system error. apps is disabled. template caching. is disabled. Error: Call to undefined method IPS\forums\Forum::hasMarkers() in /var/www/html/system/Theme/Theme.php(885) : eval()'d code:821 Stack trace: #0 /var/www/html/system/Theme/SandboxedTemplate.php(61): IPS\Theme\class_forums_front_global->row() #1 /var/www/html/system/Theme/Theme.php(885) : eval()'d code(1498): IPS\Theme\_SandboxedTemplate->__call() #2 /var/www/html/system/Theme/SandboxedTemplate.php(61): IPS\Theme\class_forums_front_widgets->topicFeed() #3 /var/www/html/system/Widget/Widget.php(234): IPS\Theme\_SandboxedTemplate->__call() #4 /var/www/html/system/Content/Widget.php(532): IPS\_Widget->output() #5 /var/www/html/system/Widget/Widget.php(833): IPS\Content\_Widget->render() #6 /var/www/html/system/Widget/Widget.php(888): IPS\_Widget->_render() #7 /var/www/html/system/Theme/Theme.php(885) : eval()'d code(19560): IPS\_Widget->__toString() #8 /var/www/html/system/Theme/SandboxedTemplate.php(61): IPS\Theme\class_core_front_global->widgetContainer() #9 /var/www/html/system/Theme/Theme.php(885) : eval()'d code(7603): IPS\Theme\_SandboxedTemplate->__call() #10 /var/www/html/system/Theme/SandboxedTemplate.php(61): IPS\Theme\class_core_front_global->globalTemplate() #11 /var/www/html/system/Dispatcher/Dispatcher.php(173): IPS\Theme\_SandboxedTemplate->__call() #12 /var/www/html/system/Dispatcher/Standard.php(113): IPS\_Dispatcher->finish() #13 /var/www/html/system/Dispatcher/Front.php(558): IPS\Dispatcher\_Standard->finish() #14 /var/www/html/system/Dispatcher/Dispatcher.php(155): IPS\Dispatcher\_Front->finish() #15 /var/www/html/index.php(13): IPS\_Dispatcher->run() #16 {main} #0 /var/www/html/system/Theme/SandboxedTemplate.php(71): IPS\_Log::log() #1 /var/www/html/system/Theme/Theme.php(885) : eval()'d code(1498): IPS\Theme\_SandboxedTemplate->__call() #2 /var/www/html/system/Theme/SandboxedTemplate.php(61): IPS\Theme\class_forums_front_widgets->topicFeed() #3 /var/www/html/system/Widget/Widget.php(234): IPS\Theme\_SandboxedTemplate->__call() #4 /var/www/html/system/Content/Widget.php(532): IPS\_Widget->output() #5 /var/www/html/system/Widget/Widget.php(833): IPS\Content\_Widget->render() #6 /var/www/html/system/Widget/Widget.php(888): IPS\_Widget->_render() #7 /var/www/html/system/Theme/Theme.php(885) : eval()'d code(19560): IPS\_Widget->__toString() #8 /var/www/html/system/Theme/SandboxedTemplate.php(61): IPS\Theme\class_core_front_global->widgetContainer() #9 /var/www/html/system/Theme/Theme.php(885) : eval()'d code(7603): IPS\Theme\_SandboxedTemplate->__call() #10 /var/www/html/system/Theme/SandboxedTemplate.php(61): IPS\Theme\class_core_front_global->globalTemplate() #11 /var/www/html/system/Dispatcher/Dispatcher.php(173): IPS\Theme\_SandboxedTemplate->__call() #12 /var/www/html/system/Dispatcher/Standard.php(113): IPS\_Dispatcher->finish() #13 /var/www/html/system/Dispatcher/Front.php(558): IPS\Dispatcher\_Standard->finish() #14 /var/www/html/system/Dispatcher/Dispatcher.php(155): IPS\Dispatcher\_Front->finish() #15 /var/www/html/index.php(13): IPS\_Dispatcher->run() #16 {main}

This issue is resolved. Third-Party App app prevented from maintenance task to run for a few days. when disable the app, and run the task manually, every thing back to normal.

Hello, My forum crashing every few moments even when disable template caching. can you please take a look? The server resources is fine: https://ibb.co/brkn2BR Try to reboot the server, no luck.