Invision Community 4: SEO, prepare for v5 and dormant account notifications By Matt Monday at 02:04 PM
RevengeFNF Posted November 28, 2012 Posted November 28, 2012 Hello, Im running IPB on a VPS with 1GB of Ram. Until now it have run fine, but it started to become very slow. Here is the thing: I enter in the Shell and do a reboot. Servers reboots and starts with 300Mb of free ram. My site is flying in speed. After about 30 minutes or less, it only have 50Mb of free ram. My Site is still flying. Few minutes later, when it reachs 10Mb free Ram, it starts to use Swap. And its at this point, that my site starts to become realy slow. Sometime it takes a full minute to make a simples post or view new content. I can only make another reboot... But i will not make reboots every hour... What can i do? Here is the info i take from the diagnostics inside ACP. top - 02:00:35 up 37 min, 0 users, load average: 1.61, 1.23, 0.67 Tasks: 65 total, 1 running, 64 sleeping, 0 stopped, 0 zombie Cpu(s): 20.0%us, 1.6%sy, 0.0%ni, 64.2%id, 14.0%wa, 0.0%hi, 0.0%si, 0.1%st Mem: 1016636k total, 1006696k used, 9940k free, 3456k buffers Swap: 2097144k total, 13820k used, 2083324k free, 671276k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 1200 mysql 20 0 902m 184m 4308 S 65.5 18.5 3:05.72 mysqld 1368 www 20 0 554m 38m 20m S 7.9 3.9 0:03.89 php-fpm 1 root 20 0 19228 672 648 S 0.0 0.1 0:00.11 init 2 root 20 0 0 0 0 S 0.0 0.0 0:00.00 kthreadd 3 root RT 0 0 0 0 S 0.0 0.0 0:00.00 migration/0 4 root 20 0 0 0 0 S 0.0 0.0 0:00.01 ksoftirqd/0 5 root RT 0 0 0 0 S 0.0 0.0 0:00.00 migration/0 6 root RT 0 0 0 0 S 0.0 0.0 0:00.00 watchdog/0 7 root 20 0 0 0 0 S 0.0 0.0 0:00.20 events/0 8 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cgroup 9 root 20 0 0 0 0 S 0.0 0.0 0:00.00 khelper 10 root 20 0 0 0 0 S 0.0 0.0 0:00.00 netns 11 root 20 0 0 0 0 S 0.0 0.0 0:00.00 async/mgr 12 root 20 0 0 0 0 S 0.0 0.0 0:00.00 pm 13 root 20 0 0 0 0 S 0.0 0.0 0:00.00 xenwatch 14 root 20 0 0 0 0 S 0.0 0.0 0:00.00 xenbus 15 root 20 0 0 0 0 S 0.0 0.0 0:00.00 sync_supers 16 root 20 0 0 0 0 S 0.0 0.0 0:00.00 bdi-default 17 root 20 0 0 0 0 S 0.0 0.0 0:00.00 kintegrityd/0 18 root 20 0 0 0 0 S 0.0 0.0 0:00.97 kblockd/0 19 root 20 0 0 0 0 S 0.0 0.0 0:00.00 ata/0 20 root 20 0 0 0 0 S 0.0 0.0 0:00.00 ata_aux 21 root 20 0 0 0 0 S 0.0 0.0 0:00.00 ksuspend_usbd 22 root 20 0 0 0 0 S 0.0 0.0 0:00.00 khubd 23 root 20 0 0 0 0 S 0.0 0.0 0:00.00 kseriod 24 root 20 0 0 0 0 S 0.0 0.0 0:00.00 md/0 25 root 20 0 0 0 0 S 0.0 0.0 0:00.00 md_misc/0 26 root 20 0 0 0 0 S 0.0 0.0 0:00.00 khungtaskd 27 root 20 0 0 0 0 S 0.0 0.0 0:00.50 kswapd0 28 root 25 5 0 0 0 S 0.0 0.0 0:00.00 ksmd 29 root 20 0 0 0 0 S 0.0 0.0 0:00.00 aio/0 30 root 20 0 0 0 0 S 0.0 0.0 0:00.00 crypto/0 35 root 20 0 0 0 0 S 0.0 0.0 0:00.00 kthrotld/0 37 root 20 0 0 0 0 S 0.0 0.0 0:00.00 khvcd 38 root 20 0 0 0 0 S 0.0 0.0 0:00.00 kpsmoused 39 root 20 0 0 0 0 S 0.0 0.0 0:00.00 usbhid_resumer 197 root 20 0 0 0 0 S 0.0 0.0 0:00.47 kjournald 262 root 16 -4 10784 256 256 S 0.0 0.0 0:00.02 udevd 485 root 18 -2 10780 240 240 S 0.0 0.0 0:00.00 udevd 488 root 20 0 0 0 0 S 0.0 0.0 0:00.00 kstriped 545 root 20 0 0 0 0 S 0.0 0.0 0:00.00 kauditd 692 root 16 -4 27636 504 468 S 0.0 0.0 0:00.00 auditd 708 root 20 0 243m 592 592 S 0.0 0.1 0:00.00 rsyslogd 736 root 20 0 0 0 0 S 0.0 0.0 0:00.03 flush-202:1 747 root 20 0 192m 1216 768 S 0.0 0.1 0:00.32 snmpd 758 root 20 0 64072 376 308 S 0.0 0.0 0:00.00 sshd 766 ntp 20 0 30160 1004 868 S 0.0 0.1 0:00.01 ntpd 777 root 20 0 52060 180 180 S 0.0 0.0 0:00.00 vsftpd 791 root 20 0 105m 640 640 S 0.0 0.1 0:00.04 mysqld_safe 1234 exim 20 0 91052 1376 504 S 0.0 0.1 0:00.00 exim 1243 root 20 0 44632 1148 240 S 0.0 0.1 0:00.00 nginx 1245 www 20 0 46080 3152 836 S 0.0 0.3 0:01.82 nginx 1252 root 20 0 114m 1164 564 S 0.0 0.1 0:00.00 crond 1261 root 20 0 539m 4136 988 S 0.0 0.4 0:00.13 php-fpm 1270 root 20 0 4060 496 416 S 0.0 0.0 0:00.00 mingetty 1272 root 20 0 4060 500 416 S 0.0 0.0 0:00.00 mingetty 1274 root 20 0 4060 496 416 S 0.0 0.0 0:00.00 mingetty 1276 root 20 0 4060 500 416 S 0.0 0.0 0:00.00 mingetty 1278 root 20 0 4060 500 416 S 0.0 0.0 0:00.00 mingetty 1280 root 20 0 4060 496 416 S 0.0 0.0 0:00.00 mingetty 1366 www 20 0 554m 43m 27m S 0.0 4.4 0:07.17 php-fpm 1367 www 20 0 556m 47m 27m S 0.0 4.8 0:10.01 php-fpm 1369 www 20 0 553m 29m 12m S 0.0 3.0 0:00.19 php-fpm 1370 www 20 0 548m 23m 11m S 0.0 2.4 0:00.21 php-fpm 1373 www 20 0 14888 1112 872 R 0.0 0.1 0:00.00 top I rebooted my server one hour ago. As you can see, its already using the swap memory.
Mack_au Posted November 28, 2012 Posted November 28, 2012 My site is using massive amounts of CPU now for some reason. I've lost members, certain bbcodes have stopped working. Very dodgy upgrade.
Dmacleo Posted November 28, 2012 Posted November 28, 2012 iirc, and I may be wrong, someone else had been trying php-fpm with board and saw sluggish issues. maybe something there?
TracyIsland Posted November 28, 2012 Posted November 28, 2012 how many hooks do you have? not that this is a critique at all ... just wondering ... since another post in another topic mused that 100 hooks would make anyone site's slow ... when perhaps the coding change in the 3.4.0 upgrade has some hidden poison that activates for those who have a lot of hooks.
RevengeFNF Posted November 28, 2012 Author Posted November 28, 2012 how many hooks do you have? not that this is a critique at all ... just wondering ... since another post in another topic mused that 100 hooks would make anyone site's slow ... when perhaps the coding change in the 3.4.0 upgrade has some hidden poison that activates for those who have a lot of hooks. I only have 4 Hooks. The same ones that i used in previous versions.
TracyIsland Posted November 28, 2012 Posted November 28, 2012 I have 14. well, there goes that theory ... I have 55? I think ...
Mack_au Posted November 28, 2012 Posted November 28, 2012 There is definitely a problem for me. My site is getting slammed on CPU usage. Yesterday (and every day basically for the last month): Today (upgrade was performed early this morning): There has been no user spike.
Rimi Posted November 28, 2012 Posted November 28, 2012 Just submit a ticket so IPS can look at it directly.
RevengeFNF Posted November 28, 2012 Author Posted November 28, 2012 I got this spike just few seconds ago: PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 1200 mysql 20 0 902m 183m 4152 S 69.6 18.5 114:08.42 mysqld Is this normal mysql process wasting 70% of the Cpu?
RevengeFNF Posted November 28, 2012 Author Posted November 28, 2012 My forum is pretty unusable at this moment... I have dozens of members complaining about that.
nylyon Posted November 28, 2012 Posted November 28, 2012 What is mysql doing? You can login to mysql and do: >show processlist; That should give more details on what it's doing.
RevengeFNF Posted November 28, 2012 Author Posted November 28, 2012 What is mysql doing? You can login to mysql and do: >show processlist; That should give more details on what it's doing. Id User Host db Command Time State Info 1740 fastnews localhost forum Query 3 Sending data INSERT INTO ibf_backup_queue (queue_entry_date, queue_entry_type, queue_entry_table, queue_entry_key 1820 fastnews localhost forum Query 14 Sending data SELECT author_id, topic_id FROM ibf_posts WHERE queued=0 AND author_id=26003 AND topic_id IN(58810 1838 fastnews localhost forum Query 0 SHOW PROCESSLIST Id User Host db Command Time State Info 1976 fastnews localhost forum Query 14 Sending data INSERT INTO ibf_backup_queue (queue_entry_date, queue_entry_type, queue_entry_table, queue_entry_key 2065 fastnews localhost forum Query 10 Sending data SELECT author_id, topic_id FROM ibf_posts WHERE queued=0 AND author_id=13904 AND topic_id IN(4362, 2077 fastnews localhost forum Query 0 Sending data SELECT p.*,m.member_id as mid,m.name,m.member_group_id,m.email,m.joined,m.po sts, m.last_visit, m.las 2079 fastnews localhost forum Query 0 SHOW PROCESSLIST Id User Host db Command Time State Info 2970 fastnews localhost forum Query 0 Sending data INSERT INTO ibf_backup_queue (queue_entry_date, queue_entry_type, queue_entry_table, queue_entry_key 2998 fastnews localhost forum Query 0 Sending data SELECT count(*) as cnt FROM ibf_attachments a LEFT JOIN ibf_posts p ON ( p.pid=a.attach_rel_id ) 3002 fastnews localhost forum Query 29 statistics SELECT author_id, topic_id FROM ibf_posts WHERE queued=0 AND author_id=26035 AND topic_id IN(49610 3007 fastnews localhost forum Sleep 0 3008 fastnews localhost forum Query 24 statistics SELECT author_id, topic_id FROM ibf_posts WHERE queued=0 AND author_id=26035 AND topic_id IN(49610 3011 fastnews localhost forum Query 0 SHOW PROCESSLIST 3019 fastnews localhost forum Sleep 0 What is the Table ibf_backup_queue?
nylyon Posted November 28, 2012 Posted November 28, 2012 My test system has no users, I don't see that process running and the backup_queue table is empty. Obviously yours is getting populated, how many rows does it have? [url= wonder if this has anything to do with it? Did you upgrade from a beta version? Perhaps it was enabled in beta then never got disabled with the actual upgrade? I really have no clue just speculating. It would probably be best to open a ticket with the information you have. If you do, please post what if found.
RevengeFNF Posted November 28, 2012 Author Posted November 28, 2012 My test system has no users, I don't see that process running and the backup_queue table is empty. Obviously yours is getting populated, how many rows does it have? I wonder if this has anything to do with it? Did you upgrade from a beta version? Perhaps it was enabled in beta then never got disabled with the actual upgrade? I really have no clue just speculating. It would probably be best to open a ticket with the information you have. If you do, please post what if found. It has some Millions of Rows. Is the Table with more Rows in my DB. I upgraded from 3.3.4. Yep, i have already a ticket opened with this issue.
nylyon Posted November 28, 2012 Posted November 28, 2012 You should open a ticket for support with this information.
nylyon Posted November 28, 2012 Posted November 28, 2012 Check your batch scheduler. I just ran this: "Back Up Batch Send" and now that table is populated. My entry is not scheduled so it shouldn't run, is yours scheduled?
LinkMania Posted November 28, 2012 Posted November 28, 2012 It has some Millions of Rows. Is the Table with more Rows in my DB. I upgraded from 3.3.4. Yep, i have already a ticket opened with this issue. same here, from 3.3.4 to 3.4 last night, same problem on a dual xeon 2.5 ghz with 8 gb ram: # Time: 121128 16:19:41 # User@Host: forum[forum] @ localhost [] # Query_time: 62.755063 Lock_time: 0.001493 Rows_sent: 0 Rows_examined: 4998512 SET timestamp=1354112381; INSERT INTO ibf_backup_queue (queue_entry_date, queue_entry_type, queue_entry_table, queue_entry_key, queue_entry_value, queue_entry_sql)( SELECT UNIX_TIMESTAMP(), 1, 'ibf_reputation_totals', 'rt_key', rt_key, '' FROM ibf_reputation_totals );
Mack_au Posted November 28, 2012 Posted November 28, 2012 That item was listed as running 'every minute' on my schedule list. I just disabled it.
nylyon Posted November 28, 2012 Posted November 28, 2012 [url='s an update to 3.4.0 which likely addresses this issue
nylyon Posted November 28, 2012 Posted November 28, 2012 I wonder if there's a cleanup routine to remove the data which was inadvertently added to the tables?
Mack_au Posted November 28, 2012 Posted November 28, 2012 The back-up initialisation task can run daily which can affect performance on larger boards Daily!? It's not even meant to run daily! Mine was running every minute!
Dmacleo Posted November 28, 2012 Posted November 28, 2012 Daily!? It's not even meant to run daily! Mine was running every minute! thats what mine was set to also. I disabled it just now.
RevengeFNF Posted November 28, 2012 Author Posted November 28, 2012 That item was listed as running 'every minute' on my schedule list. I just disabled it. Did it works, or you still having the Cpu spikes?
nylyon Posted November 28, 2012 Posted November 28, 2012 I don't know enough about mysql, but it's possible that it needs to be recycled to clean everything up (ie buffers, release memory etc)
Recommended Posts
Archived
This topic is now archived and is closed to further replies.