Gauravk

Posted April 19, 2020 · April 19, 2020

Thanks a lot @newbie LAC, for great teaching patience and help over the PM.

Have a nice day.

Posted April 16, 2020 · April 16, 2020

Hi @newbie LAC may I please have a new script for extracting all member who joined for car problem and solution.

Fields needed: email phone first name last name zip city country gender

elCheckbox_core_pfield_22_0

Thanks in advance

April 13, 2020

6 minutes ago, Eudemon said:

two things, enough people interested in it, and the IPS dev does not have plan to implement it

Hope you understand that latter comes with indefinite tense. It can be 1 day to 10 years..................................!

People crying on other thread since 2018 about IPS to give some love to subscription and they dont even acknowledge such post let alone giving some love.

Appreciate if you can be open with your expected number of people interested, so that I can do something to gather that interest for common good or ditch IPS dreams completely.

April 12, 2020

I understand your concern @Eudemon.

As a developer if you have enough taker will that interest you....?

April 12, 2020

4 minutes ago, Eudemon said:

if you get official response they won't be adding this, i might be able to write a plugin

That will be fantastic. Are you also able to add these tabs:

Multiple renewal option in same place - Monthly and Yearly (MOST IMPORTANT)
Custom email (very important)
Client area settings (important)

I'm ready to pay in advance if you can make this plugin, irrespective of the official answer as even if that is positive they will take some time for these enhancements.

April 12, 2020

1 minute ago, Eudemon said:

technically if you set a coupon to apply to all product, then it can be applied to subscription

This is exactly creating an above error.

Tom S. · April 12, 2020

Just like the products in commerce, subscription should also have these features enabled.

Discounts
Coupon code (not working with subscriptions, throwing gateway error)
Multiple renewal option in same place - Monthly and Yearly
Client area settings
Custom email

Throws this gateway error only if coupon code is used.

April 6, 2020

10 hours ago, Katherine Grace Bond said:

I think we are having the same problem with our product setup. We can set up recurring payments, but evidently, they recur forever unless we go into each individual customer's purchase and set an expiration date. We would like very much to build into the product a set number of payments. (Field: How many payments) We've been told this is not possible. I'm not sure why.

As our customer base increases, we are seriously considering other platform options, as it would be too easy to miss manually adding expiry dates for each customer. Charging the customer after the agreed-upon time is enough of a trust issue that we would soon begin losing return customers.

Is this fixable?

We are facing the same issue but from another angle that also shows a down side.

When we tell user it's monthly payment without auto-renewal we still loose 90% of new sign up as people are scared of monthly commitments.

I really hope and request IPB to add expiry in one-time subscription, asap please.

April 5, 2020

Any update on this request?

April 4, 2020

Any clue what these three scripts doing with such a small size but huge waiting time as oppose to 80+ other scripts?

Which app, module, or function uses them?

Appreciate any clue to optimize this.

Thanks in advance.

root_map = 1.3 KB size - 1.31 seconds wait time.

global_global_core = 8 KB size - 689 ms wait time.

manifest.webmanifest = 831bytes size - 713 ms wait time

April 2, 2020

44K slow queries in 12 hours

-------- Performance Metrics -------------------------------------------------
[--] Up for: 12h 34m 35s (6M q [134.405 qps], 49K conn, TX: 51B, RX: 5B)
[--] Reads / Writes: 88% / 12%
[--] Total buffers: 7.3G global + 4.6M per thread (500 max threads)
[OK] Maximum possible memory usage: 9.5G (30% of installed RAM)
[OK] Slow queries: 0% (44K/6M)
[OK] Highest usage of available connections: 9% (45/500)
[OK] Key buffer size / total MyISAM indexes: 4.0G/204.4M
[OK] Key buffer hit rate: 100.0% (143M cached / 29K reads)
[OK] Query cache efficiency: 90.7% (5M cached / 5M selects)
[!!] Query cache prunes per day: 406082
[OK] Sorts requiring temporary tables: 0% (435 temp sorts / 44K sorts)
[!!] Joins performed without indexes: 391
[OK] Temporary tables created on disk: 4% (6K on disk / 133K total)
[OK] Thread cache hit rate: 99% (45 created / 49K connections)
[OK] Table cache hit rate: 61% (9K open / 14K opened)
[OK] Open file limit used: 18% (5K/32K)
[OK] Table locks acquired immediately: 99% (733K immediate / 734K locks)
[OK] InnoDB buffer pool / data size: 1.0G/34.9M
[OK] InnoDB log waits: 0

April 1, 2020

Edit: 2K in 1 hour

-------- Performance Metrics -------------------------------------------------
[--] Up for: 59m 4s (406K q [114.568 qps], 4K conn, TX: 3B, RX: 337M)
[--] Reads / Writes: 90% / 10%
[--] Total buffers: 7.3G global + 4.6M per thread (500 max threads)
[OK] Maximum possible memory usage: 9.5G (30% of installed RAM)
[OK] Slow queries: 0% (2K/406K)
[OK] Highest usage of available connections: 6% (34/500)
[OK] Key buffer size / total MyISAM indexes: 4.0G/204.0M
[OK] Key buffer hit rate: 99.9% (11M cached / 13K reads)
[OK] Query cache efficiency: 87.2% (334K cached / 383K selects)
[OK] Query cache prunes per day: 0
[OK] Sorts requiring temporary tables: 1% (56 temp sorts / 3K sorts)
[!!] Joins performed without indexes: 34
[OK] Temporary tables created on disk: 3% (356 on disk / 11K total)
[OK] Thread cache hit rate: 99% (34 created / 4K connections)
[OK] Table cache hit rate: 72% (11K open / 15K opened)
[OK] Open file limit used: 19% (6K/32K)
[OK] Table locks acquired immediately: 99% (65K immediate / 65K locks)
[OK] InnoDB buffer pool / data size: 1.0G/34.9M
[OK] InnoDB log waits: 0

April 1, 2020

Help needed in understanding what is causing these slow queries?

Over 3K entries in 3-4 hours. Below is a small sample of last couple of pages.

Also its logging queries without index.

# User@Host: dummyname @ localhost []  Id:  3311
# Query_time: 0.000907  Lock_time: 0.000018 Rows_sent: 1  Rows_examined: 17231
SET timestamp=1585763412;
/*IPS\Patterns\hook543::load:17*/ SELECT * FROM `membersshop_points` WHERE `member_id`=10282;
# Time: 2020-04-01T17:50:13.927016Z
# User@Host: dummyname @ localhost []  Id:  3312
# Query_time: 0.021526  Lock_time: 0.000124 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763413;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:50:15.833196Z
# User@Host: dummyname @ localhost []  Id:  3313
# Query_time: 0.021612  Lock_time: 0.000125 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763415;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:50:16.345437Z
# User@Host: dummyname @ localhost []  Id:  3314
# Query_time: 0.021635  Lock_time: 0.000131 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763416;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:50:17.644784Z
# User@Host: dummyname @ localhost []  Id:  3316
# Query_time: 0.021781  Lock_time: 0.000117 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763417;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:50:19.440366Z
# Time: 2020-04-01T17:49:59.364806Z
# User@Host: dummyname @ localhost []  Id:  3296
# Query_time: 0.000894  Lock_time: 0.000017 Rows_sent: 1  Rows_examined: 17231
SET timestamp=1585763399;
/*IPS\Patterns\hook543::load:17*/ SELECT * FROM `membersshop_points` WHERE `member_id`=27208;
# Time: 2020-04-01T17:50:00.221319Z
# User@Host: dummyname @ localhost []  Id:  3297
# Query_time: 0.021762  Lock_time: 0.000126 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763400;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:50:00.421537Z
# User@Host: dummyname @ localhost []  Id:  3298
# Query_time: 0.021629  Lock_time: 0.000126 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763400;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:50:02.321192Z
# User@Host: dummyname @ localhost []  Id:  3300
# Query_time: 0.021604  Lock_time: 0.000125 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763402;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:50:03.609614Z
# User@Host: dummyname @ localhost []  Id:  3301
# Query_time: 0.021593  Lock_time: 0.000127 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763403;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:49:46.147596Z
# User@Host: dummyname @ localhost []  Id:  3285
# Query_time: 0.023963  Lock_time: 0.000120 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763386;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:49:46.209695Z
# User@Host: dummyname @ localhost []  Id:  3286
# Query_time: 0.022603  Lock_time: 0.000127 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763386;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:49:48.935601Z
# User@Host: dummyname @ localhost []  Id:  3288
# Query_time: 0.021588  Lock_time: 0.000123 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763388;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:49:52.228132Z
# User@Host: dummyname @ localhost []  Id:  3289
# Query_time: 0.022334  Lock_time: 0.000123 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763392;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:49:52.480006Z
SET timestamp=1585763368;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:49:30.832373Z
# User@Host: dummyname @ localhost []  Id:  3269
# Query_time: 0.021494  Lock_time: 0.000130 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763370;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:49:33.366652Z
# User@Host: dummyname @ localhost []  Id:  3270
# Query_time: 0.021650  Lock_time: 0.000125 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763373;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:49:34.140295Z
# User@Host: dummyname @ localhost []  Id:  3271
# Query_time: 0.021545  Lock_time: 0.000125 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763374;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:49:35.683698Z
# User@Host: dummyname @ localhost []  Id:  3274
# Query_time: 0.021548  Lock_time: 0.000119 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763375;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:49:37.461513Z
# User@Host: dummyname @ localhost []  Id:  3276
# Query_time: 0.000084  Lock_time: 0.000022 Rows_sent: 0  Rows_examined: 26
SET timestamp=1585763377;
/*IPS\Http\Url\cms_hook_FriendlyUrl::createFriendlyUrlFromComponents:55*/ SELECT store_current_id FROM `cms_url_store` WHERE store_type='page' and store_path='fbclid=IwAR16ELYSJqeQ0TjcQoAaPOQFNEZDw6C2zfGHKAtHwPCToBE5SILpAsvUtWI';
# Time: 2020-04-01T17:49:37.753534Z
# User@Host: dummyname @ localhost []  Id:  3277
# Query_time: 0.022480  Lock_time: 0.000120 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763377;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:49:37.862450Z
# User@Host: dummyname @ localhost []  Id:  3276
# Query_time: 0.027804  Lock_time: 0.000059 Rows_sent: 6  Rows_examined: 18532
SET timestamp=1585763377;
/*IPS\Theme\Cache\class_membersshop_front_widgets::mostpoints:61*/ SELECT * FROM `core_members` ORDER BY core_members.shop_points DESC LIMIT 6;
# Time: 2020-04-01T17:49:39.895140Z
# User@Host: dummyname @ localhost []  Id:  3278
# Query_time: 0.021495  Lock_time: 0.000126 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763379;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:49:40.361018Z
# User@Host: dummyname @ localhost []  Id:  3279
# Query_time: 0.021502  Lock_time: 0.000125 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763380;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:49:42.192213Z
# User@Host: dummyname @ localhost []  Id:  3282
# Query_time: 0.023179  Lock_time: 0.000111 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763382;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:49:44.252843Z
# User@Host: dummyname @ localhost []  Id:  3283
# Query_time: 0.021532  Lock_time: 0.000125 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763384;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:49:46.147596Z

# User@Host: dummyname @ localhost []  Id:  3289
# Query_time: 0.000355  Lock_time: 0.000021 Rows_sent: 10  Rows_examined: 211
SET timestamp=1585763392;
/*IPS\featuredcontent\_Slider::fromCustom:638*/ SELECT * FROM `featuredcontent_contents` WHERE fcc_slider=70 ORDER BY RAND() LIMIT 0,20;
# Time: 2020-04-01T17:49:52.492625Z
# User@Host: dummyname @ localhost []  Id:  3290
# Query_time: 0.022380  Lock_time: 0.000113 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763392;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:49:53.252109Z
# User@Host: dummyname @ localhost []  Id:  3291
# Query_time: 0.000351  Lock_time: 0.000024 Rows_sent: 9  Rows_examined: 209
SET timestamp=1585763393;
/*IPS\featuredcontent\_Slider::fromCustom:638*/ SELECT * FROM `featuredcontent_contents` WHERE fcc_slider=73 ORDER BY RAND() LIMIT 0,20;
# Time: 2020-04-01T17:49:53.270722Z
# User@Host: dummyname @ localhost []  Id:  3292
# Query_time: 0.023296  Lock_time: 0.000170 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763393;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:49:53.282073Z
# User@Host: dummyname @ localhost []  Id:  3291
# Query_time: 0.000354  Lock_time: 0.000017 Rows_sent: 10  Rows_examined: 211
SET timestamp=1585763393;
/*IPS\featuredcontent\_Slider::fromCustom:638*/ SELECT * FROM `featuredcontent_contents` WHERE fcc_slider=70 ORDER BY RAND() LIMIT 0,20;
# Time: 2020-04-01T17:49:53.582308Z
# User@Host: dummyname @ localhost []  Id:  3292
# Query_time: 0.000357  Lock_time: 0.000014 Rows_sent: 10  Rows_examined: 211
SET timestamp=1585763393;
/*IPS\featuredcontent\_Slider::fromCustom:638*/ SELECT * FROM `featuredcontent_contents` WHERE fcc_slider=71 ORDER BY RAND() LIMIT 0,20;
# Time: 2020-04-01T17:49:56.625556Z
# User@Host: dummyname @ localhost []  Id:  3293
# Query_time: 0.021547  Lock_time: 0.000124 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763396;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:49:59.364806Z
# User@Host: dummyname @ localhost []  Id:  3296

# Time: 2020-04-01T17:50:06.076380Z
# User@Host: dummyname @ localhost []  Id:  3303
# Query_time: 0.023793  Lock_time: 0.000125 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763406;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:50:06.451228Z
# User@Host: dummyname @ localhost []  Id:  3304
# Query_time: 0.025381  Lock_time: 0.000131 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763406;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:50:08.997641Z
# User@Host: dummyname @ localhost []  Id:  3305
# Query_time: 0.021670  Lock_time: 0.000126 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763408;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:50:10.637792Z
# User@Host: dummyname @ localhost []  Id:  3308
# Query_time: 0.021607  Lock_time: 0.000125 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763410;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:50:11.484728Z
# User@Host: dummyname @ localhost []  Id:  3309
# Query_time: 0.023702  Lock_time: 0.000125 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763411;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:50:11.732868Z
# User@Host: dummyname @ localhost []  Id:  3310
# Query_time: 0.022362  Lock_time: 0.000122 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763411;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:50:12.331545Z
# User@Host: dummyname @ localhost []  Id:  3311
# Query_time: 0.000907  Lock_time: 0.000018 Rows_sent: 1  Rows_examined: 17231

# User@Host: dummyname @ localhost []  Id:  3318
# Query_time: 0.022499  Lock_time: 0.000119 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763419;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:50:21.397308Z
# User@Host: dummyname @ localhost []  Id:  3319
# Query_time: 0.022529  Lock_time: 0.000125 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763421;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:50:22.104804Z
# User@Host: dummyname @ localhost []  Id:  3321
# Query_time: 0.021491  Lock_time: 0.000124 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763422;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:50:23.431014Z
# User@Host: dummyname @ localhost []  Id:  3322
# Query_time: 0.021680  Lock_time: 0.000127 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763423;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:50:25.297973Z
# User@Host: dummyname @ localhost []  Id:  3323
# Query_time: 0.021648  Lock_time: 0.000125 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763425;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:50:25.596070Z
# User@Host: dummyname @ localhost []  Id:  3324
# Query_time: 0.000823  Lock_time: 0.000027 Rows_sent: 1  Rows_examined: 9
SET timestamp=1585763425;
/*IPS\Content\Search\_Results::init:246*/ SELECT `app`, `type`, `type_id`, `member_id`, `rep_rating`, `reaction` FROM `core_reputation_index`  LEFT JOIN `core_reactions` ON reaction=reaction_id WHERE ( reaction_enabled=1 AND app='forums$
# Time: 2020-04-01T17:50:25.709388Z
# User@Host: dummyname @ localhost []  Id:  3324
# Query_time: 0.000912  Lock_time: 0.000018 Rows_sent: 1  Rows_examined: 17231
SET timestamp=1585763425;

# Query_time: 0.000912  Lock_time: 0.000018 Rows_sent: 1  Rows_examined: 17231
SET timestamp=1585763425;
/*IPS\Patterns\hook543::load:17*/ SELECT * FROM `membersshop_points` WHERE `member_id`=10659;
# Time: 2020-04-01T17:50:27.078886Z
# User@Host: dummyname @ localhost []  Id:  3327
# Query_time: 0.021628  Lock_time: 0.000123 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763427;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:50:27.130422Z
# User@Host: dummyname @ localhost []  Id:  3326
# Query_time: 0.001008  Lock_time: 0.000024 Rows_sent: 1  Rows_examined: 17231
SET timestamp=1585763427;
/*IPS\Patterns\hook543::load:17*/ SELECT * FROM `membersshop_points` WHERE `member_id`=10265;
# Time: 2020-04-01T17:50:27.209523Z
# User@Host: dummyname @ localhost []  Id:  3328
# Query_time: 0.029687  Lock_time: 0.000123 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763427;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:50:27.609941Z
# User@Host: dummyname @ localhost []  Id:  3330
# Query_time: 0.000903  Lock_time: 0.000019 Rows_sent: 1  Rows_examined: 17231
SET timestamp=1585763427;
/*IPS\Patterns\hook543::load:17*/ SELECT * FROM `membersshop_points` WHERE `member_id`=10170;
# Time: 2020-04-01T17:50:28.936390Z
# User@Host: dummyname @ localhost []  Id:  3332
# Query_time: 0.022450  Lock_time: 0.000120 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763428;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:50:31.601200Z
# User@Host: dummyname @ localhost []  Id:  3334
# Query_time: 0.000915  Lock_time: 0.000018 Rows_sent: 1  Rows_examined: 17231
SET timestamp=1585763431;
/*IPS\Patterns\hook543::load:17*/ SELECT * FROM `membersshop_points` WHERE `member_id`=12023;
# Time: 2020-04-01T17:50:32.098079Z
# User@Host: dummyname @ localhost []  Id:  3335
# Query_time: 0.021491  Lock_time: 0.000125 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763432;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:50:32.803349Z
# User@Host: dummyname @ localhost []  Id:  3336
# Query_time: 0.022528  Lock_time: 0.000125 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763432;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:50:34.813465Z
# User@Host: dummyname @ localhost []  Id:  3337
# Query_time: 0.023262  Lock_time: 0.000120 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763434;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:50:36.890484Z
# User@Host: dummyname @ localhost []  Id:  3339
# Query_time: 0.000928  Lock_time: 0.000015 Rows_sent: 1  Rows_examined: 17231
SET timestamp=1585763436;
/*IPS\Patterns\hook543::load:17*/ SELECT * FROM `membersshop_points` WHERE `member_id`=26004;
# Time: 2020-04-01T17:50:37.446807Z
# User@Host: dummyname @ localhost []  Id:  3340
# Query_time: 0.021553  Lock_time: 0.000118 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763437;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
SET timestamp=1585763437;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:50:37.643541Z
# User@Host: dummyname @ localhost []  Id:  3341
# Query_time: 0.021540  Lock_time: 0.000114 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763437;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:50:39.045187Z
# User@Host: dummyname @ localhost []  Id:  3342
# Query_time: 0.000928  Lock_time: 0.000019 Rows_sent: 1  Rows_examined: 17231
SET timestamp=1585763439;
/*IPS\Patterns\hook543::load:17*/ SELECT * FROM `membersshop_points` WHERE `member_id`=18121;
# Time: 2020-04-01T17:50:39.968212Z
# User@Host: dummyname @ localhost []  Id:  3344
# Query_time: 0.021478  Lock_time: 0.000124 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763439;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:50:42.087237Z
# User@Host: dummyname @ localhost []  Id:  3346
# Query_time: 0.021599  Lock_time: 0.000125 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763442;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$
# Time: 2020-04-01T17:50:43.147057Z
# User@Host: dummyname @ localhost []  Id:  3348
# Query_time: 0.021645  Lock_time: 0.000125 Rows_sent: 394  Rows_examined: 1579
SET timestamp=1585763443;
/*IPS\Node\_Model::loadIntoMemory:749*/ SELECT * FROM `forums_forums`  LEFT JOIN `core_permission_index` ON core_permission_index.app='forums' AND core_permission_index.perm_type='forum' AND core_permission_index.perm_type_id=forums_for$

April 1, 2020

I have defrag MyISAM (Majority) and InnoDB (Minority) tables in MySQL multiple times today. Dropped from 70+ to 11 (lowest) and then climb back to 30-40 in an hour or two time.

How to constantly defrag tables or identify what is causing the defrag?

April 1, 2020

10 hours ago, Ryan Ashbrook said:

InnoDB is officially recommended, yes. In fact some places, like AWS, don't even support MyISAM anymore.

Apache versus Nginx and MySQL vs MariaDB really depend on personal preference, though bear in mind our support team are mostly familiar with Apache and MySQL.

Thanks @Ryan Ashbrook so its time for us to switch to InnoDB then.

Do you know how to do it as previously all these were managed by another admin.

April 1, 2020

7 hours ago, Steph40 said:

@Gauravk sent you a pm.

Thanks for the PM, lovely site with a very beautiful and fresh design and awesome speed.

Please share the backend details like: Apache or Nginx, MySQL or MariaDB, Redis or Memcached, InnoDB or MyISAM?

March 31, 2020

Can anyone please agree more on Innodb recommendation here?

We use to use Innodb in the past and if I rem correctly someone here recommended MyISAM and we switched. This must be 3-4 years back, if things have changed today or Innodb is officially recommended with current version, please confirm and we will switch it back.

What does usually self hosted site use here for IPB communities:

Apache OR Nginx?
MySQL OR MariaDB

March 31, 2020

On 3/30/2020 at 10:30 PM, Steph40 said:

I highly recommend centminmod:

https://centminmod.com/

Thanks @Steph40 for recommending this. Can you please explain little bit what it is? And can we use this with Apache and CentOS?

Are you using this? If yes, I like to have a look at your IPB site for speed testing, please.

March 30, 2020

Thanks, I have created the ticket and after initial round of questions, no one replied yet.

March 30, 2020

Thanks @Makoto and @ASTRAPI apart from the cost, there are several other reasons that I am stuck with DIY approach due to internal policies.

If any of you have some mod, plugin, app or detailed guide, I'm happy to buy it.

See if you can still support here with any inputs that will be highly appreciated.

I made little progress so far from 1.96 Request/Sec - 6.43 Request/Sec, hope I can better this more.

Baseline - Anonymous - Cloudflare ON

Concurrency Level:      1
Time taken for tests:   51.114 seconds
Complete requests:      100
Failed requests:        9
   (Connect: 0, Receive: 0, Length: 9, Exceptions: 0)
Non-2xx responses:      100
Total transferred:      4339200 bytes
HTML transferred:       4244800 bytes
Requests per second:    1.96 [#/sec] (mean)
Time per request:       511.145 [ms] (mean)
Time per request:       511.145 [ms] (mean, across all concurrent requests)
Transfer rate:          82.90 [Kbytes/sec] received

Redis + MySql config - Anonymous + Cloudflare ON

Concurrency Level:      1
Time taken for tests:   15.553 seconds
Complete requests:      100
Failed requests:        0
Total transferred:      19199846 bytes
HTML transferred:       19138500 bytes
Requests per second:    6.43 [#/sec] (mean)
Time per request:       155.530 [ms] (mean)
Time per request:       155.530 [ms] (mean, across all concurrent requests)
Transfer rate:          1205.55 [Kbytes/sec] received

March 30, 2020

Thanks @AlexWebsites this is nice to verify that its working.

March 30, 2020

Which type of default storage engine IPB recommends: Innodb VS MyISAM?

Does any of below help or improvise IPB sites speed?

mod_expire
Memcached
Opcode Cache
Varnish

Does Redis work for logged in user too or only for anonymous users?

Redis best practice / configuration like maxmemory etc?

March 30, 2020

Thanks @AlexWebsites yes its showing on at the back-end, but Im not sure if its doing any good.

Any ways to check the redis installation is alive and kicking....?

March 29, 2020

Looking for some experienced help and advice to optimize server side to reduce wait time to improvise the page load.

We are running on dedicated server with clouldflare pro plan to speed up front end.

We only have 1 main site on this server.

Server spec:

2 X Intel(R) Xeon(R) CPU E3-1245 V2 @ 3.40GHz
Speed: 3392.173 MHz
Cache: 8192 KB
RAM: 32 GB

Operating system

CENTOS 6.10
PHP
MySql
Apache

CPU Load

top - 22:20:01 up 286 days,  1:59,  1 user,  load average: 0.14, 0.14, 0.17
Tasks: 244 total,   1 running, 241 sleeping,   0 stopped,   2 zombie
Cpu0  : 31.8%us,  2.0%sy,  0.0%ni, 65.7%id,  0.0%wa,  0.0%hi,  0.5%si,  0.0%st
Cpu1  :  4.0%us,  2.0%sy,  0.0%ni, 94.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu2  :  0.0%us,  0.5%sy,  0.0%ni, 99.5%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu3  :  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu4  :  0.0%us,  1.0%sy,  0.0%ni, 99.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu5  :  1.0%us,  0.5%sy,  0.0%ni, 98.5%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu6  :  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu7  :  2.0%us,  0.5%sy,  0.0%ni, 97.5%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Mem:  32909764k total, 14882656k used, 18027108k free,  1733764k buffers
Swap:   523260k total,   158160k used,   365100k free,  5096856k cached

MySql Config

[mysqld]
default-storage-engine=MyISAM
open-files-limit=6553
performance-schema=0
local-infile=0
bind-address=127.0.0.1

innodb_buffer_pool_size=134217728
max_allowed_packet=268435456

# CACHES AND LIMITS #
tmp-table-size=512M
max-heap-table-size=256M
query-cache-type=1
query-cache-size=256M
query-cache-limit=1048576
max-connections=505
max_user_connections=500
thread-cache-size=32
table-definition-cache=102400
table-open-cache=20480

#### Per connection configuration ####
join_buffer_size=4M
sort_buffer_size=4M
read_buffer_size=4M
read_rnd_buffer_size=4M

# INNODB #
innodb_file_per_table=1
innodb_buffer_pool_size=134217728

# MyISAM #
key-buffer-size=1G
open_files_limit=10000

MySQL Tuner Report

 >>  MySQLTuner 1.4.0 - Major Hayden <major@mhtx.net>
 >>  Bug reports, feature requests, and downloads at http://mysqltuner.com/
 >>  Run with '--help' for additional options and output filtering
[OK] Currently running supported MySQL version 5.7.29
[OK] Operating on 64-bit architecture

-------- Storage Engine Statistics -------------------------------------------
[--] Status: +ARCHIVE +BLACKHOLE +CSV -FEDERATED +InnoDB +MRG_MYISAM
[--] Data in MyISAM tables: 508M (Tables: 684)
[--] Data in InnoDB tables: 34M (Tables: 476)
[--] Data in PERFORMANCE_SCHEMA tables: 0B (Tables: 87)
[--] Data in MEMORY tables: 0B (Tables: 4)
[!!] Total fragmented tables: 101

-------- Security Recommendations  -------------------------------------------
ERROR 1054 (42S22) at line 1: Unknown column 'password' in 'where clause'
[OK] All database users have passwords assigned

-------- Performance Metrics -------------------------------------------------
[--] Up for: 5d 22h 27m 10s (95M q [186.335 qps], 582K conn, TX: 545B, RX: 27B)
[--] Reads / Writes: 90% / 10%
[--] Total buffers: 1.6G global + 16.2M per thread (505 max threads)
[OK] Maximum possible memory usage: 9.7G (30% of installed RAM)
[OK] Slow queries: 0% (0/95M)
[OK] Highest usage of available connections: 43% (219/505)
[OK] Key buffer size / total MyISAM indexes: 1.0G/240.5M
[OK] Key buffer hit rate: 100.0% (1B cached / 72K reads)
[OK] Query cache efficiency: 91.9% (84M cached / 91M selects)
[!!] Query cache prunes per day: 608570
[OK] Sorts requiring temporary tables: 0% (176 temp sorts / 670K sorts)
[!!] Joins performed without indexes: 6834
[OK] Temporary tables created on disk: 5% (106K on disk / 1M total)
[OK] Thread cache hit rate: 99% (1K created / 582K connections)
[OK] Table cache hit rate: 38% (19K open / 51K opened)
[OK] Open file limit used: 27% (11K/41K)
[OK] Table locks acquired immediately: 99% (10M immediate / 10M locks)
[OK] InnoDB buffer pool / data size: 128.0M/34.9M
[OK] InnoDB log waits: 0

March 29, 2020

On 3/28/2020 at 3:27 PM, Adlago said:

A little later I will give you an instruction to "onload" avatar images that slow down your mobile site.

Of course a cookies-free domain will write to you, but when you improve your site load a little more.

Any update on these two points, today?

Downloads

Release Notes

IPS4 Guides

IPS4 Developer Documentation

Invision Community Blog

Development Blog

Deprecation Tracker

Providers Directory

Forums

Events

Store

Gallery

Posts posted by Gauravk