Clover13

Nothing that I can see. I can try to push the themes back to S3 and then back to local again if you'd like to re-test?

Too late! 😬 Images just weren't presenting well on desktop even though they fit, it wasn't a very fluid viewing experience because they were too big. Many also had a max quality setting, which was impacting page load times too much. So downsizing them to a better size and quality was needed. I'll just have to address any issues that may come up. Worst case I guess will be scripting something to query posts, parse images, read image properties, calc width/height and ratios, then update the forums_posts.post data. Not something I want to do if I don't have to though 🙂 Moving forward things should be all good on new uploads. CLS seems OK after the resizing and custom CSS, testing against a Topic page that had many resized images. Desktop CLS: 0.045 Mobile CLS: 0.022 FWIW, I used ImageMagick's mogrify to do the resizing and quality changes, which is the same as I have configured in IPS now.

Yes, the files were recopied back down locally via IPS automatically when I switched the storage option back but the S3 files were not removed. The IAM group and user under it have AmazonS3FullAccess as part of the Configuring Amazon S3 guide here. At the bucket level, I see only the following ACL: Grantee: Bucket owner Objects: List, Write Bucket ACL: Read, Write There is no mention of an explicit delete option in the guide. The API uses the user's access key, which should have delete via AmazonS3FullAccess right?

Not possible via IPS, but an external process can be used. I'm just trying to figure out what else has to change to get things working as they should. I'll test out the lazy loading and page jumping impact to CLS with my current solution.

FWIW, my current solution to this is to drive intrinsic sizing via custom CSS, while leaving the DB data alone. So the original width of a resized thumbnail may be stored in the DB with a larger value as part of the IMG element in the HTML, but once I resize (downsize) the actual image, I can force a max-content width and it will display correctly. One would probably never upsize an existing image due to pixelation. Original image before resizing is 900x1200. It is stored in the DB with a width="900" (as seen in the code example below). Resized image is 720x960 which is done via an external process, but the DB has not been updated (and may not need to be). Custom CSS: /* Override the original thumbnail image sizing to use the intrinsic sizing due to the static width defined and stored in the DB as HTML during the thumbnailing process */ .ipsType_richText img.ipsImage.ipsImage_thumbnailed { width: max-content !important; } Original IMG element generated from thumbnailing process and stored as HTML in the DB: <img class="ipsImage ipsImage_thumbnailed" data-fileid="11639" data-ratio="133.33" width="900" alt="IMG_7522.thumb.jpeg.2519c5354c6b4b35301e60eadcf52944.jpeg" data-src="//cdn.domain.com/monthly_2023_07/IMG_7522.thumb.jpeg.2519c5354c6b4b35301e60eadcf52944.jpeg" src="//cdn.domain.com/monthly_2023_07/IMG_7522.thumb.jpeg.2519c5354c6b4b35301e60eadcf52944.jpeg" style="height: auto;" data-loaded="true"> Without the CSS, the image will have an intrinsic size of 720x960 but display with a rendered size of 900x1200. With the CSS, the image displays as 720x960.

What is the purpose of these and what is the impact of removing them from the forums_posts.post data? They are contained within the forums_posts.post data, and then used for the HTML rendered in the image display of an attachment in a forum Topic. These data-ratio and width values appear to be created during thumbnail creation process and correlate to the AdminCP Posting settings for image sizing at the time of the thumbnail creation, however I am not sure what their purpose is. These reflect what the original image was resized into as a thumbnail, but the image itself already has those preferred size settings intrinsically. Why does it also need to be statically embedded within the HTML itself (and also statically stored in the DB)? The reason I ask is because in the event you want to revise your image sizing and rebuild your thumbnails, all of those forums_posts.post rows will need to also be recalculated and updated. If not and you resize (downsize) the thumbnails but leave the DB as-is, per what I've observed, then the rendered size of the image will be larger than the intrinsic size of the image and forced to display that rendered sizing (i.e. enlarged) based on the IMG width property. Without the IMG width property (being in the forums_posts.post HTML), it would display the image's intrinsic value which matches the configured value in the AdminCP settings.

Yes, both moves done via IPS AdminCP.

There appear to be files under the following directories specifically: css_built_0 css_built_2 javascript_calendar javascript_cms javascript_core javascript_forums javascript_gallery javascript_global javascript_ignoretopics javascript_rsvpevents javascript_tthumb set_resources_0 set_resources_2 set_resources_8 Some of these are third party, but even the core ones were not removed once I reconfigured to local. Examples:

Hi @Jim M, I added Notes to the Client Area providing the locations and details.

Yes, all complete and cache cleared a number of times since the move back was made. I was working on something else when I noticed the residual files today. So it's been quite a few days of them being there.

I was doing some testing of Theme Resources locally vs on S3. I changed back to local but see the theme related files still out on S3. Should they not have been removed/cleaned up on the move back? Namely: css_built_* javascript_* set_resources_*

The problem is, without the current IPS scan/approval process of apps/plugins, any new development is a risk. We also don't know how many iterations of scan/approval a given version of a given app had to go through to get final IPS approval, nor what those rulesets/barriers were for good practice per IPS standards. We just know the end product from the Marketplace dev. Now clients are subject to the intermediate iterations and any issues they expose. This is particularly concerning when we get into PII and any level of security risk to our sites (which we had a confidence level IPS was protecting us from with their scan/approval process).

Right, so this bodes well for well known and established devs as they have already created a foundational trust model with clients. For new devs, that's a barrier they'd have to create over time. Meanwhile, clients either have no way to validate new devs work like IPS previously did to guarantee the safety of the app/plugin. I think this greatly elevates the risk for clients and subsequently harms the potential for developers to grow the product. Hobbyist sites will suffer the most as they simply don't have the resources to invest in robust security evaluation. Perhaps another opportunity for a dev to provide some level of AppSec and InfoSec scanning of applications to lower the risk.

One potentially large gap is the validation and approval process done by IPS to guarantee the Marketplace developer's app/plugin aligned with IPS standards before it was approved for client download. How will this be managed moving forward?

OK, nevermind, this was one is on me. I must have accidentally moved the files and my FTP client had cached versions showing, so they weren't where they should be. Working through resolving getting things where they need to be.

I'm not going to leave it like this for long if I can resolve it by clearing the cache. Hoping the above information is helpful enough to determine what may be going on or where to look.

So it looks like this came back up, but now on my other site. It's currently happening. Tried two different browsers and Incognito/private modes. I have not cleared the IPS cache yet. These theme files are local to the server, they are not CDNed. FTPing to the server shows these files are indeed where they should be. From Chrome: GET https://www.domainxyz.com/uploads/themes/javascript_tthumb/front_front_tthumb.js?v=066306acec1691876423 net::ERR_ABORTED 404 www.domainxyz.com/:3224 GET https://www.domainxyz.com/uploads/themes/javascript_global/root_js_lang_1.js?v=066306acec1691876423 net::ERR_ABORTED 404 www.domainxyz.com/:3226 GET https://www.domainxyz.com/uploads/themes/javascript_core/global_global_core.js?v=066306acec1691876423 net::ERR_ABORTED 404 www.domainxyz.com/:3223 GET https://www.domainxyz.com/uploads/themes/javascript_global/root_library.js?v=066306acec1691876423 net::ERR_ABORTED 404 www.domainxyz.com/:3228 GET https://www.domainxyz.com/uploads/themes/javascript_global/root_front.js?v=066306acec1691876423 net::ERR_ABORTED 404 www.domainxyz.com/:3235 GET https://www.domainxyz.com/uploads/themes/javascript_core/front_app.js?v=066306acec1691876423 net::ERR_ABORTED 404 www.domainxyz.com/:3225 GET https://www.domainxyz.com/uploads/themes/javascript_global/root_framework.js?v=066306acec1691876423 net::ERR_ABORTED 404 www.domainxyz.com/:3232 GET https://www.domainxyz.com/uploads/themes/javascript_core/front_front_statuses.js?v=066306acec1691876423 net::ERR_ABORTED 404 www.domainxyz.com/:3237 GET https://www.domainxyz.com/uploads/themes/javascript_rsvpevents/front_front_widget.js?v=066306acec1691876423 net::ERR_ABORTED 404 www.domainxyz.com/:3231 GET https://www.domainxyz.com/uploads/themes/javascript_core/front_front_streams.js?v=066306acec1691876423 net::ERR_ABORTED 404 www.domainxyz.com/:3230 GET https://www.domainxyz.com/uploads/themes/javascript_core/front_front_widgets.js?v=066306acec1691876423 net::ERR_ABORTED 404 www.domainxyz.com/:3229 GET https://www.domainxyz.com/uploads/themes/javascript_core/front_front_core.js?v=066306acec1691876423 net::ERR_ABORTED 404 jquery-ui.js?v=066306acec1691876423:4 Uncaught ReferenceError: jQuery is not defined at jquery-ui.js?v=066306acec1691876423:4:157 at jquery-ui.js?v=066306acec1691876423:4:165 (anonymous) @ jquery-ui.js?v=066306acec1691876423:4 (anonymous) @ jquery-ui.js?v=066306acec1691876423:4 jquery-touchpunch.js?v=066306acec1691876423:10 Uncaught ReferenceError: jQuery is not defined at jquery-touchpunch.js?v=066306acec1691876423:10:1155 (anonymous) @ jquery-touchpunch.js?v=066306acec1691876423:10 (index):3240 Uncaught ReferenceError: ips is not defined at (index):3240:4 (anonymous) @ (index):3240 From the Safari console: [Error] Failed to load resource: the server responded with a status of 404 (Not Found) (root_library.js, line 0) [Error] Failed to load resource: the server responded with a status of 404 (Not Found) (front_front_core.js, line 0) [Error] Failed to load resource: the server responded with a status of 404 (Not Found) (front_front_tthumb.js, line 0) [Error] Failed to load resource: the server responded with a status of 404 (Not Found) (global_global_core.js, line 0) [Error] Failed to load resource: the server responded with a status of 404 (Not Found) (root_js_lang_1.js, line 0) [Error] Failed to load resource: the server responded with a status of 404 (Not Found) (root_front.js, line 0) [Error] Failed to load resource: the server responded with a status of 404 (Not Found) (front_app.js, line 0) [Error] Failed to load resource: the server responded with a status of 404 (Not Found) (front_front_statuses.js, line 0) [Error] Failed to load resource: the server responded with a status of 404 (Not Found) (root_framework.js, line 0) [Error] Failed to load resource: the server responded with a status of 404 (Not Found) (front_front_streams.js, line 0) [Error] ReferenceError: Can't find variable: jQuery (anonymous function) (jquery-ui.js:4:164) Global Code (jquery-ui.js:4:166) [Error] ReferenceError: Can't find variable: jQuery Global Code (jquery-touchpunch.js:10:1162) [Error] ReferenceError: Can't find variable: ips Global Code (www.domainxyz.com:2659)

Does this apply to cloud only or to self hosted as well?

Anyone here happen to do a bulk image optimization on S3 to reduce file sizing and maintain quality? If so, what was your approach and was there anything that needed to be updated on IPS to account for this change, or did you strictly run it against S3? Worth asking too, what is your preferred Image Settings here on IPS? GD vs Imagemagick and what level of quality setting(s)?

Just to be clear, it only happened on 1 site despite both being on the same host server. That is what lead me to believe it was software sided rather than server sided. If it had been both sites, I would have thought server related. However, it could have been something between the server and clients for that one site that was a problem. Agree, my sense was something became corrupted and stuck as a result. Clearing the IPS cache seemed to resolve it, just no idea how it got in that state initially for all users and only for one of the sites. The other aspect just recalled that is unique to this site, is that it is CDNing the Theme Resources (File Storage). I wonder if something with CF got messed up that caused it, although I did not clear the CF cache at all, only the IPS cache. I am not sure what that operation does exactly, so I can't comment on what it clears and the corresponding repopulation of the cache. How exactly does the IPS cache clearing work with File Storage such as Theme Resources that are on a CDN (such as CF)? I will keep an eye on things and let you guys know if it happens again so you can review. Given the time of discovery (9PM EDT) and 12 hour outage, I was just working on getting the site back to operational at that point.

4.7.12 I run two sites on the same server that are nearly identical installs, both of which I've had my host evaluate for errors/issues during this period of unresponsiveness. Neither site indicated any issues at the host level (i.e. errors, resource issues, etc). There were no recent updates to either site that I feel would have influenced this behavior. Only one site had issues with unresponsiveness described below. No alerts were received. The unresponsiveness period was nearly 12 hours (I was away from cell reception and had no idea the site was in this state until I returned to find no activity since users couldn't post). Symptoms observed: All users experienced the same symptoms, so it wasn't isolated to one device or one set of devices. It was definitively a site related issue. Main site would load and present the landing page (activity stream) Main site buttons wouldn't work Main site menu wouldn't open Admin CP would load and present the landing page (had to manually type in URL since main site menu wouldn't open) Admin CP menu would not open Admin CP Support page would open but all of the checks would just show the status check spinning indefinitely Fix: I was able to clear the cache with the link on the AdminCP Support page and that seemed to resolve the issue. Simple fix, but I still have no idea what happened or why. I don't see any errors in the IPS error or system logs pointing to any issues at this time. Anyone have any ideas or experienced something similar before? I've never seen this occur before, and I've been using IPS for 10+ years now.

OK so I observe the following with all custom applications and plugins disabled and using the default theme: All Activity Expanded view shows the hidden topic All Activity Condensed view does NOT show the hidden topic Custom Stream Expanded view does NOT show the hidden topic Custom Stream Condensed view does NOT show the hidden topic I would say next steps are for you to verify you can see it in All Activity Expanded and Condensed? FWIW, this is an admin account I am testing with and I can see the hidden topic in the forum itself and access it.

Appears to show in Expanded view but not Condensed for me, can you try in Condensed? I also tried with the default theme and all applications and plugins disabled, but see the same behavior. Strange it did show in Expanded for a few refreshes and is gone again. I'll keep investigating.

4.7.12 You can reproduce by creating a topic and marking it as hidden upon creation.

Found an issue where using the add-on to select an attached image as the Embed Image and then later deleting the image results in the topic displaying duplicate original post and comments (OP and comments, then OP and comments again). The breadcrumbs also indicate a problem of duplication in the pathing. See: