Invision Community 4: SEO, prepare for v5 and dormant account notifications By Matt Monday at 02:04 PM
2002faq Posted March 29, 2022 Posted March 29, 2022 I am getting a large number of errors in the logs that look like this IPS\File\Exception::3 SlowDown: Please reduce your request rate. #0 /home/skupper/www.bmw2002faq.com/system/File/File.php(351): IPS\File\_Amazon->save() #1 /home/skupper/www.bmw2002faq.com/system/Output/Javascript/Javascript.php(1010): IPS\_File::create('core_Theme', 'root_map.js', 'var ipsJavascri...', 'javascript_glob...', true, NULL, false) #2 /home/skupper/www.bmw2002faq.com/system/Output/Javascript/Javascript.php(977): IPS\Output\_Javascript::_writeJavascript('var ipsJavascri...', 'map.js', 'global', 'root') #3 /home/skupper/www.bmw2002faq.com/system/Output/Javascript/Javascript.php(807): IPS\Output\_Javascript::_writeJavascriptFromResultset(Array, 'map.js', 'global', 'root') #4 /home/skupper/www.bmw2002faq.com/system/Output/Javascript/Javascript.php(932): IPS\Output\_Javascript::compile('global', 'root', 'map.js') #5 /home/skupper/www.bmw2002faq.com/system/Output/Output.php(565): IPS\Output\_Javascript::compile('core', 'front', 'front_core.js') #6 /home/skupper/www.bmw2002faq.com/system/Output/Output.php(358): IPS\_Output::_getJavascriptFileObject('core', 'front', 'front_core.js') #7 /home/skupper/www.bmw2002faq.com/system/Dispatcher/Front.php(866): IPS\_Output->js('front_core.js', 'core', 'front') #8 /home/skupper/www.bmw2002faq.com/system/Dispatcher/Front.php(82): IPS\Dispatcher\_Front::baseJs() #9 /home/skupper/www.bmw2002faq.com/init.php(913) : eval()'d code(20): IPS\Dispatcher\_Front->init() #10 /home/skupper/www.bmw2002faq.com/system/Dispatcher/Dispatcher.php(110): IPS\Dispatcher\pagesmapwidget_hook_loadMapWidgetResources->init() #11 /home/skupper/www.bmw2002faq.com/index.php(13): IPS\_Dispatcher::i() #12 {main} What is causign this and how can this be resolved? thank you, Steve K.
Jim M Posted March 29, 2022 Posted March 29, 2022 It looks like the Javascript is rebuilding as part of your theme or saving. Have you recently rebuilt your cache multiple times? If so you may have hit the Amazon S3 request limit. This looks to be a warning at this time rather than an error. Are you experiencing any issues?
2002faq Posted March 29, 2022 Author Posted March 29, 2022 I ave not rebuilt cache in a while. The error in the log is often, but not consecutive and all of them i see are caused by Guest user. i am not sure what issues these might be causing, but i just saw this in the post where the attachment is not available. https://www.bmw2002faq.com/blogs/entry/2411-first-drive/ And i am also seeing that the thumbnails on old posts are not showing ups properly https://www.bmw2002faq.com/forums/topic/169196-1970-bmw-2002-fully-built-scca-fsp-26-kgb-racing-machine/#comment-1055759 I do not know if these are related. thank you, Steve
Jim M Posted March 29, 2022 Posted March 29, 2022 Cache will rebuild occasionally by a system task so it can happen that it would happen that way but not in a manner which should exceed your S3 limits. Does each folder in your S3 bucket have appropriate permissions? Those appear to not be able to write there.
2002faq Posted March 29, 2022 Author Posted March 29, 2022 I think the problem with the Thumbnails is different. The file exists, but the path to it is incorrect <img src="//media.invisioncic.com/a319035/monthly_08_2015/post-32029-0-34079200-1438909995_thumb.jpg" data-fileid="106908" class="ipsImage ipsImage_thumbnailed" alt="post-32029-0-34079200-1438909995_thumb.j" data-ratio="56.25" data-src="//media.invisioncic.com/a319035/monthly_08_2015/post-32029-0-34079200-1438909995_thumb.jpg" width="400" style="height: 225px;" data-loading="true"> I changed the policy on the bucket to prevent the List for Public. I have CloudFront for the external serving. I will see if that reduces the rate. I do not have the rate monitored in CloudWatch, so i will look to see if i get any more errors. thank you, Steve
2002faq Posted March 30, 2022 Author Posted March 30, 2022 It looks like having logs written to the same bucket was triggering a large number of LIST and PUT requests. I have moved the S3 Bucket logs to its own bucket and here are the results. You can see the change at 17:00. I have not seen 500 error since the change. I will keep monitoring. Thank you, Steve K. P.S. Should I create a different post for the Thumbnail issue? I do not think it is related to the S3 bucket.
Jim M Posted March 30, 2022 Posted March 30, 2022 6 minutes ago, misfit76 said: P.S. Should I create a different post for the Thumbnail issue? I do not think it is related to the S3 bucket. That would be ideal. Thank you.
2002faq Posted March 30, 2022 Author Posted March 30, 2022 Excitement was short lived. Reading at some S3 documentation, AWS scales the capacity as needed and the 503 errors are short lived. Does IPB retry the request if it does not succed?
Marc Posted March 31, 2022 Posted March 31, 2022 10 hours ago, misfit76 said: Excitement was short lived. Reading at some S3 documentation, AWS scales the capacity as needed and the 503 errors are short lived. Does IPB retry the request if it does not succed? I have tagged this for one of our developers, who may be able to shed more light on this for you. I would however doubt we would re-request if it fails on 'slow down requests' as that would actually compound the issue
2002faq Posted April 1, 2022 Author Posted April 1, 2022 How often is /javascript_global/root_map.js supposed to be rewritten? I see constant PUT on the S3 for that and other items in /javascript_* Looking at the S3 logs i see that there were over 4000 PUT requests to /javascript in 30 minutes. Is that normal? Thank you, Steve
Marc Posted May 12, 2022 Posted May 12, 2022 I have got this into a ticket for you, so we can discuss further
Recommended Posts