Error in the logs

[2002faq]

I am getting a large number of errors in the logs that look like this

IPS\File\Exception::3

 

SlowDown: Please reduce your request rate.

 

#0 /home/skupper/www.bmw2002faq.com/system/File/File.php(351): IPS\File\_Amazon->save()
#1 /home/skupper/www.bmw2002faq.com/system/Output/Javascript/Javascript.php(1010): IPS\_File::create('core_Theme', 'root_map.js', 'var ipsJavascri...', 'javascript_glob...', true, NULL, false)
#2 /home/skupper/www.bmw2002faq.com/system/Output/Javascript/Javascript.php(977): IPS\Output\_Javascript::_writeJavascript('var ipsJavascri...', 'map.js', 'global', 'root')
#3 /home/skupper/www.bmw2002faq.com/system/Output/Javascript/Javascript.php(807): IPS\Output\_Javascript::_writeJavascriptFromResultset(Array, 'map.js', 'global', 'root')
#4 /home/skupper/www.bmw2002faq.com/system/Output/Javascript/Javascript.php(932): IPS\Output\_Javascript::compile('global', 'root', 'map.js')
#5 /home/skupper/www.bmw2002faq.com/system/Output/Output.php(565): IPS\Output\_Javascript::compile('core', 'front', 'front_core.js')
#6 /home/skupper/www.bmw2002faq.com/system/Output/Output.php(358): IPS\_Output::_getJavascriptFileObject('core', 'front', 'front_core.js')
#7 /home/skupper/www.bmw2002faq.com/system/Dispatcher/Front.php(866): IPS\_Output->js('front_core.js', 'core', 'front')
#8 /home/skupper/www.bmw2002faq.com/system/Dispatcher/Front.php(82): IPS\Dispatcher\_Front::baseJs()
#9 /home/skupper/www.bmw2002faq.com/init.php(913) : eval()'d code(20): IPS\Dispatcher\_Front->init()
#10 /home/skupper/www.bmw2002faq.com/system/Dispatcher/Dispatcher.php(110): IPS\Dispatcher\pagesmapwidget_hook_loadMapWidgetResources->init()
#11 /home/skupper/www.bmw2002faq.com/index.php(13): IPS\_Dispatcher::i()
#12 {main}

 

What is causign this and how can this be resolved?

thank you,

Steve K.

[Jim M]

It looks like the Javascript is rebuilding as part of your theme or saving. Have you recently rebuilt your cache multiple times? If so you may have hit the Amazon S3 request limit. This looks to be a warning at this time rather than an error. Are you experiencing any issues?

[2002faq]

I ave not rebuilt cache in a while. The error in the log is often, but not consecutive and all of them i see are caused by Guest user.

 

i am not sure what issues these might be causing, but i just saw this in the post where the attachment is not available.

https://www.bmw2002faq.com/blogs/entry/2411-first-drive/

And i am also seeing that the thumbnails on old posts are not showing ups properly

https://www.bmw2002faq.com/forums/topic/169196-1970-bmw-2002-fully-built-scca-fsp-26-kgb-racing-machine/#comment-1055759

I do not know if these are related.

thank you,

Steve 

[Jim M]

Cache will rebuild occasionally by a system task so it can happen that it would happen that way but not in a manner which should exceed your S3 limits.

Does each folder in your S3 bucket have appropriate permissions? Those appear to not be able to write there. 

[2002faq]

I think the problem with the Thumbnails is different. The file exists, but the path to it is incorrect

<img src="//media.invisioncic.com/a319035/monthly_08_2015/post-32029-0-34079200-1438909995_thumb.jpg" data-fileid="106908" class="ipsImage ipsImage_thumbnailed" alt="post-32029-0-34079200-1438909995_thumb.j" data-ratio="56.25" data-src="//media.invisioncic.com/a319035/monthly_08_2015/post-32029-0-34079200-1438909995_thumb.jpg" width="400" style="height: 225px;" data-loading="true">

 

I changed the policy on the bucket to prevent the List for Public. I have CloudFront for the external serving. I will see if that reduces the rate. I do not have the rate monitored in CloudWatch, so i will look to see if i get any more errors.

thank you,

Steve  

 

 

[Marc]

No problem. Please let us know where you get to

[2002faq]

It looks like having logs written to the same bucket was triggering a large number of LIST and PUT requests. I have moved the S3 Bucket logs to its own bucket and here are the results. You can see the change at 17:00. I have not seen 500 error since the change. I will keep monitoring.

 

 

Thank you,

Steve K.

P.S. Should I create a different post for the Thumbnail issue?  I do not think it is related to the S3 bucket.

 

[Jim M]

6 minutes ago, misfit76 said:

P.S. Should I create a different post for the Thumbnail issue?  I do not think it is related to the S3 bucket.

That would be ideal. Thank you.

[2002faq]

Excitement was short lived. Reading at some S3 documentation, AWS scales the capacity as needed and the 503 errors are short lived. Does IPB retry the request if it does not succed?

 

[Marc]

10 hours ago, misfit76 said:

Excitement was short lived. Reading at some S3 documentation, AWS scales the capacity as needed and the 503 errors are short lived. Does IPB retry the request if it does not succed?

 

I have tagged this for one of our developers, who may be able to shed more light on this for you. I would however doubt we would re-request if it fails on 'slow down requests' as that would actually compound the issue

[2002faq]

How often is  /javascript_global/root_map.js supposed to be rewritten?

I see constant PUT on the S3 for that and other items in  /javascript_*

Looking at the S3 logs i see that there were over 4000 PUT requests to /javascript in 30 minutes.

Is that normal?

Thank you,

Steve 

 

[2002faq]

Has anyone been able to look at this?  

[Marc]

I have got this into a ticket for you, so we can discuss further