David N. Posted April 25 Posted April 25 My site is very slow right now, it takes about 10 seconds after I click on a topic name to see the topic. Clicking the notification bell doesn't display notifications. I see the progress wheel turn and nothing. SeNioR-, sadams101 and Grafidea 3
TracyIsland Posted April 25 Posted April 25 Yes, opening invisioncommunity.com took about 7 seconds and then the same for opening unread activity, and still more when I clicked on this topic. oh wait, after I typed the reply and hit save, it took 21 seconds to process.
I_cant_Swim_ Posted April 25 Posted April 25 16 seconds to load this page... my site is also crawling. A cloud issue?
Jim M Posted April 25 Posted April 25 12 minutes ago, I_cant_Swim_ said: 16 seconds to load this page... my site is also crawling. A cloud issue? You are on our Cloud so yes. Things should start to normalize here soon. I_cant_Swim_ 1
I_cant_Swim_ Posted April 25 Posted April 25 We were completely offline, for a bit 😞 ...but now we're up again, snappy too.
David N. Posted April 25 Author Posted April 25 Are you mitigating DDOS attack again? Just a few days ago (April 21, 10:20pm CEST), my site was completely down:
Jim M Posted April 25 Posted April 25 Our status page will provide information about incidents which occur on our platform: https://status.invisioncommunity.com/ There were no issues on April 21st with Cloud as a whole.
Grant_B Posted April 26 Posted April 26 We have 100's of pages of errors in our system log from around 4:45pm yesterday to around 6:33pm (UK time) which seems to coincide with this issue - do other see the same? The errors relate to redis, mysql and template errors so I just wanted to check these all relate to the cloud issues. Jelly Belly™ 1
David N. Posted April 26 Author Posted April 26 1 minute ago, Grant_B said: We have 100's of pages of errors in our system log from around 4:45pm yesterday to around 6:33pm (UK time) which seems to coincide with this issue - do other see the same? I see the same, yes. 14 hours ago, Jim M said: Our status page will provide information about incidents which occur on our platform: https://status.invisioncommunity.com/ There were no issues on April 21st with Cloud as a whole. What does that mean when my site is down but there's no incident listed at https://status.invisioncommunity.com/ ? Jelly Belly™ 1
My Sharona Posted April 26 Posted April 26 (edited) 7 minutes ago, Grant_B said: We have 100's of pages of errors in our system log from around 4:45pm yesterday to around 6:33pm (UK time) which seems to coincide with this issue - do other see the same? The errors relate to redis, mysql and template errors so I just wanted to check these all relate to the cloud issues. Just had a look and while not hundreds of pages, there are redis, template, javascript, and datastore errors. I also experienced other issues with this as well, which can be found here. Edited April 26 by My Sharona Jelly Belly™ 1
Marc Posted April 26 Posted April 26 16 minutes ago, David N. said: What does that mean when my site is down but there's no incident listed at https://status.invisioncommunity.com/ ? This is simply because it was not down as such in most places. It was slow for the most part, so hasnt tripped it
David N. Posted April 26 Author Posted April 26 (edited) 5 minutes ago, Marc Stridgen said: This is simply because it was not down as such in most places. It was slow for the most part, so hasnt tripped it But at the time, uptrends.com showed my site down in all its testing locations throughout the world, as I shared on that screenshot. (Ugh... the anchoring is linking to the wrong post. The screenshot is a little further down.) Edited April 26 by David N.
Marc Posted April 26 Posted April 26 24 minutes ago, David N. said: But at the time, uptrends.com showed my site down in all its testing locations throughout the world, as I shared on that screenshot. (Ugh... the anchoring is linking to the wrong post. The screenshot is a little further down.) I can certainly see the screenshot there. However as you mentioned in your own post there, ours is not showing it. Dont get me wrong, we acknowledged there was an isssue, which has now been resolved. 🙂
Management Matt Posted April 26 Management Posted April 26 As Marc said, we did have two separate pockets of about 10-15 minutes of degraded performance around 4:45pm (BST) and around 6:15pm (BST). There was a very short period where we cycled our caching layer that was not performing optimally and putting pressure on the database servers. I am not aware of any issues on the 21st.
David N. Posted April 26 Author Posted April 26 (edited) I understand that there were issues on 04/25 that are reported on the status tracker, were acknowledged, and have now been resolved (thank you). I don't understand why my site was down in all locations tested by uptrend on 04/21, and why this downtime was not reported on the status tracker, or why you are not aware of it. I was trying to ask if that 04/21 issue was related to the 04/25 issues, or if this is an isolated issue that should be troubleshot separately? I see a bunch of errors in my log around the time when I detected the downtime: All those errors end with 'MySQL server has gone away', for example: SELECT * FROM `cloud_livetopics_topic` WHERE `topic_topic_id`=136254 MySQL server has gone away Here's the backtrace: #0 /var/www/html/107748/system/Db/Select.php(388): IPS\_Db->preparedQuery('/*u324175::u324...', Array, true) #1 /var/www/html/107748/system/Db/Select.php(446): IPS\Db\_Select->runQuery() #2 /var/www/html/107748/system/Db/Select.php(370): IPS\Db\_Select->rewind() #3 /var/www/html/107748/system/Patterns/ActiveRecord.php(138): IPS\Db\_Select->first() #4 /var/www/html/107748/applications/forums/sources/Topic/LiveTopic.php(40): IPS\Patterns\_ActiveRecord::load(136254, 'topic_topic_id') #5 /var/www/html/107748/init.php(934) : eval()'d code(87): IPS\forums\_Topic->getLiveTopic() #6 /var/www/html/107748/system/Content/Item.php(4769): IPS\Content\cloud_hook_ipsContentItem->commentFormElements() #7 /var/www/html/107748/system/Theme/Theme.php(885) : eval()'d code(5378): IPS\Content\_Item->commentForm() #8 /var/www/html/107748/system/Theme/SandboxedTemplate.php(61): IPS\Theme\class_forums_front_topics->topic(Object(IPS\forums\Topic), Array, NULL, Array, NULL, NULL, Array) #9 /var/www/html/107748/applications/forums/modules/front/forums/topic.php(643): IPS\Theme\_SandboxedTemplate->__call('topic', Array) #10 /var/www/html/107748/system/Dispatcher/Controller.php(118): IPS\forums\modules\front\forums\_topic->manage() #11 /var/www/html/107748/system/Content/Controller.php(50): IPS\Dispatcher\_Controller->execute() #12 /var/www/html/107748/applications/forums/modules/front/forums/topic.php(39): IPS\Content\_Controller->execute() #13 /var/www/html/107748/system/Dispatcher/Dispatcher.php(153): IPS\forums\modules\front\forums\_topic->execute() #14 /var/www/html/107748/index.php(13): IPS\_Dispatcher->run() #15 {main} The very first errors I see in my logs associated to that 04/21 downtime are: Edited April 26 by David N.
Marc Posted April 26 Posted April 26 As mentioned above, we arent (or certainly werent) aware of any issues on 21st. Of course as your site is now online, there isnt anything present to investigate. If you see these happen again, please let us know at the time they are happening
Grant_B Posted April 27 Posted April 27 We saw a repeat of these issues at 5pm and 9pm (UK time) yesterday 26th - did anybody else experience the same? SeNioR- 1
Allen Bradford Posted April 27 Posted April 27 (edited) See Topic “Site Offline” Topic. My Board experienced intermittent slow downs the last couple days and is now dead on my main Safari Browser on my devices. There is no indication of this issue on the Status Page. Edited April 27 by Allen Bradford
Owlsonline Admin Posted April 27 Posted April 27 (edited) 19 minutes ago, Allen Bradford said: See Topic “Site Offline” Topic. My Board experienced intermittent slow downs the last couple days and is now dead on my main Safari Browser on my devices. There is no indication of this issue on the Status Page. Same for me on mine, and I'm getting messages from site users to say the same. It's weird, I can access on my macbook via safari and chrome, but on my iphone it's not having it at all, the page stays blank. This is the case as of postiing this post. Edited April 27 by Owlsonline Admin Allen Bradford 1
Owlsonline Admin Posted April 27 Posted April 27 Just had a site member say, using external browsers on mobile aren't working. but when he uses the samsung browser things are fine!
Allen Bradford Posted April 27 Posted April 27 4 minutes ago, Owlsonline Admin said: Same for me on mine, and I'm getting messages from site users to say the same. It's weird, I can access on my macbook via safari and chrome, but on my iphone it's not having it at all, the page stays blank. This is the case as of postiing this post. Mine went down on Safari iPhone yesterday but stayed stable on Safari iPad until this morning when it struck a server error and went dead white with that default URL. I can currently access my Board in Firefox browser on devices but I suspect its only a matter of time.
David N. Posted April 27 Author Posted April 27 Same issue here right now. Trying to access my site from Firefox on my iPhone redirects to mysite.com/admin/install which yields a blank page.
Owlsonline Admin Posted April 27 Posted April 27 4 minutes ago, Allen Bradford said: Mine went down on Safari iPhone yesterday but stayed stable on Safari iPad until this morning when it struck a server error and went dead white with that default URL. I can currently access my Board in Firefox browser on devices but I suspect its only a matter of time. I hope mine doesn't go down on laptop. Especially on a bloody matchday! 6 minutes ago, David N. said: Same issue here right now. Trying to access my site from Firefox on my iPhone redirects to mysite.com/admin/install which yields a blank page. similar address for me on my site on Safari on iPhone
Recommended Posts