Just experienced 10 minutes of downtime (Invision Cloud)

[David N.]

My site was down for the past 10 minutes. This is the same issue I (and others on the Invision Cloud) have reported many times before. When my site is down, I check and this site is down as well. 

I can't stress enough how fixing these reoccurring Invision Cloud server issues really need to be Invision's highest priority.

Moreover, as in prior instances of my site being down, the issue are tracked at https://status.invisioncommunity.com/ as issues affecting only invisioncommunity.com, and 100% of uptime which is clearly incorrect when my site was down for the exact same amount of time. 

 

Edited August 2 by David N.

[Jim M]

Sorry for the inconvenience. Our Cloud team is aware of the issue and working towards it.

[David N.]

Thank you for acknowledging the issue @Jim M.

[Jim M]

This should be resolved now.

[David N.]

Yes, it was resolved after 10mn, however the big issue is that the downtimes keep reoccurring on the Invision Community in the Cloud service on a regular basis. And on top of that the downtime isn't tracked by the status tracker, which claims there is 100% uptime. 

This is frustrating. I've been complaining about this for a long time, and so have many other users. 

Here's one other example, but there are many others. It's not an isolated event. Here again the user says he has, like me experienced the downtimes many times.

And here was the original thread where I used to keep track of all the downtimes. 😞 

 

Edited August 2 by David N.

[Jim M]

While I completely understand your frustration and no one gets that further than our Cloud team who have to wake up in the middle of the night, leave family gatherings, vacations, etc... to get part of Cloud back up and running again. Our team digests each issue and retrospectively sees what we can improve from it each time. They also work proactively to see that new issues don't bring us down in the future. There have just been a series of separate, unfortunate events that you're noticing here, and they have typically been extremely short. We're not talking CrowdStrike outage here 🙂 .

Keep in mind with our monitoring system, our Cloud is a distributed environment across many regions. You and your monitor likely are tied to a specific region and thus noticing when that region has had an issue. Whereas our monitors look at our Cloud as a whole. Our monitor did track the issue for our community here which is similar: invisioncommunity.com Status - Uptime.com . While our external monitors look at Cloud as whole (like many uptime monitors for Cloud platforms do), we do have internal monitors and alerts for specific regions, clusters, and all the way down to single databases. I would not be worried that we're missing when something goes down 🙂 . (We still appreciate any reports you do have when you go down as it is completely possible something could happen specific to your community that a monitor doesn't pick up.)

All and all, the positive news is even with the downtime yesterday, uptime for the month is well into the upper 99%. Which is a typical goal among hosting providers. With all this said though, we want to do better and as mentioned, continue to plan, learn from mistakes, etc... If you have concerns you would like to discuss in private or with a manager, you're more than welcome to send a contact us request in and we can address those.

[David N.]

Thank you for taking the time to answer, I really appreciate it. 

2 hours ago, Jim M said:

(We still appreciate any reports you do have when you go down as it is completely possible something could happen specific to your community that a monitor doesn't pick up.)

What I can tell you is that from my experience, every time I notice that my site is down, I come to invisioncommunity.com and it's down as well. I then use tools like https://downforeveryoneorjustme.com/ or https://www.uptrends.com/tools/uptime (that last one checks multiple locations worldwide) and often both sites are down worldwide - or in most worldwide locations (for this current issue I did not check uptrends). 

Once I finally notice that one of the websites (invisioncommunity.com or mine) is back up, the other is back up as well. 

I'll keep alerting you if I see any issues in the future. 

Thanks for all your work, it's truly appreciated. 

[David N.]

Again just now, my site and this site were both down in most regions around the world for 4 minutes. 

[teraßyte]

I guess that's why I was getting 504 timeouts for a while then: 

 

The site seems fast again now. 🤔

 

 

[Marc]

Will ensure people are aware, thank you

[David N.]

My site (and this site) are both very slow this morning. 

[Jim M]

Apologies for the inconvenience there. Our Cloud team deployed a fix which should resolve these issues. 

[bearback]

thought it was just me so just came back later. Seams ok now though 😉 

The site slowness or unavailable are notably getting regular. although are only for a short time.

[David N.]

My site was just down again, and now it's generally slow. 

[Marc]

We are aware of some issues that were happening around 45 mins ago, that should be resolved. Please let us know if you see any further issues

[Marc]

For issues on the cloud platform itself, you are best to create a ticket when you can. Just so the correct people get that right away 🙂 

[Max]

We have been seeing some issues on Sunday and again tonight.

[Marc]

We are aware there were some issues last night, we are in the process of investigating. The issue itself however, is now resolved

[David N.]

New issues again now. It's hard to accept how frequently the Invision Cloud is down. 

On 9/12/2024 at 5:09 PM, Marc said:

For issues on the cloud platform itself, you are best to create a ticket when you can. Just so the correct people get that right away 🙂 

By the time the team is alerted the issues are generally resolved. The issue isn't with resolving these downtimes, it's that the downtimes are so frequent, no matter how short-lived they are. 

[Jelly Belly™]

another 10 minutes of downtime and now running painfully slow 🤔

Edited September 22 by Jelly Belly™

[Jim M]

We’re aware of the issue and looking into it. Sorry for the inconvenience. 

[Jelly Belly™]

and again

 

 

[Como]

2 minutes ago, Jelly Belly™ said:

and again

 

 

I'm here to report the precise same error.

[Como]

It's fine now.

[Marc]

We're aware and taking action to address the cause of these