Worldwide Google services – from GCP to G Suite – hit with the outage stick
- Reference: 1597915104
- News link: https://www.theregister.co.uk/2020/08/20/gmail_outage/
- Source link:
The main issue appears to be with cloud infrastructure components, and Google Kubernetes Engine is also having problems. GKE clusters using node auto-provisioning are "becoming stuck during node version upgrades", the firm said in a recent update. The cloud giant has temporarily disabled node auto-upgrades.
By 07:56 UTC (08:56 UK time), the cloud crew said they were seeing a decrease in error rates and working on mitigation, but the problems are still lingering, as evidenced by multiple complaints across social media.
Ouch ! The day is going to be tough... [2]#GCP [3]pic.twitter.com/oDPCKArycH — Pierre Lannoy (@PierreLannoy) [4]August 20, 2020
On the office side, the [5]G Suite Status Dashboard drones have plastered the yellow traffic light stickers of non-productivity on the status page as world+dog heads into and out of its home office.
Let's face it, we never leave our home office.
As the UK enters its morning meetings and Australia tries to fire off its last messages of the day, Reg readers have also told us they're unable to send email, with one claiming they can't even log in into their Gmail account. Users on social media have reported "missing emails" and not being able upload files. The outages appear to be patchy, but worldwide at this point, although many will still find the platform is working for them.
Service disruptions are spread out across all of the cloud giant's key business productivity suite applications, including Gmail, Google Drive, Docs, Chat, Meet, Keep and Voice – all of which are covered by the G Suite Service Level Agreement.
Third-party tracker [6]DownDetector traced complaints from thousands of users scattered across the geographies, with the [7]ones in time zones in the daylight hours over-represented .
The G Suite issues appeared to begin at 5:09 UTC (6:09 UK time). At 07:21 UTC (8:21 UK time) the cloud 'n' ads giant [8]admitted to "Gmail sending issues, Meet recording issues, Creating files issues in Drive, CSV user upload issues in Admin Console, Posting message issues in Google Chat" in a [9]status page update . It said it would provide more information about the problem by 08:00 UTC (09:00 UK), but that deadline has since been pushed back several times.
The timing is especially poor as the world's office drones are having to contend with a [10]concurrent Slack outage , which began at 5:13 UTC and was still ongoing at the time of publication.
We've asked Google for comment. ®
Updated at 11:18 UTC to add
The G-Suite team has marked the issue " [11]resolved ", with [12]GCP following shortly after . If that's not the case for you, let us know [13]here .
Get our [14]Tech Resources
[1] https://status.cloud.google.com/
[2] https://twitter.com/hashtag/GCP?src=hash&ref_src=twsrc%5Etfw
[3] https://t.co/oDPCKArycH
[4] https://twitter.com/PierreLannoy/status/1296366910779654144?ref_src=twsrc%5Etfw
[5] https://www.google.com/appsstatus#hl=en-GB&v=status
[6] https://downdetector.com/status/gmail/map/
[7] https://www.timeanddate.com/time/map/
[8] https://www.google.com/appsstatus#hl=en-GB&v=issue&sid=1&iid=a45de3b26d6c5872f4cfe8e3424d7a82
[9] https://www.google.com/appsstatus#hl=en
[10] https://status.slack.com/2020-08/c9cf7aaf51ffda19
[11] https://www.google.com/appsstatus#hl=en-GB&v=issue&sid=1&iid=a45de3b26d6c5872f4cfe8e3424d7a82
[12] https://status.cloud.google.com/incident/zall/20008
[13] mailto:jkarabus@sitpub.com
[14] https://whitepapers.theregister.com/
Re: Oh my, Google Cloud and Slack at the same time
It's Storm Ellen making it rain!
Re: Oh my, Google Cloud and Slack at the same time
We used to talk about five nines availability - seems like that's last millennium's history.
They decided to improve it to nine fives.
Re: Oh my, Google Cloud and Slack at the same time
GSuite manages upwards of four nines usually, but falls just short of five. Generally you don't notice the small wobbles it has.
I very much doubt most businesses ran an email system with greater uptime, back in the days when running your own email system was seen to be a good idea.
Smiley
Aah, the wonders of having your systems running on someone else's computer somewhere.
Smiling face, because I'm self-hosting a Nextcloud server on Raspberry Pi 4.
Re: Nextcloud server on Raspberry Pi 4.
Only a single Pi 4? Tut-tut. Have you got a decent CPU heatsink as they do tend to run a tad hot at times.
I would have hoped that you would have had a beowolf cluster of them by now!
Re: Smiley
Wow, all your users must be really enjoying all that storage and super fast performance.
A clear case of all your eggs
in one basket
As has been said, we used to measure uptimes as good 99.99999%. Now? 95%
But hey, this cloudy stuff is soooooooooooo cheap. Too bad that your business has gone TITSUP (again). What price that eh?
Posting AC as my current employer has announced that it will soon be Google this and Google that for everything. Better start dusting off my CV as they won't survive BREXIT day as there won't be anyone left who understands what system does what at the current rate of attrition.
Oh my, Google Cloud and Slack at the same time
It seems that all this cloudy stuff is really, really hard to keep working.
We used to talk about five nines availability - seems like that's last millennium's history.