Where are we now? Microsoft 363? 362? We've lost count because Exchange Online isn't playing nicely this morning
(2020/10/01)
- Reference: 1601547996
- News link: https://www.theregister.co.uk/2020/10/01/microsoft_exchange_online_outage/
- Source link:
Microsoft's Exchange Online service fell over in the early hours of this morning.
The company's status orifice [1]initially figured that the problem mainly affected users in India as its engineers noted the wobbling at around 0700 BST. Just under an hour later Microsoft had to [2]admit it was another global outage.
It is the latest in what appears to be a battle of who can annoy their users more. Azure [3]suffered a major outage earlier this week. Rival Apple then hit back [4]with its own wobble before Microsoft continued the TITSUP* tit-for-tat this morning.
The mystery issue afflicted apps using Exchange Online protocols, including Outlook on the desktop, mobile devices, and "those dependant on REST functionality," [5]Microsoft said . The company was taking a long hard look at what it might have changed in recent days that might have broken something.
Initial thoughts centred around a traffic routing problem, meaning that the gods of downtime would only bless those unfortunate enough to find themselves on the afflicted infrastructure.
Microsoft eventually [6]pinned the blame on a "recent configuration update", rolled it back and, at time of writing, was "monitoring the service" for signs of life.
In the meantime, folk were left twiddling their thumbs and pondering the wisdom of a leap cloudwards versus an on-premises service, staffed by engineers that could be yelled at face to face.
Users reported problems sending and receiving mails, accessing folders and attachments, or even being able to log into their services. Some noted difficulty synchronising between Azure Active Directory and Exchange Online while there were also isolated reports of SharePoint and Teams struck by the curse of bork.
Not all users were affected, but for some it is the latest in a series of cock-ups at Microsoft's end, which will only serve to undermine faith in its cloudy productivity services. Email is, after all, a critical communication medium (no matter how much Slack wishes it wasn't).
While Microsoft has yet to explain itself (we suspect the postmortem for this week is going to be a big'un), users have turned the speculatogun on to the company.
Aha, so the DEV team is testing in production.. — Vishal Chotoe (@ViC_0508) [7]October 1, 2020
Let they who have not suffered the bowel-loosening sensation of accidentally pushing dev code to production cast the first stone. Not that we'd dream of suggesting such slipshod antics from the Redmond gang.
Instead, we'll leave you with an emission from its marketing tentacle, mere hours before the wheels came off.
Exceed customer expectations—even during times of rapid change—using digital sales and service solutions. Learn more: [8]https://t.co/bgBIdYF2Wd [9]#ResilienceAtWork [10]pic.twitter.com/Ul7gs8I5XS — Microsoft 365 (@Microsoft365) [11]September 30, 2020
Well, the company has certainly exceeded expectations in terms of outage count. Or has it?
A hat-tip to Register reader David for the heads-up.
Microsoft sent us a statement:
“Our engineers are addressing an issue that affected some Microsoft 365 services. Services are starting to improve as a result of the measures we have implemented.” ®
* Total Inability To Serve User Protocols
Get our [12]Tech Resources
[1] https://twitter.com/MSFT365Status/status/1311547386901098499
[2] https://twitter.com/MSFT365Status/status/1311558919731458048
[3] https://www.theregister.com/2020/09/28/microsoft_azure_office_outlook_outage/
[4] https://www.theregister.com/2020/09/30/apple_services_down/
[5] https://twitter.com/MSFT365Status/status/1311574577542299649
[6] https://twitter.com/MSFT365Status/status/1311600345454387200
[7] https://twitter.com/ViC_0508/status/1311566034474762242?ref_src=twsrc%5Etfw
[8] https://t.co/bgBIdYF2Wd
[9] https://twitter.com/hashtag/ResilienceAtWork?src=hash&ref_src=twsrc%5Etfw
[10] https://t.co/Ul7gs8I5XS
[11] https://twitter.com/Microsoft365/status/1311440737465257986?ref_src=twsrc%5Etfw
[12] https://whitepapers.theregister.com/
The company's status orifice [1]initially figured that the problem mainly affected users in India as its engineers noted the wobbling at around 0700 BST. Just under an hour later Microsoft had to [2]admit it was another global outage.
It is the latest in what appears to be a battle of who can annoy their users more. Azure [3]suffered a major outage earlier this week. Rival Apple then hit back [4]with its own wobble before Microsoft continued the TITSUP* tit-for-tat this morning.
The mystery issue afflicted apps using Exchange Online protocols, including Outlook on the desktop, mobile devices, and "those dependant on REST functionality," [5]Microsoft said . The company was taking a long hard look at what it might have changed in recent days that might have broken something.
Initial thoughts centred around a traffic routing problem, meaning that the gods of downtime would only bless those unfortunate enough to find themselves on the afflicted infrastructure.
Microsoft eventually [6]pinned the blame on a "recent configuration update", rolled it back and, at time of writing, was "monitoring the service" for signs of life.
In the meantime, folk were left twiddling their thumbs and pondering the wisdom of a leap cloudwards versus an on-premises service, staffed by engineers that could be yelled at face to face.
Users reported problems sending and receiving mails, accessing folders and attachments, or even being able to log into their services. Some noted difficulty synchronising between Azure Active Directory and Exchange Online while there were also isolated reports of SharePoint and Teams struck by the curse of bork.
Not all users were affected, but for some it is the latest in a series of cock-ups at Microsoft's end, which will only serve to undermine faith in its cloudy productivity services. Email is, after all, a critical communication medium (no matter how much Slack wishes it wasn't).
While Microsoft has yet to explain itself (we suspect the postmortem for this week is going to be a big'un), users have turned the speculatogun on to the company.
Aha, so the DEV team is testing in production.. — Vishal Chotoe (@ViC_0508) [7]October 1, 2020
Let they who have not suffered the bowel-loosening sensation of accidentally pushing dev code to production cast the first stone. Not that we'd dream of suggesting such slipshod antics from the Redmond gang.
Instead, we'll leave you with an emission from its marketing tentacle, mere hours before the wheels came off.
Exceed customer expectations—even during times of rapid change—using digital sales and service solutions. Learn more: [8]https://t.co/bgBIdYF2Wd [9]#ResilienceAtWork [10]pic.twitter.com/Ul7gs8I5XS — Microsoft 365 (@Microsoft365) [11]September 30, 2020
Well, the company has certainly exceeded expectations in terms of outage count. Or has it?
A hat-tip to Register reader David for the heads-up.
Microsoft sent us a statement:
“Our engineers are addressing an issue that affected some Microsoft 365 services. Services are starting to improve as a result of the measures we have implemented.” ®
* Total Inability To Serve User Protocols
Get our [12]Tech Resources
[1] https://twitter.com/MSFT365Status/status/1311547386901098499
[2] https://twitter.com/MSFT365Status/status/1311558919731458048
[3] https://www.theregister.com/2020/09/28/microsoft_azure_office_outlook_outage/
[4] https://www.theregister.com/2020/09/30/apple_services_down/
[5] https://twitter.com/MSFT365Status/status/1311574577542299649
[6] https://twitter.com/MSFT365Status/status/1311600345454387200
[7] https://twitter.com/ViC_0508/status/1311566034474762242?ref_src=twsrc%5Etfw
[8] https://t.co/bgBIdYF2Wd
[9] https://twitter.com/hashtag/ResilienceAtWork?src=hash&ref_src=twsrc%5Etfw
[10] https://t.co/Ul7gs8I5XS
[11] https://twitter.com/Microsoft365/status/1311440737465257986?ref_src=twsrc%5Etfw
[12] https://whitepapers.theregister.com/
katrinab
I recon we must be at about 340 by now.
365 allows for one day of downtime in 2020, as it is a leap year.
mark l 2
"Aha, so the DEV team is testing in production.."
Well that is how Microsoft test updates Windows 10 by pushing them out and waiting to see if people report breakages, so why not do the same with Office 365?
Saw it here
Yep, e-mail for my wife was offline this morning - although my own company e-mail continued to work fine. Interestingly it also took out Teams as well for her. Not a great start to the day when you've got a lot of meetings and other bits scheduled...