Microsoft customers locked out of Teams, Office, Xbox, Dynamics – and Azure Active Directory breakdown blamed
- Reference: 1615843140
- News link: https://www.theregister.co.uk/2021/03/15/microsoft_azure_outage/
- Source link:
"Starting at approximately 1915 UTC on 15 Mar 2021, a subset of customers may experience issues authenticating into Microsoft services, including Microsoft Teams, Office and/or Dynamics, Xbox Live, and the Azure Portal," Microsoft said on its [1]Azure status page .
[2]
Other services that utilize AAD, such as Microsoft Teams, Forms, Exchange Online, Azure Kubernetes Service, Intune, and Yammer are also said by users to be affected. "Teams, Azure, the whole nine yards," as one Register reader told us.
Two hours on and counting, the problem remains. The incident recalls [3]a similar AAD incident in September that led to a three-hour service outage.
[4]
Microsoft says engineering teams are investigating but as yet there's no estimate for when service will be restored.
Federal Reserve falls over in massive hours-long tech outage, knocks down US inter-bank transfer system [5]READ MORE
Microsoft Office 365 [6]reported that users are having problems accessing various Microsoft 365, Azure, and Dynamics 365 services, including the Service Health Dashboard. The Windows titan said the issue appears to be affecting users worldwide, though how many remains unclear.
At 2111 UTC, Microsoft [7]said ,"We've identified an issue with a recent change to an authentication system. We’re rolling back the update to mitigate impact, which we expect will take approximately 15 minutes."
If only it were that simple. Shortly after that, Microsoft [8]warned , "The process to roll back the change is taking longer than expected. We'll provide an ETA as soon as one becomes available." ®
Bootnote
Microsoft unfortunately scheduled, at best, one of its [9]twee little tweets about its online services to go live during today's outage. That post was quickly deleted when Microsofties realized the optics here weren't good. "Could this be your next Microsoft Teams background?" the software giant asked, with the classic Windows XP background, the one with the green hills, as the suggestion.
[10]
At the moment, a poorly lit empty conference room is about right for Teams.
Get our [11]Tech Resources
[1] https://status.azure.com/en-us/status
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offprem/saas&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2YE-nCemeQdF3iOBC1IxKlAAAAA4&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[3] https://www.theregister.com/2020/12/15/auth_failure_google_and_microsoft/
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offprem/saas&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33YE-nCemeQdF3iOBC1IxKlAAAAA4&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[5] https://www.theregister.com/2021/02/24/federal_reserve_outage/
[6] https://twitter.com/MSFT365Status/status/1371546946263916545?s=20
[7] https://twitter.com/MSFT365Status/status/1371554704518352896?s=20
[8] https://twitter.com/MSFT365Status/status/1371562998561579009?s=20
[9] https://regmedia.co.uk/2021/03/15/screenshot_ms_teams_deleted_tweet.jpg
[10] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offprem/saas&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YE-nCemeQdF3iOBC1IxKlAAAAA4&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[11] https://whitepapers.theregister.com/
Re: 365, 364, 363...
To paraphrase Douglas Adams
We have a new normality. I repeat, we have a new normality. Anything that still doesn't work is therefore your own problem.
SANS
French - without
English - Software As a Non-Service
I guess they are going to miss their SLA?
https://www.theregister.com/2021/01/06/four_nines_azure_active_directory_sla/
Re: I guess they are going to miss their SLA?
Open 24hours (although not in a row)
Re: I guess they are going to miss their SLA?
I thought the same thing... But that doesn't come into effect for another couple of weeks!
Having said that, they still missed the 99.9% one anyway!
A system restore can take a while but generally Microsoft system restores normally work well - it's the highlight in a set of operating systems that suck. We'll all be back to normal in a few hours with any luck.
Well tomorrow is gonna suck.....
I Hope El Reg Stays on This
The gremlins started several hours before 19:15 UTC. From noon Eastern time in US (17:00 UTC) onwards I was trying to figure out why access to an Azure Key Vault that worked yesterday didn't work today. When I finally (~5:00P) decided to look at the status in the Azure Portal, I find that the Portal says I have no subscription, hence no resources, even though it also says I am logged in. Not a good day.
Tell me again why putting everything in the Cloud is such a brilliant idea.
Maybe...
They need "Google’s site reliability senseis ... to train [them] in their mystical ways."
I love it when ElReg posts come together.
Have they tried etc etc and on again.
Put all of your eggs in someone else's basket, they said. It'll be fine, they said.
Yep, it's affected us...
But not a peep from our on-site business continuity peeps. I guess they can't send anything because Microsoft?
Subsets...
"Starting at approximately 1915 UTC on 15 Mar 2021, a subset of customers may experience issues authenticating into Microsoft services, including Microsoft Teams, Office and/or Dynamics, Xbox Live, and the Azure Portal,"
A set with N elements has 2 N subsets if we include the null set and the set itself, so the above quote isn't really saying a lot.
I wonder why Microsoft does not become the first large computing supply company to actually give a very rough percentage of user accounts affected? Think of the kudos they would acquire through transparency.
365, 364, 363...
-31415926535897932384626433832795 and falling...