Want to deploy a new Windows VM on Microsoft Azure? Today might not be your lucky day
(2021/10/13)
- Reference: 1634126711
- News link: https://www.theregister.co.uk/2021/10/13/azure_vm_glitch/
- Source link:
It is shaping up to be a Black Wednesday for providers of online services after Microsoft Azure Virtual Machines users suffered lingering near-global glitches that prevented them from spinning up new Windows-based systems.
According to Microsoft's [1]status page , the downtime happened "as early as" 05:12 UTC today and has yet to be fixed, with the company saying it is "Applying Mitigation", which we are sure is of some comfort to irritated users.
The message states that a "subset of customers using Windows Virtual Machines may experience failure notifications when performing service management operations – such as start, create, update, delete."
[2]
As such, "deployments of new VMs and any updates to extensions may fail. Non-Windows Virtual Machines, and existing running Windows Virtual Machines should not be impacted by this issue. Services with dependencies on Windows VMs may also experience failures when creating resources."
[3]
[4]
Services are impacted everywhere from the Americas, to Europe, the Middle East, Africa, and Asia Pacific. Azure Government and Azure China were not listed as running borked VM services.
The Azure Support page on Twitter made no mention of the incident but [5]confirmed to a customer it was "aware of this issue" and that "engineering teams are actively collaborating to resolve this."
[6]
As of 11:03 UTC, Microsoft said it had "identified that calls made during service management operations are failing due to a required artifact version not returning as expected during query.
[7]Instagram is testing feature that tells panicking users the service is broken again
[8]Xero, Slack suffer outages just as Let's Encrypt root cert expiry downs other websites, services
[9]AWS US East region endures eight-hour wobble thanks to 'Stuck IO' in Elastic Block Store
[10]Tech contractors fume over payday outage at Giant Pay after it sniffs 'suspicious activity'
[11]Imagine a fiber optic cable that can sense it's about to be dug up and send a warning
"The failure shows that that a required extension cannot be located. We are currently implementing a mitigation option to force a refresh of the extension and are seeing signs of recovery where mitigation has been deployed. We expect recovery to be observed as the mitigation progresses across regions. The next update will be provided within 60 minutes, or as events warrant."
So sysadmins, it might be best to explain the situation to your users and then pop off for some lunch. It'll all be fixed by the time you return, right? At least all of Microsoft's other services appear to be working… for now.
As [12]revealed earlier today , European great cloud hope OVH suffered some downtime after a planned network reconfiguration turned into something less routine, with human error blamed. ®
Get our [13]Tech Resources
[1] https://status.azure.com/status
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/virtualization&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2YWcCtGJ@Jg0MFVrGqH-VTgAAAE8&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/virtualization&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YWcCtGJ@Jg0MFVrGqH-VTgAAAE8&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/virtualization&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33YWcCtGJ@Jg0MFVrGqH-VTgAAAE8&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[5] https://twitter.com/AzureSupport/status/1448229496130256897?s=20
[6] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/virtualization&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YWcCtGJ@Jg0MFVrGqH-VTgAAAE8&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[7] https://www.theregister.com/2021/10/12/instagram_outage_warning_feature/
[8] https://www.theregister.com/2021/09/30/lets_encrypt_xero_slack_outages/
[9] https://www.theregister.com/2021/09/28/aws_east_brownout/
[10] https://www.theregister.com/2021/09/24/giant_pay_outage_uk/
[11] https://www.theregister.com/2021/09/23/vibration_sensing_optic_fibers_challenge_iot_sensors/
[12] https://www.theregister.com/2021/10/13/ovh_outage/
[13] https://whitepapers.theregister.com/
According to Microsoft's [1]status page , the downtime happened "as early as" 05:12 UTC today and has yet to be fixed, with the company saying it is "Applying Mitigation", which we are sure is of some comfort to irritated users.
The message states that a "subset of customers using Windows Virtual Machines may experience failure notifications when performing service management operations – such as start, create, update, delete."
[2]
As such, "deployments of new VMs and any updates to extensions may fail. Non-Windows Virtual Machines, and existing running Windows Virtual Machines should not be impacted by this issue. Services with dependencies on Windows VMs may also experience failures when creating resources."
[3]
[4]
Services are impacted everywhere from the Americas, to Europe, the Middle East, Africa, and Asia Pacific. Azure Government and Azure China were not listed as running borked VM services.
The Azure Support page on Twitter made no mention of the incident but [5]confirmed to a customer it was "aware of this issue" and that "engineering teams are actively collaborating to resolve this."
[6]
As of 11:03 UTC, Microsoft said it had "identified that calls made during service management operations are failing due to a required artifact version not returning as expected during query.
[7]Instagram is testing feature that tells panicking users the service is broken again
[8]Xero, Slack suffer outages just as Let's Encrypt root cert expiry downs other websites, services
[9]AWS US East region endures eight-hour wobble thanks to 'Stuck IO' in Elastic Block Store
[10]Tech contractors fume over payday outage at Giant Pay after it sniffs 'suspicious activity'
[11]Imagine a fiber optic cable that can sense it's about to be dug up and send a warning
"The failure shows that that a required extension cannot be located. We are currently implementing a mitigation option to force a refresh of the extension and are seeing signs of recovery where mitigation has been deployed. We expect recovery to be observed as the mitigation progresses across regions. The next update will be provided within 60 minutes, or as events warrant."
So sysadmins, it might be best to explain the situation to your users and then pop off for some lunch. It'll all be fixed by the time you return, right? At least all of Microsoft's other services appear to be working… for now.
As [12]revealed earlier today , European great cloud hope OVH suffered some downtime after a planned network reconfiguration turned into something less routine, with human error blamed. ®
Get our [13]Tech Resources
[1] https://status.azure.com/status
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/virtualization&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2YWcCtGJ@Jg0MFVrGqH-VTgAAAE8&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/virtualization&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YWcCtGJ@Jg0MFVrGqH-VTgAAAE8&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/virtualization&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33YWcCtGJ@Jg0MFVrGqH-VTgAAAE8&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[5] https://twitter.com/AzureSupport/status/1448229496130256897?s=20
[6] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/virtualization&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YWcCtGJ@Jg0MFVrGqH-VTgAAAE8&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[7] https://www.theregister.com/2021/10/12/instagram_outage_warning_feature/
[8] https://www.theregister.com/2021/09/30/lets_encrypt_xero_slack_outages/
[9] https://www.theregister.com/2021/09/28/aws_east_brownout/
[10] https://www.theregister.com/2021/09/24/giant_pay_outage_uk/
[11] https://www.theregister.com/2021/09/23/vibration_sensing_optic_fibers_challenge_iot_sensors/
[12] https://www.theregister.com/2021/10/13/ovh_outage/
[13] https://whitepapers.theregister.com/
Joining Office and Windows .....?
PeterM42
.........364½ or less
Re: Joining Office and Windows .....?
katrinab
I prefer to call it Office 356.
Anonymous Coward
They also had issues with autopilot pre-provisioning / auto-deployment this morning too.. so not just a VM thing.
annnnd...
that's it back.
Wondering if any VMs left in a "Failed" state accrued cost, as technically they weren't deallocated?
Regardless... hours that took! Very little in the way of useful updates, and status.azure.com was over an hour before it mentioned anything. Not very impressive.