News: 1644945247

  ARM Give a man a fire and he's warm for a day, but set fire to him and he's warm for the rest of his life (Terry Pratchett, Jingo)

Users report trouble with Azure DevOps services

(2022/02/15)


Azure DevOps services in Europe have slowed and in some cases are unavailable, resulting in a number of the platform's offerings being broken for local users.

Problems began on Tuesday afternoon, UK time, taking out (or rather "degrading") some fairly critical services. Boards, Repos, Pipelines and Test Plans have all been affected, although currently only for users in Europe.

The issues have hit affected users at pretty much every point in the DevOps lifecycle. This includes capturing data using boards on the service:

I tend to capture notes, bugs, etc using [1]@AzureDevOps boards while on a call/demo with customers. This morning, several of the items got lost due to Boards having an issue 😢

Don't accept data if you can't ensure it can be persisted. — Sean Feldman (@sfeldman) [2]February 15, 2022

And dealing with repos:

Is it just me or is Azure DevOps super slow/down? [3]@AzureDevOps [4]@AzureSupport

Can't pull git changes either, it seems. — Jos Koelewijn (@Jawz_84) [5]February 15, 2022

As for what happened to the service, Microsoft isn't saying much. The Register asked the company for more information and if there was a likelihood the issue might spread to other regions, but we have yet to receive a response.

[6]Microsoft prepares for its staff to return to Washington sites

[7]20 years of .NET: Reflecting on Microsoft's not-Java

[8]Microsoft Teams unable to send and receive calls for some after update

[9]Microsoft veteran demystifies Abort, Retry, Fail? DOS error

Slightly worryingly, a good hour and a half after the service's [10]status page admitted that there were problems due to "an event impacting Azure DevOps" the engineers looking into the issue seemed mystified by the problem, reporting that: "The root cause is not fully understood at this time," and "We currently have no estimated time for resolution."

[11]

Click to enlarge

Yikes.

It's all a bit unfortunate, for both the service and the affected customers. The service's Hosted Pools [12]came under attack last year by what Microsoft delicately called "abusers."

[13]

An anonymous source used an altogether ruder term for the crypto-mining miscreants, but told us that this time around it didn't look like the same issue (although in the absence of an official comment from Microsoft all bets are off).

[14]

Things remain wobbly at time of writing. So crack open notepad.exe for your reports and dust off that copy of SourceSafe. What could possibly go wrong? ®

Get our [15]Tech Resources



[1] https://twitter.com/AzureDevOps?ref_src=twsrc%5Etfw

[2] https://twitter.com/sfeldman/status/1493616049983422464?ref_src=twsrc%5Etfw

[3] https://twitter.com/AzureDevOps?ref_src=twsrc%5Etfw

[4] https://twitter.com/AzureSupport?ref_src=twsrc%5Etfw

[5] https://twitter.com/Jawz_84/status/1493597333233315843?ref_src=twsrc%5Etfw

[6] https://www.theregister.com/2022/02/15/microsoft_open_office/

[7] https://www.theregister.com/2022/02/15/20_years_of_net_reflecting/

[8] https://www.theregister.com/2022/02/15/microsoft_teams_outage/

[9] https://www.theregister.com/2022/02/14/dave_plummer_abort_retry_fail/

[10] https://status.dev.azure.com/

[11] https://regmedia.co.uk/2022/02/15/azure_devops_status.png

[12] https://www.theregister.com/2021/04/07/azure_devops/

[13] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/devops&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2YgwwmFk8curQ1UNHATzdowAAAEI&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0

[14] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/devops&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YgwwmFk8curQ1UNHATzdowAAAEI&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[15] https://whitepapers.theregister.com/



If Microsoft are being consistent

Anonymous Coward

It will be due to "... a recent change / recently enabled flight which is now being reverted..."

Just give Alice some pencils and she will stay busy for hours.