Atlassian Jira, Confluence outage persists two days on
(2022/04/06)
- Reference: 1649274291
- News link: https://www.theregister.co.uk/2022/04/06/atlassian_jira_confluence_outage/
- Source link:
Atlassian's Jira and Confluence issue tracking and collaboration services have been down for some customers for two days now and the outage remains ongoing.
Starting around Tuesday at 0902 UTC, Atlassian's [1]status page reported problems affecting customers using Jira Work Management, Confluence, Jira Service Management, Jira Software, and Atlassian Access Cloud.
The company's last update, on today at 1204 UTC, says the issues are still being worked on.
[2]
'We continue to work on the resolution of the incident for a number of our Jira Work Management, Jira Service Management, Confluence, Jira Software, Atlassian Access, Jira Product Discovery, and Opsgenie Cloud customers," the company's latest status update says. "We can confirm this is not impacting all customers but remains a high priority for Atlassian as our dedicated team of SMEs work 24/7 to restore the sites as soon as possible. We will provide more detail as we progress through resolution."
[3]
[4]
At this time of this writing, about 1900 UTC, the service troubles remain unresolved.
The timing could not be much worse: Atlassian is presently hosting its [5]Team '22 event in Las Vegas, Nevada, where company presenters are talking-up "how teams collaborate, power digital transformation, and drive cultural change." Atlassian's customers have taken note of the coincidence.
[6]
"Watching [7]@Atlassian execs excitedly shill flashy new products at [8]#atlassianteam , on the second day of a Jira and Confluence outage, is so frustrating," wrote Joseph Clift, delivery lead for a London-based tech firm, [9]via Twitter . "I wish they'd just bin the roadmap and focus on service reliability and making existing products more performant!"
[10]Atlassian flags Bitbucket and Confluence Data Center flaws
[11]Atlassian warns of critical Confluence flaw
[12]You need to shift millions of repos to AWS without any downtime. How? Bitbucket engineering chief tells all
[13]CircleCI suffering 'degraded performance' for hours
The downtime already exceeds the 8 hours and 45 minutes allowed annually for Premium plans (99.9 percent uptime) under Atlassian's [14]Service Level Agreement , so affected customers may be entitled to refunds.
This perhaps explains why Wall Street does not appear to be impressed. Since April 5, when the service trouble began, Atlassian's stock has dropped from about $317 per share to about $287 at time of publication.
According to Atlassian, over 200,000 customers use its software. One of its avowed [15]values is "Don’t #@!% the customer."
Maintenance gone wrong
In a statement emailed to The Register , Atlassian attributed the problem to a script that went awry.
"While conducting a routine maintenance script, a small number of sites were unintentionally disabled which resulted in them being unable to access their products and data," a company spokesperson said.
"We know our customers rely on our products to get their work done, and we are sorry for the disruption this has caused. We are working 24/7 to restore products to full availability. Affected customers can reach out to us at [16]https://support.atlassian.com/contact if they have any questions or concerns."
[17]
Atlassian also provided a more extensive statement to the supposedly small number of affected customers that suggests it may be several days before everything returns to normal.
We're sorry your site is currently unavailable. While running a maintenance script, a small number of sites were disabled unintentionally. Our team identified this immediately and have been working hard to restore the product data and associated access. A dedicated team is working around the clock to restore the sites as soon as possible.
We expect the restoration efforts to continue for the next several days, and we are actively working on an estimate of when your site will be available to you again. We don't believe any data has been lost at this point. We can confirm this incident was not the result of a cyberattack and there has been no unauthorized access to your data.
As we work to restore access to your site, we will provide updates here every 6 hours, or sooner if we have a material update. Reach out to us if you have any questions or concerns.
If there's a lesson here, it may be that what happens in Vegas doesn't stay in Vegas if your cloud service is down. ®
Get our [18]Tech Resources
[1] https://status.atlassian.com/
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offprem/saas&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2Yk4NmC1VBdGQzLHqCze37gAAAIs&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offprem/saas&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44Yk4NmC1VBdGQzLHqCze37gAAAIs&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offprem/saas&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33Yk4NmC1VBdGQzLHqCze37gAAAIs&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[5] https://events.atlassian.com/team22
[6] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offprem/saas&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44Yk4NmC1VBdGQzLHqCze37gAAAIs&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[7] https://twitter.com/Atlassian
[8] https://twitter.com/hashtag/atlassianteam?src=hashtag_click
[9] https://twitter.com/jmdkc/status/1511743403943501830?s=20
[10] https://www.theregister.com/2022/03/25/atlassian_hazelcast/
[11] https://www.theregister.com/2021/08/26/atlassian_critical_confluence_flaw/
[12] https://www.theregister.com/2021/11/03/atlassian_aws/
[13] https://www.theregister.com/2022/04/06/circleci_outage/
[14] https://support.atlassian.com/subscriptions-and-billing/docs/service-level-agreement-for-atlassian-cloud-products/
[15] https://www.atlassian.com/company
[16] https://support.atlassian.com/contact
[17] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offprem/saas&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33Yk4NmC1VBdGQzLHqCze37gAAAIs&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[18] https://whitepapers.theregister.com/
Starting around Tuesday at 0902 UTC, Atlassian's [1]status page reported problems affecting customers using Jira Work Management, Confluence, Jira Service Management, Jira Software, and Atlassian Access Cloud.
The company's last update, on today at 1204 UTC, says the issues are still being worked on.
[2]
'We continue to work on the resolution of the incident for a number of our Jira Work Management, Jira Service Management, Confluence, Jira Software, Atlassian Access, Jira Product Discovery, and Opsgenie Cloud customers," the company's latest status update says. "We can confirm this is not impacting all customers but remains a high priority for Atlassian as our dedicated team of SMEs work 24/7 to restore the sites as soon as possible. We will provide more detail as we progress through resolution."
[3]
[4]
At this time of this writing, about 1900 UTC, the service troubles remain unresolved.
The timing could not be much worse: Atlassian is presently hosting its [5]Team '22 event in Las Vegas, Nevada, where company presenters are talking-up "how teams collaborate, power digital transformation, and drive cultural change." Atlassian's customers have taken note of the coincidence.
[6]
"Watching [7]@Atlassian execs excitedly shill flashy new products at [8]#atlassianteam , on the second day of a Jira and Confluence outage, is so frustrating," wrote Joseph Clift, delivery lead for a London-based tech firm, [9]via Twitter . "I wish they'd just bin the roadmap and focus on service reliability and making existing products more performant!"
[10]Atlassian flags Bitbucket and Confluence Data Center flaws
[11]Atlassian warns of critical Confluence flaw
[12]You need to shift millions of repos to AWS without any downtime. How? Bitbucket engineering chief tells all
[13]CircleCI suffering 'degraded performance' for hours
The downtime already exceeds the 8 hours and 45 minutes allowed annually for Premium plans (99.9 percent uptime) under Atlassian's [14]Service Level Agreement , so affected customers may be entitled to refunds.
This perhaps explains why Wall Street does not appear to be impressed. Since April 5, when the service trouble began, Atlassian's stock has dropped from about $317 per share to about $287 at time of publication.
According to Atlassian, over 200,000 customers use its software. One of its avowed [15]values is "Don’t #@!% the customer."
Maintenance gone wrong
In a statement emailed to The Register , Atlassian attributed the problem to a script that went awry.
"While conducting a routine maintenance script, a small number of sites were unintentionally disabled which resulted in them being unable to access their products and data," a company spokesperson said.
"We know our customers rely on our products to get their work done, and we are sorry for the disruption this has caused. We are working 24/7 to restore products to full availability. Affected customers can reach out to us at [16]https://support.atlassian.com/contact if they have any questions or concerns."
[17]
Atlassian also provided a more extensive statement to the supposedly small number of affected customers that suggests it may be several days before everything returns to normal.
We're sorry your site is currently unavailable. While running a maintenance script, a small number of sites were disabled unintentionally. Our team identified this immediately and have been working hard to restore the product data and associated access. A dedicated team is working around the clock to restore the sites as soon as possible.
We expect the restoration efforts to continue for the next several days, and we are actively working on an estimate of when your site will be available to you again. We don't believe any data has been lost at this point. We can confirm this incident was not the result of a cyberattack and there has been no unauthorized access to your data.
As we work to restore access to your site, we will provide updates here every 6 hours, or sooner if we have a material update. Reach out to us if you have any questions or concerns.
If there's a lesson here, it may be that what happens in Vegas doesn't stay in Vegas if your cloud service is down. ®
Get our [18]Tech Resources
[1] https://status.atlassian.com/
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offprem/saas&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2Yk4NmC1VBdGQzLHqCze37gAAAIs&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offprem/saas&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44Yk4NmC1VBdGQzLHqCze37gAAAIs&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offprem/saas&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33Yk4NmC1VBdGQzLHqCze37gAAAIs&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[5] https://events.atlassian.com/team22
[6] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offprem/saas&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44Yk4NmC1VBdGQzLHqCze37gAAAIs&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[7] https://twitter.com/Atlassian
[8] https://twitter.com/hashtag/atlassianteam?src=hashtag_click
[9] https://twitter.com/jmdkc/status/1511743403943501830?s=20
[10] https://www.theregister.com/2022/03/25/atlassian_hazelcast/
[11] https://www.theregister.com/2021/08/26/atlassian_critical_confluence_flaw/
[12] https://www.theregister.com/2021/11/03/atlassian_aws/
[13] https://www.theregister.com/2022/04/06/circleci_outage/
[14] https://support.atlassian.com/subscriptions-and-billing/docs/service-level-agreement-for-atlassian-cloud-products/
[15] https://www.atlassian.com/company
[16] https://support.atlassian.com/contact
[17] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offprem/saas&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33Yk4NmC1VBdGQzLHqCze37gAAAIs&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[18] https://whitepapers.theregister.com/
The vocabulary of our age
VoiceOfTruth
-> a small number of sites
It's always always a 'small number' or a synonym. Perhaps I can enlarge (geddit) the vocabulary of the people who write these status messages. Let me suggest bijou, dinky, teeny-weeny, stubby, piddling, measly...
Re: The vocabulary of our age
Gene Cash
I'm thinking "a small number" is a short phrase for "95% of our customer base"
Cloud vs On_Premise
jeff_w87
This is why moving your "stuff" to the cloud is probably not the best option for a lot of people. Centralized target for hackers of all stripes and a central point of failure when someone on staff screws up an update or maintenance activity. This happens way too often with all these big players and the fact that they promise resiliency with their cloud offerings, it just doesn't seem to pan out and customers are down for hours or days. Hopefully their customers in this case, since it looks like they've violated their SLA will be getting some major refunds, but I'm sure the CEO will still get his/her bonus for the year.
We continue to work on the resolution of the incident for a number of our Jira Work Management, Jira Service Management, Confluence, Jira Software, Atlassian Access, Jira Product Discovery, and Opsgenie Cloud customers. You can follow the progress in jira ticket...... oh wait.