Study finds 268% higher failure rates for Agile software projects
(2024/06/05)
- Reference: 1717579513
- News link: https://www.theregister.co.uk/2024/06/05/agile_failure_rates/
- Source link:
A study has found that projects adopting Agile practices are 268 percent more likely to fail than those that do not.
Even though the [1]research commissioned by consultancy Engprax could be seen as a thinly veiled plug for Impact Engineering methodology, it feeds into the suspicion that the Agile Manifesto [2]might not be all it's cracked up to be .
The study's fieldwork was conducted between May 3 and May 7 with 600 software engineers (250 in the UK and 350 in the US) participating. One standout statistic was that projects with clear requirements documented before development started were 97 percent more likely to succeed. In comparison, one of the four pillars of the Agile Manifesto is "Working Software over Comprehensive Documentation."
[3]
According to the study, putting a specification in place before development begins can result in a 50 percent increase in success, and making sure the requirements are accurate to the real-world problem can lead to a 57 percent increase.
[4]
[5]
Dr Junade Ali, author of Impact Engineering, said: "With 65 percent of projects adopting Agile practices failing to be delivered on time, it's time to question Agile's cult following.
"Our research has shown that what matters when it comes to delivering high-quality software on time and within budget is a robust requirements engineering process and having the psychological safety to discuss and solve problems when they emerge, whilst taking steps to prevent developer burnout."
[6]
The Agile Manifesto has been criticized over the years. The infamous UK Post Office Horizon IT system was an early large-scale project to use the methodology, although blaming an Agile approach for the system's design flaws seems a bit of a stretch.
[7]Report: 83% of UK software engineers suffer burnout, COVID-19 made it worse
[8]'Business folk often don't understand what developers do...' Twilio boss on the chasm that holds companies back
[9]IBM warns Global Tech Services staff that 346 UK heads will roll in latest redundancy action
[10]Erik Meijer: AGILE must be destroyed, once and for all
It is also easy to forget that other methodologies have their own flaws. Waterfall, for example, uses a succession of documented phases, of which coding is only a part. While simple to understand and manage, Waterfall can also be slow and costly, with changes challenging to implement.
Hence, there is a tendency for teams to look for alternatives.
Projects where engineers felt they had the freedom to discuss and address problems were 87 percent more likely to succeed. Worryingly, workers in the UK were 13 percent less likely to feel they could discuss problems than those in the US, according to the study.
Many sins of today's tech world tend to be attributed to the Agile Manifesto. A neverending stream of patches indicates that quality might not be what it once was, and code turning up in an unfinished or ill-considered state have all been attributed to Agile practices.
[11]
One Agile developer criticized the daily stand-up element, describing it to The Register as "a feast of regurgitation."
However, while the Agile Manifesto might have its problems, those stem more from its implementation rather than the principles themselves. "We don't need a test team because we're Agile" is a cost-saving abdication of responsibility.
In highlighting the need to understand the requirements before development begins, the research charts a path between Agile purists and Waterfall advocates. ®
Get our [12]Tech Resources
[1] https://www.engprax.com/post/268-higher-failure-rates-for-agile-software-projects-study-finds
[2] https://www.theregister.com/2015/01/08/erik_meijer_agile_is_a_cancer_we_have_to_eliminate_from_the_industry/
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZmA3QDOIvytDemTeTcCstQAAAI8&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZmA3QDOIvytDemTeTcCstQAAAI8&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZmA3QDOIvytDemTeTcCstQAAAI8&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[6] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZmA3QDOIvytDemTeTcCstQAAAI8&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[7] https://www.theregister.com/2021/07/14/uk_developer_burnout/
[8] https://www.theregister.com/2021/03/17/twilio_jeff_lawson_on_developers/
[9] https://www.theregister.com/2020/12/01/ibm_global_tech_services_uk_layoffs/
[10] https://www.theregister.com/2015/01/08/erik_meijer_agile_is_a_cancer_we_have_to_eliminate_from_the_industry/
[11] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZmA3QDOIvytDemTeTcCstQAAAI8&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[12] https://whitepapers.theregister.com/
Even though the [1]research commissioned by consultancy Engprax could be seen as a thinly veiled plug for Impact Engineering methodology, it feeds into the suspicion that the Agile Manifesto [2]might not be all it's cracked up to be .
The study's fieldwork was conducted between May 3 and May 7 with 600 software engineers (250 in the UK and 350 in the US) participating. One standout statistic was that projects with clear requirements documented before development started were 97 percent more likely to succeed. In comparison, one of the four pillars of the Agile Manifesto is "Working Software over Comprehensive Documentation."
[3]
According to the study, putting a specification in place before development begins can result in a 50 percent increase in success, and making sure the requirements are accurate to the real-world problem can lead to a 57 percent increase.
[4]
[5]
Dr Junade Ali, author of Impact Engineering, said: "With 65 percent of projects adopting Agile practices failing to be delivered on time, it's time to question Agile's cult following.
"Our research has shown that what matters when it comes to delivering high-quality software on time and within budget is a robust requirements engineering process and having the psychological safety to discuss and solve problems when they emerge, whilst taking steps to prevent developer burnout."
[6]
The Agile Manifesto has been criticized over the years. The infamous UK Post Office Horizon IT system was an early large-scale project to use the methodology, although blaming an Agile approach for the system's design flaws seems a bit of a stretch.
[7]Report: 83% of UK software engineers suffer burnout, COVID-19 made it worse
[8]'Business folk often don't understand what developers do...' Twilio boss on the chasm that holds companies back
[9]IBM warns Global Tech Services staff that 346 UK heads will roll in latest redundancy action
[10]Erik Meijer: AGILE must be destroyed, once and for all
It is also easy to forget that other methodologies have their own flaws. Waterfall, for example, uses a succession of documented phases, of which coding is only a part. While simple to understand and manage, Waterfall can also be slow and costly, with changes challenging to implement.
Hence, there is a tendency for teams to look for alternatives.
Projects where engineers felt they had the freedom to discuss and address problems were 87 percent more likely to succeed. Worryingly, workers in the UK were 13 percent less likely to feel they could discuss problems than those in the US, according to the study.
Many sins of today's tech world tend to be attributed to the Agile Manifesto. A neverending stream of patches indicates that quality might not be what it once was, and code turning up in an unfinished or ill-considered state have all been attributed to Agile practices.
[11]
One Agile developer criticized the daily stand-up element, describing it to The Register as "a feast of regurgitation."
However, while the Agile Manifesto might have its problems, those stem more from its implementation rather than the principles themselves. "We don't need a test team because we're Agile" is a cost-saving abdication of responsibility.
In highlighting the need to understand the requirements before development begins, the research charts a path between Agile purists and Waterfall advocates. ®
Get our [12]Tech Resources
[1] https://www.engprax.com/post/268-higher-failure-rates-for-agile-software-projects-study-finds
[2] https://www.theregister.com/2015/01/08/erik_meijer_agile_is_a_cancer_we_have_to_eliminate_from_the_industry/
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZmA3QDOIvytDemTeTcCstQAAAI8&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZmA3QDOIvytDemTeTcCstQAAAI8&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZmA3QDOIvytDemTeTcCstQAAAI8&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[6] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZmA3QDOIvytDemTeTcCstQAAAI8&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[7] https://www.theregister.com/2021/07/14/uk_developer_burnout/
[8] https://www.theregister.com/2021/03/17/twilio_jeff_lawson_on_developers/
[9] https://www.theregister.com/2020/12/01/ibm_global_tech_services_uk_layoffs/
[10] https://www.theregister.com/2015/01/08/erik_meijer_agile_is_a_cancer_we_have_to_eliminate_from_the_industry/
[11] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZmA3QDOIvytDemTeTcCstQAAAI8&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[12] https://whitepapers.theregister.com/
A project being agile
ComputerSays_noAbsolutelyNo
... could also mean, that the project manager has sufficient agility to evade and deflect blame when things go wrong
Next Week
wolfetone
A new study finds water is wet.
Filippo
That tracks with my experience. I haven't been in very many Agile projects, but of the three, two failed.
I'm sure that proponents of Agile could pop in and say that it only fails when badly executed (e.g. when you skimp on unit tests), to which I would observe that, by that line of reasoning, abstinence would be a good contraceptive. If a few people misuse a methodology, that's a problem with a few people; if a lot of people misuse a methodology, that's a problem with the methodology.
This is just my gut feeling, but I can't help forming the idea that Agile is a well-crafted justification over the obsession with "now now now" and "planning for more than the next thirty seconds is boring" that is so typical of our age.
wolfetone
" This is just my gut feeling, but I can't help forming the idea that Agile is a well-crafted justification over the obsession with "now now now" and "planning for more than the next thirty seconds is boring" that is so typical of our age. "
See to me, Agile is the counter answer to the phrase "Poor planning on your part doesn't constitute an emergency for me".
Just maybe?
We all need to grow up and pick the methodology that suits the project.