Australia's 'great example of government using technology' found to be 'crude and cruel'. And literally lethal to citizens
(2023/07/07)
- Reference: 1688707807
- News link: https://www.theregister.co.uk/2023/07/07/robodebt_royal_comission_report_australia/
- Source link:
An Australian government initiative described by the then-minister in charge as "a great example of the Government using technology" has been described by a Royal Commission as "a crude and cruel mechanism, neither fair nor legal, and it made many people feel like criminals."
The initiative came to be known as "Robodebt" – reflecting its automated matching of data sets and issuance of debt notices to welfare recipients.
But the algorithm Australia's government used to calculate the debts was based on massively and tragically incorrect assumptions.
[1]
Australians are eligible for welfare payments if their income dips below certain levels in a given two-week period. In the early 2010s, the government of the day decided to ensure that welfare recipients hadn't received more payments than they were due, with data sharing between welfare and tax agencies informing the process.
[2]
[3]
To assess whether proper payments had been made, the relevant department averaged recipients' income across a year.
Which was a huge mistake.
[4]
To understand why, consider someone who spent three months of the year receiving unemployment benefits while they searched for a job, then worked for nine months. The government considered their income for the entire year and averaged it, then assessed their eligibility for payments based on their average fortnightly earnings – not their income when they were out of work and therefore eligible for payments.
That method meant people who received benefits could be held to have exceeded the eligibility threshold, even though they had no income other than government benefits when they received payments. The government nonetheless declared the recipient had been overpaid and sent stinky letters demanding repayment.
Some within government pointed out the problems with that methodology. Senior public servants knew the entire program may not have rested on firm legal footings.
[5]
But ministers nonetheless pressed ahead, and hailed the likely revenue the scheme would generate as the aforementioned "great example." Agencies were soon pumping out automatically generated debt notices based on the faulty methodology at a rate of up to 20,000 a week.
[6]Australia to refund $720m in 'debts' determined by dodgy algorithm
[7]Centrelink scheduled maintenance at time clients needed it most
[8]Australian privacy commissioner flags new data mining rules for government agencies
[9]Australian government doxxed citizens who criticized illegal 'Robodebt' scheme
Pushback and protest quickly followed, but the government of the day persisted with the program.
Fighting the debt notices proved extraordinary difficult, as the onus of proof required citizens to provide documents proving the debt was incorrect. As the program looked back at years of payment history, many simply couldn't find records of past income – or lack of it. Australia's government services agency struggled to handle the workload and stonewalled many complainants.
Several suicides have been linked to anxiety induced by the sudden requirement to repay incorrectly assessed debts, some of which ran to many thousands of dollars. Even after some of those deaths were widely reported, the relevant government department did not review the scheme.
Public and press opprobrium eventually reached sufficient levels that the government ended the scheme and agreed to repay debts it had collected based on miscalculations.
But by then the damage had been done.
In May 2022 Australia elected a new government, which promised a Royal Commission into Robodebt. Its [10]final report [PDF] was published on Friday, and offers grim reading. The document found ministers made untrue statements and abused their power, and that senior public servants knew the scheme was flawed and/or illegal but did not act to stop it. The report recommends hundreds of people be considered for possible civil or criminal prosecution, though that section has been sealed so the identities of the accused are not known.
The report's 57 recommendations call for significant reform of Australia's government and public service – including a change to freedom of information laws that would allow scrutiny of cabinet documents.
The report also makes some recommendations about information technology, among them:
Establishment of a body to monitor and audit automated decision-making processes in government;
Seeking advice on whether data-sharing among government agencies is legal;
An immediate review and strengthening of operational governance practices as applied to data-matching programs conducted jointly by different agencies;
Departmental websites should contain information advising that automated decision-making is used and explaining in plain language how the process works;
Business rules and algorithms should be made available, to enable independent expert scrutiny;
Implementation of online customer service tools to facilitate easier interaction with government.
In a terrible irony, the report found that some debts were so small it cost the government more to recover them than the value of the debt. And the compensation due to those who paid incorrectly assessed debts will likely exceed the sum the scheme aimed to recoup. ®
Get our [11]Tech Resources
[1] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZKfiSRiFlqWPaxGQEJylNQAAAwk&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZKfiSRiFlqWPaxGQEJylNQAAAwk&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZKfiSRiFlqWPaxGQEJylNQAAAwk&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZKfiSRiFlqWPaxGQEJylNQAAAwk&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZKfiSRiFlqWPaxGQEJylNQAAAwk&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[6] https://www.theregister.com/2020/06/01/robodebt_refunds/
[7] https://www.theregister.com/2018/07/03/centrelink_crash/
[8] https://www.theregister.com/2017/05/18/privacy_commissioner_flags_new_data_mining_rules_for_government_agencies/
[9] https://www.theregister.com/2023/02/05/asia_tech_news_roundup/
[10] https://robodebt.royalcommission.gov.au/system/files/2023-07/report-of-the-royal-commission-into-the-robodebt-scheme.pdf
[11] https://whitepapers.theregister.com/
The initiative came to be known as "Robodebt" – reflecting its automated matching of data sets and issuance of debt notices to welfare recipients.
But the algorithm Australia's government used to calculate the debts was based on massively and tragically incorrect assumptions.
[1]
Australians are eligible for welfare payments if their income dips below certain levels in a given two-week period. In the early 2010s, the government of the day decided to ensure that welfare recipients hadn't received more payments than they were due, with data sharing between welfare and tax agencies informing the process.
[2]
[3]
To assess whether proper payments had been made, the relevant department averaged recipients' income across a year.
Which was a huge mistake.
[4]
To understand why, consider someone who spent three months of the year receiving unemployment benefits while they searched for a job, then worked for nine months. The government considered their income for the entire year and averaged it, then assessed their eligibility for payments based on their average fortnightly earnings – not their income when they were out of work and therefore eligible for payments.
That method meant people who received benefits could be held to have exceeded the eligibility threshold, even though they had no income other than government benefits when they received payments. The government nonetheless declared the recipient had been overpaid and sent stinky letters demanding repayment.
Some within government pointed out the problems with that methodology. Senior public servants knew the entire program may not have rested on firm legal footings.
[5]
But ministers nonetheless pressed ahead, and hailed the likely revenue the scheme would generate as the aforementioned "great example." Agencies were soon pumping out automatically generated debt notices based on the faulty methodology at a rate of up to 20,000 a week.
[6]Australia to refund $720m in 'debts' determined by dodgy algorithm
[7]Centrelink scheduled maintenance at time clients needed it most
[8]Australian privacy commissioner flags new data mining rules for government agencies
[9]Australian government doxxed citizens who criticized illegal 'Robodebt' scheme
Pushback and protest quickly followed, but the government of the day persisted with the program.
Fighting the debt notices proved extraordinary difficult, as the onus of proof required citizens to provide documents proving the debt was incorrect. As the program looked back at years of payment history, many simply couldn't find records of past income – or lack of it. Australia's government services agency struggled to handle the workload and stonewalled many complainants.
Several suicides have been linked to anxiety induced by the sudden requirement to repay incorrectly assessed debts, some of which ran to many thousands of dollars. Even after some of those deaths were widely reported, the relevant government department did not review the scheme.
Public and press opprobrium eventually reached sufficient levels that the government ended the scheme and agreed to repay debts it had collected based on miscalculations.
But by then the damage had been done.
In May 2022 Australia elected a new government, which promised a Royal Commission into Robodebt. Its [10]final report [PDF] was published on Friday, and offers grim reading. The document found ministers made untrue statements and abused their power, and that senior public servants knew the scheme was flawed and/or illegal but did not act to stop it. The report recommends hundreds of people be considered for possible civil or criminal prosecution, though that section has been sealed so the identities of the accused are not known.
The report's 57 recommendations call for significant reform of Australia's government and public service – including a change to freedom of information laws that would allow scrutiny of cabinet documents.
The report also makes some recommendations about information technology, among them:
Establishment of a body to monitor and audit automated decision-making processes in government;
Seeking advice on whether data-sharing among government agencies is legal;
An immediate review and strengthening of operational governance practices as applied to data-matching programs conducted jointly by different agencies;
Departmental websites should contain information advising that automated decision-making is used and explaining in plain language how the process works;
Business rules and algorithms should be made available, to enable independent expert scrutiny;
Implementation of online customer service tools to facilitate easier interaction with government.
In a terrible irony, the report found that some debts were so small it cost the government more to recover them than the value of the debt. And the compensation due to those who paid incorrectly assessed debts will likely exceed the sum the scheme aimed to recoup. ®
Get our [11]Tech Resources
[1] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZKfiSRiFlqWPaxGQEJylNQAAAwk&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZKfiSRiFlqWPaxGQEJylNQAAAwk&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZKfiSRiFlqWPaxGQEJylNQAAAwk&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZKfiSRiFlqWPaxGQEJylNQAAAwk&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZKfiSRiFlqWPaxGQEJylNQAAAwk&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[6] https://www.theregister.com/2020/06/01/robodebt_refunds/
[7] https://www.theregister.com/2018/07/03/centrelink_crash/
[8] https://www.theregister.com/2017/05/18/privacy_commissioner_flags_new_data_mining_rules_for_government_agencies/
[9] https://www.theregister.com/2023/02/05/asia_tech_news_roundup/
[10] https://robodebt.royalcommission.gov.au/system/files/2023-07/report-of-the-royal-commission-into-the-robodebt-scheme.pdf
[11] https://whitepapers.theregister.com/
Accountability
fxkeh
"The report recommends hundreds of people be considered for possible civil or criminal prosecution"
Good! Only when the people responsible for this receive criminal records and have to pay restitution from their own pockets will it serve as a deterrent for future politicians and bureaucrats.
Re: Accountability
cookieMonster
Unfortunately “recommends” means that no slimeball politician will ever agree to go ahead and prosecute those responsible
Oz just like UK
Anonymous Coward
Good to see the model of government in the UK and Oz are totally aligned
MP’s & Civil servants make a FUBAR
Everyone points it out
So they double down because everyone knows when you’re in a hole you dig faster to get out of it
IR35 comes to mind
Re: Oz just like UK
Anonymous Coward
Except in Australia they have a proper inquiry that says "you did bad things", while in the UK they hand-pick a well-educated-but-hard-of-thinking lickspittle to head up a whitewash campaign disguised as an investigation.
Natalie Gritpants Jr
I'd start at the top and fire anyone who couldn't explain why the algorithm is wrong. If you're dealing with money, you have to be able to do the maths behind it, or you're just guessing and parroting
abend0c4
You're assuming anyone cared. It's more likely the policy was aimed at getting favourable headlines about targeting "benefit scroungers" and that legality and justice were never part of the equation.
We seem to have reached a point in the Anglosphere where politicians who make the laws denounce their inconvenient enforcement as the work of "lefty lawyers" and "enemies of the people" judges.
Government as usual
" The document found ministers made untrue statements and abused their power, and that senior public servants knew the scheme was flawed and/or illegal but did not act to stop it. "
So, bumbling idiots with a mandate and high-ranking position holders not wanting to rock the boat. Mix in a hefty dose of badly-thought-out financial rules and apply blindly via Computer Says No and you get the almost invitable : human suffering and death.
A little knowledge may be a bad thing, but a bit more knowledge, and somebody with a pair, would have been a better thing in this case.
Funny thing : as soon as I read the heading I immediately thought of that Yes Minister episode, and the great example of government and private sector collaboration.