The Department of Work and Pensions’ new plans for an AI powered automated welfare fraud detection plan have caused an outcry from privacy watchdogs and activist groups. Here’s the full story.
Dystopian Nightmare
In the latest step toward the UK becoming a dystopian nightmare, the Department for Work and Pensions (DWP) has announced plans to combat welfare fraud through the automated surveillance of bank accounts.
The New Process Is Necessary
While the government has insisted that this new process is necessary to protect taxpayers’ money, a cacophony of critics has warned that the government is sleepwalking into a technological scandal reminiscent of the Post Office Horizon scandal.
Kafkaesque Plans
The DWP’s Kafkaesque new plans involve using AI technology, along with other undisclosed “fully automated” technologies, to monitor the bank accounts of millions of benefit claimants.
Monitoring Suspicious Activity
Using the technology would allow the DWP to sift through the accounts of claimants to monitor for any activity the system considers suspicious.
The DWP hopes that using this new, untested technology will curb the £8 billion lost annually to welfare fraud, less than one-fifth of the UK’s yearly defence budget.
Big Brother
Attempting to allay fears of the Big Brother-style invasion of privacy of citizens whose only crime is to require benefits, a DWP spokesperson made it clear that “a member of staff will always take any decision related to suspending benefits, and any signals of potential fraud or error will be looked at comprehensively before action is taken.”
Cracking down on Fraud
They continued: “We have a duty to treat taxpayer’s money responsibly, which is why we are cracking down on fraud.”
The DWP has made no such commitment to use AI to trawl through the accounts of UK citizens who, according to TaxJustice UK, hold £570 billion in tax havens outside of the UK.
Grand Coalition
Despite the government’s limited assurances, a grand coalition of 42 organisations, from disability rights advocates to privacy watchdogs, vehemently opposed the proposed surveillance plans.
Impact on the Members of Society
They argue that trawling through individuals’ data on such a massive scale constitutes a severe infringement on financial privacy, with an outsized impact on the most vulnerable members of society.
Treated Like Criminals
In a joint letter to the Work and Pensions Secretary, Mel Stride, the campaigner’s coalition stated, “There are approximately 22.6 million individuals in the welfare system, including those who are disabled, sick, caregivers, job seekers, and pensioners. They should not be treated like criminals by default.”
They continued: “The Horizon scandal saw hundreds of people wrongfully prosecuted using data from faulty software. The government must learn from this mistake – not replicate it en masse.”
Blind Faith
The Horizon scandal should be a cautionary tale regarding blind faith in technology, which led to hundreds of post office workers’ wrongful prosecution and financial ruin.
The groups calling for revising the proposed legislation come from every strata of British society, from groups as disparate as the Child Poverty Action Group and Age UK.
Mental Health Charities
Other mental health charities are also involved in the effort, citing research that indicates the heightened vulnerability of those suffering from mental health disorders in the benefit system.
350 a Day
Shocking research conducted last year revealed that 350 low-paid workers were lodging complaints regarding errors in welfare top-ups within the system daily. These errors caused low-paid workers and other benefit claimants to report significant financial and emotional stress.
Biassed Outcomes
As if the human errors within the DWP’s systems were not bad enough, a National Audit Office report in 2022 warned that previous attempts to use AI and other technologies to detect fraud could “generate biassed outcomes.”
Automatic Detection Systems
Despite this warning, the following year, the government ramped up its use of automatic detection systems for benefit claimants.
No Guarantee
The government’s own Information Commissioner, John Edwards, has emphasised that he cannot guarantee the proportionality of the latest plans from the DWP.
Potential Harm
Without sufficient assurance of these factors, concerns persist about the potential harm caused by the widespread introduction of automated systems.
Addressing Fraud Tool
Edwards states that the government needed to be “transparent about the evidence base for introducing this power and its efficacy as a tool for addressing fraud and error.”
Family Scrutiny
The DWP’s new proposals do not only affect those on benefits, as the new plans would allow the government to access the bank accounts of those on benefits and those related to them. Parents, romantic partners, and even landlords could have their privacy violated in the government’s AI-powered fever dream of lowering benefit fraud.
Pushing Back Against New Policy
While benefit fraud is a costly problem for the government, the vast array of organisations pushing back against this new policy should be cause for alarm. As the unproven and untested rollout of AI continues to affect citizens’ everyday lives, steps must be taken to ensure progress does not roll over privacy.
Featured Image Credit: Shutterstock / William Barton.