Big Data and artificial intelligence are, perhaps surprisingly, a featured highlight in the (.PDF). Technology is frequently proffered as a solution to poverty and other social rights failings (see for example the recent ). However, Philip Alston, the UN Special Rapporteur on extreme poverty and human rights, focuses instead on its potential to erode democracy.
Alston, an independent UN expert, examines the impact of the UK commitment to transform the public service sector to full automation, 鈥渁ided by data science and artificial intelligence鈥�. He warns that while the government is talking about a system which is 鈥榙igital by default鈥�, in reality, a digital welfare state is emerging. 鈥淭he impact on the human rights of the most vulnerable in the UK will be immense,鈥� and the report documents 鈥渢he gradual disappearance of the postwar British welfare state behind a webpage and an algorithm.鈥�
Even in a modern, high income state such as the UK, a digital divide exists. Alston presents alarming statistics about people who cannot easily participate in a digital system despite government assurances that 鈥渕ost people are at ease and competent online鈥�.
- 47% of those on low income use broadband internet at home
- 42% of those who are unemployed do their banking online
- 43% of those on low income do their banking online
- 21% of the UK population do not have five basic digital skills
- 16% of the population is not able to fill out an online application form
- 52% of Citizens Advice clients found the Universal Credit online application process difficult
- The Department for Work and Pensions鈥� (DWP) survey in June 2018 found only 54% of claimants could apply online independently without assistance.
The digital barrier to welfare support (Universal Credit) was found by Alston to be particularly hard on women, older people, people who do not speak English, and the disabled. At the same time that people are turning to public libraries to seek support with online applications, the libraries are experiencing severe budget cuts. The report states, 鈥淚n Newcastle alone, the first city where 鈥榝ull service鈥� Universal Credit was rolled out in May 2016, the City Library has digitally assisted nearly 2,000 customers between August 2017 and September 2018.鈥�
The digital divide is not a problem identified in the move to an automated government. There is also a lack of transparency in automated decision-making processes. The Real Time Information system integrates various UK government agency data including the tax on earnings information submitted by employers. When errors are made in the data, resulting in inconsistent information about a claimant, the programmed assumption is that the automated system is correct and claimants are wrong.
According to DWP, a team of 50 civil servants work full-time resolving the 2% of millions of monthly transactions that are incorrect. Alston was told by claimants that they often have to wait for weeks to get paid the correct amount, even when they have written proof in the form of payslips that the IT system is wrong. Similarly, the investigation of fraud is controlled by private sector IT vendors who have built 鈥榬isk-based verification systems which flag claimants for low, medium or high risk of fraud and error, thus allowing local authorities to investigate high risk cases more closely.鈥� This system is soon to be extended into a 鈥渇ully automated risk analysis and intelligence system for fraud and error,鈥� to prevent fraud and error by using Artificial Intelligence. But Alston finds an absence of transparency, and he states, 鈥淭he existence, purpose and basic functioning of these automated government systems remains a mystery in many cases, fueling misconceptions and anxiety about them.鈥� Public awareness and understanding of these systems is imperative. He writes:
There is nothing inherent in Artificial Intelligence and other technologies that enable automation that threatens human rights and the rule of law. The reality is that governments simply seek to operationalize their political preferences through technology; the outcomes may be good or bad. But without more transparency about the development and use of automated systems, it is impossible to make such an assessment. And by excluding citizens from decision-making in this area we may set the stage for a future based on an artificial democracy.
Alston also raises the limitations of newly established institutions in the UK which use ethics, not human rights, to address the challenges of an automated government. 鈥淓thical concepts such as fairness are without agreed upon definitions, unlike human rights which are law. Government use of automation, with its potential to severely restrict the rights of individuals, needs to be bound by the rule of law and not just an ethical code.鈥�
Paul Hunt, in his , praises Alston for 鈥榚xposing the gaping hole at the heart of our national human rights system: its failure to explicitly recognise social rights.鈥� He endorses the UN report for insisting that there is a need for legislative recognition of social rights. Another social rights risk posed by big data and artificial intelligence has been identified by the Human Rights, Big Data and Technology project as the use of data sharing partnerships in healthcare. Social rights risks could, however, be mitigated by conducting human rights impact assessments before embarking on artificial intelligence projects. The project has also commented on the global digital divide and the likelihood of increasing inequities if digital technologies are employed to address poverty and other Sustainable Development Goals.
Alston states that a machine learning system may be able to beat a human at chess, but it may be less adept at solving complicated social ills such as poverty.
