Correspondence

Appendix A: Update on algorithmic bias

Published 5 July 2021

This was published under the 2019 to 2022 Johnson Conservative government

Introduction

Advances in the way we use and deploy data and AI are revolutionising almost every aspect of our lives. From faster, more accurate diagnosis of illnesses, to smarter and more sophisticated solutions to energy use and security threats - the use of data and AI has the potential to enhance our lives in unprecedented, powerful and positive ways.

Nevertheless, the use of data and AI is giving rise to complex, fast moving and far reaching economic and ethical issues. Increasingly sophisticated algorithms can glean powerful insights, which can be deployed in ways that influence the decisions we make, or target the services and resources we receive.

皇冠体育app government recognises the urgent need for the world to do better in using algorithms in the right way: to promote fairness, not undermine it. Algorithms, like all technology, should work for people, and not against them. Significant growth is happening both in data availability and use of algorithmic decision-making across many sectors; we have a window of opportunity to get this right and ensure that these changes serve to promote equality, not to entrench existing biases.

皇冠体育app CDEI review surveyed the issue of bias in algorithmic decision-making, and studied four initial areas of focus to illustrate the range of issues and ethical questions relating to bias in algorithmic decision-making. 皇冠体育appse were recruitment, financial services, policing and local government.

皇冠体育app review moved on to identify how some of the challenges we identified can be addressed, the progress made so far, and what needs to happen next.

皇冠体育app review identified three main areas to consider:

  • 皇冠体育app enablers needed by organisations building and deploying algorithmic decision-making tools to help them do so in a fair way;
  • 皇冠体育app regulatory levers , both formal and informal, needed to incentivise organisations to do this, and create a level playing field for ethical innovation;
  • How the public sector, as a major developer and user of data-driven technology, can show leadership through transparency.

皇冠体育app update below highlights developments in a number of key areas.

Guidance to support local authorities

皇冠体育app Department for Education has commissioned the CDEI to develop guidance for local authorities to use data analytics in children鈥檚 social care responsibly. 皇冠体育app CDEI is currently developing draft guidance to be tested with local authorities in the autumn.

Enabling fair innovation

皇冠体育app UK Innovation Strategy, to be published later this year, will set the government鈥檚 vision for the UK to be the world鈥檚 most innovative economy by 2035. Underpinning this vision are more specific objectives including investing in people and talent, improving diversity and inclusion, and closing the gap between the workforce - including within the technology sector - and the skills employers need.

This objective will build on from current programmes, such as Innovate UK鈥檚 first diversity and inclusion campaign: Women in Innovation. 皇冠体育app strategy is a key next step in delivering on the plan for growth, to support new opportunities in every part of the country, enabling anyone to acquire the skills to do those jobs, wherever they live and whatever their stage of life.

皇冠体育app regulatory environment

皇冠体育app AI Roadmap, commissioned by the government and delivered by the independent AI Council, made two recommendations for Data, Infrastructure and Public Trust concerning governance. 皇冠体育appy are: 鈥榌皇冠体育app government should] lead the development of data governance options and鈥hould lead in developing appropriate standards to frame the future governance of data鈥�; and 鈥楤uilding on its strengths, the UK has a crucial opportunity to become a global lead in good governance, standards and frameworks for AI and enhance bilateral cooperation with key actors.鈥� 皇冠体育appse two recommendations are now being taken forward into the new National AI Strategy, which the Office for AI will publish later this year.

Furthermore, the independent Regulatory Horizons Council has been appointed to horizon-scan for new technological innovations 鈥� including Artificial Intelligence 鈥� and provide the government with impartial, expert advice on the regulatory reform required to support its rapid and safe introduction, while protecting citizens and the environment.

皇冠体育app CDEI report highlighted a potentially greater role for the EHRC in investigating algorithmic discrimination. Development of the EHRC鈥檚 2022-25 Strategic Plan is underway. In light of the changing world that we are in following the pandemic, the EHRC will take a responsive approach to using their powers, considering carefully the equality and human rights issues which are most pressing and where they can have the most impact. One of the emerging areas of focus being considered is artificial intelligence and emerging digital technologies, which they will continue to explore through internal engagement, and as part of their statutory public consultation later this year.

皇冠体育app EHRC is also currently developing new guidance on artificial intelligence and the public sector equality duty, for public authorities and private organisations that carry out public functions. 皇冠体育app EHRC are liaising with the CDEI and the Alan Turing Institute on the draft guidance, and they are intending to publish it in September 2021.

Regulators are increasingly considering algorithmic bias in their research and guidance work. For example the ICO鈥檚 AI and Data Protection guidance and the CMA鈥檚 algorithmic harms report both explicitly reference discrimination and equality law.

皇冠体育app Competition and Markets Authority (CMA), the Information Commissioner鈥檚 Office (ICO) and Ofcom have together formed the Digital Regulation Cooperation Forum (DRCF) to support regulatory coordination in digital markets and cooperation on areas of mutual importance, and will be examining the issues of algorithmic processing as part of their work plan for the coming year, building on work undertaken by the CMA. Further, the ICO, Alan Turing Institute, CDEI and Office for AI have agreed to work together to develop, roll out and monitor training for regulators on issues around AI.

皇冠体育app Office for AI, CDEI, and ICO and other regulators also sit on a larger Regulators and AI working group, comprising 32 regulators and other organisations. This forum will be used to discuss how to take forward the recommendations made in the report, forming a special sub-group chaired by the ICO with active membership from the CDEI, Office for AI, Alan Turing Institute, and key regulators. 皇冠体育appy will identify gaps, consider training needs and make recommendations.

Transparency in the public sector

皇冠体育app CDEI report proposed that the Government introduced a mandatory transparency obligation on all public sector organisations using algorithms that have a significant influence on significant decisions affecting individuals. Since the report was published the Cabinet Office has established the Central Digital and Data Office (CDDO) as the new strategic centre for Digital, Data and Technology for the government. 皇冠体育app CDDO is responsible for shaping and delivering the government鈥檚 innovation and transformation strategies to overhaul legacy IT systems, strengthen our cyber security, improve capability, and ensure the government can better leverage data and emerging technologies.

皇冠体育app CDDO recognises that ensuring fairness in how the public sector uses algorithms in decision-making is crucial for gaining and maintaining public trust. Introducing mechanisms for a more transparent use of algorithms within the government will encourage responsible public sector innovation and further enhance the UK鈥檚 long-standing leadership in the field of transparency and openness. In the National Data Strategy the government committed to collaborate with the leading organisations and academic bodies in the field to scope and pilot methods to enhance algorithmic transparency, and I鈥檓 pleased that the Centre are working with the CDDO, alongside a number of leading organisations in the field, to support the development and piloting later this year, including considering what transparency measures would be most effective at increasing public understanding about the use of algorithms in the public sector.

皇冠体育app CDDO also recently published an Ethics, Transparency and Accountability Framework for Automated Decision Making. This framework, aimed at senior public sector leaders, incorporated case studies provided by the CDEI鈥檚 work, and it also links to the CDEI鈥檚 Bias report as an important resource for teams considering using algorithms in their work.

In addition, the Crown Commercial Service has introduced a , similar to a framework agreement, for public sector procurement of AI that includes data ethics requirements for suppliers. Suppliers are expected to follow the data ethics framework to mitigate bias and ensure diversity in the team that developed/ is developing a solution; as well as transparency/ interpretability and explainability of the results, including audits. 皇冠体育app supplier will need to be open around how an AI service was built.