Automation and data need radically new systems of governance according to scientists ⁰

The current framework for governing automation and the management and use of data cannot keep pace with technological advances, according to a new report by the Royal Society and the British Academy. The report calls for the establishment of a new, independent body to steward an overall framework that can safeguard public confidence and ensure that the potential benefits of data use such as improved public services, better healthcare and business innovation are fully realised. The two National Academies convened leading figures from the Sciences, Humanities and Social Sciences to undertake a detailed review of the current governance landscape for data usage and management. Data Management and Use: Governance in the 21st Century found that data usage, data collection and management are increasingly intertwined, and new ways of using data make it difficult to define which data is sensitive.  It found that, while the current governance architecture provides a lot of what is needed to deal with these challenges, there are clear gaps and too many silos, such that tensions between how individual and collective benefits and risks are negotiated are not always identified and addressed in a transparent and inclusive way.

First among the recommendations is the adoption of a set of high level principles to guide future data governance. It proposes an over-arching principle that systems that govern data need to promote human flourishing, focusing on ensuring that data is used to serve individuals and communities. The principles are:

• Protect individual and collective rights and interests
• Ensure trade-offs affected by data management and data use are made transparently, accountably and inclusively
• Seek out good practices and learn from success and from failure
• Enhance existing democratic governance

The second recommendation is the creation of an independent body to steward the governance landscape as a whole. This body would anticipate, monitor and evaluate the management and usage of data, build practices and set standards and provide clarity and propose solutions where tensions arise. It would steward, rather than replace, a range of existing public and private actors such as the Information Commissioner’s Office and those in the health sector. It would be led by experts from across disciplines including those who could represent the public interest. It would be UK focussed but globally relevant and exchange good practice with other countries.

The report stresses that any form of governance needs to be specific to context recognising that, for example, the benefits and risks of use of data in online shopping are different to data being used in a healthcare context. Rather than restricting innovation, the report finds that a clearly defined framework setting out acceptable uses of data would give stakeholders the confidence to explore new technologies and enable society to reap the benefits that these technologies can deliver.

Professor Dame Ottoline Leyser FRS, Chair of the Royal Society Science Policy Advisory Group and Co-Chair of the report, said: “We have reached a stage where most aspects of our day-to-day lives generate data that is collected, presenting opportunities for various actors to use this information. Many of the ways in which the data is used lead to positive impacts for us and wider society. However, the rapid rate of change in this area requires a new approach to governance that can keep pace, ensuring that the risks and benefits of new applications can be debated in a transparent and inclusive way.”

She added: “History shows us that societies need to act early to create well-founded responses to rapid technological change. A principle-based approach to data governance can provide direction and stewardship during a potentially disruptive period of transition.”

Professor Genevra Richardson CBE FBA, Vice President for Public Policy at the British Academy and Co-Chair of the report, said: “The capturing and use of data is not a new concept – but the collection methods, usage and storage has changed significantly and continues to evolve. The National Academies have been able to convene the leading experts from the whole spectrum of disciplines and communities to look at these complex challenges.  Our report presents a reasoned, evidence-based and pragmatic set of proposals.”

Antony Walker, Deputy CEO of techUK and member of the Royal Society and British Academy Working Group on Data Governance added: “We are already seeing intelligent machines outperform humans on a range of complex tasks, from playing Go to piloting aircraft and real time language translation. As we consider the implications of a world where humans live and work alongside intelligent machines we have to ensure that we put the interests of humans first and develop effective mechanisms to ensure we have full control over such machines. A data stewardship body, bringing together leading experts from academia, business and other fields, will be able to do just that focusing, in particular, on promoting human flourishing to ensure that we anticipate and head off any risks that will arise from the development of AI and harness the huge opportunities these advances will unlock.”

Image: Taken from HBO series Westworld