Skip Navigation
United Kingdom

Involving data users in shaping the future of open data (UK0072)

Overview

At-a-Glance

Action Plan: United Kingdom – Third National Action Plan 2016-18

Action Plan Cycle: 2016

Status: Inactive

Institutions

Lead Institution: Cabinet Office (Government Digital Service)

Support Institution(s): All government departments; mySociety, The Open Data Institute

Policy Areas

Capacity Building, E-Government, Open Data

IRM Review

IRM Report: United Kingdom End-of-Term Report 2016-2018, United Kingdom Mid-Term Report 2016-2018

Starred: No

Early Results: Marginal Marginal

Design i

Verifiable: Yes

Relevant to OGP Values: Access to Information Civic Participation , Technology

Potential Impact:

Implementation i

Completion:

Description

Objective: To engage widely with current and potential data users in the development of the Government Data Programme and government’s broader open data agenda, in order to ensure that our work meets users’ needs and that limited resources are focused on areas of highest priority.

Status quo: Effective menagement with users of government data – whether in the public sector, private sector or civil society – is essential to shaping the future of open data. It is also key to the success of the Government Data Programme and our ability to drive innovation, public service reform and transparency through the better use of data. Since our first OGP National Action Plan we have learned a huge amount through our engagement with data users. The feedback we have received has enabled government to prioritise its efforts to open up more data. We have built a clear understanding of the highestvalue datasets that are not yet freely and openly available, giving us a strong platform on which to continue to pursue greater open access where appropriate. And we have heard clearly from stakeholders that open data quality and reliability, not just quantity, is crucially important. This has helped us to develop a Government Data Programme to address the need for modernized data infrastructure and capability across government, driving better quality data for all users. We have opened up a huge range of government datasets, while strengthening citizens’ rights to request data in open and reusable format through amendments to the Freedom of Information Act and the introduction of the Re-use of Public Sector Information regulations. But we can be clearer and more proactive in raising awareness of the routes by which data access requests can be made available, and public bodies’ duties in responding to them.

Ambition: We need a wide range of engagement opportunities for users of government open data – and, crucially, those who currently do not use government data but stand to benefit from doing so. These will range from public events and speaking engagements, to online collaboration and subject-specific working groups. As government’s use of data develops and expands, this engagement will need to be active and ongoing, and must involve the full spectrum of holders and users of government data. We must also be open and transparent about the discussions we have held and the outcomes of those discussions.

IRM End of Term Status Summary

10. Involving data users in shaping the future of open data

Commitment text:We will ensure government's work to modernise and improve the management, use and availability of data assets is informed by active and wide-ranging collaboration with current and potential data users.

Objective: To engage widely with current and potential data users in the development of the Government Data Programme and government's broader open data agenda, in order to ensure that our work meets users' needs and that limited resources are focused on areas of highest priority.

Status quo: Effective engagement with users of government data – whether in the public sector, private sector or civil society – is essential to shaping the future of open data. It is also key to the success of the Government Data Programme and our ability to drive innovation, public service, reform and transparency through the better use of data.

Since our first OGP National Action Plan we have learned a huge amount through our engagement with data users. The feedback we have received has enabled government to prioritise its efforts to open up more data. We have built a clear understanding of the highest value datasets that are not yet freely and openly available, giving us a strong platform on which to continue to pursue greater open access where appropriate. And we have heard clearly from stakeholders that open data quality and reliability, not just quantity, is crucially important. This has helped us to develop a Government Data Programme to address the need for modernised data infrastructure and capability across government, driving better quality data for all users.

We have opened up a huge range of government datasets, while strengthening citizens' rights to request data in open and reusable format through amendments to the Freedom of Information Act and the introduction of the Re-use of Public Sector Information regulations. But we can be clearer and more proactive in raising awareness of the routes by which data access requests can be made available, and public bodies' duties in responding to them.

Ambition: We need a wide range of engagement opportunities for users of government open data – and, crucially, those who currently do not use government data but stand to benefit from doing so. These will range from public events and speaking engagements, to online collaboration and subject-specific working groups. As government's use of data develops and expands, this engagement will need to be active and on going, and must involve the full spectrum of holders and users of government data. We must also be open and transparent about the discussions we have held and the outcomes of those discussions.

Milestones:

1. Develop a strong, ongoing and collaborative conversation with data users across sectors and specialisms, particularly through working groups and meet-ups on specific aspects of the government data agenda, to inform and challenge the Government Data Programme

2. Ensure government policy and the Government Data Programme is informed and challenged by leading external thinkers through an active Data Steering Group

3. Develop our partnership with the Open Data Institute to help government connect with data businesses, innovators and civil society

4. Build cross-government engagement and leadership on data management and open data, and publish plans for departmental engagement with data users and new open data commitments, through a cross- government Data Leaders Network

5. Maintain active and wide-ranging engagement with civil society groups to ensure the Government Data Programme supports better data access and use for smaller civil society organisations

6. Maintain regular updates on the government's open data policies online through blog posts and social media - allowing users to interact with these policies as they develop and post suggestions for improvements

7. Explore further channels with which to engage users on open data issues, such as the Open Government Forum, Google Communities or Slack – these would have the advantage of real time discussion and problem solving, as well as a more direct link between government and data users

8. Engage with citizens, civil society, private and public sectors to develop an ethical framework for the use of data science techniques in government, including through public engagement events and an interactive online engagement tool

Responsible institution: Cabinet Office (Government Digital Service)

Supporting institutions: all government departments, mySociety, The Open Data Institute

Start date: May 2016

End date: June 2018

Commitment Aim:

This commitment aimed to improve and deepen engagement with civil society and expert networks in open data, given the sometimes-limited involvement by CSOs and limited means of doing so. Previous action plans had highlighted the need for wider involvement and suggested experimenting with new ideas. The commitment included using a series of pre-established bodies to monitor and review activity, as well as activities to extend and innovate on how government and civil society interact.

Status

Midterm: Limited

At the end of the first year of implementation, the government continuously engaged with data users in various ways.[Note 93: Cabinet Office, Open Government National Action Plan 2016-18: July 2017 Commitment Progress Updates (commitment update for July 2017) pre-publication passed to author. ] These included attending events at the London Open Data Institute and interacting with user requests made via the data.gov.uk portal.[Note 94: Open Data Institute ‘Events', https://theodi.org/events.] The UK government also co-sponsored the fourth Open Data Camp in Cardiff in February 2017.[Note 95: Data Blog, Gov.uk ‘Looking Forward to Open Data Camp 2017, https://data.blog.gov.uk/2017/02/20/looking-forward-to-open-data-camp-2017/ ] There had also been continuous informal interaction through the Cabinet Office and through other departments.[Note 96: Interview with Thom Townsend and William Gerry, Cabinet Office, 14 September 2017; Cabinet Office ‘Open Government Partnership National Action Plan 2016-18: Mid-term Self Assessment Report' (UK government report September 2017) passed to author pre-publication. ]

Parts of the commitment were incomplete or delayed. The Data Steering Group met every three months until September 2016.[Note 97: Gov.uk, ‘Data Steering Group', https://www.gov.uk/government/groups/data-steering-group ] The Data Leaders Network met monthly, though meetings were not listed.[Note 98: Interview with Thom Townsend and William Gerry, Cabinet Office, 14 September 2017.] The government has experimented with new channels and used ‘Open Knowledge Forums during the exercise to create the Global Open Data Index'. It has also experimented with a cross-government Slack channel and Google group, as well as continuing regular internal meet-ups of its data community.[Note 99: Government Data Service Technology Blog, ‘Technology at GDS: Join The Conversation', https://gdstechnology.blog.gov.uk/join-the-conversation/, and UK Government Digital ‘Slack Channel', ukgovernmentdigital.slack.com; Interview with Thom Townsend and William Gerry, Cabinet Office, 14 September 2017.] Some CSOs felt the interaction was not as full as it could have been online.[Note 100: Cabinet Office, Open Government National Action Plan 2016-18: July 2017 Commitment Progress Updates (commitment update for July 2017) pre-publication passed to author. ]

In June 2017, it was reported the UK government was clamping down on Slack use by officials over fear of FOIs opening them up or leaks, which may inhibit use.[Note 101: Civil Service World, ‘Not picking up the Slack: Whitehall instant messaging clampdown reveals lack of trust in civil servants', https://www.civilserviceworld.com/articles/opinion/not-picking-slack-whitehall-instant-messaging-clampdown-reveals-lack-trust-civil ] In May 2016, the government launched the first version of its Data Science Ethical Framework “intended to give civil servants guidance on conducting data science projects [work with data using scientific approaches], and the confidence to innovate with data”.[Note 102: Cabinet Office, ‘Guidance: Data Science Ethical Framework, https://www.gov.uk/government/publications/data-science-ethical-framework, and Cabinet Office, ‘Speech Data Science Ethical Framework launch: Matt Hancock speech', https://www.gov.uk/government/speeches/data-science-ethical-framework-launch-matt-hancock-speech ] It called on civil society and experts to help develop it but there has been no sign of any further activity since.

End of Term: Substantial

There have been a number of moves forward in several areas that mean the commitment is now substantially implemented. Informal activities continued with a series of data user related activities, blogs and steering group meetings, including one joint meeting with data leaders and ‘working with academics, civil society and the wider industry'.[Note 103: UK government (2018), 2016-18 Open Government Action Plan: April 2018 Commitment Progress Updates, https://www.opengovernment.org.uk/resource/2016-18-open-government-action-plan-april-2018-commitment-progress-updates/; UK government (2017), Updating the data science ethics framework, https://gds.blog.gov.uk/2017/11/27/updating-the-data-science-ethical-framework/],[Note 104: Interview with Katie Holder and Thom Townsend, DCMS, 8 August 2018.] Most importantly in the final phase, a new data ethics framework was published in June 2018. According to the Minister responsible, the new version focused on the need for co-operation across specialisms.[Note 105: DCMS (2018), Guidance: Data Ethics Framework, https://www.gov.uk/government/publications/data-ethics-framework/data-ethics-framework]

The new framework is intended to ‘help policy and practitioners better understand the core ethical expectations for public sector data science projects, and to tailor their offerings appropriately'. It is intended to set out ‘ethical principles' while providing guidance and acting as ‘a workbook'.

Did It Open Government?
Access to Information: Marginal
Civic Participation: Marginal

The commitment has certainly succeeded in increasing CSO and expert engagement. In terms of access to information, the continued work improving the quality and consistency of statistics, as well as pushing organisational changes such as ‘Reproducible Analytical Pipeline'(which allows for easy production and reproduction of statistics), made for more open and systematic data. The publicising of the government work with data and design of the two versions of the ethical framework may have encouraged innovation across government but the IRM found no evidence of its effect. Given some feeling among CSOs that there could have been more engagement, and some of the limitations, it is listed as marginal.

Carried Forward?

This commitment will continue outside of action plan into 2019 and beyond.

United Kingdom's Commitments

  1. Grants Data

    UK0090, 2019, E-Government

  2. Public Participation

    UK0091, 2019, E-Government

  3. Open Policy Making

    UK0092, 2019, Public Participation

  4. Open Contracting Data

    UK0093, 2019, E-Government

  5. Natural Resource Transparency

    UK0094, 2019, E-Government

  6. Innovation in Democracy Programme

    UK0095, 2019, Public Participation

  7. Sustainable Open Government

    UK0096, 2019, Capacity Building

  8. Local Transparency

    UK0097, 2019, E-Government

  9. Beneficial ownership – UK

    UK0063, 2016, Beneficial Ownership

  10. Natural resource transparency

    UK0064, 2016, Extractive Industries

  11. Anti-Corruption Strategy

    UK0065, 2016, Anti-Corruption Institutions

  12. Anti-Corruption Innovation Hub

    UK0066, 2016, Anti-Corruption Institutions

  13. Open contracting

    UK0067, 2016, E-Government

  14. Grants data

    UK0068, 2016, E-Government

  15. Elections data

    UK0069, 2016, Capacity Building

  16. Revising Freedom of Information Act Code of Practice

    UK0070, 2016, Open Contracting and Procurement

  17. Identifying and publishing core data assets

    UK0071, 2016, Legislation & Regulation

  18. Involving data users in shaping the future of open data

    UK0072, 2016, Capacity Building

  19. Better use of data assets

    UK0073, 2016, Capacity Building

  20. "http://gov.uk/","GOV.UK"

    UK0074, 2016, Open Data

  21. Ongoing collaborative approach to open government reform

    UK0075, 2016, E-Government

  22. Open Government at all Levels

    UK0076, 2016, OGP

  23. Open Policy-making and Public Engagement

    UK0077, 2016, Capacity Building

  24. Public Sector Innovation

    UK0078, 2016, Capacity Building

  25. OCDS Implementation

    UK0079, 2016, E-Government

  26. Open-up Government

    UK0080, 2016, Capacity Building

  27. Open data plan

    UK0081, 2016, E-Government

  28. Open data service

    UK0082, 2016, Capacity Building

  29. StatsWales

    UK0083, 2016, E-Government

  30. Data Research Centre Wales

    UK0084, 2016, E-Government

  31. Government Social Research Publication Protocol

    UK0085, 2016, E-Government

  32. Gov.Wales

    UK0086, 2016, E-Government

  33. Code of Practice in Supply Chains

    UK0087, 2016, Labor

  34. Starred commitment National Indicators for Wales

    UK0088, 2016, Fiscal Transparency

  35. Starred commitment Well-being duty

    UK0089, 2016, E-Government

  36. National Information Infrastructure

    UK0042, 2013, Records Management

  37. NHS England Website and Network

    UK0043, 2013, Health

  38. Revised Local Authories Data Transparency Code

    UK0044, 2013, Capacity Building

  39. Transparent Social Investment Market

    UK0045, 2013, Open Data

  40. Manage and Capture Digital Records

    UK0046, 2013, Capacity Building

  41. Starred commitment Cross-Government Anti-Corruption Plan

    UK0047, 2013, Anti-Corruption Institutions

  42. Starred commitment Company Beneficial Ownership Information

    UK0048, 2013, Beneficial Ownership

  43. Access to Police Records

    UK0049, 2013, Justice

  44. Transparency in Construction

    UK0050, 2013, Infrastructure & Transport

  45. Legislative Openness

    UK0051, 2013, Beneficial Ownership

  46. Whistleblowing

    UK0052, 2013, Legislation & Regulation

  47. Open Contracting

    UK0053, 2013, Open Contracting and Procurement

  48. Open Contracting Scotland

    UK0054, 2013, E-Government

  49. Starred commitment International Aid Transparency

    UK0055, 2013, Aid

  50. Health Care Data

    UK0056, 2013, Health

  51. Open Policy Making

    UK0057, 2013, E-Government

  52. Sciencewise

    UK0058, 2013, E-Government

  53. Publication of Draft Legislation

    UK0059, 2013, Legislature

  54. OpenDataCommunities Programme

    UK0060, 2013, E-Government

  55. PSI Re-Use Directive

    UK0061, 2013, Legislation & Regulation

  56. Starred commitment Extractive Transparency

    UK0062, 2013, E-Government

  57. Ensuring a clear process to support reduction in collection of ‘unnecessary data’

    UK0024, 2011, E-Government

  58. Developing data.gov.uk and identifying other digital channels to support users

    UK0025, 2011,

  59. Evidence and databases behind policy statements

    UK0026, 2011, E-Government

  60. Data underlying surveys

    UK0027, 2011, E-Government

  61. Examining ways for improving the use of existing published data

    UK0028, 2011, E-Government

  62. Stimulate the market for innovative use of open data

    UK0029, 2011, Open Data

  63. Spend up to 5% of budget support on accountability

    UK0030, 2011, E-Government

  64. Include the OGP eligibility criteria to determine readiness for UK budget support

    UK0031, 2011, Aid

  65. Publish aid information from all ODA government departments

    UK0032, 2011, Aid

  66. Use a single domain for government services

    UK0033, 2011, E-Government

  67. Mandate ‘channel shift’

    UK0034, 2011, E-Government

  68. Go online for all consultations

    UK0035, 2011, E-Government

  69. Develop practical guidelines on departmental access to internet and social media

    UK0036, 2011, Civic Space

  70. Open data and application interfaces in ways that encourage businesses

    UK0037, 2011, E-Government

  71. Create cross-government standards on APIs

    UK0038, 2011,

  72. Establish standardised formats for user-satisfaction data

    UK0039, 2011, Records Management

  73. Provide government documents in open standard format

    UK0040, 2011, E-Government

  74. Implement crowd-sourcing and engagement processes

    UK0041, 2011,

  75. New power to secure release of valuable datasets

    UK0001, 2011,

  76. New, higher cost cap for FOI

    UK0002, 2011, Right to Information

  77. Meaningful disincentives

    UK0003, 2011,

  78. Maximum time limits

    UK0004, 2011, Right to Information

  79. Altered procurement rules

    UK0005, 2011,

  80. Mandating phased introduction of ‘Public by Default’

    UK0006, 2011, E-Government

  81. Formalising Public Data Principles

    UK0007, 2011, Records Management

  82. Having in place an Open Data compliance monitoring process

    UK0008, 2011, Records Management

  83. Making clear the minimum citizens can expect on publication and quality of data

    UK0009, 2011,

  84. Ensuring a line of continuous improvement for public service providers

    UK0010, 2011, Open Data

  85. Encourage continuous improvement

    UK0011, 2011, Records Management

  86. Setting out how citizens can challenge where there is failure in the process

    UK0012, 2011, Public Participation

  87. Establishing an obligation to consider and act on user feedback

    UK0013, 2011, Public Participation

  88. Making clear that licenses must cover free, commercial re-use

    UK0014, 2011,

  89. Merge information asset registers…into a single data inventory

    UK0015, 2011,

  90. Set consistent expectations of the appropriate quality of meta-data

    UK0016, 2011, Records Management

  91. For data co-ordinated across government, set definitions

    UK0017, 2011, E-Government

  92. Introducing corporate responsibility at Transparency Board level

    UK0018, 2011, Records Management

  93. Strengthening and broadening the Public Sector Transparency Board

    UK0019, 2011, Anti-Corruption Institutions

  94. Bringing the Sector Transparency Board model to other parts of public sector

    UK0020, 2011, Anti-Corruption Institutions

  95. Reviewing the existing governance and regulatory model

    UK0021, 2011, Records Management

  96. Establishing a framework for public service providers data inventories

    UK0022, 2011, Records Management

  97. Developing a clear methodology to support intelligent inventories

    UK0023, 2011, Records Management