Pilot open data communities concept (NL0048)

What is the public problem that the commitment will address? Data is a production tool for every organization. A production tool that plays an increasingly important role in providing added value to both inside and outside the organization. It is essential to improve the findability of data and to make it easier to conclude “data deals” in collaboration with private and public parties. That is why we started data communities on data.overheid.nl in 2019. 25 It is important to follow up the course that has been set. We now need to take next steps in supporting the communities. We also want to gain generic insight into the impact of making data available. In this way, data policy in the Netherlands can contribute to the promised development of economic and social value. The data.overheid.nl portal is thus catching up to keep up with European developments. To be able to manage our activities, a yardstick is needed to measure the impact of data.overheid.nl and our activities. A framework to measure the impact of making data available with KPIs. We also see that data.overheid.nl is being asked to play a role in supporting AI initiatives and sharing data. The Corona crisis reinforces the need to share data better and easier. Being able to share data makes it possible to utilize the value. However, a lot of data is not shared because the conditions are not clear under which it can be shared. Most open data on data.overheid.nl has an open license of which it is reasonably clear what the condition for reuse is. Data that is not open and for which, for example, must be logged in or an agreement signed, is now not shared. There is a lack of a proper description of the conditions and a way of checking the conditions for reuse. Data.overheid.nl now plays a natural role in providing startups and scale-ups with easy access to government data. Not only by handling data requests that lead to efficient contact between startups and data owners, but mainly by ensuring more and better findable datasets, even if they are not initially available as open data.

What is the commitment? We are starting a process in which we facilitate 5 data communities. A data community consists of a combination of data owners, re-users and experts in a specific domain. The community offers in-depth information, specific data, reference data, applications and an opportunity to ask experts directly about data. In addition, we will provide more information with datasets about how the datasets can be reused. Currently, many re-users are still confused about how they can re-use data. In the coming period, we will improve this and show how data can be reused for each dataset. Finally, we are developing a framework to actually measure the impact of the data that is made available. Indicators are drawn up and these are made visible on the data portal. In this way, more insight is provided into the impact of government data. With these activities we are able to:  Provide better insight into the impact of making data available.  To have clear conditions and conditions for sharing data in a selection of datasets.  Create a structural effect on bringing together supply and demand for open data with the help of the data communities.

How will the commitment contribute to solving the public problem? In other countries, the focus on communities is successfully used to initiate demand articulation and in this way bring supply and demand for government data closer together. In order to make more data of better quality available for public use. That is why we also want to apply this in the Netherlands. 26 We are conducting a pilot in which we are investigating a number of datasets whether it is possible to share more information about the data. Most datasets lack insight into the structure of the data. For example:  Which columns does the data contain?  Which concepts can be found in the data?  What is the underlying data model?  What is the relationship with other data sources?

Why is this commitment relevant to OGP values? The data community revolves around the interaction between the supply of data by data owners, the use of the data in applications and the insight into the impact of the use of the data on processes, business operations and services to customers. The essence of a community is the feedback and interaction that arises. It contributes to the improvement of the quality and continuity of the data for data owners. At the same time, employees are directly involved in the data management process. The examples from France and Spain, and the first insights from our own Education and Mobility data communities show that the focus on specific domains gives a boost to:  Gain more insight into the impact of data;  Get more data available;  Make this more attuned to demand;  Contribute to more shareable data. This benefits transparency and the possibility of participation. This also stimulates technological innovation.

Additional information The implementation and further development on data.overheid.nl stems directly from the National Data Agenda drawn up by Min. BZK. Milestone Activity with a verifiable deliverable Start Date: End Date: Pilot from the data communities 01-01-20 01-01-22 Pilots on the subject of data sharing 01-01-21 01-01-22 Developing an impact framework 01-08-20 01-01-22

Action Plan Review

Commitment 10: Open data communities

Commitment cluster #10, 11, and 12: Open Technology

(Ministry of the Interior and Kingdom Relations and/or its subsidiaries such as KOOP (Netherlands publication office), ICTU, Foundation for Public Code, Open State Foundation, Code for NL, EMMA Communicatie, Ministry of Justice and Safety, Chamber of Audit)

For a complete description of the commitments included in this cluster, see commitments 10, 11, and 12 on pages 24-30 of the Netherlands 2020 – 2022 action plan here.

Context and objectives:

The Dutch government owns vast amounts of data, which can be accessed publicly via the national open data portal data.overheid.nl. Following the completion of a pilot in 2020, Commitment 10 seeks to scale up this work by establishing five new open data communities in addition to the four currently active communities. The open data communities consist of data owners, re-users, and experts in specific domains, such as education or mobility. [32] The communities offer specific data, reference data, applications, and an opportunity to ask experts directly about the data. This commitment also involves developing indicators that can help assess the actual impact of using and re-using government datasets. These indicators will be made visible on the national data portal and are expected to sustain a structural supply and demand for open data (with the help of these data communities). The commitment also calls for developing impact assessment on open data use.

In addition, digital transformations have altered the functioning of public service delivery in the Netherlands. Engagement with the IT community, including software developers, is essential as this enhances quality and helps foster a deeper understanding of these tools between users and creators. As the government frequently commissions software, doing so in an open-source format, meaning software is free and open to modification and re-distribution, promotes essential collaboration of public organizations and the sharing of digital tools for the public good. Aside from collaborative development, open-source software can also strengthen transparency, avoid the duplication of software tools for government agencies, and prevent so-called vendor ‘lock in’. Furthermore, and in response to inquiries from MPs, the government plans to make the source code available for software that is developed by public means so that it can be publicly reviewed, improved, and re-used. [33] Government organizations, however, have limited experience releasing source codes and it is not always clear what the costs of releasing the source code are or if this adds value in all cases. Through Commitment 11, the Ministry of Interior and Kingdom Relations, together with a broad range of technology-focused CSOs, will spread the use of working open source within government, by stimulating debate, developing a toolbox, sharing best practices, and linking this theme to policy making at the national level.

Governments also increasingly rely on new technologies such as artificial intelligence (AI), machine learning, and algorithms to analyze data and inform policy making. The use of algorithms in government policies stirred debate in Dutch society; local watchdogs criticized the use of an algorithm called SyRI by the government to fight fraud due to its its lack of transparency, apparent bias, and disregard for privacy. SyRI’s use was ultimately banned in national court who ruled that the system violated the European Convention on Human Rights. [34] The government has commissioned various studies on the topic [35] and agrees that algorithms need to be transparent for reasons of oversight and legal supervision. [36] The extent to which algorithms are used, however, still appears to be largely unknown. In addition, the Court of Audit has reported that little attention is currently paid to ethical aspects or potential biases in the government’s algorithms. [37] It noted that citizens should be able to understand the use and operation of algorithms and know where to turn to with questions or objections. The Court of Audit recommends that the government secure personal data in the management of its algorithms and ensure an unambiguous common language that defines quality requirements for algorithms.

Against this backdrop, the fourth action plan continues to work on the theme of algorithms under Commitment 12. The Netherlands’ previous action plan included a commitment on developing preliminary frameworks and guidelines around algorithmic transparency, but it saw only limited completion. [38] This new commitment, on the other hand, explicitly focuses on the issue of ethics and algorithms. It aims to develop a human-rights based impact assessment tool for potential algorithms and use this to set standards in engaging with third parties (such as external software suppliers). It also plans to improve conditions for the government purchasing algorithms from companies and explore how to arrive at joint definitions in AI and algorithms. However, the commitment does not explicitly state if the human rights impact assessments for government algorithms will be made available to the public.

Potential for results:Modest

Taken together, the commitments in this cluster could improve the openness, transparency, and participation in how the Netherlands uses critical technologies and data. All three commitments seek to work with a broad variety of stakeholders outside government and facilitate external (including citizen) feedback to improve government owned or hosted data and software tools.

Open government data can only live up to its potential if, aside from being readily and publicly available in appropriate formats, it is used by an ever-growing group of diverse and experienced users. Through the open data communities under Commitment 10, government agencies will learn about new, innovative ways for the re-use of government data, while users will learn to better navigate the national portal that includes tens of thousands of datasets. The particular attention devoted to monitoring and evaluating success, by seeking to develop portal-wide indicators to measure impact of data, could yield significant results. Demonstrated impact on social issues by using open data can subsequently increase the demand for more data. Drawing on that impact assessment, this commitment can also help build broader social and political support for the disclosure of government data in an open data format.

Commitment 11 has promising potential to strengthen the government’s ability to work in open source, thanks to direct linkages to existing policy-making efforts at the central government level, coupled with strong engagement from civil society and the open-source community. Although the exact results are difficult to forecast, making open-source coding more transparent could reveal new insights into how government operates regarding digital public services.

Finally, the renewed focus on government algorithms under Commitment 12 follows earlier IRM recommendations to draw on existing bodies of domestic work in this area at the central government level. [39] Although this commitment does not call for opening up additional government algorithms, the human rights impact assessment could help government agencies to safeguard against potential biases in the underlining data of the algorithms they procure. This in turn could help reduce the possible discrimination of certain segments of the population when the government utilizes algorithms in developing policies. This commitment could also enrich other efforts at the central government level, such as the ‘procurement with impact’ strategy. [40]

It is important to note, however, that the commitment does not specify if the use of the human rights impact assessments will become mandatory for all government agencies when they procure algorithms. It also does not specify if the findings of these impact assessments will be made publicly available during the algorithm procurement process. Therefore, the results of this commitment will largely depend on the uptake of the human rights assessments among government agencies and the level of detail included. The commitment’s results will also depend on the discussions held with civil society on the impact of algorithms on society and the extent to which these discussions lead to making more algorithms publicly available for scrutiny.

Opportunities, challenges, and recommendations during implementation

Open technology is a broad topic, yet several thematic overlaps could be explored inside this cluster and beyond. For example, the commitments on open data communities and open source could strengthen the proactive disclosure of government information under Commitment 5 of this action plan. Information categories and formats are central to that work. Therefore, the IRM recommends sharing relevant insights and ideas from Commitments 10 and 11 with the stakeholders working on the proactive disclosure of government information (Commitment 5). In addition, Commitment 3 on digital democracy aims to pilot an open source digital tool and AI-powered consensus platforms (such as pol.is and openstad.org), and lessons learned could be shared with the experts and organizations involved under Commitment 11.

Regarding Commitment 12, the IRM recommends making the human rights impact assessment for government procurement of algorithms publicly available. This way, the impact assessments could provide citizens and civil society with an important mechanism to monitor how government agencies are taking human rights into account when procuring their algorithms. As a result, citizens and civil society will be able to better raise potential ethical issues in the government’s use of algorithms in its policies. The IRM also recommends going a step further by making use of the human rights impact assessments mandatory for all public agencies when they procure algorithms.

In terms of open algorithms more broadly, the Netherlands has joined a group of other countries working on this topic in the context of OGP. [41] The IRM recommends engaging international experts from other countries to share their experiences and lessons learned on algorithmic transparency. EtaLab from France, for example, has experience in disclosing to citizens how and when algorithms were used and could add significant value to the work in the Netherlands. In addition, the IRM recommends assessing where disclosure is needed the most and consider listing the high-value datasets where algorithms are currently used. For example, the City of Amsterdam, that was involved in the co-creation process, has developed an algorithm register where citizens can learn more about the use of algorithms in the city administration. [42] Such examples of public outreach and awareness raising are considered important to help increase knowledge and skills for citizens to develop ‘technological citizenship’. [43]

Finally, in anticipation of Commitment 13 of this action plan (discussed below), the IRM recommends that stakeholders involve the National Ombudsperson, when possible, in their work on algorithmic transparency, as this represent one of the key channels for people to raise concerns. In addition, the National Ombudsperson has declared it seeks to assure that algorithms used by the government are sound and citizen driven. [44]

Results Report

Commitment 10. Open Data Communities

● Verifiable: Yes

● Does it have an open government lens? Yes

● This commitment has been clustered as: Open Technology

● Potential for results: Modest

● Completion: Complete

● Did it open government? Marginal

The open data communities began operating in 2021 on data.overheid.nl. [30] The communities consist of data holders, re-users, and experts, and cover the domains of energy, education, mobility, social security, and migration. They provide a central place to discuss available data within the subject. The action plan did not specify the number of open data communities that would be created, but data.overheid.nl offers instructions on how to set up a community. The communities reportedly meet regularly. While it is difficult to determine the exact impact these communities have had on opening government, they could help users navigate existing data and access it more easily. Furthermore, they encourage interaction among government data holders and potential users, which could contribute in the long term to a culture of openness. Therefore, the IRM assesses this commitment’s impact on opening government as marginal.