Challenges in using data across government

Curated on Posted on by Stefaan Verhulst

National Audit Office (UK): “Data is crucial to the way government delivers services for citizens, improves its own systems and processes, and makes decisions. Our work has repeatedly highlighted the importance of evidence-based decision-making at all levels of government activity, and the problems that arise when data is inadequate.

Government recognises the value of using data more effectively, and the importance of ensuring security and public trust in how it is used. It plans to produce a new national data strategy in 2020 to position “the UK as a global leader on data, working collaboratively and openly across government”.

To achieve its ambitions government will need to resolve fundamental challenges around how to use and share data safely and appropriately, and how to balance competing demands on public resources in a way that allows for sustained but proportionate investment in data. The future national data strategy provides the government with an opportunity to do this, building on the renewed interest and focus on the use of data within government and beyond.

Content and scope of the report

This report sets out the National Audit Office’s experience of data across government, including initial efforts to start to address the issues. From our past work we have identified three areas where government needs to establish the pre-conditions for success: clear strategy and leadership; a coherent infrastructure for managing data; and broader enablers to safeguard and support the better use of data. In this report we consider:

  • the current data landscape across government (Part One);
  • how government needs a clear plan and leadership to improve its use of data (Part Two);
  • the quality, standards and systems needed to use data effectively (Part Three); and
  • wider conditions and enablers for success (Part Four).

Concluding remarks

Past examples such as Windrush and Carer’s Allowance show how important good‑quality data is, and the consequences if not used well. Without accurate, timely and proportionate data, government will not be able get the best use out of public money or take the next step towards more sophisticated approaches to using data that can reap real rewards.

But despite years of effort and many well-documented failures, government has lacked clear and sustained strategic leadership on data. This has led to departments under-prioritising their own efforts to manage and improve data. There are some early signs that the situation is improving, but unless government uses the data strategy to push a sea change in strategy and leadership, it will not get the right processes, systems and conditions in place to succeed, and this strategy will be yet another missed opportunity….(More)”.

Modernizing Congress: Bringing Democracy into the 21st Century

Curated on Posted on by Stefaan Verhulst

Report by Lorelei Kelly: “Congress represents a national cross section of civic voice. It is potentially the most diverse market for ideas in government and should be reaping the benefits of America’s creativity and knowledge. During our transition into the 21st century, this civic information asset — from lived experience to structured data — should fuel the digital infrastructure of a modern representative system. Yet Congress has thus far failed to tap this resource on behalf of its legislative and deliberative functions.

Today’s Congress can’t compete on digital infrastructure or modern data methods with the executive branch, the media or the private sector. To be sure, information weaponization, antique technology and Congress’ stubborn refusal to fund itself has arrested its development of a digital infrastructure. Congress is knowledge incapacitated, physically disconnected and technologically obsolete. In this condition, it cannot fulfill its First Branch duties as laid out in Article I of the U.S. Constitution.

Fortunately, changing the direction of Congress is now in sight. Before the end of January 2019, (1) the Foundations for Evidence-Based Policymaking Act became law, (2) the House created a Select Committee on Modernization, and (3) Congress began to restore its internal science and technology capacity.

Modernizing Congress lays out a plan to accelerate this institutional progress. It scopes out the challenge of including civic voice in the legislative and deliberative process. It then identifies trusted local information intermediaries who could act as key components of a modern knowledge commons in Congress. With three case studies, the report illustrates how members and staff are finding new ways to build connection and gather useful constituent input at the district level. The report explores an urban, rural and suburban district. It concludes that while individual members are leveraging technology to connect and use new forms of civic voice from constituents, what Congress needs most is a systemwide digital infrastructure and updated institutional standards for data collection….(More)”.

Make FOIA Work

Curated on Posted on by Stefaan Verhulst

“Make FOIA Work is about re-imagining journalism through design, participation and collaboration. Faculty, staff and students at Emerson College and the Engagement Lab staff worked alongside the Boston Institute of Nonprofit Journalism (BINJ) and MuckRock, two independent and alternative news and information platforms and publishers, to produce a data-driven and engagement-based investigative reporting series that exposes corruption around the sales of guns in Massachusetts. Through design studios in participatory methods and data visualization, project participants created a participatory guide book for journalists, practitioners and community members on how to undertake participatory design projects with a focus on FOIA requests, community participation, and collaboration. The project also highlights the course syllabi in participatory design methods and data visualization….(More)”.

Open Urban Data and the Sustainable Development Goals

Curated on Posted on by Stefaan Verhulst

Conference Paper by Christine Meschede and Tobias Siebenlist: “Since the adoption of the United Nations’ Sustainable Development Goals (SDGs) in 2015 – an ambitious agenda to end poverty, combat environmental threats and ensure prosperity for everyone – some effort has been made regarding the adequate measuring of the progress on its targets. As the crucial point is the availability of sufficient, comparable information, open data can play a key role. The coverage of open data, i.e., data that is machine-readable, freely available and reusable for everyone, is assessed by several measurement tools. We propose the use of open governmental data to make the achievement of SDGs easy and transparent to measure. For this purpose, a mapping of the open data categories to the SDGs is presented. Further, we argue that the SDGs need to be tackled in particular at the city level. For analyzing the current applicability of open data for measuring progress on the SDGs, we provide a small-scale case study on German open data portals and the embedded data categories and datasets. The results suggest that further standardization is needed in order to be able to use open data for comparing cities and their progress towards the SDGs….(More)”.

Disinformation Rated As Significant of a Problem As Gun Violence and Terrorism

Curated on Posted on by Stefaan Verhulst

Report by the Institute for Public Relations: “Sixty-three percent of Americans view disinformation—deliberately biased and misleading information—as a “major” problem in society, on par with gun violence (63%) and terrorism (66%), according to the 2019 Institute for Public Relations Disinformation in Society Report.

The 2019 IPR Disinformation in Society Report surveyed 2,200 adults to determine the prevalence of disinformation, who is responsible for sharing disinformation, the level of trust in different information sources, and the parties responsible for combatting disinformation.

“One surprising finding was how significant of a problem both Republicans and Democrats rated disinformation,” said Dr. Tina McCorkindale, APR, President and CEO of the Institute for Public Relations. “Unfortunately, only a few organizations outside of the media literacy and news space devote resources to help fix it, including many of the perceived culprits responsible for spreading disinformation.”

More than half (51%) of the respondents said they encounter disinformation at least once a day, while 78% said they see it once a week. Four in five adults (80%) said they are confident in their ability to recognize false news and information. Additionally, nearly half of Americans (47%) said they “often” or “always” go to other sources to see if news and information are accurate….(More)”.

Transparency in the EU Institutions – An Overview

Curated on Posted on by Stefaan Verhulst

Paper by Gianluca Sgueo: “The concepts of transparency of the public sector has been in existence, in various forms, for centuries. Academics, however, agree on the fact that transparency should be qualified as a modern concept. The wave of government reforms that occurred in the 1950s and the 1960s fostered the culture of transparent, accessible and accountable bureaucracies. In the 1990s, following on the spread of technologies, terms like “Government 2.0” and “open government” were coined to describe the use that public administrations made of the Internet and other digital tools in order to foster civic engagement, improve transparency, and enhance the efficiency of government services.

Transparency has come to the fore again over the past few years. National and supranational regulators (including the European Union) have placed transparency among the priorities in their regulatory agendas. Enhanced transparency in decision-making is considered to be a solution to the decline of trust in the public sector, a limit to the negative impact of conspiracy theories and fake news, and also a way to revitalise civic engagement.

EU institutions promote transparency across different lines of action. Exemplary are the ongoing debates on reforming the legislative procedure of the Union, regulating lobbying activities, making available data in open format and digitalising services. Also relevant is the role of the European Ombudsman in promoting a culture of transparency at the EU level. 

Studies suggest that transparency and participation in public governance are having a positive impact on the accountability of EU institutions, and hence on citizens’ perceptions of their activities. The present briefing offers an overview of the actions that EU institutions are implementing to foster transparency, analyzing the potential benefits and briefly discussing its possible drawbacks…(More)”.

Smarter Select Committees

Curated on Posted on by Stefaan Verhulst

Theo Bass at Nesta: “This report outlines how digital tools and methods can help select committees restore public trust in democracy, reinvigorate public engagement in Parliament and enhance the work of committees themselves.

Since their establishment in 1979, select committees have provided one of our most important democratic functions. At their best, committees gather available evidence, data and insight; tap into public experiences and concerns; provide a space for thoughtful deliberation; and help parliament make better decisions. However, the 40th anniversary of select committees presents an important opportunity to re-examine this vital parliamentary system to ensure they are fit for the 21st century.

Since 2012 select committees have committed to public engagement as a ‘core task’ of their work, but their approach has not been systematic and they still struggle to reach beyond the usual suspects, or find ways to gather relevant knowledge quickly and effectively. With public trust in democracy deteriorating, the imperative to innovate, improve legitimacy and find new ways to involve people in national politics is stronger than ever. This is where digital innovation can help.

If used effectively, digital tools and methods offer select committees the opportunity to be more transparent and accessible to a wider range of people, improving relevance and impact. Like any good public engagement, this needs careful design, without which digital participation risks being distorting and unhelpful, amplifying the loudest or least informed voices.

To achieve success, stronger ambition and commitment by senior staff and MPs, as well as experimentation and learning through trial and improvement will be essential. We recommend that the UK Parliament commits to running at least five pilots for digital participation, which we outline in more detail in the final section of this report….(More)”.

Crowdsourcing and Crisis Mapping in Complex Emergencies

Curated on Posted on by Stefaan Verhulst

Guidance paper by Andrew Skuse: “…examines the use of crowdsourcing and crisis mapping during complex emergencies. Crowdsourcing is a process facilitated by new information and communication technologies (ICTs), social media platforms and dedicated software programs. It literally seeks the help of ‘the crowd’, volunteers or the general public, to complete a series of specific tasks such as data collection, reporting, document contribution and so on. Crowdsourcing is important in emergency situations because it allows for a critical link to be forged between those affected by an emergency and those who are responding to it. Crowdsourcing is often used by news organisations to gather information, i.e. citizen journalism, as well as by organisations concerned with emergencies and humanitarian aid, i.e. International Committee of the Red Cross, the Standby Task Force and CrisisCommons. Here, crowdsourced data on voting practices and electoral violence, as well as the witnessing of human rights contraventions are helping to improve accountability and transparency in fragile or conflict-prone states. Equally, crowdsourcing facilitates the sharing of individual and collective experiences, the gathering of specialized knowledge, the undertaking of collective mapping tasks and the engagement of the public through ‘call-outs’ for information…(More)”.

Open Data Retrospective

Curated on Posted on by Stefaan Verhulst

Laura Bacon at Luminate:: “Our global philanthropic organisation – previously the Government & Citizen Engagement (GCE) initiative at Omidyar Network, now Luminate – has been active in the open data space for over decade. In that time, we have invested more than $50m in organisations and platforms that are working to advance open data’s potential, including Open Data Institute, IMCO, Open Knowledge, ITS Rio, Sunlight, GovLab, Web Foundation, Open Data Charter, and Open Government Partnership.

Ahead of our transition from GCE to Luminate last year, we wanted to take a step back and assess the field in order to cultivate a richer understanding of the evolution of open data—including its critical developments, drivers of change, and influential actors[1]. This research would help inform our own strategy and provide valuable insight that we can share with the broader open data ecosystem. 

First, what is open data? Open data is data that can be freely used, shared, and built-upon by anyone, anywhere, for any purpose. At its best, open government data can empower citizens, improve governments, create opportunities, and help solve public problems. Have you used a transport app to find out when the next bus will arrive? Or a weather app to look up a forecast? When using a real estate website to buy or rent a home, have you also reviewed its proximity to health, education, and recreational facilities or checked out neighborhood crime rates? If so, your life has been impacted by open data. 

The Open Data Retrospective

We commissioned Dalberg, a global strategic advisory firm, to conduct an Open Data Retrospective to explore: ‘how and why did the open data field evolve globally over the past decade?’ as well as ‘where is the field today?’ With the concurrent release of the report “The State of Open Data” – led by IDRC and Open Data for Development initiative – we thought this would be a great time to make public the report we’d commissioned. 

You can see Dalberg’s open data report here, and its affiliated data here. Please note, this presentation is a modification of the report. Several sections and slides have been removed for brevity and/or confidentiality. Therefore, some details about particular organisations and strategies are not included in this deck.

Evolution and impact

Dalberg’s report covers the trajectory of the open data field and characterised it as: inception (pre-2008), systematisation (2009-2010), expansion (2011-2015), and reevaluation (2016-2018).This characterisation varies by region and sector, but generally captures the evolution of the open data movement….(More)”.

The Age of Digital Interdependence

Curated on Posted on by Stefaan Verhulst

Report of the High-level Panel on Digital Cooperation: “The immense power and value of data in the modern economy can and must be harnessed to meet the SDGs, but this will require new models of collaboration. The Panel discussed potential pooling of data in areas such as health, agriculture and the environment to enable scientists and thought leaders to use data and artificial intelligence to better understand issues and find new ways to make progress on the SDGs. Such data commons would require criteria for establishing relevance to the SDGs, standards for interoperability, rules on access and safeguards to ensure privacy and security.

Anonymised data – information that is rendered anonymous in such a way that the data subject is not or no longer identifiable – about progress toward the SDGs is generally less sensitive and controversial than the use of personal data of the kind companies such as Facebook, Twitter or Google may collect to drive their business models, or facial and gait data that could be used for surveillance. However, personal data can also serve development goals, if handled with proper oversight to ensure its security and privacy.

For example, individual health data is extremely sensitive – but many people’s health data, taken together, can allow researchers to map disease outbreaks, compare the effectiveness of treatments and improve understanding of conditions. Aggregated data from individual patient cases was crucial to containing the Ebola outbreak in West Africa. Private and public sector healthcare providers around the world are now using various forms of electronic medical records. These help individual patients by making it easier to personalise health services, but the public health benefits require these records to be interoperable.

There is scope to launch collaborative projects to test the interoperability of data, standards and safeguards across the globe. The World Health Assembly’s consideration of a global strategy for digital health in 2020 presents an opportunity to launch such projects, which could initially be aimed at global health challenges such as Alzheimer’s and hypertension.

Improved digital cooperation on a data-driven approach to public health has the potential to lower costs, build new partnerships among hospitals, technology companies, insurance providers and research institutes and support the shift from treating diseases to improving wellness. Appropriate safeguards are needed to ensure the focus remains on improving health care outcomes. With testing, experience and necessary protective measures as well as guidelines for the responsible use of data, similar cooperation could emerge in many other fields related to the SDGs, from education to urban planning to agriculture…(More)”.