The impact of Open Data


GovLab/Omidyar Network: “…share insights gained from our current collaboration with Omidyar Network on a series of open data case studies. These case studies – 19, in total – are designed to provide a detailed examination of the various ways open data is being used around the world, across geographies and sectors, and to draw some over-arching lessons. The case studies are built from extensive research, including in-depth interviews with key participants in the various open data projects under study….

Ways in which open data impacts lives

Broadly, we have identified four main ways in which open data is transforming economic, social, cultural and political life, and hence improving people’s lives.

  • First, open data is improving government, primarily by helping tackle corruption, improving transparency, and enhancing public services and resource allocation.
  • Open data is also empowering citizens to take control of their lives and demand change; this dimension of impact is mediated by more informed decision making and new forms of social mobilization, both facilitated by new ways of communicating and accessing information.
  • Open data is also creating new opportunities for citizens and groups, by stimulating innovation and promoting economic growth and development.
  • Finally, open data is playing an increasingly important role insolving big public problems, primarily by allowing citizens and policymakers to engage in new forms of data-driven assessment and data-driven engagement.

 

Enabling Conditions

While these are the four main ways in which open data is driving change, we have seen wide variability in the amount and nature of impact across our case studies. Put simply, some projects are more successful than others; or some projects might be more successful in a particular dimension of impact, and less successful in others.

As part of our research, we have therefore tried to identify some enabling conditions that maximize the positive impact of open data projects. These four stand out:

  • Open data projects are most successful when they are built not from the efforts of single organizations or government agencies, but when they emerge from partnerships across sectors (and even borders). The role of intermediaries (e.g., the media and civil society groups) and “data collaboratives” are particularly important.
  • Several of the projects we have seen have emerged on the back of what we might think of as an open data public infrastructure– i.e., the technical backend and organizational processes necessary to enable the regular release of potentially impactful data to the public.
  • Clear open data policies, including well-defined performance metrics, are also essential; policymakers and political leaders have an important role in creating an enabling (yet flexible) legal environment that includes mechanisms for project assessments and accountability, as well as providing the type high-level political buy-in that can empower practitioners to work with open data.
  • We have also seen that the most successful open data projects tend to be those that target a well-defined problem or issue. In other words, projects with maximum impact often meet a genuine citizen need.

 

Challenges

Impact is also determined by the obstacles and challenges that a project confronts. Some regions and some projects face a greater number of hurdles. These also vary, but we have found four challenges that appear most often in our case studies:

  • Projects in countries or regions with low capacity or “readiness”(indicated, for instance by low Internet penetration rates or hostile political environments) typically fare less well.
  • Projects that are unresponsive to feedback and user needs are less likely to succeed than those that are flexible and able to adapt to what their users want.
  • Open data often exists in tension with risks such as privacy and security; often, the impact of a project is limited or harmed when it fails to take into account and mitigate these risks.
  • Although open data projects are often “hackable” and cheap to get off the ground, the most successful do require investments – of time and money – after their launch; inadequate resource allocation is one of the most common reasons for a project to fail.

These lists of impacts, enabling factors and challenges are, of course, preliminary. We continue to refine our research and will include a final set of findings along with our final report….(More)

Policies for a fair re-use of data: Big Data and the application of anonymization techniques


Paper by Giuseppe D’Acquisto: “The legal framework on data protection in Europe sets a high standard with regard to the possible re-use of personal data. Principles like purpose limitation and data minimization challenge the emerging Big Data paradigm, where the “value” of data is linked to its somehow still unpredictable potential future uses. Nevertheless, the re-use of data is not impossible, once they are properly anonymized. The EU’s Article 29 Working Party published in 2014 an Opinion on the application of anonymization techniques, which can be implemented to enable potential re-use of previously collected data within a framework of safeguards for individuals. The paper reviews the main elements of the Opinion, with a view to the widespread adoption of anonymization policies enabling a fair re-use of data, and gives an overview of the legal and technical aspects related to anonymization, pointing out the many misconceptions on the issue…(More)”

US citizenship and immigration services to host Twitter ‘office hours’


NextGov: “U.S. Citizenship and Immigration Services wants to get more social with prospective immigrants.

USCIS will host its first-ever Twitter office hours Tuesday from 3-4 p.m. using the #AskUSCIS hashtag. Agency officials hope to provide another avenue for customers to ask questions and receive real-time feedback, according to a USCIS blog post.

To participate, customers just have to follow @USCIS on Twitter, use the hashtag and ask away, although the blog post makes clear staff won’t answer case-specific questions and case status updates.

The post also warns Twitter users not to post Social Security numbers, receipt numbers or any other personally identifiable information.

“With Twitter office hours, we want to help you – either as you’re preparing forms or after you’ve filed,” the blog post states.

USCIS will post a transcript of the questions and answers to its blog following the Twitter office hours, and if the concept is successful, the agency plans to host the sessions on a regular basis.

The agency’s social outreach plan is part of broader effort among federal agencies to improve customer experience.

This particular variant of digital engagement mirrors an effort championed by the Office of Federal Student Aid. FAFSA answers questions on the last Wednesday of every month using the hashtag #AskFAFSA, an effort that’s helped build its digital engagement significantly in recent years….(More)”

How will security attitudes change in the era of the smart city?


Chloe Green at Information Age: “The phrase ‘Cities of the Future’ conjures up so many different images, from the utopia of The Jetsons to the dystopia of Judge Dredd. But one thing that most agree on is the connected nature of our cities, with every aspect of life being connected to the internet, machines communicating with machines and with us.

….

Connected cities, also called smart cities, are one aspect of the Internet of Things. Smart cities are where services use technology to be more efficient and cost-effective, from traffic and transport systems to waste management to energy and healthcare…. – with these technological advances come big concerns. Specifically these concerns revolve around data and its protection.

A connected city will be generating huge quantities of data, which will be shared from machine to machine and department to department. That’s a lot of data to target, and a lot of attack vectors to get at it.

And, as this article on Dark Reading points out, those attack vectors include the sensors themselves, which can be hacked and used to feed fake data into the system. This can result in transport systems being shut down, for example. In a big city that is a quick route to total mayhem….

Hiding the data away on an internal network won’t work, in fact that goes against the very idea of a smart city, where data sharing is the norm. The problem is, many of the companies producing hardware and software for smart cities are not experts in cyber security and so it’s often an after-thought. There is also a startling lack of standards in the smart city industry at the moment.

That is slowly changing though; Securing Smart Cities is a non-profit organisation made up of cyber security companies such as Kaspersky Lab, research bodies such as IOActive and industry bodies like the Cloud Security Alliance.

Similarly, there have been calls for smart cities to have a Computer Emergency Response Team (CERT) on standby in case of a cyber attack against the infrastructure.

But in some ways new security threats posed by smart cities are not too different from what we’ve seen with the emergence of mobile and cloud computing. What’s changed is the perimeter of the network; it’s no longer contained to a data centre. The same rules that apply here could well apply to smart cities.

Access management will play a big role in securing smart cities; ensuring only the right people (or devices) from the right location can interact with each other can help to keep the bad guys out.

From encryption to DDoS mitigation to intelligent traffic management, there are systems that can be put in place to secure the data that smart cities and the IoT need to be truly effective…..(More)

Civic engagement platform brings the town meeting online


Springwise: “Citizens may have the ability to express enthusiasm or disgust for government policies online, but these opinions are only as valuable as the ears they reach. We recently saw Balancing Act offer citizens the ability to view and play around with their city’s budget, providing governments with a better understanding of the wants and needs of their constituents. Now, CitizenLab is another civic engagement platform, which is bringing the town meeting into the digital age — providing a space for citizens to communicate with their government, and for governments to ‘citizensource’ opinions on their policies.

citizenlab

To begin, participants visit the platform and enter their city. This will take them to a collection of ‘labs’ — categories such as education, health and public spaces. They can then post new ideas, join existing conversations and upvote interesting topics. Local governments can then use the platform as a resource to discover the priorities of its citizens. They can respond directly to discussions and consult the public opinion on important issues. Governments can also acknowledge the most vital issues raised by taking them to city council for discussion. The platform is designed to host positive ideas, rather than raise issues.

Website: www.citizenlab.co

The Website That Visualizes Human Activity in Cities Across the World


Emerging Technology From the arXiv: “The data from mobile phones is revolutionizing our understanding of human activity. In recent years, it has revealed commuting patterns in major cities, wealth distribution in African countries, and even reproductive strategies in western societies. That has provided unprecedented insight for economists, sociologists, and city planners among others.

But this kind of advanced research is just a first step in a much broader trend. Phone data is set to become a standard resource that almost anyone can use to study and watch humanity continuously, much as they can now watch the weather unfold anywhere on the planet almost in real time.

But one thing is holding them back—the lack of powerful computational tools that can gather, crunch, and present the data in meaningful ways.

Today, that looks set to change to the work of Dániel Kondor and a few pals at the SENSEable City Laboratory, part of MIT, and at Ericsson, a company that produces network infrastructure technologies. These guys have unveiled a powerful online tool that uses mobile phone data to visualize human activity in cities all over the world.

This new tool, called ManyCities, allows anybody to study human activity in various cities with unprecedented detail.  But the key is that it organizes and presents the data in intuitive ways that quickly reveals trends and special events….

ManyCities then presents the data in three simple ways. The first shows how phone usage varies over time, revealing clear daily and weekly patterns as well as longer term trends. For example, ManyCities clearly shows a steady, long-term increase in data traffic, the effect of holidays, and how usage patterns change dramatically during important events like the Wimbledon tennis championship in London.

ManyCities also allows user to drill down into the data to compare patterns in different neighborhoods or in different cities. It shows, for example, that text message activity peaks in the morning in Hong Kong, in the evening in New York and at midday in London….Kondor and co have made it available at www.ManyCities.org for anybody to try.

This kind of tool is clearly evolving into a real time analytics tool. It’s not hard to imagine how people could use it to plan events such as conferences, sporting contests, or concerts or to plan emergency city infrastructure. One day people may even tune in to a “smartphone forecast” to find out if their phone will work when the big game kicks off that evening.

Ref: arxiv.org/abs/1509.00459 : Visualizing Signatures Of Human Activity In Cities Across The Globe”

5 tech trends that will transform governments


Zac Bookman at the World Economic Forum: “…The public sector today looks a bit like the consumer industry of 1995 and the enterprise space in 2005: it is at the beginning of a large-scale digital metamorphosis. The net result will be years of saved time, better decisions and stronger communities.

Here are five trends that will define this transformation in the coming decade:

  1. Real-time operations

Many industries in the global economy already operate in real time. ….

Governments are different. They often access accurate data only on a monthly or quarterly basis, even though they make critical decisions every day. This will change with software deployments that help governments unleash and use current data to make more informed decisions about how they can allocate public resources effectively.

  1. Smarter cities  

Studies on human migration patterns indicate that more people are moving to cities. By 2025, an estimated 60% of the world’s population will live in an urban centre. High rates of urbanization will force cities to use their existing resources more efficiently. Networked infrastructures – including roads, phone lines, cable networks, satellites and the internet – will be important parts of the solution to this challenge….For example, MIT and Copenhagen recently collaborated on an electric-hybrid bike wheel that monitors pollution, road conditions and traffic. The wheel allows cities to monitor their environments at a level that was previously unfeasible with cheap sensors and manual labour, offering a quantum leap in networking capability without using further human or capital resources.

  1. Increased citizen engagement

Smart networks are wonderful things, but cities need to guard themselves against making efficiency a sacred cow. There is inherent tension between the ideals of democracy and efficiency, between the openness of platforms that encourage engagement and centralized systems. Rather than focus solely on making everything smart, cities will have to focus on slowing down and improving the quality of life.

These considerations will cause cities to increase citizen engagement. Transparency is a subset of this goal. Open data platforms, such as data.gov and data.gov.uk, host troves of machine-readable government information that allow communities to target and solve problems for which governments do not have the bandwidth. Crowdfunding platforms, such as neighbor.ly, allow citizens to participate in the civic process by enabling them to invest in local capital projects. These types of civic tech platforms will continue to grow, and they will be vital to the health of future democracies.

  1. 21st-century reporting software for governments

The information technology that powers government is notoriously antiquated. …

New reporting technology, such as the system from OpenGov, will automatically pull and display data from governments’ accounting systems. These capabilities empower employees to find information in seconds that would have previously taken hours, days or even weeks to find. They will expand inter-departmental collaboration on core functions, such as budgeting. And they will also allow governments to compare themselves with other governments. In the next decade, advanced reporting software will save billions of dollars by streamlining processes, improving decisions and offering intelligent insights across the expenditure spectrum.

  1. Inter-governmental communication

The internet was conceived as a knowledge-sharing platform. Over the past few decades, technologists have developed tools such as Google and Wikipedia to aid the flow of information on the web and enable ever greater knowledge sharing. Today, you can find nearly any piece of information in a matter of seconds. Governments, however, have not benefited from the rapid development of such tools for their industry, and most information sharing still occurs offline, over email, or on small chat forums. Tools designed specifically for government data will allow governments to embrace the inherent knowledge-sharing infrastructure of the internet….(More)”

Open Budget Data: Mapping the Landscape


Jonathan Gray at Open Knowledge: “We’re pleased to announce a new report, “Open Budget Data: Mapping the Landscape” undertaken as a collaboration between Open Knowledge, the Global Initiative for Financial Transparency and the Digital Methods Initiative at the University of Amsterdam.

Download the PDF.

The report offers an unprecedented empirical mapping and analysis of the emerging issue of open budget data, which has appeared as ideals from the open data movement have begun to gain traction amongst advocates and practitioners of financial transparency.

In the report we chart the definitions, best practices, actors, issues and initiatives associated with the emerging issue of open budget data in different forms of digital media.

In doing so, our objective is to enable practitioners – in particular civil society organisations, intergovernmental organisations, governments, multilaterals and funders – to navigate this developing field and to identify trends, gaps and opportunities for supporting it.

How public money is collected and distributed is one of the most pressing political questions of our time, influencing the health, well-being and prospects of billions of people. Decisions about fiscal policy affect everyone-determining everything from the resourcing of essential public services, to the capacity of public institutions to take action on global challenges such as poverty, inequality or climate change.

Digital technologies have the potential to transform the way that information about public money is organised, circulated and utilised in society, which in turn could shape the character of public debate, democratic engagement, governmental accountability and public participation in decision-making about public funds. Data could play a vital role in tackling the democratic deficit in fiscal policy and in supporting better outcomes for citizens….(More)”

Humanizing Technology: A History of Human-Computer Interaction


Steve Lohr in the New York Times: “The march of progress in computing is a climb. Each big step forward is also a step up, so that communication is further away from the machine, more on human terms.

And each time, the number of people who can use computing increases dramatically. At first, programming languages were the medium of communication between man and machine. Fortran, the breakthrough computer language, was designed to resemble the algebraic formulas familiar to scientists and engineers — reasonably enough, since they were the only people anyone could imagine using the relative handful of giant calculating machines back then.

Today, billions of people roam the Internet from computer phones they hold in their hands. Dramatic advances in hardware, of course, are a big part of the explanation, notably the flywheel of technological dynamism known as Moore’s Law, celebrating the chip industry’s ability to double computing power every couple of years (there’s a debate about whether the pace is tailing off, but that’s another story).

Yet there is another force in the striking democratization of computing beyond hardware, one that is more subtle but still crucial. That is the steady stream of improvements in the design of computer products, mainly software, which have opened the door to new users by making computers easier to use. The term most used now is “user-interface design.” But that suggests a narrower, product focus than the field that stretches back several decades, called human-computer interaction, which embraces psychology, anthropology and other disciplines.

“I think human-computer interaction designs have had as much impact as Moore’s Law in bringing the web and mobile devices to the world,” said Ben Shneiderman, a professor at the University of Maryland, College Park.

To try to raise the profile of prominent people in the field, Mr. Shneiderman last week published a web site for what he calls “The Human-Computer Interaction Pioneers Project.” It is a personal project for Mr. Shneiderman, who founded Maryland’s Human-Computer Interaction Laboratory in 1983, and is an avid photographer. The web page for each of his pioneers includes a brief text description and photographs, often several, that Mr. Shneiderman has taken of the person, at professional conferences and elsewhere over the years….(More)”

Harnessing the Internet of Everything to Serve the Public Good


Brian Gill at Socrata: “…Thanks to sensor-based objects, big data is getting bigger, and that presents opportunities — and considerations — for government organizations.

Picture this: It’s a sunny summer’s day a few years from now, plants are in full bloom, and you’re strolling through a major city park. Unfortunately, your eyes are watering as the itchy beginnings of a pollen-induced allergy attack begin to compromise the experience.

Pulling out your phone, you consult a data visualization showing the park’s hour-by-hour pollen count densities. You then choose a new path, one with different vegetation and lighter pollen counts, and go about your way, barely noticing the egg-shaped nodes in the canopy monitoring everything from pollen to air quality to foot-traffic trends.

Welcome to the Internet of Everything, city edition.

….tapping into, and especially generating, IoT data streams is a natural fit for larger municipal governments who not only have the fiscal resources needed to put IoT data to work, they have an innate motivator: improving citizens’ lives.

Consider Chicago’s Array of Things project, an experimental network of modular sensor boxes installed around the city’s core. Think of it as an urban fitness-data tracker: The nodes collect real-time data on the city’s environment and infrastructure for research and public use, with the first units focusing on atmosphere, air quality, and environmental factors such as temperature, humidity, and light.

From this data alone, the potential applications are exciting, such as using air, sound, and vibration data to monitor vehicle traffic, or infrared sensors to measure street temperature to guide salting responses during winter storms. The thinkers behind Array of Things can even envision a downtown where street lamp poles alert pedestrians to icy sidewalk patches and apps guide people to safe nocturnal walking routes.

This is all cool stuff, but “outcome” is the key word here, says McInnis, who recommends a bottom-up approach when assessing IoT opportunities. Instead of worrying whether you currently possess the technical infrastructure to harness IoT data, he says, first determine what you want to achieve, be it water quality monitoring or winter sidewalk safety, and then work from there — you may even already have IoT data streams that can be redeployed.

And as cities like Chicago are demonstrating, the Internet of Things not only has the potential to reshape how municipalities can harness a world of increasing object-driven data; it’s helping reshape how cities think about the nature of usable data.

In other words, all these new IoT data streams are actually like water, a natural resource. And just as water flows from many sources, government IoT data can also be collected, channeled, and processed like any utility — and serve as a powerful public good. …(More)”