The value and challenges of public sector information


A paper by M. Henninger in Cosmopolitan Civil Societies: An Interdisciplinary Journal: “The aim of this paper is to explore the concept of public sector information (PSI), what it is, its history and evolution, what constitutes its corpus of documents and the issues and challenges it presents to society, its institutions and to those who use and manage it. The paper, by examining the literatures of the law, political science, civil society, economics and information and library science explores the inherent tensions of access to and use of PSI—pragmatism vs. idealism; openness vs. secrecy; commerce vs. altruism; property vs. commons; public good vs. private good. It focusses on open government data (OGD)—a subset of what is popularly referred to as ‘big data’—its background and development since much of the current debate of its use concerns its commercial value for both the private sector and the public sector itself. In particular it looks at the information itself which, driven by technologies of networks, data mining and visualisation gives value in industrial and economic terms, and in its ability to enable new ideas and knowledge.”

The Flow of Technology Talent into Government and Civil Society


Report for the Ford Foundation and the MacArthur Foundation: “As information technology further suffuses every aspect of our lives, government will inevitably have a role to play in ensuring that technology serves the public interest. The ability for government to improve operations and provide services to citizens more efficiently through the effective use of technology is among the greatest contemporary opportunities for the public sector…
Among the key findings of this report:

  • The Current Pipeline Is Insufficient: the vast majority of interviewees indicated that there is a severe paucity of individuals with technical skills in computer science, data science, and the Internet or other information technology expertise in civil society and government. In particular, many of those interviewed noted that existing talent levels fail to meet current needs to develop, leverage, or understand technology.
  • Barriers to Recruitment and Retention Are Acute: many of those interviewed said that substantial barriers thwart the effective recruitment and retention of individuals with the requisite skills in government and civil society. Among the most common barriers mentioned were those of compensation, an inability to pursue groundbreaking work, and a culture that is averse to hiring and utilizing potentially disruptive innovators
  • A Major Gap between the Public-Interest and For-Profit Sectors Persists: as a related matter, interviewees discussed superior for-profit recruitment and retention models. Specifically, the for-profit sector was perceived as providing both more attractive compensation (especially to young talent) and fostering a culture of innovation, openness, and creativity that was seen as more appealing to technologists and innovators.
  • A Need to Examine Models from Other Fields: interviewees noted significant space to develop new models to improve the robustness of the talent pipeline; in part, many existing models were regarded as unsustainable or incomplete. Interviewees did, however, highlight approaches from other fields that could provide relevant lessons to help guide investments in improving this pipeline.
  • Significant Opportunity for Connection and Training: despite consonance among those interviewed that the pipeline was incomplete, many individuals indicated the possibility for improved and more systematic efforts to expose young technologists to public interest issues and connect them to government and civil society careers through internships, fellowships, and other training and recruitment tools.
  • Culture Change Necessary: the culture of government and civil society –and its effects on recruitment and other bureaucratic processes –was seen as a vital challenge that would need to be addressed to improve the pipeline. This view manifested through comments that government and civil society organizations needed to become more open to utilizing technology and adopting a mindset of experimentation….”

Big Data needs Big Theory


Geoffrey West, former President of the Santa Fe Institute: “As the world becomes increasingly complex and interconnected, some of our biggest challenges have begun to seem intractable. What should we do about uncertainty in the financial markets? How can we predict energy supply and demand? How will climate change play out? How do we cope with rapid urbanization? Our traditional approaches to these problems are often qualitative and disjointed and lead to unintended consequences. To bring scientific rigor to the challenges of our time, we need to develop a deeper understanding of complexity itself….
The digital revolution is driving much of the increasing complexity and pace of life we are now seeing, but this technology also presents an opportunity. The ubiquity of cell phones and electronic transactions, the increasing use of personal medical probes, and the concept of the electronically wired “smart city” are already providing us with enormous amounts of data. With new computational tools and techniques to digest vast, interrelated databases, researchers and practitioners in science, technology, business and government have begun to bring large-scale simulations and models to bear on questions formerly out of reach of quantitative analysis, such as how cooperation emerges in society, what conditions promote innovation, and how conflicts spread and grow.
The trouble is, we don’t have a unified, conceptual framework for addressing questions of complexity. We don’t know what kind of data we need, nor how much, or what critical questions we should be asking. “Big data” without a “big theory” to go with it loses much of its potency and usefulness, potentially generating new unintended consequences.
When the industrial age focused society’s attention on energy in its many manifestations—steam, chemical, mechanical, and so on—the universal laws of thermodynamics came as a response. We now need to ask if our age can produce universal laws of complexity that integrate energy with information. What are the underlying principles that transcend the extraordinary diversity and historical contingency and interconnectivity of financial markets, populations, ecosystems, war and conflict, pandemics and cancer? An overarching predictive, mathematical framework for complex systems would, in principle, incorporate the dynamics and organization of any complex system in a quantitative, computable framework.
We will probably never make detailed predictions of complex systems, but coarse-grained descriptions that lead to quantitative predictions for essential features are within our grasp. We won’t predict when the next financial crash will occur, but we ought to be able to assign a probability of one occurring in the next few years. The field is in the midst of a broad synthesis of scientific disciplines, helping reverse the trend toward fragmentation and specialization, and is groping toward a more unified, holistic framework for tackling society’s big questions. The future of the human enterprise may well depend on it.”

Neighborhood Buzz: What people are tweeting in your city.


“Neighborhood Buzz is an experimental system that lets you find out what people in your neighborhood, and neighborhoods in cities around the country, are talking about on Twitter. When you select a neighborhood from a city map, Neighborhood Buzz displays the main topics that people in that neighborhood are discussing — politics, sports, food, etc. — and then lets you drill down to look at the individual tweets in those categories.
The system also lets you see, at a glance, how much people in different neighborhoods in a city are talking about a given topic through a “heat map” overlay on the city’s geographical map.
Neighborhood Buzz uses geo-located tweets as input. Only a small fraction of tweets currently have location tags, but the number is sufficient to provide tens or hundreds of tweets per neighborhood per day.
The topical categorizer that the system uses is statistical — which means that even though we show only the tweets we are most confident the system is categorizing correctly, it still sometimes makes mistakes. You can let us know when the system has incorrectly categorized a tweet, and eventually that will help us to improve the system.
Neighborhood Buzz was originally developed at Northwestern University Knight Lab in our joint projects class in technology and journalism, involving students and faculty from the Medill School of Journalism and the McCormick School of Engineering, Dept. of Electrical Engineering and Computer Science, at Northwestern. It was then re-architected and further developed at the Knight Lab.”

6 Projects That Make Data More Accessible Win $100,000 Each From Gates


Chronicle of Philanthropy: “Six nonprofit projects that aim to combine multiple sets of data to help solve social problems have each won $100,000 grants from the Bill & Melinda Gates Foundation…The winners:
• Pushpa Aman Singh, who founded GuideStar India as an effort of the Civil Society Information Services India. GuideStar India is the most comprehensive database of India’s registered charities. It has profiles of more than 4,000 organizations, and Ms. Singh plans to expand that number and the types of information included.
• Development Initiatives, an international aid organization, to support its partnership with the Ugandan nonprofit Development Research and Training. Together, they are trying to help residents of two districts in Uganda identify a key problem the communities face and use existing data sets to build both online and offline tools to help tackle that challenge…
• H.V. Jagadish, at the University of Michigan, to develop a prototype that will merge sets of incompatible geographic data to make them comparable. Mr. Jagadish, a professor of electrical engineering and computer science, points to crime precincts and school districts as an example. “We want to understand the impact of education on crime, but the districts don’t quite overlap with the precincts,” he says. “This tool will address the lack of overlap.”
• Vijay Modi, at Columbia University, to work with government agencies and charities in Nigeria on a tool similar to Foursquare, the social network that allows people to share their location with friends. Mr. Modi, a mechanical-engineering professor and faculty member of the university’s Earth Institute, envisions a tool that will help people find important resources more easily…
• Gisli Olafsson and his team at NetHope, a network of aid organizations. The group is building a tool to help humanitarian charities share their data more widely and in real time—potentially saving more lives during disasters…
• Development Gateway, a nonprofit that assists international development charities with technology, and GroundTruth Initiative, a nonprofit that helps residents of communities learn mapping and media skills. The two groups want to give people living in the slums of Nairobi, Kenya, more detailed information about local schools…”

New Visions in Citizen Science


New Report by Anne Bowser and Lea Shanley for the Commons Lab within Science and Technology Innovation Program, Woodrow Wilson Center, with the support of the Alfred P. Sloan Foundation: “Citizen science is one form of open innovation, a paradigm where organizations solicit the efforts of external contributors with unique perspectives who generate new knowledge and technology, or otherwise bolster organizational resources.  Recent executive branch policies encourage and support open innovation in the federal government. The President’s 2009 Memorandum on Transparency and Open Government  charged agencies with taking specific action to support transparency, public participation, and collaboration. Similarly, the Obama Administration’s 2013 Memorandum on Open Data Policy—Managing Information as an Asset   instructs agencies to support these principles by sharing government data sets. The Preview Report for the Second Open Government National Action Plan, released October 31, 2013, specifically states that the United States will commit to “harness the ingenuity of the public by enabling, accelerating, and scaling the use of open innovation methods such as incentive prizes, crowdsourcing, and citizen science within the Federal Government.”
This report showcases seventeen case studies that offer a mosaic view of federally-sponsored citizen science and open innovation projects, from in-the-field data collection to online games for collective problem-solving. Its goal is not to provide line-by-line instructions for agencies attempting to create or expand projects of their own; each agency has a unique mission with distinct challenges that inform project designs.  Rather, it offers a sampling of different models that support public contribution, potential challenges, and positive impacts that projects can have on scientific literacy, research, management, and public policy.
Some case studies represent traditional but well-executed projects that illustrate how citizen science functions at its best, by contributing to robust scientific research.  Other projects, such as the National Aeronautics and Space Administration (NASA)’s International Space Apps Challenge, evolve from these traditional models, demonstrating how open innovation can address agency-specific challenges in new and compelling ways. Through this progression, the evolution of citizen science begins to take shape, and the full possibilities of open innovation begin to emerge.”

Inside Avaaz – can online activism really change the world?


The Guardian: “With 30 million members, Avaaz is an organisation with ambitions to save us all through technology. Carole Cadwalladr meets its founder Ricken Patel to find out what it has achieved…But then, this is the reality of 21st century protest: it’s a beauty parade. A competition for the thing that we all seem to have less of: attention. The TV cameras do show up, though, and a young Rohingya woman from Burma’s Muslim minority gives moving interviews to journalists about the terrible human rights abuses her family have endured. And a dozen or so mostly fresh-faced young people show up to offer their support. The protest has been organised by Avaaz, an online activist organisation, and these are Avaazers. They may have just signed an online petition, or “liked” a cause on Facebook, or donated to a campaign – to save Europe’s bees from pesticides, or to defend Masai land rights in Tanzania, or to “stand by” Edward Snowden. And, depending on who you believe, they’re either inventing a new type of 21st-century protest or they’re a bunch of idle slacktivists who are about as likely to start a revolution as they are to renounce their iPhones and give up Facebook.
In just six years, Avaaz – which means “voice” in various languages – has become a global pressure group to be reckoned with. It’s a new kind of activism that isn’t issue-led, it’s issues-led. It’s human rights abuses in Burma, or it’s the Syrian civil war, or it’s threats against the Great Barrier Reef or it’s homophobia in Costa Rica. It’s whatever its supporters, guided by the Avaaz team, choose to click on most this month. And if you hadn’t heard of Avaaz before, it’s probably only a matter of time….
“We’re like a laboratory for virality. For every campaign we test perhaps 20 different versions of it to see what people want.” It tweaks and it tweaks and it tweaks, changing the wording, pictures, call for action, and only then does it send it out on public release. Sam Barratt, Avaaz’s head of press, shows me the previous versions of its email about the Burma campaign. “Changing the meme at the top, or the photograph, massively affects the number of clicks. Eighteen versions were tested. People think we just chuck it out there, but there’s a huge amount of data sophistry into how we design the campaigns.” And, just as Amazon and Google try to predict our behaviour, and adjust their offerings based on our past preferences, so does Avaaz. It uses algorithms to detect things we perhaps don’t even know about ourselves.
“It’s a tremendously evolving science, internet engagement,” says Patel. “But we develop a picture of someone from their previous engagements with us. So, for example, we can see that a certain set of people, based on their previous behaviour, might be interested in starting a campaign, and another set won’t be, but may be interested in signing something. We can tailor it to the individual.”
Everything is viral now, says Patel, “from financial crises to health epidemics to ideas”. And learning the lessons of that and of how to garner attention from some of the most attention-deficient people on the planet – young people with electronic devices – has been Avaaz’s masterstroke….
A crisistunity is another Avaaz-ism. “Though I think we originally got it from The Simpsons,” says Patel. “It’s a mixture of crisis and opportunity. We’re at this extraordinary moment in history. We have the power to wipe out our species. But at the same time, we’ve had tremendous progress in the past 30 years. We have more than halved global poverty. We’ve radically increased the status of women. There are tremendous reasons for hope and optimism.”
There is something very Avaazian about the crisistunity, I come to think, in that it’s borrowed something slick and witty from popular culture and re-purposed it for something which used to be called the Greater Good. And then given it a thick dollop of added earnestness.”

Social innovation, an answer to contemporary societal challenges? Locating the concept in theory and practice


Paper by R. Grimm, C. Fox, S. Baines, and K. Albertson in Innovation: The European Journal of Social Science Research: “Social innovation discourses see in social challenges opportunities to make societies more sustainable and cohesive through inclusive practices, coproduction and pro-active grassroots initiatives. In this paper we are concerned first that the concept has been stretched in so many directions that it is at breaking point. We illustrate this by documenting the varied uses of social innovation in different academic and policy discourses. Second, we assume that, if social innovation is to be a useful concept for policy-makers, then it must tell us something about what adjustments are needed to develop an effective political economy that is social innovation ready. Finally, we argue that what is needed is more theoretical and empirical work to help social innovation to develop into an effective policy tool”

NEW: The Open Governance Knowledge Base


In its continued efforts to organize and disseminate learnings in the field of technology-enabled governance innovation, today, The Governance Lab is introducing a collaborative, wiki-style repository of information and research at the nexus of technology, governance and citizenship. Right now we’re calling it the Open Governance Knowledge Base, and it goes live today.
Our goal in creating this collaborative platform is to provide a single source of research and insights related to the broad, interdiscplinary field of open governance for the benefit of: 1) decision-makers in governing institutions seeking information and inspiration to guide their efforts to increase openness; 2) academics seeking to enrich and expand their scholarly pursuits in this field; 3) technology practitioners seeking insights and examples of familiar tools being used to solve public problems; and 4) average citizens simply seeking interesting information on a complex, evolving topic area.
While you can already find some pre-populated information and research on the platform, we need your help! The field of open governance is too vast, complex and interdisciplinary to meaningfully document without broad collaboration.
Here’s how you can help to ensure this shared resource is as useful and engaging as possible:

  • What should we call the platform? We want your title suggestions. Leave your ideas in the comments or tweet them to us @TheGovLab.
  • And more importantly: Share your knowledge and research. Take a look at what we’ve posted, create an account, refer to this MediaWiki formatting guide as needed and start editing!