Selected Readings on Crowdsourcing Opinions and Ideas


The Living Library’s Selected Readings series seeks to build a knowledge base on innovative approaches for improving the effectiveness and legitimacy of governance. This curated and annotated collection of recommended works on the topic of crowdsourcing was originally published in 2013.

As technological advances give individuals greater ability to share their opinions and ideas with the world, citizens are increasingly expecting government to consult with them and factor their input into the policy-making process. Moving away from the representative democracy system created in a less connected time, e-petitions; participatory budgeting (PB), a collaborative, community-based system for budget allocation; open innovation initiatives; and Liquid Democracy, a hybrid of direct and indirect democracy, are allowing citizens to make their voices heard between trips to the ballot box.

Selected Reading List (in alphabetical order)

Annotated Selected Reading List (in alphabetical order)

Bergmann, Eirikur. “Reconstituting Iceland – Constitutional Reform Caught in a New Critical Order in the Wake of Crisis.” in Academia.edu, (presented at the Political Legitimacy and the Paradox of Regulation, Leiden University, 2013). http://bit.ly/1aaTVYP.
  •  This paper explores the tumultuous history of Iceland’s “Crowdsourced Constitution.” The since-abandoned document was built upon three principles: distribution of power, transparency and responsibility.
  •  Even prior to the draft being dismantled through political processes, Bergmann argues that an overenthusiastic public viewed the constitution as a stronger example of citizen participation than it really was: “Perhaps with the delusion of distance the international media was branding the production as the world’s first ‘crowdsourced’ constitution, drafted by the interested public in clear view for the world to follow…This was however never a realistic description of the drafting. Despite this extraordinary open access, the Council was not able to systematically plough through all the extensive input as [it] only had four months to complete the task.”
  • Bergmann’s paper illustrates the transition Iceland’s constitution has undertaken in recent years: moving form a paradigmatic example of crowdsourcing opinions to a demonstration of the challenges inherent in bringing more voices into a realm dominated by bureaucracy and political concerns.
Gassmann, Oliver, Ellen Enkel, and Henry Chesbrough. “The Future of Open Innovation.” R&D Management 40, no. 3 (2010): 213– 221. http://bit.ly/1bk4YeN.
  • In this paper – an introduction to a special issue on the topic – Gassmann, Enkel and Chesbrough discuss the evolving trends in open innovation. They define the concept, referencing previous work by Chesbrough et al., as “…the purposive inflows and outflows of knowledge to accelerate internal innovation, and expand the markets for external use of innovation, respectively.”
  • In addition to examining the existing literature for the field, the authors identify nine trends that they believe will define the future of open innovation for businesses, many of which can also be applied to governing insitutions:
    • Industry penetration: from pioneers to mainstream
    • R&D intensity: from high to low tech
    • Size: from large firms to SMEs
    • Processes: from stage gate to probe-and-learn
    • Structure: from standalone to alliances
    • Universities: from ivory towers to knowledge brokers  Processes: from amateurs to professionals
    • Content: from products to services
    • Intellectual property: from protection to a tradable good
Gilman, Hollie Russon. “The Participatory Turn: Participatory Budgeting Comes to America.” Harvard University, 2012. https://bit.ly/2BhaeVv.
  •  In this dissertation, Gilman argues that participatory budgeting (PB) produces better outcomes than the status quo budget process in New York, while also transforming how those who participate understand themselves as citizens, constituents, Council members, civil society leaders and community stakeholders.
  • The dissertation also highlights challenges to participation drawing from experience and lessons learned from PB’s inception in Porto Alege, Brazil in 1989. While recognizing a diversity of challenges, Gilman ultimately argues that, “PB provides a viable and informative democratic innovation for strengthening civic engagement within the United States that can be streamlined and adopted to scale.”
Kasdan, Alexa, and Cattell, Lindsay. “New Report on NYC Participatory Budgeting.” Practical Visionaries. Accessed October 21, 2013. https://bit.ly/2Ek8bTu.
  • This research and evaluation report is the result of surveys, in-depth interviews and observations collected at key points during the 2011 participatory budgeting (PB) process in New York City, in which “[o]ver 2,000 community members were the ones to propose capital project ideas in neighborhood assemblies and town hall meetings.”
  • The PBNYC project progressed through six main steps:
    •  First Round of Neighborhood Assemblies
    • Delegate Orientations
    • Delegate Meetings
    • Second Round of Neighborhood Assemblies
    • Voting
    • Evaluation, Implementation & Monitoring
  •  The authors also discuss the varied roles and responsibilities for the divers stakeholders involved in the process:
    • Community Stakeholders
    • Budget Delegates
    • District Committees
    • City-wide Steering Committee  Council Member Offices
Masser, Kai. “Participatory Budgeting as Its Critics See It.” Burgerhaushalt, April 30, 2013. http://bit.ly/1dppSxW.
  • This report is a critique of the participatory budgeting (PB) process, focusing on lessons learned from the outcomes of a pilot initiative in Germany.
  • The reports focuses on three main criticisms leveled against PB:
    • Participatory Budgeting can be a time consuming process that is barely comprehensive to the people it seeks to engage, as a result there is need for information about the budget, and a strong willingness to participate in preparing it.
    • Differences in the social structure of the participants inevitably affect the outcome – the process must be designed to avoid low participation or over-representation of one group.
    • PB cannot be sustained over a prolonged period and should therefore focus on one aspect of the budgeting process. The article points to outcomes that show that citizens may find it considerably more attractive to make proposals on how to spend money than on how to save it, which may not always result in the best outcomes.
OECD. “Citizens as Partners: Information, Consultation and Public Participation in Policy-making.” The IT Law Wiki. http://bit.ly/1aIGquc.
  • This OECD policy report features discussion on the concept of crowdsourcing as a new form or representation and public participation in OECD countries, with the understanding that it creates avenues for citizens to participate in public policy-making within the overall framework of representative democracy.
  • The report provides a wealth of comparative information on measures adopted in OECD countries to strengthen citizens’ access to information, to enhance consultation and encourage their active participation in policy-making.

Tchorbadjiiski, Angel. “Liquid Democracy.” Rheinisch-Westf alische Technische Hochschule Aachen Informatik 4 ComSy, 2012. http://bit.ly/1eOsbIH.

  • This thesis presents discusses how Liquid Democracy (LD) makes it for citizens participating in an election to “either take part directly or delegate [their] own voting rights to a representative/expert. This way the voters are not limited to taking one decision for legislative period as opposed to indirect (representative) democracy, but are able to actively and continuously take part in the decision-making process.”
  • Tchorbadjiiski argues that, “LD provides great flexibility. You do not have to decide yourself on the program of a political party, which only suits some aspects of your opinion.” Through LD, “all voters can choose between direct and indirect democracy creating a hybrid government form suiting their own views.”
  • In addition to describing the potential benefits of Liquid Democracy, Tchorbadjiiski focuses on the challenge of maintaining privacy and security in such a system. He proposes a platform that “allows for secure and anonymous voting in such a way that it is not possible, even for the system operator, to find out the identity of a voter or to prevent certain voters (for example minority groups) from casting a ballot.”

From open data to open democracy


Article by : “Such debates further underscore the complexities of open data and where it might lead. While open data may be viewed by some inside and outside government as a technically-focused and largely incremental project based upon information formatting and accessibility (with the degree of openness subject to a myriad of security and confidentiality provisions), such an approach greatly limits its potential. Indeed, the growing ubiquity of mobile and smart devices, the advent of open source operating systems and social media platforms, and the growing commitment by governments themselves to expansive public engagement objectives, all suggest a widening scope.
Yet, what will incentivize the typical citizen to access open data and to partake in collective efforts to create public value? It is here where our digital culture may well fall short, emphasizing individualized service and convenience at the expense of civic responsibility and community-mindedness. For one American academic, this “citizenship deficit” erodes democratic legitimacy and renders our politics more polarized and less discursive. For other observers in Europe, notions of the digital divide are giving rise to new “data divides.”
The politics and practicalities of data privacy often bring further confusion. While privacy advocates call for greater protection and a culture of data activism among Internet users themselves, the networked ethos of online communities and commercialization fuels speed and sharing, often with little understanding of the ramifications of doing so. Differences between consumerism and citizenship are subtle yet profoundly important, while increasingly blurred and overlooked.
A key conundrum provincially and federally, within the Westminster confines of parliamentary democracy, is that open data is being hatched mainly from within the executive branch, whereas the legislative branch watches and withers. In devising genuine democratic openness, politicians and their parties must do more than post expenses online: they must become partners and advocates for renewal. A lesson of open source technology, however, is that systemic change demands an informed and engaged civil society, disgruntled with the status quo but also determined to act anew.
Most often, such actions are highly localized, even in a virtual world, giving rise to the purpose and meaning of smarter and more intelligent communities. And in Canada it bears noting that we see communities both large and small embracing open data and other forms of online experimentation such as participatory budgeting. It is often within small but connected communities where a virtuous cycle of online and in-person identities and actions can deepen and impact decision-making most directly.
How, then, do we reconcile traditional notions of top-down political federalism and national leadership with this bottom-up approach to community engagement and democratic renewal? Shifting from open data to open democracy is likely to be an uneven, diverse, and at times messy affair. Better this way than attempting to ordain top-down change in a centralized and standardized manner.”

Participatory Budgeting Around the World


Jay Colburn, from the International Budget Partnership:  “Public participation in budget decision making can occur in many different forms. Participatory budgeting (PB) is an increasingly popular process in which the public is involved directly in making budgetary decisions, most often at the local level. The involvement of community members usually includes identifying and prioritizing the community’s needs and then voting on spending for specific projects.
PB was first developed in Porto Alegre, Brazil, in 1989 as an innovative reform to address the city’s severe inequality. Since then it has spread around the world. Though the specifics of how the PB process works varies depending on the context in which it is implemented, most PB processes have four basic similarities: 1) community members identify spending ideas; 2) delegates are selected to develop spending proposals based on those ideas; 3) residents vote on which proposals to fund; and 4) the government implements the chosen proposals.
During the 1990s PB spread throughout Brazil and across Latin America. Examples of participatory budgeting can now be found in every region of the world, including Central Asia, Europe, and the Middle East. As the use of PB has expanded, it has been adapted in many ways. One example is to incorporate new information and communication technologies as a way to broaden opportunities for participation (see Using Technology to Improve Transparency and Citizen Engagement in this newsletter for more on this topic.)…
There are also a number of different models of PB that have been developed, each with slightly different rules and processes. Using the different models and methods has expanded our knowledge on the potential impacts of PB. In addition to having demonstrable and measurable results on mobilizing public funds for services for the poor, participatory budgeting has also been linked to greater tax compliance, increased demands for transparency, and greater access to budget information and oversight.
However, not all instances of PB are equally successful; there are many variables to consider when weighing the impact of different cases. These can include the level and mechanisms of participation, information accessibility, knowledge of opportunities to participate, political context, and prevailing socioeconomic factors. There is a large and growing literature on the benefits and challenges of PB. The IBP Open Budgets Blog recently featured posts on participatory budgeting initiatives in Peru, Kyrgyzstan, and Kenya. While there are still many lessons to be learned about how PB can be used in different contexts, it is certainly a positive step toward increased citizen engagement in the budget process and influence over how public funds are spent.
For more information and resources on PB, visit the participatory budgeting Facebook group”

San Francisco To Test Online Participatory Budgeting


Crunch.gov: “Taxpayers are sometimes the best people to decide how their money gets spent — sounds obvious, but usually we don’t have a direct say beyond who we elect. That’s changing for San Francisco residents.
It intends to be the first major US city to allow citizens to directly vote on portions of budget via the web. While details are still coming together, its plan is for each city district to vote on $100,000 in expenditures. Citizens will get to choose how the money is spent from a list of options, similar to the way they already vote from a list of ballot propositions. Topical experts will help San Francisco residents deliberate online.
So-called “participatory budgeting” first began in the festival city of Porto Alegre, Brazil, in 1989, and has slowly been expanding throughout the world. While major cities, such as Chicago and New York, have piloted participatory budgeting, they have not incorporated the modern features of digital voting and deliberation that are currently utilized in Brazil.
According to participatory budgeting expert and former White House technology fellow, Hollie Russon Gilman, San Francisco’s experiment will mark a “frontier” in American direct democracy.
This is significant because the Internet engenders a different type of democracy: not one of mere expression, but one of ideas. The net is good at surfacing the best ideas hidden within the wisdom of the crowds. Modern political scientists refer to this as “Epistemic Democracy,” derived from the Greek word for knowledge, epistēmē. Epistemic Democracy values citizens most for their expertise and builds tools to make policy making more informed.
For example, participatory budgeting has been found to reduce infant mortality rates in Brazil. It turns out that the mothers in Brazil had a better knowledge of why children were dying than health experts. Through participatory budgeting, they “channeled a larger fraction of their total budget to key investments in sanitation and health services,” writes Sonia Goncalves of King’s College London. “I also found that this change in the composition of municipal expenditures is associated with a pronounced reduction in the infant mortality rates for municipalities which adopted participatory budgeting.” [PDF]”

The Participatory Turn: Participatory Budgeting Comes to America


Thesis by Hollie Russon Gilman: “Participatory Budgeting (PB) has expanded to over 1,500 municipalities worldwide since its inception in Porto Alege, Brazil in 1989 by the leftist Partido dos Trabalhadores (Workers’ Party). While PB has been adopted throughout the world, it has yet to take hold in the United States. This dissertation examines the introduction of PB to the United States with the first project in Chicago in 2009, and proceeds with an in-depth case study of the largest implementation of PB in the United States: Participatory Budgeting in New York City. I assess the outputs of PB in the United States including deliberations, governance, and participation. I argue that PB produces better outcomes than the status quo budget process in New York City, while also transforming how those who participate understand themselves as citizens, constituents, Council members, civil society leaders and community stakeholders. However, there are serious challenges to participation, including high costs of engagement, process exhaustion, and perils of scalability. I devise a framework for assessment called “citizenly politics,” focusing on: 1) designing participation 2) deliberation 3) participation and 4) potential for institutionalization. I argue that while the material results PB produces are relatively modest, including more innovative projects, PB delivers more substantial non-material or existential results. Existential citizenly rewards include: greater civic knowledge, strengthened relationships with elected officials, and greater community inclusion. Overall, PB provides a viable and informative democratic innovation for strengthening civic engagement within the United States that can be streamlined and adopted to scale.”

Improved Governance? Exploring the Results of Peru's Participatory Budgeting Process


Paper by Stephanie McNulty for the 2013 Annual Meeting of the American Political Science Association (Aug. 29-Sept. 1, 2013): “Can a nationally mandated participatory budget process change the nature of local governance? Passed in 2003 to mandate participatory budgeting in all districts and regions of Peru, Peru’s National PB Law has garnered international attention from proponents of participatory governance. However, to date, the results of the process have not been widely documented. Presenting data that have been gathered through fieldwork, online databases, and primary documents, this paper explores the results of Peru’s PB after ten years of implementation. The paper finds that results are limited. While there are a significant number of actors engaged in the process, the PB is still dominated by elite actors that do not represent the diversity of the civil society sector in Peru. Participants approve important “pro-poor” projects, but they are not always executed. Finally, two important indicators of governance, sub-national conflict and trust in local institutions, have not improved over time. Until Peruvian politicians make a concerted effort to move beyond politics as usual, results will continue to be limited” 

An Ethnographic Approach to Impact Evaluation: Stop Measuring Outputs, Start Understanding Experiences


Panthea Lee, a principal at Reboot, in TechPresident: “Is open government working? I asked the question in a previous post …Too often, assessing the impact of open government initiatives amounts to measuring outputs: how many developers flocked to a civic tech hackathon; the amount of procurement records feeding corruption hawks and socially-minded graphic designers; or the number of tweets or media mentions about a particular initiative, regardless of whether they are from the same industry blogs and actors covering open government.
Quantitative metrics have their place. They may be useful for gauging the popularity of an initiative. They are almost always used to justify funding for an initiative. But, ultimately, these studies say very little about open government’s actual impact on people….We need to move beyond measuring outputs and toward understanding experiences….
Applied ethnography holds great potential for understanding how individuals experience open government initiatives. Ethnography––“a portrait of people”––is the study of people within their social and cultural contexts. It embraces context, examining how results can be explained by human factors and situational interactions. Ethnography allows us to understand the meaning of participation for different individuals––who is affected or not, and why. (Ethnographic research is often mistakenly equated with “interview studies” or other types of qualitative research. An immersive research approach, it uses techniques such as participant observation, unstructured interviews, and artifact collection to attempt a holistic analysis of human behaviours, interactions, and perceptions over time.)
Take, for example, this ethnographic study of a participatory budgeting initiative in Rome. The study found that through engagement with the participatory budgeting process, some participants “discovered a passion for politics,” leading them to join neighborhood associations and local political parties. Other participants, however, left the budgeting process feeling more cynical about and disengaged from participatory democracy.”