Selected Readings on Crowdsourcing Opinions and Ideas

Curated on Posted on by Andrew Young

The Living Library’s Selected Readings series seeks to build a knowledge base on innovative approaches for improving the effectiveness and legitimacy of governance. This curated and annotated collection of recommended works on the topic of crowdsourcing was originally published in 2013.

As technological advances give individuals greater ability to share their opinions and ideas with the world, citizens are increasingly expecting government to consult with them and factor their input into the policy-making process. Moving away from the representative democracy system created in a less connected time, e-petitions; participatory budgeting (PB), a collaborative, community-based system for budget allocation; open innovation initiatives; and Liquid Democracy, a hybrid of direct and indirect democracy, are allowing citizens to make their voices heard between trips to the ballot box.

Selected Reading List (in alphabetical order)

Annotated Selected Reading List (in alphabetical order)

Bergmann, Eirikur. “Reconstituting Iceland – Constitutional Reform Caught in a New Critical Order in the Wake of Crisis.” in Academia.edu, (presented at the Political Legitimacy and the Paradox of Regulation, Leiden University, 2013). http://bit.ly/1aaTVYP.
  •  This paper explores the tumultuous history of Iceland’s “Crowdsourced Constitution.” The since-abandoned document was built upon three principles: distribution of power, transparency and responsibility.
  •  Even prior to the draft being dismantled through political processes, Bergmann argues that an overenthusiastic public viewed the constitution as a stronger example of citizen participation than it really was: “Perhaps with the delusion of distance the international media was branding the production as the world’s first ‘crowdsourced’ constitution, drafted by the interested public in clear view for the world to follow…This was however never a realistic description of the drafting. Despite this extraordinary open access, the Council was not able to systematically plough through all the extensive input as [it] only had four months to complete the task.”
  • Bergmann’s paper illustrates the transition Iceland’s constitution has undertaken in recent years: moving form a paradigmatic example of crowdsourcing opinions to a demonstration of the challenges inherent in bringing more voices into a realm dominated by bureaucracy and political concerns.
Gassmann, Oliver, Ellen Enkel, and Henry Chesbrough. “The Future of Open Innovation.” R&D Management 40, no. 3 (2010): 213– 221. http://bit.ly/1bk4YeN.
  • In this paper – an introduction to a special issue on the topic – Gassmann, Enkel and Chesbrough discuss the evolving trends in open innovation. They define the concept, referencing previous work by Chesbrough et al., as “…the purposive inflows and outflows of knowledge to accelerate internal innovation, and expand the markets for external use of innovation, respectively.”
  • In addition to examining the existing literature for the field, the authors identify nine trends that they believe will define the future of open innovation for businesses, many of which can also be applied to governing insitutions:
    • Industry penetration: from pioneers to mainstream
    • R&D intensity: from high to low tech
    • Size: from large firms to SMEs
    • Processes: from stage gate to probe-and-learn
    • Structure: from standalone to alliances
    • Universities: from ivory towers to knowledge brokers  Processes: from amateurs to professionals
    • Content: from products to services
    • Intellectual property: from protection to a tradable good
Gilman, Hollie Russon. “The Participatory Turn: Participatory Budgeting Comes to America.” Harvard University, 2012. https://bit.ly/2BhaeVv.
  •  In this dissertation, Gilman argues that participatory budgeting (PB) produces better outcomes than the status quo budget process in New York, while also transforming how those who participate understand themselves as citizens, constituents, Council members, civil society leaders and community stakeholders.
  • The dissertation also highlights challenges to participation drawing from experience and lessons learned from PB’s inception in Porto Alege, Brazil in 1989. While recognizing a diversity of challenges, Gilman ultimately argues that, “PB provides a viable and informative democratic innovation for strengthening civic engagement within the United States that can be streamlined and adopted to scale.”
Kasdan, Alexa, and Cattell, Lindsay. “New Report on NYC Participatory Budgeting.” Practical Visionaries. Accessed October 21, 2013. https://bit.ly/2Ek8bTu.
  • This research and evaluation report is the result of surveys, in-depth interviews and observations collected at key points during the 2011 participatory budgeting (PB) process in New York City, in which “[o]ver 2,000 community members were the ones to propose capital project ideas in neighborhood assemblies and town hall meetings.”
  • The PBNYC project progressed through six main steps:
    •  First Round of Neighborhood Assemblies
    • Delegate Orientations
    • Delegate Meetings
    • Second Round of Neighborhood Assemblies
    • Voting
    • Evaluation, Implementation & Monitoring
  •  The authors also discuss the varied roles and responsibilities for the divers stakeholders involved in the process:
    • Community Stakeholders
    • Budget Delegates
    • District Committees
    • City-wide Steering Committee  Council Member Offices
Masser, Kai. “Participatory Budgeting as Its Critics See It.” Burgerhaushalt, April 30, 2013. http://bit.ly/1dppSxW.
  • This report is a critique of the participatory budgeting (PB) process, focusing on lessons learned from the outcomes of a pilot initiative in Germany.
  • The reports focuses on three main criticisms leveled against PB:
    • Participatory Budgeting can be a time consuming process that is barely comprehensive to the people it seeks to engage, as a result there is need for information about the budget, and a strong willingness to participate in preparing it.
    • Differences in the social structure of the participants inevitably affect the outcome – the process must be designed to avoid low participation or over-representation of one group.
    • PB cannot be sustained over a prolonged period and should therefore focus on one aspect of the budgeting process. The article points to outcomes that show that citizens may find it considerably more attractive to make proposals on how to spend money than on how to save it, which may not always result in the best outcomes.
OECD. “Citizens as Partners: Information, Consultation and Public Participation in Policy-making.” The IT Law Wiki. http://bit.ly/1aIGquc.
  • This OECD policy report features discussion on the concept of crowdsourcing as a new form or representation and public participation in OECD countries, with the understanding that it creates avenues for citizens to participate in public policy-making within the overall framework of representative democracy.
  • The report provides a wealth of comparative information on measures adopted in OECD countries to strengthen citizens’ access to information, to enhance consultation and encourage their active participation in policy-making.

Tchorbadjiiski, Angel. “Liquid Democracy.” Rheinisch-Westf alische Technische Hochschule Aachen Informatik 4 ComSy, 2012. http://bit.ly/1eOsbIH.

  • This thesis presents discusses how Liquid Democracy (LD) makes it for citizens participating in an election to “either take part directly or delegate [their] own voting rights to a representative/expert. This way the voters are not limited to taking one decision for legislative period as opposed to indirect (representative) democracy, but are able to actively and continuously take part in the decision-making process.”
  • Tchorbadjiiski argues that, “LD provides great flexibility. You do not have to decide yourself on the program of a political party, which only suits some aspects of your opinion.” Through LD, “all voters can choose between direct and indirect democracy creating a hybrid government form suiting their own views.”
  • In addition to describing the potential benefits of Liquid Democracy, Tchorbadjiiski focuses on the challenge of maintaining privacy and security in such a system. He proposes a platform that “allows for secure and anonymous voting in such a way that it is not possible, even for the system operator, to find out the identity of a voter or to prevent certain voters (for example minority groups) from casting a ballot.”

Mexico City Open Database Improves Transit Efficiency, Helps Commuters

Curated on Posted on by Stefaan Verhulst

The World Bank: “Mexico City residents make 32 million vehicle trips a day, of which over 20 million are via public transport. These use 12 subway lines, four rapid transit lines, eight trolleybus and light rail lines, a suburban rail line, a hundred formal bus routes and over 1,400 “colectivo” minibus routes, along 260 public bike stations. Since the 1970s, five separate agencies have supervised this network, grouped under SETRAVI, Mexico City’s public transit authority. And although each agency has made attempts to collect and store data on passenger counts, route licenses, travel times, and stop locations, these data have never been assembled in one place….

In November 2012, the Bank’s Latin America and Caribbean Transport Unit—with support from the Energy Sector Management Assistance Program (ESMAP)—began providing SETRAVI with technical assistance to develop a new digital platform to collect and manage urban transport data.  This new system is built to the General Transit Feed Specification (GTFS), the de facto standard for cities in recording transit data.
GTFS, created in 2005 by Google and the US city of Portland, Oregon., is an open standard that can be shared and used by anyone. It enables the collection, storage, publication and updating of information on transit routes, times, stops and other important public transport data.
Representatives from each transit agency were enrolled by SETRAVI to crisscross the capital, using TransitWand, an open-source app on their mobile phones, to collect real-time data such as routes, speed, location of bus stops and frequency of train departures.  The data collected were then fed into a data management portal and converted into GTFS.
Despite its simplicity and ease of use, there was one major hurdle to adapting GTFS for Mexico City. The standard was too rigid to incorporate data related to non-scheduled services such as the thousands of colectivo minibuses traversing the city.  As such, another objective of the World Bank scheme was to pilot a “GTFS-Lite” specification that could measure forms of transport that operated with flexible routes and stopping points.
With “GTFS-lite”, Mexico City’s urban planners have access to comparable data on minibuses. This helps them visualize route configurations to determine where best to add or eliminate services, how to plan for integration with more structured transit services, regulate and improve service, and plan for the longer-term future.
Mexico City’s GTFS data have been made public, so that third party software developers can use them to innovate and create applications—such as trip planners and timetable publishers—that can be used on smartphones and other devices.
The GTFS feed for Mexico City will also help the city’s transit agencies develop practical open tools. For example, a real-time tracking tool that informs users of disruptions in the system and provides route change options has already been developed with World Bank assistance…”

Findings from the emerging field of Transparency Research

Curated on Posted on by Stefaan Verhulst

Tiago Peixoto: “HEC Paris has just hosted the 3rd Global Conference on Transparency Research, and they have made the list of accepted papers available. …
As one goes through the papers,  it is clear that unlike most of the open government space, when it comes to research, transparency is treated less as a matter of technology and formats and more as a matter of social and political institutions.  And that is a good thing.”
This year’s papers are listed below:

Open Data Index provides first major assessment of state of open government data

Curated on Posted on by Stefaan Verhulst

Press Release from the Open Knowledge Foundation: “In the week of a major international summit on government transparency in London, the Open Knowledge Foundation has published its 2013 Open Data Index, showing that governments are still not providing enough information in an accessible form to their citizens and businesses.
The UK and US top the 2013 Index, which is a result of community-based surveys in 70 countries. They are followed by Denmark, Norway and the Netherlands. Of the countries assessed, Cyprus, St Kitts & Nevis, the British Virgin Islands, Kenya and Burkina Faso ranked lowest. There are many countries where the governments are less open but that were not assessed because of lack of openness or a sufficiently engaged civil society. This includes 30 countries who are members of the Open Government Partnership.
The Index ranks countries based on the availability and accessibility of information in ten key areas, including government spending, election results, transport timetables, and pollution levels, and reveals that whilst some good progress is being made, much remains to be done.
Rufus Pollock, Founder and CEO of the Open Knowledge Foundation said:

Opening up government data drives democracy, accountability and innovation. It enables citizens to know and exercise their rights, and it brings benefits across society: from transport, to education and health. There has been a welcome increase in support for open data from governments in the last few years, but this Index reveals that too much valuable information is still unavailable.

The UK and US are leaders on open government data but even they have room for improvement: the US for example does not provide a single consolidated and open register of corporations, while the UK Electoral Commission lets down the UK’s good overall performance by not allowing open reuse of UK election data.
There is a very disappointing degree of openness of company registers across the board: only 5 out of the 20 leading countries have even basic information available via a truly open licence, and only 10 allow any form of bulk download. This information is critical for range of reasons – including tackling tax evasion and other forms of financial crime and corruption.
Less than half of the key datasets in the top 20 countries are available to re-use as open data, showing that even the leading countries do not fully understand the importance of citizens and businesses being able to legally and technically use, reuse and redistribute data. This enables them to build and share commercial and non-commercial services.
To see the full results: https://index.okfn.org. For graphs of the data: https://index.okfn.org/visualisations.”

Bright Spots of open government to be recognised at global summit

Curated on Posted on by Stefaan Verhulst

Press Release of the UK Cabinet Office: “The 7 shortlisted initiatives vying for the Bright Spots award show how governments in Open Government Partnership countries are working with citizens to sharpen governance, harness new technologies to increase public participation and improve government responsiveness.
At the Open Government Partnership summit in London on 31 October 2013 and 1 November 2013, participants will be able to vote for one of the shortlisted projects. The winning project – the Bright Spot – will be announced in the summit’s final plenary session….
The shortlisted entries for the Bright Spots prize – which will be awarded at the London summit – are:

  • Chile – ChileAtiende

The aim of ChileAtiende has been to simplify government to citizens by providing a one-stop shop for accessing public services. Today, ChileAtiende has more than 190 offices across the whole country, a national call centre and a digital platform, through which citizens can access multiple services and benefits without having to navigate multiple government offices.

  • Estonia – People’s Assembly

The People’s Assembly is a deliberative democracy tool, designed to encourage input from citizens on the government’s legislative agenda. This web-based platform allows ordinary citizens to propose policy solutions to problems including fighting corruption. Within 3 weeks, 1,800 registered users posted nearly 6,000 ideas and comments. Parliament has since set a timetable for the most popular proposals to be introduced in the formal proceedings.

  • Georgia – improvements to the Freedom of Information Act

Civil society organisations in Georgia have successfully used the government’s participation in OGP to advocate improvements to the country’s Freedom of Information legislation. Government agencies are now obliged to proactively publish information in a way that is accessible to anyone, and to establish an electronic request system for information.

  • Indonesia – complaints portal

LAPOR! (meaning “to report” in Indonesian) is a social media channel where Indonesian citizens can submit complaints and enquiries about development programmes and public services. Comments are transferred directly to relevant ministries or government agencies, which can respond via the website. LAPOR! now has more than 225,350 registered users and receives an average of 1,435 inputs per day.

  • Montenegro – Be Responsible app

“Be Responsible” is a mobile app that allows citizens to report local problems – from illegal waste dumps, misuse of official vehicles and irregular parking, to failure to comply with tax regulations and issues over access to healthcare and education.

  • Philippines – citizen audits

The Citizen Participatory Audit (CPA) project is exploring ways in which citizens can be directly engaged in the audit process for government projects and contribute to ensuring greater efficiency and effectiveness in the use of public resources. 4 pilot audits are in progress, covering public works, welfare, environment and education projects.

  • Romania – transparency in public sector recruitment

The PublicJob.ro website was set up to counter corruption and lack of transparency in civil service recruitment. PublicJob.ro takes recruitment data from public organisations and e-mails it to more than 20,000 subscribers in a weekly newsletter. As a result, it has become more difficult to manipulate the recruitment process.”

Sir Tim Berners-Lee: The many meanings of Open

Curated on Posted on by Stefaan Verhulst

Sir Tim Berners-Lee; ” I was recently asked to talk about the idea of “open”, and I realized the term is used in at least eight different ways. The distinct interpretations are all important in different but interlocking ways. Getting them confused leads to a lot of misunderstanding, so it’s good to review them all.
When we tease apart their meanings, we can understand more clearly which aspects of each are the most important. The first, one of the most important forms of openness for the Web, is its universality.
Universality – When I designed the Web protocols, I had already seen many networked information systems fail because they made some assumptions about the users – that they were using a particular type of computer for instance – or constrained the way they worked, such as forcing them to organize their data in a particular way, or to use a particular data format. The Web had to avoid these issues. The goal was that anyone should be able to publish anything on the Web and so it had to be universal in that it was independent of all these technical constraints, as well as language, character sets, and culture….
Open Standards
The actual design of the Web involved the creation of open standards – and getting people to agree to use them globally. The World Wide Web Consortium (W3C), of which I am the Director, helps create interoperable standards for Web technology, including HTML5, mobile Web, graphics, the Semantic Web of linked data, and Web accessibility. Any company can join and anyone can review and help create the specifications for the Web….
Open Web Platform (OWP)
W3C’s Open Web Platform is the name for a particular set of open standards which enable an exciting stage of Web computing. Standards such as HTML5, SVG, CSS, video, JavaScript, and others are advancing together so that programmes that once worked only on desktop, tablets or phones can now work from  within the browser itself. It has all the power of HTML5, like easily-inserted video and, in the future, easily-inserted conferences. It also features the APIs for accessing hardware and other capabilities on the device, such as a smartphone’s accelerometer, camera, and local storage. While native apps are limited, Web Apps can work on any platform….
Open Government through Open Data
In 2009, I resolved to encourage more use of data on the Web. Too many websites could generate nice reports as documents, but had no way to access the data behind it to check and build on the results.  In February that year I stood up in front of a TED audience and asked them for their data; I even got them to chant: “raw data now”.  In April that year, I met with Gordon Brown, then Prime Minister of the UK and with him began the UK Government’s ground-breaking work on Open Data. That same year President Barack Obama announced his commitment to the US Open Government Initiative. In 2010 I went back to TED and showed the audience some of what had been achieved, including Open Street Map’s role in relief efforts in Haiti….
Open Platform
While it’s not really a feature of the Web, a concern for a lot of people is whether they can choose which apps run on their own phone or computer. An Open Platform means having the right to install and write software on your computer or device. One motivation to close off a computing platform comes from a manufacturer wanting to allow you to experience their content on your machine without being able to store it or pass it on. Some systems are very closed, in that the user can only watch a movie or play a game, with no chance to copy anything or back it up. Some systems are very open, allowing users to take copies of files and run any application they like. Many systems fall in between, letting users pay for additional material or an experience…
Open Source
“Open Source” is another way “open” is used on the web, one which has been and is very important to the Web’s growth. It’s important to me that I can get at the source code of any software I’m using. If I can get at the source code, can I modify it? Can I distribute the modified code and run it on my machine?  As Free Software Foundation lead Richard Stallman puts it, “free as in freedom rather than free as in beer”.
Open Access
Open Access is a Web-based movement specifically about free (as in beer) access to the body of academic learning. Governments, and therefore taxpayers, pay for research via grants but often the results of the research are kept in closed-access academic journals. The results are only available to those at big universities. The poor and those in remote rural areas cannot participate…
Open Internet and Net Neutrality
When we talk about keeping the internet free and open, we are often worried about blocking and spying. One of the ways in which we protect the Web is by ensuring Net Neutrality. Net Neutrality is about non-discrimination. Its principle is that if I pay to connect to the Net with a certain quality of service, and you pay to connect with that or a greater quality of service, then we can both communicate at the same level. This is important because it allows an open, fair market. It’s essential to an open, fair democracy. The alternative is a Web in which governments or large companies, or frequently a close association of the two, try to control the internet, with packets of information delivered in a way that discriminates for commercial or political reasons. Regimes of every sort spy on their citizens, deriving hugely accurate and detailed profiles of them and their intimate lives. Today, the battle is building.  The rights of individual people on the Web are being attacked, and at the moment only a few people really understand and realize what is going on.”

Participatory Budgeting Around the World

Curated on Posted on by Stefaan Verhulst

Jay Colburn, from the International Budget Partnership:  “Public participation in budget decision making can occur in many different forms. Participatory budgeting (PB) is an increasingly popular process in which the public is involved directly in making budgetary decisions, most often at the local level. The involvement of community members usually includes identifying and prioritizing the community’s needs and then voting on spending for specific projects.
PB was first developed in Porto Alegre, Brazil, in 1989 as an innovative reform to address the city’s severe inequality. Since then it has spread around the world. Though the specifics of how the PB process works varies depending on the context in which it is implemented, most PB processes have four basic similarities: 1) community members identify spending ideas; 2) delegates are selected to develop spending proposals based on those ideas; 3) residents vote on which proposals to fund; and 4) the government implements the chosen proposals.
During the 1990s PB spread throughout Brazil and across Latin America. Examples of participatory budgeting can now be found in every region of the world, including Central Asia, Europe, and the Middle East. As the use of PB has expanded, it has been adapted in many ways. One example is to incorporate new information and communication technologies as a way to broaden opportunities for participation (see Using Technology to Improve Transparency and Citizen Engagement in this newsletter for more on this topic.)…
There are also a number of different models of PB that have been developed, each with slightly different rules and processes. Using the different models and methods has expanded our knowledge on the potential impacts of PB. In addition to having demonstrable and measurable results on mobilizing public funds for services for the poor, participatory budgeting has also been linked to greater tax compliance, increased demands for transparency, and greater access to budget information and oversight.
However, not all instances of PB are equally successful; there are many variables to consider when weighing the impact of different cases. These can include the level and mechanisms of participation, information accessibility, knowledge of opportunities to participate, political context, and prevailing socioeconomic factors. There is a large and growing literature on the benefits and challenges of PB. The IBP Open Budgets Blog recently featured posts on participatory budgeting initiatives in Peru, Kyrgyzstan, and Kenya. While there are still many lessons to be learned about how PB can be used in different contexts, it is certainly a positive step toward increased citizen engagement in the budget process and influence over how public funds are spent.
For more information and resources on PB, visit the participatory budgeting Facebook group”

San Francisco To Test Online Participatory Budgeting

Curated on Posted on by Stefaan Verhulst

Crunch.gov: “Taxpayers are sometimes the best people to decide how their money gets spent — sounds obvious, but usually we don’t have a direct say beyond who we elect. That’s changing for San Francisco residents.
It intends to be the first major US city to allow citizens to directly vote on portions of budget via the web. While details are still coming together, its plan is for each city district to vote on $100,000 in expenditures. Citizens will get to choose how the money is spent from a list of options, similar to the way they already vote from a list of ballot propositions. Topical experts will help San Francisco residents deliberate online.
So-called “participatory budgeting” first began in the festival city of Porto Alegre, Brazil, in 1989, and has slowly been expanding throughout the world. While major cities, such as Chicago and New York, have piloted participatory budgeting, they have not incorporated the modern features of digital voting and deliberation that are currently utilized in Brazil.
According to participatory budgeting expert and former White House technology fellow, Hollie Russon Gilman, San Francisco’s experiment will mark a “frontier” in American direct democracy.
This is significant because the Internet engenders a different type of democracy: not one of mere expression, but one of ideas. The net is good at surfacing the best ideas hidden within the wisdom of the crowds. Modern political scientists refer to this as “Epistemic Democracy,” derived from the Greek word for knowledge, epistēmē. Epistemic Democracy values citizens most for their expertise and builds tools to make policy making more informed.
For example, participatory budgeting has been found to reduce infant mortality rates in Brazil. It turns out that the mothers in Brazil had a better knowledge of why children were dying than health experts. Through participatory budgeting, they “channeled a larger fraction of their total budget to key investments in sanitation and health services,” writes Sonia Goncalves of King’s College London. “I also found that this change in the composition of municipal expenditures is associated with a pronounced reduction in the infant mortality rates for municipalities which adopted participatory budgeting.” [PDF]”

The Participatory Turn: Participatory Budgeting Comes to America

Curated on Posted on by Stefaan Verhulst

Thesis by Hollie Russon Gilman: “Participatory Budgeting (PB) has expanded to over 1,500 municipalities worldwide since its inception in Porto Alege, Brazil in 1989 by the leftist Partido dos Trabalhadores (Workers’ Party). While PB has been adopted throughout the world, it has yet to take hold in the United States. This dissertation examines the introduction of PB to the United States with the first project in Chicago in 2009, and proceeds with an in-depth case study of the largest implementation of PB in the United States: Participatory Budgeting in New York City. I assess the outputs of PB in the United States including deliberations, governance, and participation. I argue that PB produces better outcomes than the status quo budget process in New York City, while also transforming how those who participate understand themselves as citizens, constituents, Council members, civil society leaders and community stakeholders. However, there are serious challenges to participation, including high costs of engagement, process exhaustion, and perils of scalability. I devise a framework for assessment called “citizenly politics,” focusing on: 1) designing participation 2) deliberation 3) participation and 4) potential for institutionalization. I argue that while the material results PB produces are relatively modest, including more innovative projects, PB delivers more substantial non-material or existential results. Existential citizenly rewards include: greater civic knowledge, strengthened relationships with elected officials, and greater community inclusion. Overall, PB provides a viable and informative democratic innovation for strengthening civic engagement within the United States that can be streamlined and adopted to scale.”

Improved Governance? Exploring the Results of Peru's Participatory Budgeting Process

Curated on Posted on by Stefaan Verhulst

Paper by Stephanie McNulty for the 2013 Annual Meeting of the American Political Science Association (Aug. 29-Sept. 1, 2013): “Can a nationally mandated participatory budget process change the nature of local governance? Passed in 2003 to mandate participatory budgeting in all districts and regions of Peru, Peru’s National PB Law has garnered international attention from proponents of participatory governance. However, to date, the results of the process have not been widely documented. Presenting data that have been gathered through fieldwork, online databases, and primary documents, this paper explores the results of Peru’s PB after ten years of implementation. The paper finds that results are limited. While there are a significant number of actors engaged in the process, the PB is still dominated by elite actors that do not represent the diversity of the civil society sector in Peru. Participants approve important “pro-poor” projects, but they are not always executed. Finally, two important indicators of governance, sub-national conflict and trust in local institutions, have not improved over time. Until Peruvian politicians make a concerted effort to move beyond politics as usual, results will continue to be limited”