External validity and policy adaptation. From impact evaluation to policy design


Paper by Martin J. Williams: “With the growing number of rigorous impact evaluations worldwide, the question of how best to apply this evidence to policymaking processes has arguably become the main challenge for evidence-based policymaking. How can policymakers predict whether a policy will have the same impact in their context as it did elsewhere, and how should this influence the design and implementation of policy? This paper introduces a simple and flexible framework to address these questions of external validity and policy adaptation. I show that failures of external validity arise from an interaction between a policy’s theory of change and a dimension of the context in which it is being implemented, and develop a method of “mechanism mapping” that maps a policy’s theory of change against salient contextual assumptions to identify external validity problems and suggest appropriate policy adaptations. In deciding whether and how to adapt a policy in a new context, I show there is a fundamental informational trade-o↵ between the strength and relevance of evidence on the policy from other contexts and the policymaker’s knowledge of the local context. This trade-o↵ can guide policymakers’ judgments about whether policies should be copied exactly from elsewhere, adapted, or invented anew….(More)”

How Americans Perceive Government in 2017


Gallup: “Overall, Americans’ views of government remain negative. Most U.S. adults are dissatisfied with how the executive and legislative branches are doing their jobs, and majorities hold unfavorable views of both major political parties. Even Republicans rate Congress negatively, despite their party being in control of both chambers.

  1. Americans’ frustration with government is focused on Washington, D.C. This is seen in trust and approval ratings they give to the executive and legislative branches — especially Congress. U.S. adults maintain higher levels of trust in the judicial branch as well as state and local government.
  2. Barely a quarter of Americans, 28%, currently say they are satisfied with the way the nation is being governed. This is below the average of 38% found in the 22 times Gallup has asked this question since 1971 but still above the low point of 18%, recorded during the federal government shutdown in October 2013.
  3. Americans’ low trust in many aspects of their government is part of a general trend of declining trust in U.S. institutions. But even in this broad context, the government is particularly suspect in the public’s eyes. The federal government has the least positive image of any business or industry sector measured, Congress engenders the lowest confidence of any institution that Gallup tests, and Americans rate the honesty and ethics of members of Congress as the lowest among 22 professions in Gallup’s most recent update.
  4. Another longtime indicator of citizen frustration with government comes from Gallup’s monthly updates on the most important problem facing the nation. Government was the most frequently occurring single problem mentioned during all of 2014 and 2015, was the second most frequently mentioned problem in 2016, and has been at the top or near the top of the list throughout 2017.
  5. The issues that Americans raise when they talk about government as the top problemcenter more on the process of government and political personalities — particularly infighting and bickering — than on worries about government power, size, or specific policies or tendencies.
  6. Americans continue to have more trust in the government to handle international than domestic problems, although both are down substantially since Gallup began measuring them routinely 17 years ago. Even with these overall declines, a majority continue to have at least a fair amount of trust in the government to handle international issues.
  7. Americans’ declining trust in the government is also reflected in the finding that both presidential and congressional job approval ratings are low on a historical basis. Just 13% say they approve of Congress, slightly above the all-time low of 9% recorded in the fall of 2013. Rank-and-file Republicans are essentially as down on the legislative branch of government as are Democrats, even though the GOP is in control of both houses. Presidential job approval is in the 35% to 40% range, well below historical averages as well as averages for elected presidents in their first year in office.
  8. One consistent finding in recent decades: Americans have a relatively higher level of trust in the judicial branch than either the executive or legislative branch. The higher regard in which Americans hold the judicial branch is also reflected in the approval rating they give the Supreme Court — now 49%, and the highest in five years. Still, trust in all three branches is down on a longer-term basis.
  9. Trust in the men and women in political office is also low. The majority of Americans, however, continue to have trust in the people of the country themselves, in essence the bedrock of democracy, and this is up slightly this year….(More)”.

The Pnyx and the Agora


Richard Sennett at ReadingDesign: “I am not going to speak about the present, but about the past: about the foundations on which our democracy is based. These foundations were rooted in cities, in their civic spaces. We need to remember this history to think about how democratic cities should be made today.

A democracy supposes people can consider views other than their own. This was Aristotle’s notion in the Politics. He thought the awareness of difference occurs only in cities, since the every city is formed by synoikismos, a drawing together of different families and tribes, of competing economic interests, of natives with foreigners.

“Difference” today seems about identity — we think of race, gender, or class. Aristotle’s meant something more by difference; he included also the experience of doing different things, of acting in divergent ways which do not neatly fit together. The mixture in a city of action as well as identity is the foundation of its distinctive politics. Aristotle’s hope was that when a person becomes accustomed to a diverse, complex milieu he or she will cease reacting violently when challenged by something strange or contrary. Instead, this environment should create an outlook favourable to discussion of differing views or conflicting interests. Almost all modern urban planners subscribe to this Aristotelian principle. But if in the same space different persons or activities are merely concentrated, but each remains isolated and segregated, diversity loses its force. Differences have to interact.

Classical urbanism imagines two kinds of spaces in which this interaction could occur. One was the pnyx, an ampitheatre in which citizens listed to debates and took collective decisions; the other was the agora, the town square in which people were exposed to difference in a more raw, unmediated form….(More)”

Public Brainpower: Civil Society and Natural Resource Management


Book edited by Indra Øverland: ” …examines how civil society, public debate and freedom of speech affect natural resource governance. Drawing on the theories of Robert Dahl, Jurgen Habermas and Robert Putnam, the book introduces the concept of ‘public brainpower’, proposing that good institutions require: fertile public debate involving many and varied contributors to provide a broad base for conceiving new institutions; checks and balances on existing institutions; and the continuous dynamic evolution of institutions as the needs of society change.

The book explores the strength of these ideas through case studies of 18 oil and gas-producing countries: Algeria, Angola, Azerbaijan, Canada, Colombia, Egypt, Iraq, Kazakhstan, Libya, Netherlands, Nigeria, Norway, Qatar, Russia, Saudi, UAE, UK and Venezuela. The concluding chapter includes 10 tenets on how states can maximize their public brainpower, and a ranking of 33 resource-rich countries and the degree to which they succeed in doing so.

The Introduction and the chapters ‘Norway: Public Debate and the Management of Petroleum Resources and Revenues’, ‘Kazakhstan: Civil Society and Natural-Resource Policy in Kazakhstan’, and ‘Russia: Public Debate and the Petroleum Sector’ of this book are available open access under a CC BY 4.0 license at link.springer.com….(More)”.

Spotting the Patterns: 2017 Trends in Design Thinking


Andy Hagerman at Stanford Social Innovation Review: “Design thinking: It started as an academic theory in the 60’s, a notion of starting to look at broader types of challenges with the intention and creativity that designers use to tackle their work. It gained widespread traction as a product design process, has been integrated into culture change initiatives of some of the world’s most important organizations and governments, and has been taught in schools kindergarten to grad school. It’s been celebrated, criticized, merged with other methodologies, and modified for nearly every conceivable niche.

Regardless of what side of those perspectives you fall on, it’s undeniable that design thinking is continuing to grow and evolve. Looking across the social innovation landscape today, we see a few patterns that, taken together, suggest that social innovators continue to see great promise in design thinking. They are working to find ways to make it yield real performance gains for their organizations and clients.

From design thinking to design doing

Creative leaders have moved beyond increasing people’s awareness of design thinking to actively seeking concrete opportunities for using it. One of the principal drivers of this shift has been the need to demonstrate value and return on investment from design-thinking initiatives—something people have talked about for years. (Ever heard the question, “Is design thinking just the next fad?”) Social sector organizations, in particular, stand to benefit from the shift from design thinking to design doing. Timelines for getting things built in the social sector are often slow, due to legitimate constraints of responsibly doing impact work, as well as to legacy practices and politics. As long as organizations use design thinking responsibly and acknowledge the broader systems in which new ideas live, some of the emerging models can help them move projects along more quickly and gain greater stakeholder participation….

Building cultures around design thinking

As design thinking has proliferated, many organizational leaders have moved from replicating the design thinking programs of academic institutions like the Stanford d.School or foundational agencies like IDEO to adapting the methodology to their own goals, external environments, and organizational cultures.

One organization that has particularly inspired us is Beespace, a New York City-based social-impact foundation. Beespace has designed a two-year program that helps new organizations not only get off the ground, but also create the conditions for breakthrough innovation. To create this program, which combines deep thinking, impact assessment, and rapid prototyping, Beespace’s leadership asked itself what tools it would need, and came up with a mix that included not just design thinking, but also disciplines of behavioral science and systems thinking, and tools stemming from emotional intelligence and theory of change….

Empowering the few to shift the many

We have seen a lot of interest this year in “train the trainer” programs, particularly from organizations realizing the value of developing their internal capabilities to reduce reliance on outside consultants. Such development often entails focusing on the few people in the organization who are highly capable of instigating major change, as opposed to spreading awareness among the many. It takes time and resources, but the payoff is well worth it from both cultural and operational perspectives….(More)”.

How do interest groups legitimate their policy advocacy? Reconsidering linkage and internal democracy in times of digital disruption


Bret Fraussen and Darren Halpin in Public Administration: “The ongoing embrace of interest groups as agents capable of addressing democratic deficits in governing institutions is in large part because they are assumed to contribute democratic legitimacy to policy processes. Nonetheless, they face the challenge of legitimating their policy advocacy in democratic terms, clarifying what makes them legitimate partners in governance. In this article we suggest that digital innovations have disrupted the established mechanisms of legitimation. While the impact of this disruption is most easily demonstrated in the rise of a small number of ‘digital natives’, we argue that the most substantive impact has been on more conventional groups, which typically follow legitimation logics of either representation or solidarity. While several legacy groups are experimenting with new legitimation approaches, the opportunities provided by technology seem to offer more organizational benefits to groups employing the logic of solidarity, and appear less compatible with the more traditional logic of representation….(More)”.

Does protest really work in cosy democracies?


Steve Crawshaw at LSE Impact Blog: “…If it is possible for peaceful crowds to force the collapse of the Berlin Wall or to unseat a Mubarak, how easy it should it be for protesters to persuade a democratically elected leader to retreat from “mere” bad policy? In truth, not easy at all. Two million marched in the UK against the Iraq War in 2003 – and it made not a blind bit of difference with Tony Blair’s determination to proceed with a war that the UN Secretary-General described as illegal. Blair was re-elected, two years later.

After the inauguration of Donald Trump in January 2017, millions took part in the series of Women’s Marches in the United States and around the world. It seemed – it was – a powerful defining moment. And yet, at least in the short-term, those remarkable protests were water off the presidential duck’s back. His response was mockery. In some respects, Trump could afford to mock. A man who has received 63 million votes is in a stronger position than the unelected leader who has to threaten or use violence to stay in power.

And yet.

One thing that protest in an authoritarian and a democratic context have in common is that the impact of protest – including delayed impact – remains uncertain, both for those who protest and those who are protested against.

Vaclav Havel argued that it was worth “living in truth” – speaking truth to power – even without any certainty of outcome. “Those that say individuals are not capable of changing anything are only looking for excuses.” In that context, what is perhaps most unacceptable is to mock those who take risks, and seek change. Lord Charles Powell, former adviser to Margaret Thatcher, for example explained to the umbrella protesters in Hong Kong in 2013 that they were foolish and naive. They should, he told them, learn to live with the “small black cloud” of anti-democratic pressures from Beijing. The protesters failed to heed Powell’s complacent message. In the words of Joshua Wong, on his way back to jail earlier in 2017: “You can lock up our bodies, but not our minds.”

Scepticism and failure are linked, as the Egyptian activist Asmaa Mahfouz made clear in a powerful video which helped trigger the uprising in 2011. The 26-year-old declared: ‘”Whoever says it is not worth it because there will only be a handful or people, I want to tell him, “You are the reason for this.” Sitting at home and just watching us on the news or Facebook leads to our humiliation.’ The video went viral. Millions went out. The rest was history.

Even in a democracy, that same it-can’t-be-done logic sucks us in more often, perhaps, than we realize….(More)”.

Globally, Broad Support for Representative and Direct Democracy


Pew Global: “A deepening anxiety about the future of democracy around the world has spread over the past few years. Emboldened autocrats and rising populists have shaken assumptions about the future trajectory of liberal democracy, both in nations where it has yet to flourish and countries where it seemed strongly entrenched. Scholars have documented a global “democratic recession,” and some now warn that even long-established “consolidated” democracies could lose their commitment to freedom and slip toward more authoritarian politics.

A 38-nation Pew Research Center survey finds there are reasons for calm as well as concern when it comes to democracy’s future. More than half in each of the nations polled consider representative democracy a very or somewhat good way to govern their country. Yet, in all countries, pro-democracy attitudes coexist, to varying degrees, with openness to nondemocratic forms of governance, including rule by experts, a strong leader or the military.

A number of factors affect the depth of the public’s commitment to representative democracy over nondemocratic options. People in wealthier nations and in those that have more fully democratic systems tend to be more committed to representative democracy. And in many nations, people with less education, those who are on the ideological right and those who are dissatisfied with the way democracy is currently working in their country are more willing to consider nondemocratic alternatives.

At the same time, majorities in nearly all nations also embrace another form of democracy that places less emphasis on elected representatives. A global median of 66% say direct democracy – in which citizens, rather than elected officials, vote on major issues – would be a good way to govern. This idea is especially popular among Western European populists….(More)”

Who governs or how they govern: Testing the impact of democracy, ideology and globalization on the well being of the poor


Eunyoung Ha and Nicholas L.Cain in The Social Science Journal: “This paper examines the effects of regime type, government ideology and economic globalization on poverty in low- and middle-income countries around the world. We use panel regression to estimate the effect of these explanatory variables on two different response variables: national poverty gap (104 countries from 1981 to 2005) and child mortality rate (132 countries from 1976 to 2005). We find consistent and significant results for the interactive effect of democracy and government ideology: strong leftist power under a democratic regime is associated with a reduction in both the poverty gap and the child mortality rate. Democracy, on its own, is associated with a lower child mortality rate, but has no effect on the poverty gap. Leftist power under a non-democratic regime is associated with an increase in both poverty measures. Trade reduces both measures of poverty. Foreign direct investment has a weak and positive effect on the poverty gap. From examining factors that influence the welfare of poor people in less developed countries, we conclude that who governs is as important as how they govern….

  • Our paper uses a unique dataset to study the impact of regime type, ideology and globalization on two measures of poverty.
  • We find that higher levels of democracy are associated with lower child mortality rates, but do not impact poverty gap.
  • The interaction of regime type and ideology has a strong effect: leftist power in a democracy reduces poverty and child mortality.
  • We find that trade significantly reduces both the poverty gap and the child mortality rate.
  • Overall, we find strong evidence that who governs is as important as how they govern…(More)”

Governance Reforms: the Good, the Bad, and the Ugly; and the Sound: Examining the Past and Exploring the Future of Public Organizations


Ali Farazmand in Public Organization Review: “This paper addresses governance reforms of the last three and a half decades and looks into the future. This is done in three parts. The first part presents a birds-eye view of the massive literature on governance and governance reforms with a focus on the good, the bad, and ugly sides, then in part two argues for an alternative concept or theory of “sound governance” with characteristics and dimensions that overcome the deficiencies of other models of governance. As a consequence of reforms, the third part examines the past and explores the future of public organizations via “going home” as a conclusion with possible scenarios, challenges, and opportunities….(More)”