How to use research evidence to improve your work


NESTA: “We’re pleased to announce the launch of the latest publication in our series of practice guides – Using Research Evidence. Created by the Alliance for Useful Evidence and Nesta, the guide has been designed to help you improve the way you work by using evidence effectively.

Evidence can help you make better decisions. Whether it’s in a police station, a school classroom or the boardroom of a charity, using research-based evidence can help improve outcomes. It is helpful not only in frontline service-delivery, but also in creating smarter organisations – charities, local authorities, government departments – and in developing national policies or charity campaigns.

It is also useful not only to you as a decision-maker, but to the citizens, voters, donors and wider public you are trying to support. Evidence can show if your services are working (or failing), save money, and align services with public needs.

The guide is aimed at those working in government, charities, voluntary organisations, professional membership bodies and local authorities. It will help you to:

  • Learn about evidence-informed decision-making, and why research is an essential element of it.

  • Understand the different scenarios in which using evidence can help you, as well as the types of evidence you might need at different stages of development.

  • Explore different types of evidence, how to choose the most appropriate and how to judge its quality.

  • Get advice on finding the right evidence to support your case, and how to get your message across once you have it….

Download the report here.”

Designing a toolkit for policy makers


 at UK’s Open Policy Making Blog: “At the end of the last parliament, the Cabinet Office Open Policy Making team launched the Open Policy Making toolkit. This was about giving policy makers the actual tools that will enable them to develop policy that is well informed, creative, tested, and works. The starting point was addressing their needs and giving them what they had told us they needed to develop policy in an ever changing, fast paced and digital world. In a way, it was the culmination of the open policy journey we have been on with departments for the past 2 years. In the first couple of months we saw thousands of unique visits….

Our first version toolkit has been used by 20,000 policy makers. This gave us a huge audience to talk to to make sure that we continue to meet the needs of policy makers and keep the toolkit relevant and useful. Although people have really enjoyed using the toolkit, user testing quickly showed us a few problems…

We knew what we needed to do. Help people understand what Open Policy Making was, how it impacted their policy making, and then to make it as simple as possible for them to know exactly what to do next.

So we came up with some quick ideas on pen and paper and tested them with people. We quickly discovered what not to do. People didn’t want a philosophy— they wanted to know exactly what to do, practical answers, and when to do it. They wanted a sort of design manual for policy….

How do we make user-centered design and open policy making as understood as agile?

We decided to organise the tools around the journey of a policy maker. What might a policy maker need to understand their users? How could they co-design ideas? How could they test policy? We looked at what tools and techniques they could use at the beginning, middle and end of a project, and organised tools accordingly.

We also added sections to remove confusion and hesitation. Our opening section ‘Getting started with Open Policy Making’ provides people with a clear understanding of what open policy making might mean to them, but also some practical considerations. Sections for limited timeframes and budgets help people realise that open policy can be done in almost any situation.

And finally we’ve created a much cleaner and simpler design that lets people show as much or little of the information as they need….

So go and check out the new toolkit and make more open policy yourselves….(More)”

Digital Decisions: Policy Tools in Automated Decision-Making


Ali Lange at CDT: “Digital technology has empowered new voices, made the world more accessible, and increased the speed of almost every decision we make as businesses, communities, and individuals. Much of this convenience is powered by lines of code that rapidly execute instructions based on rules set by programmers (or, in the case of machine learning, generated from statistical correlations in massive datasets)—otherwise known as algorithms. The technology that drives our automated world is sophisticated and obscure, making it difficult to determine how the decisions made by automated systems might fairly or unfairly, positively or negatively, impact individuals. It is also harder to identify where bias may inadvertently arise. Algorithmically driven outcomes are influenced, but not exclusively determined, by technical and legal limitations. The landscape of algorithmic decision-making is also shaped by policy choices in technology companies and by government agencies. Some automated systems create positive outcomes for individuals, and some threaten a fair society. By looking at a few case studies and drawing out the prevailing policy principle, we can draw conclusions about how to critically approach the existing web of automated decision-making. Before considering these specific examples, we will present a summary of the policy debate around data-driven decisions to give context to the examples raised. Then we will analyze three case studies from diverse industries to determine what policy interventions might be applied more broadly to encourage positive outcomes and prevent the risk of discrimination….(More)”

Platform for Mumbai’s slum entrepreneurs


Springwise: “We recently saw an initiative that empowered startup talent in a Finnish refugee camp, and now Design Museum Dharavi is a mobile museum that will provide a platform for makers in the Mumbai neighborhood.

The initiative is a brainchild of artist Jorge Rubio and Creative Industries Fund NL. Taking the model of a pop-up, it will stop at various locations throughout the neighborhood. Despite being an ‘informal settlement’, Dharavi is famed for producing very little waste due to a culture of recycling and repurposing. The mobile museum will showcase local makers, enable them to connect with potential clients and run workshops, ultimately elevating the global social perception towards life in the so-called ‘slums’. Home to over a million people, Dharavi has the additional tourism pull from appearing on the film Slumdog Millionaire…..(More)”

Political Speech Generation


Valentin Kassarnig at arXiv: “In this report we present a system that can generate political speeches for a desired political party. Furthermore, the system allows to specify whether a speech should hold a supportive or opposing opinion. The system relies on a combination of several state-of-the-art NLP methods which are discussed in this report. These include n-grams, Justeson & Katz POS tag filter, recurrent neural networks, and latent Dirichlet allocation. Sequences of words are generated based on probabilities obtained from two underlying models: A language model takes care of the grammatical correctness while a topic model aims for textual consistency. Both models were trained on the Convote dataset which contains transcripts from US congressional floor debates. Furthermore, we present a manual and an automated approach to evaluate the quality of generated speeches. In an experimental evaluation generated speeches have shown very high quality in terms of grammatical correctness and sentence transitions….(More)”

Innovating and changing the policy-cycle: Policy-makers be prepared!


Marijn Janssen and Natalie Helbig in Government Information Quarterly: “Many policy-makers are struggling to understand participatory governance in the midst of technological changes. Advances in information and communication technologies (ICTs) continue to have an impact on the ways that policy-makers and citizens engage with each other throughout the policy-making process. A set of developments in the areas of opening government data, advanced analytics, visualization, simulation, and gaming, and ubiquitous citizen access using mobile and personalized applications is shaping the interactions between policy-makers and citizens. Yet the impact of these developments on the policy-makers is unclear. The changing roles and need for new capabilities required from the government are analyzed in this paper using two case studies. Salient new roles for policy-makers are outlined focused on orchestrating the policy-making process. Research directions are identified including understand the behavior of users, aggregating and analyzing content from scattered resources, and the effective use of the new tools. Understanding new policy-makers roles will help to bridge the gap between the potential of tools and technologies and the organizational realities and political contexts. We argue that many examples are available that enable learning from others, in both directions, developed countries experiences are useful for developing countries and experiences from the latter are valuable for the former countries…(More)”

The true geographers are in the buses


Felix Delattre: “When there is no map for the 1670 kilometers of metropolitan Managua’s public 45 bus lines network, there is only one thing you and anybody can do: Ask the people in the buses how to get from one point to another.

Once, a bus driver told us, that had no idea about the route of this bus, the first day he arrived at work. His supervisors didn’t explain him anything, so he took the most logical decision: he turned around and started asking the passengers where to go. And this is how he learned his own bus route.

The passengers of this complex – and naturally grown network within the capital – know most about it. But until today, a comprehensible map of Managua and Ciudad Sandino, that makes the cities more enjoyable has never existed. In both municipalities together every day there are approximately 1 million boardings. And within seventeen years of existence the city’s regulatory entity for municipal transports (IRTRAMMA), nor any private company, never could achieve to provide such a transit map.

But two years ago, a group inhabitants of Managua by own initiative decided to take the the feat and create the first bus network map in whole Central America. All creators are regular users of public transportation, which they use to get around in Nicaragua’s capital, in order to reach their job, their school, university or visit friends and family. We empowered ourselves, learned and mapped together the public transportation network of Managua. We were using available resources of new technologies and Free and Open Software, in particular the OpenStreetMap project and it’s ecosystem. This way more than 150 citizens collaborated in this gigantic task to map all routes and bus stops of the two cities.

The product of the effort is available online….(More)”

The Smart City and its Citizens


Paper by Carlo Francesco Capra on “Governance and Citizen Participation in Amsterdam Smart City…Smart cities are associated almost exclusively with modern technology and infrastructure. However, smart cities have the possibility to enhance the involvement and contribution of citizens to urban development. This work explores the role of governance as one of the factors influencing the participation of citizens in smart cities projects. Governance characteristics play a major role in explaining different typologies of citizen participation. Through a focus on Amsterdam Smart City program as a specific case study, this research examines the characteristics of governance that are present in the overall program and within a selected sample of projects, and how they relate to different typologies of citizen participation. The analysis and comprehension of governance characteristics plays a crucial role both for a better understanding and management of citizen participation, especially in complex settings where multiple actors are interacting….(More)”

Designing for Respect: UX Ethics for the Digital Age


O’Reilly Publishing: Although designers are responsible for orchestrating the behaviors of all sorts of interactions on the Web, mobile devices, and in consumer environments every day, they often forget—or don’t fully realize—the influence they have on others.

With this O’Reilly report, you’ll examine the subject of design with an ethical lens, and focus specifically on how UX, interaction, graphic, and visual product designers can affect a user’s time, mood, and trust. Author David Hindman, Interaction Design Director at Fjord San Francisco, investigates the topic of respectful design by providing examples of the challenges and frameworks to help inform considerate design solutions.

Designers and business owners alike will examine some of the most commonly used digital services from an ethical standpoint. This report will help you:

  • Recognize deceitful patterns, and learn how to create more efficient and honest solutions
  • Understand the impact of respectful design on business
  • Create more efficient and honest solutions
  • Raise awareness about the value of clarity and respect from digital services…(More)”

 

Transparency, accountability, and technology


Shanthi Kalathil at Plan International: “The recently launched Sustainable Development Goals have kicked off a renewed development agenda that features, among other things, a dedicated emphasis on peace, justice, and strong institutions. This emphasis, encapsulated in Goal #16, contains several sub-priorities, including reducing corruption; developing effective, accountable, and transparent institutions; ensuring inclusive, participatory, and representative decision-making; and ensuring access to information.

Indeed, the governance-related Goals merely stamp an official imprimatur on what have now become key buzzwords in development. Naturally, where there are buzzwords, there are “tools.” In many cases, those “tools” turn out to be information and communications technologies, and the data flows they facilitate. It’s no wonder, then, that technology has been embraced by the development community as a crucial component of the global accountability and transparency “toolkit.”

Certainly, information and communication technology for development (ICT4D) has long been a part of the development conversation. More recently, ICTs have emerged prominently in the context of good governance, transparency, and accountability. Yet – despite a growing number of studies and evaluations – there hasn’t been a field-wide deeper reckoning with technology’s role in fostering accountability. Technology often seems to promise greater transparency and empowered citizen voice, fitting seamlessly into broader goals of good governance for development. Yet the actual track record of many initiatives has been spotty, and dedicated examination has been sparse (although efforts are underway to change this). That hasn’t stemmed the enthusiasm to press ahead with tech-related applications and open-data-everything; if anything, calls for more critical examination are often treated as mere bumps on the road to progress.

One problem with the “tool for accountability” frame is that it minimizes the political, economic, and social ramifications of technology itself, including the complex web of laws, regulation, culture, norms, and power relations that accompany any form of communication. This means that, while many of these projects tackle the accountability piece using the recommended political economy lens, there is no corresponding emphasis on the communications and/or technology side of the equation. Referring to technology primarily as a “tool” to facilitate aspects of good governance, accountability, or transparency reinforces the idea that it’s merely a widget, one that doesn’t carry its own complexities. It subsumes technology as a means to a broader end, and in doing so, minimizes its ramifications. This, in turn, can lead to unintended or unsustainable outcomes.

Perhaps the answer, then, is to view accountability projects that employ technology in a different way. It’s time to ditch the “tech toolkit,” and instead embrace the emergence of a truly hybrid field with its own unique political economy. This will require a deeper engagement with the power relations that accompany the introduction of technology, and is likely to illuminate a host of issues that currently lie hidden in the planning stage and beyond. This deeper engagement will also require a rethink of current design, monitoring, and evaluation practices; so, for example, in addition to understanding the accountability challenge in question, program design will have to incorporate an equally substantive analysis of the political economy of the proposed ICT intervention, including stakeholders, potential obstacles, and an examination of all possible outcomes (intended or otherwise). While this will require substantial effort, by moving beyond the toolkit approach, we may be able to engage holistically with transparency, accountability, AND technology in ways that could lead to more sustained development impact. (Read the Report)