Eight ways to make government more experimental
Such an approach requires a degree of humility. Facing up to the fact that we don’t have all the answers for the next five years. We need to test things out, evaluate new ways of doing things with the best of social science, and grow what works. And drop policies that fail.
But how best to go about it? Here are our 8 ways to make it a reality:
- Make failure OK. A more benign attitude to risk is central to experimentation. As a 2003 Cabinet Office review entitled Trying it Out said, a pilot that reveals a policy to be flawed should be ‘viewed as a success rather than a failure, having potentially helped to avert a potentially larger political and/or financial embarrassment’. Pilots are particularly important in fast moving areas such as technology to try promising fresh ideas in real-time. Our ‘Visible Classroom’ pilot tried an innovative approach to teacher CPD developed from technology for television subtitling.
- Avoid making policies that are set in stone. Allowing policy to be more project–based, flexible and time-limited could encourage room for manoeuvre, according to a previous Nesta report State of Uncertainty; Innovation policy through experimentation. The Department for Work and Pensions’ Employment Retention and Advancement pilot scheme to help people back to work was designed to influence the shape of legislation. It allowed for amendments and learning as it was rolled out. We need more policy experiments like this.
- Work with the grain of current policy environment. Experimenters need to be opportunists. We need to be nimble and flexible. Ready to seize windows of opportunity to experiment. Some services have to be rolled out in stages due to budget constraints. This offers opportunities to try things out before going national. For instance, The Mexican Oportunidades anti-poverty experiments which eventually reached 5.8 million households in all Mexican states, had to be trialled first in a handful of areas. Greater devolution is creating a patchwork of different policy priorities, funding and delivery models – so-called ‘natural experiments’. Let’s seize the opportunity to deliberately test and compare across different jurisdictions. What about a trial of basic income in Northern Ireland, for example, along the lines of recent Finnish proposals, or universal free childcare in Scotland?
- Experiments need the most robust and appropriate evaluation methods such as, if appropriate, Randomised Controlled Trials. Other methods, such as qualitative research may be needed to pry open the ‘black box’ of policies – to learn about why and how things are working. Civil servants should use the government trial advice panel as a source of expertise when setting up experiments.
- Grow the public debate about the importance of experimentation. Facebook had to apologise after a global backlash to psychological experiments on their 689,000 users web-users. Approval by ethics committees – normal practice for trials in hospitals and universities – is essential, but we can’t just rely on experts. We need a dedicated public understanding of experimentation programmes, perhaps run by Evidence Matters or Ask for Evidence campaigns at Sense about Science. Taking part in an experiment in itself can be a learning opportunity creating an appetite amongt the public, something we have found from running an RCT with schools.
- Create ‘Skunkworks’ institutions. New or improved institutional structures within government can also help with experimentation. The Behavioural Insights Team, located in Nesta, operates a classic ‘skunkworks’ model, semi-detached from day-to-day bureaucracy. The nine UK What Works Centres help try things out semi-detached from central power, such as the The Education Endowment Foundation who source innovations widely from across the public and private sectors- including Nesta- rather than generating ideas exclusively in house or in government.
- Find low-cost ways to experiment. People sometimes worry that trials are expensive and complicated. This does not have to be the case. Experiments to encourage organ donation by the Government Digital Service and Behavioural Insights Team involved an estimated cost of £20,000. This was because the digital experiments didn’t involve setting up expensive new interventions – just changing messages on web pages for existing services. Some programmes do, however, need significant funding to evaluate and budgets need to be found for it. A memo from the White House Office for Management and Budget has asked for new Government schemes seeking funding to allocate a proportion of their budgets to ‘randomized controlled trials or carefully designed quasi-experimental techniques’.
- Be bold. A criticism of some experiments is that they only deal with the margins of policy and delivery. Government officials and researchers should set up more ambitious experiments on nationally important big-ticket issues, from counter-terrorism to innovation in jobs and housing….(More)
New York Police to Use Social Media to Connect With Residents
Benjamin Mueller And Jeffrey E. Singer at the New York Times: “The New York Police Department has faced its share of pushback on social media, most memorably when it solicited photos of police interactions on Twitter under the hashtag #myNYPD. Images of aggression by officers upended that campaign.
Now, the department is seeking to turn New Yorkers’ penchant for online complaints to its gain by crowdsourcing their concerns. It has even consulted another sector troubled by social media gripes — the airline industry — to become more responsive to problems voiced online.
“They’re very good at managing customer complaints,” said Zachary Tumin, deputy commissioner for strategic initiatives and leader of the department’s social media efforts, who visited Delta Air Lines’ Atlanta headquarters this month. “That’s an area we need to explore.”
The department’s fleet of commanding officers has found its footing on Twitter in recent months, using the site to herald arrests, announce transportation delays and spread information about suspects. Now, the officers are planning to use that online visibility to draw ground-level information on crimes and conditions, a potential boost to a department seeking to align its “broken windows” crime-fighting objectives with local communities’ needs….
In a pilot program starting next month in the 109th Precinct in Queens, police officials will use a platform called IdeaScale to solicit tips and concerns from residents. The platform, which some government agencies have used internally as a brainstorming tool, promotes the posts that other users agree deserve attention.
In that way, officials argue, the police will be able to look beyond departmentwide priorities and focus on concerns that resonate in smaller communities….(More)”
Twitter for government: Indonesians get social media for public services
Medha Basu at FutureGov: “One of the largest users of social media in the world, Indonesians are taking it a step further with a new social network just for public services.
Enda Nasution and his team have built an app called Sebangsa, or Same Nation, featuring Facebook-like timelines (or Twitter-like feeds) for citizens to share about public services.
They want to introduce an idea they call “social government” in Indonesia, Nasution told FutureGov, going beyond e-government and open government to build a social relationship between the government and citizens….
It has two features that stand out. One called Sebangsa911 is for Indonesians to post emergencies, much like they might on Twitter or Facebook when they see an accident on the road or a crowd getting violent, for instance. Indonesia does not have any single national emergency number.
Another feature is called Sebangsa1800 which is a channel for people to post reviews, questions and complaints on public services and consumer products.
Why another social network?
But why build another social network when there are millions of users on Facebook and Twitter already? One reason is to provide a service that focuses on Indonesians, Nasution said – the app is in Bahasa.
Another is because existing social networks are not built specifically for public services. If you post a photo of an accident on Twitter, how many and how fast people see it depends on how many followers you have, Nasution said. These reports are also unstructured because they are “scattered all over Twitter”, he said. The app “introduces a little bit of structure to the reports”….(More)”
Embracing Crowdsourcing
Paper by Jesse A. Sievers on “A Strategy for State and Local Governments Approaching “Whole Community” Emergency Planning”: “Over the last century, state and local governments have been challenged to keep proactive, emergency planning efforts ahead of the after-the-disaster, response efforts. After moving from decentralized to centralized planning efforts, the most recent policy has returned to the philosophy that a decentralized planning approach is the most effective way to plan for a disaster. In fact, under the Obama administration, a policy of using the “whole community” approach to emergency planning has been adopted. This approach, however, creates an obvious problem for state and local government practitioners already under pressure for funding, time, and the continuous need for higher and broader expertise—the problem of how to actually incorporate the whole community into emergency planning efforts. This article suggests one such approach, crowdsourcing, as an option for local governments. The crowdsourcer-problem-crowd-platform-solution (CPCPS) model is suggested as an initial framework for practitioners seeking a practical application and basic comprehension. The model, discussion, and additional examples in this essay provide a skeletal framework for state and local governments wishing to reach the whole community while under the constraints of time, budget, and technical expertise….(More).
World Justice Project (WJP) Open Government Index
“The World Justice Project (WJP) Open Government Index™ provides scores and rankings on four dimensions of government openness: publicized laws and government data, right to information, civic participation, and complaint mechanisms (full descriptions below). Scores are based on responses to household surveys and in-country expert questionnaires collected for the WJP Rule of Law Index. The WJP Open Government Index 2015 covers a total of 102 countries and jurisdictions.
This index is the product of two years of development, consultation, and vetting with policy makers, civil society groups, and academics from several countries. It is our hope that over time this diagnostic tool will help identify strengths and weaknesses in countries under review and encourage policy choices that enhance openness, promote effective public oversight, and increase collaboration amongst public and private sectors.
- Download the full report, data set, and global insights: worldjusticeproject.org/opengov
- Read the methodology: worldjusticeproject.org/opengov/methodology
- Learn about the World Justice Project: worldjusticeproject.org“
Mobile Spans Language Gap to Aid Human Trafficking Victims
Aida Akl at VOATechTonics: “A mobile solution from the Mekong Club, a non-profit group dedicated to fighting slavery, helps identify potential trafficking victims among populations where the person’s country of origin and language is unknown, and lets law enforcement agencies communicate with them.
The Android app was the product of collaboration between the Mekong Club, the United Nations Action for Cooperation Against Trafficking in Persons, and MotherApp, a private company that developed the app for free.
To communicate with potential victims, users press an icon which brings up a sample of flags on the phone’s screen, said Mathew Friedman, CEO of the Mekong Club, in an email interview.
Users then tap the flags that correspond to their countries of origin. “Once this has been done,” Friedman added, “a video in the language of the country comes up informing the respondent of his/her rights, assuring them of confidentiality, and explaining that the officials playing the video to them are there to help should they require assistance.”
The videos pose a number of questions for users to respond to by pressing either a green button for an affirmative answer or a red button for a negative response.
The questions help law enforcement officials determine if the respondent is a victim of human trafficking.
“If all of the users’ answers are in the affirmative, then that would indicate a potential problem,” said Friedman.
Organizations that tested the app found it useful in bridging the translation gap. Friedman said the easy-to-use app offers an option for responders to triage potential victims in locations where translation is absent and allows the user to take notes and record audio/visual information….
Once developed, Friedman said the app will be cost-effective because “putting it on responder phones doesn’t cost anything.” But he lamented that it was only able to help “about 48,000″ trafficking victims last year — “well below one percent,” he said….(More)”
Why Google’s Waze Is Trading User Data With Local Governments
Parmy Olson at Forbes: “In Rio de Janeiro most eyes are on the final, nail-biting matches of the World Cup. Over in the command center of the city’s department of transport though, they’re on a different set of screens altogether.
Planners there are watching the aggregated data feeds of thousands of smartphones being walked or driven around a city, thanks to two popular travel apps, Waze and Moovit.
The goal is traffic management, and it involves swapping data for data. More cities are lining up to get access, and while the data the apps are sharing is all anonymous for now, identifying details could get more specific if cities like what they see, and people become more comfortable with being monitored through their smartphones in return for incentives.
Rio is the first city in the world to collect real-time data both from drivers who use the Waze navigation app and pedestrians who use the public-transportation app Moovit, giving it an unprecedented view on thousands of moving points across the sprawling city. Rio is also talking to the popular cycling app Strava to start monitoring how cyclists are moving around the city too.
All three apps are popular, consumer services which, in the last few months, have found a new way to make their crowdsourced data useful to someone other than advertisers. While consumers use Waze and Moovit to get around, both companies are flipping the use case and turning those millions of users into a network of sensors that municipalities can tap into for a better view on traffic and hazards. Local governments can also use these apps as a channel to send alerts.
On an average day in June, Rio’s transport planners could get an aggregated view of 110,000 drivers (half a million over the course of the month), and see nearly 60,000 incidents being reported each day – everything from built-up traffic, to hazards on the road, Waze says. Till now they’ve been relying on road cameras and other basic transport-department information.
What may be especially tantalizing for planners is the super-accurate read Waze gets on exactly where drivers are going, by pinging their phones’ GPS once every second. The app can tell how fast a driver is moving and even get a complete record of their driving history, according to Waze spokesperson Julie Mossler. (UPDATE: Since this story was first published Waze has asked to clarify that it separates users’ names and their 30-day driving info. The driving history is categorized under an alias.)
This passively-tracked GPS data “is not something we share,” she adds. Waze, which Google bought last year for $1.3 billion, can turn the data spigots on and off through its application programing interface (API).
Waze has been sharing user data with Rio since summer 2013 and it just signed up the State of Florida. It says more departments of transport are in the pipeline.
But none of these partnerships are making Waze any money. The app’s currency of choice is data. “It’s a two-way street,” says Mossler. “Literally.”
In return for its user updates, Waze gets real-time information from Rio on highways, from road sensors and even from cameras, while Florida will give the app data on construction projects or city events.
Florida’s department of transport could not be reached for comment, but one of its spokesmen recently told a local news station: “We’re going to share our information, our camera images, all of our information that comes from the sensors on the roadway, and Waze is going to share its data with us.”…
To get Moovit’s data, municipalities download a web interface that gives them an aggregated view of where pedestrians using Moovit are going. In return, the city feeds Moovit’s database with a stream of real-time GPS data for buses and trains, and can issue transport alerts to Moovit’s users. Erez notes the cities aren’t allowed to make “any sort of commercial approach to the users.”
Erez may be saving that for advertisers, an avenue he says he’s still exploring. For now getting data from cities is the bigger priority. It gives Moovit “a competitive advantage,” he says.
Cycling app Strava also recently started sharing its real-time user data as part of a paid-for service called Strava Metro.
Municipalities pay 80 cents a year for every Strava member being tracked. Metro only launched in May, but it already counts the state of Oregon; London, UK; Glasgow, Scotland; Queensland, Austalia and Evanston, Illinois as customers.
….
Privacy advocates will naturally want to keep a wary eye on what data is being fed to cities, and that it doesn’t leak or get somehow misused by City Hall. The data-sharing might not be ubiquitous enough for that to be a problem yet, and it should be noted that any kind of deal making with the public sector can get wrapped up in bureaucracy and take years to get off the ground.
For now Waze says it’s acting for the public good….(More)
Growing Data Collection Inspires Openness at NGA
Steven Aftergood at Secrecy News: “A flood of information from the ongoing proliferation of space-based sensors and ground-based data collection devices is promoting a new era of transparency in at least one corner of the U.S. intelligence community.
The “explosion” of geospatial information “makes geospatial intelligence increasingly transparent because of the huge number and diversity of commercial and open sources of information,” said Robert Cardillo, director of the National Geospatial-Intelligence Agency (NGA), in a speech last month.
Hundreds of small satellites are expected to be launched within the next three years — what Mr. Cardillo called a “darkening of the skies” — and they will provide continuous, commercially available coverage of the entire Earth’s surface.
“The challenges of taking advantage of all of that data are daunting for all of us,” Mr. Cardillo said.
Meanwhile, the emerging “Internet of Things” is “spreading rapidly as more people carry more handheld devices to more places” generating an abundance of geolocation data.
This is, of course, a matter of intelligence interest since “Every local, regional, and global challenge — violent extremism in the Middle East and Africa, Russian aggression, the rise of China, Iranian and North Korean nuclear weapons, cyber security, energy resources, and many more — has geolocation at its heart.”
Consequently, “We must open up GEOINT far more toward the unclassified world,” Director Cardillo said in another speech last week.
“In the past, we have excelled in our closed system. We enjoyed a monopoly on sources and methods. That monopoly has long since ended. Today and in the future, we must thrive and excel in the open.”
So far, NGA has already distinguished itself in the area of disaster relief, Mr. Cardillo said.
“Consider Team NGA’s response to the Ebola crisis. We are the first intelligence agency to create a World Wide Web site with access to our relevant unclassified content. It is open to everyone — no passwords, no closed groups.”
NGA provided “more than a terabyte of up-to-date commercial imagery.”
“You can imagine how important it is for the Liberian government to have accurate maps of the areas hardest hit by the Ebola epidemic as well as the medical and transportation infrastructure to combat the disease,” Mr. Cardillo said.
But there are caveats. Just because information is unclassified does not mean that it is freely available.
“Although 99 percent of all of our Ebola data is unclassified, most of that is restricted by our agreements [with commercial providers],” Mr. Cardillo said. “We are negotiating with many sources to release more data.”
Last week, Director Cardillo announced a new project called GEOINT Pathfinder that will attempt “to answer key intelligence questions using only unclassified data.”….(More)
Methods to Protect and Secure “Big Data” May Be Unknowingly Corrupting Research
New paper by John M. Abowd and Ian M. Schmutte: “…As the government and private companies increase the amount of data made available for public use (e.g. Census data, employment surveys, medical data), efforts to protect privacy and confidentiality (through statistical disclosure limitation or SDL) can often cause misleading and compromising effects on economic research and analysis, particularly in cases where data properties are unclear for the end-user.
Data swapping is a particularly insidious method of SDL and is frequently used by important data aggregators like the Census Bureau, the National Center for Health Statistics and others, which interferes with the results of empirical analysis in ways that few economists and other social scientists are aware of.
To encourage more transparency, the authors call for both government statistical agencies as well as the private sector (Amazon, Google, Microsoft, Netfix, Yahoo!, etc.) to release more information about parameters used in SDL methods, and insist that journals and editors publishing such research require documentation of the author’s entire methodological process….(More)
VIDEO: