Three ways to grow the open data economy


Nigel Shadbolt in The Guardian: “…here are three areas where action by the UK government can help to support and promote a flourishing open data economy

Strengthen our data infrastructure

We are used to thinking of areas like transport and energy requiring physical infrastructure. From roads and rail networks to the national grid and power stations, we understand that investment and management of these vital parts of an infrastructure are essential to the economic wellbeing and future prosperity of the nation.

This is no less true of key data assets. Our data infrastructure is a core part of our national infrastructure. From lists of legally constituted companies to the country’s geospatial data, our data infrastructure needs to be managed, maintained, in some cases built and in all cases made as widely available as possible.

To maximise the benefits to the UK’s economy and to reduce costs in delivery of public services, the data we rely on needs to be adaptable, trustworthy, and as open as possible….

While we do have some excellent examples of infrastructure data from the likes of Companies House, Land Registry, Ordnance Survey and Defra, core parts of the data infrastructure that we need within the UK are missing, unreliable, or of a low quality. The government must invest here just as it invests in our other traditional infrastructure.

Support and promote data innovation

If we are to make best use of data, we need a bridge between academic research, public, private and third sectors, and a thriving startup ecosystem where new ideas and approaches can grow.

We have learned that properly targeted challenges could identify potential savings for government – similar to Prescribing Analytics, an ODI-incubated startup which used publicly available data to identify £200m in prescriptions savings per year for the NHS – but, more importantly, translate that potential into procurable products and services that could deliver those savings.

A data challenge series run at a larger scale, funded by Innovate UK, openly contested and independently managed, would stimulate the creation of new companies, jobs, products and services. It would also act as a forcing function to strengthen data infrastructure around key challenges, and raise awareness and capacity for those working to solve them. The data needed to satisfy the challenges would have to be made available and usable, bringing data innovation into government and bolstering the offer of the startups and SMEs who take part.

Invest in data literacy

In order to take advantage of the data revolution, policymakers, businesses and citizens need to understand how to make use of data. In other words, they must become data literate.

Data literacy is needed through our whole educational system and society more generally. Crucially, policymakers are going to need to be informed by insights that can only be gleaned through understanding and analysing data effectively….(More)”

How to ensure smart cities benefit everyone


 at the Conversation Global: “By 2030, 60 percent of the world’s population is expected to live in mega-cities. How all those people live, and what their lives are like, will depend on important choices leaders make today and in the coming years.

Technology has the power to help people live in communities that are more responsive to their needs and that can actually improve their lives. For example, Beijing, notorious for air pollution, is testing a 23-foot-tall air purifier that vacuums up smog, filters the bad particles and releases clear air.

This isn’t a vision of life like on “The Jetsons.” It’s real urban communities responding in real-time to changing weather, times of day and citizen needs. These efforts can span entire communities. They can vary from monitoring traffic to keep cars moving efficiently or measuring air quality to warn residents (or turn on massive air purifiers) when pollution levels climb.

Using data and electronic sensors in this way is often referred to as building “smart cities,” which are the subject of a major global push to improve how cities function. In part a response to incoherent infrastructure design and urban planning of the past, smart cities promise real-time monitoring, analysis and improvement of city decision-making. The results, proponents say, will improve efficiency, environmental sustainability and citizen engagement.

Smart city projects are big investments that are supposed to drive social transformation. Decisions made early in the process determine what exactly will change. But most research and planning regarding smart cities is driven by the technology, rather than the needs of the citizens. Little attention is given to the social, policy and organizational changes that will be required to ensure smart cities are not just technologically savvy but intelligently adaptive to their residents’ needs. Design will make the difference between smart city projects offering great promise or actually reinforcing or even widening the existing gaps in unequal ways their cities serve residents.

City benefits from efficiency

A key feature of smart cities is that they create efficiency. Well-designed technology tools can benefit government agencies, the environment and residents. Smart cities can improve the efficiency of city services by eliminating redundancies, finding ways to save money and streamlining workers’ responsibilities. The results can provide higher-quality services at lower cost….

Environmental effects

Another way to save money involves real-time monitoring of energy use, which can also identify opportunities for environmental improvement.

The city of Chicago has begun implementing an “Array of Things” initiative by installing boxes on municipal light poles with sensors and cameras that can capture air quality, sound levels, temperature, water levels on streets and gutters, and traffic.

The data collected are expected to serve as a sort of “fitness tracker for the city,” by identifying ways to save energy, to address urban flooding and improve living conditions.

Helping residents

Perhaps the largest potential benefit from smart cities will come from enhancing residents’ quality of life. The opportunities cover a broad range of issues, including housing and transportation, happiness and optimism, educational services, environmental conditions and community relationships.

Efforts along this line can include tracking and mapping residents’ health, using data to fight neighborhood blight, identifying instances of discrimination and deploying autonomous vehicles to increase residents’ safety and mobility….(More)“.

Open Innovation: Practices to Engage Citizens and Effectively Implement Federal Initiatives


United States Government Accountability Office: “Open innovation involves using various tools and approaches to harness the ideas, expertise, and resources of those outside an organization to address an issue or achieve specific goals. GAO found that federal agencies have frequently used five open innovation strategies to collaborate with citizens and external stakeholders, and encourage their participation in agency initiatives.

Screen Shot 2016-10-14 at 10.13.38 AM

GAO identified seven practices that agencies can use to effectively implement initiatives that involve the use of these strategies:

  • Select the strategy appropriate for the purpose of engaging the public and the agency’s capabilities.
  • Clearly define specific goals and performance measures for the initiative.
  • Identify and engage external stakeholders and potential partners.
  • Develop plans for implementing the initiative and recruiting participants.
  • Engage participants and partners while implementing the initiative.
  • Collect and assess relevant data and report results.
  • Sustain communities of interested partners and participants.

Aspects of these practices are illustrated by the 15 open innovation initiatives GAO reviewed at six selected agencies: the Departments of Energy, Health and Human Services, Housing and Urban Development, and Transportation (DOT); the Environmental Protection Agency; and the National Aeronautics and Space Administration (NASA).

For example:

• With the Asteroid Data Hunter challenge, NASA used a challenge and citizen science effort, beginning in 2014, to improve the accuracy of its asteroid detection program and develop an application for citizen scientists.

• Since 2009, DOT’s Federal Highway Administration has used an ideation initiative called Every Day Counts to identify innovations to improve highway project delivery. Teams of federal, state, local, and industry experts then implement the ideas chosen through this process….(More)”

Seeing Cities Through Big Data


Book edited by Thakuriah, Piyushimita (Vonu), Tilahun, Nebiyou, and Zellner, Moira: “… introduces the latest thinking on the use of Big Data in the context of urban systems, including  research and insights on human behavior, urban dynamics, resource use, sustainability and spatial disparities, where it promises improved planning, management and governance in the urban sectors (e.g., transportation, energy, smart cities, crime, housing, urban and regional economies, public health, public engagement, urban governance and political systems), as well as Big Data’s utility in decision-making, and development of indicators to monitor economic and social activity, and for urban sustainability, transparency, livability, social inclusion, place-making, accessibility and resilience…(More)”

We’re failing to solve the world’s ‘wicked problems.’ Here’s a better approach


 and  at the Conversation: “We live in a world burdened by large-scale problems that refuse to go away: the refugee crisis; terrorism; rising sea levels; frequent floods, droughts and wildfires; not to mention persistent inequality and violation of basic human rights across the world.

What do these problems have in common? They resist any simple solution. In policy research they are called “wicked.” This is because cause-effect relations are complex and solutions unclear; many of these problems are urgent, yet there is no central authority to solve them; their magnitude is often hard to estimate; and those trying to solve them may even contribute to causing them.

The EU refugee crisis, the topic of a recent U.N. summit, is a good example: Driven by regional conflicts and poverty, and assisted by trafficking networks, people from Africa and the Middle East continue to take enormous risks to enter EU territory by land or sea. For several years now, thousands of refugees have died on this journey each year andno solution is in sight. EU member countries continue to blame their neighbors for either taking in too many refugees or for refusing to help, while there is little shared interest and limited capacity for actually addressing the sources of the problem.

What’s the best way to effectively address these types of wicked problems?…

Facing the current refugee situation, U.N. member states got together two weeks ago to sign a declaration for a more coordinated response to the refugee crisis. Yet, critics have pointed out that the goals are too vague and the document is not legally binding. Such meetings have happened several times in the course of the EU refugee crisis – with very little outcome. In reality, “grand solutions” for large-scale problems either do not exist, or they are too vague or controversial to be of much value.

 

…A number of development experts have argued that “small wins” might be a promising alternative to tackle large-scale problems. Small wins focus on smaller-scale independent projects with attainable and measurable objectives. For example, many firms independently develop solutions to increase energy efficiency or to avoid waste. Likewise, several EU countries have looked into better ways of processing asylum applications and easing the integration of refugees.

Such small wins may not solve the entire problem – in these cases, climate change or refugee crisis – but they have tangible positive outcomes in line with longer-term goals. Also, the more countries and parties deal with the same problem, the greater the number of innovative experiments.

The only problem is: How can such small wins add up to a larger-scale sustainable solution?….

Similarly, EU countries are increasingly moving from idiosyncratic to modular solutions of refugee management and integration. For example, the German trade union organization IG Metall is currently developing connected modules of language and professional training for refugeesthat allow for faster integration into higher-skilled labor markets. These modules are designed to be transferable across industry sectors, and they serve as important foundations for more job-specific training.

Overall, modular solutions can reduce the complexity of climate adaptation and refugee integration. In developing and disseminating such solutions, intermediary organizations are very important – development agencies, standard-setters, consulting groups, NGOs, industrial relations partners….(More)”

Lessons Learned Implementing Bold Ideas


Anne Emig at Bloomberg Philanthropies: “Since 2013, hundreds of cities around the world have competed in Bloomberg Philanthropies’ Mayors Challenge by proposing bold new ideas that solve urban challenges, improve city life – and have the potential to spread….

Today, we released a report that offers important advice from the winning cities to municipalities looking to bring bold ideas to life. In summary, the lessons are:

Playing Politics:

  • The bigger and bolder the idea, the more political support is needed to make it happen. However, city administrations change, re-election campaigns can shift priorities, and political atmospherics in general are challenging. This makes it all the more important for innovators to understand the political space they are working in and try to be inclusive in forming alliances and relationships that can support their case.

Support Can Come from Anywhere: 

  • Political approval is great, but so are resources from outside government. Cities should capitalize on the energy surrounding innovative projects and bring on board a diversity of organizations and people who can offer advice, make introductions, provide funding, and advocate on behalf of the city.

Managing Internal Affairs:

  • Innovation leaders know they have to manage up – but they also must skillfully engage their peers in order to succeed. In particular, middle managers are crucial to successfully implementing bold new ideas, so their buy-in must be earned. Taking the time to create enthusiasm for a new strategy among middle managers and helping them understand how a successful rollout is not just good for end-users, but good for them and their career as well, will pay dividends in the long run.

The Right Team for the Job:

  • A team that excels in producing a framework for a bold new idea may not be the perfect team to actually implement it. Understanding the team’s strengths and weaknesses and how individuals fit together as a whole is essential to bringing an idea to life. Passionate and visionary leaders also need comrades with common sense skills who can simply get things done.

Keeping Eyes on the Prize:

  • It’s critical to create a compelling narrative that sustains the attention and enthusiasm of government workers and the public. The winning teams constantly reminded their colleagues that the day-to-day tasks and deliverables were all in pursuit of a higher and larger goal; nothing less than changing the world, if only a little at a time. It’s that kind of powerful and ambitious narrative that builds passion and brings out the best in people….(More)”

Nudge Theory in Action: Behavioral Design in Policy and Markets


Book edited by Sherzod Abdukadirov: “This collection challenges the popular but abstract concept of nudging, demonstrating the real-world application of behavioral economics in policy-making and technology. Groundbreaking and practical, it considers the existing political incentives and regulatory institutions that shape the environment in which behavioral policy-making occurs, as well as alternatives to government nudges already provided by the market. The contributions discuss the use of regulations and technology to help consumers overcome their behavioral biases and make better choices, considering the ethical questions of government and market nudges and the uncertainty inherent in designing effective nudges. Four case studies – on weight loss, energy efficiency, consumer finance, and health care – put the discussion of the efficiency of nudges into concrete, recognizable terms. A must-read for researchers studying the public policy applications of behavioral economics, this book will also appeal to practicing lawmakers and regulators…(More)”

Living in the World of Both/And


Essay by Adene Sacks & Heather McLeod Grant  in SSIR: “In 2011, New York Times data scientist Jake Porway wrote a blog post lamenting the fact that most data scientists spend their days creating apps to help users find restaurants, TV shows, or parking spots, rather than addressing complicated social issues like helping identify which teens are at risk of suicide or creating a poverty index of Africa using satellite data.

That post hit a nerve. Data scientists around the world began clamoring for opportunities to “do good with data.” Porway—at the center of this storm—began to convene these scientists and connect them to nonprofits via hackathon-style events called DataDives, designed to solve big social and environmental problems. There was so much interest, he eventually quit his day job at the Times and created the organization DataKind to steward this growing global network of data science do-gooders.

At the same time, in the same city, another movement was taking shape—#GivingTuesday, an annual global giving event fueled by social media. In just five years, #GivingTuesday has reshaped how nonprofits think about fundraising and how donors give. And yet, many don’t know that 92nd Street Y (92Y)—a 140-year-old Jewish community and cultural center in Manhattan, better known for its star-studded speaker series, summer camps, and water aerobics classes—launched it.

What do these two examples have in common? One started as a loose global network that engaged data scientists in solving problems, and then became an organization to help support the larger movement. The other started with a legacy organization, based at a single site, and catalyzed a global movement that has reshaped how we think about philanthropy. In both cases, the founding groups have incorporated the best of both organizations and networks.

Much has been written about the virtues of thinking and acting collectively to solve seemingly intractable challenges. Nonprofit leaders are being implored to put mission above brand, build networks not just programs, and prioritize collaboration over individual interests. And yet, these strategies are often in direct contradiction to the conventional wisdom of organization-building: differentiating your brand, developing unique expertise, and growing a loyal donor base.

A similar tension is emerging among network and movement leaders. These leaders spend their days steering the messy process required to connect, align, and channel the collective efforts of diverse stakeholders. It’s not always easy: Those searching to sustain movements often cite the lost momentum of the Occupy movement as a cautionary note. Increasingly, network leaders are looking at how to adapt the process, structure, and operational expertise more traditionally associated with organizations to their needs—but without co-opting or diminishing the energy and momentum of their self-organizing networks…

Welcome to the World of “Both/And”

Today’s social change leaders—be they from business, government, or nonprofits—must learn to straddle the leadership mindsets and practices of both networks and organizations, and know when to use which approach. Leaders like Porway, and Henry Timms and Asha Curran of 92Y can help show us the way.

How do these leaders work with the “both/and” mindset?

First, they understand and leverage the strengths of both organizations and networks—and anticipate their limitations. As Timms describes it, leaders need to be “bilingual” and embrace what he has called “new power.” Networks can be powerful generators of new talent or innovation around complex multi-sector challenges. It’s useful to take a network approach when innovating new ideas, mobilizing and engaging others in the work, or wanting to expand reach and scale quickly. However, networks can dissipate easily without specific “handrails,” or some structure to guide and support their work. This is where they need some help from the organizational mindset and approach.

On the flip side, organizations are good at creating centralized structures to deliver products or services, manage risk, oversee quality control, and coordinate concrete functions like communications or fundraising. However, often that efficiency and effectiveness can calcify over time, becoming a barrier to new ideas and growth opportunities. When organizational boundaries are too rigid, it is difficult to engage the outside world in ideating or mobilizing on an issue. This is when organizations need an infusion of the “network mindset.”

 

…(More)

Artificial intelligence is hard to see


Kate Crawford and Meredith Whittaker on “Why we urgently need to measure AI’s societal impacts“: “How will artificial intelligence systems change the way we live? This is a tough question: on one hand, AI tools are producing compelling advances in complex tasks, with dramatic improvements in energy consumption, audio processing, and leukemia detection. There is extraordinary potential to do much more in the future. On the other hand, AI systems are already making problematic judgements that are producing significant social, cultural, and economic impacts in people’s everyday lives.

AI and decision-support systems are embedded in a wide array of social institutions, from influencing who is released from jail to shaping the news we see. For example, Facebook’s automated content editing system recently censored the Pulitzer-prize winning image of a nine-year old girl fleeing napalm bombs during the Vietnam War. The girl is naked; to an image processing algorithm, this might appear as a simple violation of the policy against child nudity. But to human eyes, Nick Ut’s photograph, “The Terror of War”, means much more: it is an iconic portrait of the indiscriminate horror of conflict, and it has an assured place in the history of photography and international politics. The removal of the image caused an international outcry before Facebook backed down and restored the image. “What they do by removing such images, no matter what good intentions, is to redact our shared history,” said the Prime Minister of Norway, Erna Solberg.

It’s easy to forget that these high-profile instances are actually the easy cases. As Tarleton Gillespie has observed, hundreds of content reviews are occurring with Facebook images thousand of times per day, and rarely is there a Pulitzer prize to help determine lasting significance. Some of these reviews include human teams, and some do not. In this case, there is alsoconsiderable ambiguity about where the automated process ended and the human review began: which is part of the problem. And Facebook is just one player in complex ecology of algorithmically-supplemented determinations with little external monitoring to see how decisions are made or what the effects might be.

The ‘Terror of War’ case, then, is the tip of the iceberg: a rare visible instance that points to a much larger mass of unseen automated and semi-automated decisions. The concern is that most of these ‘weak AI’ systems are making decisions that don’t garner such attention. They are embedded at the back-end of systems, working at the seams of multiple data sets, with no consumer-facing interface. Their operations are mainly unknown, unseen, and with impacts that take enormous effort to detect.

Sometimes AI techniques get it right, and sometimes they get it wrong. Only rarely will those errors be seen by the public: like the Vietnam war photograph, or when a AI ‘beauty contest’ held this month was called out for being racist for selecting white women as the winners. We can dismiss this latter case as a problem of training data — they simply need a more diverse selection of faces to train their algorithm with, and now that 600,000 people have sent in their selfies, they certainly have better means to do so. But while a beauty contest might seem like a bad joke, or just a really good trick to get people to give up their photos to build a large training data set, it points to a much bigger set of problems. AI and decision-support systems are reaching into everyday life: determining who will be on a predictive policing‘heat list’, who will be hired or promoted, which students will be recruited to universities, or seeking to predict at birth who will become a criminal by the age of 18. So the stakes are high…(More)”

“Big Data Europe” addresses societal challenges with data technologies


Press Release: “Across society, from health to agriculture and transport, from energy to climate change and security, practitioners in every discipline recognise the potential of the enormous amounts of data being created every day. The challenge is to capture, manage and process that information to derive meaningful results and make a difference to people’s lives. The Big Data Europe project has just released the first public version of its open source platform designed to do just that. In 7 pilot studies, it is helping to solve societal challenges by putting cutting edge technology in the hands of experts in fields other than IT.

Although many crucial big data technologies are freely available as open source software, they are often difficult for non-experts to integrate and deploy. Big Data Europe solves that problem by providing a package that can readily be installed locally or at any scale in a cloud infrastructure by a systems administrator, and configured via a simple user interface. Tools like Apache Hadoop, Apache Spark, Apache Flink and many others can be instantiated easily….

The tools included in the platform were selected after a process of requirements-gathering across the seven societal challenges identified by the European Commission (Health, Food, Energy, Transport, Climate, Social Sciences and Security). Tasks like message passing are handled using Kafka and Flume, storage by Hive and Cassandra, or publishing through geotriples. The platform uses the Docker system to make it easy to add new tools and, again, for them to operate at a scale limited only by the computing infrastructure….

The platform can be downloaded from GitHub.
See also the installation instructions, Getting Started and video.”