How Open Data Can Revolutionize a Society in Crisis

Curated on Posted on by Stefaan Verhulst

Beth Noveck at BrinkNews:”…These myriad open data success stories, however, depend on the political will to be transparent and collaborative. There is a looming risk that governments will only post what is expedient and noncontroversial while seeking recognition for their proactive disclosure—a practice increasingly referred to as “open-washing.” Governments of all political stripes refuse to disclose data when they should. The data to be found on government websites is not always the information most in demand by journalists, activists, and researchers.

Especially as political administrations turnover, there is a risk that change will result in a failure to collect and publish important data. These practices will be subject to the vagaries of politics.

The genie should not, however, be put back in the bottle.

Open data appeals to both right and left politically: the former sees open data as a pathway to smaller, more efficient government and the latter sees open data as a tool to pursue more effective social programs. The bipartisan interest in evidence-based approaches to governing should fuel greater demand for access to administrative information of all kinds—including the data that agencies collect about companies, workplaces, the environment, and the world beyond government.

Government data should be open in part because of the ill-effects of secrecy, but also because taxpayers have paid for the collection of this data by government in its role as regulator and researcher.

It is a pragmatic tool to make government and companies more accountable at solving social problems and to help communities make better informed buying decisions. It helps create jobs and generate entrepreneurship. Perhaps of paramount importance, open data can advance civil rights and help us to govern more legitimately and effectively….(More).

Open Data Maturity in Europe 2016

Curated on Posted on by Stefaan Verhulst

European Data Portal Report: “…the second in a series of annual studies and explores the level of Open Data Maturity in the EU28 and Norway, Switzerland and Liechtenstein – referred to as EU28+. The measurement is built on two key indicators Open Data Readiness and Portal Maturity, thereby covering the level of development of national activities promoting Open Data as well as the level of development of national portals. In 2016, with a 28.6% increase compared to 2015, the EU28+ countries completed over 55% of their Open Data journey showing that, by 2016, a majority of the EU28+ countries have successfully developed a basic approach to address Open Data. The Portal Maturity level increased by 22.6 percentage points from 41.7% to 64.3% thanks to the development of more advanced features on country data portals. The overall Open Data Maturity groups countries into different clusters: Beginners, Followers, Fast Trackers and Trend Setters. Barriers do remain to move Open Data forward. The report concludes on a series of recommendations, providing countries with guidance to further improve Open Data maturity. Countries need to raise more (political) awareness around Open Data, increase automated processes on their portals to increase usability and re-usability of data, and organise more events and trainings to support both local and national initiatives….(More)”.

Technology and the Voluntary Sector: Don’t (always) Believe the Hype

Curated on Posted on by Stefaan Verhulst

Gareth Lloyd at the NCVO: “One of the most important questions for voluntary sector organisations of all sizes is how their work can be supported by technology. We have talked before about how the sector needs to identify technology that is replicable and has low barriers to uptake, but we have also recently carried out a research project with Tata Consultacy Services on this issue, which involved an evidence review, mapping exercise and workshop with voluntary sector experts.

Here’s a brief overview of what we learned, including the different challenges for large and small organisations; as well as those that apply to everyone.

Grand ambitions

First, our work looked at the attraction – and possible dangers of – investing in new and largely unproven technologies. We have seen the voluntary sector undergo fleeting love affairs with new and exciting types of technology, such as big data, crowdfunding and bitcoin; and we go through periods of hearing about technologies that have the potential to change the way that the sector works…..

Defining problems and choosing solutions

For all the challenges mentioned so far, the underlying issue is the same: a mismatch between the problem to be solved and the solution implemented. The answer is to focus on the problem that you’re trying to solve, whether approaching it as a technology issue or not, and then look at the ways that technology can help you. For example, Jointly – the app developed by Carers UK to enable conversation between groups of carers – stands out as a problem that could have been addressed without use of technology, but was eventually enhanced by it.

But organisations also have to ensure that the technology used to solve those problems is cost effective, time effective, and appropriate for them in terms of where they are starting from. If the solution you choose is tying you up in knots, maybe it isn’t a solution at all.

Our research came up with some high level principles that organisations can use to avoid these problems, and try to ensure that adopting technology transforms the day-to-day activities of organisations while minimising disruption…

Think iterations, rather than discrete projects

Participants at our workshop talked about how the discrete project model doesn’t quite work when trying to embed technology at an organisation. That is, rather than these projects having straightforward planning and implementation phases, they need to be introduced iteratively, as an ongoing process of deployment, evaluation and redesign. Introducing technology in this way minimises risk, helps to ensure that the solution fits the problem, and ensures that it is tailored to the needs of the people who will use it on a day to day basis.

If you are interested in this research you can read the executive summary here, the full slide deck here, or find details of the Spark Salon event where it was launched here….(More)”

Prediction and Inference from Social Networks and Social Media

Curated on Posted on by Stefaan Verhulst

Book edited by Kawash, Jalal, Agarwal, Nitin, Özyer, Tansel: “This book addresses the challenges of social network and social media analysis in terms of prediction and inference. The chapters collected here tackle these issues by proposing new analysis methods and by examining mining methods for the vast amount of social content produced. Social Networks (SNs) have become an integral part of our lives; they are used for leisure, business, government, medical, educational purposes and have attracted billions of users. The challenges that stem from this wide adoption of SNs are vast. These include generating realistic social network topologies, awareness of user activities, topic and trend generation, estimation of user attributes from their social content, and behavior detection. This text has applications to widely used platforms such as Twitter and Facebook and appeals to students, researchers, and professionals in the field….(More)”

Book-Smart, Not Street-Smart: Blockchain-Based Smart Contracts and The Social Workings of Law

Curated on Posted on by Stefaan Verhulst

Paper by Karen E. C. Levy: “…critiques blockchain-based “smart contracts,” which aim to automatically and securely execute obligations without reliance on a centralized enforcement authority. Though smart contracts do have some features that might serve the goals of social justice and fairness, I suggest that they are based on a thin conception of what law does, and how it does it. Smart contracts focus on the technical form of contract to the exclusion of the social contexts within which contracts operate, and the complex ways in which people use them. In the real world, contractual obligations are enforced through all kinds of social mechanisms other than formal adjudication—and contracts serve many functions that are not explicitly legal in nature, or even designed to be formally enforced. I describe three categories of contracting practices in which people engage (the inclusion of facially unenforceable terms, the inclusion of purposefully underspecified terms, and willful nonenforcement of enforceable terms) to illustrate how contracts actually “work.” The technology of smart contracts neglects the fact that people use contracts as social resources to manage their relations. The inflexibility that they introduce, by design, might short-circuit a number of social uses to which law is routinely put. Therefore, I suggest that attention to the social and relational contexts of contracting are essential considerations for the discussion, development, and deployment of smart contracts….(More)”

The law is adapting to a software-driven world

Curated on Posted on by Stefaan Verhulst

Andrew Burt in the Financial Times: “When the investor Marc Andreessen wrote in 2011 that “software is eating the world,” his point was a contentious one. He argued that the boundary between technology companies and the rest of industry was becoming blurred, and that the “information economy” would supplant the physical economy in ways that were not entirely obvious. Six years later, software’s dominance is a fact of life. What it has yet to eat, however, is the law. If almost every sector of society has been exposed to the headwinds of the digital revolution, governments and the legal profession have not. But that is about to change. The rise of complex software systems has led to new legal challenges. Take, for example, the artificial intelligence systems used in self-driving cars. Last year, the US Department of Transportation wrote to Google stating that the government would “interpret ‘driver’ in the context of Google’s described motor-vehicle design” as referring to the car’s artificial intelligence. So what does this mean for the future of law?

It means that regulations traditionally meant to govern the way that humans interact are adapting to a world that has been eaten by software, as Mr Andreessen predicted. And this is about much more than self-driving cars. Complex algorithms are used in mortgage and credit decisions, in the criminal justice and immigration systems and in the realm of national security, to name just a few areas. The outcome of this shift is unlikely to be more lawyers writing more memos. Rather, new laws will start to become more like software — embedded within applications as computer code. As technology evolves, interpreting the law itself will become more like programming software.

But there is more to this shift than technology alone. The fact is that law is both deeply opaque and unevenly accessible. The legal advice required to understand both what our governments are doing, and what our rights are, is only accessible to a select few. Studies suggest, for example, that an estimated 80 per cent of the legal needs of the poor in the US go unmet. To the average citizen, the inner workings of government have become more impenetrable over time. Granted, laws have been murky to average citizens for as long as governments have been around. But the level of disenchantment with institutions and the experts who run them is placing new pressures on governments to change their ways. The relationship between citizens and professionals — from lawyers to bureaucrats to climatologists — has become tinged with scepticism and suspicion. This mistrust is driven by the sense that society is stacked against those at the bottom — that knowledge is power, but that power costs money only a few can afford….(More)”.

Standard Business Reporting: Open Data to Cut Compliance Costs

Curated on Posted on by Stefaan Verhulst

Report by the Data Foundation: “Imagine if U.S. companies’ compliance costs could be reduced, by billions of dollars. Imagine if this could happen without sacrificing any transparency to investors and governments. Open data can make that possible.

This first-ever research report, co-published by the Data Foundation and PwC, explains how Standard Business Reporting (SBR), in which multiple regulatory agencies adopt a common open data structure for the information they collect, reduces costs for both companies and agencies.

SBR programs are in place in the Netherlands, Australia, and elsewhere – but the concept is unknown in the United States. Our report is intended to introduce SBR to U.S. policymakers and lay the groundwork for future change….(More)”.

Big Data and the Well-Being of Women and Girls: Applications on the Social Scientific Frontier

Curated on Posted on by Stefaan Verhulst

Report by Bapu Vaitla et al for Data2X: “Conventional forms of data—household surveys, national economic accounts, institutional records, and so on—struggle to capture detailed information on the lives of women and girls. The many forms of big data, from geospatial information to digital transaction logs to records of internet activity, can help close the global gender data gap. This report profiles several big data projects that quantify the economic, social, and health status of women and girls…

This report illustrates the potential of big data in filling the global gender data gap. The rise of big data, however, does not mean that traditional sources of data will become less important. On the contrary, the successful implementation of big data approaches requires investment in proven methods of social scientific research, especially for validation and bias correction of big datasets. More broadly, the invisibility of women and girls in national and international data systems is a political, not solely a technical, problem. In the best case, the current “data revolution” will be reimagined as a step towards better “data governance”: a process through which novel types of information catalyze the creation of new partnerships to advocate for scientific, policy, and political reforms that include women and girls in all spheres of social and economic life….(More)”.

Innovations in Federal Statistics: Combining Data Sources While Protecting Privacy

Curated on Posted on by Stefaan Verhulst

Report by the National Academies of Sciences’s Panel on Improving Federal Statistics for Policy and Social Science: “Federal government statistics provide critical information to the country and serve a key role in a democracy. For decades, sample surveys with instruments carefully designed for particular data needs have been one of the primary methods for collecting data for federal statistics. However, the costs of conducting such surveys have been increasing while response rates have been declining, and many surveys are not able to fulfill growing demands for more timely information and for more detailed information at state and local levels.

Innovations in Federal Statistics examines the opportunities and risks of using government administrative and private sector data sources to foster a paradigm shift in federal statistical programs that would combine diverse data sources in a secure manner to enhance federal statistics. This first publication of a two-part series discusses the challenges faced by the federal statistical system and the foundational elements needed for a new paradigm….(More)”