A Visual Introduction to Machine Learning


R2D3 introduction: “In machine learning, computers apply statistical learning techniques to automatically identify patterns in data. These techniques can be used to make highly accurate predictions.

Keep scrolling. Using a data set about homes, we will create a machine learning model to distinguish homes in New York from homes in San Francisco…./

 

  1. Machine learning identifies patterns using statistical learning and computers by unearthing boundaries in data sets. You can use it to make predictions.
  2. One method for making predictions is called a decision trees, which uses a series of if-then statements to identify boundaries and define patterns in the data
  3. Overfitting happens when some boundaries are based on on distinctions that don’t make a difference. You can see if a model overfits by having test data flow through the model….(More)”

Accur8Africa


Accur8Africa aims to be the leading platform supporting the accuracy of data in the continent. If we intend to meet the Sustainable Development Goals (SDGs) in the next fifteen years, accurate data remains a non-negotiable necessity. Accur8Africa recognizes that nothing less than a data revolution is required. To achieve this we are building the statistical capacity of institutions across Africa and encouraging the use of data-driven decisions alongside better development metrics for key sectors such as gender equality, climate change, equity and social inclusion and health.

Africa has data in abundance but it exists in a fragmented and disorganized manner. As a result, the achievements of the Millennium Development Goals will be largely unquantifiable. As we transition from the MDG’s to the Sustainable Development Goals, and national governments meet to discuss the 17 goals that could transform the world by 2030, we believe that the African Continent deserves better and more accurate data…..Africa has a great role to play in the next fifteen years. The United Nations development agenda has generated momentum for a worldwide “data revolution,” shining a much-needed light on the need for better development data in Africa and elsewhere. Governments, international institutions, and donors need accurate data on basic development metrics such as inflation, vaccination coverage, and school enrolment in order to accurately plan, budget, and evaluate their activities. Governments, citizens, and civil society can then use this data as a “currency” for accountability. When statistical systems function properly, good-quality data are exchanged freely amongst all stakeholders ensuring that funding and development efforts are producing the desired results….(More)”

Urban Informatics


Special issue of Data Engineering: “Most data related to people and the built world originates in urban settings. There is increasing demand to capture and exploit this data to support efforts in areas such as Smart Cities, City Science and Intelligent Transportation Systems. Urban informatics deals with the collection, organization, dissemination and analysis of urban information used in such applications. However, the dramatic growth in the volume of this urban data creates challenges for existing data-management and analysis techniques. The collected data is also increasingly diverse, with a wide variety of sensor, GIS, imagery and graph data arising in cities. To address these challenges, urban informatics requires development of advanced data-management approaches, analysis methods, and visualization techniques. It also provides an opportunity to confront the “Variety” axis of Big Data head on. The contributions in this issue cross the spectrum of urban information, from its origin, to archiving and retrieval, to analysis and visualization. …

Collaborative Sensing for Urban Transportation (By Sergio Ilarri, et al)

Open Civic Data: Of the People, For the People, By the People (by Arnaud Sahuguet, et al, The GovLab)

Plenario: An Open Data Discovery and Exploration Platform for Urban Science (by Charlie Catlett et al)

Riding from Urban Data to Insight Using New York City Taxis (by Juliana Freire et al)…(More)”

 

Ethics Experts as an Instrument of Technocratic Governance


Article by Annabelle Littoz-Monnet examining EU Medical Biotechnology Policy in Governance: “This article challenges the assumption that ethics committees introduce democratic control in policy areas where scientific expertise and ethical concerns collide. The claim is that politicians or bureaucrats are likely to resort to the use of ethical expertise when they face a specific type of dilemma: the impossibility, on the one hand, of yielding a consensus on controversial value-based issues via the democratic route and the need, on the other, to legitimize controversial policy choices in these areas. The article examines this dynamic with regard to the European Union’s medical biotechnology policy, a contested policy domain where ethical specialists are awarded expert status. The article finds that establishing ethical experts as a new category of expertise alongside scientific experts actually bolsters the technocratic domain in areas where it is contested, thus reinforcing the authority of experts and bureaucrats in the policy process, rather than democratic control….(More)”

Transparency in Social Media


New book on “Tools, Methods and Algorithms for Mediating Online Interactions” edited by Matei, Sorin; Adam; Russell Martha G.: and Bertino, Elisa (Eds.): “The volume presents, in a synergistic manner, significant theoretical and practical contributions in the area of social media reputation and authorship measurement, visualization, and modeling. The book justifies and proposes contributions to a future agenda for understanding the requirements for making social media authorship more transparent. Building on work presented in a previous volume of this series, Roles, Trust, and Reputation in Social Media Knowledge Markets, this book discusses new tools, applications, services, and algorithms that are needed for authoring content in a real-time publishing world. These insights may help people who interact and create content through social media better assess their potential for knowledge creation. They may also assist in analyzing audience attitudes, perceptions, and behavior in informal social media or in formal organizational structures. In addition, the volume includes several chapters that analyze the higher order ethical, critical thinking, and philosophical principles that may be used to ground social media authorship. Together, the perspectives presented in this volume help us understand how social media content is created and how its impact can be evaluated.

The chapters demonstrate thought leadership through new ways of constructing social media experiences and making traces of social interaction visible. Transparency in Social Media aims to help researchers and practitioners design services, tools, or methods of analysis that encourage a more transparent process of interaction and communication on social media. Knowing who has added what content and with what authority to a specific online social media project can help the user community better understand, evaluate and make decisions and, ultimately, act on the basis of such information …(More)”

Breaking Smart


Breaking Smart is a technology analysis site. We aim to produce a binge-worthy collection of essays approximately once every 2 years. Season 1, comprising 20 essays totaling approximately 30,000 words, is written by Venkatesh Rao and illustrated by Grace Witherell. This inaugural season is an in-depth exploration of Marc Andreessen’s observation that “software is eating the world.” Season 2 (due out in 2017) is currently under development…..

Unpacking Civic Tech – Inside and Outside of Government


David Moore at Participatory Politics Foundation: “…I’ll argue it’s important to unpack the big-tent term “civic tech” to at least five major component areas, overlapping in practice & flexible of course – in order to more clearly understand what we have and what we need:

  • Responsive & efficient city services (e.g., SeeClickFix)
  • Open data portals & open government data publishing / visualization (Socrata, OpenGov.com)
  • Engagement platforms for government entities (Mindmixer aka Sidewalk)
  • Community-focused organizing services (Change, NextDoor, Brigade- these could validly be split, as NextDoor is of course place-based IRL)
  • Geo-based services & open mapping data (e.g.. Civic Insight)

More precisely, instead of “civic tech”, the term #GovTech can be productively applied to companies whose primary business model is vending to government entities – some #govtech is #opendata, some is civic #engagement, and that’s healthy & brilliant. But it doesn’t make sense to me to conflate as “civic tech” both government software vendors and the open-data work of good-government watchdogs. Another framework for understanding the inside / outside relationship to government, in company incorporation strategies & priorities, is broadly as follows:

  • tech entirely-outside government (such as OpenCongress or OpenStates);
  • tech mostly-outside government, where some elected officials volunteer to participate (such as AskThem, Councilmatic, DemocracyOS, or Change Decision Makers);
  • tech mostly-inside government, paid-for-by-government (such as Mindmixer or SpeakUp or OpenTownHall) where elected officials or gov’t staff sets the priorities, with the strong expectation of an official response;
  • deep legacy tech inside government, the enterprise vendors of closed-off CRM software to Congressional offices (including major defense contractors!).

These are the websites up and running today in the civic tech ecosystem – surveying them, I see there’s a lot of work still to do on developing advanced metrics towards thicker civic engagement. Towards evaluating whether the existing tools are having the impact we hope and expect them to at their level of capitalization, and to better contextualize the role of very-small non-profit alternatives….

One question to study is whether the highest-capitalized U.S. civic tech companies (Change, NextDoor, Mindmixer, Socrata, possibly Brigade) – which also generally have most users – are meeting ROI on continual engagement within communities.

  • If it’s a priority metric for users of a service to attend a community meeting, for example, are NextDoor or Mindmixer having expected impact?
  • How about metrics on return participation, joining an advocacy group, attending a district meeting with their U.S. reps, organizing peer-to-peer with neighbors?
  • How about writing or annotating their own legislation at the city level, introducing it for an official hearing, and moving it up the chain of government to state and even federal levels for consideration? What actual new popular public policies or systemic reforms are being carefully, collaboratively passed?
  • Do less-capitalized, community-based non-profits (AskThem, 596 Acres, OpenPlans’ much-missed Shareabouts, CKAN data portals, LittleSis, BeNeighbors, PBNYC tools) – with less scale, but with more open-source, open-data tools that can be remixed – improve on the tough metric of ROI on continual engagement or research-impact in the news?…(More)

Data Ethics in the Age of the Quantified Self


Video of Aspen Ideas Festival Session on Data Ethics: “Leading thinkers from business, government, civil society, and academia explore and debate ethics in the age of the quantified society. What role do ethics play in guiding existing efforts to develop and deploy data and information technologies? Does data ethics need to develop as a field to help guide policy, research, and practice — just as bioethics did in order to guide medicine and biology? Why or why not? Speakers:Kate Crawford, Jonathan Zittrain, Ashkan Soltani,Alexis Madrigal….

(More)”

The Causes, Costs and Consequences of Bad Government Data


Katherine Barrett & Richard Greene in Governing: “Data is the lifeblood of state government. It’s the crucial commodity that’s necessary to manage projects, avoid fraud, assess program performance, keep the books in balance and deliver services efficiently. But even as the trend toward greater reliance on data has accelerated over the past decades, the information itself has fallen dangerously short of the mark. Sometimes it doesn’t exist at all. But worse than that, all too often it’s just wrong.

There are examples everywhere. Last year, the California auditor’s office issued a report that looked at accounting records at the State Controller’s Office to see whether it was accurately recording sick leave and vacation credits. “We found circumstances where instead of eight hours, it was 80 and in one case, 800,” says Elaine Howle, the California state auditor. “And the system didn’t have controls to say that’s impossible.” The audit found 200,000 questionable hours of leave due to data entry errors, with a value of $6 million.

Mistakes like that are embarrassing, and can lead to unequal treatment of valued employees. Sometimes, however, decisions made with bad data can have deeper consequences. In 2012, the secretary of environmental protection in Pennsylvania told Congress that there was no evidence the state’s water quality had been affected by fracking. “Tens of thousands of wells have been hydraulically fractured in Pennsylvania,” he said, “without any indication that groundwater quality has been impacted.”

But by August 2014, the same department published a list of 248 incidents of damage to well water due to gas development. Why didn’t the department pick up on the water problems sooner? A key reason was that the data collected by its six regional offices had not been forwarded to the central office. At the same time, the regions differed greatly in how they collected, stored, transmitted and dealt with the information. An audit concluded that Pennsylvania’s complaint tracking system for water quality was ineffective and failed to provide “reliable information to effectively manage the program.”

When data is flawed, the consequences can reach throughout the entire government enterprise. Services are needlessly duplicated; evaluation of successful programs is difficult; tax dollars go uncollected; infrastructure maintenance is conducted inefficiently; health-care dollars are wasted. The list goes on and on. Increasingly, states are becoming aware of just how serious the problem is. “The poor quality of government data,” says Dave Yost, Ohio’s state auditor, “is probably the most important emerging trend for government executives, across the board, at all levels.”

Just how widespread a problem is data quality? In aGoverning telephone survey with more than 75 officials in 46 states, about 7 out of 10 said that data problems were frequently or often an impediment to doing their business effectively. No one who worked with program data said this was rarely the case. (View the full results of the survey in this infographic.)…(More)

See also: Bad Data Is at All Levels of Government and The Next Big Thing in Data Analytics

Deliberation and Development : Rethinking the Role of Voice and Collective Action in Unequal Societies


Book by Patrick Heller and Vijayendra Rao for the Worldbank: “Deliberation is the process by which a group of people, each with equal voice, can – via a process of discussion and debate – reach an agreement. This book attempts to do two things. First, it rethinks the role of deliberation in development and shows that it has potential well beyond a narrow focus on participatory projects. Deliberation, if properly instituted, has the potential to have a transformative effect on many if not all aspects of development, and especially in addressing problems of collective action, coordination, and entrenched inequality. This has broad implications both at the global and local level. Second, the book demonstrates that taking deliberation seriously calls for a different approach to both research and policy design and requires a much greater emphasis on the processes by which decisions are made, rather than an exclusive focus on the outcomes. Deliberation and Development contributes to a broader literature to understand the role of communicative processes in development….(More)