book – Page 111 – The Living Library

The Curious Journalist’s Guide to Data

Curated on April 2, 2016November 14, 2018 by Stefaan Verhulst

New book by The Tow Center: “This is a book about the principles behind data journalism. Not what visualization software to use and how to scrape a website, but the fundamental ideas that underlie the human use of data. This isn’t “how to use data” but “how data works.”

This gets into some of the mathy parts of statistics, but also the difficulty of taking a census of race and the cognitive psychology of probabilities. It traces where data comes from, what journalists do with it, and where it goes after—and tries to understand the possibilities and limitations. Data journalism is as interdisciplinary as it gets, which can make it difficult to assemble all the pieces you need. This is one attempt. This is a technical book, and uses standard technical language, but all mathematical concepts are explained through pictures and examples rather than formulas.

The life of data has three parts: quantification, analysis, and communication. Quantification is the process that creates data. Analysis involves rearranging the data or combining it with other information to produce new knowledge. And none of this is useful without communicating the result.

Quantification is a problem without a home. Although physicists study measurement extensively, physical theory doesn’t say much about how to quantify things like “educational attainment” or even “unemployment.” There are deep philosophical issues here, but the most useful question to a journalist is simply, how was this data created? Data is useful because it represents the world, but we can only understand data if we correctly understand how it came to be. Representation through data is never perfect: all data has error. Randomly sampled surveys are both a powerful quantification technique and the prototype for all measurement error, so this report explains where the margin of error comes from and what it means – from first principles, using pictures.

All data analysis is really data interpretation, which requires much more than math. Data needs context to mean anything at all: Imagine if someone gave you a spreadsheet with no column names. Each data set could be the source of many different stories, and there is no objective theory that tells us which true stories are the best. But the stories still have to be true, which is where data journalism relies on established statistical principles. The theory of statistics solves several problems: accounting for the possibility that the pattern you see in the data was purely a fluke, reasoning from incomplete and conflicting information, and attempting to isolate causes. Stats has been taught as something mysterious, but it’s not. The analysis chapter centers on a single problem – asking if an earlier bar closing time really did reduce assaults in a downtown neighborhood – and traces through the entire process of analysis by explaining the statistical principles invoked at each step, building up to the state-of-the-art methods of Bayesian inference and causal graphs.

A story isn’t isn’t finished until you’ve communicated your results. Data visualization works because it relies on the biology of human visual perception, just as all data communication relies on human cognitive processing. People tend to overestimate small risks and underestimate large risks; examples leave a much stronger impression than statistics; and data about some will, unconsciously, come to represent all, no matter how well you warn that your sample doesn’t generalize. If you’re not aware of these issues you can leave people with skewed impressions or reinforce harmful stereotypes. The journalist isn’t only responsible for what they put in the story, but what ends up in the mind of the audience.

This report brings together many fields to explore where data comes from, how to analyze it, and how to communicate your results. It uses examples from journalism to explain everything from Bayesian statistics to the neurobiology of data visualization, all in plain language with lots of illustrations. Some of these ideas are thousands of years old, some were developed only a decade ago, and all of them have come together to create the 21st century practice of data journalism….(More)”

Knowledge Unbound

Curated on March 30, 2016August 3, 2018 by Stefaan Verhulst

MIT Press: “Peter Suber has been a leading advocate for open access since 2001 and has worked full time on issues of open access since 2003. As a professor of philosophy during the early days of the internet, he realized its power and potential as a medium for scholarship. As he writes now, “it was like an asteroid crash, fundamentally changing the environment, challenging dinosaurs to adapt, and challenging all of us to figure out whether we were dinosaurs.” When Suber began putting his writings and course materials online for anyone to use for any purpose, he soon experienced the benefits of that wider exposure. In 2001, he started a newsletter—the Free Online Scholarship Newsletter, which later became the SPARC Open Access Newsletter—in which he explored the implications of open access for research and scholarship. This book offers a selection of some of Suber’s most significant and influential writings on open access from 2002 to 2010.

In these texts, Suber makes the case for open access to research; answers common questions, objections, and misunderstandings; analyzes policy issues; and documents the growth and evolution of open access during its most critical early decade. (Free Download)”

Data Mining Reveals the Four Urban Conditions That Create Vibrant City Life

Curated on March 25, 2016August 3, 2018 by Stefaan Verhulst

Emerging Technology from the arXiv: “Lack of evidence to city planning has ruined cities all over the world. But data-mining techniques are finally revealing the rules that make cities successful, vibrant places to live. …Back in 1961, the gradual decline of many city centers in the U.S. began to puzzle urban planners and activists alike. One of them, the urban sociologist Jane Jacobs, began a widespread and detailed investigation of the causes and published her conclusions in The Death and Life of Great American Cities, a controversial book that proposed four conditions that are essential for vibrant city life.

Jacobs’s conclusions have become hugely influential. Her ideas have had a significant impact on the development of many modern cities such as Toronto and New York City’s Greenwich Village. However, her ideas have also attracted criticism because of the lack of empirical evidence to back them up, a problem that is widespread in urban planning.
Today, that looks set to change thanks to the work of Marco De Nadai at the University of Trento and a few pals, who have developed a way to gather urban data that they use to test Jacobs’s conditions and how they relate to the vitality of city life. The new approach heralds a new age of city planning in which planners have an objective way of assessing city life and working out how it can be improved.
In her book, Jacobs argues that vibrant activity can only flourish in cities when the physical environment is diverse. This diversity, she says, requires four conditions. The first is that city districts must serve more than two functions so that they attract people with different purposes at different times of the day and night. Second, city blocks must be small with dense intersections that give pedestrians many opportunities to interact. The third condition is that buildings must be diverse in terms of age and form to support a mix of low-rent and high-rent tenants. By contrast, an area with exclusively new buildings can only attract businesses and tenants wealthy enough to support the cost of new building. Finally, a district must have a sufficient density of people and buildings.

While Jacobs’s arguments are persuasive, her critics say there is little evidence to show that these factors are linked with vibrant city life. That changed last year when urban scientists in Seoul, South Korea, published the result of a 10-year study of pedestrian activity in the city at unprecedented resolution. This work successfully tested Jacobs’s ideas for the first time.
However, the data was gathered largely through pedestrian surveys, a process that is time-consuming, costly, and generally impractical for use in most modern cities.
De Nadai and co have come up with a much cheaper and quicker alternative using a new generation of city databases and the way people use social media and mobile phones. The new databases include OpenStreetMap, the collaborative mapping tool; census data, which records populations and building use; land use data, which uses satellite images to classify land use according to various categories; Foursquare data, which records geographic details about personal activity; and mobile-phone records showing the number and frequency of calls in an area.
De Nadai and co gathered this data for six cities in Italy—Rome, Naples, Florence, Bologna, Milan, and Palermo.
Their analysis is straightforward. The team used mobile-phone activity as a measure of urban vitality and land-use records, census data, and Foursquare activity as a measure of urban diversity. Their goal was to see how vitality and diversity are correlated in the cities they studied. The results make for interesting reading….(More)

Crowdsourced Health

Curated on March 24, 2016August 3, 2018 by Stefaan Verhulst

Book by Elad Yom-Tov: “Most of us have gone online to search for information about health. What are the symptoms of a migraine? How effective is this drug? Where can I find more resources for cancer patients? Could I have an STD? Am I fat? A Pew survey reports more than 80 percent of American Internet users have logged on to ask questions like these. But what if the digital traces left by our searches could show doctors and medical researchers something new and interesting? What if the data generated by our searches could reveal information about health that would be difficult to gather in other ways? In this book, Elad Yom-Tov argues that Internet data could change the way medical research is done, supplementing traditional tools to provide insights not otherwise available. He describes how studies of Internet searches have, among other things, already helped researchers track to side effects of prescription drugs, to understand the information needs of cancer patients and their families, and to recognize some of the causes of anorexia.

Yom-Tov shows that the information collected can benefit humanity without sacrificing individual privacy. He explains why people go to the Internet with health questions; for one thing, it seems to be a safe place to ask anonymously about such matters as obesity, sex, and pregnancy. He describes in detrimental effects of “pro-anorexia” online content; tells how computer scientists can scour search engine data to improve public health by, for example, identifying risk factors for disease and centers of contagion; and tells how analyses of how people deal with upsetting diagnoses help doctors to treat patients and patients to understand their conditions….(More)

On-demand service could be Uber for blood collection

Curated on March 23, 2016August 3, 2018 by Stefaan Verhulst

Springwise: Collecting blood for clinical and medical testing can be an arduous process, involving lots of travel, with the added annoyance of patients not turning up to appointments, and time wasted with doctors and phlebotomists.

But now a new phlebotomy service, Iggbo, is looking to change that. Blood collectors can become a freelancer with the new on-demand app; rather than employing a full-time phlebotomist, doctors can use the app to employ a freelancer who is paid per donation collected. The phlebotomists can collect donations at home, rather than having patients wait around for someone to take their blood.

Physicians can book clinical blood donations and Iggbo sends out the request via its smartphone app to its freelance phlebotomists. Iggbo also sends a number of reminders using text and email to ensure patients remember their appointments, and helps to book a new phlebotomist if something falls through.

The app even features an Uber-like ratings system, and Iggbo says it carefully vets all its collectors to ensure the service is safe and efficient. The company says the service will improve the efficiency of the healthcare system for blood testing and collection, and in doing so reduce overall costs….(More)”

“Streetfight” by Janette Sadik-Khan

Curated on March 23, 2016August 3, 2018 by Stefaan Verhulst

Review by Amrita Gupta in Policy Innovations of the book Streetfight: “Janette Sadik-Khan was New York City’s transportation commissioner from 2007-2013. Under her watch, the city’s streets were reimagined and redesigned to include more than 60 plazas and 400 miles of bike lanes—radical changes designed to improve traffic and make spaces safer for everybody. Over seven years, New York City underwent a transportation transformation, played out avenue by avenue, block by block. Times Square went from being the city’s worst traffic nightmare to a two-and-a-half acre outdoor sitting area in 2009. Citi Bike, arguably her biggest success, is the nation’s largest bike share system, and the city’s first new transit system in over half a century. In Streetfight, Sadik-Khan breaks down her achievements into replicable ideas for urban planners and traffic engineers everywhere, and she also reminds us that the fight isn’t over. As part of Bloomberg Associates, she now takes the lessons from New York City’s streets to metropolises around the world.

The old order vs the new order

The crux of the problem, she explains, is that until recently, cities of the future were thought to be cities built for cars, not cities that encouraged human activity on the street.

Understanding what city-building used to mean is key to understanding how our cities are failing us today. Sadik-Khan offers a quick recap of New York City through recent decades. The historical lesson holds; in many ways, cities in every continent grew along a similar trajectory. Streets were designed to keep traffic moving, but not to support the life alongside it. The old order—which Sadik-Khan writes is typified by Robert Moses—took the auto-centric view that pedestrians, public transit, and bike riders were all hindrances in the path of cars.

Sadik-Khan calls for a more equitable and relevant city, one that prioritizes accessibility and convenience for everybody. Her generation of planners aims to transform roads, tunnels, and rail tracks—the legacy hardware of their predecessors—and repurpose them into public spaces to walk, bike, and play.

The strength of the book lies in just how effectively it dispels the misconceptions that most citizens, and indeed, urban planners, have held onto for decades. There are plenty of surprises in Streetfight.

Sadik-Khan shows that people’s ideas about safety can be obsolete. For instance, bike lanes don’t make accidents more likely, they make the streets safer. The statistics show that bike riders actually protect pedestrians by altering the behavior of drivers. Sadik-Khan states that bike ridership in New York City quadrupled from 2000-2012; and as the number of riders increases, so too does the safety of the street.

The assumption, for instance, that reducing lanes or closing them entirely creates gridlock, is entirely wrong. Sadik-Khan’s interventions in New York City —providing pedestrian space and creating fewer but more orderly lanes for vehicles—actually improved traffic. And she uses taxi GPS data to prove it….

In fact, Sadik-Khan makes the claim that the economic power of sustainable streets is probably one of the strongest arguments for implementing dramatic change. Cities need data—think retail rents, shop sales, travel speeds, vehicle counts—to defend their interventions, and then to measure their effectiveness. Yet, she writes, unfortunately there are few cities anywhere that have access to reliable numbers of this kind….

Sadik-Khan emphasizes time and again that change can happen quickly and affordably. She didn’t have to bulldoze neighborhoods, or build new bridges and highways to transform the transportation network of New York City. Planners can reorder a street without destroying a single building.

Streetfight is a handbook that prioritizes paint, planters, signs, and signals over mega-infrastructure projects. We are told that small-scale interventions can have transformative large-scale impacts. Sadik-Khan’s pocket parks, plazas, pedestrian-friendly road redesigns, and parking-protected bike lanes are all the proof we need. For planners in developing countries, this should serve as both guide and encouragement.

Innovation doesn’t need big dollars behind it to be effective, and most ideas are scalable for cities big and small. What it does need, however, is street smarts. Sadik-Khan makes it clear that the key to getting projects to move ahead is support on the ground, and enough political capital to pave the way. Planners everywhere need to encourage participation, invite ideas, and be more transparent about proposals, she writes. But they also need to be willing to put up a fight….(More)”

Participatory Budgeting

Curated on March 15, 2016August 3, 2018 by Stefaan Verhulst

Participatory Budgeting in Europe: Democracy and public governance by Yves Sintomer, Anja Röcke, and Carsten Herzberg: “Can participatory budgeting help make public services really work for the public? Incorporating a range of experiments in ten different countries, this book provides the first comprehensive analysis of participatory budgeting in Europe and the effect it has had on democracy, the modernization of local government, social justice, gender mainstreaming and sustainable development. By focussing on the first decade of European participatory budgeting and analysing the results and the challenges affecting the agenda today it provides a critical appraisal of the participatory model. Detailed comparisons of European cases expose similarities and differences between political cultures and offer a strong empirical basis to discuss the theories of deliberative and participatory democracy and reveal contradictory tendencies between political systems, public administrations and democratic practices. (More)”

Participatory Budgeting in the United States: A Guide for Local Governments by Victoria Gordon, Jeffery L. Osgood, Jr., and Daniel Boden : “Although citizen engagement is a core public service value, few public administrators receive training on how to share leadership with people outside the government. Participatory Budgeting in the United States serves as a primer for those looking to understand a classic example of participatory governance, engaging local citizens in examining budgetary constraints and priorities before making recommendations to local government. Utilizing case studies and an original set of interviews with community members, elected officials, and city employees, this book provides a rare window onto the participatory budgeting process through the words and experiences of the very individuals involved. The central themes that emerge from these fascinating and detailed cases focus on three core areas: creating the participatory budgeting infrastructure; increasing citizen participation in participatory budgeting; and assessing and increasing the impact of participatory budgeting. This book provides students, local government elected officials, practitioners, and citizens with a comprehensive understanding of participatory budgeting and straightforward guidelines to enhance the process of civic engagement and democratic values in local communities….(More)