Who is “Public” Data Really For?

Curated on Posted on by Stefaan Verhulst

Jer Thorp at Literary Hub: “Public” is a word that has, in the last decade, become bound tightly to data. Loosely defined, any data that is available in the public domain falls into this category, but the term is most often used to describe data that might serve some kind of civic purpose: census data or environmental data or health data, along with transparency-focused data like government budgets and reports. Often sidled up to “public” is the word “open.” Although the Venn diagram between the two words has ample overlap (public data is often open, and vice versa), the word “open” typically refers to if and how the data is accessible, rather than toward what ends it might be put to use.

Both words—“public” and “open”—invite a question: For whom? Despite the efforts of Mae and Gareth, and Tom Grundner and many others, the internet as it exists is hardly a public space. Many people still find themselves excluded from full participation. Access to anything posted on a city web page or on a .gov domain is restricted by barriers of cost and technical ability. Getting this data can be particularly hard for communities that are already marginalized, and both barriers—financial and technical—can be nearly impassable in places with limited resources and literacies.

Data.gov, the United States’ “open data portal,” lists nearly 250,000 data sets, an apparent bounty of free information. Spend some time on data.gov and other portals, though, and you’ll find out that public data as it exists is messy and often confusing. Many hosted “data sets” are links to URLs that are no longer active. Trying to access data about Native American communities from the American Community Survey on data.gov brought me first to a census site with an unlabeled list of file folders. Downloading a zip file and unpacking it resulted in 64,086 cryptically named text files each containing zero kilobytes of data. As someone who has spent much of the last decade working with these kinds of data, I can tell you that this is not an uncommon experience. All too often, working with public data feels like assembling particularly complicated Ikea furniture with no tools, no instructions, and an unknown number of missing pieces.

Today’s public data serves a particular type of person and a specific type of purpose. Mostly, it supports technically adept entrepreneurs. Civic data initiatives haven’t been shy about this; on data.gov’s impact page you’ll find a kind of hall-of-fame list of companies that are “public data success stories”: Kayak, Trulia, Foursquare, LinkedIn, Realtor.com, Zillow, Zocdoc, AccuWeather, Carfax. All of these corporations have, in some fashion, built profit models around public data, often charging for access to the very information that the state touts as “accessible, discoverable, and usable.”…(More)”.

Why Aren’t Text Message Interventions Designed to Boost College Success Working at Scale?

Curated on Posted on by Stefaan Verhulst

Article by Ben Castleman: “I like to think of it as my Mark Zuckerberg moment: I was a graduate student and it was a sweltering summer evening in Cambridge. Text messages were slated to go out to recent high school graduates in Massachusetts and Texas. Knowing that thousands of phones would soon start chirping and vibrating with information about college, I refreshed my screen every 30 seconds, waiting to see engagement statistics on how students would respond. Within a few minutes there were dozens of new responses from students wanting to connect with an advisor to discuss their college plans.

We’re approaching the tenth anniversary of that first text-based advising campaign to reduce summer melt—when students have been accepted to and plan to attend college upon graduating high school, but do not start college in the fall. The now-ubiquity of businesses sending texts makes it hard to remember how innovative texting as a channel was; back in the early 2010s, text was primarily used for social and conversational communication. Maybe the occasional doctor’s office or airline would send a text reminder, but SMS was not broadly used as a channel by schools or colleges.

Those novel text nudges appeared successful. Results from a randomized controlled trial (RCT) that I conducted with Lindsay Page showed that students who received the texts reminding them of pre-enrollment tasks and connecting them with advisors enrolled in college at higher rates. We had the opportunity to replicate our summer melt work two summers later in additional cities and with engagement from the White House Social and Behavioral Sciences team and found similar impacts.

This evidence emerged as the Obama administration made higher ed policy a greater focus in the second term, with a particular emphasis on expanding college opportunity for underrepresented students. Similar text campaigns expanded rapidly and broadly—most notably former First Lady Michelle Obama’s Up Next campaign—in part because they check numerous boxes for policymakers and funders: Texts are inexpensive to send; text campaigns are relatively easy to implement; and there was evidence of their effectiveness at expanding college access….(More)”.

The lapses in India’s Covid-19 data are a result of decades of callousness towards statistics

Curated on Posted on by Stefaan Verhulst

Prathamesh Mulye at Quartz: “India is paying a huge price for decades of callous attitude towards data and statistics. For several weeks now, experts have been calling out the Indian government and state heads for suppressing Covid-19 infection and death figures. None of the political leaders have addressed these concerns even as official data reflects a small fraction of what’s playing out at hospitals and cremation grounds.

A major reason why administrations are getting away without an answer is that data lapses are nothing new to India.

Successive regimes in the country have tinkered and twisted figures as per their convenience without much consequences. For years, the country has been criticised for insufficient and poor quality data relating to a range of topics, including GDP, farmer suicide, and even unemployment…

Before the pandemic started, the most prominent data controversy in India was around the GDP numbers, which the Modi government continuously changed and chopped to cover up the slowdown in economic growth. In 2019, the Modi government also chose not to publish an unemployment data report that showed that joblessness in the country was at a nine-year high in 2017-18. And last year, in the middle of the pandemic, the government said it had no data on the number of frontline workers who had lost their lives to Covid-19 or a list of police personnel fatalities due to the disease.

Experts say that India’s statistical machinery has been deliberately weakened over the past few years to protect various governments’ false claims and image.

“The weakened statistical machinery manifests itself in different ways such as delays and questions about data quality. Also, when the results of a survey don’t suit the government in power, it tries to suppress data. This happened, for instance, with nutrition data in previous governments too,” said Reetika Khera, associate professor at the Indian Institute of Technology (IIT), Delhi.

“Think of the economy as a patient: data captures its pulse rate. If you don’t listen to the pulse, you won’t be able to diagnose correctly, let alone cure it,” she added….(More)”

Alphonse Bertillon and the Troubling Pursuit of Human Metrics

Curated on Posted on by Stefaan Verhulst

Article by Jessica Helfand: “…We are groomed, from an early age, to crave measurement. Notches on walls verify our height. Notes from doctors record our weight. We buy scales and diaries, save report cards and log achievements. As babies become toddlers become adolescents and adults, we take pictures — lots of pictures. Memories registered and milestones passed, we willingly share our data by way of a host of forms that cumulatively present, over a lifetime, as a kind of gold standard. On paper or online, they’re our material witnesses, holding the temporal at bay.

Dora’s material witness is typical of the sorts of records to which all of us are attached, official documents that connect faces to places, snapshots to statistics. Bureaucratic and perfunctory, we seldom stop to question the silent power of these documents, even as they transport our collective selves across time and space. Lacking nuance, devoid of emotion, they nevertheless confer a kind of keen graphic authority, begetting permission, enabling access, presupposing legitimacy, and anticipating a host of needs. Framed by the records that circumscribe that legitimacy — the records and diplomas, ID cards and passports and licenses — the playing field of difference is homogenized by numerical necessity, making all of us, in a sense, prisoners of the indexical.

Sir Francis Galton’s 1851 “Anthropometric Laboratory” — which was included in the International Health Exhibition held in London in 1885 — was an attempt to show the public how human characteristics could be both measured and recorded.

The pursuit of human metrics has a rich and fascinating history, dating back to the ancient Greeks, who viewed proportion itself as a physical projection of the harmony of the universe. Idealized proportion was synonymous with beauty, a physical expression of divine benevolence. (“The good, of course, is always beautiful,” wrote Plato, “and the beautiful never lacks proportion.”) From Dürer to da Vinci, the notion that humans might aspire to a pure and balanced ideal would find expression in everything from the writings of Vitruvius to the gardens of Le Nôtre to the evolution of the humanist alphabet. To the degree that proportion itself was deemed closer to the divine when realized as an expression of balance and geometry, proportion had everything to do with mathematics in general (and the golden section in particular) and found its most profound expression in the realization of the human form.

While there is ample evidence to suggest that the urge to measure had its origins in ancient civilizations, the science of bodily measurement was not recognized as a proper professional pursuit until the 19th century. With the advent of industry and the pragmatic concerns with which it was associated — growth projections, profit motives, numerical evidence as approved metrics for evaluation — certain public institutions were perhaps uniquely sensitized to appreciate the value of quantitative data. Statistics as a field of mathematical inquiry gained traction as a discipline thanks in no small part to the scholarship of Sir Francis Galton, whose obsession with counting and measuring everything imaginable (but especially human beings) warrants mention here. His 1851 “Anthropometric Laboratory” — which was included in the International Health Exhibition held in London in 1885 — was an attempt to show the public how human characteristics could be both measured and recorded. Add to this the rise in photography as a promising new technology and the idea of capturing evidence via methodical efforts in data mining was an idea whose time had clearly come….(More)”

Zoom Court Is Changing How Justice Is Served

Curated on Posted on by Stefaan Verhulst

Eric Scigliano at The Atlantic: “…Last spring, as COVID‑19 infections surged for the first time, many American courts curtailed their operations. As case backlogs swelled, courts moved online, at a speed that has amazed—and sometimes alarmed—judges, prosecutors, and defense attorneys. In the past year, U.S. courts have conducted millions of hearings, depositions, arraignments, settlement conferences, and even trials—nearly entirely in civil cases or for minor criminal offenses—over Zoom and other meeting platforms. As of late February, Texas, the state that’s moved online most aggressively, had held 1.1 million remote proceedings.

“Virtual justice” (the preferred, if unsettling, term) is an emergency response to a dire situation. But it is also a vision some judicial innovators had long tried to realize. One leading booster, Michigan Chief Justice Bridget Mary McCormack, told me that going online can make courts not only safer but “more transparent, more accessible, and more convenient.” Witnesses, jurors, and litigants no longer need to miss hours of work and fight traffic. Attorneys with cases in multiple courts can jump from one to another by swiping on their phones.

In July the Conference of Chief Justices and the Conference of State Court Administrators jointly endorsed a set of “Guiding Principles for Post-pandemic Court Technology” with a blunt message: The legal system should “move as many court processes as possible online,” and keep them there after the risk of infection passes. The pandemic, they wrote, “is not the disruption courts wanted, but it is the disruption that courts needed.”

America’s courts are burdened by weighty encrustations of complexity and habit, from black robes and “All rise” to arcane trial procedures. COVID-19 has forced them to improvise and experiment. Now, as a post-pandemic future glimmers, we have a chance to reflect. How much of that experimentation will survive after the crisis abates? Given the stakes involved in the justice system, how much should?…(More)”.

Artificial Intelligence in Migration: Its Positive and Negative Implications

Curated on Posted on by Stefaan Verhulst

Article by Priya Dialani: “Research and development in new technologies for migration management are rapidly increasing. To quote certain migration examples, big data was used to predict population movements in the Mediterranean, AI lie detectors used at the European border, and the recent one is the government of Canada using automated decision-making in immigration and refugee applications. Artificial intelligence in migration is helping countries to manage international migration.

Every corner of the world is encountering an unprecedented number of challenging migration crises. As an increasing number of people are interacting with immigration and refugee determination systems, nations are taking a stab at artificial intelligence. AI in global immigration is helping countries to automate a plethora of decisions that are made almost daily as people want to cross borders and look for new homes.

AI projects in migration management can help in predicting the next migration crisis with better accuracy. Artificial intelligence can predict the movements of people migrating by taking into account different types of data such as WiFi positioning, Google Trends, etc. This data can further help the nations and government to be prepared more efficiently for mass migration. Governments can use AI algorithms to examine huge datasets and look for potential gaps in their reception facilities such as the absence of appropriate places for people or vulnerable unaccompanied children.

Recognizing such gaps can allow the government to alter their reception conditions as well as be prepared to comply with their legal obligations under international human rights law (IHRL).

AI applications can also help in changing the lives of asylum seekers and refugees. AI machine learning and optimized algorithms are helping in improving refugee integration. Annie MOORE (Matching Outcome Optimization for Refugee Empowerment) is one such project that matches refugees to communities where they can find the resources and environment as per their preferences and needs.

Asylum seekers or refugees most of the time lack access to lawyers and legal advice. A UK-based chatbot DoNotPay provides free legal advice to asylum seekers using intelligent algorithms. It also provides personalized legal support, which includes help through the UK asylum application process.

AI tech is not just helpful to the government but also to international organisations taking care of international migration. Some organizations are already leveraging machine learning in association with biometric technology. IOM has introduced the Big Data for Migration Alliance project, which intends to use different technologies in international migration….(More)”.

The Case for Open Land-Data Systems

Curated on Posted on by Stefaan Verhulst

Tim Hanstad at Project Syndicate: “Last month, a former Zimbabwean cabinet minister was arrested for illegally selling parcels of state land. A few days earlier, a Malaysian court convicted the ex-chairman of a state-owned land development agency of corruption. And in January, the Estonian government collapsed amid allegations of corrupt property dealings. These recent events all turned the spotlight on the growing but neglected threat of land-related corruption.

Such corruption can flourish in countries that are unprepared to manage the heightened demand for land that accompanies economic and population growth. Land governance in these countries – institutions, policies, rules, and records for managing land rights and use – is underdeveloped, which undermines the security of citizens’ land rights and enables covert land grabs by the well connected.

In Ghana, for example, the government keeps land records for only about 2% of currently operating farms; the ownership of the remainder is largely undocumented. In India, these records were, until recently, often kept in disorganized stacks in government offices.

Under such circumstances, corruption becomes relatively easy and lucrative. After all, when recordkeeping is nonexistent or chaotic, who can confidently identify the rightful owner of a parcel of land? As the United Nations Food and Agriculture Organization and Transparency International put it in a report a decade ago, “where land governance is deficient, high levels of corruption often flourish.” This corruption “is pervasive and without effective means of control.”

Globally, one in five people report having paid a bribe to access land services. In Africa, two out of three people believe the rich are likely to pay bribes or use their connections to grab land. Uncertainty about land rights can also affect housing security – around a billion people worldwide say they expect to be forced from their homes over the next five years.

Inevitably, the marginalized and vulnerable are the worst affected, whether they are widows driven from their homes by speculators or entire communities subjected to forced eviction by developers. Weak land rights and corruption also fuel conflict within communities, such as in Kenya, where political parties promise already-occupied land to supporters in an attempt to win votes.

But there is reason for hope. The ongoing revolution in information and communications technology provides unprecedented opportunities to digitize and open land records. Doing so would clarify the land rights of hundreds of millions of people globally and limit the scope for corrupt practices….(More)”.

Infrastructure Isn’t Really About Roads. It’s About the Society We Want.

Curated on Posted on by Stefaan Verhulst

Eric Klinenberg in the New York Times: “…Consider civic infrastructure. Many of the critical systems the United States needs to build and sustain a good society are degraded. Discriminatory voting laws, like Georgia’s new legislation, threaten the integrity of the political process. Social media companies like Facebook, by using algorithms that reward political extremism and promote political polarization, distort the discourse in our public sphere. Community organizations that help feed, house and educate low-income Americans are essential for preserving peace and improving living standards, but they have struggled to remain solvent during the pandemic. Mr. Biden’s plan leaves these failings in the civic infrastructure practically untouched.

The neglect of social infrastructure in Mr. Biden’s plan is even more striking, given how critical social infrastructure was to the success of President Franklin Roosevelt’s New Deal, the last “once in a generation” investment in America. The New Deal was not just about roads and bridges, after all. It also funded the construction or renovation of thousands of gathering places across the country, in suburbs and cities, rural areas and small towns.

What came from these investments? Libraries. Parks. Playgrounds. Piers. Post offices. Swimming pools. Sports fields. Theaters. Museums. Gardens. Forests. Beaches. Lodges. Walkways. Armories. Courthouses. County fairgrounds. Today too many of us take these projects for granted, even as we continue to use them on a huge scale.

Paradoxically, the success of this social infrastructure is also the source of its degradation. Our gathering places are overrun and dilapidated. Parks and playgrounds need updating. Athletic fields need new surfaces. Public libraries have an estimated $26 billion in capital needs, according to the American Library Association, and the costs of safely operating them at full capacity are likely to exceed what states and local governments can afford. None of this, sadly, is explicitly addressed in Mr. Biden’s proposal….(More)”.

The Ease of Tracking Mobile Phones of U.S. Soldiers in Hot Spots

Curated on Posted on by Stefaan Verhulst

Byron Tau at the Wall Street Journal: “In 2016, a U.S. defense contractor named PlanetRisk Inc. was working on a software prototype when its employees discovered they could track U.S. military operations through the data generated by the apps on the mobile phones of American soldiers.

At the time, the company was using location data drawn from apps such as weather, games and dating services to build a surveillance tool that could monitor the travel of refugees from Syria to Europe and the U.S., according to interviews with former employees. The company’s goal was to sell the tool to U.S. counterterrorism and intelligence officials.

But buried in the data was evidence of sensitive U.S. military operations by American special-operations forces in Syria. The company’s analysts could see phones that had come from military facilities in the U.S., traveled through countries like Canada or Turkey and were clustered at the abandoned Lafarge Cement Factory in northern Syria, a staging area at the time for U.S. special-operations and allied forces.

The discovery was an early look at what today has become a significant challenge for the U.S. armed forces: how to protect service members, intelligence officers and security personnel in an age where highly revealing commercial data being generated by mobile phones and other digital services is bought and sold in bulk, and available for purchase by America’s adversaries….(More)“.

Why bad times call for good data

Curated on Posted on by Stefaan Verhulst

Tim Harford in the Financial Times: “Watching the Ever Given wedge itself across the Suez Canal, it would have taken a heart of stone not to laugh. But it was yet another unpleasant reminder that the unseen gears in our global economy can all too easily grind or stick.

From the shutdown of Texas’s plastic polymer manufacturing to a threat, to vaccine production from a shortage of giant plastic bags, we keep finding out the hard way that modern life relies on weak links in surprising places.

So where else is infrastructure fragile and taken for granted? I worry about statistical infrastructure — the standards and systems we rely on to collect, store and analyse our data.

Statistical infrastructure sounds less important than a bridge or a power line, but it can mean the difference between life and death for millions. Consider Recovery (Randomised Evaluations of Covid-19 Therapy). Set up in a matter of days by two Oxford academics, Martin Landray and Peter Horby, over the past year Recovery has enlisted hospitals across the UK to run randomised trials of treatments such as the antimalarial drug hydroxychloroquine and the cheap steroid dexamethasone.

With minimal expense and paperwork, it turned the guesses of physicians into simple but rigorous clinical trials. The project quickly found that dexamethasone was highly effective as a treatment for severe Covid-19, thereby saving a million lives.

Recovery relied on data accumulated as hospitals treated patients and updated their records. It wasn’t always easy to reconcile the different sources — some patients were dead according to one database and alive on another. But such data problems are solvable and were solved. A modest amount of forethought about collecting the right data in the right way has produced enormous benefits….

But it isn’t just poor countries that have suffered. In the US, data about Covid-19 testing was collected haphazardly by states. This left the federal government flying blind, unable to see where and how quickly the virus was spreading. Eventually volunteers, led by the journalists Robinson Meyer and Alexis Madrigal of the Covid Tracking Project, put together a serviceable data dashboard. “We have come to see the government’s initial failure here as the fault on which the entire catastrophe pivots,” wrote Meyer and Madrigal in The Atlantic. They are right.

What is more striking is that the weakness was there in plain sight. Madrigal recently told me that the government’s plan for dealing with a pandemic assumed that good data would be available — but did not build the systems to create them. It is hard to imagine a starker example of taking good statistical infrastructure for granted….(More)”.