Digital Public Library of America Launched


Press Release: “The Digital Public Library of America (DPLA) launched a beta of its discovery portal and open platform today. The portal delivers millions of materials found in American archives, libraries, museums, and cultural heritage institutions to students, teachers, scholars, and the public. Far more than a search engine, the portal provides innovative ways to search and scan through its united collection of distributed resources. Special features include a dynamic map, a timeline that allow users to visually browse by year or decade, and an app library that provides access to applications and tools created by external developers using DPLA’s open data…
With an application programming interface (API) and maximally open data, the DPLA can be used by software developers, researchers, and others to create novel environments for learning, tools for discovery, and engaging apps. The DPLA App Library features an initial slate of applications built on top of the platform; developers and hobbyists of all skill levels are freely able to make use of the data provided via the platform….
With its content partners, the DPLA has developed a number of diverse virtual exhibitions that tell the stories of people, places, and historical events both here in the US and abroad; all are available freely via the portal.”
 

Demystifying data centers


Wired: “If you walk into the lobby of the data center Facebook operates in the high desert in Prineville, Oregon, you’ll find a flatscreen display on the wall where you can check the pulse of this massive computing facility.
The display tracks the efficiency of the operation, which spans 333,400-square feet and tens of thousands of computer servers. Facebook built this data center in an effort to significantly reduce the power and dollars needed to serve up the world’s most popular social network, and — driven by CEO Mark Zuckerberg’s deep-seeded belief in the free exchange of ideas — the company aims to push the computing world in a similar direction. The display — which shows much the same information Facebook engineers use to monitor the facility — is an advertisement for the Facebook way.
Now, the company is taking this idea a step further. On Thursday, Facebook uncloaked a pair of web services that let anyone in the world track the efficiency of the Prineville data center and its sister facility in Forest City, North Carolina. “We’re pulling back the curtain to share some of the same information that our data center technicians view every day,” Facebook’s Lyrica McTiernan said in a blog post. “We think it’s important to demystify data centers and share more about what our operations really look like.”
http://www.wired.com/wiredenterprise/wp-content/uploads/2013/04/facebook-dashboard.png

Mental Geography, Wonky Maps and a Long Way Ahead


Paper by Alan Dix at GeoHCI Workshop at CHI 2013, April 27–28, 2013: ” It has never been easier to create your own maps, creating data mashups with Google Maps and similar tools and embedding them in web pages. This has benefited tourism and commerce, and has also revolutionised many areas of social activism, allowing open government data and other public (or leaked) data to be visualised in ways that may subvert or offer alternative views to the official narrative. However, like all maps, digital mapping  embodies a particular politics and world view…”

Surfing Logs Reveal Global Eating Patterns


From the The Physics arXiv Blog:  “The way we view online recipes reveals how our eating habits change over time, say computational sociologists….it’s no surprise that computational sociologists have begun to mine the data associated with our browsing habits to discover more about our diets and eating habits. Last year we looked at some fascinating work examining networks of ingredients and the flavours they contain, gathered from online recipe websites.  It turns out this approach gives fascinating insights into the way recipes vary geographically and into the possibility of unexplored combinations of flavours.
Today, Robert West at Stanford University and Ryen White and Eric Horvitz from Microsoft Research in Redmond, take a deeper look at the electronic trails we leave when we hunt for food on the web. They say the data reveals important trends in the way our diets change with the season, with our geographical location and with certain special days such as Thanksgiving and Christmas. And they conclude that the data could become an important tool for monitoring public health.”
See also : arxiv.org/abs/1304.3742: From Cookies to Cooks: Insights on Dietary Patterns via Analysis of Web Usage Logs

David Brooks on Big Data


David Brooks in NYT: “Over the past few centuries, there have been many efforts to come up with methods to help predict human behavior — what Leon Wieseltier of The New Republic calls mathematizing the subjective. The current one is the effort to understand the world by using big data.

Other efforts to predict behavior were based on models of human nature. The people using big data don’t presume to peer deeply into people’s souls. They don’t try to explain why people are doing things. They just want to observe what they are doing. The theory of big data is to have no theory, at least about human nature. You just gather huge amounts of information, observe the patterns and estimate probabilities about how people will act in the future….

One of my take-aways is that big data is really good at telling you what to pay attention to. It can tell you what sort of student is likely to fall behind. But then to actually intervene to help that student, you have to get back in the world of causality, back into the world of responsibility, back in the world of advising someone to do x because it will cause y.”

Big Data, Big Brains


“This report on Big Data is the first MeriTalk Beacon, a new series of reports designed to shed light and provide direction on far reaching issues in government and technology. Since Beacons are designed to tackle broad concepts, each Beacon report relies on insight from a small number of big thinkers in the topic area. Less data. More insight. Real knowledge…Mankind created 150 exabytes (billion gigabytes) of data in 2005, and 1,800 exabytes in 20112; growth that only continues to accelerate. Every minute, users: Upload 48 hours of video to YouTube; Send 204 million emails; Spend $207,000 via the web; Create 571 new websites. Within the Federal government; U.S. drone aircraft sent back 24 years worth of video footage in just 2009. Every 24 hours, NASA’s Curiosity rover can send nearly three gigabytes of data, collecting in mere days the equivalent of all human knowledge through the death of Augustus Caesar – from Mars.”

Digital engagement: time to shift attention toward use and usefulness


Geoff Mulgan: “The last few years have brought a cornucopia of innovation around data, with millions of data sets opened up, and big campaigns around transparency, all interacting with the results of a glut of hackathons, appathons and the like. Linked to this has been the explosion of creativity around digital tools for civic engagement and local government….
There are also big questions to ask about digital technologies and public services – and in particular why so few public services have been radically redesigned. This has been talked about for as long as I can remember – and it’s not hard to map out how a transformed health, welfare or transport system could work if you started afresh. But with a few exceptions (like tax) this isn’t happening in any of the big public services anywhere. I’ll be writing some blogs soon about how we might accelerate this kind of systemic change.
In the meantime there are some more pragmatic questions to ask about what is and isn’t working.  A pattern is becoming clear which poses a challenge to the enthusiasts, and to funders like us.  In essence it’s this: there has been brilliant progress on the supply side – opening up data, and multiplying tools and apps of all kinds. But there has been far less progress on the demand and use side. The result is that thousands of promising data sets, apps and sites remain unused; and a great deal of creativity and energy has gone to waste.
The reasons are fairly obvious when you think about it. This is a movement driven by enthusiasts who have tended to assume that supply will create its own demand (sometimes it does – but not often).  Most of the practitioners are interested in the technical challenges of design, and a measure of their success is that for most applications there are readily accessible tools now available. Yet the much bigger challenges lie around use: how to develop attractive brands; how to promote and market; how to shape design to fit how people will actually use the services; how to build living communities.”

Data for the Boston Marathon Investigation Will Be Crowdsourced


WIRED: “The investigation of Monday’s deadly twin bombings in Boston will rely to an extraordinary extent on crowdsourced surveillance, provided by Marathon spectators’ cellphone photos, Vine videos, and Instagram feeds….There are limits to the crowdsourcing. The data used in the investigation will be crowdsourced. The investigation will not be. A crowdsourced investigation runs a high risk of becoming a witchhunt, as we saw in the Newton shooting spree.”

Citizen Engagement and City Budgets


Governing Magazine: “Inviting public comment early in the budget process, and doing so in multiple ways, is closely associated with better performance outcomes, according to a new study in The American Review of Public Administration.

State and local government meetings, from a state agency to a county board, are notoriously low in attendance. Some governments have reacted with experiments to spur better public involvement, especially in drafting budgets. … Despite this patchwork of efforts to involve citizens, public administrators still don’t know exactly when to seek public input and how it might affect the day-to-day work of governing. So Hai Guo and Milena Neshkova, both assistant professors in the Department of Public Administration at Florida International University, set out to study the relationship between citizen participation in budgeting and measurable performance outcomes. Their analysis relied on 2005 survey data on state transportation agencies and their civic engagement strategies (focus groups, for example) across four stages in the budget process.
Because their research focused solely on transportation agencies, they looked at transportation-related outcomes that governments value: fewer road-related fatalities and fewer poor-quality roads. They took into account external factors, such as level of funding, that might account for differences in fatality rates or road conditions. They found that not only is there an inverse relationship (more attempts at civic engagement mean fewer fatalities and low-quality roads), but that the relationship is statistically significant. In other words, the result isn’t due to chance.
More importantly, the association was strongest at the earliest stage in the process. “You need to engage them early. I think that’s the point we’re trying to make,” Prof. Guo said. Since the analysis was specific to state transportation departments, Prof. Guo says he’d like to see if the same pattern would emerge at other levels of government.”

Big Data Challenge to Transform Health Care Delivery


BPC Press Release: “Today, the Bipartisan Policy Center (BPC), Heritage Provider Network (HPN), and The Advisory Board Company launched the Care Transformation Prize Series, a national contest to address the most daunting data problems U.S. health care organizations face as they implement new delivery system and payment reforms.
The goal of this big data challenge is to help health care organizations more effectively use data to drive improvements in health care cost and quality. The series was announced at a BPC-hosted event today that featured a forward-thinking discussion on the strategies that providers, health plans, and states are using to harness data to help Americans lower their health care costs and improve care.”