The White House Blog: “We can’t talk about We the People without getting into the numbers — more than 8 million users, more than 200,000 petitions, more than 13 million signatures. The sheer volume of participation is, to us, a sign of success.
And there’s a lot we can learn from a set of data that rich and complex, but we shouldn’t be the only people drawing from its lessons.
So starting today, we’re making it easier for anyone to do their own analysis or build their own apps on top of the We the People platform. We’re introducing the first version of our API, and we’re inviting you to use it.
Get started here: petitions.whitehouse.gov/developers
This API provides read-only access to data on all petitions that passed the 150 signature threshold required to become publicly-available on the We the People site. For those who don’t need real-time data, we plan to add the option of a bulk data download in the near future. Until that’s ready, an incomplete sample data set is available for download here.”
Cities and Data
The Economist: “Many cities around the country find themselves in a similar position: they are accumulating data faster than they know what to do with. One approach is to give them to the public. For example, San Francisco, New York, Philadelphia, Boston and Chicago are or soon will be sharing the grades that health inspectors give to restaurants with an online restaurant directory.
Another way of doing it is simply to publish the raw data and hope that others will figure out how to use them. This has been particularly successful in Chicago, where computer nerds have used open data to create many entirely new services. Applications are now available that show which streets have been cleared after a snowfall, what time a bus or train will arrive and how requests to fix potholes are progressing.
New York and Chicago are bringing together data from departments across their respective cities in order to improve decision-making. When a city holds a parade it can combine data on street closures, bus routes, weather patterns, rubbish trucks and emergency calls in real time.”
Open Data and Civil Society
Nick Hurd, UK Minister for Civil Society, on the potential of open data for the third sector in The Guardian:
“Part of the value of civil society is holding power to account, and if this can be underpinned by good quality data, we will have a very powerful tool indeed….The UK is absolutely at the vanguard of the global open data movement, and NGOs have a great sense that this is something they want to play a part in.There is potential to help them do more of what they do, and to do it better, but they’re going to need a lot of help in terms of information and access to events where they can exchange ideas and best practice.”
Also in the article: “The competitive marketplace and bilateral nature of funding awards make this issue perhaps even more significant in the charity sector, and it is in changing attitudes and encouraging this warts-and-all approach that movement leadership bodies such as the Open Data Institute (ODI) will play their biggest role….Joining the ODI in driving and overseeing wider adoption of these practices is the Open Knowledge Foundation (OKFN). One of its first projects was a partnership with an organisation called Publish What You Fund, the aim of which was to release data on the breakdown of funding to sectors and departments in Uganda according to source – government or aid.
…Open data can often take the form of complex databases that need to be interrogated by a data specialist, and many charities simply do not have these technical resources sitting untapped. OKFN is foremost among a number of organisations looking to bridge this gap by training members of the public in data mining and analysis techniques….
“We’re all familiar with the phrase ‘knowledge is power’, and in this case knowledge means insight gained from this newly available data. But data doesn’t turn into insight or knowledge magically. It takes people, it takes skills, it takes tools to become knowledge, data and change.
“We set up the School of Data in partnership with Peer 2 Peer University just over a year and a half ago with the aim of enabling citizens to carry out this process, and what we really want to do is empower charities to use data in the same way”, said Pollock.”
The Value of Open Data – Don’t Measure Growth, Measure Destruction
David Eaves: “…And that is my main point. The real impact of open data will likely not be in the economic wealth it generates, but rather in its destructive power. I think the real impact of open data is going to be in the value it destroys and so in the capital it frees up to do other things. Much like Red Hat is fraction of the size of Microsoft, Open Data is going to enable new players to disrupt established data players.
What do I mean by this?
Take SeeClickFix. Here is a company that, leveraging the Open311 standard, is able to provide many cities with a 311 solution that works pretty much out of the box. 20 years ago, this was a $10 million+ problem for a major city to solve, and wasn’t even something a small city could consider adopting – it was just prohibitively expensive. Today, SeeClickFix takes what was a 7 or 8 digit problem, and makes it a 5 or 6 digit problem. Indeed, I suspect SeeClickFix almost works better in a small to mid-sized government that doesn’t have complex work order software and so can just use SeeClickFix as a general solution. For this part of the market, it has crushed the cost out of implementing a solution.
Another example. And one I’m most excited. Look at CKAN and Socrata. Most people believe these are open data portal solutions. That is a mistake. These are data management companies that happen to have simply made “sharing (or “open”) a core design feature. You know who does data management? SAP. What Socrata and CKAN offer is a way to store, access, share and engage with data previously gathered and held by companies like SAP at a fraction of the cost. A SAP implementation is a 7 or 8 (or god forbid, 9) digit problem. And many city IT managers complain that doing anything with data stored in SAP takes time and it takes money. CKAN and Socrata may have only a fraction of the features, but they are dead simple to use, and make it dead simple to extract and share data. More importantly they make these costly 7 and 8 digital problems potentially become cheap 5 or 6 digit problems.
On the analysis side, again, I do hope there will be big wins – but what I really think open data is going to do is lower the costs of creating lots of small wins – crazy numbers of tiny efficiencies….
Don’t look for the big bang, and don’t measure the growth in spending or new jobs. Rather let’s try to measure the destruction and cumulative impact of a thousand tiny wins. Cause that is where I think we’ll see it most.”
Data-Driven Public Transport Planning
David Talbot in MIT Technology Review: “Researchers at IBM, using movement data collected from millions of cell-phone users in Ivory Coast in West Africa, have developed a new model for optimizing an urban transportation system….
While the results were preliminary, they point to the new ways that urban planners can use cell-phone data to design infrastructure, says Francesco Calabrese, a researcher at IBM’s research lab in Dublin, and a coauthor of a paper on the work. “This represents a new front with a potentially large impact on improving urban transportation systems,” he says. “People with cell phones can serve as sensors and be the building blocks of development efforts.”
The IBM work was done as part of a research challenge dubbed Data for Development, in which the telecom giant Orange released 2.5 billion call records from five million cell-phone users in Ivory Coast. The records were gathered between December 2011 and April 2012. The data release is the largest of its kind ever done. The records were cleaned to prevent anyone identifying the users, but they still include useful information about these users’ movements. The IBM paper is one of scores being aired later this week at a conference at MIT.”
Open Data for Agriculture
USDA News Release: “Agriculture Secretary Tom Vilsack, along with Bill Gates, and U.S. Chief Technology Officer Todd Park, today kicked off a two-day international open data conference, saying that data “is among the most important commodities in agriculture” and sharing it openly increases its value.
Secretary Vilsack, as head of the U.S. Government delegation to the conference, announced the launch of a new “virtual community” as part of a suite of actions, including the release of new data, that the United States is taking to give farmers and ranchers, scientists, policy makers and other members of the public easy access to publicly funded data to help increase food security and nutrition.
“The digital revolution fueled by open data is starting to do for the modern world of agriculture what the industrial revolution did for agricultural productivity over the past century,” said Vilsack. “Open access to data will help combat food insecurity today while laying the groundwork for a sustainable agricultural system to feed a population that is projected to be more than nine billion by 2050.”
The virtual Food, Agriculture, and Rural data community launched today on Data.gov-the U.S. Government’s data sharing website-to catalogue America’s publicly available agricultural data and increase the ability of the public to find, download, and use datasets that are generated and held by the Federal Government. The data community features a collection of more than 300 newly cataloged datasets, databases, and raw data sources related to food, agriculture, and rural issues from agencies across the U.S. Government. In addition to the data catalog, the virtual community shares a number of applications, maps and tools designed to help farmers, scientists and policymakers improve global food security and nutrition….
The conference and the U.S. actions supporting open agricultural data fulfill the Open Data for Agriculture commitment made as part of the New Alliance for Food Security and Nutrition, which was launched by President Obama and G-8 partners at the 2012 G-8 Leaders Summit last year at Camp David, Maryland.”
| G-8 Open Data for Agriculture Conference Aims to Help Feed a Growing Population and Fulfill New Alliance for Food Security and Nutrition Commitment | |||||
| Secretary Vilsack Announces Launch of a Virtual Community to Give Increased Public Access to Food, Agriculture, and Rural Data | |||||
Analyzing social media use can help predict, track and map obesity rates
Statement from the Boston Children’s Hospital: “The higher the percentage of people in a city, town or neighborhood with Facebook interests suggesting a healthy, active lifestyle, the lower that area’s obesity rate. At the same time, areas with a large percentage of Facebook users with television-related interests tend to have higher rates of obesity. Such are the conclusions of a study by Boston Children’s Hospital researchers comparing geotagged Facebook user data with data from national and New York City-focused health surveys.
Together, the conclusions suggest that knowledge of people’s online interests within geographic areas may help public health researchers predict, track and map obesity rates down to the neighborhood level, while offering an opportunity to design geotargeted online interventions aimed at reducing obesity rates.
The study team, led by Rumi Chunara, PhD, and John Brownstein, PhD, of Boston Children’s Hospital’s Informatics Program (CHIP), published their findings on April 24 in PLOS ONE. The amount of data available from social networks like Facebook makes it possible to efficiently carry out research in cohorts of a size that has until now been impractical.”
Stock Market Prediction using Google search terms
MIT Technology Review: “This week’s fleeting stock market crash prompted by a false report from the Associated Press’s hacked Twitter account has focused attention again on the growing Wall Street practice of mining news and social data to make trades.
A study in Nature Scientific Reports today illustrates just how lucrative the right combination of algorithms could potentially be.
Using Google Trends, researchers analyzed the Google search query volumes from 2004 to 2011 for a set of 98 mostly finance-related search terms, looked at how stock prices changed over that same time, and tried to see if they could retroactively tease out search patterns that showed “early warning signs” of market moves. They also tested trading strategies that would act on these signs.
The volume of the search term “debt” turned out to be the word that showed the most promise, and one trading plan based on changes in searches for this term would have yielded a return of 326 percent over the period analyzed, the authors found. For comparison, a “buy and hold” investment in the Dow Jones Industrial Average yielded 16 percent return.”
Better Cities Competition
Announcement: Do you want to make our cities of the future better? Want to help improve quality of life in your home, your work and your public life? Have an idea how? Capture it in a short video and be in with a chance to win one of our amazing prizes!
As a part of Open Innovation 2.0: Sustainable Economy & Society collaboration Intel Labs Europe, Dublin City Council, Trinity College Dublin and European Commission Open Innovation and Strategy Policy Group are delighted to announce that the 2013 Better Cities competition is now open.
The theme of the competition is how to make our cities more socially and economically sustainable, through use of open data and information technology. Particular focus should be given to how citizens can engage and contribute to the innovation process.
"Imagery to the Crowd"
Description: “The Humanitarian Information Unit (HIU), a division within the Office of the Geographer and Global Issues at the U.S. Department of State, is working to increase the availability of spatial data in areas experiencing humanitarian emergencies. Built from a crowdsourcing model, the new “Imagery to the Crowd” process publishes high-resolution commercial satellite imagery, purchased by the Unites States Government, in a web-based format that can be easily mapped by volunteers.
The digital map data generated by the volunteers are stored in a database maintained by OpenStreetMap (OSM), a UK-registered non-profit foundation, under a license that ensures the data are freely available and open for a range of uses (http://osm.org). Inspired by the success of the OSM mapping effort after the 2010 Haiti earthquake, the Imagery to the Crowd process harnesses the combined power of satellite imagery and the volunteer mapping community to help aid agencies provide informed and effective humanitarian assistance, and plan recovery and development activities.
5-minute Ignite Talk about Imagery to the Crowd: