Open Data Directory – Use Cases and Requirements


Word Wide Web Foundation: “Today, we’re pleased to be publishing a report entitled “Open Data Directory: Use Cases and Requirements”. The full report can be downloaded here.

As we noted in April when we released a draft for comment, quality rich information and content references are a need when you are dealing with innovative environments such as Open Data, where sharing and reusing are necessary routines in order to advance, and to give Open Data initiatives the visibility and recognition they need.

Although only a few years ago it was nearly impossible to find information and examples of Open Government Data initiatives and their components, there are currently a growing and varied number of Open Data resources all over the Web.
Given the increasing number of Open Data-related activities all around the world, and the social, economic or cultural diversity within the different countries, no single person or organization could grasp the whole scope of such a huge amount of information.
Any Government or organization interested in Open Data would greatly benefit from the existing and growing knowledge base and resources, so this scenario represents an invaluable opportunity to construct a neutral and trustable central directory that can help us to structure references, share best practices, and, generally speaking, mobilize the global Open Data community around it….”

Analyzing the Analyzers


catAn Introspective Survey of Data Scientists and Their Work,By Harlan Harris, Sean Murphy, Marck Vaisman: “There has been intense excitement in recent years around activities labeled “data science,” “big data,” and “analytics.” However, the lack of clarity around these terms and, particularly, around the skill sets and capabilities of their practitioners has led to inefficient communication between “data scientists” and the organizations requiring their services. This lack of clarity has frequently led to missed opportunities. To address this issue, we surveyed several hundred practitioners via the Web to explore the varieties of skills, experiences, and viewpoints in the emerging data science community.

We used dimensionality reduction techniques to divide potential data scientists into five categories based on their self-ranked skill sets (Statistics, Math/Operations Research, Business, Programming, and Machine Learning/Big Data), and four categories based on their self-identification (Data Researchers, Data Businesspeople, Data Engineers, and Data Creatives). Further examining the respondents based on their division into these categories provided additional insights into the types of professional activities, educational background, and even scale of data used by different types of Data Scientists.
In this report, we combine our results with insights and data from others to provide a better understanding of the diversity of practitioners, and to argue for the value of clearer communication around roles, teams, and careers.”

Xeroc PARC Tackles Online Dating’s Biggest Conundrum


CertifeyeThe Physics arXiv Blog: “Online dating has changed the way people start relationships. In 2000, a few hundred thousand individuals were experimenting with online dating. Today, more than 40 million people have signed up to meet their dream man or woman online. That kind of success is reflected in the fact that this industry is currently worth some $1.9 billion in annual revenue.
Of course, nobody would claim that online dating is the perfect way to meet a mate. One problem in particular is whether to trust the information that a potential date has given. How do you know that this person isn’t being economical with the truth?…
The new approach is simple. The idea these guys have come up with is to use an app that connects to a person’s Facebook page (or other social network page) and then compare the information there with the information on the dating profile. If the data is the same, then it is certified. The beauty of this system is that the Facebook details are not open to external scrutiny—the app does not take, make public or display any information from the social network. It simply compares the information from the two sites.
Any discrepancy indicates that something, somewhere is wrong and the ambiguous details are not then certified….this process of certification gives users a greater sense of security because Facebook data is largely peer reviewed already.
Ref: arxiv.org/abs/1303.4155: Bootstrapping Trust in Online Dating: Social Verification of Online Dating Profiles”

Gamification: A Short History


Ty McCormick in Foreign Policy: “If you’re checking in on Foursquare or ramping up the “strength” of your LinkedIn profile, you’ve just been gamified — whether or not you know it. “Gamification,” today’s hottest business buzzword, is gaining traction everywhere from corporate boardrooms to jihadi chat forums, and its proponents say it can revolutionize just about anything, from education to cancer treatment to ending poverty. While the global market for gamification is expected to explode from $242 million in 2012 to $2.8 billion in 2016, according to market analysis firm M2 Research, there is a growing chorus of critics who think it’s little more than a marketing gimmick. So is the application of game mechanics to everyday life more than just a passing fad? You decide.
1910
Kellogg’s cereals offers its first “premium,” the Funny Jungleland Moving-Pictures book, free with every two boxes. Two years later, Cracker Jack starts putting prizes, from stickers to baseball cards, in its boxes of caramel-coated corn snacks. “A prize in every box” is an instant hit; over the next 100 years, Cracker Jack gives away more than 23 billion in-package treasures. By the 1950s, the concept of gamification is yet to be born, but its primary building block — fun — is motivating billions of consumers around the world.
1959
Duke University sociologist Donald F. Roy publishes “Banana Time,” an ethnographic study of garment workers in Chicago. Roy chronicles how workers use “fun” and “fooling” on the factory room floor — including a daily ritual game in which workers steal a banana — to stave off the “beast of monotony.” The notion that fun can enhance job satisfaction and productivity inspires reams of research on games in the workplace….”

How Open Data Can Fight Climate Change


New blog post by Joel Gurin, Founder and Editor, OpenDataNow.com: When people point to the value of Open Data from government, they often cite the importance of weather data from NOAA, the National Oceanic and Atmospheric Administration. That data has given us the Weather Channel, more accurate forecasts, and a number of weather-based companies. But the most impressive – and one of the best advertisements for government Open Data – may well be The Climate Corporation, headquartered in San Francisco.
Founded in 2006 under the name WeatherBill, The Climate Corporation was started to sell a better kind of weather insurance. But it’s grown into a company that could help farmers around the world plan around climate change, increase their crop yields, and become part of a new green revolution.
The company’s work is especially relevant in light of President Obama’s speech yesterday on new plans to fight climate change. We know that whatever we do to reduce carbon emissions now, we’ll still need to deal with changes that are already irreversible. The Climate Corporation’s work can be part of that solution…
The company has developed a new service, Climate.com, that is free to policyholders and available to others for a fee….
Their work may become part of a global Green Revolution 2.0. The U.S. Government’s satellite data doesn’t stop at the border: It covers the entire planet.  The Climate Corporation is now looking for ways to apply its work internationally, probably starting with Australia, which has relevant data of its own.
Start with insurance sales, end up by changing the world. The power of Open Data has never been clearer.”

Knight News Challenge on Open Gov


Press Release: “Knight Foundation today named eight projects as winners of the Knight News Challenge on Open Gov, awarding the recipients more than $3.2 million for their ideas.
The projects will provide new tools and approaches to improve the way people and governments interact. They tackle a range of issues from making it easier to open a local business to creating a simulator that helps citizens visualize the impact of public policies on communities….
Each of the winning projects offers a solution to a real-world need. They include:
Civic Insight: Providing up-to-date information on vacant properties so that communities can find ways to make tangible improvements to local spaces;
OpenCounter: Making it easier for residents to register and create new businesses by building open source software that governments can use to simplify the process;
Open Gov for the Rest of Us: Providing residents in low-income neighborhoods in Chicago with the tools to access and demand better data around issues important to them, like housing and education;
Outline.com: Launching a public policy simulator that helps people visualize the impact that public policies like health care reform and school budget changes might have on local economies and communities;
Oyez Project: Making state and appellate court documents freely available and useful to journalists, scholars and the public, by providing straightforward summaries of decisions, free audio recordings and more;
Procur.io: Making government contract bidding more transparent by simplifying the way smaller companies bid on government work;
GitMachines: Supporting government innovation by creating tools and servers that meet government regulations, so that developers can easily build and adopt new technology;
Plan in a Box: Making it easier to discover information about local planning projects, by creating a tool that governments and contractors can use to easily create websites with updates that also allow public input into the process.

Now in its sixth year, the Knight News Challenge accelerates media innovation by funding breakthrough ideas in news and information. Winners receive a share of $5 million in funding and support from Knight’s network of influential peers and advisors to help advance their ideas. Past News Challenge winners have created a lasting impact. They include: DocumentCloud, which analyzes and annotates public documents – turning them into data; Tools for OpenStreetMap, which makes it easier to contribute to the editable map of the world; and Safecast, which helps people measure air quality and became the leading provider of pollution data following the 2011 earthquake and tsunami in Japan.
For more, visit newschallenge.org and follow #newschallenge on Twitter.

Canada's Action Plan on Open Government


Introduction: “Canada’s commitment to open government is part of the federal government’s efforts to foster greater openness and accountability, to provide Canadians with more opportunities to learn about and participate in government, to drive innovation and economic opportunities for all Canadians and, at the same time, create a more cost effective, efficient and responsive government.
The Government of Canada first launched its Open Government strategy in March 2011, and then further enhanced its commitment by announcing its intention to join the Open Government Partnership in September 2011.
Over the past two years, we have consulted Canadians on both the development of a Digital Economy Strategy and on Open Government. Our Digital Economy consultation sought feedback from all Canadians on how to improve innovation and creativity, and achieve the shared goal of making Canada a global leader in the digital economy. More recently, in the fall of 2011, we launched a consultation to explore Canadians’ perspectives on Open Government in order to inform the development of Canada’s Action Plan on Open Government.
The results of these consultations stressed the importance of providing open access to public sector information and data and, in particular, the need to improve the availability of data to researchers and the private sector with fewer restrictions on reuse of these information assets. Canadians also want the opportunity to engage in an ongoing dialogue with government on policies and priorities. Cumulatively, the valuable information and insight received from Canadians have helped us shape the direction for open government in Canada. As we move forward, we will continue to consult with Canadians and Canada’s active open government community on how best to implement this plan.
Our Action Plan on Open Government sets out our commitments to Canadians and for the Open Government Partnership, which we will achieve over a three-year period through the effective and prudent use of resources. It is structured along the three streams of our Open Government Strategy: Open Information, Open Data, and Open Dialogue.”
 

Visualizing 3 Billion Tweets


9080460045_cb6c84283e_bEric Gundersen from Mapbox: “This is a look at 3 billion tweets – every geotagged tweet since September 2011, mapped, showing facets of Twitter’s ecosystem and userbase in incredible new detail, revealing demographic, cultural, and social patterns down to city level detail, across the entire world. We were brought in by the data team at Gnip, who have awesome APIs and raw access to the Twitter firehose, and together Tom and data artist Eric Fischer used our open source tools to visualize the data and build interfaces that let you explore the stories of space, language, and access to technology.
This is big data, and there’s a significant level of geographic overlap between tweets, so Eric wrote an open-source tool that de-duplicated 2.7 billion overlapping datapoints, leaving 280 million unique locations…”
 

Visualizing the Stunning Growth of 8 Years of OpenStreetMap


new yorkEmily Badger in Atlantic Cities: “The U.S. OpenStreetMap community gathered in San Francisco over the weekend for its annual conference, the State of the Map. The loose citizen-cartography collective has now been incrementally mapping the world since 2004. While they were taking stock, it turns out the global open mapping effort has now mapped data on more than 78 million buildings and 21 million miles of road (if you wanted to drive all those roads at, say, 60 miles an hour, it would take you some 40 years to do it).
And more than a million people have chipped away at this in an impressively democratic manner: 83.6 percent of the changes in the whole database have been made by 99.9 percent of contributors.
These numbers come from the OpenStreetMap 2013 Data Report, which also contains, of course, more maps. The report, created by MapBox, includes a beautiful worldwide visualization of all the road updates made as OpenStreetMap has grown, with some of the earliest imports of data shown in green and blue, and more recent ones in white. You can navigate the full map here (scroll down), but we’ve grabbed a couple of snapshots for you as well.”

Social Media Boosted Organ Donor Registrations 2000%


The Social Graf (Media Post Blog): “One of the common criticisms of social media activism is that it people’s interest in causes is transient and superficial, lasting the few moments it takes to click “Like” before moving on and forgetting about it entirely. And it may be true that the period of active engagement is fleeting — but that can still produce significant results, as demonstrated by a social media campaign to sign up new organ donors beginning in May 2012.
The organ donor initiative, described in an article in the American Journal of Transplantation, encouraged Facebook users to publicize their own organ donor status on their timelines, and share links that made it easy to change their organ donor status, which in turn encouraged even more people to register, and so on. According to the authors, the Facebook push produced a rather mind-boggling 21-fold increase in organ donor registrations on the first day of the campaign, with 13,012 people signing up to become organ donors, compared to the usual daily average of 616.
The example of the social media organ donor registration drive is both encouraging and cautionary. On the positive side, it showed that (for certain causes, at least) the combination of peer examples and ease of engagement can prompt large numbers of people to make a significant commitment.
Less encouraging (but not surprising) is the fact that after the initial period of “viral” success, fueled in part by the novelty of the timeline feature showing organ donor status, the organ donor registration rates apparently fell back to “just” twice the normal rate several weeks later.”