Why the Open Definition Matters for Open Data: Quality, Compatibility and Simplicity


Rufus Pollock at Open Knowledge: “The Open Definition performs an essential function as a “standard”, ensuring that when you say “open data” and I say “open data” we both mean the same thing. This standardization, in turn, ensures the quality, compatibility and simplicity essential to realizing one of the main practical benefits of “openness”: the greatly increased ability to combine different datasets together to drive innovation, insight and change. …
However, these benefits are at significant risk both from quality-dilution and “open-washing”” (non-open data being passed off as open) as well as from fragmentation of the ecosystem as the proliferation of open licenses each with their own slightly different terms and conditions leads to incompatibility. The Open Definition helps eliminates these risks and ensure we realize the full benefits of open. It acts as the “gold standard” for open content and data guaranteeing quality and preventing incompatibility. This post explores in more detail why it’s important to have the Open Definition and the clear standard it provides for what “open” means in open data and open content…”

YouTube for Government


Brandon Feldman at Google Politics & Elections Blog: From live streams of the State of the Union and legislative hearings, to explainer videos on important issues and Hangouts with constituents, YouTube has become an important platform where citizens engage with their governments and elected officials.
In order to help government officials get a better idea of what YouTube can do, we are launching youtube.com/government101, a one-stop shop where government officials can learn how to get the most out of YouTube as a communication tool.

The site offers a broad range of YouTube advice, from the basics of creating a channel to in-depth guidance on features like live streaming, annotations, playlists and more. We’ve also featured case studies from government offices around the world that are using YouTube in innovative ways.
If you’re a government official, whether you are looking for an answer to a quick question or need a full training on YouTube best practices, we hope this resource will help you engage in a rich dialogue with your constituents and increase transparency within your community….”

MIT launches Laboratory for Social Machines with major Twitter investment


MIT Press Release: “The MIT Media Lab today announced the creation of the Laboratory for Social Machines (LSM), funded by a five-year, $10 million commitment from Twitter. As part of the new program, Twitter will also provide full access to its real-time, public stream of tweets, as well as the archive of every tweet dating back to the first.
The new initiative, based at the Media Lab, will focus on the development of new technologies to make sense of semantic and social patterns across the broad span of public mass media, social media, data streams, and digital content. Pattern discovery and data visualization will be explored to reveal interaction patterns and shared interests in relevant social systems, while collaborative tools and mobile apps will be developed to enable new forms of public communication and social organization.
A main goal for the LSM will be to create new platforms for both individuals and institutions to identify, discuss, and act on pressing societal problems. Though funded by Twitter, the LSM will have complete operational and academic independence. In keeping with the academic mission of LSM, students and staff will work across many social media and mass media platforms — including, but not limited to, Twitter.
“The Laboratory for Social Machines will experiment in areas of public communication and social organization where humans and machines collaborate on problems that can’t be solved manually or through automation alone,” says Deb Roy, an associate professor at the Media Lab who will lead the LSM, and who also serves as Twitter’s chief media scientist. “Social feedback loops based on analysis of public media and data can be an effective catalyst for increasing accountability and transparency — creating mutual visibility among institutions and individuals.”
“With this investment, Twitter is seizing the opportunity to go deeper into research to understand the role Twitter and other platforms play in the way people communicate, the effect that rapid and fluid communication can have and apply those findings to complex societal issues,” says Dick Costolo, CEO of Twitter…”

Uncovering State And Local Gov’s 15 Hidden Successes


Emily Jarvis at GovLoop: “From garbage trucks to vacant lots, cities and states are often tasked with the thankless job of cleaning up a community’s mess. These are tasks that are often overlooked, but are critical to keeping a community vibrant.
But even in these sometimes thankless jobs, there are real innovations happening. Take Miami-Dade County where they are using hybrid garbage trucks to save the community millions of dollars in fuel every year and make the environment a little cleaner. Or head over to Milwaukee where the city is turning vacant and abandoned lots into urban farms.
There are just two of the fifteen examples, GovLoop uncovered in our new guide, From the State House to the County Clerk – 15 Challenges and Success Stories.
We have broken the challenges into four categories:

  • Internal Best Practices
  • Tech Challenges
  • Health and Safety
  • Community Engagement and Outreach

Here’s another example, the open data movement has the potential to effect governing and civic engagement at the state and local government levels. But today very few agencies are actively providing open data. In fact, only 46 U.S. cities and counties have open data sites. One of the cities on the leading edge of the open data movement is Fort Worth, Texas.

“When I came into office, that was one of my campaign promises, that we would get Fort Worth into this century on technology and that we would take a hard look at open records requests and requests for data,” Mayor Betsy Price said in an interview with the Star-Telegram. “It goes a lot further to being transparent and letting people participate in their government and see what we are doing. It is the people’s data, and it should be easy to access.”

The website, data.fortworthtexas.gov, offers data and documents such as certificates of occupancy, development permits and residential permits for download in several formats, including Excel and PDF. Not all datasets are available yet — the city said its priority was to put the most-requested data on the portal first. Next up? Crime data, code violations, restaurant ratings and capital projects progress.

City officials’ ultimate goal is to create and adopt a full open data policy. As part of the launch, they are also looking for local software developers and designers who want to help guide the open data initiative. Those interested in participating can sign up online to receive more information….”

UN Data Revolution Group


Website: “UN Secretary-General Ban Ki-moon has asked an Independent Expert Advisory Group to make concrete recommendations on bringing about a data revolution in sustainable development. Here you can find out more about the work of the group, and feed into the process by adding your comments to this site or sending a private consultation submission

Consultation Areas

Why we’re failing to get the most out of open data


Victoria Lemieux at the WEF Blog: “An unprecedented number of individuals and organizations are finding ways to explore, interpret and use Open Data. Public agencies are hosting Open Data events such as meetups, hackathons and data dives. The potential of these initiatives is great, including support for economic development (McKinsey, 2013), anti-corruption (European Public Sector Information Platform, 2014) and accountability (Open Government Partnership, 2012). But is Open Data’s full potential being realized?
news item from Computer Weekly casts doubt. A recent report notes that, in the United Kingdom, poor data quality is hindering the government’s Open Data program. The report goes on to explain that – in an effort to make the public sector more transparent and accountable – UK public bodies have been publishing spending records every month since November 2010. The authors of the report, who conducted an analysis of 50 spending-related data releases by the Cabinet Office since May 2010, found that that the data was of such poor quality that using it would require advanced computer skills.
Far from being a one-off problem, research suggests that this issue is ubiquitous and endemic. Some estimates indicate that as much as 80 percent of the time and cost of an analytics project is attributable to the need to clean up “dirty data” (Dasu and Johnson, 2003).
In addition to data quality issues, data provenance can be difficult to determine. Knowing where data originates and by what means it has been disclosed is key to being able to trust data. If end users do not trust data, they are unlikely to believe they can rely upon the information for accountability purposes. Establishing data provenance does not “spring full blown from the head of Zeus.” It entails a good deal of effort undertaking such activities as enriching data with metadata – data about data – such as the date of creation, the creator of the data, who has had access to the data over time and ensuring that both data and metadata remain unalterable.
Similarly, if people think that data could be tampered with, they are unlikely to place trust in it; full comprehension of data relies on the ability to trace its origins….”

'How We Got to Now' by Steven Johnson


Book Review by Philip Delves Broughton in the Wall Street Journal: “Theories of innovation and entrepreneurship have always yo-yoed between two basic ideas. First, that it’s all about the single brilliant individual and his eureka moment that changes the world. Second, that it’s about networks, collaboration and context. The truth, as in all such philosophical dogfights, is somewhere in between. But that does not stop the bickering. This controversy blew up in a political context during the 2012 presidential election, when President Obama used an ill-chosen set of words (“you didn’t build that”) to suggest that government and society had a role in creating the setting for entrepreneurs to flourish, and Republicans berated him for denigrating the rugged individualists of American enterprise.
Through a series of elegant books about the history of technological innovation, Steven Johnson has become one of the most persuasive advocates for the role of collaboration in innovation. His latest, “How We Got to Now,” accompanies a PBS series on what he calls the “six innovations that made the modern world.” The six are detailed in chapters titled “Glass,” “Cold,” “Sound,” “Clean,” “Time” and “Light.” Mr. Johnson’s method is to start with a single innovation and then hopscotch through history to illuminate its vast and often unintended consequences….
Mr. Johnson calls this “long-zoom” history, an examination of what he refers to as the “hummingbird effect” in history. Back in the Cretaceous age, he explains, flowers evolved colors and scents to alert insects to the presence of nectar. Hummingbirds evolved their peculiar flying mechanics to hover beside a flower like an insect in order to extract nectar. From flowers to nectar to insects to an innovation in avian flight. Mr. Johnson professes to be agnostic about the innovations he describes, but the hummingbird effects he believes in are so hard to predict that taking the long view means withholding negative judgments on the present. One may not like the Facebook of today, for example, but who knows what benefits its social network might yield in decades to come?
Mr. Johnson’s ideas are popular in Silicon Valley, and it is easy to see why. He is an optimist about technology and its possibilities. In his section on “Light,” he links the discovery of neon lighting to the growth of Las Vegas and then to the post-modernist movement in American art and architecture. A more raffish mind might have gone from Las Vegas to Siegfried and Roy, Wayne Newton, and the Nevada flesh trade. But Mr. Johnson is too upstanding for that. He believes that the arc of technological history may be long but that it bends toward good.”

Antidisciplinary


Joi Ito at LinkedIn: “One of the first words that I learned when I joined the Media Lab was “antidisciplinary.” It was listed an a requirement in an ad seeking applicants for a new faculty position. Interdisciplinary work is when people from different disciplines work together. An antidisciplinary project isn’t a sum of a bunch of disciplines but something entirely new – the word defies easy definition. But what it means to me is someone or something that doesn’t fit within traditional academic discipline­­­–a field of study with its own particular words, frameworks, and methods. Most academics are judged by how many times they have published in prestigious, peer-reviewed journals. Peer review usually consists of the influential members of your field reviewing your work and deciding whether it is important and unique. This architecture often leads to a dynamic where researchers focus more on impressing a small number of experts in their own field than on taking the high risk of an unconventional approach. This dynamic reinforces the cliché of academics–learning more and more about less and less. It causes a hyper-specialization where people in different areas have a very difficult time collaborating–or even communicating–with people in different fields. For me, antidisciplinary research is akin to mathematician Stanislaw Ulam’s famous observation that the study of non-linear physics is like the study of “non-elephant animals.” Antidisciplinary is all about the non-elephant animals.
The Media Lab focuses on “uniqueness, impact and magic.” What our students and faculty do should be unique. We shouldn’t be doing something that someone else is doing. If someone else starts doing it, we should stop. Everything we do should have impact. Lastly, things should induce us to be passionate and should go beyond incremental thinking. “Magic” means that we take on projects that inspire us. In the Lifelong Kindergarten group, researchers often describe the “Four Ps of Creative Learning” as Projects, Peers, Passion and Play. Play is extremely important for creative learning. There is a great deal of research showing that rewards and pressure can motivate people to “produce,” but creative learning and thinking requires the “space” that play creates. Pressure and rewards can often diminish that space, and thus, squash creative thinking….”

Smarter video games, thanks to crowdsourcing


AAAS –Science Magazine: “Despite the stereotypes, any serious gamer knows it’s way more fun to play with real people than against the computer. Video game artificial intelligence, or AI, just isn’t very good; it’s slow, predictable, and generally stupid. All that stands to change, however, if GiantOtter, a Massachusetts-based startup, has its way, New Scientist reports. By crowdsourcing the AI’s learning, GiantOtter hopes to build systems where the computer can learn based on player’s previous behaviors, decision-making, and even voice communication—yes, the computer is listening in as you strategize. The hope is that by abandoning the traditional scripted programming models, AIs can be taught to mimic human behaviors, leading to more dynamic and challenging scenarios even in incredibly complex games like Blizzard Entertainment Inc.’s professionally played StarCraft II.