New blog post by Joel Gurin, Founder and Editor, OpenDataNow.com: When people point to the value of Open Data from government, they often cite the importance of weather data from NOAA, the National Oceanic and Atmospheric Administration. That data has given us the Weather Channel, more accurate forecasts, and a number of weather-based companies. But the most impressive – and one of the best advertisements for government Open Data – may well be The Climate Corporation, headquartered in San Francisco.
Founded in 2006 under the name WeatherBill, The Climate Corporation was started to sell a better kind of weather insurance. But it’s grown into a company that could help farmers around the world plan around climate change, increase their crop yields, and become part of a new green revolution.
The company’s work is especially relevant in light of President Obama’s speech yesterday on new plans to fight climate change. We know that whatever we do to reduce carbon emissions now, we’ll still need to deal with changes that are already irreversible. The Climate Corporation’s work can be part of that solution…
The company has developed a new service, Climate.com, that is free to policyholders and available to others for a fee….
Their work may become part of a global Green Revolution 2.0. The U.S. Government’s satellite data doesn’t stop at the border: It covers the entire planet. The Climate Corporation is now looking for ways to apply its work internationally, probably starting with Australia, which has relevant data of its own.
Start with insurance sales, end up by changing the world. The power of Open Data has never been clearer.”
Transforming Government Acquisition Systems: Overview and Selected Issues
New Report of the Congressional Research Service: “Increasingly, the federal government uses technology to facilitate and support the federal acquisition process. Primary beneficiaries of this shift to online systems (websites and databases) are the government’s acquisition workforce and prospective and incumbent government contractors. The suite of web-based systems supports contracting officers’ efforts to ensure the government contracts only with responsible parties, is essential to the dissemination of information regarding contracting opportunities, and facilitates interagency contracting. From the contractor perspective, the government’s online systems streamline the processes involved in fulfilling various administrative requirements, provide access to possible contracting opportunities, and are potential resources for market research.
Although this report does not focus on transparency, several issues discussed here are related to transparency. First, while the Federal Business Opportunities (FedBizOpps) website and FPDS-NG provide information about executive branch agencies’ procurements, a database of federal agencies’ contracts does not exist. In 2003, GSA established a working group to examine the feasibility, challenges, and anticipated benefits of posting federal contracts online. Ultimately, the working group concluded there were insufficient data to support recommending the establishment of a central system for posting contracts online. In 2010, the Department of Defense (DOD), GSA, and the National Aeronautics and Space Administration (NASA) issued an advance notice of proposed rulemaking (ANPR) regarding posting contracts online. Comments submitted in response to the notice identified several challenges, and the matter was concluded when the agencies withdrew the ANPR. Second, transparency does not necessarily equate to comprehension. Generally, variation exists among the users of government procurement systems regarding their knowledge of government procurement and procurement data. Third, during the 113th Congress, two similar bills (H.R. 2061 and S. 994) with the same name (Digital Accountability and Transparency Act, or DATA Act) were introduced, either of which would enhance transparency of spending data, including certain procurement data. If either bill is enacted, it might have implications for FPDS-NG.”
Sensing and Shaping Emerging Conflicts
A new Report of a Joint Workshop of the National Academy of Engineering and the United States Institute of Peace: Roundtable on Technology, Science, and Peacebuilding: “Technology has revolutionized many aspects of modern life, from how businesses operate, to how people get information, to how countries wage war. Certain technologies in particular, including not only cell phones and the Internet but also satellites, drones, and sensors of various kinds, are transforming the work of mitigating conflict and building peaceful societies. Rapid increases in the capabilities and availability of digital technologies have put powerful communications devices in the hands of most of the world’s population.
These technologies enable one-to-one and one-to-many flows of information, connecting people in conflict settings to individuals and groups outside those settings and, conversely, linking humanitarian organizations to people threatened by violence. Communications within groups have also intensified and diversified as the group members use new technologies to exchange text, images, video, and audio. Monitoring and analysis of the flow and content of this information can yield insights into how violence can be prevented or mitigated. In this way technologies and the resulting information can be used to detect and analyze, or sense, impending conflict or developments in ongoing conflict.”
G8 Open Data Charter: "Open Data by Default" will "fuel innovation"
G8 Open Data Charter, June 2013: “Principle 1: Open Data by Default
13. We recognise that free access to, and subsequent re-use of, open data are of significant value to society and the economy.
14. We agree to orient our governments towards open data by default.
15. We recognise that the term government data is meant in the widest sense possible. This could apply to data owned by national, federal, local, or international government bodies, or by the wider public sector.
16. We recognise that there is national and international legislation, in particular pertaining to intellectual property, personally-identifiable and sensitive information, which must be observed.
17. We will: establish an expectation that all government data be published openly by default , as outlined in this Charter, while recognising that there are legitimate reasons why some data cannot be released….
Principle 4: Releasing Data for Improved Governance
25. We recognise that the release of open data strengthens our democratic institutions and encourages better policy-making to meets the needs of our citizens. This is true not only in our own countries but across the world.
26. We also recognise that interest in open data is growing in other multilateral organisations and initiatives.
27. We will: share technical expertise and experience with each other and with other countries across the world so that everyone can reap the benefits of open data; and be transparent about our own data collection, standards, and publishing processes , by documenting all of these related processes online.
Principle 5: Releasing Data for Innovation
28. Recognising the importance of diversity in stimulating creativity and innovation, we agree that the more people and or ganisations that use our data, the greater the social and economic benefits that will be generated. This is true for both commercial and non-commercial uses .
29. We will: work to increase open data literacy and encourage people, such as developers of applications and civil society organisations that work in the field of open data promotion, to unlock the value of open data ; empower a future generation of data innovators by providing data in machine-readable formats.”
See also:
Professor Sir Nigel Shadbolt, Chairman and Co-Founder, Open Data Institute on G8 Open Data Charter: why it matters
Nick Sinai and Marina Martin from the White House on Open Data Going Global
When Ordinary Americans Accomplish What the Government Can’t
Ronald Brownstein in The National Journal: “Washington may be paralyzed by partisanship, but across the country, grassroots innovators are crafting solutions to our problems….This special issue of National Journal celebrates these pragmatic problem-solvers in business, the civic sector, local government, and partnerships that creatively combine all three. At a time of endemic stalemate in the nation’s capital, think of it as a report from the America that works (to borrow a recent phrase from The Economist)….
Another significant message is that the communications revolution, by greatly accelerating the sharing of ideas, has produced a “democratization of innovation,” as author Vijay Vaitheeswaran put it in his 2012 book, Need, Speed, and Greed. This dynamic has simultaneously allowed breakthroughs to disseminate faster than ever and empowered more people inside companies and communities to tackle problems previously left to elites. “One of the most interesting stories in social change today is how much creative problem-solving is emerging from citizens scattered far and wide who are taking it upon themselves to fix things and who, in many cases, are outperforming traditional organizations,” David Bornstein, founder of the Dowser.org website that tracks social innovation, wrote in The New York Times last year. Our honoree Eric Greitens, the former Navy SEAL who founded The Mission Continues for other post-9/11 veterans, personifies this trend. Across the categories, many honorees insist they have pursued new approaches in part because they could no longer wait for Washington to address the problems they face. In a world where barriers to the dispersal of ideas are crumbling, waiting for elites to propose answers may soon seem as outdated as waiting for a dial-up connection to the Internet.
The third conclusion limits the first two. Even many of the most dynamic grassroots innovations will remain isolated islands of excellence in this continent-sized society without energy and amplification from the top. Donald Kettl, dean of the University of Maryland’s School of Public Policy, notes the federal government is unavoidably a major force on many of the challenges facing America, particularly reforming education, health care, and training; developing regional economic strategies; and providing physical and digital infrastructure. Washington need not direct or control the response to these problems, but change on a massive scale is always harder without stronger signals and incentives than the federal government has provided in recent years. “It is possible to feed change aggressively from the bottom,” Kettl says. “[But] the federal government, for better or worse, inevitably is involved…. There’s a natural limit in what’s possible to bubble up from the bottom….
Special issue at https://web.archive.org/web/2013/http://www.nationaljournal.com/back-in-business ”
Data-Smart City Solutions
Press Release: “Today the Ash Center for Democratic Governance and Innovation at Harvard Kennedy School announced the launch of Data-Smart City Solutions, a new initiative aimed at using big data and analytics to transform the way local government operates. Bringing together leading industry, academic, and government officials, the initiative will offer city leaders a national depository of cases and best practice examples where cities and private partners use analytics to solve city problems. Data-Smart City Solutions is funded by Bloomberg Philanthropies and the John D. and Catherine T. MacArthur Foundation.
Data-Smart City Solutions highlights best practices, curates resources, and supports cities embarking on new data projects. The initiative’s website contains feature-length articles on how data drives innovation in different policy areas, profile pieces on municipal leaders at the forefront of implementing data analytics in their cities, and resources for interested officials to begin data projects in their own communities.
Recent articles include an assessment of Boston’s Adopt-a-Hydrant program as a potential harbinger of future city work promoting civic engagement and infrastructure maintenance, and a feature on how predictive technology is transforming police work. The site also spotlights municipal use of data such as San Francisco’s efforts to integrate data from different social service departments to better identify and serve at-risk youth. In addition to visiting the initiative’s website, Data-Smart City Solutions’ work is chronicled in their newsletter as well as on their Twitter page.”
Why Governments Use Broadcast TV and Dissidents Use Twitter
Philip Howard in The Atlantic: “Everyone in Turkey can tell a story about how they turned on the TV hoping for news about current events, but found game shows, beauty pageants, and nature documentaries. Even Erdogan’s devotees know that the state-run news programs are grindingly uncritical. The pall of media control even has an impact on foreign broadcasters like CNN, which aired a penguin documentary within Turkey while its international broadcasters covered the clashes. Even when the country’s newspapers and broadcasters began reporting on the crisis, they spun the story as being violent and local to Istanbul. Another friend, who attended the protests on Saturday, said “you see misinformation on Twitter. But social media has played a corrective role to faults in the other available media.” On the days he joined in, he was part of peaceful demonstrations, and he found the Twitter streams telling stories about how the protests were country-wide and mostly nonviolent.
These days, Turks find themselves caught in the crossfire between highly politicized media organizations, so it is not surprising that when people want news they trust their own networks. The country has a dedicated community of startups designing apps, building games and generating content for the country’s rapidly growing population of internet and mobile phone users. Half of the country’s 75 million people are under 30. Half of Turkish citizens are online, and they are Facebook’s seventh largest national audience. Government ministers and strategists do have Twitter accounts, but they still tend to treat social media as a broadcast tool, a way of pushing their perspectives out to followers. Erdogan has a twitter account with more than 2.5 million followers, but recently opined that “This thing called social media is a curse on societies”….
This isn’t just happening in Turkey: In moments of political and military crisis, people want to control their media and connect with family and friends. And ruling elites respond by investing in broadcast media and censoring and surveilling digital networks. So the battles between political elites who use broadcast media and the activists who use digital media are raging in other parts of the world, as well.”
UK launches Information Economy Strategy
Open Data Institute: “The Information Economy Strategy sets out a range of key actions, including:
- Digitally transforming 25 of the top 50 UK public services over the next 300 days, including plans to give businesses a single, online view of their tax records
- Launching a new programme to help 1.6 million SMEs scale up their business online over the next five years.
- Publishing a data capability strategy in October 2013, developed in partnership with government, industry and academia. The strategy will build on the recommendations in Stephan Shakespeare’s review of Public Sector Information and the Prime Minister’s Council for Science and Technology’s report on algorithms, and will be published alongside the Open Government Partnership National Action Plan.
- Establishing the world’s first facility for testing state of the art 5G mobile technology, working with industry and the University of Surrey.”
The Future of Internet Governance: 90 Places to Start
Council on Foreign Relations Blog: “The open, global Internet, which has created untold wealth and empowered billions of individuals, is in jeopardy. Around the world, “nations are reasserting sovereignty and territorializing cyberspace” to better control the political, economic, social activities of their citizens, and the content they can access. These top-down efforts undermine the Internet’s existing decentralized, multi-stakeholder system of governance and threaten its fragmentation into multiple national intranets. To preserve an open system that reflects its interests and values while remaining both secure and resilient, the United States must unite a coalition of like-minded states committed to free expression and free markets and prepared to embrace new strategies to combat cyber crime and rules to govern cyber warfare.
These are the core messages of the just-released CFR report, Defending an Open, Global, Resilient, and Secure Internet. The product of a high-level task force, chaired by former Director of National Intelligence John D. Negroponte and former IBM Chairman Samuel J. Palmisano, the report opens by describing the epochal transformation the Internet has wrought on societies and economies worldwide—particularly in the developing world.
Facilitating this unprecedented connectivity has been a framework based not on governmental (or intergovernmental) fiat but on “self-regulation, private sector leadership, and a bottom-up policy process.” By leaving regulation in the hands of technical experts, private sector actors, civil society groups, and end-users, the pioneers of the early Internet ensured that it would “reflect a broad range of perspectives and keep pace with rapidly changing technology.” They also ensured that rights of free expression and privacy would emerge as dominant norms….
Given current trends, can the United States possibly preserve the open global internet? Yes, but the first step is getting its own house in order. Distressingly, the U.S. government lacks a coherent strategic vision, an adequate policy coordination framework, and the requisite legislative authorities to develop and implement a national cyberspace policy, undercutting its global leadership.
Beyond this general guidance, the CFR task force offers some ninety (!) recommendations for U.S. policymakers.”
First, they gave us targeted ads. Now, data scientists think they can change the world
Derrick Harris in Gigaom: “The best minds of my generation are thinking about how to make people click ads … That sucks.” – Jeff Hammerbacher, co-founder and chief scientist, Cloudera
Well, something has to pay the bills. Thankfully, there’s also a sweeping trend in the data science world right now around bringing those skills to bear on some really meaningful problems, …
We’ve already covered some of these efforts, including the SumAll Foundation’s work on modern-day slavery and future work on child pornography. Closely related is the effort — led by Google.org’s deep pockets — to create an international hotline network for reporting human trafficking and collecting data. Microsoft, in particular Microsoft Research’s danah boyd, has been active in helping fight child exploitation using technology.
This week, I came across two new efforts on different ends of the spectrum. One is ActivityInfo, which describes itself on its website as “an online humanitarian project monitoring tool” — developed by Unicef and a consulting firm called BeDataDriven — that “helps humanitarian organizations to collect, manage, map and analyze indicators….
The other effort I came across is DataKind, specifically its work helping the New York City Department of Parks and Recreations, or NYC Parks, quantify the benefits of a strategic tree-pruning program. Founded by renowned data scientists Drew Conway and Jake Porway (who’s also the host of the National Geographic channel’s The Numbers Game), DataKind exists for the sole purpose of helping non-profit organizations and small government agencies solve their most-pressing data problems.”