Hungry Planet: Can Big Data Help Feed 9 Billion Humans?


at NBC News: “With a population set to hit 9 billion human beings by 2050, the world needs to grow more food —without cutting down forests and jungles, which are the climate’s huge lungs.

The solution, according to one soil management scientist, is Big Data.

Kenneth Cassman, an agronomist at the University of Nebraska, Lincoln, recently unveiled a new interactive mapping tool that shows in fine-grain detail where higher crop yields are possible on current arable land.

“By some estimates, 20 to 30 percent of greenhouse gas emissions are associated with agriculture and of that a large portion is due to conversion of natural systems like rainforests or grassland savannahs to crop production, agriculture,” Cassman told NBC News at a conference in suburban Seattle.

The only practical way to stop the conversion of wild lands to farmland is grow more food on land already dedicated to agriculture, he said. Currently, the amount of farmland used to produce rice, wheat, maize and soybean, he noted, is expanding at a rate of about 20 million acres a year.

Cassman and colleagues unveiled the Global Yield Gap and Water Productivity Atlas in October at the Water for Food conference. The atlas was six years and $6 million in the making and contains site-specific data on soil, climate and cropping systems to determine potential yield versus actual yield farm by farm in nearly 20 countries around the world. Projects are ongoing to secure data for 30 more countries….

A key initiative going forward is to teach smallholder farmers how to use the atlas, Cassman said. Until now, the tool has largely rested with agricultural researchers who have validated its promise of delivering information that can help grow more food on existing farmland….

New Tool in Fighting Corruption: Open Data


Martin Tisne at Omidyar Network: “Yesterday in Brisbane, the G20 threw its weight behind open data by featuring it prominently in the G20 Anti-Corruption working action plan. Specifically, the action plan calls for effort in three related areas:

(1)   Prepare a G20 compendium of good practices and lessons learned on open data and its application in the fight against corruption
(2)   Prepare G20 Open Data Principles, including identifying areas or sectors where their application is particularly useful
(3)   Complete self‑assessments of G20 country open data frameworks and initiatives

Open data describes information that is not simply public, but that has been published in a manner that makes it easy to access and easy to compare and connect with other information.
This matters for anti corruption – if you are a journalist or a civil society activist investigating bribery and corruption those connections are everything. They tell you that an anonymous person (e.g. ‘Mr Smith’) who owns an obscure company registered in a tax haven is linked to a another company that has been illegally exporting timber from a neighboring country. That the said Mr. Smith is also the son-in-law of the mining minister of yet another country, who herself has been accused of embezzling mining revenues. As we have written elsewhere on this blog, investigative journalists, prosecution authorities, and civil society groups all need access to this linked data for their work.
The action plan also links open data to the wider G20 agenda, citing its impact on the ability of businesses to make better investment decisions. You can find the full detail here….”

Design for Policy


New book edited by Christian Bason:Design for Policy is the first publication to chart the emergence of collaborative design approaches to innovation in public policy. Drawing on contributions from a range of the world’s leading academics, design practitioners and public managers, it provides a rich, detailed analysis of design as a tool for addressing public problems and capturing opportunities for achieving better and more efficient societal outcomes.
In his introduction, Christian Bason suggests that design may offer a fundamental reinvention of the art and craft of policy making for the twenty-first century. From challenging current problem spaces to driving the creative quest for new solutions and shaping the physical and virtual artefacts of policy implementation, design holds a significant yet largely unexplored potential.
The book is structured in three main sections, covering the global context of the rise of design for policy, in-depth case studies of the application of design to policy making, and a guide to concrete design tools for policy intent, insight, ideation and implementation. The summary chapter lays out a future agenda for design in government, suggesting how to position design more firmly on the public policy stage.
Design for Policy is intended as a resource for leaders and scholars in government departments, public service organizations and institutions, schools of design and public management, think tanks and consultancies that wish to understand and use design as a tool for public sector reform and innovation….More: Full contents list; Introduction – The Design for Policy Nexus.”
 

Building a complete Tweet index


Yi Zhuang (@yz) at Twitter: “Since that first simple Tweet over eight years ago, hundreds of billions of Tweets have captured everyday human experiences and major historical events. Our search engine excelled at surfacing breaking news and events in real time, and our search index infrastructure reflected this strong emphasis on recency. But our long-standing goal has been to let people search through every Tweet ever published.
This new infrastructure enables many use cases, providing comprehensive results for entire TV and sports seasons, conferences (#TEDGlobal), industry discussions (#MobilePayments), places, businesses and long-lived hashtag conversations across topics, such as #JapanEarthquake, #Election2012, #ScotlandDecides, #HongKong, #Ferguson and many more. This change will be rolling out to users over the next few days.
In this post, we describe how we built a search service that efficiently indexes roughly half a trillion documents and serves queries with an average latency of under 100ms….”

Innovating Practice in a Culture of Expertise


Aleem Walji at SSI Review: “When I joined the World Bank five years ago to lead a new innovation practice, the organization asked me to help expand the space for experimentation and learning with an emphasis on emergent technologies. But that mandate was intimidating and counter-intuitive in an “expert-driven” culture. Experts want detailed plans, budgets, clear success indicators, and minimal risk. But innovation is about managing risk and navigating uncertainty intelligently. You fail fast and fail forward. It has been a step-by-step process, and the journey is far from over, but the World Bank today sees innovation as essential to achieving its mission.
It’s taught me a lot about seeding innovation in a culture of expertise, including phasing change across approaches to technology, teaming, problem solving, and ultimately leadership.
Innovating technologies: As a newcomer, my goal was not to try to change the World Bank’s culture. I was content to carve out a space where my team could try new things we couldn’t do elsewhere in the institution, learn fast, and create impact. Our initial focus was leveraging technologies with approaches that, if they took root, could be very powerful.
Over the first 18 to 24 months, we served as an incubator for ideas and had a number of successes that built on senior management’s support for increased access to information. The Open Data Initiative, for example, made our trove of information on countries, people, projects, and programs widely available and searchable. To our surprise, people came in droves to access it. We also launched the Mapping for Results initiative, which mapped project results and poverty data to show the relationship between where we lend and where the poor live, and the results of our work. These programs are now mainstream at the World Bank and have penetrated other development institutions….
Innovating teams: The lab idea—phase two—would require collaboration and experimentation in an unprecedented way. For example, we worked with other parts of the World Bank and a number of outside organizations to incubate the Open Development Technology Alliance, now part of the digital engagement unit of the World Bank. It worked to enhance accountability, and improve the delivery and quality of public services through technology-enabled citizen engagement such as using mobile phones, interactive mapping, and social media to draw citizens into collective problem mapping and problem solving….
Innovating problem solving: At the same time, we recognized that we face some really complex problems that the World Bank’s traditional approach of lending to governments and supervising development projects is not solving. For this, we needed another type of lab that innovated the very way we solve problems. We needed a deliberate process for experimenting, learning, iterating, and adapting. But that’s easier said than done. At our core, we are an expert-driven organization with know-how in disciplines ranging from agricultural economics and civil engineering to maternal health and early childhood development. Our problem-solving architecture is rooted in designing technical solutions to complicated problems. Yet the hardest problems in the world defy technical fixes. We work in contexts where political environments shift, leaders change, and conditions on the ground constantly evolve. Problems like climate change, financial inclusion, food security, and youth unemployment demand new ways of solving old problems.
The innovation we most needed was innovation in the leadership architecture of how we confront complex challenges. We share knowledge and expertise on the “what” of reform, but the “how” is what we need most. We need to marry know-how with do-how. We need multiyear, multi-stakeholder, and systems approaches to solving problems. We need to get better at framing and reframing problems, integrative thinking, and testing a range of solutions. We need to iterate and course-correct as we learn what works and doesn’t work in which context. That’s where we are right now with what we call “integrated leadership learning innovation”—phase four. It’s all about shaping an innovative process to address complex problems….”

Can Government Mine Tweets to Assess Public Opinion?


at Government Technology: “What if instead of going to a city meeting, you could go on Twitter, tweet your opinion, and still be heard by those in government? New research suggests this is a possibility.
The Urban Attitudes Lab at Tufts University has conducted research on accessing “big data” on social networking sites for civic purposes, according to Justin Hollander, associate professor in the Department of Urban and Environmental Policy and Planning at Tufts.
About six months ago, Hollander began researching new ways of accessing how people think about the places they live, work and play. “We’re looking to see how tapping into social media data to understand attitudes and opinions can benefit both urban planning and public policy,” he said.
Harnessing natural comments — there are about one billion tweets per day — could help governments learn what people are saying and feeling, said Hollander. And while formal types of data can be used as proxies for how happy people are, people openly share their sentiments on social networking sites.
Twitter and other social media sites can also provide information in an unobtrusive way. “The idea is that we can capture a potentially more valid and reliable view [of people’s] opinions about the world,” he said. As an inexact science, social science relies on a wide range of data sources to inform research, including surveys, interviews and focus groups; but people respond to being the subject of study, possibly affecting outcomes, Hollander said.
Hollander is also interested in extracting data from social sites because it can be done on a 24/7 basis, which means not having to wait for government to administer surveys, like the Decennial Census. Information from Twitter can also be connected to place; Hollander has approximated that about 10 percent of all tweets are geotagged to location.
In its first study earlier this year, the lab looked at using big data to learn about people’s sentiments and civic interests in New Bedford, Mass., comparing Twitter messages with the city’s published meeting minutes.
To extract tweets over a six-week period from February to April, researchers used the lab’s own software to capture 122,186 tweets geotagged within the city that also had words pertaining to the New Bedford area. Hollander said anyone can get API information from Twitter to also mine data from an area as small as a neighborhood containing a couple hundred houses.
Researchers used IBM’s SPSS Modeler software, comparing this to custom-designed software, to leverage a sentiment dictionary of nearly 3,000 words, assigning a sentiment score to each phrase — ranging from -5 for awful feelings to +5 for feelings of elation. The lab did this for the Twitter messages, and found that about 7 percent were positive versus 5.5 percent negative, and correspondingly in the minutes, 1.7 percent were positive and .7 percent negative. In total, about 11,000 messages contained sentiments.
The lab also used NVivo qualitative software to analyze 24 key words in a one-year sample of the city’s meeting minutes. By searching for the same words in Twitter posts, the researchers found that “school,” “health,” “safety,” “parks,” “field” and “children” were used frequently across both mediums.
….
Next up for the lab is a new study contrasting Twitter posts from four Massachusetts cities with the recent election results.

We’re All Pirates Now


Book Review by Edward Kosner of “Information Doesn’t Want to Be Free”in the Wall Street Journal: “Do you feel like a thief when you click on a website link and find yourself reading an article or listening to a song you haven’t paid for? Should you? Are you annoyed when you can’t copy a movie you’ve paid for onto your computer’s hard drive? Should you be? Should copyright, conceived in England three centuries ago to protect writers from unscrupulous printers, apply the same way to creators and consumers in the digital age?
The sci-fi writer, blogger and general man-about-the-Web Cory Doctorow tries to answer some of these questions—and introduces others—in “Information Doesn’t Want to Be Free.” Billed as a guide for perplexed creators about how to make a living in the Internet Era, the book is actually a populist manifesto for the information revolution.
Mr. Doctorow is a confident and aphoristic writer—his book is like one long TED talk—and his basic advice to creators is easy to grasp: Aspiring novelists, journalists, musicians and other artists and would-be artists should recognize the Web as an unprecedented promotional medium rather than a revenue source. Creators, writes Mr. Doctorow, need to get known before they can expect to profit from their work. So they should welcome having their words, music or images reproduced online without permission to pave the way for a later payoff.
Even if they manage to make a name, he warns, they’re likely to be ripped off by the entertainment-industrial complex—big book publishers, record companies, movie studios, Google , Apple and Microsoft. But they can monetize their creativity by, among other things, selling tickets to public shows, peddling “swag”—T-shirts, ball caps, posters and recordings—and taking commissions for new work.

He cites the example of a painter named Molly Crabapple, who, inspired by the Occupy Wall Street movement, raised $55,000 on the crowdsourcing site Kickstarter, rented a storefront and created nine huge canvases, seven of which she sold for $8,000 each. Not the easiest way to become the next Jeff Koons, Taylor Swift or Gillian Flynn.
But Mr. Doctorow turns out to be less interested in mentoring unrealized talent than in promulgating a new regime for copyright regulation on the Internet. Copyright has been enshrined in American law since 1790, but computer technology, he argues, has rendered the concept obsolete: “We can’t stop copying on the Internet because the Internet is a copying machine.” And the whole debate, he complains, “is filled with lies, damn lies and piracy statistics.”
There’s lots of technical stuff here about digital locks—he calls devices like the Kindle “roach motels” that allow content to be loaded but never offloaded elsewhere—as well as algorithms, embedded keys and such. And the book is clotted with acronyms: A diligent reader who finishes this slim volume should be able to pass a test on the meaning of ACTA, WIPO, WPPT, WCT, DMCA, DNS, SOPA and PIPA, not to mention NaTD (techspeak for “Notice and Take Down”).
The gist of Mr. Doctorow’s argument is that the bad guys of the content game use copyright protection and antipiracy protocols not to help creators but to enrich themselves at the expense of the talent and the consumers of content. Similarly, he contends that the crusade against “net neutrality”—the principle that Internet carriers must treat all data and users the same way—is actually a ploy to elevate big players in the digital world by turning the rest of us into second-class Netizens.
“The future of the Internet,” he writes, “should not be a fight about whether Google (or Apple or Microsoft) gets to be in charge or whether Hollywood gets to be in charge. Left to their own devices, Big Tech and Big Content are perfectly capable of coming up with a position that keeps both ‘sides’ happy at the expense of everyone else.”…”

Get the Data Button


BetaNYC: “A Web Button to Link Web Projects with their Source Data

How to use

When building a website, report, map, data visualization, or any other project, use this button to link to the underlying data. That’s it! Tell your friends! Let’s make this a thing!
180x60
125x50
120x60
110x32
88x31
80x15
36x13
Born on a discussion of the NYC Open Data Working Group on 14 November 2014.
Icon made by Freepik from www.flaticon.com is licensed by CC BY 3.0

How to use the Internet to end corrupt deals between companies and governments


Stella Dawson at the Thomson Reuters Foundation: “Every year governments worldwide spend more than $9.5 trillion on public goods and services, but finding out who won those contracts, why and whether they deliver as promised is largely invisible.
Enter the Open Contracting Data Standard (OCDS).
Canada, Colombia, Costa Rica and Paraguay became the first countries to announce on Tuesday that they have adopted the new global standards for publishing contracts online as part of a project to shine a light on how public money is spent and to combat massive corruption in public procurement.
“The mission is to end secret deals between companies and governments,” said Gavin Hayman, the incoming executive director for Open Contracting Partnership.
The concept is simple. Under Open Contracting, the government publishes online the projects it is putting out for bid and the terms; companies submit bids online; the winning contract is published including the reasons why; and then citizens can monitor performance according to the terms of the contract.
The Open Contracting initiative, developed by the World Wide Web Foundation with the support of the World Bank and Omidyar Network, has been several years in the making and is part of a broader global movement to increase the accountability of governments by using Internet technologies to make them more transparent.
A pioneer in data transparency was the Extractive Industries Transparency Initiative, a global coalition of governments, companies and civil society that works on improving accountability by publishing the revenues received in 35 member countries for their natural resources.
Publish What You Fund is a similar initiative for the aid industry. It delivered a common open standards in 2011 for donor countries to publish how much money they gave in development aid and details of what projects that money funded and where.
There’s also the Open Government Partnership, an international forum of 65 countries, each of which adopts an action plan laying out how it will improve the quality of government through collaboration with civil society, frequently using new technologies.
All of these initiatives have helped crack open the door of government.
What’s important about Open Contracting is the sheer scale of impact it could have. Public procurement accounts for about 15 percent of global GDP and according to Anne Jellema, CEO of the World Wide Web Foundation which seeks to expand free access to the web worldwide and backed the OCDS project, corruption adds an estimated $2.3 trillion to the cost of those contracts every year.
A study by the Center for Global Development, a Washington-based think tank, looked at four countries already publishing their contracts online — the United Kingdom, Georgia, Colombia and Slovakia. It found open contracting increased visibility and encouraged more companies to submit bids, the quality and price competitiveness improved and citizen monitoring meant better service delivery….”
 

The Next Frontier of Engagement: Civic Innovation Labs


Maayan Dembo at Planetizen: “As described by Clayton Christensen, a professor at the Harvard Business School who developed the term “disruptive innovation,” a successful office for social innovation should employ four main tactics to accomplish its mission. First, governments should invest “in innovations that are developed and identified by citizens outside of government who better understand the problems.” Second, the office should support “‘bottom-up’ initiatives, in preference to ‘trickle-down’ philanthropy—because the societal impact of the former is typically greater.” Third, Christensen argues that the office should utilize impact metrics to measure performance and, finally, that it should also invest in social innovation outside of the non-profit sector.
Los Angeles’ most recent citizen-driven social innovation initiative, the Civic Innovation Lab, is an 11-month project aimed at prototyping new solutions for issues within the city of Los Angeles. It is supported by the HubLA, Learn Do Share, the Los Angeles *City  Tech Bullpen, and Innovate LA, a membership organization within the Los Angeles County Economic Development Corporation. Private and public sector support for such labs, in one of the largest cities in America, is highly unprecedented, and because this initiative in Los Angeles is a new mechanism explicitly supported by the public sector, it warrants a critical check on its motivations and accomplishments. Depending on its success, the Civic Innovation Lab could serve as a model for future municipalities.
The Los Angeles Civic Innovation Lab operates in three main phases: 1) workshops where citizens learn about the possibilities of Open Data and discuss what deep challenges face Los Angeles (called the “Discover, Define, Design” stage), 2) a call for solutions to solve the design challenges brought to light in the first phase, and 3) a six-month accelerator program to prototype selected solutions. I participated in the most recent Civic Innovation Lab session, a three-day workshop concluding the “Discover, Define, Design” phase….”