Thomas Lin in Quanta Magazine: “As science dives into an ocean of data, the demands of large-scale interdisciplinary collaborations are growing increasingly acute…Seven years ago, when David Schimel was asked to design an ambitious data project called the National Ecological Observatory Network, it was little more than a National Science Foundation grant. There was no formal organization, no employees, no detailed science plan. Emboldened by advances in remote sensing, data storage and computing power, NEON sought answers to the biggest question in ecology: How do global climate change, land use and biodiversity influence natural and managed ecosystems and the biosphere as a whole?…
For projects like NEON, interpreting the data is a complicated business. Early on, the team realized that its data, while mid-size compared with the largest physics and biology projects, would be big in complexity. “NEON’s contribution to big data is not in its volume,” said Steve Berukoff, the project’s assistant director for data products. “It’s in the heterogeneity and spatial and temporal distribution of data.”
Unlike the roughly 20 critical measurements in climate science or the vast but relatively structured data in particle physics, NEON will have more than 500 quantities to keep track of, from temperature, soil and water measurements to insect, bird, mammal and microbial samples to remote sensing and aerial imaging. Much of the data is highly unstructured and difficult to parse — for example, taxonomic names and behavioral observations, which are sometimes subject to debate and revision.
And, as daunting as the looming data crush appears from a technical perspective, some of the greatest challenges are wholly nontechnical. Many researchers say the big science projects and analytical tools of the future can succeed only with the right mix of science, statistics, computer science, pure mathematics and deft leadership. In the big data age of distributed computing — in which enormously complex tasks are divided across a network of computers — the question remains: How should distributed science be conducted across a network of researchers?
Part of the adjustment involves embracing “open science” practices, including open-source platforms and data analysis tools, data sharing and open access to scientific publications, said Chris Mattmann, 32, who helped develop a precursor to Hadoop, a popular open-source data analysis framework that is used by tech giants like Yahoo, Amazon and Apple and that NEON is exploring. Without developing shared tools to analyze big, messy data sets, Mattmann said, each new project or lab will squander precious time and resources reinventing the same tools. Likewise, sharing data and published results will obviate redundant research.
To this end, international representatives from the newly formed Research Data Alliance met this month in Washington to map out their plans for a global open data infrastructure.”
User-Generated Content Is Here to Stay
Azeem Khan in the Huffington Post: “The way media are transmitted has changed dramatically over the last 10 years. User-generated content (UGC) has completely changed the landscape of social interaction, media outreach, consumer understanding, and everything in between. Today, UGC is media generated by the consumer instead of the traditional journalists and reporters. This is a movement defying and redefining traditional norms at the same time. Current events are largely publicized on Twitter and Facebook by the average person, and not by a photojournalist hired by a news organization. In the past, these large news corporations dominated the headlines — literally — and owned the monopoly on public media. Yet with the advent of smartphones and spread of social media, everything has changed. The entire industry has been replaced; smartphones have supplanted how information is collected, packaged, edited, and conveyed for mass distribution. UGC allows for raw and unfiltered movement of content at lightening speed. With the way that the world works today, it is the most reliable way to get information out. One thing that is for certain is that UGC is here to stay whether we like it or not, and it is driving much more of modern journalistic content than the average person realizes.
Think about recent natural disasters where images are captured by citizen journalists using their iPhones. During Hurricane Sandy, 800,000 photos uploaded onto Instagram with “#Sandy.” Time magazine even hired five iPhoneographers to photograph the wreckage for its Instagram page. During the May 2013 Oklahoma City tornadoes, the first photo released was actually captured by a smartphone. This real-time footage brings environmental chaos to your doorstep in a chillingly personal way, especially considering the photographer of the first tornado photos ultimately died because of the tornado. UGC has been monumental for criminal investigations and man-made catastrophes. Most notably, the Boston Marathon bombing was covered by UGC in the most unforgettable way. Dozens of images poured in identifying possible Boston bombers, to both the detriment and benefit of public officials and investigators. Though these images inflicted considerable damage to innocent bystanders sporting suspicious backpacks, ultimately it was also smartphone images that highlighted the presence of the Tsarnaev brothers. This phenomenon isn’t limited to America. Would the so-called Arab Spring have happened without social media and UGC? Syrians, Egyptians, and citizens from numerous nations facing protests can easily publicize controversial images and statements to be shared worldwide….
This trend is not temporary but will only expand. The first iPhone launched in 2007, and the world has never been the same. New smartphones are released each month with better cameras and faster processors than computers had even just a few years ago….”
The transition towards transparency
More recently the Technology Strategy Board have been working with the likes of NERC, Met Office, Environment Agency and other public agencies to help solve business problems using environmental data.…
It goes without saying that data won’t leap up and create any value by itself any more than a pile of discarded parts outside a factory will assemble themselves into a car. We’ve found that the secret of successful open data innovation is to be with people working to solve some specific problem. Simply releasing the data is not enough. See below a summary of our Do’s and Don’ts of opening up data
Do…
- Make sure data quality is high (ODI Certificates can help!)
- Promote innovation using data sets. Transparency is only a means to an end
- Enhance communication with external innovators
- Make sure your co-creators are incentivised
- Get organised, create a community around an issue
- Pass on learnings to other similar organisations
- Experiement – open data requires new mindsets and business models
- Create safe spaces – Innovation Airlocks – to share and prototype with trusted partners
- Be brave – people may do things with the data that you don’t like
- Set out to create commercial or social value with data
Dont…
- Just release data and expect people to understand or create with it. Publication is not the same as communication
- Wait for data requests, put the data out first informally
- Avoid challenges to current income streams
- Go straight for the finished article, use rapid prototyping
- Be put off by the tensions between confidentiality, data protection and publishing
- Wait for the big budget or formal process but start big things with small amounts now
- Be technology led, be business led instead
- Expect the community to entirely self-manage
- Restrict open data to the IT literate – create interdisciplinary partnerships
- Get caught in the false dichotomy that is commercial vs. social
In summary we believe we need to assume openness as the default (for organisations that is, not individuals) and secrecy as the exception – the exact opposite to how most commercial organisations currently operate. …”
MyUSA
“MyUSA (formerly known as MyGov) is creating a new service that helps Americans find the information and services they need across the Federal Government. Rather than organizing services around the agencies that deliver them, as most Federal websites do today, MyUSA organizes services around people and the specific tasks they need to complete. Building on the work of the inaugural class of MyUSA Presidential Innovation Fellows, motivated by President Obama’s call for a smarter, leaner government, and inspired by innovative models of collaboration in the private sector, the Round 2 MyUSA Fellows will take the MyUSA service to the next level.
In particular, small businesses and exporters have a fundamental problem navigating the Federal Government’s myriad resources. It can be difficult to locate information about government assistance programs or find and complete the correct forms for taxes or business operations. MyUSA is working to solve these problems. The project team will build and beta-test new features and tools for entrepreneurs and businesses with the purpose of cutting red tape, increasing efficiency, and supporting American businesses and American jobs.
MyUSA will save people and businesses time when transacting with the government, increase awareness of available government services, and speed up notifications and updates. MyUSA has the potential not only to save Americans time and money, but to reshape how they interact with and view their government.”
Prizes and Productivity: How Winning the Fields Medal Affects Scientific Output
New NBER working paper by George J. Borjas and Kirk B. Doran: “Knowledge generation is key to economic growth, and scientific prizes are designed to encourage it. But how does winning a prestigious prize affect future output? We compare the productivity of Fields medalists (winners of the top mathematics prize) to that of similarly brilliant contenders. The two groups have similar publication rates until the award year, after which the winners’ productivity declines. The medalists begin to “play the field,” studying unfamiliar topics at the expense of writing papers. It appears that tournaments can have large post-prize effects on the effort allocation of knowledge producers.”
New book: "Crowdsourcing"
New book by Jean-Fabrice Lebraty, Katia Lobre-Lebraty on Crowdsourcing: “Crowdsourcing is a relatively recent phenomenon that only appeared in 2006, but it continues to grow and diversify (crowdfunding, crowdcontrol, etc.). This book aims to review this concept and show how it leads to the creation of value and new business opportunities.
Chapter 1 is based on four examples: the online-banking sector, an informative television channel, the postal sector and the higher education sector. It shows that in the current context, for a company facing challenges, the crowd remains an untapped resource. The next chapter presents crowdsourcing as a new form of externalization and offers definitions of crowdsourcing. In Chapter 3, the authors attempt to explain how a company can create value by means of a crowdsourcing operation. To do this, authors use a model linking types of value, types of crowd, and the means by which these crowds are accessed.
Chapter 4 examines in detail various forms that crowdsourcing may take, by presenting and discussing ten types of crowdsourcing operation. In Chapter 5, the authors imagine and explore the ways in which the dark side of crowdsourcing might be manifested and Chapter 6 offers some insight into the future of crowdsourcing.
Contents
1. A Turbulent and Paradoxical Environment.
2. Crowdsourcing: A New Form of Externalization.
3. Crowdsourcing and Value Creation.
4. Forms of Crowdsourcing.
5. The Dangers of Crowdsourcing.
6. The Future of Crowdsourcing.”
GovLab Seeks Open Data Success Stories
Novek, who served in the White House as the first U.S. deputy CTO and led the White House Open Government Initiative from 2009-2011, founded GovLab while also teaching at the MIT Media Lab and NYU’s Robert F. Wagner Graduate School of Public Service.
In an interview with InformationWeek Government, Gurin explained that the goal of GovLab, and the Open Data 500 project, is to show how technology and new uses of data can make government more effective, and create more of a partnership between government and the public. “We’re also trying to draw on more public expertise to solve government problems,” he said….
Gurin said Open Data 500 will primarily look at U.S.-based, revenue-producing companies or organizations where government data is a key resource for their business. While the GovLab will focus initially on the use of federal data, it will also look at cases where entrepreneurs are making use of state or local data, but in scalable fashion.
“This goes one step further than the datapaloozas” championed by U.S. CTO Todd Park to showcase tools developed by the private sector using government data. “We’re trying to show how we can make data sets even more impactful and useful.”
Gurin said the GovLab team hopes to complete the study by the end of this year. The team has already identified 150 companies as candidates. To submit your company for consideration, visit thegovlab.org/submit-your-company; to submit another company, visit thegovlab.org/open500“
A Manifesto for Smart Citizens
Frank Kresin from the Waag Society: “We, citizens of all cities, take the fate of the places we live in into our own hands. We care about the familiar buildings and the parks, the shops, the schools, the roads and the trees, but far more about the quality of the life we live in them. About the casual interactions, uncalled for encounters, the craze and the booze and the love we lost and found. We know that our lives are interconnected, and what we do here will impact the outcomes over there. While we can never predict the eventual effect of our actions, we take full responsibility to make this world a better place.
Therefore, we will refuse to be consumers, client and informants only, and reclaim agency towards the processes, algorithms and systems that shape our world. We need to know how decisions are made, we need to have the information that is at hand; we need to have direct access to the people in power, and be involved in the crafting of laws and procedures that we grapple with everyday.
Fortunately, we are not alone. We are well educated and have appropriated the tools to connect at the touch of a button, organize ourselves, make our voices heard. We have the tools to measure ourselves and our environment, to visualize and analyse the data, to come to conclusions and take action. We have continuous access to the best of learning in the world, to powerful phones and laptops and software, and to home-grown labs that help us make the things that others won’t. Furthermore we were inspired by such diverse examples as the 1% club, Avaaz, Kickstarter, Couchsurfing, Change by Us, and many, many more.
We are ready. But government is not. It was shaped in the 18th century, but increasingly struggles with 21st century problems it cannot solve. It lost touch with its citizens and is less and less equipped to provide the services and security it had pledged to offer. While it tries to build ‘smart cities’ that reinforce or strengthen the status quo – that was responsible for the problems in the first place – it loses sight of the most valuable resource it can tap into: the smart citizen.
Smart Citizens:
- Will take responsibility for the place they live, work and love in;
- Value access over ownership, contribution over power;
- Will ask forgiveness, not permission;
- Know where they can get the tools, knowledge and support they need;
- Value empathy, dialogue and trust;
- Appropriate technology, rather than accept it as is;
- Will help the people that struggle with smart stuff;
- Ask questions, then more questions, before they come up with answers;
- Actively take part in design efforts to come up with better solutions;
- Work agile, prototype early, test quickly and know when to start over;
- Will not stop in the face of seemingly huge boundariesbarriers;
- Unremittingly share their knowledge and their learning, because they know this is where true value comes from.
All over the world, smart citizens take action. We self-organise, form cooperations, share resources and take back full responsibility for the care of our children and elderly. We pop up restaurants, harvest renewable energy, maintain urban gardens, build temporary structures and nurture compassion and trust. We kickstart the products and services we care about, repair and upcycle, or learn how to manufacture things ourselves. We even coined new currencies in response to events that recently shook our comfortable world, but were never solved by the powers that be.
Until now, we have mostly worked next to governments, sometimes against them, but hardly ever with them. As a result, many of the initiatives so far have been one-offs, inspiring but not game changing. We have put lots of energy into small-scale interventions that briefly flared and then returned to business as usual. Just imagine what will happen if our energy, passion and knowledge are teamed up by governments that know how to implement and scale up. Governments that take full responsibility for participating in the open dialogue that is needed to radically rethink the systems that were built decades ago.
One day we will wake up and realise WE ARE OUR GOVERNMENT. Without us, there is nobody there. As it takes a village to raise a child, it takes a people to craft a society. We know it can be done; it was done before. And with the help of new technologies it is easier than ever. So let’s actively set out to build truly smart cities, with smart citizens at their helms, and together become the change that we want to see in this world.”
A Theory of Creepy: Technology, Privacy and Shifting Social Norms
Omer Tene and Jules Polonetsky in Yale Journal of Law & Technology: “The rapid evolution of digital technologies has hurled to the forefront of public and legal discourse dense social and ethical dilemmas that we have hardly begun to map and understand. In the near past, general community norms helped guide a clear sense of ethical boundaries with respect to privacy. One does not peek into the window of a house even if it is left open. One does not hire a private detective to investigate a casual date or the social life of a prospective employee. Yet with technological innovation rapidly driving new models for business and inviting new types of personal socialization, we often have nothing more than a fleeting intuition as to what is right or wrong. Our intuition may suggest that it is responsible to investigate the driving record of the nanny who drives our child to school, since such tools are now readily available. But is it also acceptable to seek out the records of other parents in our child’s car pool or of a date who picks us up by car? Alas, intuitions and perceptions of “creepiness” are highly subjective and difficult to generalize as social norms are being strained by new technologies and capabilities. And businesses that seek to create revenue opportunities by leveraging newly available data sources face huge challenges trying to operationalize such subjective notions into coherent business and policy strategies.
This article presents a set of social and legal considerations to help individuals, engineers, businesses and policymakers navigate a world of new technologies and evolving social norms. These considerations revolve around concepts that we have explored in prior work, including enhanced transparency; accessibility to information in usable format; and the elusive principle of context.”
Measuring the Internet Economy
New OECD Report: “The Internet began as a way of linking different computers over the phone network, but it now connects billions of users worldwide from wherever they happen to be via portable or fixed devices. The Internet began as an important tool for improving communication but has transformed into a universal technology supporting all virtually sectors across the economy, just like electricity or steam engine did in the past. Given the growing importance of the Internet as a policy tool, the question about the value of the Internet economy becomes particularly relevant.
There is a high level of interest, therefore, in being able to measure the size of the Internet economy as a way to understand the effects of various investment strategies, regulatory rulings and policy decisions. The existing OECD research presented in this report and in the Internet Economy Outlook illustrates the importance of establishing an international definition and the need to develop related policies. According to one of the approaches, at least 3.2% and up to 13.8% of business sector value added in the United States in 2011 could be attributed to Internet-related activities depending on the scope of the definition. It needs to be highlighted that the respective figures for 2010 were 3% and up to 13%. This indicates that the Internet economy has reported a steady growth rate since 2010.”