HBR Working Paper by Andrea Blasco et al: “Open data science and algorithm development competitions offer a unique avenue for rapid discovery of better computational strategies. We highlight three examples in computational biology and bioinformatics research where the use of competitions has yielded significant performance gains over established algorithms. These include algorithms for antibody clustering, imputing gene expression data, and querying the Connectivity Map (CMap). Performance gains are evaluated quantitatively using realistic, albeit sanitized, data sets. The solutions produced through these competitions are then examined with respect to their utility and the prospects for implementation in the field. We present the decision process and competition design considerations that lead to these successful outcomes as a model for researchers who want to use competitions and non-domain crowds as collaborators to further their research….(More)”.
Using massive online choice experiments to measure changes in well-being
Paper by Erik Brynjolfsson, Avinash Collis, and Felix Eggers: “Gross domestic product (GDP) and derived metrics such as productivity have been central to our understanding of economic progress and well-being. In principle, changes in consumer surplus provide a superior, and more direct,
For example, the median user needed
Crowdsourcing Change: A Novel Vantage Point for Investigating Online Petitioning Platforms
Presentation by Shipi Dhanorkar and Mary Beth Rosson: “The internet connects people who are spatially and temporally separated. One result is new modes of reaching out to, organizing and mobilizing people, including online activism. Internet platforms can be used to mobilize people around specific concerns, short-circuiting structures such as organizational hierarchies or elected officials. These online processes allow consumers and concerned citizens to voice their opinions, often to businesses, other times to civic groups or other authorities. Not surprisingly, this opportunity has encouraged a steady rise in specialized platforms dedicated to online petitioning; eg., Change.org, Care2 Petitions, MoveOn.org, etc.
These platforms are open to everyone; any individual or group who is affected by a problem or disappointed with the status quo, can raise awareness for or against corporate or government policies. Such platforms can empower ordinary citizens to bring about social change, by leveraging support from the masses. In this sense, the platforms allow citizens to “crowdsource change”. In this paper, we offer a comparative analysis of the affordances of four online petitioning platforms, and use this analysis to propose ideas for design enhancements to online petitioning platforms….(More)”.
Using street imagery and crowdsourcing internet marketplaces to measure motorcycle helmet use in Bangkok, Thailand
Hasan S. Merali, Li-Yi Lin, Qingfeng Li, and Kavi Bhalla in Injury Prevention: “The majority of Thailand’s road traffic deaths occur on
Using Google Maps, 3000 intersections in Bangkok were selected at random. At each intersection, hyperlinks of four images 90° apart were extracted. These 12 000 images were processed in Amazon Mechanical Turk using crowdsourcing to identify images containing motorcycles. The remaining images were sorted manually to determine helmet use
After processing, 462 unique motorcycle drivers were
This novel method of estimating helmet use has produced results similar to traditional methods. Applying this technology can reduce
Identifying commonly used and potentially unsafe transit transfers with crowdsourcing
Paper by Elizabeth J.Traut and Aaron Steinfeld: “Public transit is an important contributor to sustainable transportation as well as a public service that makes necessary travel possible for many. Poor transit transfers can lead to both a real and perceived reduction in convenience and safety, especially for people with disabilities. Poor transfers can expose riders to inclement weather and crime, and they can reduce transit ridership by motivating riders who have the option of driving or using paratransit to elect a more expensive and inefficient travel mode. Unfortunately, knowledge about inconvenient, missed, and unsafe transit transfers is sparse and incomplete.
We show that crowdsourced public transit ridership data, which is more scalable than conducting traditional surveys, can be used to analyze transit transfers. The Tiramisu Transit app merges open transit data with information contributed by users about which trips they take. We use Tiramisu data to do origin-destination analysis and identify connecting trips to create a better understanding of where and when poor transfers are occurring in the Pittsburgh region. We merge the results with data from other open public data sources, including crime data, to create a data resource that can be used for planning and identification of locations where bus shelters and other infrastructure improvements may facilitate safer and more comfortable waits and more accessible transfers. We use generalizable methods to ensure broader value to both science and practitioners.
We present a case study of the Pittsburgh region, in which we identified and characterized 338 transfers from 142 users. We found that 66.6% of transfers were within 0.4 km (0.25 mi.) and 44.1% of transfers were less than 10 min. We identified the geographical distribution of transfers and found several highly-utilized transfer locations that were not identified by the Port Authority of Allegheny County as recommended transfer points, and so might need more planning attention. We cross-referenced transfer location and wait time data with crime levels to provide additional planning insight….(More)”.
A Review of Citizen Science and Crowdsourcing in Applications of Pluvial Flooding
Jonathan D. Paul in Frontiers in Earth Science: “Pluvial flooding can have devastating effects, both in terms of loss of life and damage. Predicting pluvial floods is difficult and many cities do not have a hydrodynamic model or an early warning system in place. Citizen science and crowdsourcing have the potential for contributing to early warning systems and can also provide data for validating flood forecasting models. Although there are increasing applications of citizen science and crowdsourcing in fluvial hydrology, less is known about activities related to pluvial flooding. Hence the aim of this paper is to review current activities in citizen science and crowdsourcing with respect to applications of pluvial flooding.
Based on a search in Scopus, the papers were first filtered for relevant content and then classified into four main themes. The first two themes were divided into (i) applications relevant during a flood event, which includes automated street flooding detection using crowdsourced photographs and sensors, analysis of social media, and online and mobile applications for flood reporting; and (ii) applications related to post-flood events. The use of citizen science and crowdsourcing for model development and validation is the third theme while the development of integrated systems is theme four. All four main areas of research have the potential to contribute to early warning systems and build community resilience. Moreover, developments in one will benefit others, e.g., further developments in flood reporting applications and automated flood detection systems will yield data useful for model validation….(More)”.
Congress needs your input (but don’t call it crowdsourcing)
Lorelei Kelly at TechCrunch: “As it stands, Congress does not have the technical infrastructure to ingest all this new input in any systematic way. Individual members lack a method to sort and filter signal from noise or trusted credible knowledge from malicious falsehood and hype.
What Congress needs is curation, not just more information
Curation means discovering, gathering and presenting content. This word is commonly thought of as the job of librarians and museums, places we go to find authentic and authoritative knowledge. Similarly, Congress needs methods to sort and filter information as required within the workflow of lawmaking. From personal offices to committees, members and their staff need context and informed judgement based on broadly defined expertise. The input can come from individuals or institutions. It can come from the wisdom of colleagues in Congress or across the federal government. Most importantly, it needs to be rooted in local constituents and it needs to be trusted.
It is not to say that crowdsourcing is unimportant for our governing system. But input methods that include digital must demonstrate informed and accountable deliberative methods over time. Governing is the curation part of democracy. Governing requires public review, understanding of context, explanation and measurements of value for the nation as a whole. We are already thinking about how to create an ethical blockchain. Why not the same attention for our most important democratic institution?
Governing requires trade-offs that elicit emotion and sometimes anger. But as in life, emotions require self-regulation. In Congress, this means compromise and negotiation. In fact, one of the reasons Congress is so stuck is that its own deliberative process has declined at every level. Besides the official committee process stalling out, members have few opportunities to be together as colleagues, and public space is increasingly antagonistic and dangerous.
With so few options, members are left with blunt communications objects like clunky mail management systems and partisan talking points. This means that lawmakers don’t use public input for policy formation as much as to surveil public opinion.
Any path forward to the 21st century must include new methods to (1) curate and hear from the public in a way that informs policy AND (2) incorporate real data into a results-driven process.
While our democracy is facing unprecedented stress, there are bright spots. Congress is again dedicating resources to an in-house technologyassessment capacity. Earlier this month, the new 116th Congress created a Select Committee on the Modernization of Congress. It will be chaired by Rep. Derek Kilmer (D-WA). Then the Open Government Data Actbecame law. This law will potentially scale the level of access to government data to unprecedented levels. It will require that all public-facing federal data must be machine-readable and reusable. This is a move in the right direction, and now comes the hard part.
Marci Harris, the CEO of civic startup Popvox, put it well, “The Foundations for Evidence-Based Policymaking (FEBP) Act, which includes the OPEN Government Data Act, lays groundwork for a more effective, accountable government. To realize the potential of these new resources, Congress will need to hire tech literate staff and incorporate real data and evidence into its oversight and legislative functions.”
In forsaking its own capacity for complex problem solving, Congress has become non-competitive in the creative process that moves society forward. During this same time period, all eyes turned toward Silicon Valley to fill the vacuum. With mass connection platforms and unlimited personal freedom, it seemed direct democracy had arrived. But that’s proved a bust. If we go by current trends, entrusting democracy to Silicon Valley will give us perfect laundry and fewer voting rights. Fixing democracy is a whole-of-nation challenge that Congress must lead.
Finally, we “the crowd” want a more effective governing body that incorporates our experience and perspective into the lawmaking process, not just feel-good form letters thanking us for our input. We also want a political discourse grounded in facts. A “modern” Congress will provide both, and now we have the institutional foundation in place to make it happen….(More)”.
MIT Sloan study finds crowdsourcing an effective tool to fight spread of fake news
MIT Sloan Press Release: “Fake news isn’t a new problem, but it’s becoming a greater concern because of social media, where it is easily created and rapidly distributed. A recent study by MIT Sloan School of Management Prof. David Rand and Prof. Gordon Pennycook of the University of Regina finds there is a possible solution: crowdsourcing. As their research shows that laypeople trust reputable news outlets more than outlets that create misinformation, social media platforms could use trust ratings to inform how they promote content.
“There has been a lot of research examining fake news and how it spreads, but this study is among the first to suggest a potential long-term solution, which is cause for measured optimism. If we can decrease the amount of misinformation spreading on social media, we can increase agreement on basic facts across political parties, which will hopefully lead to less political polarization and a greater ability to compromise on how to run the country,” says Rand. “It may also make it harder for individuals to win elections based on false claims.”
He notes that current solutions for fighting misinformation deployed by social media companies haven’t been that effective. For example, partnering with fact-checkers isn’t scalable because they can’t keep up with the rapid creation of false stories. Further, putting warnings on content found to be false can be counterproductive, because it makes misleading stories that didn’t get checked seem more accurate – the “implied truth” effect.
“Our study is good news because we find a scalable solution to this problem, based on the surprisingly good judgment of everyday Americans. Things may not be as hopeless as most coverage of fake news makes you think,” says Rand.
In their study, Rand and Pennycook examined whether crowdsourcing could work as an effective tool in fighting the spread of misinformation. They asked laypeople to rate familiarity with and trust in news sources across three categories: mainstream media outlets, hyper-partisan websites, and websites that produce blatantly false content (“fake news”). The pool of people surveyed was nationally representative across age, gender, ethnicity, and political affiliations. They also asked professional fact-checkers the same questions to compare responses.
They found that laypeople trust reputable news outlets more than those that create misinformation and that the trust ratings of the laypeople surveyed closely matched the trust ratings of professional fact-checkers. “Our results show that laypeople are much better than many would have expected at knowing which outlets to trust,” says Rand. “Although there were clear partisan differences, with Republicans distrusting all mainstream outlets (except for Fox News) relative to Democrats, there was a remarkable consensus regarding non-mainstream outlets being untrustworthy.”…(More)”.
What Sustains Individuals’ Participation in Crowdsourcing Contests?
Paper by Xuan Wang et al: Crowdsourcing contests have become widely adopted for idea generation and problem-solving in various companies in different industries. The success of crowdsourcing depends on the sustained participation and quality-submissions of the individuals. Yet, little is known about the factors that influence individuals’ continued participation in these contests. We address this issue, by conducting an empirical study using data from an online crowdsourcing contest platform, Kaggle, which delivers data science and machine learning solutions and models to its clients.
The findings show that the community activities and team activities do not contribute to motivating the continued participation, but tenure does significantly affect the continued participation. We also found statistically significant effects of
Outcomes of open government: Does an online platform improve citizens’ perception of local government?
Paper by Lisa Schmidthuber et al: “Governments all over the world have implemented
Data conducted from a survey among users of a
The findings of this paper suggest that active platform usage positively relates to several outcomes perceived by citizens, such as improved information flow, increased trust in and satisfaction with local government. In contrast, repetitive participation does not significantly relate to users’ outcome evaluation