Comparative Accuracy of Diagnosis by Collective Intelligence of Multiple Physicians vs Individual Physicians

Curated on Posted on by Stefaan Verhulst

Study by Michael L. Barnett et al in JAMA: “Is a collective intelligence approach of pooling multiple clinician and medical student diagnoses associated with improvement in diagnostic accuracy in online, structured clinical cases?

Findings  This cross-sectional study analyzing data from the Human Diagnosis Project found that, across a broad range of medical cases and common presenting symptoms, independent differential diagnoses of multiple physicians combined into a weighted list significantly outperformed diagnoses of individual physicians with groups as small as 2, and accuracy increased with larger groups up to 9 physicians. Groups of nonspecialists also significantly outperformed individual specialists solving cases matched to the individual specialist’s specialty….

Main Outcomes and Measures  The primary outcome was diagnostic accuracy, assessed as a correct diagnosis in the top 3 ranked diagnoses for an individual; for groups, the top 3 diagnoses were a collective differential generated using a weighted combination of user diagnoses with a variety of approaches. A version of the McNemar test was used to account for clustering across repeated solvers to compare diagnostic accuracy.

Conclusions and Relevance  A collective intelligence approach was associated with higher diagnostic accuracy compared with individuals, including individual specialists whose expertise matched the case diagnosis, across a range of medical cases. Given the few proven strategies to address misdiagnosis, this technique merits further study in clinical settings….(More)”.

Crowdsourcing Change: A Novel Vantage Point for Investigating Online Petitioning Platforms

Curated on Posted on by Stefaan Verhulst

Presentation by Shipi Dhanorkar and Mary Beth Rosson: “The internet connects people who are spatially and temporally separated. One result is new modes of reaching out to, organizing and mobilizing people, including online activism. Internet platforms can be used to mobilize people around specific concerns, short-circuiting structures such as organizational hierarchies or elected officials. These online processes allow consumers and concerned citizens to voice their opinions, often to businesses, other times to civic groups or other authorities. Not surprisingly, this opportunity has encouraged a steady rise in specialized platforms dedicated to online petitioning; eg., Change.org, Care2 Petitions, MoveOn.org, etc.

These platforms are open to everyone; any individual or group who is affected by a problem or disappointed with the status quo, can raise awareness for or against corporate or government policies. Such platforms can empower ordinary citizens to bring about social change, by leveraging support from the masses. In this sense, the platforms allow citizens to “crowdsource change”. In this paper, we offer a comparative analysis of the affordances of four online petitioning platforms, and use this analysis to propose ideas for design enhancements to online petitioning platforms….(More)”.

Civic Tech for Civic Engagement

Curated on Posted on by Stefaan Verhulst

Blog Post by Jason Farra: “When it came to gathering input for their new Environmental Master Plan, the Town of Okotoks, AB decided to try something different. Rather than using more traditional methods of consulting residents, they turned to a Canadian civic tech company called Ethelo.

Ethelo’s online software “enables groups to evaluate scenarios, apply constraints, prioritize options and come up with decisions that will get broad support from the group,” says John Richardson, the company’s CEO and founder.

Okotoks gathered over 350 responses, with residents able to compare and evaluate different solutions for a variety of environmental issues, including what kind of transportation and renewable energy options they wanted to see in their town.

One of the options presented to Okotoks residents in the online engagement site for the town’s Environmental Master Plan.

“Ethelo offered a different opportunity in terms of allowing a conversation to happen online,” Marni Hutchison, Communications Specialist with the Town of Okotoks, said in a case study of the project. “We can see the general consensus as it’s forming and participants have more opportunities to see different perspectives.”

John sees this as part of a broader shift in how governments and other organizations are approaching stakeholder engagement, particularly with groups like IAP2 working to improve engagement practices by training practitioners.

Rather than simply consulting, then informing residents about decisions, civic tech startups like Ethelo allow governments to involve residents more actively in the actual decision-making process….(More)”.

When Patients Become Innovators

Curated on Posted on by Stefaan Verhulst

Article by Harold DeMonaco, Pedro Oliveira, Andrew Torrance, Christiana von Hippel, and Eric von Hippel: “Patients are increasingly able to conceive and develop sophisticated medical devices and services to meet their own needs — often without any help from companies that produce or sell medical products. This “free” patient-driven innovation process enables them to benefit from important advances that are not commercially available. Patient innovation also can provide benefits to companies that produce and sell medical devices and services. For them, patient do-it-yourself efforts can be free R&D that informs and amplifies in-house development efforts.

In this article, we will look at two examples of free innovation in the medical field — one for managing type 1 diabetes and the other for managing Crohn’s disease. We will set these cases within the context of the broader free innovation movement that has been gaining momentum in an array of industries1 and apply the general lessons of free innovation to the specific circumstances of medical innovation by patients….

What is striking about both of these cases is that neither commercial medical producers nor the clinical care system offered a solution that these patients urgently needed. Motivated patients stepped forward to develop solutions for themselves, entirely without commercial support.4

Free innovation in the medical field follows the general pattern seen in many other areas, including crafts, sporting goods, home and garden equipment, pet products, and apparel.5 Enabled by technology, social media, and a keen desire to find solutions aligned with their own needs, consumers of all kinds are designing new products for themselves….(More)”


e-Citizens: Toward a New Model of (Inter)active Citizenry

Curated on Posted on by Stefaan Verhulst

Book by Alfredo M. Ronchi: “…This book explores a society currently being transformed by the influence of advanced information technology, and provides insights into the main technological and human issues and a holistic approach to inclusion, security, safety and, last but not least, privacy and freedom of expression. Its main aim is to bridge the gap between technological solutions, their successful implementation, and the fruitful utilization of the main set of e-Services offered by governments, private institutions, and commercial companies.
Today, various parameters actively influence e-Services’ success or failure: cultural aspects, organisational issues, bureaucracy and workflow, infrastructure and technology in general, user habits, literacy, capacity or merely interaction design. The purpose of this book is to help in outlining and understanding a realistic scenario of what we can term e-Citizenry. It identifies today’s citizen, who is surrounded by an abundance of digital services, as an “e-Citizen” and explores the transition from their traditional role and behaviour to new ones. The respective chapters presented here will lay the foundation of the technological and social environment in which this societal transition takes place…(More)”.

The People’s Republic of Walmart

Curated on Posted on by Stefaan Verhulst

Book by Leigh Phillips and Michal Rozworski: “For the left and the right, major multinational companies are held up as the ultimate expressions of free-market capitalism. Their remarkable success appears to vindicate the old idea that modern society is too complex to be subjected to a plan. And yet, as Leigh Phillips and Michal Rozworski argue, much of the economy of the West is centrally planned at present. Not only is planning on vast scales possible, we already have it and it works. The real question is whether planning can be democratic. Can it be transformed to work for us?

An engaging, polemical romp through economic theory, computational complexity, and the history of planning, The People’s Republic of Walmart revives the conversation about how society can extend democratic decision-making to all economic matters. With the advances in information technology in recent decades and the emergence of globe-straddling collective enterprises, democratic planning in the interest of all humanity is more important and closer to attainment than ever before….(More)”.

Using street imagery and crowdsourcing internet marketplaces to measure motorcycle helmet use in Bangkok, Thailand

Curated on Posted on by Stefaan Verhulst

Hasan S. Merali, Li-Yi Lin, Qingfeng Li, and Kavi Bhalla in Injury Prevention: “The majority of Thailand’s road traffic deaths occur on motorised two-wheeled or three-wheeled vehicles. Accurately measuring helmet use is important for the evaluation of new legislation and enforcement. Current methods for estimating helmet use involve roadside observation or surveillance of police and hospital records, both of which are time-consuming and costly. Our objective was to develop a novel method of estimating motorcycle helmet use.

Using Google Maps, 3000 intersections in Bangkok were selected at random. At each intersection, hyperlinks of four images 90° apart were extracted. These 12 000 images were processed in Amazon Mechanical Turk using crowdsourcing to identify images containing motorcycles. The remaining images were sorted manually to determine helmet use.

After processing, 462 unique motorcycle drivers were analysed. The overall helmet wearing rate was 66.7 % (95% CI 62.6 % to 71.0 %). …

This novel method of estimating helmet use has produced results similar to traditional methods. Applying this technology can reduce time and monetary costs and could be used anywhere street imagery is used. Future directions include automating this process through machine learning….(More)”.

Identifying commonly used and potentially unsafe transit transfers with crowdsourcing

Curated on Posted on by Stefaan Verhulst

Paper by Elizabeth J.Traut and Aaron Steinfeld: “Public transit is an important contributor to sustainable transportation as well as a public service that makes necessary travel possible for many. Poor transit transfers can lead to both a real and perceived reduction in convenience and safety, especially for people with disabilities. Poor transfers can expose riders to inclement weather and crime, and they can reduce transit ridership by motivating riders who have the option of driving or using paratransit to elect a more expensive and inefficient travel mode. Unfortunately, knowledge about inconvenient, missed, and unsafe transit transfers is sparse and incomplete.

We show that crowdsourced public transit ridership data, which is more scalable than conducting traditional surveys, can be used to analyze transit transfers. The Tiramisu Transit app merges open transit data with information contributed by users about which trips they take. We use Tiramisu data to do origin-destination analysis and identify connecting trips to create a better understanding of where and when poor transfers are occurring in the Pittsburgh region. We merge the results with data from other open public data sources, including crime data, to create a data resource that can be used for planning and identification of locations where bus shelters and other infrastructure improvements may facilitate safer and more comfortable waits and more accessible transfers. We use generalizable methods to ensure broader value to both science and practitioners.

We present a case study of the Pittsburgh region, in which we identified and characterized 338 transfers from 142 users. We found that 66.6% of transfers were within 0.4 km (0.25 mi.) and 44.1% of transfers were less than 10 min. We identified the geographical distribution of transfers and found several highly-utilized transfer locations that were not identified by the Port Authority of Allegheny County as recommended transfer points, and so might need more planning attention. We cross-referenced transfer location and wait time data with crime levels to provide additional planning insight….(More)”.

The role of information and communications technology in the transformation of government and citizen trust

Curated on Posted on by Stefaan Verhulst

Mohamed Mahmood et al in the International Review of Administrative Sciences: “We present an empirically tested conceptual model based on exit–voice theory to study the influence of information and communications technology-enabled transformation of government on citizen trust in government. We conceptualize and address the key factors affecting the influence of transformation of government on citizen trust, including government performance and transparency. Based on 313 survey responses from citizens in Bahrain, the top-ranked country in information and communications technology adoption in the Gulf Cooperation Council region, we test government performance and transparency as mediators between transformation of government and citizen trust. The resulting preliminary insights on the measurement and manifestation of citizen trust in the context of information and communications technology-enabled transformation of government have multiple policy implications and extend our understanding of how information and communications technology-enabled transformation of government can improve the government–citizen relationship and digital services adoption….(More)”.

The tools of citizen science: An evaluation of map-based crowdsourcing platforms

Curated on Posted on by Stefaan Verhulst

Paper by Zachary Lamoureux and Victoria Fast: “There seems to be a persistent yet inaccurate sentiment that collecting vast amounts of data via citizen science is virtually free, especially compared to the cost of privatized scientific endeavors (Bonney et al., 2009; Cooper, Hochachka & Dhondt, 2011). However, performing scientific procedures with the assistance of the public is often far more complex than traditional scientific enquiry (Bonter & Cooper, 2012).

Citizen science promotes the participation of the public in scientific endeavors (Hecker et al., 2018). While citizen science is not synonymous with volunteered geographic information (VGI)— broadly defined as the creation of geographic information by citizens (Goodchild, 2007)—it often produces geographic information. Similar to VGI, citizen science projects tend to follow specific protocols to ensure the crowdsourced geographic data serves as an input for (scientific) research (Haklay, 2013). Also similar to VGI, citizen science projects often require software applications and specialized training to facilitate citizen data collection. Notably, citizen science projects are increasingly requiring a webbased participatory mapping platform—i.e., Geoweb (Leszczynski & Wilson, 2013)—to coordinate the proliferation of citizen contributions. ...

In this research, we investigate publicly available commercial and opensource map-based tools that enable citizen science projects. Building on a comprehensive comparative framework, we conduct a systematic evaluation and overview of five map-based crowdsourcing platforms: Ushahidi, Maptionnaire, Survey123 (ArcGIS Online), Open Data Kit, and GIS Cloud. These tools have additional uses that extend beyond the field of citizen science; however, the scope of the investigation was narrowed to focus on aspects most suitable for citizen science endeavors, such as the collection, management, visualization and dissemination of crowdsourced data. It is our intention to provide information on how these publicly available crowdsourcing platforms suit generic geographic citizen science crowdsourcing needs….(More)”.