James Surowiecki in the New Yorker: “If Reddit were looking for a model to follow, it could use NASA’s Clickworkers experiment, which in 2000-01 let tens of thousands of amateurs look at photos of Mars in order to identify craters on the planet and classify them by age. That study found that the aggregated judgments of the amateur “clickworkers” were “virtually indistinguishable from the inputs of a geologist with years of experience.”
The problem from Reddit’s perspective, of course, is that this method of sleuthing would be far less exciting for users, and would probably generate less traffic, than its current free-for-all approach. The point of the “find-the-bombers” subthread, after all, wasn’t just to find the bombers—it was also to connect and talk with others, and to feel like you were part of a virtual community. But valuable as that experience may have been for users, it also diminished the chances of the community coming up with useful information. Reddit has done an excellent job of being engaging. Now it needs to figure out if it wants to be effective”.