Big Data and Chicago's Traffic-cam Scandal


Holman Jenkins in the Wall Street Journal: “The danger is microscopic regulation that we invite via the democratic process.
Big data techniques are new in the world. It will take time to know how to feel about them and whether and how they should be legally corralled. For sheer inanity, though, there’s no beating a recent White House report quivering about the alleged menace of “digital redlining,” or the use of big-data marketing tactics in ways that supposedly disadvantage minority groups.
This alarm rests on an extravagant misunderstanding. Redlining was a crude method banks used to avoid losses in bad neighborhoods even at the cost of missing some profitable transactions—exactly the inefficiency big data is meant to improve upon. Failing to lure an eligible customer into a sale, after all, is hardly the goal of any business.
The real danger of the new technologies lies elsewhere, which the White House slightly touches upon in some of its fretting about police surveillance. The danger is microscopic regulation of our daily activities that we will invite on ourselves through the democratic process.
Soon it may be impossible to leave our homes without our movements being tracked by traffic and security cameras able to read license plates, identify faces and pull up data about any individual, from social media postings to credit reports.
Private businesses are just starting to use these techniques to monitor shoppers in front of shelves of goodies. Towns and cities have already embraced such techniques as revenue grabs, encouraged by private contractors peddling automated traffic cameras.
Witness a festering Chicago scandal. This month came federal indictments of a former city bureaucrat, an outside consultant, and the former CEO of Redflex Traffic Systems, the company that operated the city’s traffic cameras until last year….”
 

The wisest choices depend on instinct and careful analysis


John Kay in the Financial Times: “Moneyball, Michael Lewis’s 2003 book on the science of picking baseball teams, was perhaps written to distract himself from his usual work of attacking the financial services industry. Even after downloading the rules of baseball, I still could not fully understand what was going on. But I caught the drift: sabermetrics, the statistical analysis of the records of players, proved a better guide than the accumulated wisdom of experienced coaches.

Another lesson, important for business strategy, was the brevity of the benefits gained by the Oakland A’s, Lewis’s sporting heroes. If the only source of competitive advantage is better quantitative analysis – whether in baseball or quant strategies in the financial sector – such an advantage can be rapidly and accurately imitated.

At the same time, another genre of books proclaims the virtues of instinctive decision-making. Malcolm Gladwell’s Blink (2005) begins with accounts of how experts could identify the Getty kouros – a statue of naked youth purported to be of ancient Greek provenance and purchased in 1985 for $9m – as fake immediately, even though it had supposedly been authenticated through extended scientific tests.

Gary Klein, a cognitive psychologist has for many years monitored the capabilities of experienced practical decision makers – firefighters, nurses and military personnel – who make immediate judgments that are vindicated by the more elaborate assessments possible only with hindsight.
Of course, there is no real inconsistency between the two propositions. The experienced coaches disparaged by sabermetrics enthusiasts were right to believe they knew a lot about spotting baseball talent; they just did not know as much as they thought they did. The art experts and firefighters who made instantaneous, but accurate, judgments were not hearing voices in the air. But no expert can compete with chemical analysis and carbon dating in assessing the age of a work of art.
There are two ways of reconciling expertise with analysis. One takes the worst of both worlds, combining the overconfidence of experience with the naive ignorance of the quant. The resulting bogus rationality seeks to objectivise expertise by fitting it into a template.
It is exemplified in the processes by which interviewers for jobs, and managers who make personnel assessments, are required to complete checklists explaining how they reached their conclusion using prescribed criteria….”

Follow the money: A study of cashtags on Twitter


Paper by Martin Hentschel and Omar Alonso at FirstMonday: “The popularity of Twitter goes beyond trending topics, world events, memes, and popular hashtags. Recently a new way of sharing financial information is taking place in social media under the name of cashtags, stock ticker symbols that are prefixed with a dollar sign. In this paper we present an exploratory analysis of cashtags on Twitter. Specifically, we investigate how widespread cashtags are, what stock symbols are tweeted more often, and which users tweet about cashtags in general. We analyze relationships among cashtags and study hashtags in the context of cashtags. Finally, we compare tweet performance to stock market performance. We conclude that cashtags, in particular in combination with other cashtags or hashtags, can be very useful for analyzing financial information and provide new insights into stocks and companies.”

The Rise of Virtual Advocacy Groups


at Connectivity: “Ever since the launch of MoveOn in 1998, I have been evaluating the advantages and disadvantages of virtual advocacy groups compared to traditional, brick-and-mortar advocacy groups.
I hypothesized that organizing and working mostly online would allow advocates to escape a conundrum that ensnare those that rent pricey office space. As I have observed over the years, many brick-and-mortar groups dilute the effectiveness of their email programs for advocacy by inserting fundraising appeals into their email stream. As they emerged in the wake of MoveOn, virtual advocacy groups offered a new model of nimble organizations that could focus less on fundraising and more on advocacy.
Marketing guru Seth Godin describes this process as flipping the funnel. Like a funnel, he says traditional organizations ask supporters for self-sustaining money as broadly as they can, but mobilize a very small percent of them to do so. For this trickle of funds, they end up alienating many in the process. Much of the money raised, meanwhile, simply goes towards giving its supporters a megaphone to advocate for the organizations’ causes.
Today, most of an advocacy organization’s supporters already have their own megaphone: social media. So instead of alienating so many supporters with fundraising appeals to buy them a megaphone, Godin says advocacy groups should instead ask supporters to use the megaphones they already have on their behalf. Thus, the funnel is flipped into a megaphone and supporters don’t have to become alienated by excessive fundraising appeals.
This concept is central to any effective social media campaign. And with no rent to pay, virtual organizations should be best positioned to take advantage of the strategy.
In practice, virtual advocacy groups pioneered back in the ‘90s by MoveOn have proven to be more efficient purveyors of their members’ messages. And at the organizations I spoke to for this article, shifting work online has created workplaces that live up to their founders’ values, too.
I reached out to Nita Chaudhary and Kat Barr, the co-executive director and chief of staff of UltraViolet, an advocacy group formed to fight sexism and expand women’s rights in the U.S. I spoke to MomsRising executive director Kristin Row-Finkbeiner, whose group takes on critical issues facing women, mothers and families. I also consulted Joan Blades, co-founder of both MoveOn and MomsRising who currently works for a new start-up called Great Work Cultures, which promotes a variety of new workplace organizational models that are more respectful of employee work-life balances. Both Chaudhary and Barr previously worked at MoveOn.
MoveOn, MomsRising and UltraViolet are not merely virtual advocacy groups, but are three of the most successful advocacy groups in the U.S. with many millions of supporters among them….”

Behavior Analysis in Social Media


Paper by Reza Zafarani and Huan Liu in IEEE Intelligent Systems (Volume 29, Issue 4, 2014): “With the rise of social media, information sharing has been democratized. As a result, users are given opportunities to exhibit different behaviors such as sharing, posting, liking, commenting, and befriending conveniently and on a daily basis. By analyzing behaviors observed on social media, we can categorize these behaviors into individual and collective behavior. Individual behavior is exhibited by a single user, whereas collective behavior is observed when a group of users behave together. For instance, users using the same hashtag on Twitter or migrating to another social media site are examples of collective behavior. User activities on social media generate behavioral data, which is massive, expansive, and indicative of user preferences, interests, opinions, and relationships. This behavioral data provides a new lens through which we can observe and analyze individual and collective behaviors of users.”

City 72 Toolkit


“An effective preparedness platform customizable to your city. City72 is an open-source emergency preparedness platform that promotes community resilience and connection. This Toolkit is designed specifically for emergency preparedness organizations and provides the information and resources to create a customized City72 site for any city or region. It includes: how to create localized content, access to the code to build and install your City72 website, and tips for how to manage and promote your site.”

Startup lessons from the Knight News Challenge: Make damn sure you fill a market need


at GigaOm: “The Knight Foundation looked at the 28 media-focused startups it funded as part of its News Challenge competition in 2010 and 2011 and came up with some useful lessons for those who might want to follow in their footsteps
Media startups are a lot like any other startup, in the sense that they are a risky bet on an idea or vision — but what makes them even harder is that they are aimed at an industry that is undergoing unprecedented upheaval, filled with potential customers who are struggling to keep their heads above water. What does success look like in that kind of environment? The Knight Foundation knows better than most, since it has funded dozens of startup ventures over the years through its News Challenge, and it has come out with a report that looks at what it has learned.
The report considered the progress of 28 projects that applied for and won funding as part of the 2010-2011 Knight News Challenge competitions, and includes a profile of each — from the Front Porch Forum, a Vermont-based community-building service that started up in the aftermath of Hurricane Irene, to a winner called FrontlineSMS, which uses mobile technology to serve the information needs of small communities that don’t have reliable internet access.
Among the lessons that Knight drew from this roster of winners is one that will sound familiar to any technology startup or venture capital partner: namely, make sure your idea serves a market need, as opposed to just being a cool technical solution. This is especially important in an industry like media, the report says:

Selling innovations to news organizations is extremely difficult because they may lack the money and time to spend on innovative projects or the technical capacity to take full advantage of new tools. The innovation may also be entering a market guarded by institutions that may be resistant to change. Fundamentally, unless an innovation addresses a pressing need, journalists and news organizations will not adopt it.”

Secrecy in the Sunshine Era – The Promise and Failures of U.S. Open Government Laws


book cover imageNew book by Jason Ross Arnold: “A series of laws passed in the 1970s promised the nation unprecedented transparency in government, a veritable “sunshine era.” Though citizens enjoyed a new arsenal of secrecy-busting tools, officials developed a handy set of workarounds, from overclassification to concealment, shredding, and burning. It is this dark side of the sunshine era that Jason Ross Arnold explores in the first comprehensive, comparative history of presidential resistance to the new legal regime, from Reagan-Bush to the first term of Obama-Biden.
After examining what makes a necessary and unnecessary secret, Arnold considers the causes of excessive secrecy, and why we observe variation across administrations. While some administrations deserve the scorn of critics for exceptional secrecy, the book shows excessive secrecy was a persistent problem well before 9/11, during Democratic and Republican administrations alike. Regardless of party, administrations have consistently worked to weaken the system’s legal foundations.
The book reveals episode after episode of evasive maneuvers, rule bending, clever rhetorical gambits, and downright defiance; an army of secrecy workers in a dizzying array of institutions labels all manner of documents “top secret,” while other government workers and agencies manage to suppress information with a “sensitive but unclassified” designation. For example, the health effects of Agent Orange and antibiotic-resistant bacteria leaking out of Midwestern hog farms are considered too “sensitive” for public consumption. These examples and many more document how vast the secrecy system has grown during the sunshine era.
Rife with stories of vital scientific evidence withheld, justice eluded, legalities circumvented, and the public interest flouted, Secrecy in the Sunshine Era reveals how our information society has been kept in the dark in too many ways and for too long.”

Twitter Analytics Now Available To Everyone


Information Week: “All Twitter users can access a detailed report on their followers and individual tweets, including impressions, clicks, and engagement. Here’s what you need to know.
Twitter just made it easier for you to gauge how well your tweets resonate with your followers.
Ian Chan, front-end engineer at Twitter, announced yesterday in a tweet that all users now have access to its analytics platform, which launched in July but was open only to advertisers and verified accounts. The analytics provide details on your tweets’ engagement, clicks, retweets, favorites, replies, and more.
To access the analytics dashboard, log into analytics.twitter.com with your username and password. Analytics are provided to users who have had a Twitter account for at least 14 days, the company said….
Twitter’s analytics dashboard will probably appeal mostly to power users looking to reach more people and improve engagement. The social network does place restrictions on who can access it, however. In addition to the 14-day account requirement, users must primarily tweet in English, French, Japanese, or Spanish, the company said. Your account must also be public.”