New Digital Activism Data!

Version 1.0 of the Global Digital Activism Set is now available.

Last month my other initiative, the Digital Activism Research Project, released version 1.0 of the Global Digital Activism Data Set (GDADS), a collection of digital activism cases from around the world, created as an open resource to scholars.  I am finally getting around to posting the announcement here, which seems only fair as GDADS began at the Meta-Activism Project.

The release includes the following resources.  Some are available via email so we can track distribution. All requests will be answered promptly and all materials have a Creative Commons license.

1) Documentation: User’s Manual and Codebook 
Description: Contains project history, data description, methodology notes, variable definitions.
Format: Personal Document File (.pdf)
Access: Download Link

2) Coded Case Studies Spreadsheet
Description: Contains 1,180 cases of digital activism from 151 countries and dependent territories, rangine from 1982 through 2012, coded according to 57 variables.
Format: Excel (.xlsx)
Access: email request to Mary at mjoyce AT uw DOT edu

3) Case Study Sources Spreadsheet
Description: Contains links and citations to the source materials for 1,346 cases of digital activism initially collected for the GDADS project.
Format: Excel (.xlsx)
Access: email request to Mary at mjoyce AT uw DOT edu

If you have any additional questions about the project, please contact Mary Joyce at mjoyce AT uw DOT edu.

The digital fire? Yeah, we started it.

The Internet is making activism more difficult to analyze. It’s hard to know who initiated a digital action. First, people can initiate many activism tactics pseudonymouslyand anonymously, whether they are posting a video, writing a blog post, or tweeting.

But the problem goes deeper.

The problem of pseudonymity assumes that the individual or group who initiated the action has been identified, but in the world ofviral dissemination, “patient zero” may be more difficult to locate. When the piece of content is a meme – an idea expressed through a range of separate pieces of content – the problem of tracking viral growth becomes even more complex.

The recent “binders full of women”meme and the reappropriation of#SignsYoKidIsGayon Twitter are interesting case studies for delving into this question of how we determine who started the “digital fire” of a viral meme and whether the idea of an action initiator even has meaning anymore.

It is possible, through network analysis, to locate the first people who produced a piece of public digital satire of “women in binders.” But is this person really the initiator of the surge of content creation and discourse that leapt from platform to platform and medium to medium, from the world of atoms to the world of bits and back again? Even if one were to be more specific and call the initiator of “binders full of women”the earliest person to create a piece of highly-linked content, this seems a bit reductive.

The “binders full of women” meme was created by the people of the Internet, it was a collective creation. Though there was an individual who startedbindersfullofwomen.tumblr.com, that photoblog had effect because other individual submitted images to it. Likewise there was an individual who wrote the first satirical Amazon binder review, but others added similar reviews andamplified the action. Likewise Tiffani Ricci pushed the meme back into the world of atoms by organizing a women in binders protest (left) in front of the Ohio Republican Party headquarters. Was she following the existing meme or initiating something new? She was doing both.

#SignsYoKidIsGayis a methodologically easier to analyze since it is occurred on a single platform which makes its content accessible (for a fee) as machine-readable data. However, even when someone identifies the first person to “flip the script” and turn a hashtag of homophobia into a hashtag of exquisite humanism (see below), that action only had cultural impact because of the many individual participants that both added their own tweets and amplified the action. Unlike a tree falling in the forest, a meme only exists if it is amplified.

Continue reading

New Study on Chinese Censorship: OK to Criticize Government, Just Do It Alone

In the largest study yet of Chinese internet censorship (PDF), scholars at Harvard University have learned that China’s censorship program targets incitements to collective action, not criticism of the government, as previously supposed. Notes the abstract:

Contrary to previous understandings, posts with negative, even vitriolic, criticism of the state, its leaders, and its policies are not more likely to be censored. Instead, we show that the censorship program is aimed at curtailing collective action by silencing comments that represent, reinforce, or spur social mobilization, regardless of content. Censorship is oriented toward attempting to forestall collective activities that are occurring now or may occur in the future — and, as such, seem to clearly expose government intent….

The scholars -Gary King,Jennifer Pan, andMargaret Roberts – used a scraper to collect content from 1,382 Chinese social media services in early 2011. They then used computer-assisted text analytic methodsto compare content that was censored (removed from the Internet) to content that wasn’t. As the scholars point out, China’s censorship program, though “designed to limit freedom of speech ofChinese people, paradoxically also exposes an extraordinarily rich source of information about the Chinese government’s interests, intentions, and goals.”

China’s censorship ecology is formidable and at times surprising. Some of the paper’s best background observations:

Unlike in the U.S., where social media is centralized through a few providers, in Chinait is fractured across hundreds of local sites, with each individual site employing up to1,000 censors. Additionally, approximately 20,000–50,000 Internet police and an estimated 250,000–300,000 “50 cent party members” (wumao dang) are employed by thecentral government

….The vast majority of censorshipactivity [on high-sensitivity topics] occurs within 24 hours of the original posting, although a few deletions occurlonger than ?ve days later. This is a stunning organizational accomplishment, requiringlarge scale military-like precision:The many leaders at different levels of government?rst need to come to a decision (by agreement, direct order, or compromise) about whatto censor in each situation; they need to communicate it to tens of thousands of individuals; and then they must all complete execution of the plan within about 24 hours.

….Overall, approximately 13% of all social media posts [in our study of high, moderate, and low-sensitivity topics] were censored.

….An oddly “inappropriate” behavior of the censors: They offer freedomto the Chinese people to criticize every political leader except for the censors, every policyexcept the one they implement, and every program except the one they run.

Previous to this study, what the authors call thestate critique theory of censorship dominated. This theory posits that “the goal of the Chinese leadership is supress [sic.] dissent, and to prune human expression that ?nds fault with elements of the Chinese state, its policies, or its leaders.” The theory and is supported by evidence, presented by Rebecca MacKinnon and others, of particular sensitive words, like “democracy” or “Bo Xilai” being blocked or immediately removed from Chinese weibo microblog services once posted.

The second theory of censorship is that of collective action potential:collective expressions — many people communicating on social media on the same subject — regarding actual collective actions, such as protests.” Whether or not the speech is critical of the governmentis irrelevant. In fact, “the government censorsviews that are both supportive and critical of the state” if they are related to collective action.An example of this kind of apolitical censoring of speech about collective action is the rather strange anecdote from 2011 of the government censoring the word “to stroll” after the word was used to organize protests inspired by the Arab Spring.

While these two theories were debated by experts or thought to be jointly valid, the authors argue that they have found a winner:

State critique theory is incorrect and the theory of collection action potential iscorrect…. censorship is primarily aimed at restricting the spread of information that may lead tocollective action, regardless of whether or not the expression is in direct opposition to thestate….

Thus, observations like MacKinnon’s of individual words being censored can be reinterpreted. The government was not reacting to the critical meaning of the word, but to the volume of use of the word. If one person says “stroll” in China, it is not censored. If one million people do, it is. Thus, the government does not have a problem with people talking about democracy or freedom, except when they believe that it is likely to lead to collective action.

According to the theory of the paper, this is why these and similar words are either added to a list of machine-blocked keywords or are manual censored by human reviewers. Theimplication is that the Chinese government is usingonline collective expression as a predictorofoffline collective action.

The study itself focuses on content that is censored (removed) by human reviewers. This is because content containing machine-censored words would not be posted in the first place. The methodology of the paper compares published content on the 1,382 sites to the sub-set of that content that is later removed. As such, the scholars required that the content be first published on the public net so it could be collected by their scraper.

By using automated data collection they actual had an advantage over censors. As the authors state, “the reason we are ableto accomplish this is because our data collection methods are highly automated whereasChinese censorship is a massive effort accomplished in large part by hand.”

What first clued them in to the fact that content had little relevance to what was and was not censorship was that there was a “surprisingly low correlation between our ex ante measure of political sensitivity and censorship.”At the beginning of their study they selected 85 topics on which to collect content, divided into three level of political sensitivity”High” (such as Ai Weiwei), “Medium” (such as the one childpolicy), and “Low” (such as a popular online video game). They defined each topic by keywords and them collected all posts on those topics from the selected platforms for six months.

When they began analyzing their data, they found that “censorshipbehavior in the Low and Medium categories was essentially the same (16% and 17% respectively) and only marginally lower than the High category (24%).” That is, a post about the one child policy had about the same chance of being censored as a post about an online game.

In another instance, a health scare (a run on iodized salt to protect against radiation following the Japanese earthquake), which incited apolitical collective action, was also highly censored, while supposedly political news about education and a rise in food prices was not.

A diagram of high an low-censored topics is at left and shows the surprising lack of correlation between a topic’s political sensitivity and its likelihood of being censored. Political topics appear in both histograms, but it is the topics that involve protest or crowd formation offline (hence the salt run’s inclusion) that are most censored.

Some topics that one might think would cause offline collective action, like the rise in food prices, were not highly censored. According to the analysis of the researchers, this was because the topic did not fall into one of three types of content which have collective action potential.

Is this the checklist used by Chinese censors? It is likely something similar.

  1. Current Inciter ofCollective Action: The discussant calls for offline collective action (“we should…”).
  2. Past Inciterof Collective Action: The discussant previously called for offline collective action on another subject (past offender).
  3. Past Subjectof Collective Action:The topic itself was previously the subject of offline collective action,particularlynationalism.

A post could thus be categorized as having collective action potential without actually containing an incitement to collective action. For example, the translated post below supports the government’s position in the case of Ran Jianxin, a local legislator who died in police custody.

According to news from the Badong county propaganda department website, when Ran Jianxinwas party secretary in Lichuan, he exploitedhis position for personal gain in land requisition, building demolition, capital constructionprojects, etc. He accepted bribes, and is suspected of other criminal acts.

The post does not incite collective action orcriticizethe government, but it references Ran Jianxin, who was thesubject of past protests, making the post an example of the third type of collective action content and was thus censored.

At the end of the paper, the author provide a juicy treat: their censorship analysis software is predictive of actions taken by the Chinese government. This is because censorship policies are determined and implemented in advance of public government actions. If you can find an up-tick in censorship activity (not explained by chance or other factors), it is likely to pre-sage public government action on that topic.

For example, the authors found that censorship of Ai Weiwei’s name increased in the days ahead of his April 3rd arrest (the gray area in the diagram at left) and censorship discussion of Wang Lijun, who exposed the corruption of Bo Xilai, was censored in advance of Wang’s demotion on February 2nd.

The paper concludes with the wise dictum that “with respect to speech, the Chinese people are individually free but collectively in chains.” It is the collective nature of speech, rather than its content, that merits censorship in the eyes of the Chinese government.

This also supports the hypothesis that the Chinese government uses social media as a barometer of public opinion, thus allowing it to respond to certain public demands while remaining an autocracy. This policy of freedom of speech (so long as it is individual) ironically allows China to maintain its legitimacy and improve governance as measured byresponsivenessto citizens’ needs. As the article’s authors point out:

Dimitrov (2008) argues that regimes collapse when its people stopbringing grievances to the state, since it is an indicator that the state is no longer regardedas legitimate. By extension, this suggests that allowing criticism, as we found the Chineseleadership does, may legitimize the state and help the regime maintain power.

Personally, this makes me never want to use human coders again (except to train a machine to code). It seems like the machine readable content and mind-boggling scale of the subject matter of digital activism require the adoption of methods best suited to this new medium.

Thank toJay Ulfelder and Patrick Meier for alerting me to this article.

What it Means to Be a 21st-Century Think Tank

Yesterday the Meta-Activism Project launched its most recent product, Civil Resistance 2.0, which is not really “ours” and not really a “product.” It’s a crowdsourced initiative that will eventually be authored by people both inside and outside our organizations and it does not exist in physical space, just in the cloud. This got me thinking about our values here at MAP, and what it means to be a 21st century think tank.

Along with The Global Digital Activism Data Set, Essential Readings in Digital Activism, and Digital Activism Decoded, MAP is coming to define itself by digital production, flexible human resources through porous collaboration, embracing the economics of abundance, and producing information that is free (in more ways than one).

Digital Production: Our products don’t exist in the world of atoms, they exist in the world of bits. Everything we have created – Civil Resistance 2.0, the Global Digital Activism Data Set, the Essential Readings in Digital Activism resources list, and the book Digital Activism Decoded – exist in digital form. In fact, only the last product exists in physical form. We’re creating products, but we create them only in cyberspace. This saves money and allows for a wide audience.

Flexible Human Resources through Porous Collaboration: Civil Resistance 2.0 is crowdsourced. Anyone can edit the list of methods, which exists as a Google Spreadsheet with no editing or privacy restrictions. For the Global Digital Activism Data Set, we collaborated with Christopher Bail of UNC Chapel Hill, who donated his research assistants’ time to help us code a large tranche of our digital activism case studies. In this way we shared the cost of coding without creating any bureaucratic overhead.

This is the kind of easy and porous collaboration championed by Beth Kanter and Allison Fine in their book The Networked Nonprofit. It also relies on the talent of brilliant volunteers through mechanisms described by Clay Shirky in Cognitive Surplus. The motivation is to leverage passion, talent, and financial resources across a range of institutions and individuals to create the best products at the lowest cost. If we had to pay all the experts and PhD’s that contribute to creating our products, our budget would be at least a few hundred thousand dollars. As it is we pay a small fraction of that, mostly for student labor to code data.

Embracing the Economics of Abundance: As our openness statement declares, we are committed to making our research processes and research products open to the public. But it goes beyond openness. We embrace the economics of abundance on the production side by leveraging the spare time of passionate and brilliant people. We embrace the economics of abundance on the distribution side by creating digital products, of which infinite copies can be made for free. These are the kinds of non-market economics principles discussed in Yochai Benkler’s The Wealth of Networks.

Information Should be Free… and Free: Open source evangelist Richard Stallman made the distinction that his software was free as in freedom, not as in free beer. We believe that information should be free in both ways: it should be legally unrestricted (everything we produce is under a Creative Commons license) but should also be cost-free to the user. Be believe that the information we are distributing about digital activism is important and as such we want it to be accessible to as many people as possible. (I’d imagine most people in intellectual endeavors are of this opinion.) Free digital products help us achieve these goals.

Our goal at the Meta-Activism Project is to innovate on three levels: as an organization, in our research methods, and in the results of that research. We want to study the new phenomenon of digital activism in a new way, and be a new type of organization while doing it.

Digital Activism Research: Learning a Lot About a Little

Kony tweets: a gorgeous N of 1 (source: Gilad Lotan)

We now know a tremendous amount about the Kony 2012 campaign and excellent analysis keeps rolling in: on the Ushahidi blog, Patrick Meier has posted a variety of responses from Ugandans and Ethan Zuckerman has posted a gorgeous visualization fromGilad Lotan of the first 5000 Kony tweets (see left). At a panel at SXSW yesterday, I learned that Invisible Children plans to release their own data on the campaign.

As a digital activism researcher this makes me happy, because we need more empirical qualitative and quantitative analysis of digital activism, and most of the analysis I have read is of this type: nuanced, data-driven, analytically sophisticated. At the same time, it is just one case. We are learning a lot about a little.

This reminds me of 2009, when there was so much attention paid to the use of digital technology in the Iranian post-election protests. Excellent research was conducted by the Web Ecology Project, The Center for International Media Assistance, and The United States Institute of Peace. This happened again in 2011 when in-depth survey data on citizen media use during the Egyptian Revolution was collected by The Engine Room and analyzed by Zeynep Tufekci. The problem with intense but uneven data collection is that there is little basis for comparison. In academic terms, we are left with an N of 1.

I am not criticizing the intense analysis of the Kony case, or any of the other cases. I am pushing for an awareness that knowing a lot about a few cases has limited value because there is a great danger of making baseless extrapolations about how the lessons learned in Iran, Egypt, or the Kony case apply to other digital activism cases. What does our knowledge about media choices in Egypt tell us about media choices in Syria? What will Kony tell use about the next viral video? We don’t know.

The Global Digital Activism Data Set is collecting and comparatively analyzing digital activism cases, but our data is mostly qualitative and narrative. We don’t have network analyses like Gilad’s. For every digital activism case for which we have detailed information, there are thousands for which we know little or nothing. Even as we laud the empirical analysis of individual digital activism cases, we must work for the funding, tools, and academic interest that will allow the Gilad Lotans of the world to conduct their analyses not only on single digital activism cases, but on hundreds.

Author’s Reponse: “Digitally Enabled Social Change: Activism in the Internet Age”

Note: This post is a response to Book Review: “Digitally Enabled Social Change: Activism in the Internet Age”

by Jennifer Earl (Professor of Sociology, University of California, Santa Barbara)

I appreciate the chance that Mary has given us to reply to her critical review of our book, Digitally Enabled Social Change (2011, MIT Press). Given the tone of Mary’s review, I think it is helpful to first step back and notice that there are many things on which Mary and I agree. Indeed, Mary ends her review with a laundry list of things she liked about our book, some of which are quite important themes. For example, she agrees with our arguments about the changing infrastructure of movements—which may seem like a simple point to her but is one that in some ways upends four decades of social movement scholarship. She also agrees with our argument about the likelihood of episodic activism, which again may seem minor to her but would represent a fundamental break in our academic understanding of social movements across two centuries. But, at an even bigger level, and perhaps most importantly, Mary and I both think digital activism is important and that people (activists and scholars alike) should pay more attention to it.

Where Mary and I diverge is in how you forward an agenda about raising the profile of digital activism. That divergence in large part owes to our expected audiences—Katrina and my audience is academic; we are trying to make a case to social movements researchers, who as a group have been exceedingly skeptical of digital activism. It has been an uphill battle to get social movement scholars to consider the possibility that digital activism has different dynamics and that studying those dynamics is important. Mary’s is a technology-rich audience where utopian visions of technology are as common as skepticism. Our primary audience uses email; hers tweets. Our primary audience is obsessed with the quality of research methods, theories of causality, and academic rules of evidence. Hers is obsessed with cutting edge technologies. So, it is understandable that despite common orientations to digital activism overall, we end up with very different means of forwarding that agenda. With this as background, let’s turn to Mary’s main concerns:

Why study online petitions, boycotts, and email and letter-writing campaigns?

Mary takes issue with our empirical focus on these tactics for a variety of reasons (indeed, if you read carefully, this is her biggest beef with our work), and certainly, if you don’t want to read about these kinds of online tools, you might take issue with us too. But, instead of critiquing our book based on the book you wish we had written, let’s discuss the merits of the book that was written. We focus on these tactics for several reasons.

First, as Mary points out, these are online incarnations of offline tactics. Although Mary takes this on its face as a negative, we think it actually gives us a lot of helpful research leverage. From a research methods perspective, it allows us to very precisely isolate the impact of action taking place online versus offline because we know how these specific tactics have worked offline in the past and can use that as a baseline. Also, by limiting the only source of variation to whether the action is taking place online or off, we immediately eliminate a ton of other causal explanations for what we find. For instance, if we had chosen other online protest forms, like the Google bomb that Mary mentions, critical social movement scholars would have been able to assume that the differences between on and offline activism we find owe to the exoticism of the tactic, not to its online elements.

Second, Mary argues that the tactics we study are least likely to showcase novel action. We agree—this is a chief reason we chose them! For an academic audience, choosing the hardest target and then still proving your point is a huge bonus, not a criticism: that we find important differences between online and offline tactics in places where you might expect those differences to not exist or to be minimal is our argument. Indeed, choosing a venue where you are mostly likely to be wrong and then testing your theory is a hallmark of good social science—despite what many people think, social scientists should try to avoid “cooking the books” in their favor through their selection of cases.

Third, we chose these tactics because they seem to be everywhere online. Mary asserts (without data, much as she accuses us of doing) that these tactics are not the most common online forms of action. Perhaps these are not the most common tactics in the complex world of the Obama campaign or in a training session for experienced digital activists, but in the everyday world where my aunt and her friends are looking to participate online, online petitions, boycotts, letter-writing and emailing campaigns are where it is at. And, while this book doesn’t present data on the frequency of these tactics versus other kinds of tactics (you got us there, Mary), I have recently finished a 5-year study of 20 social movement arenas and can tell you that those data conclusively show that the tactics Katrina and I are studying in this book are the most frequent online tactics. You can check out some early results from that study in the December 2010 issue of Mobilization. Later papers from this study will confirm what Mary thinks must be wrong: even in 2010, online petitions, boycotts, and email and letter-writing campaigns are very popular online.

Fourth, Mary objects to the lack of focus on social media and related social media tactics, arguing that the tactics we study are stale in digital terms. But, as I just mentioned, later work of mine shows that these are not stale—they are quite popular even today. And, my more recent data collection shows that the social media tactics Mary thinks are so prevalent still make up a very small share of the overall online protest universe. While social media maybe the shiniest thing out today, it’s not the only or the most empirically frequent form of online protest. Moreover, while we are looking at data from 2004, we don’t believe that the theoretical principals we are trying to illustrate with that data are much different in 2011 from 2004. Indeed, my current work is testing precisely that hypothesis. I also think there is another audience issue at work here: academics understand that writing a well-researched book and getting it through the academic publishing process takes a few years. Mary’s audience is now, new, next. But just because something took place yesterday, doesn’t mean it’s not instructive about today and tomorrow.

Finally, Mary suggests our tactics are not representative of the online universe. Here I could not strenuously disagree more and hope that readers will judge this for themselves. The methods that Katrina and I use are unique in that they actually give us a better chance of charting a representative population of online petitions, boycotts, and email and letter-writing campaigns. Check out the methods and decide for yourself. As for whether they are representative of the most common forms online, see my response above—new work shows, yes, they are. While Mary’s anecdotes about the popularity of other forms are interesting, they aren’t accurate in painting a larger view. Some of Mary’s examples certainly have gotten a lot of news coverage—but they are outliers in both their public notoriety and their novelty.

Are you claiming that some kinds of online protest are “better” than others?

No. I think this is a place where Mary misreads us. For whatever part of that Katrina and I are responsible for as authors, let me set the record straight. In a nutshell, we argue that theoretical processes that have been developed over the past 50 years to explain activism are only good guides for the theoretical processes driving some kinds of online activism today, and those theoretical expectations don’t lead us in the right direction for other kinds of online activism. Try this analogy: 50 years of research has shown that engines are based on combustion. We are saying that for some kinds of online protest, the engine is all electric (proverbially speaking). We are not claiming that an electric engine is better; we are saying it operates differently from a classic combustion engine. More precisely, we are saying that when people take advantage of and leverage two unique features of Internet-enabled technologies—low costs and coordinated action without co-presence—the theoretical explanations for participation and organizing change. When they don’t leverage these unique features, the engine stays the same. We are not claiming one is better, just that they are different. For Mary, those theoretical differences might not matter much. For social movement scholars, they are critically important.

Why didn’t you study which online protests were effective?

From her review, it appears Mary wanted a book that empirically examined which kinds of online protest are more or less effective. We don’t advertise such a book, nor did we write one. I think for a variety of methodological reasons, it will be a long time before someone writes the book that Mary wants in this regard, or at least writes one that, from a research methods point of view, I would also want to read. It turns out that the study of offline protest faces the same problem: it turns out to be very difficult to prove, from a social scientific perspective, which offline actions or movements are effective. I gave a paper on this very topic in Berlin this summer and would be happy to share it with people who email me.

Other Quibbles

Mary had other quibbles with the book. She thought we should have mathematically tested whether organizers’ time exactly conformed to a power law. We didn’t see that as necessary because even something that looks close to a power law—which we do show—is a very radical departure from what would be anticipated by social movement scholars. If it is off by a hair, it doesn’t really matter to the arc of our argument because it’s still in the ballpark. She wishes we didn’t use the terminology of e-tactics, preferring digital protest. I am hoping much of both of our audiences can get past such semantic differences in style.

So, where does this leave us?

As I said in the opening, Mary and I actually have pretty similar agendas: we both think people should pay more attention to digital activism. In my case, I want social movement scholars to dig more deeply into our theoretical approaches so we can figure out when and how protesting online differs—at a theoretical process level—from protesting offline. I also want Internet scholars to have to seriously engage with the literatures that have been developed around relevant offline areas of social life instead of engaging in drive-by theorizing that doesn’t connect with different areas’ rich research traditions. I think Katrina and my book gets scholars off to a good start on both of these endeavors. I hope readers will judge for themselves and I am confident that most will enjoy the book much more than Mary did.

Book Review: “Digitally Enabled Social Change: Activism in the Internet Age”

Note: This post is followed by a response from the authors.

Broad-based empirical studies are sorely needed to understand the effect of digital technology on contentious politics, a field where battling anecdotes predominate. Jennifer Earl and Katrina Kimport’s new book, Digitally Enabled Social Change: Activism in the Internet Age attempts to fill this need. However, the book has several serious weaknesses in its methodology, theoretic goals, and conclusions.

The authors clearly wish to find disruptive new phenomena, evidence that digital activism challenges traditional social movement theory. Yet they choose to study digital tactics that are merely digital incarnations of analog ones and focus on outdated tactics and applications while ignoring tactics which are more relevant to current practices of digital activism. This desire to come to a certain theoretical conclusion leads the authors to make intellectually appealing yet practically unsound conclusions about how to evaluate digital tactics.

Outdated Tactics

In 2004, Jennifer Earl of the University of California at Santa Barbara and Katrina Kimport of the University of California at San Francisco created a data set composed of four types of digital tactics: petitions, letter-writing campaigns, email campaigns, and boycotts. The tactics, identified through a robust and innovative use of Google search, were split between “warehouse” sites like PetitionOnline.com (362 tactics), and non-warehouse sites, like personal blogs (748 tactics).

Already some problems are apparent. First, no social media platforms are included in their data set. Based even on a casual review of news headlines, social media seems extremely salient in “activism in the Internet age,” the avowed topic of the book. Social media is not discussed at length until the very last page of the conclusion, and is discussed in vague and platitudinous terms: “social networking sites like Facebook will encourage new uses and dynamics of online protest,” “networks could even be created around specific actions,” etc. (p 204). The disconnect is perhaps most visible in the index, which includes one entry and four sub-entries on “fax campaigns,” but not a single entry of any kind for “social networking” or “social media”.

Earl and Kimport do briefly acknowledge this shortcoming in the beginning of their book when they note that their “data are drawn from the period just preceding the rise of many dominant social networking Web sites” (p 27). However, this statement is problematic. First of all, it is not really true. The first wave social networks like Friendster (2002) and MySpace (2003) existed when they collected their data. Other social media platforms more important for activism, like Facebook (2004), YouTube (2005), and Twitter (2006), were founded soon after, and long before the publication of their book.

To draw conclusions about activism in the Internet age without reference to social media seems almost as negligent as drawing conclusions about weight gain without reference to carbohydrates. During the seven years between data collection and publication could they not have collected new data to reflect current practice? And, if such revision was impractical, could they not have couched their findings with a strong disclaimer? Publishing outdated material is a particular danger in this rapidly changing field, but downplaying or ignoring valid concerns about old data is more problematic.

What about the tactics they did choose: petitions, letter-writing campaigns, email campaigns, and boycotts? Earl and Kimport state that “most examples of relatively inexpensive activism online take the form of the e-tactics we examine in this book” (p 73), yet they offer no evidence for this claim. Did they do an earlier survey of a broad range of digital tactics and select the most popular to focus on? There is no evidence of this. Though anecdotal evidence supports the continuing popularity of email in digital campaigns, it’s hard to imagine that digital boycotts are as pervasive. After failures of high-profile e-petition sites like Number 10, the tactical value of e-petitions has also been questioned.1 In fact, Earl and Kimport acknowledge that “seven of the fifteen [warehouse sites] we studied are gone from the Web” (p 195), a fact that does not bode well for the current validity of their seven-year-old tactical data.

This focus on the pre-social media, Web 1.0 era of the Internet is also evident in their terminology: e-tactics, e-movements, e-mobilization. These terms are a throwback to the late nineties when the terms grew out of the word e-mail, short for “electronic mail.” Back then it was assumed that the principle difference between digital and paper media was that the former required electricity to be created and disseminated. We now have a more sophisticated understanding for how digital media is different from paper media, differences that hinge on the use of code (Lessig’s “perfect copies, freely made”) and network effects. (It is for this reason that I use the prefix “digital” instead of “e-” in this paper.)

Bottom Line: The four tactics selected for the study ignore the most popular current platforms, and have questionable representative salience.

Theory Before Evidence

Though Earl and Kimport’s book is founded on an empirical study, theirs is a deductive rather than inductive logic. They propose interesting theories yet their evidence does not really fit them. In other cases evidence they ignore challenges the validity of their theoretical claims.

There are the main theoretical arguments in the book:

  • Tactics that maximally leverage digital affordances will lead to theory 2.0 changes in pre-digital social movement theory while tactics that only minimally leverage those affordances will lead to supersize changes where the mechanics of pre-digital social movement theory remains intact, only at a larger scale.
  • That leveraged affordances should be the principal lens through which to evaluate digital tactics.
  • That new types of online organizing structures exhibit a power-law function in that the most engaged organizers is twice as active as the second most active and so on.

Supersize / Theory 2.0

Earl and Kimport’s contention that the use of digital technology in activism will require the updating of pre-digital social movement theories is a good one. However, the evidence they provide does not support this contention. This is likely a result of the types of tactics they decided to study. Since they clearly have an interest in showing how digital tactics require the re-working of pre-digital theories, it is peculiar that they choose to focus on tactics that are merely digital forms of pre-digital tactics, a fact they acknowledge when they write that “each of these e-tactical forms has an offline progenitor and a long offline legacy” (p 202). These seem like the tactics least likely to reveal paradigm shifts. In fact, I often refer to e-petitions as the consummate example of a supersize tactic in that it achieves the exact same function as an offline petition – collecting signatures – only it allows more signatures to be collected more quickly and from a wider geographic area.

To find evidence of model change Earl and Kimport could have chosen tactics, like the Google-bomb, that have no pre-digital form. For example, in one high-profile instance of Google bombing, gay sex columnist Dan Savage led a campaign to redefine the name of conservative politician Rick Santorum as a “frothy mix” associated with anal sex, a tactic meant to publicly shame Santorum for his homophobia. An analog equivalent of this tactic – changing the definition of a word in every dictionary – simply doesn’t exist. They could also have studied tactics that don’t quite line up with their pre-digital precursors. For example, though DDoS attacks have been referred to as digital sit-ins, they are really more like ordering a million pizzas to arrive at MasterCard headquarters. These “false cognate” digital tactics could also reveal areas where old theory needs to be updated. The reason why Earl and Kimport chose supersize tactics in their effort to demonstrate theory 2.0 effects is never explained as they never reveal their process for selecting the tactics in the first place.

Leveraged Affordances

Their second theoretical point, that the leveraged affordances (fully utilizing capacities of digital tools) of digital technology is “critical to understanding Web activism” (p 177) is certainly true, but it is not as central as they make it out to be. In their analysis they equate maximal leveraging of affordances with “skill” and the altering of past social movement theory while they equate a lack of maximal leveraging with the junk food metaphor “supersizing” (p 177). They are drawing an implicit hierarchy of tactics here, with the tactics that maximally leverage digital affordances on top.

Earl and Kimport acknowledge that both types of tactics are likely to coexist in practice, which is clearly the case. Yet the reason they give for this integration is flawed:

Reality is likely to always be a mix of supersize effects and theory 2.0 effects because some people don’t notice key affordances, other don’t want to or can’t leverage them even if they do notice them, and still others notice and leverage these affordances quite skillfully (p 177).

In this analysis they set up a duality where skill is equated with leveraged affordances and ignorance, refusal, and lack of capacity are equated with a failure to leverage. However, they miss one reason why someone might choose not to maximally leverage digital affordances: they have noticed the affordance and understand it, but skillfully realize that a digital tactic will not be effective in their particular context. That is, they make a skillful decision not to maximally leverage digital affordances.

There are many examples of the phenomenon of skilled minimal leveraging. The case of the Stop Stock-Outs campaign, which took place in 2009 in the southern Africa countries of Kenya, Malawi, Uganda, Zambia and Zimbabwe, is one such example.2 The key digital tactic of the campaign was a Pill Check Week in which volunteers visited public health facilities and then submitted reports of out-of-stock essential medicines via FrontlineSMS from their mobile phones. Those messages were used to create a stock-out map using the software Ushahidi to create a compelling visual which, in combination with other tactics, successfully drew the attention of local governments and international media.

By Earl and Kimport’s logic the campaign should have maximally leveraged digital affordances by using mostly (or exclusively) online tactics, since these tactics maximally leverage the digital affordances of low-cost collective action without copresence. According to this pure leveraged affordance analysis, the organizers should have called the facilities to check pill levels rather than sending volunteers out into the field to collect reports. A volunteer could call a facility in a few minutes for a few cents but it likely took hours to visit the facilities in person, plus the cost of transportation. However, if volunteers had only called facilities, they would have been forced to receive their information from facility staff who may not have been motivated to be truthful about the shortages at their facility, assuming any of the overworked staff even had the inclination to pick up at all. By using the higher-cost offline tactic of visiting the facilities, the volunteers could interview a range of patients, circumventing the necessity of getting information from facility staff and making their final reports multi-sourced and more reliable. In this way organizers increased their effectiveness by choosing a mixed offline-digital tactic rather than a purely digital tactic that maximally leveraged digital affordances. Though less theoretically elegant that a pure affordances framework, analysis of the effects of digital tactics reveals that no single measure can determine the value of a tactics, especially where information about effects is absent.

Power-Law Dynamics

The final theoretical argument, which Earl and Kimport introduce at the end of their paper, is that new digital organizations are likely to follow a power-law function because of the ease of digital organizing. They quote Clay Shirky’s definition of a power law: data “in which the nth position has 1/nth of the first position’s rank” such that the 2nd position has a quantity of 1/2 that of the 1st position and so on. They argue:

Innovative uses of the Web can make organizing inexpensive enough that it can begin to follow power-law dynamics in some situations. When that happens, one person will bear the majority of the costs, the active organizer has to bear substantially fewer costs, and so on down the line so that quickly there are no organizing costs left to bear at all…. Our power-law explanation of organizing is certainly consistent with the findings that we cited above of online protests being led by single individuals, pairs, or drastically small teams (p 152 and 153).

However, “consistent” is quite different from mathematically verified. Saying that, in the thirty-eight digital organizations they interviewed, a lead organizer did the lion’s share of the work is far from being able to demonstrate a power law. On could easily imagine that the division of labor followed this patten without following the power law.

In fact, they do not even attempt to show quantitative evidence for their claim. It would not have been difficult to collect data during these interviews about the number of hours per week each member of the organization worked, to see how closely this data matched a power-law graph. However, there is no evidence that they attempted to prove or disprove their claim, even based on their own limited sample. Perhaps they thought that the theory was so attractive that it did not require evidence to support it.

But Does it Work?

Why do Earl and Kimport’s theoretical conclusions seem so detached from the real life practice of digital organizing and activism? It is likely because they blithely eschew the key evaluative question of any organizer: “does it work?”. Earl and Kimport do not consider the effectiveness of any of the tactics in their study. “Ours is not a study of the effectiveness of e-tactics,” they write, “so although we are aware of many successful online campaigns, including efforts in our data set, we cannot empirically address” claims challenging the effectiveness of digital tactics (p 94). Their focus on claims over evidence may be a direct result of the fact that their otherwise methodologically strong study ignores the effects of their digital tactics.

Bottom Line
: The authors present arguments in favor of theories of value that are unsupported – or substantially contradicted – by evidence.

Conclusion

The book is not without interesting ideas. The idea that digital tactics will force a re-working of some elements of social movement theory is spot-on and leveraged affordances is certainly one valuable way to evaluate a digital tactic. Changes in organizational structure, made possible by digital tools, are also important, though without reference the the effectiveness of these new types of organizations, their ultimate impact is in question. Earl and Kimport are also right to note that online privacy norms may change expectations about what it means to act in public and I agree that these quick-start organizations, created by new activists, will likely lead to more episodic activism. It also seems that the ease of online participation may also not require previous feelings of collective identity to motivate participation, another interesting challenge to existing theory.

These positive points do not save the book, though. Its disregard for effects, choice of outdated tactics as the focus of study, and attention to theory over evidence lays the whole field of the digital contention open to charges of disconnected abstraction, cyber-utopianism, and techno-fetishism that threaten this young field’s legitimacy.

What Causes Digital Activism… And What Does Digital Activism Cause?

There are two important causal questions for digital activism researchers: what causes digital activism and what does digital activism cause? The former is easier to answer. The latter is more difficult but also more interesting.

These two questions can be visualized in linear time where the causes of digital activism (from macro contextual factors like internet penetration rate to micro factors like activist motivation) result in an instance of digital activism (a Facebook campaign, a Twitter hashtag, an e-petition) which is itself the cause of some political or social result (mobilized supporter, a change in policy, even no effect at all). The image above shows these three events and the two causal relationships that overlay them. The instance of digital activism, in the middle of the causal stream, is both a result of the previous causes and a cause of the subsequent results.

1st Causal Relationship: What Causes Digital Activism?

The first causal relationship, the causes of a digital activism instance, are easier to get at, at least in terms of probability. Though we can never know every factor that caused a digital activism instance to arise (a blogger has a fight with her boyfriend, decides not to give him the camera she bought him, and instead uses it to capture a major instance of police abuse), we can still hope to identify the major contextual elements that correlate to instances of digital activism. The Global Digital Activism Data Set will perform this correlative function since it will be possible to correlate the number of instances (or successful instances) of digital activism in a given country to various social, political, technological, and economic contextual factors. For example, we might learn that the youth population and mobile phone penetration rate are more reliable predictors that an instance of digital activism will occur than political freedom and median income.

Here it is appropriate to acknowledge that causation is easier to pin down at the macro level of the nation-state than the micro level of the individual. We can say with confidence which national indicators correlate with national digital activism rates, but as the work of Cosma Shalizi has shown, it is difficult to tell why an individual joined a Facebook cause or followed a tweeted directive to join a protest. However, while questions of individual motivation are interesting, we can learn a great deal about digital activism even without this knowledge. We do not need to know what they acted, only whether or not they did.

2nd Causal Relationship: What Does Digital Activism Cause?

The second causal question – what does the digital activism instance cause? – is more difficult to ascertain but also more important. If there is a clearly visible change in the phenomenon that the digital activism instance aimed to influence (the end of a regime, passage of a new law), to what extent was digital activism responsible?

This is the domain of the “Facebook Revolution” and “Twitter Revolution,” terms that imply that there was an overriding causal connection between the revolution and digital activism instance. Of course, this would only be true if the other possible causal factors (role of traditional media, international pressure, elite intrigue, credibility of alternative governing parties) combined to play only a minority role, which seems unlikely.

If we wanted to demonstrate this type of causation in terms of probability we would need a data set that accurately recorded the relative strength of the same causal factors (to allow for direct comparison) according to a viable strength metric, a significant challenge in and of itself.

While we can determine causation through a rigorous qualitative process, such as interviews with key activists, review of media reports, and survey data, these conclusions only apply to the specific instance they describe. The conclusions could only be extrapolated to other scenarios if there the same qualitative data was available across a representative array of cases.

To give an example, we can only use the outcomes of digital technology use in Egypt, Tunisia, Libya, Yemen, and Syria to make guesses about the outcomes in Saudi Arabia if we have rigorous data on a range of relevant causal factors for all these countries, such that empirical comparative analysis can be carried out. There has been such an academic feeding frenzy in Egypt that it is reasonable to believe that we will have a reliable account of the role digital technology played in that revolution, but without equivalent analysis for other countries, there is no empirical basis for comparison, only plenty of grist for talking-head to make subjective comparisons to Saudi Arabia or Bahrain and make whatever conclusions they like.

How important is digital activism in shaping outcomes of political contention in which it is involved? What are the mechanisms of this influence? Are they the same across countries? We need better methods for answering the big questions of digital activism research.

The Marriage of Scaled Hybridity and Uncle Sam

Note: The authors’ views expressed in this article do not reflect the views of the United States Agency for International Development or the United States Government

In my last post I discussed how the U.S. Government (USG) is funding civil society organizations (CSOs) abroad to help build their capacity to use new media in the pursuit of increased democracy and governance. Essentially, this initiative is based on the assumption that increased ability to engage in new media equals increased effectiveness in democracy promotion. However, without empirical evidence to test this assumption, it leaves new media development interventions open to criticism and failure. In this post I’ll outline why research focused on this small niche of USG funded organizations is important for more than just Washington bureaucrats.

Within the fields of both civil society and digital activism, one of the most debated topics is whether increased engagement in new media is in having a positive or negative influence on actors working towards increased democracy. On one hand, they represent invaluable tools for organizing and disseminating information – on the other they’re a window for repression and detached realities of progress. In short, it’s yet to be determined whether the ICT revolution is one of liberation technology or repression technology. A main reason this debate continues is the lack of research, particularly research along methodological lines of hybridity (a problem succinctly outlined in this post by Mary Joyce). Hybridity in this case refers to the identification of objects of analysis in which online and offline activity interact. This is a way to measure not only the digital footprint of activism, but also their real world implications. A key challenge of hybridity analysis is finding ways to scale research beyond qualitative case studies in a practical, cost-effective manner while still maintaining the richness of data required to measure offline activities.

With this challenge in mind, the small sub-set of CSOs receiving USG funding to support their democracy efforts in new media represent a unique sample from which to draw data from the broader spectrum of digital activists. Foremost, an organization receiving USG funds is generally bound to complete regular systematic monitoring of inputs, outputs, and outcomes coupled with at least one evaluation of population level impacts. A common yet disparaging theme of development project reporting is characterized by field staff writing lengthy reports only to be read once and then stuffed in a drawer never to see daylight again. The limited shelf life of these reports is understandable, they represent data specific to one project working in one country within a relatively narrow focus. A method for aggregating these individual reports and making them useful for cross-country comparison was exemplified by the Presidents Emergency Plan for AIDS Relief (PEPFAR), a surge of billions of dollars to combat HIV/AIDS around the world initiated by President Bush and carried on by President Obama. PEPFAR instituted a rigorous format of reporting along standardized indicators as a requirement for any organization receiving its funds. The aggregate data from thousands of organizations across dozens of countries comes together in an annual report. This report allows PEPFAR to show demonstrable evidence of success to congress (thus ensuring continued funding), guides more effective programing, and adds a trove of data to the field of HIV/AIDS research.

A similar standardized reporting system initiated for CSOs receiving USG funding for new media promotion would have similar benefits, assisting in the discovery of conditions that allow the combination of new media and democracy promotion to flourish and where it’s destined to be fruitless or too risky an endeavor. A mandatory reporting system would also go a long way in solving one of the problems of scaled hybridity analysis, in that the collection of rich offline data falls not on the researcher traveling to each organization, but on trained staff within the CSO who are responsible for submitting reports on a regular basis.

A drawback to this method is that like all research, the usefulness of the data collected is dependent on the validity of the indicators and the quality of the measurements. In the field of digital activism, both of these areas have remained elusive from shared consensus. One possible starting point is the U.S Institute for Peace (USIP) report Blogs and Bullets , which outlines five levels of analysis for finding a comparable scale of measurement in regards to impact across organizations and countries. With considerable fleshing out it could serve as a useful framework to build standardized indicators that accurately capture hybridity.

Another distinct hurdle is that unlike success in battling HIV/AIDS, organizations working in democracy promotion may be wary to share a comprehensive record of their achievements, or even make public their acceptance of USG funds. Anonymity and limited public release of certain data are possible solutions, but caution would have to take precedence.

One more factor to consider is that standardized reporting across a sector is expensive for a development agency. It takes training, time and collaboration that require additional staff and funds from project budgets already stretched thin. PEPFAR can do it because it’s one of the largest development initiatives ever undertaken. USG funding to support democracy activists abroad in the use of new media is a relatively miniscule sliver of foreign aid, but as I wrote in my last post it has the potential to grow exponentially. But if this prediction proves true, it’s going to be critically important to have data that can answer the simple question: Is it a good idea? Developing a standardized hybridity analysis is beneficial not only for the USG, but also any international donor supporting democracy through new media. The results of such an analysis would help answer whether foreign funded democracy initiatives through new media support is a good idea, but also shed new light on the continuing cyber optimist – cyber pessimist debate.

 

In forthcoming posts I will continue to explore methods of evaluating the effectiveness of digital media used by civil society actors.

 

How Do You Study a Moving Object?

This morning I was reading Digitize This Book!for my side project on digital epistemology when I came across this 2001 quote from a book byPeter Lunenfeld,a professor in theDesign|Media Artsdepartment atUCLA.

A critical theory of technological media will always be in inherent conflict with the practice of creating these very media. For if theory demands from its objects a certain stability, theory is itself free to break the tethers of its objects…. The pressures of the market and the innovations of the laboratory combine to make stability impossible within the practice of digital media, however. [emphasis added]

To “pressures of the market” and “innovation of the laboratory,” Lunenfeld could also add “political contention” as a force preventing stability in the practice of digital media. For example, at one time, digital activists really did have the upper hand on the political uses of digital technology, but repressive regimes are becoming savvier to these uses and such activities as organizing online – previously safer than organizing in the street – now also entail dangers of surveillance, interception, and persecution. The practice of digital media – this case the practice of the political use of digital media – is constantly changing, never stable.

This instability is one of the of the reason I find the study of digital activism so fascinating, the practice of digital activism is constantly evolving, constantly incorporating new tools, creating and refining tactics, reacting to opponents. Yet it is also a real problem for scholars: how do you study a moving object? Once we feel we understand something about digital activism – either because practices correspond to an existing theory or because we make up a new theory to explain those practices – those practices subsequently change, upsetting the theoretical apple cart. How is is possible to make truthful statements under these circumstances? Lunenfeld has an answer: the digital dialectic.

The digital dialectic offers a way to talk about computer media that is open to the sophisticated methodologies of theory without ignoring the nuts a bolts or, better yet, the bits and byte of their production. To repeat, the digital dialectic… grounds the insights of theory in the constraints of practice.[emphasis added]

By digital dialectic Lunenfeld means that digital theory and digital practice interrogate one another such that theory frames our understanding of practice and practice informs theory in a kind of feedback loop.

I like the idea of a digital dialectic because it stresses that both theory and practice must co-exist in order to understand digital phenomena, but I don’t think it resolves the problem of the instability of practice. Even a process of constant interrogation can fail at pinning down the truth. Practically speaking, I think our best bets are to constantly collect and analyze new data about practices of digital activism: start the tape early, never stop it, and continually analyze new results. This is an appealing methodology for the Global Digital Activism Data Set, although it is an expensive and exhausting one.

Second, I think we need to be honest about the short shelf life of digital activism knowledge. We need to be explicit about the time at which data was collected and not make statements about the present with old data. How old is old? I’d say data about digital activism practice is valid for about a year, definitely outdated in five, though I’d be interested in other opinions on that figure. The constant change of digital activism make it an equally fascinating and maddening subject for study, but with a little humility and a rigorous requirement for the most recent data, we may yet be able to understand it.

 

 

Proudly powered by WordPress
Theme: Esquire by Matthew Buchanan.