Editorial Type:
Article Category: Research Article
| Online Publication Date: 23 Jun 2011
Selection and Response Bias in Protest Surveys
Selection and Response Bias in Protest Surveys
and
Page Range: 203 – 222
Popular opinion suggests protest has become ubiquitous in advanced postindustrial democracies. In order to assess this perspective scholars have increasingly relied on so-called protest surveys to gauge protesters' attitudes and characteristics while in the act of protesting. This growing body of literature has neglected the design of protest surveys and has yet to systematically test the reliability of the evidence they produce. This study attempts to make a contribution on both fronts. After reviewing the available studies relying on protest surveys, it proposes a standardized method to sample respondents in moving crowds. The sampling procedure is tested in 22 demonstrations across a variety of issues and countries. Based on a series of field experiments, the paper puts forward a specific protest survey fieldwork method by which selection bias and response bias can be reduced to a considerable degree.
Bédoyan, Isabelle, Peter Van Aelst, and Stefaan Walgrave. 2004. "Limitations and Possibilities of Transnational Mobilization: The Case of EU Summit Protesters in Brussels 2001." Mobilization 9(1): 39-54.
Blanchard, Philippe, and Olivier Fillieule. 2010. "Individual Surveys in Rallies (INSURA): A new tool for exploring transnational activism?" Pp. 186-210 in The Transnational Condition. Protest Dynamics in an Entangled Europe, Simon Teune, ed. Berlin: Bergahn Books.
Borg, Ingwer, and Tracy Turen. 2003. "Early versus Later Respondents in Internet-based, Organizational Surveys." Journal of Behavioral and Applied Management 4(1): 1-17.
Botetzagias Iosif, and Moses Boudourides. 2004. "Perceptions of War and Justice amongst Greek Mobilisers: The Case of Iraq Second War." Paper presented at the Conference "'Critically Thinking Global Resistance One Year Later': A Conference on the Global Protest of February 15, 2003, and the Movement against the War in Iraq." Columbia University, New York, March 27-28.
Boserup, Anders, and Claus Iversen. 1966. "Demonstrations as a Source of Change." Journal of Peace Research 3(4): 328-48.
Couper, Mick P., and Robert M. Groves. 1996. "Social Environmental Impacts on Survey Cooperation." Quality and Quantity 30: 173-188.
della Porta, Donatella. 2004. "Multiple Belongings, Flexible Identities and the Construction of 'Another Politics': Between the European Social Forum and the Local Social Fora." Pp. 175-202 in Transnational Movement and Global Activism, edited by Donatella Della Porta and Sidney Tarrow. Lanham, MD: Rowman and Littlefield.
della Porta, Donatella, Massimiliano Andretta, Lorenzo Mosca, and Herbert Reiter. 2006. Globalization From Below: Transnational Activists And Protest Networks. Minneapolis: University of Minnesota Press.
Dillman, Don A. 2000. Mail and Internet Surveys: The Tailored Design Method. New York: John Wiley.
Downton, James, and Jr. Paul Wehr. 1998. "Persistent Pacifism. How Activist Commitment is Developed and Sustained." Journal of Peace Research 35(5): 531-50.
Etzioni, Amitai. 1970. Demonstrating Democracy. New York: Gordon and Breach.
Favre, Philippe, Olivier Fillieule, and Nonna Mayer. 1997. "La fin d'une étrange lacune de la sociologie des mobilisations: L'étude par sondage des manifestants: fondements théoriques et solutions techniques." Revue Française de Science Politique 47: 3-28.
Fillieule, Olivier. 1997. Stratégies de la rue. Les manifestations en France. Paris : Presses de Sciences Po.
Fisher, Dana R., Kevin Stanley, David Bergmann, and Gina Neff. 2005. "How Do Organizations Matter? Mobilization and Support for Participants art Five Globalization Protests." Social Problems 52(1): 102-121.
Fisher, Dana R. 2007. "Taking Cover Beneath the Anti-Bush Umbrella: Cycles of Protest and Movement-to-Movement Transmissions in an Era of Repressive Politics." Politics and Globalization, Research in Political Sociology 15: 27-55.
Giugni, Marco, Marko Bandler, and Nina Eggert. 2006. "The Global Justice Movement." Civil Society and Social Movements Programme Paper Number 24, United Nations Research Institute for Social Development.
Goss, Kristin A. 2000. "The Million Mom March: A Preliminary Report on Survey Findings." Department of Government, Harvard University, Cambridge, MA.
Goss, Kristin A. 2003. "Rethinking the Political Participation Paradigm: The Case of Women & Gun Control." Women & Politics 25(4): 83-118.
Groves, Robert M., Don A. Dillman, John L. Eltinge, and Roderick J.A. Little. 2002. Survey Nonresponse. New York: John Wiley & Sons.
Heaney, Michael, and Fabio Rojas. 2007. "Partisans, Nonpartisans, and the Antiwar Movement in the United States." American Politics Research 35(4): 431-64.
Heaney, Michael, and Fabio Rojas. 2004. "A Strategic Approach to Collective Action: Looking for Agency in Social Movement Choices." Mobilization 9(1): 1-30.
Jasper, James M., and Jane Poulsen. 1995. "Recruiting Strangers and Friends: Moral Shocks and Social Networks in Animal Rights and Anti-Nuclear Protests." Social Problems 42(4): 493-512.
Jenkins, Robin. 1967. "Who Are These Marchers?" Journal of Peace Research 4(1): 46-60.
Kaplowitz, Michael, Timothy Hadlock, and Ralph Levine. 2004. "A Comparison of Web and Mail Survey Response Rates." Public Opinion Quarterly 68: 94-101.
Klandermans, Bert. 1997. The Social Psychology of Protest. Oxford: Blackwell Publishers.
Klandermans, Bert, and Dirk Oegema. 1987. "Potentials, Networks, Motivations and Barriers: Steps Towards Participation in Social Movements." American Sociological Review 52: 519-31.
Klandermans, Bert, and Jackie Smith. 2002. "Survey Research: A Case for Comparative Designs." Pp. 3-31 in Methods of Social Movement Research, edited by Bert Klandermans and Suzanne Staggenborg. Minneapolis, MN: University of Minnesota Press.
Klandermans, Bert, and Jacquelien van Stekelenburg. 2005. "Promoting or Preventing Social Change? Perceived Threat (Instrumental/Ideological) and Identity as Protest Participation Motives." Paper presented at the annual meeting of the American Sociological Association, Philadelphia, PA.
Ladd, Anthony, Thomas C. Hood, and Kent D. Van Liere. 1983. "Ideological Themes in the Antinuclear Movement: Consensus and Diversity." Sociological Inquiry 53(2-3): 252-72.
McPhail, Clark. 1991. The Myth of the Madding Crowd. New York: Aldine De Gruyter.
McPhail, Clark. 1994. "Social Behavior in Public Places: From Clusters to Arcs and Rings." Pp. 35-57 in The Community of The Streets, edited by Spencer Cahill and Lyn H. Lofland. Greenwich, CN: JAI Press.
Norris, Pippa. 2002. Democratic Phoenix. Cambridge: Cambridge University Press.
Norris, Pippa, Stefaan Walgrave, and Peter Van Aelst. 2005. "Who Demonstrates? Anti-State Rebels or Conventional Participants? Or Everyone?" Comparative Politics 2(37): 251-75.
Parkin, Frank. 1968. Middle Class Radicalism: The Social Bases of the British Campaign for Nuclear Disarmament. New York: Praeger.
Porter, Stephen, and Michael Whitcomb. 2005. "Non-response in Student Surveys: The Role of Demographics, Engagement and Personality." Research in Higher Education 46: 127-152.
Putnam, Robert. 2000. Bowling Alone: The Collapse and Revival of American Community. New York: Simon & Schuster.
Rootes, Chris, and Clare Saunders. 2007. "Demonstrations of Democracy: The Make Poverty History and Stop Climate Chaos Marches." Paper presented at the European Consortium for Political Research Joint Workshops, Helsinki, May 7-12.
Rüdig, Wolfgang. 2006. Assessing Nonresponse Bias in Activist Surveys: A Study of 2003 Anti-Iraq War Protesters in Scotland. Unpublished paper. University of Strathclyde, Department of Governent, Glasgow. Online on http://www.strath.ac.uk/media/departments/government/Assessing_nonresponse_bias_in_activist_surveys.pdf. http://www.strath.ac.uk/media/departments/government/Assessing_nonresponse_bias_in_activist_surveys.pdf
Rüdig, Wolfgang, Lynn G. Bennie, and Mark N. Franklin. 1991. Green Party Members: A Profile. Glasgow: Delta Publications.
Scaminaci, James, and Riley E. Dunlap. 1986. "No Nukes! A Comparison of Participants in Two National Antinuclear Demonstrations." Sociological Inquiry 56: 259-88.
Schweingruber, David, and Clark McPhail. 1999. "A Method for Systematically Observing and Recording Collective Action." Sociological Methods Research 27: 451-98.
Seidler, John, Katherine Meyer, and Lois MacGillivray. 1976. "Collecting Data on Crowds and Rallies." Social Forces 55(2): 507-18.
Tourangeau, Roger, Lance J. Rips, and Kenneth Rasinski. 2000. The Psychology of Survey Response. Cambridge: Cambridge University Press.
Van Aelst, Peter, and Stefaan Walgrave. 2001. "Who Is That (wo)man in the Street? From the Normalisation of Protest to the Normalisation of the Protester." European Journal of Political Research 39: 461-86.
Van Stekelenburg, Jacquelien. 2006. "Promoting or Preventing Social Change: Instrumentality, Identity, Ideology and Group-based Anger as Motives of Protest Participation." Doctoral Dissertation, Amsterdam, Free University.
Verhulst, Joris, and Stefaan Walgrave. 2007. "Protest and Protesters in Advanced Industrial Democracies: The Case of the 15th February Global Anti-war Demonstrations." Pp. 124-144 in Civil Societies and Social Movements: Potentials and Problems, edited by Derrick Purdue. London: Routledge.
Verhulst, Joris, and Stefaan Walgrave. 2009. "The First Time is the Hardest? A Cross-national and Cross-issue Comparison of Firsttime Protest Participants." Political Behavior 31(3): 455-84.
Waddington, David. 1988. Flashpoints of Public Disorder. London: Methues.
Walgrave, Stefaan, and Bert Klandermans. 2009. "Patterns of Mobilization." Pp. 169-193 in Protest Politics: Antiwar Mobilization in Advanced Industrial Democracies, edited by Stefaan Walgrave and Dieter Rucht. Minneapolis: Minnesota University Press.
Walgrave, Stefaan, and Dieter Rucht (eds). 2009. Protest Politics: Antiwar Mobilization in Advanced Industrial Democracies. Minneapolis: Minnesota University Press.
Walgrave, Stefaan, and Joris Verhulst. 2006. "Towards 'New Emotional Movements'? A Comparative Exploration into a Specific Movement Type." Social Movement Studies 5(3): 275-304.
Walgrave, Stefaan, and Joris Verhulst. 2009. "Government Stance and Internal Diversity of Protest." Social Forces 87(3): 1355-87.