BY ANGELA HAWKEN, MATT LEIGHTY | NOVEMBER 25, 2010

Autocratic regimes, by their nature, tend to view the opinions of their populations as a threat to be stifled. Over the years, leaders from Syria to North Korea have sharpened their tools of repression to squelch any sign of public dissatisfaction with their rule and keep their population's views a mystery to outside observers. As a result, information about how these citizens view their government has long existed in a vacuum -- at the mercy of hearsay and conjecture. But a small cadre of pollsters is using new technologies and practices to circumvent government restrictions and give a voice to the silenced. We like to call them guerrilla pollsters.

We've been intimately involved in the effort to conduct public-opinion surveys in countries controlled by authoritarian regimes. In January, we completed the analysis of an in-person survey of 1,046 adults living in Syria. The poll, conducted by the Democracy Council, a California-based NGO, was the first face-to-face survey collected by an unsanctioned organization on the ground in Syria.

Democracy Council had to overcome several hurdles to pull off the survey. First, it had to find 60 qualified interviewers in a country where such data collection is illegal and then train them from scratch. The interviewers were recruited by word of mouth, and each was put through an extensive background check to make sure that he or she had no association with the Syrian government. They were also screened for educational requirements and adequate written and verbal communication skills.

New technology greatly assisted in the training process. Democracy Council prepared its field staff using Skype, the well-known Internet calling service, which now allows videoconferencing. Skype provided several advantages: The calls are encrypted, so any messages intercepted by Syrian security services would be unintelligible, and videoconferencing avoided the need for any in-person gathering, which might have attracted the attention of the authorities. This method also kept the interviewers' identities a mystery to each other. Even if a government agent managed to pass the extensive background check, at least he or she wouldn't know the identities of the other fieldworkers.

Interviewers then sought out potential subjects with whom to conduct an in-person interview that lasted approximately 30 minutes. The fieldworkers were guided by Syrian statisticians and demographers to ensure that the data collected were representative of the Syrian population. Because security risks made it impossible to gather a completely representative sample, the research team at Pepperdine University that prepared the independent survey report weighted the survey data to ensure that the final results were nationally representative based on age, sex, location, religion, and education.  

The survey findings reflected poorly on the Syrian government and quickly spread through the media. The poll found that a majority of Syrians believe that their political and economic situation is poor and worse than it was five years ago. They consider the government to be corrupt and have little faith in its ability to confront the country's problems. A substantial majority believes the state of emergency, which has been in place since 1963 and used to justify violations of civil liberties, should be lifted, and a majority reported that it would leave Syria if it had the opportunity to do so.  

But more important than the findings is that the data exists at all. A public-opinion poll was successfully conducted within a closed regime, and without its consent. And as the critical account of the Syrian government's performance showed, Syrians weren't reluctant to speak their minds. Given the high risks to both the data collectors and the survey respondents, it is stunning just how willing these citizens were to talk.

Due to the unique circumstances under which the survey was conducted, it did face some hurdles that required us to make some adjustments to achieve a representative sample of the population. Among survey respondents, for example, men outnumbered women 2 to 1. We corrected for this disparity by giving more weight to women's responses in the final results. It is unclear whether the relative reluctance of women to participate in the survey was the result of their lesser interest in politics -- men reported a higher consumption of political news -- or whether they were more fearful of retribution. This does raise a concern that survey results might be skewed to those who are more politically minded.

KIM JAE-HWAN/AFP/Getty Images

 SUBJECTS:
 

Angela Hawken is associate professor of economics and policy analysis, and Matt Leighty is assistant project director, at the School of Public Policy at Pepperdine University.

JULIAJULIA

8:38 AM ET

November 26, 2010

..

Information about "how these situation is connected with citizens view of their government which has long existed in a vacuum -- at the mercy of hearsay and conjecture" - good argumentation: For USA foreign policy this explanation is appropriate regarding the acceptance of Foreign political direction from the USA citizens.

Again syndrom of Manifest destiny....

This situation is more related with the world (international) market and USA export and to bigger extend with the USA Nuclear Program isn`t it?

 

DONGSOOLA

1:48 PM ET

November 30, 2010

what do u mean has long

what do u mean has long existed in a vacuum? ha !

 

JULIAJULIA

8:40 AM ET

November 26, 2010

comment is related to the article "Want to Know What North Kore"

The comment above is related to the article "Want to Know What North Kore"

 

JULIAJULIA

8:56 AM ET

November 26, 2010

...

What is USA scenario now?Any ideas?

 

DR. JONES JR.

9:58 AM ET

November 26, 2010

Sorry, Julia

It's quite difficult to understand what you're trying to say.

Were you using an electronic translator?

 

MARTY MARTEL

8:12 AM ET

November 27, 2010

Does it really matter?

Laudable that it may be, the results with such polling methods are dubious at best. One also has to remember that more often than not, a person being polled is going to answer what the pollster wants to hear by the way the question gets phrased.

Will such polling really change in North Korea? Not really.

Will Kim Jong Un’s power grab engineered by his father succeed? Most likely.

Can anybody change that outcome? China can but China has already blessed such a power transfer.

Will North Korean military rebel against China’s interference? Not likely because China has complete control over North Korean military since the Chinese troops flooded North Korea to fight against US in 1954 even though US wants to forget all about that.

 

ZKP20977

3:26 PM ET

November 27, 2010

It Does Matter

The potential for polling people in closed societies is potentially very helpful. It offers insight, whether completely accurate or even a little bit accurate, that one would not otherwise have. The polling, as it applies to North Korea, is particularly interesting. The results seem to indicate that maybe North Koreans do not necessarily want a dynastic transfer of power. Perhaps they could actually be a part of the world someday if their government were changed, or at least would open up. Obviously, current events make this prospect almost non-existent. Looking at the polling generally, what is the goal? What does the polling offer in terms of action? Well, I think the polling could potentially compel regional actors to help resolve a crises related to rogue regimes.

 

DONGSOOLA

1:51 PM ET

November 30, 2010

North Korea is not closed

North Korea is not closed society. Its isolated country by US and others in the fear that they might lose their personal property.

Polling? what about I poll a bunch of homeless here in US and ask them what they think about US?

One homeless everyday complains about Government. Last time he said "the US government is trying to kill me.".. ha.!

 

GRANT

8:11 PM ET

November 28, 2010

We shouldn't forget that

We shouldn't forget that these activities (useful though they may be) still put people in serious danger. Things would be bad enough if they were caught in Syria but North Korea would be unimaginable. Don't be too enthusiastic and remember why caution must be exercised.

 

NICHOLAS WIBBERLEY

9:35 AM ET

November 29, 2010

Back off!

What do you intend to do with this dubious information? What use is it to anyone? Is it idle curiosity or are you simply unable to resist sticking your noses where they surely are not wanted? If those who cooperated in this nonsense are ever located you will be responsible for ending their lives, more than probably after a very disagreeable intervening stage. Heaven help us, haven’t you enough problems at home?