Volkov, Denis

English

SSOAR - Social Science Open Access Repository 

www.ssoar.infoAre Meaningful Public Opinion Polls Possible inToday's Russia?Volkov, DenisVeröffentlichungsversion / Published VersionZeitschriftenartikel / journal articleEmpfohlene Zitierung / Suggested Citation:Volkov, D. (2023). Are Meaningful Public Opinion Polls Possible in Today's Russia? Russian Analytical Digest, 292,2-3. https://doi.org/10.3929/ethz-b-000599408Nutzungsbedingungen:Dieser Text wird unter einer CC BY-NC-ND Lizenz(Namensnennung-Nicht-kommerziell-Keine Bearbeitung) zurVerfügung gestellt. Nähere Auskünfte zu den CC-Lizenzen findenSie hier:https://creativecommons.org/licenses/by-nc-nd/4.0/deed.deTerms of use:This document is made available under a CC BY-NC-ND Licence(Attribution-Non Comercial-NoDerivatives). For more Informationsee:https://creativecommons.org/licenses/by-nc-nd/4.0Diese Version ist zitierbar unter / This version is citable under:https://nbn-resolving.org/urn:nbn:de:0168-ssoar-86779-1RUSSIAN ANALYTICAL DIGEST No. 292, 22 February 2023 2COMMENTARYAre Meaningful Public Opinion Polls Possible in Today’s Russia?Denis Volkov (Levada-Center, Moscow)DOI: 10.3929/ethz-b-000599408Ever since Vladimir Putin announced the start of a spe-cial military operation (SMO), public opinion polls in Russia have been criticized with renewed vigor. Usually, critics give the following reasons why Russian polls can-not be trusted. Some argue that in 2022, the response rate has declined sharply and people’s reluctance to par-ticipate in surveys has increased. Others say that respon-dents interrupt interviews as soon as the conversation turns to events in Ukraine. Some say that only sup-porters of the government are now participating in the polls, while opposition-minded citizens prefer to abstain. Others speak of survey list experiments, which seem to show lower support rates, and claim that these show the “real mood” of the people. Finally, the most extreme critics of polls say that polls are not relevant because they do not show what people “really think.” Let us take a look at each of these allegations in turn.At the Levada Center, we use the AAPOR recom-mendations (https://www-archive.aapor.org/Education-Resources/For-Researchers/Poll-Survey-FAQ/Response-Rates-An-Overview.aspx) to calculate the response rate for each survey we conduct. In 2022, the average response rate in our regular all-Russian door-to-door survey was 27 percent. This is slightly less than in 2021 (31 percent on average), but higher than the averages of previous years (25 percent in 2020, 20 percent in 2019). For now, let us leave aside the discussion about what kind of response rate is considered sufficient (in the United States, for example, 9 percent has been considered an acceptable level of reach for telephone surveys, https://www.pewresearch.org/methods/2017/05/15/what-low-response-rates-mean-for-telephone-surveys/). Impor-tantly, the response rate has not changed much in the past year (just as attitudes toward the surveys themselves have not changed, https://www.levada.ru/2022/05/24/uchastie-v-oprosah-i-doverie-dannym/). If things were different, surveys according to the usual methodology would become impossible: interviewers would not take on a task that was obviously impossible, or the cost of their work would become prohibitive. But that has not happened.We looked into the problem of interrupted interviews at the end of last year (https://www.levada.ru/2022/11/15/o-nedostizhimosti-i-prervannyh-intervyu/). The analy-sis showed that this indicator is stable and has barely changed over time. In each survey on questions related to Ukraine and the “special operation” conducted in 2022, only 2 to 7 interviews were interrupted, which is an insignificant number on the scale of the entire survey. Moreover, “Ukrainian” questions do not differ in this sense from questions on other topics. In most cases, if respondents have already agreed to answer, they will go through the survey to the end, especially if it is a face-to-face interview. Therefore, there appear to be no grounds for questioning the quality of the survey data on the basis of interrupted interviews.Nor have claims that only supporters of the author-ities take part in the polls been confirmed to date. Look-ing at the results of the panel survey of respondents who have taken part in Levada Center surveys (https://www.levada.ru/2022/06/14/gotovnost-uchastvovat-v-oprosah-rezultaty-exsperimenta/), we were unable to confirm the assumption that people who repeatedly par-ticipate in telephone surveys assess the events more pos-itively, nor that respondents who do not approve of the activities of the country’s leadership more often refuse to participate in surveys (and, thus, that public opin-ion polls capture the views only of those who are pre-pared to make contact and answer polling questions). In other words, the increased support for the authorities and their decisions in 2022 reflects actual changes in public sentiment rather than any shortcomings of the survey instrument.As for survey list experiments (https://blogs.lse.ac.uk/europpblog/2022/04/06/do-russians-tell-the-truth-when-they-say-they-support-the-war-in-ukraine-evidence-from-a-list-experiment/), which seem to indicate lower support for the authorities and the SMO, their results cannot always be interpreted unambiguously. Research-ers who conducted similar experiments on mass support for Vladimir Putin in Russia in 2015–2021 warn against such an interpretation of the results of their experiments (https://www.ponarseurasia.org/is-putins-popularity-still-real-a-cautionary-note-on-using-list-experiments-to-measure-popularity-in-authoritarian-regimes/). The figures obtained as a result of such experiments coincide with the indicators of unconditional support for military action and power. But this does not mean that those who have doubts and show weak or conditional support do not really support the SMO. There is a whole set of factors that encourage doubters to side with the majority (https://ridl.io/can-you-trust-russia-s-public-support-for-a-military-operation-in-ukraine/). To reduce everything to a fear of answering pollsters would be a gross oversimplification.Finally, there is a thesis that in repressive Russian conditions, respondents will never say what they “really RUSSIAN ANALYTICAL DIGEST No. 292, 22 February 2023 3think.” But we never conduct surveys using a poly-graph, and we only record what people are willing to share with the interviewer. Thus, pollsters get informa-tion not about people’s innermost thoughts, but about their public attitudes. However, this should be suffi-cient to understand and explain their behavior in public. One can hardly contest the fact that the pressure of the Russian state on the individual has recently increased. The main goal of such pressure is obviously to change people’s behavior, discouraging them from criticizing the authorities or participating in protests. And this works. But the results of the polls say exactly the same.And besides, if changes in public opinion occur, they are—as a rule—of a systemic nature: changes in the level of support for the authorities are accompanied by changes in answers to questions about mood, hopes, and economic behavior. Such changes are unlikely to be driven by a fear of answering the questionnaire (pro-vided that the proportion of those participating in sur-veys remains more or less constant). Thus, the growth in the approval ratings of the president and government in February–March 2022 and high levels of support for the SMO were accompanied by an increase in general optimism, enthusiasm, and jingoism.Moreover, an analysis of long-term trends in public opinion showed already at the end of 2021 and begin-ning of 2022 that if a military conflict with the West were to break out, the majority of Russian society would be on the side of the president and the government. By that time, the main contours of Russian society’s atti-tude toward this conflict had already taken shape: three-quarters were sure that the United States and Ukraine were to blame for the escalation, while only one-third showed sympathy for Ukraine (https://ridl.io/we-are-being-dragged-into-a-war/). Vladimir Putin’s appro-val rating was already 71 percent in mid-February (in March it rose to 83 percent). The main gaps—between the largest cities and the rest of the country, between young and old, and between TV viewers and Internet users—were already visible. Polls showed that although Russian society was afraid of the conflict, it was inter-nally ready for it.Furthermore, even in the spring, there were early signs of people’s adaptation to the situation (https://ridl.io/can-you-trust-russia-s-public-support-for-a-military-operation-in-ukraine/). This manifested itself first in focus groups and then in surveys (as there is no need to set qualitative and quantitative survey methods up in opposition; indeed, we should use them in combina-tion). It was possible to accurately describe society’s reac-tion to the mobilization immediately after its announce-ment based on the materials of previous studies (https://www.forbes.ru/mneniya/477797-ispytanie-dla-vlasti-naskol-ko-nepopularnym-budet-resenie-o-mobilizacii). By the end of September, one could already say that Russian society had come to terms with the first wave of mobilization (https://www.agents.media/uzhas/)—and this was abundantly clear by the end of the year, when the mood largely returned to “pre-mobilization” levels (https://www.forbes.ru/mneniya/483091-resursy-spokojstvia-pocemu-dla-rossian-2022-j-ne-stal-samym-strasnym-godom).All of the above allows us to say that doubts about the quality of polls in today’s Russia remain largely ungrounded. Analysis of the situation and forecasts based on regular sociological research have shown their effectiveness. Indeed, such analysis is much more accurate than some of the most-cited journalistic spec-ulations (https://www.proekt.media/guide/kremlin-telegram-meduza/), which very often do not come true. Of course, one must be careful when using survey data: the survey projects of political activists and no-names might do more to confuse than to illuminate the situ-ation. But it is fair to say that if we discount opinion polls in general, we deprive ourselves of one of the few proven tools for understanding Russian society.About the AuthorDenis Volkov is a Russian sociologist who serves as director of the Levada Center, a Moscow-based independent socio-logical research organization. Over fifteen years with the Center, he has been involved in more than 100 quantitative and qualitative research projects on different aspects of Russian society. Volkov has authored works on the sources of the political regime’s support, the political attitudes of Russian youth, protest activities and civil society, and busi-ness and elite opinion in Russia. He was formerly a columnist for Vedomosti, RBC, Nezavisimaya Gazeta, the Mos-cow Times, and Carnegie.ru. He now writes for Forbes Russia. His articles have also appeared in Osteuropa, Journal of Democracy, and Foreign Policy.

Are Meaningful Public Opinion Polls Possible in Today's Russia?

https://www.ssoar.info/ssoar/bitstream/document/86779/1/ssoar-russanald-2023-292-volkov-Are_Meaningful_Public_Opinion_Polls.pdf

Are Meaningful Public Opinion Polls Possible in Today's Russia?

Abstract

Similar works

Full text

Available Versions

SSOAR - Social Science Open Access Repository