Methodological Challenges in Cross-comparative Surveys
The Case of Understanding Attitudes towards Democracy in Hungary
Our paper examines the validity of the rotating questionnaire block about perceptions about and attitudes towards democracy included in the sixth round of the European Social Survey (ESS). The preliminary assumptions that inspired our analysis were that respondents’ understanding of the questions formulated in such an internationally comparative survey may be challenged due to diverging theoretical constructions and narratives that feed historically developed notions of ‘democracy.’ Moreover, even within the same country people with a different socioeconomic, ethnic, and educational background may have different perceptions about the same questionnaire ‘items.’ We applied a multi-method approach to analyze the above metho-dological puzzle: a complex statistical analysis of the Hungarian ESS data served to help examine the consistency of answers to individual items and the entirety of the questionnaire block, while supplementary focus group research helped us apprehend the variety of interpretations of and perceptions about the individual items, as well as problems with understanding various terms included in the questions that assessed attitudes towards democracy. Our findings support the initial hypothesis: respondents had obvious difficulties understanding some of the items designed to assess attitudes towards democracy, while many others had differing interpretations. We conclude that even though the ESS is one of the most refined, well-prepared and validated comparative surveys in Europe, the related data cannot be analyzed without careful consideration of what the individual questions might mean in different contexts.
Authors who publish with this journal agree to the following terms:
Authors retain copyright and grant the journal right of first publication, with the work three months after publication simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal. This acknowledgement is not automatic, it should be asked from the editors and can usually be obtained one year after its first publication in the journal.