A Monte Carlo sample size study: how many countries are needed for accurate multilevel SEM?

Recently, there has been growing scientific interest for cross-national survey research. Various scholars have used multilevel techniques to link individual characteristics to aspects of the national context. At first sight, multilevel SEM seems to be a promising tool for this purpose, as it integrates multilevel modeling within a latent variable framework. However, due to the fact that the number of countries in most international surveys does not exceed 30, the application of multilevel SEM in cross-national research is problematic. Taking European Social Survey (ESS) data as a point of departure, this paper uses Monte Carlo studies to assess the estimation accuracy of multilevel SEM with small group sample sizes. The results indicate that a group sample size of 20 – a situation common in cross-national research – does not guarantee accurate estimation at all. Unacceptable amounts of parameter and standard error bias are present for the between-level estimates. Unless the standardized effect is very large (0.75), statistical power for detecting a significant between-level structural effect is seriously lacking. Required group sample sizes depend strongly on the specific interests of the researcher, the expected effect sizes and the complexity of the model. If the between-level model is relatively simple and one is merely interested in the between-level factor structure, a group sample size of 40 could be sufficient. To detect large (>0.50) structural effects at the between level, at least 60 groups are required. To have an acceptable probability of detecting smaller effects, more than 100 groups are needed. These guidelines are shown to be quite robust for varying cluster sizes and intra-class correlations (ICCs)

Why Measurement Invariance is Important in Comparative Research. A Response to Welzel et al. (2021)

Welzel et al. (2021) claim that non-invariance of instruments is inconclusive and inconsequential in the field for cross-cultural value measurement. In this response, we contend that several key arguments on which Welzel et al. (2021) base their critique of invariance testing are conceptually and statistically incorrect. First, Welzel et al. (2021) claim that value measurement follows a formative rather than reflective logic. Yet they do not provide sufficient theoretical arguments for this conceptualization, nor do they discuss the disadvantages of this approach for validation of instruments. Second, their claim that strong inter-item correlations cannot be retrieved when means are close to the endpoint of scales ignores the existence of factor-analytic approaches for ordered-categorical indicators. Third, Welzel et al. (2021) propose that rather than of relying on invariance tests, comparability can be assessed by studying the connection with theoretically related constructs. However, their proposal ignores that external validation through nomological linkages hinges on the assumption of comparability. By means of two examples, we illustrate that violating the assumptions of measurement invariance can distort conclusions substantially. Following the advice of Welzel et al. (2021) implies discarding a tool that has proven to be very useful for comparativists

Ethnocentrism in the Low Countries: A comparative perspective

Contains fulltext : 3361.pdf (publisher's version ) (Open Access)New Community, continued by: Journal of ethnic and migration studies [1369-183X

Relationships Between Religion and Intolerance Towards Muslims and Immigrants in Europe:A Multilevel Analysis

This paper examines relationships between religiosity and intolerance towards Muslims and immigrants among Europeans living in non-Muslim majority countries by applying multilevel modeling to European Values Study data (wave four, 2010). Thus relationships across 44 national contexts are analyzed. The analysis found large between-country differences in the overall levels of intolerance towards immigrants and Muslims. Eastern Europeans tend to be more intolerant than Western Europeans. In most countries Muslims are less accepted than immigrants,—a finding which reflects that in post-9/11 Europe Islamophobia is prevalent and many still see Muslims with suspicion. A key result is that believing matters for the citizen’s attitudes towards Muslims and immigrants. Across Europe, traditional and modern fuzzy beliefs in a Higher Being are strongly negatively related to intolerance towards immigrants and Muslims, while fundamentalism is positively related to both targets of intolerance. Religious practice and denominational belonging on the other hand matter far less for the citizen’s propensity to dislike the two out-groups. With the only exception of non-devout Protestants who do not practice their religion, members of religious denominations are not more intolerant than non-members. The findings are valid for the vast majority of countries although countries differ in the magnitude of the effects

Legitimacy intermediation in the multilevel European polity and its collapse in the euro crisis

This essay re-examines the dual – republican and liberal – foundations of democratic legitimacy in the Western traditions of normative political theory. Considered in isolation, the European Union conforms to liberal standards but cannot satisfy republican criteria. Given these conflicting standards, debates on the alleged European democratic deficit have remained inconclusive. Moreover, they have failed to pay sufficient attention to the multilevel character of the European polity and to the normative potential of legitimacy intermediation in its two-step compliance and legitimating relationships. I argue, however, that the capacity of democratic member states to legitimate the exercise of European governing functions is being destroyed in the present euro crisis, and I briefly discuss the implications of this new constellation.In der westlichen Tradition der normativen politischen Theorie beruht demokratische Legitimität auf der doppelten Grundlage republikanischer und liberaler Prinzipien. Für sich betrachtet entspricht die Europäische Union zwar liberalen Kriterien, aber eben nicht den republikanischen Anforderungen. Angesichts so unterschiedlicher Kriterien konnte es auch im Streit über das angebliche europäische Demokratiedefizit keine Einigung geben. Überdies ignorierte diese Diskussion den Mehrebenen-Charakter der europäischen Politik und das normative Potenzial der Legitimationsvermittlung zwischen Union und Bürgern durch die demokratisch verfassten Mitgliedstaaten. Die gegenwärtige Eurokrise allerdings zerstört die Fähigkeit demokratischer Mitgliedstaaten, die Ausübung europäischer Herrschaftsfunktionen zu legitimieren. Der Aufsatz erörtert die Implikationen dieser neuen Konstellation.1 Introduction 2 Legitimacy discourses The republican discourse The liberal discourse Differences 3 Constitutional democracies – and the European Union? 4 Legitimacy intermediation in the multilevel European polity 5 The end of legitimacy intermediation in the euro crisis Monetary Union and the failure of output legitimacy Rescuing the euro through supranational intervention 6 Legitimate supranational government? Input-oriented European legitimacy? 7 Reducing the burden on European legitimacy Reference

Testing the stability of an acquiescence style factor behind two interrelated substantive variables in a panel design

This article addresses the question of to what extent one type of response style, called acquiescence (or agreeing response bias), is stable over time. A structural equation modeling approach is applied to measure the stability of one acquiescence factor behind two concepts among the same respondents for a 4-year period. The data used are representative population surveys in 1995 and 1999 from the Belgian Election Study in which balanced sets of items are used for measuring two interrelated constructs: perceived ethnic threat and distrust in politics. This study provides empirical support that acquiescence is stable and consistent for a 4-year period

Reflections on the quality of cross-national surveys: lessons of the European Social Survey

Jaak Billiet, one of the core members of the European Social Survey (ESS) team, discusses his practical experiences with the ambition of ESS to maximize cross-country comparability of individual-level measures. The ESS has set pathbreaking standards of survey quality and Billiet takes stock of the achievements and remaining desiderata.www.concepts-methods.orgstatus: publishe

Nieuwe hoogten voor internationaal vergelijkend onderzoek

Hoe verschilt de armoedeval in België van die in Groot-Brittannië? Internationaal vergelijkend onderzoek onthult het effect van de nationale context op het individu. Het is de onderzoekstrend in dit tijdperk van internationalisering.Auteur gaat in op de voordelen en valkuilen van deze methode.status: publishe