Skip to main content
Article thumbnail
Location of Repository

Power estimation of tests in log-linear non-uniform association models for ordinal agreement.

By Fabien Valet and Jean-Yves Mary

Abstract

International audienceABSTRACT: BACKGROUND: Log-linear association models have been extensively used to investigate the pattern of agreement between ordinal ratings. In 2007, log-linear non-uniform association models were introduced to estimate, from a cross-classification of two independent raters using an ordinal scale, varying degrees of distinguishability between distant and adjacent categories of the scale. METHODS: In this paper, a simple method based on simulations was proposed to estimate the power of non-uniform association models to detect heterogeneities across distinguishabilities between adjacent categories of an ordinal scale, illustrating some possible scale defects. RESULTS: Different scenarios of distinguishability patterns were investigated, as well as different scenarios of marginal heterogeneity within rater. For sample size of N=50, the probabilities of detecting heterogeneities within the tables are lower than .80, whatever the number of categories. In additition, even for large samples, marginal heterogeneities within raters led to a decrease in power estimates. CONCLUSION: This paper provided some issues about how many objects had to be classified by two independent observers (or by the same observer at two different times) to be able to detect a given scale structure defect. Our results also highlighted the importance of marginal homogeneity within raters, to ensure optimal power when using non-uniform association models

Topics: [ SDV.MHEP ] Life Sciences [q-bio]/Human health and pathology, [ SDV.MHEP.HEM ] Life Sciences [q-bio]/Human health and pathology/Hematology
Publisher: BioMed Central
Year: 2011
DOI identifier: 10.1186/1471-2288-11-70
OAI identifier: oai:HAL:inserm-00601757v1
Provided by: Hal-Diderot

Suggested articles


To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.