<div>Introduction:</div><div>Best-Worst Scaling (BWS) is a method to elicit stated preferences, especially in situations where tradeoffs need to be considered. In a typical BWS experiment, participants have to choose the ‘best’ and the ‘worst’ options from lists of 4-7 options. It is an alternative method to examine content validity, specifically, domain representation and domain relevance. As compared to traditional methods involving subject matter experts achieving consensus through rating, ranking or sorting (e.g. Delphi method), BWS has the advantages of less response bias, better discrimination of relevant dimensions and avoiding differing interpretations of rating scales.</div><div><br></div><div>Summary of Work:</div><div>In this presentation, we will illustrate the utility of BWS experiments using a case study of an actual BWS experiment conducted to investigate the characteristics of good clinical teachers. This experiment was conducted with a large group of medical residents and faculty members (approximately 1000) that looks at characteristics of clinical teachers presented both positively and negatively and aims to compare the preferences of different clinical disciplines, institutions and status (e.g. trainee vs faculty). Considerations in the design and analysis of BWS experiment, such as sample size determination, number of options and lists, structuring of data and different statistical methods, will be discussed and potential limitations will be highlighted to guide the implementation of BWS experiments.</div><div><br></div><div>Take-home Message:</div><div>BWS experiments are a viable method to examine content validity that can overcome some of the limitations in traditional methods. The potential of BWS experiments to contribute to content validity and other aspects of assessment should be further explore.</div
