The application of Item Response Theory on a teaching strategy profile questionnaire

<p>Abstract</p> <p>Background</p> <p>In medical education research, various questionnaires are often used to study possible relationships between strategies and approaches to teaching and learning and the outcome of these. However, judging the applicability of such questionnaires or the interpretation of the results is not trivial.</p> <p>Methods</p> <p>As a way to develop teacher thinking, teaching strategy profiles were calculated for teachers in a research intensive department at Karolinska Institutet. This study compares the sum score, that was inherent in the questionnaire used, with an Item Response Theory (IRT) approach. Three teaching dimensions were investigated and the intended sum scores were investigated by IRT analysis.</p> <p>Results</p> <p>Agreements as well as important differences were found. The use of the sum score seemed to agree reasonably with an IRT approach for two of the dimensions, while the third dimension could not be identified neither by a the sum score, nor by an IRT approach, as the items included showed conflicting messages.</p> <p>Conclusions</p> <p>This study emphasizes the possibilities to gain better insight and more relevant interpretation of a questionnaire by use of IRT. A sum score approach should not be taken for granted. Its use has to be thoroughly evaluated.</p

Investigating psychometric properties and dimensional structure of an educational environment measure (DREEM) using Mokken scale analysis - A pragmatic approach

© 2018 The Author(s). Background: Questionnaires and surveys are used throughout medical education. Nevertheless, measuring psychological attributes such as perceptions of a phenomenon among individuals may be difficult. The aim of this paper is to introduce the basic principles of Mokken scale analysis (MSA) as a method for the analysis of questionnaire data and to empirically apply MSA to a real-data example. Methods: MSA provides a set of statistical tools for exploring the relationship between items and latent traits. MSA is a scaling method of item selection algorithms used to partition an array of items into scales. It employs various methods to probe the assumptions of two nonparametric item response theory models: the monotone homogeneity model and the double monotonicity model. The background and theoretical framework underlying MSA are outlined in the paper. MSA for polytomous items was applied to a real-life data example of 222 undergraduate students who had completed a 50-item self-administered inventory measuring the educational environment, the Dundee Ready Educational Measure (DREEM). Results: A pragmatic and parsimonious approach to exploring questionnaires and surveys from an item response theory (IRT) perspective is outlined. The use of MSA to explore the psychometric properties of the Swedish version of the DREEM failed to yield strong support for the scalability and dimensional structure of the instrument. Conclusions: MSA, a class of simple nonparametric IRT models - for which estimates can be easily obtained and whose fit to data is relatively easily investigated - was introduced, presented, and tested. Our real-data example suggests that the psychometric properties of DREEM are not adequately supported. Thus, the empirical application depicted a potential and feasible approach whereby MSA could be used as a valuable method for exploring the behavior of scaled items in response to varying levels of a latent trait in medical education research

The Imperforate Anus Psychosocial Questionnaire (IAPSQ): Its construction and psychometric properties

The origin of the present study was to develop the liaison work between the disciplines of child and adolescent psychiatry and paediatric surgery and nursing, so as to improve the quality of treatment and care of a group of children with imperforate anus (IA) and their families. Imperforate anus is a congenital disease involving a deformity of the anorectum. The early surgery and invasive follow-up treatment associated with IA may affect the child psychosocially, including the child-parent relationship. By developing and testing a questionnaire for children born with anorectal anomalies, a tool for measuring psychosocial functioning can be realized

High Content Screening Identifies Decaprenyl-Phosphoribose 2′ Epimerase as a Target for Intracellular Antimycobacterial Inhibitors

A critical feature of Mycobacterium tuberculosis, the causative agent of human tuberculosis (TB), is its ability to survive and multiply within macrophages, making these host cells an ideal niche for persisting microbes. Killing the intracellular tubercle bacilli is a key requirement for efficient tuberculosis treatment, yet identifying potent inhibitors has been hampered by labor-intensive techniques and lack of validated targets. Here, we present the development of a phenotypic cell-based assay that uses automated confocal fluorescence microscopy for high throughput screening of chemicals that interfere with the replication of M. tuberculosis within macrophages. Screening a library of 57,000 small molecules led to the identification of 135 active compounds with potent intracellular anti-mycobacterial efficacy and no host cell toxicity. Among these, the dinitrobenzamide derivatives (DNB) showed high activity against M. tuberculosis, including extensively drug resistant (XDR) strains. More importantly, we demonstrate that incubation of M. tuberculosis with DNB inhibited the formation of both lipoarabinomannan and arabinogalactan, attributable to the inhibition of decaprenyl-phospho-arabinose synthesis catalyzed by the decaprenyl-phosphoribose 2′ epimerase DprE1/DprE2. Inhibition of this new target will likely contribute to new therapeutic solutions against emerging XDR-TB. Beyond validating the high throughput/content screening approach, our results open new avenues for finding the next generation of antimicrobials

Discovery of Q203, a potent clinical candidate for the treatment of tuberculosis

New therapeutic strategies are needed to combat the tuberculosis pandemic and the spread of multidrug-resistant (MDR) and extensively drug-resistant (XDR) forms of the disease, which remain a serious public health challenge worldwide1, 2. The most urgent clinical need is to discover potent agents capable of reducing the duration of MDR and XDR tuberculosis therapy with a success rate comparable to that of current therapies for drug-susceptible tuberculosis. The last decade has seen the discovery of new agent classes for the management of tuberculosis3, 4, 5, several of which are currently in clinical trials6, 7, 8. However, given the high attrition rate of drug candidates during clinical development and the emergence of drug resistance, the discovery of additional clinical candidates is clearly needed. Here, we report on a promising class of imidazopyridine amide (IPA) compounds that block Mycobacterium tuberculosis growth by targeting the respiratory cytochrome bc1 complex. The optimized IPA compound Q203 inhibited the growth of MDR and XDR M. tuberculosis clinical isolates in culture broth medium in the low nanomolar range and was efficacious in a mouse model of tuberculosis at a dose less than 1 mg per kg body weight, which highlights the potency of this compound. In addition, Q203 displays pharmacokinetic and safety profiles compatible with once-daily dosing. Together, our data indicate that Q203 is a promising new clinical candidate for the treatment of tuberculosis

Abstracts from the 20th International Symposium on Signal Transduction at the Blood-Brain Barriers

https://deepblue.lib.umich.edu/bitstream/2027.42/138963/1/12987_2017_Article_71.pd

An item response theory evaluation of three depression assessment instruments in a clinical sample

BACKGROUND: This study investigates whether an analysis, based on Item Response Theory (IRT), can be used for initial evaluations of depression assessment instruments in a limited patient sample from an affective disorder outpatient clinic, with the aim to finding major advantages and deficiencies of the instruments. METHODS: Three depression assessment instruments, the depression module from the Patient Health Questionnaire (PHQ9), the depression subscale of Affective Self Rating Scale (AS-18-D) and the Montgomery-Åsberg Depression Rating Scale (MADRS) were evaluated in a sample of 61 patients with affective disorder diagnoses, mainly bipolar disorder. A ‘3- step IRT strategy’ was used. RESULTS: In a first step, the Mokken non-parametric analysis showed that PHQ9 and AS-18-D had strong overall scalabilities of 0.510 [C.I. 0.42, 0.61] and 0,513 [C.I. 0.41, 0.63] respectively, while MADRS had a weak scalability of 0.339 [C.I. 0.25, 0.43]. In a second step, a Rasch model analysis indicated large differences concerning the item discriminating capacity and was therefore considered not suitable for the data. In third step, applying a more flexible two parameter model, all three instruments showed large differences in item information and items had a low capacity to reliably measure respondents at low levels of depression severity. CONCLUSIONS: We conclude that a stepwise IRT-approach, as performed in this study, is a suitable tool for studying assessment instruments at early stages of development. Such an analysis can give useful information, even in small samples, in order to construct more precise measurements or to evaluate existing assessment instruments. The study suggests that the PHQ9 and AS-18-D can be useful for measurement of depression severity in an outpatient clinic for affective disorder, while the MADRS shows weak measurement properties for this type of patients