302 research outputs found
Rasch scaling procedures for informing development of a valid Fetal Surveillance Education Program multiple-choice assessment
<p>Abstract</p> <p>Background</p> <p>It is widely recognised that deficiencies in fetal surveillance practice continue to contribute significantly to the burden of adverse outcomes. This has prompted the development of evidence-based clinical practice guidelines by the Royal Australian and New Zealand College of Obstetricians and Gynaecologists and an associated Fetal Surveillance Education Program to deliver the associated learning. This article describes initial steps in the validation of a corresponding multiple-choice assessment of the relevant educational outcomes through a combination of item response modelling and expert judgement.</p> <p>Methods</p> <p>The Rasch item response model was employed for item and test analysis and to empirically derive the substantive interpretation of the assessment variable. This interpretation was then compared to the hierarchy of competencies specified a priori by a team of eight subject-matter experts. Classical Test Theory analyses were also conducted.</p> <p>Results</p> <p>A high level of agreement between the hypothesised and derived variable provided evidence of construct validity. Item and test indices from Rasch analysis and Classical Test Theory analysis suggested that the current test form was of moderate quality. However, the analyses made clear the required steps for establishing a valid assessment of sufficient psychometric quality. These steps included: increasing the number of items from 40 to 50 in the first instance, reviewing ineffective items, targeting new items to specific content and difficulty gaps, and formalising the assessment blueprint in light of empirical information relating item structure to item difficulty.</p> <p>Conclusion</p> <p>The application of the Rasch model for criterion-referenced assessment validation with an expert stakeholder group is herein described. Recommendations for subsequent item and test construction are also outlined in this article.</p
Creating an Instrument to Measure Student Response to Instructional Practices
BackgroundCalls for the reform of education in science, technology, engineering, and mathematics (STEM) have inspired many instructional innovations, some research based. Yet adoption of such instruction has been slow. Research has suggested that students’ response may significantly affect an instructor’s willingness to adopt different types of instruction.PurposeWe created the Student Response to Instructional Practices (StRIP) instrument to measure the effects of several variables on student response to instructional practices. We discuss the step‐by‐step process for creating this instrument.Design/MethodThe development process had six steps: item generation and construct development, validity testing, implementation, exploratory factor analysis, confirmatory factor analysis, and instrument modification and replication. We discuss pilot testing of the initial instrument, construct development, and validation using exploratory and confirmatory factor analyses.ResultsThis process produced 47 items measuring three parts of our framework. Types of instruction separated into four factors (interactive, constructive, active, and passive); strategies for using in‐class activities into two factors (explanation and facilitation); and student responses to instruction into five factors (value, positivity, participation, distraction, and evaluation).ConclusionsWe describe the design process and final results for our instrument, a useful tool for understanding the relationship between type of instruction and students’ response.Peer Reviewedhttps://deepblue.lib.umich.edu/bitstream/2027.42/136692/1/jee20162_am.pdfhttps://deepblue.lib.umich.edu/bitstream/2027.42/136692/2/jee20162.pd
Forms of Science Capital Mobilized in Adolescents’ Engineering Projects
The purpose of this multiple case study was to identify the forms of science capital that six groups of adolescents mobilized toward the realization of their self-selected engineering projects during after-school meetings. Research participants were high school students who self-identified as Hispanic, Latina, or Latino; who had received English as a Second Language (ESL) services; and whose parents or guardians had immigrated to the United States and held working class jobs. The research team used categories from Bourdieusian theories of capital to identify the forms of science capital mobilized by the participants. Data sources included transcripts from monthly interviews and from bi-monthly group meetings during which the group members worked on their engineering projects. Data analysis indicated that the groups activated science capital in the following categories: embodied capital in the form of formal scientific knowledge, literacy practices, and experiences with solving everyday problems; social capital in the form of connections with authorities, experts, and peers; objectified capital in the form of information and communication technologies (ICTs) and measuring tools; and institutional capital in the form of awards and titles. The participants co-mobilized multiple forms of science capital to advance their engineering projects, and some instances of co-mobilization enabled the future activation of subsequent forms of science capital. Engineering, as a vehicle for learning science, provided the youth with opportunities to draw from diverse community resources and from multilingual literacy practices, recasting these resources and skills as forms of science capital, which were mobilized toward the attainment of other high-status forms of science capital
- …