Multidimensional Item Response Theory and the Conceptual Survey of Electricity and Magnetism

This paper is part of the Focused Collection on Quantitative Methods in PER: A Critical Examination.] While many studies have examined the structure, validity, and reliability of the Force Concept Inventory, far less research has been performed on other conceptual instruments in widespread use in physics education research. This study performs a confirmatory analysis of the Conceptual Survey of Electricity and Magnetism (CSEM) guided by a theoretical model of expert understanding of electricity and magnetism. Multidimensional Item Response Theory (MIRT) with the discrimination matrix constrained to the theoretical model was used to investigate two large datasets (N1=2014 and N2=2657) from two research universities in the United States. The optimal model identified by MIRT was similar, but not identical, for the two datasets and had very good model fit with comparative fit indices of 0.975 and 0.984, respectively. The most parsimonious optimal model required 23 independent principles of electricity and magnetism and was significantly better fitting than a more general model dividing the CSEM into 6 general topics. The optimal models for the two samples were quite similar, sharing 22 of a possible 26 conceptual principles. Most of the overall item difficulties and discriminations were significantly different between the two samples; however, the rank order of the overall difficulty and discrimination were generally similar. There was much more similarity between the discrimination by item of the individual principles. Five items had a difficulty ranking that was substantially different between the two samples, indicating that while generally similar, relative difficulty does depend on the student population and instructional environment

Multidimensional Item Response Theory and the Force and Motion Conceptual Evaluation

Many studies have examined the structure and properties of the Force Concept Inventory (FCI); however, far less research has investigated the Force and Motion Conceptual Evaluation (FMCE). This study applied Multidimensional Item Response Theory (MIRT) to a sample of N ¼ 4528 FMCE post-test responses. Exploratory factor analysis showed that 5, 9, and 10-factor models optimized some fit statistics. The FMCE uses extensive blocking of items into groups with a common stem; these blocks factored together in most models. A confirmatory analysis, which constrained the MIRT models to a theoretical model constructed from expert solutions, produced a model requiring only 8 principles, fundamental reasoning steps. This was substantially fewer than the 19 principles identified in the FCI by a previous study. Correlation analysis also demonstrated that the two instruments were very dissimilar. The reduced number of principles and the repetition of items using a single principle allowed the extraction of eight single-principle subscales, seven with Cronbach’s alpha greater than the 0.7 required for acceptable internal consistency. The differences between the FCI and the FMCE suggest that the two instruments could provide complementary, but different, information about student understanding of Newton’s laws with the FCI measuring an integrated Newtonian force concept and the FMCE measuring details of that force concept

Multi-Dimensional Item Response Theory and the Force Concept Inventory

Research on the test structure of the Force Concept Inventory (FCI) has largely been performed with exploratory methods such as factor analysis and cluster analysis. Multi-Dimensional Item Response Theory (MIRT) provides an alternative to traditional Exploratory Factor Analysis which allows statistical testing to identify the optimal number of factors. Application of MIRT to a sample of $N=4,716$ FCI post-tests identified a 9-factor solution as optimal. Additional analysis showed that a substantial part of the identified factor structure resulted from the practice of using problem blocks and from pairs of similar questions. Applying MIRT to a reduced set of FCI items removing blocked items and repeated items produced a 6-factor solution; however, the factors had little relation the general structure of Newtonian mechanics. A theoretical model of the FCI was constructed from expert solutions and fit to the FCI by constraining the MIRT parameter matrix to the theoretical model. Variations on the theoretical model were then explored to identify an optimal model. The optimal model supported the differentiation of Newton's 1st and 2nd law; of one-dimensional and three-dimensional kinematics; and of the principle of the addition of forces from Newton's 2nd law. The model suggested by the authors of the FCI was also fit; the optimal MIRT model was statistically superior

Using Machine Learning to Predict Physics Course Outcomes

The use of machine learning and data mining techniques across many disciplines has exploded in recent years with the field of educational data mining growing significantly in the past 15 years. In this study, random forest and logistic regression models were used to construct early warning models of student success in introductory calculus-based mechanics (Physics 1) and electricity and magnetism (Physics 2) courses at a large eastern land-grant university. By combining in-class variables such as homework grades with institutional variables such as cumulative GPA, we can predict if a student will receive less than a “B” in the course with 73% accuracy in Physics 1 and 81% accuracy in Physics 2 with only data available in the first week of class using logistic regression models. The institutional variables were critical for high accuracy in the first four weeks of the semester. In-class variables became more important only after the first in-semester examination was administered. The student’s cumulative college GPA was consistently the most important institutional variable. Homework grade became the most important in-class variable after the first week and consistently increased in importance as the semester progressed; homework grade became more important than cumulative GPA after the first in-semester examination. Demographic variables including gender, race or ethnicity, and first generation status were not important variables for predicting course grade

The Pine Needle, November 1949

Libraries and archives collect materials from different cultures and time periods to preserve and make available the historical record. As a result, materials such as those presented here may reflect sexist, misogynistic, abusive, racist, or discriminatory attitudes or actions that some may find disturbing, harmful, or difficult to view. Both a humor and literary magazine, The Pine Needle was a University of Maine student-produced periodical that began publication in the fall of 1946, the first post-World War II semester that saw GIs returning to campus. The Needle reflected an edginess and rebellion not found in previous UMaine student publications. While past student publications relied on euphemisms for alcohol and dating on campus, The Needle openly promoted the sexualization of co-eds and the use of drugs, tobacco, and alcohol by students who experienced war. Cover art for this issue is a pen-and-ink illustration by Len Keenan depicting a first year student wearing a freshman cap and bow tie, smoking a pipe that appears to be making him ill. Leonard F. Keenan (1929-1984), graduated from the University of Maine in 1951 with a B.S. in Forestry. He later earned his MBA from the Army Comptrollership School at Syracuse University and served as a civilian in the Army Budget Office. Though his career with the Army hit a snag in 1976, when he was among four men receiving formal, written reprimands for ...failing to detect and present accounting [failures] that lead to massive overspending... at the end of the Vietnam War, Keenan was honored following his death by the establishment of the Leonard F. Keenan Memorial Award at Syracuse University. The award continues to be presented annually to the U.S. Department of Defense\u27s outstanding financial manager. Keenan died in Virginia on April 30, 1984 from congestive heart failure