551,037 research outputs found

    A comparison of integrated testlet and constructed-response question formats

    Full text link
    Constructed-response (CR) questions are a mainstay of introductory physics textbooks and exams. However, because of time, cost, and scoring reliability constraints associated with this format, CR questions are being increasingly replaced by multiple-choice (MC) questions in formal exams. The integrated testlet (IT) is a recently-developed question structure designed to provide a proxy of the pedagogical advantages of CR questions while procedurally functioning as set of MC questions. ITs utilize an answer-until-correct response format that provides immediate confirmatory or corrective feedback, and they thus allow not only for the granting of partial credit in cases of initially incorrect reasoning, but furthermore the ability to build cumulative question structures. Here, we report on a study that directly compares the functionality of ITs and CR questions in introductory physics exams. To do this, CR questions were converted to concept-equivalent ITs, and both sets of questions were deployed in midterm and final exams. We find that both question types provide adequate discrimination between stronger and weaker students, with CR questions discriminating slightly better than the ITs. Meanwhile, an analysis of inter-rater scoring of the CR questions raises serious concerns about the reliability of the granting of partial credit when this traditional assessment technique is used in a realistic (but non optimized) setting. Furthermore, we show evidence that partial credit is granted in a valid manner in the ITs. Thus, together with consideration of the vastly reduced costs of administering IT-based examinations compared to CR-based examinations, our findings indicate that ITs are viable replacements for CR questions in formal examinations where it is desirable to both assess concept integration and to reward partial knowledge, while efficiently scoring examinations.Comment: 14 pages, 3 figures, with appendix. Accepted for publication in PRST-PER (August 2014

    Parallel universes and parallel measures: estimating the reliability of test results

    Get PDF

    Structural reliability of electrical objects. Theory and examples of solving tasks

    Get PDF
    Structural reliability of energy objects is one of the most important topics of study in the study of specialty disciplines in the field of Power Engineering, Electrical Engineering and Electromechanics. Students in the specialty "Renewable Energy and High Voltage Engineering and Electrophysics" should have a clear understanding of the nature of structural redundancy issues, be able to evaluate the actual level of reliability through appropriate analysis and know the ways and means of ensuring trouble–free operation of power systems, subsystems and objects of renewable energy

    The internal reliability of some City & Guilds tests

    Get PDF

    The Relativity Concept Inventory: development, analysis and results

    Full text link
    We report on a concept inventory for special relativity: the development process, data analysis methods, and results from an introductory relativity class. The Relativity Concept Inventory tests understanding of kinematic relativistic concepts. An unusual feature is confidence testing for each question. This can provide additional information; for example high confidence correlated with incorrect answers suggests a misconception. A novel aspect of our data analysis is the use of Monte Carlo simulations to determine the significance of correlations. This approach is particularly useful for small sample sizes, such as ours. Our results include a gender bias that was not present in other assessment, similar to that reported for the Force Concept Inventory

    Factors affecting e-government adoption in the state of Qatar

    Get PDF
    Electronic government (e-government) initiatives are in their early stages in many developing countries and faced with various issues pertaining to their implementation, adoption and diffusion. Although e-government has increased transparency and improved communication and access to information for citizens, digital diffusion of information is often achieved at high cost to government agencies. Conversely, citizens’ adoption of e-government services has been less than satisfactory in most countries. While studies by researchers continue to outline the most salient adoption constructs, as well as various frameworks and models for understanding adoption, research by independent consultancy/research organisations has produced a host of statistics and league tables of good and bad practices of service delivery. Like many other developing countries, the e-government initiative in the state of Qatar has faced a number of challenges since its inception in 2000. This study utilises the Unified Theory of Acceptance and Use of Technology (UTAUT) to explore the adoption of e-government services in the state of Qatar. 1179 citizens were surveyed to collect primary data. A regression analysis was conducted to examine the influence of the factors adapted from the UTAUT on e-government adoption. Reliability test reported values of the various constructs vary between (0.74) and (0.91). The findings reveal that effort expectancy and social influences determine citizens’ behavioural intention towards e-government. Additionally, facilitating conditions and behavioural intention were found to determine citizens’ use of e-government services in Qatar. Implications for practice and research are discussed

    A contingency model of perceived effectiveness in accounting information systems: Organizational coordination and control effects

    Get PDF
    A contingency model is advanced that examines sources of requirements for organizational coordination and control as they affect the extent of integration in an accounting information system. Requirements that are contingent on the degree of organizational formalization, information interdependence among functional areas, and dependence in interorganizational information sharing and electronic data interchange links, are examined. The congruence or fit of system integration with those requirements is a key concept that influences beliefs about system effectiveness. Results of the empirical study indicated that, as hypothesized, the fit between the accounting system design and the contingency factors resulted in a more successful system. Specifically, system fit was a significant factor that explained variations in perceived AIS effectiveness, as measured by decision makers’ perceived satisfaction with the accuracy and monitoring effectiveness of output information. The effect of system fit on a second factor of perceived AIS effectiveness, as measured by decision-makers’ satisfaction with the perceived quality of information content in system outputs, was only marginally significant. The study addresses an important area in accounting systems research that directly relates to the decision facilitation and control objectives of accounting information. © 2000 Elsevier Science Inc. All rights reserved
    corecore