Which first-year students are making most learning gains in STEM subjects?

With the introduction of the Teaching Excellence Framework a lot of attention is focussed on measuring learning gains. A vast body of research has found that individual student characteristics influence academic progression over time. This case-study aims to explore how advanced statistical techniques in combination with Big Data can be used to provide potentially new insights into how students are progressing over time, and in particular how students’ socio-demographics (i.e., gender, ethnicity, Social Economic Status, prior educational qualifications) influence students’ learning trajectories. Longitudinal academic performance data were sampled from 4,222 first year STEM students across nine modules and analysed using multilevel growth-curve modeling. There were significant differences between white and non-white students, and students with different prior educational qualifications. However, student-level characteristics accounted only for a small portion of variance. The majority of variance was explained by module-level characteristics and assessment level characteristics

The AMC Linear Disability Score project in a population requiring residential care: psychometric properties

BACKGROUND: Currently there is a lot of interest in the flexible framework offered by item banks for measuring patient relevant outcomes, including functional status. However, there are few item banks, which have been developed to quantify functional status, as expressed by the ability to perform activities of daily life. METHOD: This paper examines the psychometric properties of the AMC Linear Disability Score (ALDS) project item bank using an item response theory model and full information factor analysis. Data were collected from 555 respondents on a total of 160 items. RESULTS: Following the analysis, 79 items remained in the item bank. The remaining 81 items were excluded because of: difficulties in presentation (1 item); low levels of variation in response pattern (28 items); significant differences in measurement characteristics for males and females or for respondents under or over 85 years old (26 items); or lack of model fit to the data at item level (26 items). CONCLUSIONS: It is conceivable that the item bank will have different measurement characteristics for other patient or demographic populations. However, these results indicate that the ALDS item bank has sound psychometric properties for respondents in residential care settings and could form a stable base for measuring functional status in a range of situations, including the implementation of computerised adaptive testing of functional status

Measuring the Impact of Youth Voluntary Service Programs

Summary and Conclusions of a meeting of international experts hosted by the World Bank and Innovations in Civic Participation to discuss evaluation of the impact of youth civic engagement on development

Measuring quality in social care services: theory and practice

Measuring and assessing service quality in the social care sector presents distinct challenges. The 'experience' good properties of social care, for instance, and the large influence played by subjective judgements about the quality of personal relationships between carer and user and of process-related service characteristics make it difficult to develop indicators of service quality, including those of service impact on final outcomes. Using some of the key features of the 'Production of Welfare' approach, the paper discusses recent developments in the UK of the theoretical and practical frameworks used for assessing quality in social care and for understanding the final impact of services on the wellbeing of their recipients. Key current and future challenges to the development of such frameworks include difficulties in disentangling the impact of social care services on final outcomes from the often dominating effects of other, non-service related factors, and the generalization of consumer-directed care models and of the 'personalization' of care services. These challenges are discussed in the context of the different possible applications of quality indicators, including their role as supporting the service commissioning process and their use for assessing the performance of service providers

Human responses to disasters: a pilot study on peritraumatic emotional and cognitive processing

This research article presents the qualitative development and cross-cultural pilot testing of a new instrument measuring emotional and cognitive processing during disasters. The instrument was developed according to a theoretical framework based on narratives from survivors of different types of disaster across Europe. Peritraumatic emotions and cognitions were assessed at three different stages of a disaster. The pilot study consisted of 311 participants responding to the questionnaire using scenario versions of disasters as well as 25 survivors working through the questionnaire using their experiences of real disasters. Both types of analysis were performed across seven countries. Differences in emotions and cognitions during the course of a disaster were displayed. Also, gender, the type of scenario participants were allocated to, and professional experience of emergencies led to differences in item response. As there was little difference between survivors’ and scenario participants’ responses, the use of a scenario in order to test pilot forms of questionnaires for purposive samples with certain characteristics such as limited sizes or access can be supported. For future research, the instrument should be field tested. It is envisaged it will be beneficial for a cross-cultural understanding of the influence of peritraumatic emotions and cognitions not only on posttraumatic psychological outcomes but also on related behavioural responses displayed during disasters

Measuring measuring: Toward a theory of proficiency with the Constructing Measures framework

This paper is relevant to measurement educators who are interested in the variability of understanding and use of the four building blocks in the Constructing Measures framework (Wilson, 2005). It proposes a uni-dimensional structure for understanding Wilson’s framework, and explores the evidence for and against this conceptualization. Constructed and fixed choice response items are utilized to collect responses from 72 participants who range in experience and expertise with constructing measures. The data was scored by two raters and was analyzed with the Rasch partial credit model using ConQuest (1998). Guided by the 1999 Testing Standards, analyses of validity and reliability evidence provide support for the construct theory and limited uses of the instrument pending item design modifications

Innovation Indicators: for a critical reflection on their use in Low- and Middle-Income Countries (LMICs)

It has been widely recognized that innovation is an important driver of economic growth. Many Low- and Middle-Income Countries (LMICs) have adopted innovation indicators to monitor innovation performance and to evaluate the impact of innovation policies. This paper argues that innovation indicators should be customized to the different socio-economic structures of LMICs. For this, the definition of innovation needs to be relevant to the multitude of innovation actors and processes in LMICs. LMICs also need to build competences not only in the construction of innovation indicators within their statistical systems, but also in the use of these indicators by among others policy makers. Especially as the fourth edition of the Oslo Manual (OM 2018) has broadened the scope of “innovation”, opening up policy space for LMICs to accommodate the diversity in their national systems of innovation and to develop accompanying innovation indicators.JEL Classification Codes: O38, O32, O29, P47http://www.grips.ac.jp/list/jp/facultyinfo/iizuka-michiko

New evidence on the green building rent and price premium

This paper investigates the effect of voluntary eco-certification on the rental and sale prices of US commercial office properties. Hedonic and logistic regressions are used to test whether there are rental and sale price premiums for LEED and Energy Star certified buildings. The results of the hedonic analysis suggest that there is a rental premium of approximately 6% for LEED and Energy Star certification. A sale price premium of approximately 35% was found for 127 price observations involving LEED rated buildings and 31% for 662 buildings involving Energy Star rated buildings. When compared to samples of similar buildings identified by a binomial logistic regression for LEED-certified buildings, the existence of a rent and sales price premium is confirmed albeit with differences regarding the magnitude of the premium. Overall, the results of this study confirm that LEED and Energy Star buildings exhibit higher rental rates and sales prices per square foot controlling for a large number of location- and property-specific factors