Meritocracy Voting: Measuring the Unmeasurable

Learned societies commonly carry out selection processes to add new fellows to an existing fellowship. Criteria vary across societies but are typically based on subjective judgments concerning the merit of individuals who are nominated for fellowships. These subjective assessments may be made by existing fellows as they vote in elections to determine the new fellows or they may be decided by a selection committee of fellows and officers of the society who determine merit after reviewing nominations and written assessments. Human judgment inevitably plays a central role in these determinations and, notwithstanding its limitations, is usually regarded as being a necessary ingredient in making an overall assessment of qualifications for fellowship. The present paper suggests a mechanism by which these merit assessments may be complemented with a quantitative rule that incorporates both subjective and objective elements. The goal of 'measuring merit' may be elusive but quantitative assessment rules can help to widen the effective electorate (for instance, by including the decisions of editors, the judgments of independent referees, and received opinion about research) and mitigate distortions that can arise from cluster effects, invisible college coalition voting and inner sanctum bias. The rule considered here is designed to assist the selection process by explicitly taking into account subjective assessments of individual candidates for election as well as direct quantitative measures of quality obtained from bibliometric data. The methodology has application to a wide arena of quality assessment and professional ranking exercises.Bibliometric data, Election, Fellowship, Measurement, Meritocracy, Peer review, Quantification, Subjective assessment, Voting

Effects of combining vertical and horizontal information into a primary flight display

A ground-based aircraft simulation study was conducted to determine the effects of combining vertical and horizontal flight information into a single display. Two display configurations were used in this study. The first configuration consisted of a Primary Flight Display (PFD) format and a Horizontal Situation Display (HSD) with the PFD displayed conventionally above the HSD. For the second display configuration, the HSD format was combined with the PFD format. Four subjects participated in this study. Data were collected on performance parameters, pilot-control inputs, auditory evoked response parameters (AEP), oculometer measurements (eye-scan), and heart rate. Subjective pilot opinion was gathered through questionnaire data and scorings for both the Subjective Workload Assessment Technique (SWAT) and the NASA Task Load Index (NASA-TLX). The results of this study showed that, from a performance and subjective standpoint, the combined configuration was better than the separate configuration. Additionally, both the eye-transition and eye-dwell times for the separate HSD were notably higher than expected, with a 46% increase in available visual time when going from double to single display configuration

Disentangling barrier effects of transport infrastructure: synthesising research for the practice of impact assessment

Transport infrastructure such as railways, motorways and arterial roads increases regional accessibility for motorised transport but simultaneously can create barriers in local street networks that can decrease accessibility for pedestrians and cyclists. Although several tools for an objective assessment of these barrier effects have been developed, their use in practice is limited; impact assessments are instead based on subjective descriptions. This article reviews the literature on barrier effects of the last 60 years and aims to offer guidance for the use of objective methods of assessment of barrier effects. The first contribution is a conceptual model for the barrier effects of transport infrastructure and their determinants. The second contribution is an overview of tools for the assessment of barrier effects. We conclude that a multi-disciplinary approach is required, supported by the conceptual model and the overview of assessment tools. Investments in transport infrastructure can then be based on broader decision support involving not only the benefits of increasing regional accessibility but also the cost of reducing local accessibility

A QoE Model for Mulsemedia TV in a Smart Home Environment

The provision to the users of realistic media contents is one of the main goals of future media services. The sense of reality perceived by the user can be enhanced by adding various sensorial effects to the conventional audio-visual content, through the stimulation of the five senses stimulation (sight, hearing, touch, smell and taste), the so-called multi-sensorial media (mulsemedia). To deliver the additional effects within a smart home (SH) environment, custom devices (e.g., air conditioning, lights) providing opportune smart features, are preferred to ad-hoc devices, often deployed in a specific context such as for example in gaming consoles. In the present study, a prototype for a mulsemedia TV application, implemented in a real smart home scenario, allowed the authors to assess the user's Quality of Experience (QoE) through test measurement campaign. The impact of specific sensory effects (i.e., light, airflow, vibration) on the user experience regarding the enhancement of sense of reality, annoyance, and intensity of the effects was investigated through subjective assessment. The need for multi sensorial QoE models is an important challenge for future research in this field, considering the time and cost of subjective quality assessments. Therefore, based on the subjective assessment results, this paper instantiates and validates a parametric QoE model for multi-sensorial TV in a SH scenario which indicates the relationship between the quality of audiovisual contents and user-perceived QoE for sensory effects applications

Effects of Cellular Telephone Use While Driving Based on Objective and Subjective Mental Workload Assessment

A series of studies were performed to investigate the effects of cellulartelephone use while driving on driver mental workload. In these surveillance studiesobjective and subjective methods were used to find the driver mental workloadbehaviour. In the first study, the results indicated that the hands-free system providedless effect on the driver’s mental workload than the hand-held system. In the secondstudy, experience in using a cellular telephone while driving had no positive effect onreaction time. The operation task and talking task had little effect on the subjectivemental workload of the experienced subjects, but had statistically significant effectson the subjective mental workload of the non-experienced subjects. In the third study,the results of experiment indicated that the telephone tasks increase the mentalworkload of the drivers as were shown in the second study. The results also indicatedthat the complex conversation task produced an increase in driver mental workload ascompared to the simple conversation task and the other tasks independent of agegroup

Are International Comparisons of Subjective Health Status Relevant? An Assessment Using Anchoring Vignettes,

When, in a survey question, response items are used in different ways by respondents, the answers are said to be affected by an item bias or by a DIF (Differential Item Functioning) effect. In such a case, the responses must be corrected before they can be used to formulate comparative hypotheses on the subjective health status of subpopulations. In this paper, we present a method for detecting and correcting for DIF effects in self-assessments of subjective health. The method is based on the individuals' assessment of health status for hypothetical situations described in short vignettes. It is exemplified by detecting a possible DIF effect in the self-assessment of physical pain, according to the geographical origin of the samples from the Share 2004 survey. Correcting for this effect leads to different conclusions than the original self-assessments concerning the respective subjective health status of the Swedish and Dutch samples.Subjective Health Measurement, Differential Item Functioning, Anchoring Vignettes, International Comparisons

Internalizing and externalizing personality and subjective effects in a sample of adolescent cannabis users

Cannabis is the illicit substance most widely used by adolescents. Certain personality traits such as impulsivity and sensation seeking, and the subjective effects experienced after substance use (e.g. euphoria or relaxation) have been identified as some of the main etiological factors of consumption. This study aims to categorize a sample of adolescent cannabis users based on their most dominant personality traits (internalizing and externalizing profile). Then, to make a comparison of both profiles considering a set of variables related to consumption, clinical severity and subjective effects experienced. From a cross-sectional design, 173 adolescents (104 men and 69 women) aged 13 to 18 asking for treatment for cannabis use disorder in an Addictive Behavior Unit (UCAD) from the hospital were recruited. For the assessment, an ad hoc protocol was employed to register consumption, the Millon Adolescent Clinical Inventory (MACI) and the Addiction Research Center Inventory (ARCI) 49-item short form were also administered. Factor analysis suggested a two-profile solution: Introverted, Inhibited, Doleful, Dramatizing (-), Egotistic (-), Self-demeaning and Borderline tendency scales composed the internalizing profile, and Submissive (-), Unruly, Forceful, Conforming (-) and Oppositional scales composed the externalizing profile. The comparative analysis showed that the internalizing profile has higher levels of clinical severity and more subjective effects reported than the externalizing profile. These results suggest the need to design specific intervention strategies for each profile