Using video-based situational judgment tests for teacher selection: : A quasi-experiment exploring the relations between test format, subgroup differences, and applicant reactions

The question whether video-based situational judgment test (SJT) formats provide benefits over ‘traditional’ text-based SJTs has not yet been addressed in research on teacher selection. Focusing on three SJT conditions - two video-based conditions (with and without text), and a text-based condition - we investigated mean differences in applicant reactions and SJT scores, subgroup differences (ethnicity and gender), and relations between SJT scores and applicant reactions. Using a quasi-experimental design, 290 prospective teachers (56.6 % female) were randomly assigned to one of the three SJT conditions. SJT scores did not significantly differ between conditions, but both video-based formats were perceived as more engaging than the text-based format. Results from a multigroup path model indicated that there were gender effects for the text-based condition (females outperforming males), but not for the two video-based conditions. However, ethnicity bias (members from majority groups outperforming members from minority groups) occurred in all conditions. Differentiated patterns of relations were found between applicant reactions and SJT performance, with test anxiety significantly predicting SJT performance in the video with text condition and engagement significantly predicting SJT performance in the video without text condition. Implications for future research and teacher selection practice are discussed

Multiple paths in complex tasks

The relationship between utility judgments of subtask paths and the utility of the task as a whole was examined. The convergent validation procedure is based on the assumption that measurements of the same quantity done with different methods should covary. The utility measures of the subtasks were obtained during the performance of an aircraft flight controller navigation task. Analyses helped decide among various models of subtask utility combination, whether the utility ratings of subtask paths predict the whole tasks utility rating, and indirectly, whether judgmental models need to include the equivalent of cognitive noise

Developing a global risk engine

Risk analysis is a critical link in the reduction of casualties and damages due to earthquakes. Recognition of this relation has led to a rapid rise in demand for accurate, reliable and flexible risk assessment software. However, there is a significant disparity between the high quality scientific data developed by researchers and the availability of versatile, open and user-friendly risk analysis tools to meet the demands of end-users. In the past few years several open-source software have been developed that play an important role in the seismic research, such as OpenSHA and OpenSEES. There is however still a gap when it comes to open-source risk assessment tools and software. In order to fill this gap, the Global Earthquake Model (GEM) has been created. GEM is an internationally sanctioned program initiated by the OECD that aims to build independent, open standards to calculate and communicate earthquake risk around the world. This initiative started with a one-year pilot project named GEM1, during which an evaluation of a number of existing risk software was carried out. After a critical review of the results it was concluded that none of the software were adequate for GEM requirements and therefore, a new object-oriented tool was to be developed. This paper presents a summary of some of the most well known applications used in risk analysis, highlighting the main aspects that were considered for the development of this risk platform. The research that was carried out in order to gather all of the necessary information to build this tool was distributed in four different areas: information technology approach, seismic hazard resources, vulnerability assessment methodologies and sources of exposure data. The main aspects and findings for each of these areas will be presented as well as how these features were incorporated in the up-to-date risk engine. Currently, the risk engine is capable of predicting human or economical losses worldwide considering both deterministic and probabilistic-based events, using vulnerability curves. A first version of GEM will become available at the end of 2013. Until then the risk engine will continue to be developed by a growing community of developers, using a dedicated open-source platform

The Current State of Performance Appraisal Research and Practice: Concerns, Directions, and Implications

On the surface, it is not readily apparent how some performance appraisal research issues inform performance appraisal practice. Because performance appraisal is an applied topic, it is useful to periodically consider the current state of performance research and its relation to performance appraisal practice. This review examines the performance appraisal literature published in both academic and practitioner outlets between 1985 and 1990, briefly discusses the current state of performance appraisal practice, highlights the juxtaposition of research and practice, and suggests directions for further research

Protest Adjustments in the Valuation of Watershed Restoration Using Payment Card Data

When using a willingness-to-pay (WTP) format in contingent valuation (CV) to value water-shed restoration, respondents may protest by questioning why they should pay to clean up a pollution problem that someone else created. Using a sample selection interval data model based on Bhat (1994) and Brox, Kumar, and Stollery (2003), we found that the decision to protest and WTP values were correlated. Protest sample selection bias resulted in a 300 percent overestimate of mean WTP per respondent. Using different ad hoc treatments of protesters, protest bias resulted in moderate effects (-10 percent to +14 percent) after controlling for sample selection bias.contingent valuation, protest bias, watershed restoration, sample selection, grouped Tobit, Resource /Energy Economics and Policy,

A Systematic Mapping of Factors Affecting Accuracy of Software Development Effort Estimation

Software projects often do not meet their scheduling and budgeting targets. Inaccurate estimates are often responsible for this mismatch. This study investigates extant research on factors that affect accuracy of software development effort estimation. The purpose is to synthesize existing knowledge, propose directions for future research, and improve estimation accuracy in practice. A systematic mapping study (a comprehensive review of existing research) is conducted to identify such factors and their impact on estimation accuracy. Thirty-two factors assigned to four categories (estimation process, estimator’s characteristics, project to be estimated, and external context) are identified in a variety of research studies. Although the significant impact of several factors has been shown, results are limited by the lack of insight into the extent of these impacts. Our results imply a shift in research focus and design to gather more in-depth insights. Moreover, our results emphasize the need to argue for specific design decisions to enable a better understanding of possible influences of the study design on the credibility of the results. For software developers, our results provide a useful map to check the assumptions that undergird their estimates, to build comprehensive experience databases, and to adequately staff design projects

Considerations for Future IGS Receivers

Future IGS receivers are considered against the backdrop of GNSS signal modernization and the IGS’s goal of further improving the accuracy of its products. The purpose of this paper is to provide IGS members with a guide to making decisions about GNSS receivers. Modernized GNSS signals are analyzed with a view toward IGS applications. A schedule for minimum IGS receiver requirements is proposed. Features of idealized conceptual receivers are discussed. The prospects for standard commercial receivers and for software-defined GNSS receivers are examined. Recommendations are given for how the IGS should proceed in order to maximally benefit from the transformation in GNSS that will occur over the next decade.Aerospace Engineering and Engineering Mechanic

Evaluation of the usefulness of various simulation technology options for TERPS enhancement

Current approved terminal instrument procedures (TERPS) do not permit the full exploitation of the helicopter's unique flying characteristics. Enhanced TERPS need to be developed for a host of non-standard landing sites and navigation aids. Precision navigation systems such as microwave landing systems (MLS) and the Global Positioning System (GPS) open the possibility of curved paths, steep glide slopes, and decelerating helicopter approaches. This study evaluated the feasibility, benefits, and liabilities of using helicopter cockpit simulators in place of flight testing to develop enhanced TERPS criteria for non-standard flight profiles and navigation equipment. Near-term (2 to 5 year) requirements for conducting simulator studies to verify that they produce suitable data comparable to that obtained from previous flight tests are discussed. The long-term (5 to 10 year) research and development requirements to provide necessary modeling for continued simulator-based testing to develop enhanced TERPS criteria are also outlined