Accuracy of percentile judgments used in the utility analysis of personnel selection procedures

Schmidt, Hunter, McKenzie and Muldrow's (1979) global estimation procedure for determining the standard deviation of job performance in monetary terms (SDy) is based on the assumption that people are able to estimate the percentiles of a normal distribution. The aim of the research reported here was to test the veracity of this assumption. We used participants who were primed to work with percentiles on a task that provided all the information necessary to solve the problem. Participants' percentile estimates were found to be grossly in error, suggesting that utilities estimated by the Schmidt et al. procedure are inaccurate. This finding was replicated in a second study which also examined the effect of group decision-making on the estimation process. Group estimates were found to be no better than individual estimate

Excluded letter fluency test (ELF) : norms and test-retest reliability data for healthy young adults

Normative and reliability data for the Excluded Letter Fluency (ELF) Test are provided. A stratified random sample of 399 healthy young adults aged 18 to 34 years from Sydney, Australia, completed the ELF Test as well as a full-length WAIS-R, as part of a larger battery of tests. After a 1-year interval 99 of these individuals were retested on the same forms of the tests. The influence of age, sex and education was investigated on the ELF and only education was found to have a significant overall effect on the total scores. However, gender was found to have an effect on the error scores, with males making more rule-breaks than females. Tables are provided for converting ELF raw scores, corrected for years of education, to standard scores with 90% and 95% confidence intervals for both test and retest purposes. A table for calculating the base rate of errors, for males and for females, on the ELF is also provided.7 page(s

Australian norms and retest data for the Rey Auditory and Verbal Learning Test

This article presents normative data for the Rey Auditory and Verbal Learning Test (RAVLT). A representative sample of 390 healthy young adults aged between 18 and 34 living within the Sydney metropolitan area, Australia, completed Form AB of the RAVLT as part of the Macquarie University Neurological Normative Study. Retest data were collected from a subsample of 98 participants after an interval of 1 year. Norms were derived for commonly used measures of the RAVLT and are presented for the whole sample as well as separately for males and females with different levels of education. Age was not found to impact significantly on test performance for this group of young adults, and therefore age-adjusted norms are not provided. An excel program to calculate RAVLT standard scores (mean of 10 and standard deviation of 3) can be downloaded from http://www.psy.mq.edu.au/RAVLT. Poor test-retest reliability raises concerns about the use of the RAVLT in clinical diagnosis.7 page(s

A Comparison of methods to estimate premorbid intelligence in an Australian sample : data from the Macquarie University Neuropsychological Normative Study (MUNNS)

A variety of methods for estimating premorbid intelligence were compared in an Australian sample participating in the Macquarie University Neuropsychological Normative Study (MUNNS). Predictors included a contextual version of the AUSNART, the WRAT-3 Reading subtest, Spot-the-Word Test and sub-tests from the WAIS-R. The study involved 244 healthy participants aged between 18 and 34 years, with half of them serving as a cross-validation sample. Multiple regression was used for all analyses. When taking into account both the statistical results and clinical utility of the methods, the Sydney Premorbid Intelligence Estimate (SPIE), consisting of Vocabulary and Picture Completion subtests from the WAIS-R, was considered to be the best predictor. Combining all measures into one regression did not substantially increase the amount of variance explained. Base rate tables for predicted IQ versus obtained IQ, and the discrepancy between predicted 10 and Delayed Recall Index of the WMS-R are provided for each of the prediction methods. Further research to examine the clinical utility of these methods is required.11 page(s

Influence of language background on tests of cognitive abilities: Australian data

This study examines the effect of language background on the performance of healthy participants on a battery of cognitive measures. The study was conducted as part of a larger normative study: the Macquarie University Neuropsychological Normative Study (MUNNS). A comparison was made between the test performance of three language background groups: participants from a non-English-speaking background whose first language was other than English (NESB-OE, N = 42); participants from a non-English-speaking background whose first language was English (NESB-E, N = 34); and participants from an English-speaking background (ESB, N = 40). A number of tests used in clinical neuropsychological assessment were found to be sensitive to the background of the participant, and trends in the data suggest that two factors are operating independently. It is proposed that one factor is language or proficiency in English that impacts on verbal subtests and the other is a sociocultural factor that impacts on performance or nonverbal subtests. These findings question current practices when assessing people from non-English-speaking backgrounds

Measurement invariance of core cognitive abilities in heterogenous neurological and community samples.

Confirmatory factor analysis of Australian adaptations of combined Wechsler Adult Intelligence Scale-Revised (WAIS-R) and Wechsler Memory Scale-Revised (WMS-R) scores was conducted in a sample of 277 participants undergoing investigation for neurological disorders. The best-fitting model was a six-factor model representing the latent abilities of Verbal Comprehension, Perceptual Organization, Working Memory, Verbal Memory, Visual Memory, and Processing Speed. Invariance of the measurement model was then examined in the mean and covariance structure with data from a recent Australian normative study of the WAIS-R and WMS-R. [Carstairs J.R. & Shores E.A.Aust Psychol 35 (2000) 36-40]. Results suggest that the measurement model underlying test scores displayed “strong” metric invariance [Widaman, K. F., & Reise, S. P. (1997). Exploring the measurement invariance of psychological instruments: Applications in the substance abuse domain. In K. J. Bryant & M. Windle (Eds.), The science of prevention: Methodological advance from alcohol and substance abuse research (pp. 281–324). Washington, DC: American Psychological Association] across clinical and community samples. These findings satisfy assumptions necessary for uncomplicated interpretation of validity correlations and differences in test scores across groups

Factorial invariance for combined Wechsler Adult Intelligence Scale-Revised and Wechsler Memory Scale-Revised scores in a sample of clients with alcohol dependency.

This study examined the joint factor structure of the WAIS-R and WMS-R in a sample of 289 participants (mostly males) with alcohol dependency. In a confirmatory phase we contrasted a range of factor models derived from previous analyses of the Wechsler scales. The best fitting model incorporated five factors representing Verbal Comprehension, Perceptual Organization, Attention-Concentration, Verbal Memory, and Visual Memory, with reassignment of factor loadings for two subtests. The invariance of the measurement model was then examined comparing data from a large sample of healthy participants (J. R. Carstairs & E. A. Shores, 1999). The results indicated that the number of factors was invariant across samples, and four of the factors satisfied the criterion of partial measurement invariance

Preferred learning modalities and practice for critical skills: A global survey of paediatric emergency medicine clinicians

© Author(s) (or their employer(s)) 2019. No commercial re-use. See rights and permissions. Published by BMJ. Objective To describe senior paediatric emergency clinician perspectives on the optimal frequency of and preferred modalities for practising critical paediatric procedures. Methods Multicentre multicountry cross-sectional survey of senior paediatric emergency clinicians working in 96 EDs affiliated with the Pediatric Emergency Research Network. Results 1332/2446 (54%) clinicians provided information on suggested frequency of practice and preferred learning modalities for 18 critical procedures. Yearly practice was recommended for six procedures (bag valve mask ventilation, cardiopulmonary resuscitation (CPR), endotracheal intubation, laryngeal mask airway insertion, defibrillation/direct current (DC) cardioversion and intraosseous needle insertion) by at least 80% of respondents. 16 procedures were recommended for yearly practice by at least 50% of respondents. Two procedures (venous cutdown and ED thoracotomy) had yearly practice recommended b