Psychology Is a Property of Persons, Not Averages or Distributions: Confronting the Group-to-Person Generalizability Problem in Experimental Psychology

This is the final version. Available on open access from SAGE Publications via the DOI in this recordWhen experimental psychologists make a claim (e.g., “Participants judged X as morally worse than Y”), how many participants are represented? Such claims are often based exclusively on group-level analyses; here, psychologists often fail to report or perhaps even investigate how many participants judged X as morally worse than Y. More troubling, group-level analyses do not necessarily generalize to the person level: “the group-to-person generalizability problem.” We first argue for the necessity of designing experiments that allow investigation of whether claims represent most participants. Second, we report findings that in a survey of researchers (and laypeople), most interpret claims based on group-level effects as being intended to represent most participants in a study. Most believe this ought to be the case if a claim is used to support a general, person-level psychological theory. Third, building on prior approaches, we document claims in the experimental-psychology literature, derived from sets of typical group-level analyses, that describe only a (sometimes tiny) minority of participants. Fourth, we reason through an example from our own research to illustrate this group-to-person generalizability problem. In addition, we demonstrate how claims from sets of simulated group-level effects can emerge without a single participant’s responses matching these patterns. Fifth, we conduct four experiments that rule out several methodology-based noise explanations of the problem. Finally, we propose a set of simple and flexible options to help researchers confront the group-to-person generalizability problem in their own work

The incidence of scarring on the dorsum of the hand

When undertaking image comparison of the hand between accused and perpetrator, it is not unusual for scars to be identified on the back of the hand. To investigate the occurrence of scarring in a discreet sample, a database of 238 individuals was examined, and the dorsum of the right and left hands was gridded for each individual. The position, size and type of scar were recorded within each grid. It was found that, in general, males exhibited a higher incidence of scarring than females. However, males were more likely to show scarring on their left hand whereas females were more likely to exhibit scarring on their right hand. Contrary to the literature, scarring was not most prevalent along the borders of the hand but occurred more frequently in association with the index and middle finger corridor regions. Surgical scars were rare as were large scars whereas linear scars smaller than 6 mm were the most frequently identified. Close to half of the sample did not exhibit scarring on one hand. The importance of understanding the pattern of scarring on the back of the hand is discussed in the light of forensic image comparison analysis

Can Score Databanks Help Teaching?

Basic courses in most medical schools assess students' performance by conferring scores. The objective of this work is to use a large score databank for the early identification of students with low performance and to identify course trends based on the mean of students' grades. METHODOLOGY/PRINCIPAL FINDINGS: We studied scores from 2,398 medical students registered in courses over a period of 10 years. Students in the first semester were grouped into those whose ratings remained in the lower quartile in two or more courses (low-performance) and students who had up to one course in the lower quartile (high-performance). ROC curves were built, aimed at the identification of a cut-off average score in the first semesters that would be able to predict low performances in future semesters. Moreover, to follow the long-term pattern of each course, the mean of all scores conferred in a semester was compared to the overall course mean obtained by averaging 10 years of data. Individuals in the low-performance group had a higher risk of being in the lower quartile of at least one course in the second semester (relative risk 3.907; 95% CI: 3.378-4.519) and in the eighth semester (relative risk 2.873; 95% CI: 2.495-3.308). The prediction analysis revealed that an average score of 7.188 in the first semester could identify students that presented scores below the lower quartiles in both the second and eighth semesters (p<0.0001 for both AUC). When scores conferred by single courses were compared over time, three time-trend patterns emerged: low variation, upward trend and erratic pattern. CONCLUSION/SIGNIFICANCE: An early identification of students with low performance may be useful in promoting pedagogical strategies for these individuals. Evaluation of the time trend of scores conferred by courses may help departments monitoring changes in personnel and methodology that may affect a student's performance

Engaging Undergraduates in Science Research: Not Just About Faculty Willingness.

Despite the many benefits of involving undergraduates in research and the growing number of undergraduate research programs, few scholars have investigated the factors that affect faculty members' decisions to involve undergraduates in their research projects. We investigated the individual factors and institutional contexts that predict faculty members' likelihood of engaging undergraduates in their research project(s). Using data from the Higher Education Research Institute's 2007-2008 Faculty Survey, we employ hierarchical generalized linear modeling to analyze data from 4,832 science, technology, engineering, and mathematics (STEM) faculty across 194 institutions to examine how organizational citizenship behavior theory and social exchange theory relate to mentoring students in research. Key findings show that faculty who work in the life sciences and those who receive government funding for their research are more likely to involve undergraduates in their research project(s). In addition, faculty at liberal arts or historically Black colleges are significantly more likely to involve undergraduate students in research. Implications for advancing undergraduate research opportunities are discussed

Prevalence and predictors of hospital prealerting in acute stroke: a mixed methods study.

BACKGROUND: Thrombolysis can significantly reduce the burden of stroke but the time window for safe and effective treatment is short. In patients travelling to hospital via ambulance, the sending of a 'prealert' message can significantly improve the timeliness of treatment. OBJECTIVE: Examine the prevalence of hospital prealerting, the extent to which prealert protocols are followed and what factors influence emergency medical services (EMS) staff's decision to send a prealert. METHODS: Cohort study of patients admitted to two acute stroke units in West Midlands (UK) hospitals using linked data from hospital and EMS records. A logistic regression model examined the association between prealert eligibility and whether a prealert message was sent. In semistructured interviews, EMS staff were asked about their experiences of patients with suspected stroke. RESULTS: Of the 539 patients eligible for this study, 271 (51%) were recruited. Of these, only 79 (29%) were eligible for prealerting according to criteria set out in local protocols but 143 (53%) were prealerted. Increasing number of Face, Arm, Speech Test symptoms (1 symptom, OR 6.14, 95% CI 2.06 to 18.30, p=0.001; 2 symptoms, OR 31.36, 95% CI 9.91 to 99.24, p<0.001; 3 symptoms, OR 75.84, 95% CI 24.68 to 233.03, p<0.001) and EMS contact within 5 h of symptom onset (OR 2.99, 95% CI 1.37 to 6.50 p=0.006) were key predictors of prealerting but eligibility for prealert as a whole was not (OR 1.92, 95% CI 0.85 to 4.34 p=0.12). In qualitative interviews, EMS staff displayed varying understanding of prealert protocols and described frustration when their interpretation of the prealert criteria was not shared by ED staff. CONCLUSIONS: Up to half of the patients presenting with suspected stroke in this study were prealerted by EMS staff, regardless of eligibility, resulting in disagreements with ED staff during handover. Aligning the expectations of EMS and ED staff, perhaps through simplified prealert protocols, could be considered to facilitate more appropriate use of hospital prealerting in acute stroke

Assessment of data quality in a multi-centre cross-sectional study of participation and quality of life of children with cerebral palsy

BACKGROUND: SPARCLE is a cross-sectional survey in nine European regions, examining the relationship of the environment of children with cerebral palsy to their participation and quality of life. The objective of this report is to assess data quality, in particular heterogeneity between regions, family and item non-response and potential for bias. METHODS: 1,174 children aged 8–12 years were selected from eight population-based registers of children with cerebral palsy; one further centre recruited 75 children from multiple sources. Families were visited by trained researchers who administered psychometric questionnaires. Logistic regression was used to assess factors related to family non-response and self-completion of questionnaires by children. RESULTS: 431/1,174 (37%) families identified from registers did not respond: 146 (12%) were not traced; of the 1,028 traced families, 250 (24%) declined to participate and 35 (3%) were not approached. Families whose disabled children could walk unaided were more likely to decline to participate. 818 children entered the study of which 500 (61%) self-reported their quality of life; children with low IQ, seizures or inability to walk were less likely to self-report. There was substantial heterogeneity between regions in response rates and socio-demographic characteristics of families but not in age or gender of children. Item non-response was 2% for children and ranged from 0.4% to 5% for questionnaires completed by parents. CONCLUSION: While the proportion of untraced families was higher than in similar surveys, the refusal rate was comparable. To reduce bias, all analyses should allow for region, walking ability, age and socio-demographic characteristics. The 75 children in the region without a population based register are unlikely to introduce bias

Puzzle based teaching versus traditional instruction in electrocardiogram interpretation for medical students – a pilot study

<p>Abstract</p> <p>Background</p> <p>Most medical professionals are expected to possess basic electrocardiogram (EKG) interpretation skills. But, published data suggests that residents' and physicians' EKG interpretation skills are suboptimal. Learning styles differ among medical students; individualization of teaching methods has been shown to be viable and may result in improved learning. Puzzles have been shown to facilitate learning in a relaxed environment. The objective of this study was to assess efficacy of teaching puzzle in EKG interpretation skills among medical students.</p> <p>Methods</p> <p>This is a reader blinded crossover trial. Third year medical students from College of Human Medicine, Michigan State University participated in this study. Two groups (n = 9) received two traditional EKG interpretation skills lectures followed by a standardized exam and two extra sessions with the teaching puzzle and a different exam. Two other groups (n = 6) received identical courses and exams with the puzzle session first followed by the traditional teaching. EKG interpretation scores on final test were used as main outcome measure.</p> <p>Results</p> <p>The average score after only traditional teaching was 4.07 ± 2.08 while after only the puzzle session was 4.04 ± 2.36 (p = 0.97). The average improvement after the traditional session was followed up with a puzzle session was 2.53 ± 1.94 while the average improvement after the puzzle session was followed with the traditional session was 2.08 ± 1.73 (p = 0.67). The final EKG exam score for this cohort (n = 15) was 84.1 compared to 86.6 (p = 0.22) for a comparable sample of medical students (n = 15) at a different campus.</p> <p>Conclusion</p> <p>Teaching EKG interpretation with puzzles is comparable to traditional teaching and may be particularly useful for certain subgroups of students. Puzzle session are more interactive and relaxing, and warrant further investigations on larger scale.</p

Diversification of refugia types needed to secure the future of coral reefs subject to climate change

Identifying locations of refugia from the thermal stresses of climate change for coral reefs and better managing them is one of the key recommendations for climate change adaptation. We review and summarize approximately 30 years of applied research focused on identifying climate refugia to prioritize the conservation actions for coral reefs under rapid climate change. We found that currently proposed climate refugia and the locations predicted to avoid future coral losses are highly reliant on excess heat metrics, such as degree heating weeks. However, many existing alternative environmental, ecological, and life-history variables could be used to identify other types of refugia that lead to the desired diversified portfolio for coral reef conservation. To improve conservation priorities for coral reefs, there is a need to evaluate and validate the predictions of climate refugia with long-term field data on coral abundance, diversity, and functioning. There is also the need to identify and safeguard locations displaying resistance toprolonged exposure to heat waves and the ability to recover quickly after thermal exposure. We recommend using more metrics to identify a portfolio of potential refugia sites for coral reefs that can avoid, resist, and recover from exposure to high ocean temperatures and the consequences of climate change, thereby shifting past efforts focused on avoidance to a diversified risk-spreading portfolio that can be used to improve strategic coral reef conservation in a rapidly warming climate

Maternal position during the first stage of labor: a systematic review

BACKGROUND: Policy makers and health professionals are progressively using evidence-based rationale to guide their decisions. There has long been controversy regarding which maternal position is more appropriate during the first stage of labor. This problem has been examined often and repeatedly and the optimal recommendation remains unclear. METHODS: This is a systematic review of the effect of maternal position during the first stage of labor. The main question addressed here is: Does encouraging women to adopt an upright position or to ambulate during the first stage of labor reduce the duration of this stage? All randomized controlled trials carried out to assess this effect were taken into consideration in this review. The following electronic databases were accessed to identify studies: MEDLINE, Popline, the Scientific Electronic Library On-line and the Latin American and Caribbean Health Science Information. Citation eligibility was independently assessed by two reviewers. The methodological quality of each trial was also evaluated independently by two reviewers and a trial under consideration was included only when consensus had been attained. Allocation concealment and screening for the occurrence of attrition, performance and detection biases were considered when studies were appraised. The decision whether to perform data pooling was based on the clinical similarity of studies. RESULTS: The search strategy resulted in 260 citations, of which 18 were assessed in full-text. Nine eligible randomized controlled trials were included in the systematic review. Randomization methods were not fully described in eight studies. The allocation concealment was considered adequate in four studies and unclear in five. The investigators pooled the data from seven studies in which the length of the first stage of labor and results were in favor of the intervention, but the high level of heterogeneity (I(2 )= 88.4%) impaired the meaning of this finding. The intervention did not affect other outcomes studied (mode of delivery, use of analgesia, labor augmentation and condition of the child at birth). CONCLUSION: Adoption of the upright position or ambulation during first stage of labor may be safe, but considering the available evidence and its consistency, it cannot be recommended as an effective intervention to reduce duration of the first stage of labor

Revealing the last 13,500 years of environmental history from the multiproxy record of a mountain lake (Lago Enol, northern Iberian Peninsula)

This is the author's accepted manuscript. The final publication is available at Springer via http://dx.doi.org/10.1007/s10933-009-9387-7.We present the Holocene sequence from Lago Enol (43°16′N, 4°59′W, 1,070 m a.s.l.), Cantabrian Mountains, northern Spain. A multiproxy analysis provided comprehensive information about regional humidity and temperature changes. The analysis included sedimentological descriptions, physical properties, organic carbon and carbonate content, mineralogy and geochemical composition together with biological proxies including diatom and ostracod assemblages. A detailed pollen study enabled reconstruction of variations in vegetation cover, which were interpreted in the context of climate changes and human impact. Four distinct stages were recognized for the last 13,500 years: (1) a cold and dry episode that includes the Younger Dryas event (13,500–11,600 cal. year BP); (2) a humid and warmer period characterizing the onset of the Holocene (11,600–8,700 cal. year BP); (3) a tendency toward a drier climate during the middle Holocene (8,700–4,650 cal. year BP); and (4) a return to humid conditions following landscape modification by human activity (pastoral activities, deforestation) in the late Holocene (4,650–2,200 cal. year BP). Superimposed on relatively stable landscape conditions (e.g. maintenance of well established forests), the typical environmental variability of the southern European region is observed at this site.The Spanish Inter-Ministry Commission of Science and Technology (CICYT), the Spanish National Parks agency, the European Commission, the Spanish Ministry of Science, and the European Social Fund