Using item response theory to explore the psychometric properties of extended matching questions examination in undergraduate medical education

BACKGROUND: As assessment has been shown to direct learning, it is critical that the examinations developed to test clinical competence in medical undergraduates are valid and reliable. The use of extended matching questions (EMQ) has been advocated to overcome some of the criticisms of using multiple-choice questions to test factual and applied knowledge. METHODS: We analysed the results from the Extended Matching Questions Examination taken by 4th year undergraduate medical students in the academic year 2001 to 2002. Rasch analysis was used to examine whether the set of questions used in the examination mapped on to a unidimensional scale, the degree of difficulty of questions within and between the various medical and surgical specialties and the pattern of responses within individual questions to assess the impact of the distractor options. RESULTS: Analysis of a subset of items and of the full examination demonstrated internal construct validity and the absence of bias on the majority of questions. Three main patterns of response selection were identified. CONCLUSION: Modern psychometric methods based upon the work of Rasch provide a useful approach to the calibration and analysis of EMQ undergraduate medical assessments. The approach allows for a formal test of the unidimensionality of the questions and thus the validity of the summed score. Given the metric calibration which follows fit to the model, it also allows for the establishment of items banks to facilitate continuity and equity in exam standards

Effects of Terrestrial Buffer Zones on Amphibians on Golf Courses

A major cause of amphibian declines worldwide is habitat destruction or alteration. Public green spaces, such as golf courses and parks, could serve as safe havens to curb the effects of habitat loss if managed in ways to bolster local amphibian communities. We reared larval Blanchard's cricket frogs (Acris blanchardi) and green frogs (Rana clamitans) in golf course ponds with and without 1 m terrestrial buffer zones, and released marked cricket frog metamorphs at the golf course ponds they were reared in. Larval survival of both species was affected by the presence of a buffer zone, with increased survival for cricket frogs and decreased survival for green frogs when reared in ponds with buffer zones. No marked cricket frog juveniles were recovered at any golf course pond in the following year, suggesting that most animals died or migrated. In a separate study, we released cricket frogs in a terrestrial pen and allowed them to choose between mown and unmown grass. Cricket frogs had a greater probability of using unmown versus mown grass. Our results suggest that incorporating buffer zones around ponds can offer suitable habitat for some amphibian species and can improve the quality of the aquatic environment for some sensitive local amphibians

Study protocol: developing a decision system for inclusive housing: applying a systematic, mixed-method quasi-experimental design

Background Identifying the housing preferences of people with complex disabilities is a much needed, but under-developed area of practice and scholarship. Despite the recognition that housing is a social determinant of health and quality of life, there is an absence of empirical methodologies that can practically and systematically involve consumers in this complex service delivery and housing design market. A rigorous process for making effective and consistent development decisions is needed to ensure resources are used effectively and the needs of consumers with complex disability are properly met. Methods/Design This 3-year project aims to identify how the public and private housing market in Australia can better respond to the needs of people with complex disabilities whilst simultaneously achieving key corporate objectives. First, using the Customer Relationship Management framework, qualitative (Nominal Group Technique) and quantitative (Discrete Choice Experiment) methods will be used to quantify the housing preferences of consumers and their carers. A systematic mixed-method, quasi-experimental design will then be used to quantify the development priorities of other key stakeholders (e.g., architects, developers, Government housing services etc.) in relation to inclusive housing for people with complex disabilities. Stakeholders randomly assigned to Group 1 (experimental group) will participate in a series of focus groups employing Analytical Hierarchical Process (AHP) methodology. Stakeholders randomly assigned to Group 2 (control group) will participate in focus groups employing existing decision making processes to inclusive housing development (e.g., Risk, Opportunity, Cost, Benefit considerations). Using comparative stakeholder analysis, this research design will enable the AHP methodology (a proposed tool to guide inclusive housing development decisions) to be tested. Discussion It is anticipated that the findings of this study will enable stakeholders to incorporate consumer housing preferences into commercial decisions. Housing designers and developers will benefit from the creation of a parsimonious set of consumer-led housing preferences by which to make informed investments in future housing and contribute to future housing policy. The research design has not been applied in the Australian research context or elsewhere, and will provide a much needed blueprint for market investment to develop viable, consumer directed inclusive housing options for people with complex disability

Exercise therapy for chronic low back pain:protocol for an individual participant data meta-analysis

<p>Abstract</p> <p>Background</p> <p>Low back pain (LBP) is one of the leading causes of disability and has a major socioeconomic impact. Despite a large amount of research in the field, there remains uncertainty about the best treatment approach for chronic LBP, and identification of relevant patient subgroups is an important goal. Exercise therapy is a commonly used strategy to treat chronic low back pain and is one of several interventions that evidence suggests is moderately effective.</p> <p>In parallel with an update of the 2005 Cochrane review, we will undertake an individual participant data (IPD) meta-analysis, which will allow us to standardize analyses across studies and directly derive results, and to examine differential treatment effects across individuals to estimate how patients’ characteristics modify treatment benefit.</p> <p>Methods/design</p> <p>We will use standard systematic review methods advocated by the Cochrane Collaboration to identify relevant trials. We will include trials evaluating exercise therapy compared to any or no other interventions in adult non-specific chronic LBP. Our primary outcomes of interest include pain, functional status, and return-to-work/absenteeism. We will assess potential risk of bias for each study meeting selection criteria, using criteria and methods recommended by the Cochrane BRG.</p> <p>The original individual participant data will be requested from the authors of selected trials having moderate to low risk of bias. We will test original data and compile a master dataset with information about each trial mapped on a pre-specified framework, including reported characteristics of the study sample, exercise therapy characteristics, individual patient characteristics at baseline and all follow-up periods, subgroup and treatment effect modifiers investigated. Our analyses will include descriptive, study-level meta-analysis and meta-regression analyses of the overall treatment effect, and individual-level IPD meta-analyses of treatment effect modification. IPD meta-analyses will be conducted using a one-step approach where the IPD from all studies are modeled simultaneously while accounting for the clustering of participants with studies.</p> <p>Discussion</p> <p>We will analyze IPD across a large number of LBP trials. The resulting larger sample size and consistent presentation of data will allow additional analyses to explore patient-level heterogeneity in treatment outcomes and prognosis of chronic LBP.</p

Prognostic markers in cancer: the evolution of evidence from single studies to meta-analysis, and beyond

In oncology, prognostic markers are clinical measures used to help elicit an individual patient's risk of a future outcome, such as recurrence of disease after primary treatment. They thus facilitate individual treatment choice and aid in patient counselling. Evidence-based results regarding prognostic markers are therefore very important to both clinicians and their patients. However, there is increasing awareness that prognostic marker studies have been neglected in the drive to improve medical research. Large protocol-driven, prospective studies are the ideal, with appropriate statistical analysis and clear, unbiased reporting of the methods used and the results obtained. Unfortunately, published prognostic studies rarely meet such standards, and systematic reviews and meta-analyses are often only able to draw attention to the paucity of good-quality evidence. We discuss how better-quality prognostic marker evidence can evolve over time from initial exploratory studies, to large protocol-driven primary studies, and then to meta-analysis or even beyond, to large prospectively planned pooled analyses and to the initiation of tumour banks. We highlight articles that facilitate each stage of this process, and that promote current guidelines aimed at improving the design, analysis, and reporting of prognostic marker research. We also outline why collaborative, multi-centre, and multi-disciplinary teams should be an essential part of future studies

REporting recommendations for tumour MARKer prognostic studies (REMARK)

Despite years of research and hundreds of reports on tumour markers in oncology, the number of markers that have emerged as clinically useful is pitifully small. Often initially reported studies of a marker show great promise, but subsequent studies on the same or related markers yield inconsistent conclusions or stand in direct contradiction to the promising results. It is imperative that we attempt to understand the reasons that multiple studies of the same marker lead to differing conclusions. A variety of methodological problems have been cited to explain these discrepancies. Unfortunately, many tumour marker studies have not been reported in a rigorous fashion, and published articles often lack sufficient information to allow adequate assessment of the quality of the study or the generalisability of the study results. The development of guidelines for the reporting of tumour marker studies was a major recommendation of the US National Cancer Institute and the European Organisation for Research and Treatment of Cancer (NCI-EORTC) First International Meeting on Cancer Diagnostics in 2000. Similar to the successful CONSORT initiative for randomised trials and the STARD statement for diagnostic studies, we suggest guidelines to provide relevant information about the study design, preplanned hypotheses, patient and specimen characteristics, assay methods, and statistical analysis methods. In addition, the guidelines suggest helpful presentations of data and important elements to include in discussions. The goal of these guidelines is to encourage transparent and complete reporting so that the relevant information will be available to others to help them to judge the usefulness of the data and understand the context in which the conclusions apply

Between-group competition elicits within-group cooperation in children

Aggressive interactions between groups are frequent in human societies and can bear significant fitness costs and benefits (e.g. death or access to resources). During between-group competitive interactions, more cohesive groups (i.e. groups formed by individuals who cooperate in group defence) should out-perform less cohesive groups, other factors being equal (e.g. group size). The cost/benefit of between-group competition are thought to have driven correlated evolution of traits that favour between-group aggression and within-group cooperation (e.g. parochial altruism). Our aim was to analyse whether the proximate relationship between between-group competition and within-group cooperation is found in 3–10 years old children and the developmental trajectory of such a relationship. We used a large cohort of children (n = 120) and tested whether simulated between-group competition increased within-group cooperation (i.e. how much of a resource children were giving to their group companions) in two experiments. We found greater within-group cooperation when groups of four children were competing with other groups then in the control condition (no between-group competition). Within-group cooperation increased with age. Our study suggests that parochial altruism and in-group/out-group biases emerge early during the course of human development

Evidence of marine ice-cliff instability in Pine Island Bay from iceberg-keel plough marks.

Marine ice-cliff instability (MICI) processes could accelerate future retreat of the Antarctic Ice Sheet if ice shelves that buttress grounding lines more than 800 metres below sea level are lost. The present-day grounding zones of the Pine Island and Thwaites glaciers in West Antarctica need to retreat only short distances before they reach extensive retrograde slopes. When grounding zones of glaciers retreat onto such slopes, theoretical considerations and modelling results indicate that the retreat becomes unstable (marine ice-sheet instability) and thus accelerates. It is thought that MICI is triggered when this retreat produces ice cliffs above the water line with heights approaching about 90 metres. However, observational evidence confirming the action of MICI has not previously been reported. Here we present observational evidence that rapid deglacial ice-sheet retreat into Pine Island Bay proceeded in a similar manner to that simulated in a recent modelling study, driven by MICI. Iceberg-keel plough marks on the sea-floor provide geological evidence of past and present iceberg morphology, keel depth and drift direction. From the planform shape and cross-sectional morphologies of iceberg-keel plough marks, we find that iceberg calving during the most recent deglaciation was not characterized by small numbers of large, tabular icebergs as is observed today, which would produce wide, flat-based plough marks or toothcomb-like multi-keeled plough marks. Instead, it was characterized by large numbers of smaller icebergs with V-shaped keels. Geological evidence of the form and water-depth distribution of the plough marks indicates calving-margin thicknesses equivalent to the threshold that is predicted to trigger ice-cliff structural collapse as a result of MICI. We infer rapid and sustained ice-sheet retreat driven by MICI, commencing around 12,300 years ago and terminating before about 11,200 years ago, which produced large numbers of icebergs smaller than the typical tabular icebergs produced today. Our findings demonstrate the effective operation of MICI in the past, and highlight its potential contribution to accelerated future retreat of the Antarctic Ice Sheet

Multisensory visual–tactile object related network in humans: insights gained using a novel crossmodal adaptation approach

Neuroimaging techniques have provided ample evidence for multisensory integration in humans. However, it is not clear whether this integration occurs at the neuronal level or whether it reflects areal convergence without such integration. To examine this issue as regards visuo-tactile object integration we used the repetition suppression effect, also known as the fMRI-based adaptation paradigm (fMR-A). Under some assumptions, fMR-A can tag specific neuronal populations within an area and investigate their characteristics. This technique has been used extensively in unisensory studies. Here we applied it for the first time to study multisensory integration and identified a network of occipital (LOtv and calcarine sulcus), parietal (aIPS), and prefrontal (precentral sulcus and the insula) areas all showing a clear crossmodal repetition suppression effect. These results provide a crucial first insight into the neuronal basis of visuo-haptic integration of objects in humans and highlight the power of using fMR-A to study multisensory integration using non-invasinve neuroimaging techniques

The Glycan Shield of HIV Is Predominantly Oligomannose Independently of Production System or Viral Clade

The N-linked oligomannose glycans of HIV gp120 are a target for both microbicide and vaccine design. The extent of cross-clade conservation of HIV oligomannose glycans is therefore a critical consideration for the development of HIV prophylaxes. We measured the oligomannose content of virion-associated gp120 from primary virus from PBMCs for a range of viral isolates and showed cross-clade elevation (62–79%) of these glycans relative to recombinant, monomeric gp120 (∼30%). We also confirmed that pseudoviral production systems can give rise to notably elevated gp120 oligomannose levels (∼98%), compared to gp120 derived from a single-plasmid viral system using the HIVLAI backbone (56%). This study highlights differences in glycosylation between virion-associated and recombinant gp120