An evaluation of the psychometric properties of the Indicator of Relative Need (IoRN) instrument

BACKGROUND: The Indicator of Relative Need (IoRN) instrument is designed for both health and social care services to measure function and dependency in older people. To date, the tool has not undergone assessment of validity. We report two studies aimed to evaluate psychometric properties of the IoRN. METHODS: The first study recruited patients receiving social care at discharge from hospital, those rehabilitating in intermediate care, and those in a rehabilitation at home service. Participants were assessed using the IoRN by a single researcher and by the clinical team at baseline and 8 weeks. Comparator instruments (Barthel ADL, Nottingham Extended ADL and Townsend Disability Scale) were also administered. Overall change in ability was assessed with a 7 point Likert scale at 8 weeks. The second study analysed linked routinely collected, health and social care data (including IoRN scores) to assess the relationship between IoRN category and death, hospitalisation and care home admission as a test of external validity. RESULTS: Ninety participants were included in the first study, mean age 77.9 (SD 12.0). Cronbach’s alpha for IoRN subscales was high (0.87 to 0.93); subscales showed moderate correlation with comparator tools (r = 0.43 to 0.63). Cohen’s weighted kappa showed moderate agreement between researcher and clinician IoRN category (0.49 to 0.53). Two-way intraclass correlation coefficients for IoRN subscales in participants reporting no change in ability were high (0.88 to 0.98) suggesting good stability; responsiveness coefficients in participants reporting overall change were equal to or better than comparator tools. 1712 patients were included in the second study, mean age 81.0 years (SD 7.7). Adjusted hazard ratios for death, care home admission and hospitalisation in the most dependent category compared to the least dependent IoRN category were 5.9 (95 % CI 2.0–17.0); 7.2 (95 % CI 4.4–12.0); 1.1 (95 % CI 0.5–2.6) respectively. The mean number of allocated hours of care 6 months after assessment was higher in the most dependent group compared to the least dependent group (5.6 vs 1.4 h, p = 0.005). CONCLUSIONS: Findings from these analyses support the use of the IoRN across a range of clinical environments although some limitations are highlighted

Process evaluation for complex interventions in primary care: understanding trials using the normalization process model

Background: the Normalization Process Model is a conceptual tool intended to assist in understanding the factors that affect implementation processes in clinical trials and other evaluations of complex interventions. It focuses on the ways that the implementation of complex interventions is shaped by problems of workability and integration.Method: in this paper the model is applied to two different complex trials: (i) the delivery of problem solving therapies for psychosocial distress, and (ii) the delivery of nurse-led clinics for heart failure treatment in primary care.Results: application of the model shows how process evaluations need to focus on more than the immediate contexts in which trial outcomes are generated. Problems relating to intervention workability and integration also need to be understood. The model may be used effectively to explain the implementation process in trials of complex interventions.Conclusion: the model invites evaluators to attend equally to considering how a complex intervention interacts with existing patterns of service organization, professional practice, and professional-patient interaction. The justification for this may be found in the abundance of reports of clinical effectiveness for interventions that have little hope of being implemented in real healthcare setting

Assessment in the service of learning: challenges and opportunities or Plus ça Change, Plus c’est la même Chose

This paper begins with a brief overview of literature indicating that, although there have been significant advances in the field’s capacity to conduct both formative and summative assessments over the past decades, those advances have not been matched by comparable impact. The bulk of the paper is devoted to a series of examples from the Mathematics Assessment Project that illustrate issues of methods, and the unrealized potential for advances

Construct-level predictive validity of educational attainment and intellectual aptitude tests in medical student selection: meta-regression of six UK longitudinal studies

Background: Measures used for medical student selection should predict future performance during training. A problem for any selection study is that predictor-outcome correlations are known only in those who have been selected, whereas selectors need to know how measures would predict in the entire pool of applicants. That problem of interpretation can be solved by calculating construct-level predictive validity, an estimate of true predictor-outcome correlation across the range of applicant abilities. Methods: Construct-level predictive validities were calculated in six cohort studies of medical student selection and training (student entry, 1972 to 2009) for a range of predictors, including A-levels, General Certificates of Secondary Education (GCSEs)/O-levels, and aptitude tests (AH5 and UK Clinical Aptitude Test (UKCAT)). Outcomes included undergraduate basic medical science and finals assessments, as well as postgraduate measures of Membership of the Royal Colleges of Physicians of the United Kingdom (MRCP(UK)) performance and entry in the Specialist Register. Construct-level predictive validity was calculated with the method of Hunter, Schmidt and Le (2006), adapted to correct for right-censorship of examination results due to grade inflation. Results: Meta-regression analyzed 57 separate predictor-outcome correlations (POCs) and construct-level predictive validities (CLPVs). Mean CLPVs are substantially higher (.450) than mean POCs (.171). Mean CLPVs for first-year examinations, were high for A-levels (.809; CI: .501 to .935), and lower for GCSEs/O-levels (.332; CI: .024 to .583) and UKCAT (mean = .245; CI: .207 to .276). A-levels had higher CLPVs for all undergraduate and postgraduate assessments than did GCSEs/O-levels and intellectual aptitude tests. CLPVs of educational attainment measures decline somewhat during training, but continue to predict postgraduate performance. Intellectual aptitude tests have lower CLPVs than A-levels or GCSEs/O-levels. Conclusions: Educational attainment has strong CLPVs for undergraduate and postgraduate performance, accounting for perhaps 65% of true variance in first year performance. Such CLPVs justify the use of educational attainment measure in selection, but also raise a key theoretical question concerning the remaining 35% of variance (and measurement error, range restriction and right-censorship have been taken into account). Just as in astrophysics, ‘dark matter’ and ‘dark energy’ are posited to balance various theoretical equations, so medical student selection must also have its ‘dark variance’, whose nature is not yet properly characterized, but explains a third of the variation in performance during training. Some variance probably relates to factors which are unpredictable at selection, such as illness or other life events, but some is probably also associated with factors such as personality, motivation or study skills

Gamification through leaderboards : an empirical study in engineering education

Universities are looking for solutions to engage more students in STEM domains and enhance their learning performance (LP). In this context, gamification is put forward as a solution to achieve this aim. The present study examined the effect of gamification – building on leaderboards ‐ on LP. Furthermore, mediating variables, such as intrinsic motivation, self‐efficacy, engagement, and background variables, such as sex, previous gaming experience, and undergraduate major, were considered. A pretest‐posttest quasi‐experimental design with an experimental and a control condition was set up (n = 89) in an Introductory Computer Programming course. We observed a significant improvement in the LP of students in the gamified condition. However, no interaction effect was detected, due to mediating and background variables. The high learning gain is a favorable indicator that gamification might be a promising approach to promote STEM programs

Chronic pain in primary care. German figures from 1991 and 2006

<p>Abstract</p> <p>Background</p> <p>Until now only limited research has been done on the prevalence of chronic pain in primary care. The aim of this investigation was to study the health care utilisation of patients suffering from pain. How many patients visit an outpatient clinic because of the symptom of pain? These data were compared with data from a similar study in 1991, to investigate whether improvements had been achieved.</p> <p>Methods</p> <p>A total of 1201 consecutive patients visiting outpatient clinics were surveyed in six practices in the western part of Germany on randomly selected days by means of questionnaires. Topics were the point prevalence of pain and the period prevalence of chronic pain, its characteristics and its impact on daily life, as well as data on previous therapies for pain. A retrospective comparison was made with the data from a similar study with same design surveying 900 patients that took place in five practices during 1991.</p> <p>Results</p> <p>In 2006, pain was the main reason for consulting a doctor in 42.5% of all patients (1991: 50.3%). Of all respondents, 62% suffered from pain on the particular day of the consultation, and 40% reported that they had been suffering from pain for more than six months (1991: 36.4%). As many as 88.3% of patients with chronic pain reported a negative impact on their daily life due to this pain (1991: 68%), and 88.1% reported impairment of their working life because of chronic pain (1991: 59.1%).</p> <p>Conclusion</p> <p>Pain, and chronic pain in particular, is a central problem in primary care. Over the last 15 years, the number of patients suffering from chronic pain has not decreased. In nearly half of all cases, pain is still the reason for health care utilisation in outpatient clinics. Pain represents a major primary health care problem with enormous impact on public health. Improvements can only be achieved by improving the quality of health care at the primary care level.</p

The systematic guideline review: method, rationale, and test on chronic heart failure

Background: Evidence-based guidelines have the potential to improve healthcare. However, their de-novo-development requires substantial resources-especially for complex conditions, and adaptation may be biased by contextually influenced recommendations in source guidelines. In this paper we describe a new approach to guideline development-the systematic guideline review method (SGR), and its application in the development of an evidence-based guideline for family physicians on chronic heart failure (CHF). Methods: A systematic search for guidelines was carried out. Evidence-based guidelines on CHF management in adults in ambulatory care published in English or German between the years 2000 and 2004 were included. Guidelines on acute or right heart failure were excluded. Eligibility was assessed by two reviewers, methodological quality of selected guidelines was appraised using the AGREE instrument, and a framework of relevant clinical questions for diagnostics and treatment was derived. Data were extracted into evidence tables, systematically compared by means of a consistency analysis and synthesized in a preliminary draft. Most relevant primary sources were re-assessed to verify the cited evidence. Evidence and recommendations were summarized in a draft guideline. Results: Of 16 included guidelines five were of good quality. A total of 35 recommendations were systematically compared: 25/35 were consistent, 9/35 inconsistent, and 1/35 un-rateable (derived from a single guideline). Of the 25 consistencies, 14 were based on consensus, seven on evidence and four differed in grading. Major inconsistencies were found in 3/9 of the inconsistent recommendations. We re-evaluated the evidence for 17 recommendations (evidence-based, differing evidence levels and minor inconsistencies) - the majority was congruent. Incongruity was found where the stated evidence could not be verified in the cited primary sources, or where the evaluation in the source guidelines focused on treatment benefits and underestimated the risks. The draft guideline was completed in 8.5 man-months. The main limitation to this study was the lack of a second reviewer. Conclusion: The systematic guideline review including framework development, consistency analysis and validation is an effective, valid, and resource saving-approach to the development of evidence-based guidelines

Insight into aquaculture's potential of marine annelid worms and ecological concerns: a review

Polychaetes are marine annelid worms that can contribute to aquaculture diversification. Its culture has been viable, and commercially attempted, but intensive production has progressed only in few countries around the world. In the countries with no production, marine polychaetes are imported or harvested. A strong and sustained research investment provided to a better understanding of the nutritional requirements and reproduction of some species. Recent studies showed new technical improvements, which can lead to an important progress in productivity and give a new impetus to the polychaete production. Some marine worm species were identified as good candidates for integrated multitrophic aquaculture. The development of cost-effective aquaculture techniques for marine annelid worms is essential to ensure a balance between commercial interests and the preservation of ecosystems. The influence of polychaete aquaculture on the environment and vice versa raise important concerns related to ecological security and sustainability of this activity. This review focus on the main technical improvements and advances that have been made in areas as diverse as: aquaculture potential of polychaetes, reared species, main species used worldwide, and highlights biological and ecological concerns, important challenges and recommendations.This study was supported by the FCT (Portuguese National Board of Scientific Research), through the MARE (Marine and Environmental Sciences Centre) (UID/MAR/04292/2013) strategic programme and through strategic project PEst-OE/MAR/UI0199/2014, granted to MARE. This study has also the financial support of PROMAR Program through the project 31-03-05-FEP42: LIVE BAIT – Annelid polychaetes as live bait in Portugal: harvesting, import and rearing management.info:eu-repo/semantics/publishedVersio

Nurse managers' experience with ethical issues in six government hospitals in Malaysia: A cross-sectional study

<p>Abstract</p> <p>Background</p> <p>Nurse managers have the burden of experiencing frequent ethical issues related to both their managerial and nursing care duties, according to previous international studies. However, no such study was published in Malaysia. The purpose of this study was to explore nurse managers' experience with ethical issues in six government hospitals in Malaysia including learning about the way they dealt with the issues.</p> <p>Methods</p> <p>A cross-sectional study was conducted in August-September, 2010 involving 417 (69.2%) of total 603 nurse managers in the six Malaysian government hospitals. Data were collected using three-part self-administered questionnaire. Part I was regarding participants' demographics. Part II was about the frequency and areas of management where ethical issues were experienced, and scoring of the importance of 11 pre-identified ethical issues. Part III asked how they dealt with ethical issues in general; ways to deal with the 11 pre-identified ethical issues, and perceived stress level. Data were analyzed using descriptive statistics, cross-tabulations and Pearson's Chi-square.</p> <p>Results</p> <p>A total of 397 (95.2%) participants experienced ethical issues and 47.2% experienced them on weekly to daily basis. Experiencing ethical issues were not associated with areas of practice. Top area of management where ethical issues were encountered was "staff management", but "patient care" related ethical issues were rated as most important. Majority would "discuss with other nurses" in dealing generally with the issues. For pre-identified ethical issues regarding "patient care", "discuss with doctors" was preferred. Only 18.1% referred issues to "ethics committees" and 53.0% to the code of ethics.</p> <p>Conclusions</p> <p>Nurse managers, regardless of their areas of practice, frequently experienced ethical issues. For dealing with these, team-approach needs to be emphasized. Proper understanding of the code of ethics is needed to provide basis for reasoning.</p