Demonstrating validity evidence of meta-assessment scores using generalizability theory

Meta-assessment, or the assessment of assessment, can provide meaningful information about the trustworthiness of an academic program’s assessment results (Bresciani, Gardner, & Hickmott, 2009; Palomba & Banta, 1999; Suskie, 2009). Many institutions conduct meta-assessments for their academic programs (Fulcher, Swain, & Orem, 2012), but no research exists to validate the uses of these processes’ results. This study developed the validity argument for the uses of a meta-assessment instrument at one mid-sized university in the mid-Atlantic. The meta-assessment instrument is a fourteen-element rubric that aligns with a general outcomes assessment model. Trained raters apply the rubric to annual assessment reports that are submitted by all academic programs at the institution. Based on these ratings, feedback is provided to programs about the effectiveness of their assessment processes. Prior research had used Generalizability theory to derive the dependability of the ratings provided by graduate students with advanced training in assessment and measurement techniques. This research focused on the dependability of the ratings provided to programs by faculty raters. In order to extend the generalizability of the meta-assessment ratings, a new fully-crossed G-study was conducted with eight faculty raters to compare the dependability of their ratings to those of the previous graduate student study. Results showed that the relative and absolute dependability of two-rater teams of faculty (ρ2 = .90, Φ = .88) were comparable to the dependability estimates of two-rater teams of graduate students. Faculty raters were more imprecise than graduate students in their ratings of individual elements, but not substantially. Based on the results, the generalizability of the meta-assessment ratings was expanded to a larger universe of raters. Rater inconsistencies for elements highlighted potential weaknesses in rater trainings. Additional evidence should be gathered to support several assumptions of the validity argument. The current research provides a roadmap for stakeholders to conduct meta-assessments and outlines the importance of validating meta-assessment uses at the program, institutional, and national levels

Basic Conditioning Factors' Influences on Adolescents' Healthy Behaviors, Self-Efficacy, and Self-Care

This article reports a secondary statistical analysis of data from a study investigating the relationships among health-promoting self-care behaviors, self-care self-efficacy, and self-care agency in an adolescent population (Callaghan, 2005). The purpose of this study was to identify the influences of selected basic conditioning factors on the practice of healthy behaviors, self-efficacy beliefs, and ability for self-care in 256 adolescents. The research instruments used to collect data for this study include: Health-Promoting Lifestyle Profile II Scale; Self-Rated Abilities for Health Practices Scale; Exercise of Self-Care Agency Scale; demographic questionnaire assessing basic conditioning factors. The results of this analysis identified significant relationships between the following basic conditioning factors and adolescents' practice of healthy behaviors, self-efficacy of those behaviors, and self-care abilities: support system, adequate income, adequate living conditions, gender, routine practice of religion, and reported medical problems/disabilities. These findings can give adolescent health nurses direction in developing interventions that promote the self-care and health in this specific population

Testing and comparing two self-care-related instruments among older Chinese adults

Objectives The study aimed to test and compare the reliability and validity, including sensitivity and specificity of the two self-care-related instruments, the Self-care Ability Scale for the Elderly (SASE), and the Appraisal of Self-care Agency Scale-Revised (ASAS-R), among older adults in the Chinese context. Methods A cross-sectional design was used to conduct this study. The sample consisted of 1152 older adults. Data were collected by a questionnaire including the Chinese version of SASE (SASE-CHI), the Chinese version of ASAS-R (ASAS-R-CHI) and the Exercise of Self-Care Agency scale (ESCA). Homogeneity and stability, content, construct and concurrent validity, and sensitivity and specificity were assessed. Results The Cronbach's alpha (α) of SASE-CHI was 0.89, the item-to-total correlations ranged from r = 0.15 to r = 0.81, and the test-retest correlation coefficient (intra-class correlation coefficient, ICC) was 0.99 (95% CI, 0.99±1.00; P<0.001). The Cronbach's α of ASAS-R-CHI was 0.78, the item-to-total correlations ranged from r = 0.20 to r = 0.65, and the test-retest ICC was 0.95 (95% CI, 0.92±0.96; P<0.001). The content validity index (CVI) of SASE-CHI and ASAS-R-CHI was 0.96 and 0.97, respectively. The findings of exploratory and confirmatory factor analyses (EFA and CFA) confirmed a good construct validity of SASE-CHI and ASAS-R-CHI. The Pearson's rank correlation coefficients, as a measure of concurrent validity, between total score of SASE-CHI and ESCA and ASAS-R-CHI and ESCA were assessed to 0.65 (P<0.001) and 0.62 (P<0.001), respectively. Regarding ESCA as the criterion, the area under the receiver operator characteristic (ROC) curve for the cut-point of SASE-CHI and ASAS-R-CHI were 0.93 (95% CI, 0.91±0.94) and 0.83 (95% CI, 0.80±0.86), respectively. Conclusion There is no significant difference between the two instruments. Each has its own characteristics, but SASE-CHI is more suitable for older adults. The key point is that the users can choose the most appropriate scale according to the specific situation.publishedVersionNivå

Structured Proposal for Rehabilitation Nursing (RN) Care Intervention: Sensitive Gains to RN Care for the Person with Self-care Deficit and in the Surgical Process

Surgical needs have been growing in Portugal due to the aging population, the increasing number of people with acute and chronic disease with consequent acquisition of deficiencies and restrictions, being verified dependence on self-care of the people in surgical process. The purpose of rehabilitation nursing intervention is to enable the person to perform his/her self-care and demonstrate the sensitive results to rehabilitation nursing care, allowing the quality of care provided to be proven. Objective. To evaluate the functionality of the person in the surgical process and the gains gained in the rehabilitation nursing care verified after the implementation of a structured proposal of intervention of nursing care of Rehabilitation. Methodology. The study is descriptive and exploratory, using the qualitative methodology of Robert Yin (multiple case studies), Lopes’ medium-range theory and the self-care model of Fonseca and Lopes, based on the nursing theory of the self-care of Orem. Results. There was a significant increase in the functionality of the person and the sensitive results to rehabilitation nursing care. Conclusion. The intervention of Rehabilitation Nursing through the application of a structured intervention plan, with the objective of enabling the person and caregiver to achieve maximum functionality and independence, translate into positive sensitive results to nursing care

Integrating nursing theory, practice and research through collaborative research

Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/75657/1/j.1365-2648.1989.tb00912.x.pd

An assessment of opportunities and challenges for public sector involvement in the maternal health voucher program in Uganda

This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.Background: Continued inequities in coverage, low quality of care, and high out-of-pocket expenses for health services threaten attainment of Millennium Development Goals 4 and 5 in many sub-Saharan African countries. Existing health systems largely rely on input-based supply mechanisms that have a poor track record meeting the reproductive health needs of low-income and underserved segments of national populations. As a result, there is increased interest in and experimentation with results-based mechanisms like supply-side performance incentives to providers and demand-side vouchers that place purchasing power in the hands of low-income consumers to improve uptake of facility services and reduce the burden of out-of-pocket expenditures. This paper describes a reproductive health voucher program that contracts private facilities in Uganda and explores the policy and implementation issues associated with expansion of the program to include public sector facilities. Methods: Data presented here describes the results of interviews of six district health officers and four health facility managers purposefully selected from seven districts with the voucher program in southwestern Uganda. Interviews were transcribed and organized thematically, barriers to seeking RH care were identified, and how to address the barriers in a context where voucher coverage is incomplete as well as opportunities and challenges for expanding the program by involving public sector facilities were investigated. Results: The findings show that access to sexual and reproductive health services in southwestern Uganda is constrained by both facility and individual level factors which can be addressed by inclusion of the public facilities in the program. This will widen the geographical reach of facilities for potential clients, effectively addressing distance related barriers to access of health care services. Further, intensifying ongoing health education, continuous monitoring and evaluation, and integrating the voucher program with other services is likely to address some of the barriers. The public sector facilities were also seen as being well positioned to provide voucher services because of their countrywide reach, enhanced infrastructure, and referral networks. The voucher program also has the potential to address public sector constraints such as understaffing and supply shortages.Conclusions: Accrediting public facilities has the potential to increase voucher program coverage by reaching a wider pool of poor mothers, shortening distance to service, strengthening linkages between public and private sectors through public-private partnerships and referral systems as well as ensuring the awareness and buy-in of policy makers, which is crucial for mobilization of resources to support the sustainability of the programs. Specifically, identifying policy champions and consulting with key policy sectors is key to the successful inclusion of the public sector into the voucher program