137,886 research outputs found

    Systematic analysis of agreement between metrics and peer review in the UK REF

    Get PDF
    When performing a national research assessment, some countries rely on citation metrics whereas others, such as the UK, primarily use peer review. In the influential Metric Tide report, a low agreement between metrics and peer review in the UK Research Excellence Framework (REF) was found. However, earlier studies observed much higher agreement between metrics and peer review in the REF and argued in favour of using metrics. This shows that there is considerable ambiguity in the discussion on agreement between metrics and peer review. We provide clarity in this discussion by considering four important points: (1) the level of aggregation of the analysis; (2) the use of either a size-dependent or a size-independent perspective; (3) the suitability of different measures of agreement; and (4) the uncertainty in peer review. In the context of the REF, we argue that agreement between metrics and peer review should be assessed at the institutional level rather than at the publication level. Both a size-dependent and a size-independent perspective are relevant in the REF. The interpretation of correlations may be problematic and as an alternative we therefore use measures of agreement that are based on the absolute or relative differences between metrics and peer review. To get an idea of the uncertainty in peer review, we rely on a model to bootstrap peer review outcomes. We conclude that particularly in Physics, Clinical Medicine, and Public Health, metrics agree quite well with peer review and may offer an alternative to peer review

    Innate talents: reality or myth?

    Get PDF
    Talents that selectively facilitate the acquisition of high levels of skill are said to be present in some children but not others. The evidence for this includes biological correlates of specific abilities, certain rare abilities in autistic savants, and the seemingly spontaneous emergence of exceptional abilities in young children, but there is also contrary evidence indicating an absence of early precursors of high skill levels. An analysis of positive and negative evidence and arguments suggests that differences in early experiences, preferences, opportunities, habits, training, and practice are the real determinants of excellence

    Testing the dimensionality of the quality management construct

    Get PDF
    © 2014 Taylor & Francis. Numerous empirical studies have conceptualised quality management (QM) as either a multidimensional or unidimensional construct. While few prior studies tested some aspects of the assumed dimensional structure of the construct, no study has been found to have tested the construct's dimensionality using alternative factor analysis models. To gain a better insight into dimensional properties of the QM construct, this paper tests its dimensionality using three confirmatory factor analysis models (oblique factor model, higher-order factor model, and one-factor model) on a subset of data collected in a larger study that investigated the effects of QM on competitive advantage using a sample of 288 hotel managers in Egypt. The results of the three tests indicate that the QM construct is multidimensional. While this study contributes to advancing the QM theory and practice, further studies are needed to investigate the dimensional properties of the construct in greater depth. The results of this study may therefore stimulate research in this area and encourage the much needed debate on the dimensionality of the QM construct

    Seizing Opportunity at the Top: How the U.S. Can Reach Every Student With an Excellent Teacher

    Get PDF
    Explains how to provide excellent teachers for every child every year by better identifying excellent teachers, removing policy barriers so they can teach more students for more pay, and catalyzing schools' and districts' will to put them in charge

    Department of Homeland Security Science and Technology Directorate: Developing Technology to Protect America

    Get PDF
    In response to a congressional mandate and in consultation with Department of Homeland Security's (DHS) Science and Technology Directorate (S&T), the National Academy conducted a review of S&T's effectiveness and efficiency in addressing homeland security needs. This review included a particular focus that identified any unnecessary duplication of effort, and opportunity costs arising from an emphasis on homeland security-related research. Under the direction of the National Academy Panel, the study team reviewed a wide variety of documents related to S&T and homeland security-related research in general. The team also conducted interviews with more than 200 individuals, including S&T officials and staff, officials from other DHS component agencies, other federal agencies engaged in homeland security-related research, and experts from outside government in science policy, homeland security-related research and other scientific fields.Key FindingsThe results of this effort indicated that S&T faces a significant challenge in marshaling the resources of multiple federal agencies to work together to develop a homeland security-related strategic plan for all agencies. Yet the importance of this role should not be underestimated. The very process of working across agencies to develop and align the federal homeland security research enterprise around a forward-focused plan is critical to ensuring that future efforts support a common vision and goals, and that the metrics by which to measure national progress, and make changes as needed, are in place
    • …
    corecore