Caveats for using statistical significance tests in research assessments

This paper raises concerns about the advantages of using statistical significance tests in research assessments as has recently been suggested in the debate about proper normalization procedures for citation indicators. Statistical significance tests are highly controversial and numerous criticisms have been leveled against their use. Based on examples from articles by proponents of the use statistical significance tests in research assessments, we address some of the numerous problems with such tests. The issues specifically discussed are the ritual practice of such tests, their dichotomous application in decision making, the difference between statistical and substantive significance, the implausibility of most null hypotheses, the crucial assumption of randomness, as well as the utility of standard errors and confidence intervals for inferential purposes. We argue that applying statistical significance tests and mechanically adhering to their results is highly problematic and detrimental to critical thinking. We claim that the use of such tests do not provide any advantages in relation to citation indicators, interpretations of them, or the decision making processes based upon them. On the contrary their use may be harmful. Like many other critics, we generally believe that statistical significance tests are over- and misused in the social sciences including scientometrics and we encourage a reform on these matters.Comment: Accepted version for Journal of Informetric

Loop Representations

The loop representation plays an important role in canonical quantum gravity because loop variables allow a natural treatment of the constraints. In these lectures we give an elementary introduction to (i) the relevant history of loops in knot theory and gauge theory, (ii) the loop representation of Maxwell theory, and (iii) the loop representation of canonical quantum gravity. (Based on lectures given at the 117. Heraeus Seminar, Bad Honnef, Sept. 1993)Comment: 38 pages, MPI-Ph/93-9

Estimating relative survival among people registered with cancer in England and Wales

Because routinely collected survival data for cancer patients in England and Wales do not typically specify cause of death, conventional estimates of survival in cancer patients based on such data are a measure of their mortality from all causes rather than their mortality due to cancer. As a result, trends in survival over time are difficult to interpret because changes in overall survival may well reflect changes in the risk of death from other causes, rather than from the cancer of interest. One way of overcoming this problem is to use some form of ‘relative survival’ defined as a measure of survival corrected for the effect of other independent causes of death. Since this concept was first introduced, various methods for calculating relative survival have been proposed and this had led to some confusion as to the most appropriate choice of estimate. This paper aims to provide an introduction to the concept of relative survival and reviews some of the suggested methods of estimation. In addition, a particularly simple, but robust approach, is highlighted based on expected and observed mortality. This method is illustrated using preliminary data from the Office for National Statistics on cancer survival in patients born after 1939 and diagnosed with cancer during 1972–84. The examples presented, although limited to analyses on a small number of selected sites, highlight some encouraging trends in survival in people aged under 35 diagnosed with leukaemia, Hodgkin's disease and testicular cancer during this period. © 1999 Cancer Research Campaig

Cognitive-Behavior Therapy (CBT) for Panic Disorder: Relationship of Anxiety and Depression Comorbidity with Treatment Outcome

Research evaluating the relationship of comorbidity to treatment outcome for panic disorder has produced mixed results. The current study examined the relationship of comorbid depression and anxiety to treatment outcome in a large-scale, multi-site clinical trial for cognitive-behavior therapy (CBT) for panic disorder. Comorbidity was associated with more severe panic disorder symptoms, although comorbid diagnoses were not associated with treatment response. Comorbid generalized anxiety disorder (GAD) and major depressive disorder (MDD) were not associated with differential improvement on a measure of panic disorder severity, although only rates of comorbid GAD were significantly lower at posttreatment. Treatment responders showed greater reductions on measures of anxiety and depressive symptoms. These data suggest that comorbid anxiety and depression are not an impediment to treatment response, and successful treatment of panic disorder is associated with reductions of comorbid anxiety and depressive symptoms. Implications for treatment specificity and conceptual understandings of comorbidity are discussed

Self-aggression in macaques: Five case studies

Spontaneous self-aggressive behaviors were observed in five adult male rhesus monkeys ( Macaca mulatta ) housed at a university facility. All were individually caged, were free of intercurrent disease, and were being utilized in ongoing research studies. The self-aggressive behaviors observed included self-biting, self-clasping, self-slapping, self-rubbing and threatening of body parts. In several cases, wounds were inflicted and medical treatment was required due to the severity of the lesions. A review of the animals' clinical histories revealed an increased level of self-aggressive behavior in four of five monkeys during such stressful or stimulating conditions as movement of the animal to a new cage, movement of animals out of the room or escape of other monkeys from their cages. The frequency with which these behaviors occurred was quantitated experimentally. The results revealed an increased level of self-aggressive behavior in two of these animals during the videotaped sessions in response to aggressive contacts with the investigator. In contrast, one monkey exhibited self-aggressive behavior both clinically and experimentally in the absence of environmental stimuli or human contact. Clinical management of self-aggressive monkeys included housing monkeys only with physically smaller primates, decreasing the level of environmental stimuli, and drug therapy. Haloperidol was used with success in one animal that exhibited severe self-aggressive behavior.Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/41601/1/10329_2006_Article_BF02381460.pd

The Continuous Sample of Working Lives: improving its representativeness

This paper studies the representativeness of the Continuous Sample of Working Lives (CSWL), a set of anonymized microdata containing information on individuals from Spanish Social Security records. We examine several CSWL waves (2005-2013) and show that it is not representative for the population with a pension income. We then develop a methodology to draw a large dataset from the CSWL that is much more representative of the retired population in terms of pension type, gender and age. This procedure also makes it possible for users to choose between goodness of fit and subsample size. In order to illustrate the practical significance of our methodology, the paper also contains an application in which we generate a large subsample distribution from the 2010 CSWL. The results are striking: with a very small reduction in the size of the original CSWL, we significantly reduce errors in estimating pension expenditure for 2010, with a p value greater or equal to 0.999

Theory and description in African Linguistics: Selected papers from the 47th Annual Conference on African Linguistics

The papers in this volume were presented at the 47th Annual Conference on African Linguistics at UC Berkeley in 2016. The papers offer new descriptions of African languages and propose novel theoretical analyses of them. The contributions span topics in phonetics, phonology, syntax, semantics, and pragmatics and reflect the typological and genetic diversity of languages in Africa. Four papers in the volume examine Areal Features and Linguistic Reconstruction in Africa, and were presented at a special workshop on this topic held alongside the general session of ACAL