Automatically detecting open academic review praise and criticism

This is an accepted manuscript of an article published by Emerald in Online Information Review on 15 June 2020. The accepted version of the publication may differ from the final published version, accessible at https://doi.org/10.1108/OIR-11-2019-0347.Purpose: Peer reviewer evaluations of academic papers are known to be variable in content and overall judgements but are important academic publishing safeguards. This article introduces a sentiment analysis program, PeerJudge, to detect praise and criticism in peer evaluations. It is designed to support editorial management decisions and reviewers in the scholarly publishing process and for grant funding decision workflows. The initial version of PeerJudge is tailored for reviews from F1000Research’s open peer review publishing platform. Design/methodology/approach: PeerJudge uses a lexical sentiment analysis approach with a human-coded initial sentiment lexicon and machine learning adjustments and additions. It was built with an F1000Research development corpus and evaluated on a different F1000Research test corpus using reviewer ratings. Findings: PeerJudge can predict F1000Research judgements from negative evaluations in reviewers’ comments more accurately than baseline approaches, although not from positive reviewer comments, which seem to be largely unrelated to reviewer decisions. Within the F1000Research mode of post-publication peer review, the absence of any detected negative comments is a reliable indicator that an article will be ‘approved’, but the presence of moderately negative comments could lead to either an approved or approved with reservations decision. Originality/value: PeerJudge is the first transparent AI approach to peer review sentiment detection. It may be used to identify anomalous reviews with text potentially not matching judgements for individual checks or systematic bias assessments

Comparing knowledge, accessibility, and use of evidence-based chronic disease prevention processes across four countries

<p>Background: Evidence-based chronic disease prevention (EBCDP) effectively reduces incidence rates of many chronic diseases, but contextual factors influence the implementation of EBCDP worldwide. This study aims to examine the following contextual factors across four countries: knowledge, access, and use of chronic disease prevention processes.</p><p>Methods: In this cross-sectional study, public health practitioners (N = 400) from Australia (n = 121), Brazil (n = 76), China (n = 102), and the United States (n = 101) completed a 26-question survey on EBCDP. One-way ANOVA and Pearson's Chi-Square tests were used to assess differences in contextual factors of interest by country.</p><p>Results: Practitioners in China reported less knowledge of EBCDP processes (p < 0.001) and less use of repositories of evidence-based interventions, than those from other countries (p < 0.001). Academic journals were the most frequently used method for accessing information about evidence-based interventions across countries. When selecting interventions, Brazilian and Chinese practitioners were more likely to consider implementation ease while the Australian and United States practitioners were more likely to consider effectiveness (p < 0.001).</p><p>Conclusions: These findings can help inform and improve within and across country strategies for implementing EBCDP interventions.</p

The Routledge handbook of vocabulary studies: A study in micro-bibliometrics

This paper reports a bibliometric analysis of two small data sets: a set of 34 papers that make up The Routledge handbook of vocabulary studies (Webb, 2020) and a set of papers dealing with second language (L2) vocabulary research taken from a single journal Frontiers in Psychology. Bibliometric maps based on author co-citations in these two data sets are presented and compared. Although the two data sets are comparable in terms of size, they appear to be very divergent. In particular, the significant sources identified in The Handbook map seem to play a relatively minor role in the Frontiers map. The obvious conclusion is that The Handbook is not as representative of L2 vocabulary research as its title might lead us to believe. The paper argues that micro-bibliometric studies like this one can sometimes highlight features that are lost in the more traditional large-scale bibliometric approach

Editorial: Research reproducibility and preventing fraud.

SCOPUS: ed.jinfo:eu-repo/semantics/publishe

Audience and Content Areas of Online Software Engineering Education and Training: A Systematic Review

Online courses and instruction are a popular and rapidly expanding medium for learning. However, no holistic summary exists which classifies who or what is being taught and how online courses are being researched in the field of software engineering education and training (SEET). More important, prior research does not cover what gaps exist in the literature: which areas of SEET being ignored altogether in research. This paper reports the results of a systematic review of the existing literature for online SEET and provides analysis of the audiences and content areas being researched. Grounded in established guidelines for systematic reviews in software engineering, the studies that are identified are then coded using three standards for software engineering education content areas. As a result of the systematic review, more than 9000 search results were analyzed. Inclusion and exclusion of studies in predetermined stages resulted in more than 30 studies being coded for audience and/or software engineering content areas. The result is a comprehensive picture of the current state of research in online SEET and an identification of the gaps to be addressed

Hubungan Depresi dan Demensia pada Pasien Lanjut Usia dengan Hipertensi Primer

Latar Belakang Hipertensi mempengaruhi seluruh sistem aliran darah, termasuk pembuluh darah pada otak. Jika pembuluh darah otak ini terganggu, risiko terjadinya gangguan fungsi kognitif otak meningkat. Gangguan kognisi pada usia lanjut, khususnya demensia dapat muncul karena depresi. Hubungan dari depresi dan demensia pada usia lanjut dengan hipertensi sangat kompleks. Usia lanjut dengan hipertensi mungkin dapat menderita demensia tanpa mengalami depresi. Tujuan Mengetahui hubungan antara depresi dan demensia pada lanjut usia dengan hipertensi ( hipertensi + depresi dan hipertensi tanpa depresi ). Metode Penelitian observasional dengan desain penelitian cross-sectional selama bulan Mei – Juni 2014 di poli rawat jalan penyakit dalam Rumah Sakit Tentara Semarang. Depresi dinilai dengan skala depresi geriatri ( SDG ), dan demensia dinilai dengan skor Mini Mental StateExamination ( MMSE ). Hasil Penelitian dilakukan terhadap 50 pasien lanjut usia hipertensi. Terdapat sedikit lanjut usia hipertensi yang menderita depresi ( 28 % ) dan sedikit yang menderita demensia (12%). Tidak ada perbedaan gangguan kognitif ( demensia ) pada lanjut usia hipertensi antara kelompok hipertensi + depresi dan hipertensi tanpa depresi (p=0,331). Korelasi antara depresi dan demensia pada lanjut usia dengan hipertensi sangat lemah dan tidak signifikan ( r = 0,033 dan p = 0,205 ) dan rasio prevalensi demensia pada lanjut usia dengan hipertensi yang mengalami depresi adalah RP = 2,571dengan interval kepercayaan 95 % antara 0,527 – 17,087. Kesimpulan Adanya depresi pada Lanjut usia tidak bermakna sebagai hal yang mempengaruhi untuk timbulnya demensia ( pseudodemensia ). Kata Kunci : Depresi, Demensia, Lanjut Usia, Hipertensi Primer, MMSE, SDG

Does the gender composition of scientific committees matter?

We analyze how a larger presence of female evaluators affects committee decision-making using information on 100,000 applications to associate and full professorships in Italy and Spain. These applications were assessed by 8,000 randomly selected evaluators. A larger number of women in evaluation committees does not increase either the quantity or the quality of female candidates who qualify. Information from individual voting reports suggests that female evaluators are not significantly more favorable toward female candidates. At the same time, male evaluators become less favorable toward female candidates as soon as a female evaluator joins the committee

Issues and perspectives in meditation research: in search for a definition

Despite the growing interest in the neurobiological correlates of meditation, most research has omitted to take into account the underlying philosophical aspects of meditation and its wider implications. This, in turn, is reflected in issues surrounding definition, study design, and outcomes. Here, I highlight the often ignored but important aspect of definition in the existing scholarship on neuroscience and meditation practice. For a satisfactory account of a neuroscience of meditation, we must aim to retrieve an operational definition that is inclusive of a traditional ontological description as well as the modern neurocognitive account of the phenomena. Moving beyond examining the effects of meditation practice, to take a potential step forward in the direction to establish how meditation works, it becomes crucial to appraise the philosophical positions that underlie the phenomenology of meditation in the originating traditions. This endeavor may challenge our intuitions and concepts in either directions, but issues pertaining to definition, design, and validity of response measures are extremely important for the evolution of the field and will provide a much-needed context and framework for meditation based interventions