Analysis of single comments left for bioRxiv preprints till September 2019

While early commenting on studies is seen as one of the advantages of preprints, the type of such comments, and the people who post them, have not been systematically explored. We analysed comments posted between 21 May 2015 and 9 September 2019 for 1983 bioRxiv preprints that received only one comment on the bioRxiv website. The comment types were classified by three coders independently, with all differences resolved by consensus. Our analysis showed that 69% of comments were posted by non-authors (N = 1366), and 31% by the preprints’ authors themselves (N = 617). Twelve percent of non-author comments (N = 168) were full review reports traditionally found during journal review, while the rest most commonly contained praises (N = 577, 42%), suggestions (N = 399, 29%), or criticisms (N = 226, 17%). Authors’ comments most commonly contained publication status updates (N = 354, 57%), additional study information (N = 158, 26%), or solicited feedback for the preprints (N = 65, 11%). Our results indicate that comments posted for bioRxiv preprints may have potential benefits for both the public and the scholarly community. Further research is needed to measure the direct impact of these comments on comments made by journal peer reviewers, subsequent preprint versions or journal publications

Impact of deliberate practice on evidence-based medicine attitudes and behaviours of health care professionals

Introduction Although evidence-based medicine (EBM) teaching activities may improve short-term EBM knowledge and skills, they have little long-term impact on learners' EBM attitudes and behaviour. This study examined the effects of learning EBM through stand-alone workshops or various forms of deliberate EBM practice. Methods We assessed EBM attitudes and behaviour with the evidence based practice inventory questionnaire, in paediatric health care professionals who had only participated in a stand-alone EBM workshop (controls), participants with a completed PhD in clinical research (PhDs), those who had completed part of their paediatric residency at a department (Isala Hospital) which systematically implemented EBM in its clinical and teaching activities (former Isala residents), and a reference group of paediatric professionals currently employed at Isala's paediatric department (current Isala participants). Results Compared to controls (n = 16), current Isala participants (n = 13) reported more positive EBM attitudes (p < 0.01), gave more priority to using EBM in decision making (p = 0.001) and reported more EBM behaviour (p = 0.007). PhDs (n = 20) gave more priority to using EBM in medical decision making (p < 0.001) and reported more EBM behaviour than controls (p = 0.016). Discussion Health care professionals exposed to deliberate practice of EBM, either in the daily routines of their department or by completing a PhD in clinical research, view EBM as more useful and are more likely to use it in decision making than their peers who only followed a standard EBM workshop. These findings support the use of deliberate practice as the basis for postgraduate EBM educational activities

Teaching Evidence-Based Literature Retrieval to Medical Students and Residents

With the growth on the emphasis on the importance of Evidence-Based Practice in the 1980s and 90s also came the need for clinicians to have a better understanding of how to find information about best-evidence outcomes in the medical literature. Academic medical librarians responded to this need by creating educational opportunities designed to instruct clinicians in how to most effectively use literature databases to find “the best-evidence needles” in what is often a very-large haystack. Many of these educational opportunities have been directed specifically towards medical students and residents with the goal of providing them with tools that will assist them in using best-evidence in the medical literature as they begin their clinical careers. This poster will demonstrate examples of educational programs focusing upon evidence-based literature retrieval that are in place at many NEGEA affiliated medical school libraries. Poster presented at the Northeast Group on Educational Affairs 2008 Annual Educational Retreat, April 12, 2008, University of Vermont College of Medicine, Burlington, VT

When will I get my paper back? A replication study of publication timelines for health professions education research.

INTRODUCTION: Biomedical researchers have lamented the lengthy timelines from manuscript submission to publication and highlighted potential detrimental effects on scientific progress and scientists\u27 careers. In 2015, Himmelstein identified the mean time from manuscript submission to acceptance in biomedicine as approximately 100 days. The length of publication timelines in health professions education (HPE) is currently unknown. METHODS: This study replicates Himmelstein\u27s work with a sample of 14 HPE journals published between 2008-2018. Using PubMed, 19,182 article citations were retrieved. Open metadata for each were downloaded, including the date the article was received by the journal, date the authors resubmitted revisions, date the journal accepted the article, and date of entry into PubMed. Journals without publication history metadata were excluded. RESULTS: Publication history data were available for 55% (n = 8) of the journals sampled. The publication histories of 4,735 (25%) articles were analyzed. Mean time from: (1) author submission to journal acceptance was 180.93 days (SD = 103.89), (2) author submission to posting on PubMed was 263.55 days (SD = 157.61), and (3) journal acceptance to posting on PubMed was 83.15 days (SD = 135.72). DISCUSSION: This study presents publication metadata for journals that openly provide it-a first step towards understanding publication timelines in HPE. Findings confirm the replicability of the original study, and the limited data suggest that, in comparison to biomedical scientists broadly, medical educators may experience longer wait times for article acceptance and publication. Reasons for these delays are currently unknown and deserve further study; such work would be facilitated by increased public access to journal metadata

Medical education departments: a study of four medical schools in Sub-Saharan Africa

Background Many African countries are investing in medical education to address significant health care workforce shortages and ultimately improve health care. Increasingly, training institutions are establishing medical education departments as part of this investment. This article describes the status of four such departments at sub-Saharan African medical schools supported by the Medical Education Partnership Initiative (MEPI). This article will provide information about the role of these institutional structures in fostering the development of medical education within the African context and highlight factors that enable or constrain their establishment and sustainability. Methods In-depth interviews were conducted with the heads or directors of the four medical education departments using a structured interview protocol developed by the study group. An inductive approach to analysis of the interview transcripts was adopted as the texts were subjected to thematic content analysis. Results Medical education departments, also known as units or centers, were established for a range of reasons including: to support curriculum review, to provide faculty development in Health Professions Education, and to improve scholarship in learning and teaching. The reporting structures of these departments differ in terms of composition and staff numbers. Though the functions of departments do vary, all focus on improving the quality of health professions education. External and internal funding, where available, as well as educational innovations were key enablers for these departments. Challenges included establishing and maintaining the legitimacy of the department, staffing the departments with qualified individuals, and navigating dependence on external funding. All departments seek to expand the scope of their services by offering higher degrees in HPE, providing assistance to other universities in this domain, and developing and maintaining a medical education research agenda. Conclusions The establishment of medical education departments in Sub-Saharan Africa is a strategy medical schools can employ to improve the quality of health professions education. The creation of communities of practice such as has been done by the MEPI project is a good way to expand the network of medical education departments in the region enabling the sharing of lessons learned across the continent

Making Headlines: An Analysis of US Government-Funded Cancer Research Mentioned In Online Media

Objective To characterise how online media coverage of journal articles on cancer funded by the US government varies by cancer type and stage of the cancer control continuum and to compare the disease prevalence rates with the amount of funded research published for each cancer type and with the amount of media attention each receives. Design A cross-sectional study. Setting The United States. Participants The subject of analysis was 11 436 journal articles on cancer funded by the US government published in 2016. These articles were identified via PubMed and characterised as receiving online media attention based on data provided by Altmetric. Results 16.8% (n=1925) of articles published on US government-funded research were covered in the media. Published journal articles addressed all common cancers. Frequency of journal articles differed substantially across the common cancers, with breast cancer (n=1284), lung cancer (n=630) and prostate cancer (n=586) being the subject of the most journal articles. Roughly one-fifth to one-fourth of journal articles within each cancer category received online media attention. Media mentions were disproportionate to actual burden of each cancer type (ie, incidence and mortality), with breast cancer articles receiving the most media mentions. Scientific articles also covered the stages of the cancer continuum to varying degrees. Across the 13 most common cancer types, 4.4% (n=206) of articles focused on prevention and control, 11.7% (n=550) on diagnosis and 10.7% (n=502) on therapy. Conclusions Findings revealed a mismatch between prevalent cancers and cancers highlighted in online media. Further, journal articles on cancer control and prevention received less media attention than other cancer continuum stages. Media mentions were not proportional to actual public cancer burden nor volume of scientific publications in each cancer category. Results highlight a need for continued research on the role of media, especially online media, in research dissemination. Objective To characterise how online media coverage of journal articles on cancer funded by the US government varies by cancer type and stage of the cancer control continuum and to compare the disease prevalence rates with the amount of funded research published for each cancer type and with the amount of media attention each receives. Design A cross-sectional study. Setting The United States. Participants The subject of analysis was 11 436 journal articles on cancer funded by the US government published in 2016. These articles were identified via PubMed and characterised as receiving online media attention based on data provided by Altmetric. Results 16.8% (n=1925) of articles published on US government-funded research were covered in the media. Published journal articles addressed all common cancers. Frequency of journal articles differed substantially across the common cancers, with breast cancer (n=1284), lung cancer (n=630) and prostate cancer (n=586) being the subject of the most journal articles. Roughly one-fifth to one-fourth of journal articles within each cancer category received online media attention. Media mentions were disproportionate to actual burden of each cancer type (ie, incidence and mortality), with breast cancer articles receiving the most media mentions. Scientific articles also covered the stages of the cancer continuum to varying degrees. Across the 13 most common cancer types, 4.4% (n=206) of articles focused on prevention and control, 11.7% (n=550) on diagnosis and 10.7% (n=502) on therapy. Conclusions Findings revealed a mismatch between prevalent cancers and cancers highlighted in online media. Further, journal articles on cancer control and prevention received less media attention than other cancer continuum stages. Media mentions were not proportional to actual public cancer burden nor volume of scientific publications in each cancer category. Results highlight a need for continued research on the role of media, especially online media, in research dissemination. &nbsp