The reporting of statistics in medical educational studies: an observational study

<p>Abstract</p> <p>Background</p> <p>There is confusion in the medical literature as to whether statistics should be reported in survey studies that query an entire population, as is often done in educational studies. Our objective was to determine how often statistical tests have been reported in such articles in two prominent journals that publish these types of studies.</p> <p>Methods</p> <p>For this observational study, we used electronic searching to identify all survey studies published in <it>Academic Medicine </it>and the <it>Journal of General Internal Medicine </it>in which an entire population was studied. We tallied whether inferential statistics were used and whether p-values were reported.</p> <p>Results</p> <p>Eighty-four articles were found: 62 in <it>Academic Medicine </it>and 22 in the <it>Journal of General Internal Medicine</it>. Overall, 38 (45%) of the articles reported or stated that they calculated statistics: 35% in <it>Academic Medicine </it>and 73% in the <it>Journal of General Internal Medicine</it>.</p> <p>Conclusion</p> <p>Educational enumeration surveys frequently report statistical tests. Until a better case can be made for doing so, a simple rule can be proffered to researchers. When studying an entire population (e.g., all program directors, all deans, and all medical schools) for factual information, do not perform statistical tests. Reporting percentages is sufficient and proper.</p

Healthcare Reform and the Next Generation: United States Medical Student Attitudes toward the Patient Protection and Affordable Care Act

CONTEXT: Over one year after passage of the Patient Protection and Affordable Care Act (PPACA), legislators, healthcare experts, physicians, and the general public continue to debate the implications of the law and its repeal. The PPACA will have a significant impact on future physicians, yet medical student perspectives on the legislation have not been well documented. OBJECTIVE: To evaluate medical students' understanding of and attitudes toward healthcare reform and the PPACA including issues of quality, access and cost. DESIGN, SETTING, AND PARTICIPANTS: An anonymous electronic survey was sent to medical students at 10 medical schools (total of 6982 students) between October-December 2010, with 1232 students responding and a response rate of 18%. MAIN OUTCOME MEASURES: Medical students' views and attitudes regarding the PPACA and related topics, measured with Likert scale and open response items. RESULTS: Of medical students surveyed, 94.8% agreed that the existing United States healthcare system needs to be reformed, 31.4% believed the PPACA will improve healthcare quality, while 20.9% disagreed and almost half (47.7%) were unsure if quality will be improved. Two thirds (67.6%) believed that the PPACA will increase access, 6.5% disagreed and the remaining 25.9% were unsure. With regard to containing healthcare costs, 45.4% of participants indicated that they are unsure if the provisions of the PPACA will do so. Overall, 80.1% of respondents indicated that they support the PPACA, and 78.3% also indicated that they did not feel that reform efforts had gone far enough. A majority of respondents (58.8%) opposed repeal of the PPACA, while 15.0% supported repeal, and 26.1% were undecided. CONCLUSION: The overwhelming majority of medical students recognized healthcare reform is needed and expressed support for the PPACA but echoed concerns about whether it will address issues of quality or cost containment

The imPaCT study: a randomised controlled trial to evaluate a hospital palliative care team

A randomised controlled trial was undertaken to assess the effectiveness of a hospital Palliative Care Team (PCT) on physical symptoms and health-related quality of life (HRQoL); patient, family carer and primary care professional reported satisfaction with care; and health service resource use. The full package of advice and support provided by a multidisciplinary specialist PCT (‘full-PCT’) was compared with limited telephone advice (‘telephone-PCT’, the control group) in the setting of a teaching hospital trust in the SW of England. The trial recruited 261 out of 684 new inpatient referrals; 175 were allocated to ‘full-PCT’, 86 to ‘telephone-PCT’ (2 : 1 randomisation); with 191 (73%) being assessed at 1 week. There were highly significant improvements in symptoms, HRQoL, mood and ‘emotional bother’ in ‘full-PCT’ at 1 week, maintained over the 4-week follow-up. A smaller effect was seen in ‘telephone-PCT’; there were no significant differences between the groups. Satisfaction with care in both groups was high and there was no significant difference between them. These data reflect a high standard of care of patients dying of cancer and other chronic diseases in an acute hospital environment, but do not demonstrate a difference between the two models of service delivery of specialist palliative care

Teaching appropriate interactions with pharmaceutical company representatives: The impact of an innovative workshop on student attitudes

BACKGROUND: Pharmaceutical company representatives (PCRs) influence the prescribing habits and professional behaviour of physicians. However, the skills for interacting with PCRs are not taught in the traditional medical school curriculum. We examined whether an innovative, mandatory workshop for third year medical students had immediate effects on knowledge and attitudes regarding interactions with PCRs. METHODS: Surveys issued before and after the workshop intervention solicited opinions (five point Likert scales) from third year students (n = 75) about the degree of bias in PCR information, the influence of PCRs on prescribing habits, the acceptability of specific gifts, and the educational value of PCR information for both practicing physicians and students. Two faculty members and one PCR led the workshop, which highlighted typical physician-PCR interactions, the use of samples and gifts, the validity and legal boundaries of PCR information, and associated ethical issues. Role plays with the PCR demonstrated appropriate and inappropriate strategies for interacting with PCRs. RESULTS: The majority of third year students (56%, 42/75) had experienced more than three personal conversations with a PCR about a drug product since starting medical school. Five percent (4/75) claimed no previous personal experience with PCRs. Most students (57.3%, 43/75) were not aware of available guidelines regarding PCR interactions. Twenty-eight percent of students (21/75) thought that none of the named activities/gifts (lunch access, free stethoscope, textbooks, educational CD-ROMS, sporting events) should be restricted, while 24.0% (8/75) thought that students should be restricted only from sporting events. The perceived educational value of PCR information to both practicing physicians and students increased after the workshop intervention from 17.7% to 43.2% (chi square, p = .0001), and 22.1% to 40.5% (p = .0007), respectively. Student perceptions of the degree of bias of PCR information decreased from 84.1% to 72.9% (p = .065), but the perceived degree of influence on prescribing increased (44.2% to 62.1% (p = .02)). CONCLUSIONS: Students have exposure to PCRs early in their medical training. A single workshop intervention may influence student attitudes toward interactions with PCRs. Students were more likely to acknowledge the educational value of PCR interactions and their impact on prescribing after the workshop intervention

Use of complementary/alternative therapies by women with advanced-stage breast cancer

BACKGROUND: This study sought to describe the pattern of complementary/alternative medicine (CAM) use among a group of patients with advanced breast cancer, to examine the main reasons for their CAM use, to identify patient's information sources and their communication pattern with their physicians. METHODS: Face-to-face structured interviews of patients with advanced-stage breast cancer at a comprehensive oncology center. RESULTS: Seventy three percent of patients used CAM; relaxation/meditative techniques and herbal medicine were the most common. The most commonly cited primary reason for CAM use was to boost the immune system, the second, to treat cancer; however these reasons varied depending on specific CAM therapy. Friends or family members and mass media were common primary information source's about CAM. CONCLUSIONS: A high proportion of advanced-stage breast cancer patients used CAM. Discussion with doctors was high for ingested products. Mass media was a prominent source of patient information. Credible sources of CAM information for patients and physicians are needed

Sources and Coverage of Medical News on Front Pages of US Newspapers

Background: Medical news that appears on newspaper front pages is intended to reach a wide audience, but how this type of medical news is prepared and distributed has not been systematically researched. We thus quantified the level of visibility achieved by front-page medical stories in the United States and analyzed their news sources. Methodology: Using the online resource Newseum, we investigated front-page newspaper coverage of four prominent medical stories, and a high-profile non-medical news story as a control, reported in the US in 2007. Two characteristics were quantified by two raters: which newspaper titles carried each target front-page story (interrater agreement, >96%; kappa, >0.92) and the news sources of each target story (interrater agreement, >94%; kappa, >0.91). National rankings of the top 200 US newspapers by audited circulation were used to quantify the extent of coverage as the proportion of the total circulation of ranked newspapers in Newseum. Findings: In total, 1630 front pages were searched. Each medical story appeared on the front pages of 85 to 117 (67.5%-78.7%) ranked newspaper titles that had a cumulative daily circulation of 23.1 to 33.4 million, or 61.8% to 88.4% of all newspapers. In contrast, the non-medical story achieved front-page coverage in 152 (99.3%) newspaper titles with a total circulation of 41.0 million, or 99.8% of all newspapers. Front-page medical stories varied in their sources, but the Washington Post, Los Angeles Times, New York Times and the Associated Press together supplied 61.7% of the total coverage of target front-page medical stories. Conclusion: Front-page coverage of medical news from different sources is more accurately revealed by analysis of circulation counts rather than of newspaper titles. Journals wishing to widen knowledge of research news and organizations with important health announcements should target at least the four dominant media organizations identified in this study

Accuracy of drug advertisements in medical journals under new law regulating the marketing of pharmaceutical products in Switzerland

<p>Abstract</p> <p>Background</p> <p>New legal regulations for the marketing of pharmaceutical products were introduced in 2002 in Switzerland. We investigated whether claims in drug advertisements citing published scientific studies were justified by these studies after the introduction of these new regulations.</p> <p>Methods</p> <p>In this cross-sectional study, two independent reviewers screened all issues of six major Swiss medical journals published in the year 2005 to identify all drug advertisements for analgesic, gastrointestinal and psychopharmacologic drugs and evaluated all drug advertisements referring to at least one publication. The pharmaceutical claim was rated as being supported, being based on a potentially biased study or not to be supported by the cited study according to pre-specified criteria. We also explored factors likely to be associated with supported advertisement claims.</p> <p>Results</p> <p>Of 2068 advertisements 577 (28%) promoted analgesic, psychopharmacologic or gastrointestinal drugs. Among them were 323 (56%) advertisements citing at least one reference. After excluding multiple publications of the same drug advertisement and advertisements with non-informative references, there remained 29 unique advertisements with at least one reference to a scientific study. These 29 advertisements contained 78 distinct pairs of claims of analgesic, gastrointestinal and psychopharmacologic drugs and referenced studies. Thirty-seven (47%) claims were supported, 16 (21%) claims were not supported by the corresponding reference, and 25 (32%) claims were based on potentially biased evidence, with no relevant differences between drug groups. Studies with conflict of interest and studies stating industry funding were more likely to support the corresponding claim (RR 1.52, 95% CI 1.07–2.17 and RR 1.50, 95% CI 0.98–2.28) than studies without identified conflict of interest and studies without information on type of funding.</p> <p>Conclusion</p> <p>Following the introduction of new regulations for drug advertisement in Switzerland, 53% of all assessed pharmaceutical claims published in major medical journals are not supported by the cited referenced studies or based on potentially biased study information. In light of the discrepancy between the new legislation and the endorsement of these regulations, physicians should not trust drug advertisement claims even when they seem to refer to scientific studies.</p

CMV quantitative PCR in the diagnosis of CMV disease in patients with HIV-infection – a retrospective autopsy based study

Background Patients with advanced HIV infection at the time of diagnosis and patients not responding to antiretroviral therapy are at risk of cytomegalovirus (CMV) disease. Earlier studies of patients with HIV infection have demonstrated that the diagnosis is often first made post-mortem. In recent years new molecular biological tests have become available for diagnosis of CMV disease. Although clinical evaluation of tests for diagnosis of CMV disease in HIV-infected individuals is suboptimal without autopsy, no results from such studies have been published. The aim of this study was to explore the diagnostic utility of CMV quantitative polymerase chain reaction (PCR) in plasma from HIV and CMV seropositive patients who died during the period 1991–2002 and in whom autopsy was performed. Methods Autopsy was performed in all cases, as part of routine evaluation of HIV-infected cases followed at Ullevaal University Hospital. Of 125 patients included, 53 had CMV disease, 37 of whom were first diagnosed at autopsy. CMV disease was diagnosed either by ophthalmoscopic findings typical of CMV retinitis, biopsy or autopsy. One or two plasma samples taken prior to the first diagnosis of CMV disease (alive or at autopsy) or death without CMV disease were analysed by CMV quantitative PCR. Sensitivity, specificity, positive and negative predictive values were calculated for different CMV viral load cut-offs and according to detection of viraemia in one versus two samples. Results Twenty-seven of 53 patients with CMV disease (51%) and 10 of 72 patients without CMV disease (14%) had detectable viraemia in at least one sample. Sensitivity and negative predictive value (NPV) of the test, maximised with a cut-off at the test's limit of detection of CMV viraemia (400 copies/mL), were 47% and 70%, respectively. With cut-off at 10 000 copies/mL, specificity and positive predictive value (PPV) were 100%. With a requirement for CMV viraemia in two samples, specificity and PPV were 100% in patients with CMV viraemia above the limit of detection. Conclusion Our results indicate that quantitative CMV PCR is best used to rule in, rather than to rule out CMV disease in HIV-infected individuals at high risk