Methodological quality of systematic reviews of animal studies: a survey of reviews of basic research

BACKGROUND: Systematic reviews can serve as a tool in translation of basic life sciences research from laboratory to human research and healthcare. The extent to which reviews of animal research are systematic and unbiased is not known. METHODS: We searched, without language restrictions, Medline, Embase, bibliographies of known reviews (1996–2004) and contacted experts to identify citations of reviews of basic science literature which, as a minimum, performed search of a publicly available resource. From these we identified reviews of animal studies where laboratory variables were measured or where treatments were administered to live animals to examine their effects, and compared them with reviews of bench studies in which human or animal tissues, cell systems or organ preparations were examined in laboratories to better understand mechanisms of diseases. RESULTS: Systematic reviews of animal studies often lacked methodological features such as specification of a testable hypothesis (9/30, 30%); literature search without language restriction (8/30, 26.6%); assessment of publication bias (5/30, 16.6%), study validity (15/30, 50%) and heterogeneity (10/30, 33.3%); and meta-analysis for quantitative synthesis (12/30, 40%). Compared to reviews of bench studies, they were less prone to bias as they specified the question (96.6% vs. 80%, p = 0.04), searched multiple databases (60% vs. 26.6%, p = 0.01), assessed study quality (50% vs. 20%, p = 0.01), and explored heterogeneity (33.3% vs. 2.2%, p = 0.001) more often. CONCLUSION: There seems to be a gradient of frequency of methodological weaknesses among reviews: Attempted systematic reviews of whole animal research tend to be better than those of bench studies, though compared to systematic reviews of human clinical trials they are apparently poorer. There is a need for rigour when reviewing animal research

Ethical issues in epidemiologic research and public health practice

A rich and growing body of literature has emerged on ethics in epidemiologic research and public health practice. Recent articles have included conceptual frameworks of public health ethics and overviews of historical developments in the field. Several important topics in public health ethics have also been highlighted. Attention to ethical issues can facilitate the effective planning, implementation, and growth of a variety of public health programs and research activities. Public health ethics is consistent with the prevention orientation of public health. Ethical concerns can be anticipated or identified early and effectively addressed through careful analysis and consultation

Is exposure to formaldehyde in air causally associated with leukemia?—A hypothesis-based weight-of-evidence analysis

Recent scientific debate has focused on the potential for inhaled formaldehyde to cause lymphohematopoietic cancers, particularly leukemias, in humans. The concern stems from certain epidemiology studies reporting an association, although particulars of endpoints and dosimetry are inconsistent across studies and several other studies show no such effects. Animal studies generally report neither hematotoxicity nor leukemia associated with formaldehyde inhalation, and hematotoxicity studies in humans are inconsistent. Formaldehyde's reactivity has been thought to preclude systemic exposure following inhalation, and its apparent inability to reach and affect the target tissues attacked by known leukemogens has, heretofore, led to skepticism regarding its potential to cause human lymphohematopoietic cancers. Recently, however, potential modes of action for formaldehyde leukemogenesis have been hypothesized, and it has been suggested that formaldehyde be identified as a known human leukemogen. In this article, we apply our hypothesis-based weight-of-evidence (HBWoE) approach to evaluate the large body of evidence regarding formaldehyde and leukemogenesis, attending to how human, animal, and mode-of-action results inform one another. We trace the logic of inference within and across all studies, and articulate how one could account for the suite of available observations under the various proposed hypotheses. Upon comparison of alternative proposals regarding what causal processes may have led to the array of observations as we see them, we conclude that the case fora causal association is weak and strains biological plausibility. Instead, apparent association between formaldehyde inhalation and leukemia in some human studies is better interpreted as due to chance or confounding