The importance of meta-analysis and systematic review: How research legacy can be maximized through adequate reporting

Systematic reviews are widely accepted as a ‘gold standard’ in evidence synthesis and the meta-analysis within provides a powerful means of looking across datasets. Neal Haddaway argues that while certain fields have embraced these reviews, there is a great opportunity for their growth in other fields. One way to encourage secondary synthesis is for researchers to ensure their data is reported in sufficient detail. Thinking carefully about legacy and future use of data is not only sensible, but should be an obligation

8 common problems with literature reviews and how to fix them

Literature reviews are an integral part of the process and communication of scientific research. Whilst systematic reviews have become regarded as the highest standard of evidence synthesis, many literature reviews fall short of these standards and may end up presenting biased or incorrect conclusions. In this post, Neal Haddaway highlights 8 common problems with literature review methods, provides examples for each and provides practical solutions for ways to mitigate them

Open Synthesis : on the need for evidence synthesis to embrace Open Science

Abstract: The Open Science movement can be broadly summarised as aiming to promote integrity, repeatability and transparency across all aspects of research, from data collection to publication. Systematic reviews and systematic maps aim to provide a reliable synthesis of the evidence on a particular topic, making use of methods that seek to maximise repeatability and comprehensives whilst minimising subjectivity and bias. The central tenet of repeatability is operationalised by transparently reporting methodological activities in detail, such that all actions could be replicated and verified. To date, evidence synthesis has only partially embraced Open Science, typically striving for Open Methodology and Open Access, and occasionally providing sufficient information to be considered to have Open Data for some published reviews. Evidence synthesis communities needs to better embrace Open Science not only to balance knowledge access and increase efficiency, but also to increase reliability, trust and reuse of information collected and synthesised within a review: concepts fundamental to systematic reviews and maps. All aspects of Open Science should be embraced: Open Methodology, Open Data, Open Source and Open Access. In doing so, evidence synthesis can be made more equal, more efficient and more trustworthy. I provide concrete recommendations of how CEE and others can fully embrace Open Synthesis

Which agricultural management interventions are most influential on soil organic carbon (using time series data)?

Background Loss of soil organic carbon (SOC) from agricultural land is identified as one of the major threats to soils, as it influences both fertility and the production of ecosystem services from agriculture. Losses of SOC across regions are often determined by monitoring in different land use systems. Results from agricultural field experiments can reveal increasing SOC stocks after implementation of specific management practices compared to a control, though in time series experiments the relative rate of change is often negative and implying an overall loss. Long-term agricultural field experiments are indispensable for quantifying absolute changes in SOC stocks under different management regimes. Since SOC responses are seldom linear over time, time series data from these experiments are particularly valuable. Methods This systematic review is based on studies reporting time series data collated in a recently completed systematic map on the topic restricted to the warm temperate climate zone and the snow climate zone. These 53 studies were identified and selected systematically according to CEE guidelines. An update of the original search for studies will be repeated using Web of Science and Google Scholar to include newly published academic and grey literature in the time since the original search was performed in September 2013. Studies will be subject to critical appraisal of the internal and external validity, followed by full data extraction (meta-data describing study settings and quantitative study results). Where possible, studies will be included in a quantitative synthesis using time series meta-analytical approaches. The implications of the meta-analytical findings will be discussed in terms of policy, practice and research along with a discussion of the nature of the evidence base

Mapping the predicted and potential impacts of metal mining and its mitigation measures in Arctic and boreal regions using environmental and social impact assessments: a systematic map protocol

Abstract : Background: Since the 1960s, environmental impact assessments (EIAs) and recently, social impact assessments (SIAs), have been conducted during the planning stages of large development projects to identify potential adverse effects and propose mitigation measures to ameliorate these impacts. EIAs and SIAs should outline all possible posi- tive and negative effects of a proposed action or development on ecological and social systems, respectively, includ- ing biodiversity, flora and fauna, abiotic components (such as air quality), human health, security and wellbeing. The work outlined herein aims to generate a list of all possible direct and indirect effects of metal mining (including gold, iron, copper, nickel, zinc, silver, molybdenum and lead) along with the impacts of mitigation measures proposed, that are mentioned in EIAs and SIAs in Arctic and boreal regions of the following countries/regions: Canada, Alaska (USA), Greenland, the Faroe Islands, Iceland, Norway, Sweden, Finland and Russia. Methods: We will conduct searches for environmental and social impact assessments in Swedish and English, and until theoretical saturation is reached (i.e. no new action-impact pathways are identified). We will perform searches of specialist websites (e.g. public repositories of environmental and social impact assessments) and Google Scholar. We will also contact relevant stakeholders (that have been identified in the wider 3MK project https://osf.io/cvh3u/) and make a call for additional information. Eligibility screening will be conducted at two levels: title and full text. Meta-data will be extracted from eligible studies including type of mining activity, location of mine, type of impacts, and planned mitigation measures. Findings will be presented narratively, in a searchable relational database and in an evidence altas (a cartographic map). We will produce a framework of different mining impacts and related mitiga- tion measures from practitioners’ knowledge reflected in EIAs and SIAs. This framework will further form the basis of a multiple knowledge base on mining impacts and mitigation measures generated from different knowledges includ- ing scientific, Indigenous, and practitioners’ knowledge

ROSES RepOrting standards for Systematic Evidence Syntheses: pro forma, flow-diagram and descriptive summary of the plan and conduct of environmental systematic reviews and systematic maps.

Reliable synthesis of the various rapidly expanding bodies of evidence is vital for the process of evidence-informed decision-making in environmental policy, practice and research. With the rise of evidence-base medicine and increasing numbers of published systematic reviews, criteria for assessing the quality of reporting have been developed. First QUOROM (Lancet 354:1896–1900, 1999) and then PRISMA (Ann Intern Med 151:264, 2009) were developed as reporting guidelines and standards to ensure medical meta-analyses and systematic reviews are reported to a high level of detail. PRISMA is now widely used by a range of journals as a pre-submission checklist. However, due to its development for systematic reviews in healthcare, PRISMA has limited applicability for reviews in conservation and environmental management. We highlight 12 key problems with the application of PRISMA to this field, including an overemphasis on meta-analysis and no consideration for other synthesis methods. We introduce ROSES (RepOrting standards for Systematic Evidence Syntheses), a pro forma and flow diagram designed specifically for systematic reviews and systematic maps in the field of conservation and environmental management. We describe how ROSES solves the problems with PRISMA. We outline the key benefits of our approach to designing ROSES, in particular the level of detail and inclusion of rich guidance statements. We also introduce the extraction of meta-data that describe key aspects of the conduct of the review. Collated together, this summary record can help to facilitate rapid review and appraisal of the conduct of a systematic review or map, potentially speeding up the peer-review process. We present the results of initial road testing of ROSES with systematic review experts, and propose a plan for future development of ROSES

Response to “Every ROSE has its thorns”

Abstract: Sharp et al. [1] raise a number of concerns about the development and communication of ROSES (RepOrting standards for Systematic Evidence Syntheses), and we welcome the opportunity to explain some of the underlying thinking behind development of the reporting standards for environmental evidence syntheses

Final report on project SP1210: Lowland peatland systems in England and Wales – evaluating greenhouse gas fluxes and carbon balances

Lowland peatlands represent one of the most carbon-rich ecosystems in the UK. As a result of widespread habitat modification and drainage to support agriculture and peat extraction, they have been converted from natural carbon sinks into major carbon sources, and are now amongst the largest sources of greenhouse gas (GHG) emissions from the UK land-use sector. Despite this, they have previously received relatively little policy attention, and measures to reduce GHG emissions either through re-wetting and restoration or improved management of agricultural land remain at a relatively early stage. In part, this has stemmed from a lack of reliable measurements on the carbon and GHG balance of UK lowland peatlands. This project aimed to address this evidence gap via an unprecedented programme of consistent, multi year field measurements at a total of 15 lowland peatland sites in England and Wales, ranging from conservation managed ‘near-natural’ ecosystems to intensively managed agricultural and extraction sites. The use of standardised measurement and data analysis protocols allowed the magnitude of GHG emissions and removals by peatlands to be quantified across this heterogeneous data set, and for controlling factors to be identified. The network of seven flux towers established during the project is believed to be unique on peatlands globally, and has provided new insights into the processes the control GHG fluxes in lowland peatlands. The work undertaken is intended to support the future development and implementation of agricultural management and restoration measures aimed at reducing the contribution of these important ecosystems to UK GHG emissions

Developing searchRxiv: An international transdisciplinary repository for search strategies

https://digitalrepository.unm.edu/hslic-posters-presentations/1088/thumbnail.jp