Managers’ perceptions of protected area outcomes in Madagascar highlight the need for species monitoring and knowledge transfer

NB! https://doi.org/10.1111/csp2.6 (right) Wrong doi reported in PDFConsiderable effort has gone into assessing the effectiveness of protected areas (PAs) in preventing biodiversity loss, and PA impacts on local communities. However, little is known about how pressures are being perceived and dealt with by local PA managers and what perceptions managers have of biodiversity trends and human‐induced pressures in the PAs they manage. We surveyed and convened a workshop with PA managers in Madagascar asking about the impacts of PA establishment. The managers reported that PAs have been successful in reducing threats. However, managers lacked specific knowledge of trends in species abundance, reporting the need for more species monitoring and knowledge transfer from scientific researchers. We argue that greater collaboration and exchange of knowledge between researchers, managers, and local communities is necessary to ensure that PA effectiveness research is of practical value and contributes to improved PA outcomes.Considerable effort has gone into assessing the effectiveness of protected areas (PAs) in preventing biodiversity loss, and PA impacts on local communities. However, little is known about how pressures are being perceived and dealt with by local PA managers and what perceptions managers have of biodiversity trends and human‐induced pressures in the PAs they manage. We surveyed and convened a workshop with PA managers in Madagascar asking about the impacts of PA establishment. The managers reported that PAs have been successful in reducing threats. However, managers lacked specific knowledge of trends in species abundance, reporting the need for more species monitoring and knowledge transfer from scientific researchers. We argue that greater collaboration and exchange of knowledge between researchers, managers, and local communities is necessary to ensure that PA effectiveness research is of practical value and contributes to improved PA outcomes.Considerable effort has gone into assessing the effectiveness of protected areas (PAs) in preventing biodiversity loss, and PA impacts on local communities. However, little is known about how pressures are being perceived and dealt with by local PA managers and what perceptions managers have of biodiversity trends and human‐induced pressures in the PAs they manage. We surveyed and convened a workshop with PA managers in Madagascar asking about the impacts of PA establishment. The managers reported that PAs have been successful in reducing threats. However, managers lacked specific knowledge of trends in species abundance, reporting the need for more species monitoring and knowledge transfer from scientific researchers. We argue that greater collaboration and exchange of knowledge between researchers, managers, and local communities is necessary to ensure that PA effectiveness research is of practical value and contributes to improved PA outcomes.Peer reviewe

Better Together: Reliable Application of the Post-9/11 and Post-Iraq US Intelligence Tradecraft Standards Requires Collective Analysis

Background: The events of 9/11 and the October 2002 National Intelligence Estimate on Iraq’s Continuing Programs for Weapons of Mass Destruction precipitated fundamental changes within the United States Intelligence Community. As part of the reform, analytic tradecraft standards were revised and codified into a policy document – Intelligence Community Directive (ICD) 203 – and an analytic ombudsman was appointed in the newly created Office for the Director of National Intelligence to ensure compliance across the intelligence community. In this paper we investigate the untested assumption that the ICD203 criteria can facilitate reliable evaluations of analytic products.Methods: Fifteen independent raters used a rubric based on the ICD203 criteria to assess the quality of reasoning of 64 analytical reports generated in response to hypothetical intelligence problems. We calculated the intra-class correlation coefficients for single and group-aggregated assessments.Results: Despite general training and rater calibration, the reliability of individual assessments was poor. However, aggregate ratings showed good to excellent reliability.Conclusion: Given that real problems will be more difficult and complex than our hypothetical case studies, we advise that groups of at least three raters are required to obtain reliable quality control procedures for intelligence products. Our study sets limits on assessment reliability and provides a basis for further evaluation of the predictive validity of intelligence reports generated in compliance with the tradecraft standards

Better together: reliable application of the post-9/11 and post-Iraq US intelligence tradecraft standards requires collective analysis

Background: The events of 9/11 and the October 2002 National Intelligence Estimate on Iraq's Continuing Programs for Weapons of Mass Destruction precipitated fundamental changes within the US Intelligence Community. As part of the reform, analytic tradecraft standards were revised and codified into a policy document – Intelligence Community Directive (ICD) 203 – and an analytic ombudsman was appointed in the newly created Office for the Director of National Intelligence to ensure compliance across the intelligence community. In this paper we investigate the untested assumption that the ICD203 criteria can facilitate reliable evaluations of analytic products. Method: Fifteen independent raters used a rubric based on the ICD203 criteria to assess the quality of reasoning of 64 analytical reports generated in response to hypothetical intelligence problems. We calculated the intra-class correlation coefficients for single and group-aggregated assessments. Results: Despite general training and rater calibration, the reliability of individual assessments was poor. However, aggregate ratings showed good to excellent reliability. Conclusions: Given that real problems will be more difficult and complex than our hypothetical case studies, we advise that groups of at least three raters are required to obtain reliable quality control procedures for intelligence products. Our study sets limits on assessment reliability and provides a basis for further evaluation of the predictive validity of intelligence reports generated in compliance with the tradecraft standards

Predicting reliability through structured expert elicitation with the repliCATS (Collaborative Assessments for Trustworthy Science) process

As replications of individual studies are resource intensive, techniques for predicting the replicability are required. We introduce the repliCATS (Collaborative Assessments for Trustworthy Science) process, a new method for eliciting expert predictions about the replicability of research. This process is a structured expert elicitation approach based on a modified Delphi technique applied to the evaluation of research claims in social and behavioural sciences. The utility of processes to predict replicability is their capacity to test scientific claims without the costs of full replication. Experimental data supports the validity of this process, with a validation study producing a classification accuracy of 84% and an Area Under the Curve of 0.94, meeting or exceeding the accuracy of other techniques used to predict replicability. The repliCATS process provides other benefits. It is highly scalable, able to be deployed for both rapid assessment of small numbers of claims, and assessment of high volumes of claims over an extended period through an online elicitation platform, having been used to assess 3000 research claims over an 18 month period. It is available to be implemented in a range of ways and we describe one such implementation. An important advantage of the repliCATS process is that it collects qualitative data that has the potential to provide insight in understanding the limits of generalizability of scientific claims. The primary limitation of the repliCATS process is its reliance on human-derived predictions with consequent costs in terms of participant fatigue although careful design can minimise these costs. The repliCATS process has potential applications in alternative peer review and in the allocation of effort for replication studies

Expert Status and Performance

Expert judgements are essential when time and resources are stretched or we face novel dilemmas requiring fast solutions. Good advice can save lives and large sums of money. Typically, experts are defined by their qualifications, track record and experience [1], [2]. The social expectation hypothesis argues that more highly regarded and more experienced experts will give better advice. We asked experts to predict how they will perform, and how their peers will perform, on sets of questions. The results indicate that the way experts regard each other is consistent, but unfortunately, ranks are a poor guide to actual performance. Expert advice will be more accurate if technical decisions routinely use broadly-defined expert groups, structured question protocols and feedback

Differential cross section measurements for the production of a W boson in association with jets in proton–proton collisions at √s = 7 TeV

Measurements are reported of differential cross sections for the production of a W boson, which decays into a muon and a neutrino, in association with jets, as a function of several variables, including the transverse momenta (pT) and pseudorapidities of the four leading jets, the scalar sum of jet transverse momenta (HT), and the difference in azimuthal angle between the directions of each jet and the muon. The data sample of pp collisions at a centre-of-mass energy of 7 TeV was collected with the CMS detector at the LHC and corresponds to an integrated luminosity of 5.0 fb[superscript −1]. The measured cross sections are compared to predictions from Monte Carlo generators, MadGraph + pythia and sherpa, and to next-to-leading-order calculations from BlackHat + sherpa. The differential cross sections are found to be in agreement with the predictions, apart from the pT distributions of the leading jets at high pT values, the distributions of the HT at high-HT and low jet multiplicity, and the distribution of the difference in azimuthal angle between the leading jet and the muon at low values.United States. Dept. of EnergyNational Science Foundation (U.S.)Alfred P. Sloan Foundatio