Local Communication Protocols for Learning Complex Swarm Behaviors with Deep Reinforcement Learning

Swarm systems constitute a challenging problem for reinforcement learning (RL) as the algorithm needs to learn decentralized control policies that can cope with limited local sensing and communication abilities of the agents. While it is often difficult to directly define the behavior of the agents, simple communication protocols can be defined more easily using prior knowledge about the given task. In this paper, we propose a number of simple communication protocols that can be exploited by deep reinforcement learning to find decentralized control policies in a multi-robot swarm environment. The protocols are based on histograms that encode the local neighborhood relations of the agents and can also transmit task-specific information, such as the shortest distance and direction to a desired target. In our framework, we use an adaptation of Trust Region Policy Optimization to learn complex collaborative tasks, such as formation building and building a communication link. We evaluate our findings in a simulated 2D-physics environment, and compare the implications of different communication protocols.Comment: 13 pages, 4 figures, version 2, accepted at ANTS 201

Conservation strategies for understanding and combating the primate bushmeat trade on Bioko Island, Equatorial Guinea

© 2017 Wiley Periodicals, Inc. Bioko Island, Equatorial Guinea is among the important places in Africa for the conservation of primates, but a cultural preference for bushmeat and a lack of effective law enforcement has encouraged commercial bushmeat hunting, threatening the survival of the remaining primate population. For over 13 years, we collected bushmeat market data in the Malabo market, recording over 35,000 primate carcasses, documenting “mardi gras” consumption patterns, seasonal carcass availability, and negative effects resulting from government intervention. We also conducted forest surveys throughout Bioko's two protected areas in order to localize and quantify primate populations and hunting pressure. Using these data, we were able to document the significant negative impact bushmeat hunting had on monkey populations, estimate which species are most vulnerable to hunting, and develop ecological niche models to approximate the distribution of each of Bioko's diurnal primate species. These results also have allowed for the identification of primate hotspots, such as the critically important southwest region of the Gran Caldera Scientific Reserve, and thus, priority areas for conservation on Bioko, leading to more comprehensive conservation recommendations. Current and future efforts now focus on bridging the gap between investigators and legislators in order to develop and effectively implement a management plan for Bioko's Gran Caldera Scientific Reserve and to develop a targeted educational campaign to reduce demand by changing consumer attitudes toward bushmeat. Using this multidisciplinary approach, informed by biological, socioeconomic, and cultural research, there may yet be a positive future for the primates of Bioko

COVID-19, systemic crisis, and possible implications for the wild meat trade in sub-Saharan Africa

Wild animals play an integral and complex role in the economies and ecologies of many countries across the globe, including those of West and Central Africa, the focus of this policy perspective. The trade in wild meat, and its role in diets, have been brought into focus as a consequence of discussions over the origins of COVID-19. As a result, there have been calls for the closure of China’s “wet markets”; greater scrutiny of the wildlife trade in general; and a spotlight has been placed on the potential risks posed by growing human populations and shrinking natural habitats for animal to human transmission of zoonotic diseases. However, to date there has been little attention given to what the consequences of the COVID-19 economic shock may be for the wildlife trade; the people who rely on it for their livelihoods; and the wildlife that is exploited. In this policy perspective, we argue that the links between the COVID-19 pandemic, rural livelihoods and wildlife are likely to be more complex, more nuanced, and more far-reaching, than is represented in the literature to date. We develop a causal model that tracks the likely implications for the wild meat trade of the systemic crisis triggered by COVID-19. We focus on the resulting economic shockwave, as manifested in the collapse in global demand for commodities such as oil, and international tourism services, and what this may mean for local African economies and livelihoods. We trace the shockwave through to the consequences for the use of, and demand for, wild meats as households respond to these changes. We suggest that understanding and predicting the complex dynamics of wild meat use requires increased collaboration between environmental and resource economics and the ecological and conservation sciences

Eating and conserving bushmeat in Africa

In Africa, overhunting of tropical wildlife for food remains an intractable issue. Donors and governments remain committed to invest in efforts to both conserve and allow the sustainable use of wildlife. Four principal barriers need to be overcome: (i) communities are not motivated to conserve wildlife long-term because they have no formal rights to benefit from wildlife, or to exclude others from taking it on their land; (ii) multispecies harvests, typical of bushmeat hunting scenarios, place large-bodied species at risk of extinction; (iii) wildlife production cannot expand, in the same way that livestock farming can, to meet the expected growth in consumer demand; and (iv) wildlife habitat is lost through conversion to agriculture, housing, transportation networks and extractive industries. In this review, we examine the actors involved in the use of wildlife as food and discuss the possible solutions required to address urban and rural bushmeat consumption. Interventions must tackle use and conservation of wildlife through the application of context-relevant interventions in a variety of geographies across Africa. That said, for any bushmeat solution to work, there needs to be concurrent and comparable investment in strengthening the effectiveness of protected area management and enforcement of wildlife conservation laws

Probing intermediates in the activation cycle of [NiFe] hydrogenase by infrared spectroscopy: the Ni-SIr state and its light sensitivity

The [NiFe] hydrogenase from the sulphate-reducing bacterium Desulfovibrio vulgaris Miyazaki F is reversibly inhibited in the presence of molecular oxygen. A key intermediate in the reactivation process, Ni-SIr, provides the link between fully oxidized (Ni-A, Ni-B) and active (Ni-SIa, Ni-C and Ni-R) forms of hydrogenase. In this work Ni-SIr was found to be light-sensitive (T ≤ 110 K), similar to the active Ni-C and the CO-inhibited states. Transition to the final photoproduct state (Ni-SL) was shown to involve an additional transient light-induced state (Ni-SI1961). Rapid scan kinetic infrared measurements provided activation energies for the transition from Ni-SL to Ni-SIr in protonated as well as in deuterated samples. The inhibitor CO was found not to react with the active site of the Ni-SL state. The wavelength dependence of the Ni-SIr photoconversion was examined in the range between 410 and 680 nm. Light-induced effects were associated with a nickel-centred electronic transition, possibly involving a change in the spin state of nickel (Ni2+). In addition, at T ≤ 40 K the CN− stretching vibrations of Ni-SL were found to be dependent on the colour of the monochromatic light used to irradiate the species, suggesting a change in the interaction of the hydrogen-bonding network of the surrounding amino acids. A possible mechanism for the photochemical process, involving displacement of the oxygen-based ligand, is discussed

Development of 100^{100}Mo-containing scintillating bolometers for a high-sensitivity neutrinoless double-beta decay search

We report recent achievements in the development of scintillating bolometers to search for neutrinoless double-beta decay of $^{100}$Mo. The presented results have been obtained in the framework of the LUMINEU, LUCIFER and EDELWEISS collaborations, and are now part of the R\&D activities towards CUPID (CUORE Update with Particle IDentification), a proposed next-generation double-beta decay experiment based on the CUORE experience. We have developed a technology for the production of large mass ($\sim$1 kg), high optical quality, radiopure zinc and lithium molybdate crystal scintillators (ZnMoO$_4$ and Li$_2$MoO$_4$, respectively) from deeply purified natural and $^{100}$Mo-enriched molybdenum. The procedure is applied for a routine production of enriched crystals. Furthermore, the technology of a single detector module consisting of a large-volume ($\sim 100$~cm$^3$) Zn$^{100}$MoO$_4$ and Li$_2$$^{100}$MoO$_4$ scintillating bolometer has been established, demonstrating performance and radiopurity that are close to satisfy the demands of CUPID. In particular, the FWHM energy resolution of the detectors at 2615 keV --- near the $Q$-value of the double-beta transition of $^{100}$Mo (3034~keV) --- is $\approx$ 4--10~keV. The achieved rejection of $\alpha$-induced dominant background above 2.6~MeV is at the level of more than 99.9\%. The bulk activity of $^{232}$Th ($^{228}$Th) and $^{226}$Ra in the crystals is below 10 $\mu$Bq/kg. Both crystallization and detector technologies favor Li$_2$MoO$_4$, which was selected as a main element for the realization of a CUPID demonstrator (CUPID-0/Mo) with $\sim$7 kg of $^{100}$Mo

Search for High-Mass Resonances Decaying to τν in pp Collisions at √s=13 TeV with the ATLAS Detector

A search for high-mass resonances decaying to τν using proton-proton collisions at √s=13 TeV produced by the Large Hadron Collider is presented. Only τ-lepton decays with hadrons in the final state are considered. The data were recorded with the ATLAS detector and correspond to an integrated luminosity of 36.1 fb−1. No statistically significant excess above the standard model expectation is observed; model-independent upper limits are set on the visible τν production cross section. Heavy W′ bosons with masses less than 3.7 TeV in the sequential standard model and masses less than 2.2–3.8 TeV depending on the coupling in the nonuniversal G(221) model are excluded at the 95% credibility level

Performance of missing transverse momentum reconstruction with the ATLAS detector using proton–proton collisions at √s = 13 TeV

The performance of the missing transverse momentum (EmissT) reconstruction with the ATLAS detector is evaluated using data collected in proton–proton collisions at the LHC at a centre-of-mass energy of 13 TeV in 2015. To reconstruct EmissT, fully calibrated electrons, muons, photons, hadronically decaying τ -leptons, and jets reconstructed from calorimeter energy deposits and charged-particle tracks are used. These are combined with the soft hadronic activity measured by reconstructed charged-particle tracks not associated with the hard objects. Possible double counting of contributions from reconstructed charged-particle tracks from the inner detector, energy deposits in the calorimeter, and reconstructed muons from the muon spectrometer is avoided by applying a signal ambiguity resolution procedure which rejects already used signals when combining the various EmissT contributions. The individual terms as well as the overall reconstructed EmissT are evaluated with various performance metrics for scale (linearity), resolution, and sensitivity to the data-taking conditions. The method developed to determine the systematic uncertainties of the EmissT scale and resolution is discussed. Results are shown based on the full 2015 data sample corresponding to an integrated luminosity of 3.2 fb−1

Measurement of VH, H → b b ¯ production as a function of the vector-boson transverse momentum in 13 TeV pp collisions with the ATLAS detector

Cross-sections of associated production of a Higgs boson decaying into bottom-quark pairs and an electroweak gauge boson, W or Z, decaying into leptons are measured as a function of the gauge boson transverse momentum. The measurements are performed in kinematic fiducial volumes defined in the `simplified template cross-section' framework. The results are obtained using 79.8 fb-1 of proton-proton collisions recorded by the ATLAS detector at the Large Hadron Collider at a centre-of-mass energy of 13 TeV. All measurements are found to be in agreement with the Standard Model predictions, and limits are set on the parameters of an effective Lagrangian sensitive to modifications of the Higgs boson couplings to the electroweak gauge bosons