Controlling sequential hybrid evolutionary algorithm by Q-learning

Many state-of-the-art evolutionary algoritahms (EAs) can be categorized as sequential hybrid EAs, in which various EAs are sequentially executed. The timing to switch from one EA to another is critical to the performance of the hybrid EA because the switching time determines the allocation of computational resources and thereby it helps balance exploration and exploitation. In this article, a framework for adaptive parameter control for hybrid EAs is proposed, in which the switching time is controlled by a learned agent rather than a manually designed scheme. First the framework is applied to an adaptive differential evolution algorithm, LSHADE, to control when to use the scheme to reduce the population. Then the framework is applied to the algorithm that won the CEC 2018 competition, i.e., the hybrid sampling evolution strategy (HSES), to control when to switch from the univariate sampling phase to the Covariance Matrix Adaptation Evolution Straategy phase. The agents for parameter control in LSHADE and HSES are trained by using Q-learning and deep Q-learning to obtain the learned algorithms Q-LSHADE and DQ-HSES. The results of experiments on the CEC 2014 and 2018 test suites show that the learned algorithms significantly outperform their counterparts and some state-of-the-art EAs.Algorithms and the Foundations of Software technolog

Characteristics of regional new particle formation in urban and regional background environments in the North China Plain

Long-term measurements of particle number size distributions were carried out both at an urban background site (Peking University, PKU) and a regional Global Atmospheric Watch station (Shangdianzi, SDZ) from March to November in 2008. In total, 52 new particle formation (NPF) events were observed simultaneously at both sites, indicating that this is a regional phenomenon in the North China Plain. On average, the mean condensation sink value before the nucleation events started was 0.025 s−1 in the urban environment, which was 1.6 times higher than that at regional site. However, higher particle formation and growth rates were observed at PKU (10.8 cm−3 s−1 and 5.2 nm h−1) compared with those at SDZ (4.9 cm−3 s−1 and 4.0 nm h−1). These results implied that precursors were much more abundant in the polluted urban environment. Different from the observations in cleaner environments, the background conditions of the observed particle homogeneous nucleation events in the North China Plain could be characterized as the co-existing of a stronger source of precursor gases and a higher condensational sink of pre-existing aerosol particles. Secondary aerosol formation following nucleation events results in an increase of particle mass concentration, particle light scattering coefficient, and cloud condensation nuclei (CCN) number concentration, with consequences on visibility, radiative effects, and air quality. Typical regional NPF events with significant particle nucleation rates and subsequent particle growth over a sufficiently long time period at both sites were chosen to investigate the influence of NPF on the number concentration of "potential" CCN. As a result, the NPF and the subsequent condensable growth increased the CCN number concentration in the North China Plain by factors in the range from 5.6 to 8.7. Moreover, the potential contribution of anthropogenic emissions to the CCN number concentration was more than 50%, to which more attention should be drawn in regional and global climate modeling, especially in the polluted urban areas

Short-time scaling behavior of growing interfaces

The short-time evolution of a growing interface is studied within the framework of the dynamic renormalization group approach for the Kadar-Parisi-Zhang (KPZ) equation and for an idealized continuum model of molecular beam epitaxy (MBE). The scaling behavior of response and correlation functions is reminiscent of the ``initial slip'' behavior found in purely dissipative critical relaxation (model A) and critical relaxation with conserved order parameter (model B), respectively. Unlike model A the initial slip exponent for the KPZ equation can be expressed by the dynamical exponent z. In 1+1 dimensions, for which z is known exactly, the analytical theory for the KPZ equation is confirmed by a Monte-Carlo simulation of a simple ballistic deposition model. In 2+1 dimensions z is estimated from the short-time evolution of the correlation function.Comment: 27 pages LaTeX with epsf style, 4 figures in eps format, submitted to Phys. Rev.

Review of Person Re-identification Techniques

Person re-identification across different surveillance cameras with disjoint fields of view has become one of the most interesting and challenging subjects in the area of intelligent video surveillance. Although several methods have been developed and proposed, certain limitations and unresolved issues remain. In all of the existing re-identification approaches, feature vectors are extracted from segmented still images or video frames. Different similarity or dissimilarity measures have been applied to these vectors. Some methods have used simple constant metrics, whereas others have utilised models to obtain optimised metrics. Some have created models based on local colour or texture information, and others have built models based on the gait of people. In general, the main objective of all these approaches is to achieve a higher-accuracy rate and lowercomputational costs. This study summarises several developments in recent literature and discusses the various available methods used in person re-identification. Specifically, their advantages and disadvantages are mentioned and compared.Comment: Published 201

Nucleosome conformation dictates the histone code

Histone post-translational modifications (PTMs) play a critical role in chromatin regulation. It has been proposed that these PTMs form localized 'codes' that are read by specialized regions (reader domains) in chromatin-associated proteins (CAPs) to regulate downstream function. Substantial effort has been made to define [CAP: histone PTM] specificities, and thus decipher the histone code and guide epigenetic therapies. However, this has largely been done using the reductive approach of isolated reader domains and histone peptides, which cannot account for any higher-order factors. Here, we show that the [BPTF PHD finger and bromodomain: histone PTM] interaction is dependent on nucleosome context. The tandem reader selectively associates with nucleosomal H3K4me3 and H3K14ac or H3K18ac, a combinatorial engagement that despite being in cis is not predicted by peptides. This in vitro specificity of the BPTF tandem reader for PTM-defined nucleosomes is recapitulated in a cellular context. We propose that regulatable histone tail accessibility and its impact on the binding potential of reader domains necessitates we refine the 'histone code' concept and interrogate it at the nucleosome level

Search for gravitational waves from Scorpius X-1 in the second Advanced LIGO observing run with an improved hidden Markov model

We present results from a semicoherent search for continuous gravitational waves from the low-mass x-ray binary Scorpius X-1, using a hidden Markov model (HMM) to track spin wandering. This search improves on previous HMM-based searches of LIGO data by using an improved frequency domain matched filter, the J-statistic, and by analyzing data from Advanced LIGO's second observing run. In the frequency range searched, from 60 to 650 Hz, we find no evidence of gravitational radiation. At 194.6 Hz, the most sensitive search frequency, we report an upper limit on gravitational wave strain (at 95% confidence) of h095%=3.47×10-25 when marginalizing over source inclination angle. This is the most sensitive search for Scorpius X-1, to date, that is specifically designed to be robust in the presence of spin wandering. © 2019 American Physical Society

Search for Tensor, Vector, and Scalar Polarizations in the Stochastic Gravitational-Wave Background

The detection of gravitational waves with Advanced LIGO and Advanced Virgo has enabled novel tests of general relativity, including direct study of the polarization of gravitational waves. While general relativity allows for only two tensor gravitational-wave polarizations, general metric theories can additionally predict two vector and two scalar polarizations. The polarization of gravitational waves is encoded in the spectral shape of the stochastic gravitational-wave background, formed by the superposition of cosmological and individually unresolved astrophysical sources. Using data recorded by Advanced LIGO during its first observing run, we search for a stochastic background of generically polarized gravitational waves. We find no evidence for a background of any polarization, and place the first direct bounds on the contributions of vector and scalar polarizations to the stochastic background. Under log-uniform priors for the energy in each polarization, we limit the energy densities of tensor, vector, and scalar modes at 95% credibility to Ω0T<5.58×10-8, Ω0V<6.35×10-8, and Ω0S<1.08×10-7 at a reference frequency f0=25 Hz. © 2018 American Physical Society

Erratum: "A Gravitational-wave Measurement of the Hubble Constant Following the Second Observing Run of Advanced LIGO and Virgo" (2021, ApJ, 909, 218)

[no abstract available