Pinning controllability of autonomous Boolean control networks

Autonomous Boolean networks (ABNs), which are developed to model the Boolean networks (BNs) with regulatory delays, are well known for their advantages of characterizing the intrinsic evolution rules of biological systems such as the gene regulatory networks. As a special type of ABNs with binary inputs, the autonomous Boolean control networks (ABCNs) are introduced for designing and analyzing the therapeutic intervention strategies where the binary inputs represent whether a certain medicine is dominated or not. An important problem in the therapeutic intervention is to design a control sequence steering an ABCN from an undesirable location (implying a diseased state) to a desirable one (corresponding to a healthy state). Motivated by such background, this paper aims to investigate the reachability and controllability of ABCNs with pinning controllers. Several necessary and sufficient criteria are provided by resorting to the semi-tensor product techniques of matrices. Moreover, an effective pinning control algorithm is presented for steering an ABCN from any given states to the desired state in the shortest time period. Numerical examples are also presented to demonstrate the results obtained.This work was supported in part by National Natural Science Foundation of China (Grant Nos. 61329301, 61273156), Natural Science Foundation of Jiangsu Province of China (Grant No. BK20130017), Six Talent Peaks Project for the High Level Personnel from the Jiangsu Province of China (Grant No. 2015- DZXX-003), Scientific Research Foundations of Graduate School of Southeast University (Grant No. YBJJ1560), and Innovation Program of Jiangsu Province (Grant No. KYZZ15 0050)

Reinforcement Learning Based Minimum State-flipped Control for the Reachability of Boolean Control Networks

To realize reachability as well as reduce control costs of Boolean Control Networks (BCNs) with state-flipped control, a reinforcement learning based method is proposed to obtain flip kernels and the optimal policy with minimal flipping actions to realize reachability. The method proposed is model-free and of low computational complexity. In particular, Q-learning (QL), fast QL, and small memory QL are proposed to find flip kernels. Fast QL and small memory QL are two novel algorithms. Specifically, fast QL, namely, QL combined with transfer-learning and special initial states, is of higher efficiency, and small memory QL is applicable to large-scale systems. Meanwhile, we present a novel reward setting, under which the optimal policy with minimal flipping actions to realize reachability is the one of the highest returns. Then, to obtain the optimal policy, we propose QL, and fast small memory QL for large-scale systems. Specifically, on the basis of the small memory QL mentioned before, the fast small memory QL uses a changeable reward setting to speed up the learning efficiency while ensuring the optimality of the policy. For parameter settings, we give some system properties for reference. Finally, two examples, which are a small-scale system and a large-scale one, are considered to verify the proposed method

Deterministic and Probabilistic Boolean Control Networks and their application to Gene Regulatory Networks

This thesis focuses on Deterministic and Probabilistic Boolean Control Networks and their application to some specific Gene Regulatory Networks. At first, some introductory materials about Boolean Logic, Left Semi-tensor Product and Probability are presented in order to explain in detail the concepts of Boolean Networks, Boolean Control Networks, Probabilistic Boolean Networks and Probabilistic Boolean Control Networks. These networks can be modelled in state-space and their representation, obtained by means of the left semi-tensor product, is called algebraic form. Subsequently, the thesis concentrates on presenting the fundamental properties of these networks such as the classical Systems Theory properties of stability, reachability, controllability and stabilisation. Afterwards, the attention is drawn towards the comparison between deterministic and probabilistic boolean networks. Finally, two examples of Gene Regulatory Networks are modelled and analysed by means of a Boolean Network and a Probabilistic Boolean Network.This thesis focuses on Deterministic and Probabilistic Boolean Control Networks and their application to some specific Gene Regulatory Networks. At first, some introductory materials about Boolean Logic, Left Semi-tensor Product and Probability are presented in order to explain in detail the concepts of Boolean Networks, Boolean Control Networks, Probabilistic Boolean Networks and Probabilistic Boolean Control Networks. These networks can be modelled in state-space and their representation, obtained by means of the left semi-tensor product, is called algebraic form. Subsequently, the thesis concentrates on presenting the fundamental properties of these networks such as the classical Systems Theory properties of stability, reachability, controllability and stabilisation. Afterwards, the attention is drawn towards the comparison between deterministic and probabilistic boolean networks. Finally, two examples of Gene Regulatory Networks are modelled and analysed by means of a Boolean Network and a Probabilistic Boolean Network

Control Theory: A Mathematical Perspective on Cyber-Physical Systems

Control theory is an interdisciplinary field that is located at the crossroads of pure and applied mathematics with systems engineering and the sciences. Recently the control field is facing new challenges motivated by application domains that involve networks of systems. Examples are interacting robots, networks of autonomous cars or the smart grid. In order to address the new challenges posed by these application disciplines, the special focus of this workshop has been on the currently very active field of Cyber-Physical Systems, which forms the underlying basis for many network control applications. A series of lectures in this workshop was devoted to give an overview on current theoretical developments in Cyber-Physical Systems, emphasizing in particular the mathematical aspects of the field. Special focus was on the dynamics and control of networks of systems, distributed optimization and formation control, fundamentals of nonlinear interconnected systems, as well as open problems in control

Discrete Time Systems

Discrete-Time Systems comprehend an important and broad research field. The consolidation of digital-based computational means in the present, pushes a technological tool into the field with a tremendous impact in areas like Control, Signal Processing, Communications, System Modelling and related Applications. This book attempts to give a scope in the wide area of Discrete-Time Systems. Their contents are grouped conveniently in sections according to significant areas, namely Filtering, Fixed and Adaptive Control Systems, Stability Problems and Miscellaneous Applications. We think that the contribution of the book enlarges the field of the Discrete-Time Systems with signification in the present state-of-the-art. Despite the vertiginous advance in the field, we also believe that the topics described here allow us also to look through some main tendencies in the next years in the research area