Population dynamical behavior of Lotka-Volterra system under regime switching

In this paper, we investigate a Lotka-Volterra system under regime switching dx(t) = diag(x1(t); : : : ; xn(t))[(b(r(t)) + A(r(t))x(t))dt + (r(t))dB(t)]; where B(t) is a standard Brownian motion. The aim here is to find out what happens under regime switching. We first obtain the sufficient conditions for the existence of global positive solutions, stochastic permanence and extinction. We find out that both stochastic permanence and extinction have close relationships with the stationary probability distribution of the Markov chain. The limit of the average in time of the sample path of the solution is then estimated by two constants related to the stationary distribution and the coefficients. Finally, the main results are illustrated by several examples

Dynamical Behavior of a Stochastic Delayed One-Predator and Two-Mutualistic-Prey Model with Markovian Switching and Different Functional Responses

We propose a stochastic delayed one-predator and two-mutualistic-prey model perturbed by white noise and telegraph noise. By the M-matrix analysis and Lyapunov functions, sufficient conditions of stochastic permanence and extinction are established, respectively. These conditions are all dependent on the subsystems’ parameters and the stationary probability distribution of the Markov chain. We also investigate another asymptotic property and finally give two examples and numerical simulations to illustrate main results

Markov Decision Processes with Applications in Wireless Sensor Networks: A Survey

Wireless sensor networks (WSNs) consist of autonomous and resource-limited devices. The devices cooperate to monitor one or more physical phenomena within an area of interest. WSNs operate as stochastic systems because of randomness in the monitored environments. For long service time and low maintenance cost, WSNs require adaptive and robust methods to address data exchange, topology formulation, resource and power optimization, sensing coverage and object detection, and security challenges. In these problems, sensor nodes are to make optimized decisions from a set of accessible strategies to achieve design goals. This survey reviews numerous applications of the Markov decision process (MDP) framework, a powerful decision-making tool to develop adaptive algorithms and protocols for WSNs. Furthermore, various solution methods are discussed and compared to serve as a guide for using MDPs in WSNs

Nonlinear Stochastic Systems And Controls: Lotka-Volterra Type Models, Permanence And Extinction, Optimal Harvesting Strategies, And Numerical Methods For Systems Under Partial Observations

This dissertation focuses on a class of stochastic models formulated using stochastic differential equations with regime switching represented by a continuous-time Markov chain, which also known as hybrid switching diffusion processes. Our motivations for studying such processes in this dissertation stem from emerging and existing applications in biological systems, ecosystems, financial engineering, modeling, analysis, and control and optimization of stochastic systems under the influence of random environments, with complete observations or partial observations. The first part is concerned with Lotka-Volterra models with white noise and regime switching represented by a continuous-time Markov chain. Different from the existing literature, the Markov chain is hidden and canonly be observed in a Gaussian white noise in our work. We use a Wonham filter to estimate the Markov chain from the observable evolution of the given process, and convert the original system to a completely observable one. We then establish the regularity, positivity, stochastic boundedness, and sample path continuity of the solution. Moreover, stochastic permanence and extinction using feedback controls are investigated. The second part develops optimal harvest strategies for Lotka-Volterra systems so as to establish economically, ecologically, and environmentally reasonable strategies for populations subject to the risk of extinction. The underlying systems are controlled regime-switching diffusions that belong to the class of singular control problems. We construct upper bounds for the value functions, prove the finiteness of the harvesting value, and derive properties of the value functions. Then we construct explicit chattering harvesting strategies and the corresponding lower bounds for the value functions by using the idea of harvesting only one species at a time. We further show that this is a reasonable candidate for the best lower bound that one can expect. In the last part, we study optimal harvesting problems for a general systems in the case that the Markov chain is hidden and can only be observed in a Gaussian white noise. The Wonham filter is employed to convert the original problem to a completely observable one. Then we treat the resulting optimal control problem. Because the problem is virtually impossible to solve in closed form, our main effort is devoted to developing numerical approximation algorithms. To approximate the value function and optimal strategies, Markov chain approximation methods are used to construct a discrete-time controlled Markov chain. Convergence of the algorithm is proved by weak convergence method and suitable scaling

Learning and Management for Internet-of-Things: Accounting for Adaptivity and Scalability

Internet-of-Things (IoT) envisions an intelligent infrastructure of networked smart devices offering task-specific monitoring and control services. The unique features of IoT include extreme heterogeneity, massive number of devices, and unpredictable dynamics partially due to human interaction. These call for foundational innovations in network design and management. Ideally, it should allow efficient adaptation to changing environments, and low-cost implementation scalable to massive number of devices, subject to stringent latency constraints. To this end, the overarching goal of this paper is to outline a unified framework for online learning and management policies in IoT through joint advances in communication, networking, learning, and optimization. From the network architecture vantage point, the unified framework leverages a promising fog architecture that enables smart devices to have proximity access to cloud functionalities at the network edge, along the cloud-to-things continuum. From the algorithmic perspective, key innovations target online approaches adaptive to different degrees of nonstationarity in IoT dynamics, and their scalable model-free implementation under limited feedback that motivates blind or bandit approaches. The proposed framework aspires to offer a stepping stone that leads to systematic designs and analysis of task-specific learning and management schemes for IoT, along with a host of new research directions to build on.Comment: Submitted on June 15 to Proceeding of IEEE Special Issue on Adaptive and Scalable Communication Network

Optimal harvesting for a stochastic competition system with stage structure and distributed delay

A stochastic competition system with harvesting and distributed delay is investigated, which is described by stochastic differential equations with distributed delay. The existence and uniqueness of a global positive solution are proved via Lyapunov functions, and an ergodic method is used to obtain that the system is asymptotically stable in distribution. By using the comparison theorem of stochastic differential equations and limit superior theory, sufficient conditions for persistence in mean and extinction of the stochastic competition system are established. We thereby obtain the optimal harvest strategy and maximum net economic revenue by the optimal harvesting theory of differential equations

EUROPEAN CONFERENCE ON QUEUEING THEORY 2016

International audienceThis booklet contains the proceedings of the second European Conference in Queueing Theory (ECQT) that was held from the 18th to the 20th of July 2016 at the engineering school ENSEEIHT, Toulouse, France. ECQT is a biannual event where scientists and technicians in queueing theory and related areas get together to promote research, encourage interaction and exchange ideas. The spirit of the conference is to be a queueing event organized from within Europe, but open to participants from all over the world. The technical program of the 2016 edition consisted of 112 presentations organized in 29 sessions covering all trends in queueing theory, including the development of the theory, methodology advances, computational aspects and applications. Another exciting feature of ECQT2016 was the institution of the Takács Award for outstanding PhD thesis on "Queueing Theory and its Applications"

Analysis of a stochastic delay competition system driven by Lévy noise under regime switching

This paper is concerned with a stochastic delay competition system driven by Lévy noise under regime switching. Both the existence and uniqueness of the global positive solution are examined. By comparison theorem, sufficient conditions for extinction and non-persistence in the mean are obtained. Some discussions are made to demonstrate that the different environment factors have significant impacts on extinction. Furthermore, we show that the global positive solution is stochastically ultimate boundedness under some conditions, and an important asymptotic property of system is given. In the end, numerical simulations are carried out to illustrate our main results