The linear quadratic regulator problem for a class of controlled systems modeled by singularly perturbed Ito differential equations

This paper discusses an infinite-horizon linear quadratic (LQ) optimal control problem involving state- and control-dependent noise in singularly perturbed stochastic systems. First, an asymptotic structure along with a stabilizing solution for the stochastic algebraic Riccati equation (ARE) are newly established. It is shown that the dominant part of this solution can be obtained by solving a parameter-independent system of coupled Riccati-type equations. Moreover, sufficient conditions for the existence of the stabilizing solution to the problem are given. A new sequential numerical algorithm for solving the reduced-order AREs is also described. Based on the asymptotic behavior of the ARE, a class of O(√ε) approximate controller that stabilizes the system is obtained. Unlike the existing results in singularly perturbed deterministic systems, it is noteworthy that the resulting controller achieves an O(ε) approximation to the optimal cost of the original LQ optimal control problem. As a result, the proposed control methodology can be applied to practical applications even if the value of the small parameter ε is not precisely known. © 2012 Society for Industrial and Applied Mathematics.Vasile Dragan, Hiroaki Mukaidani and Peng Sh

Nonlinear Systems

Open Mathematics is a challenging notion for theoretical modeling, technical analysis, and numerical simulation in physics and mathematics, as well as in many other fields, as highly correlated nonlinear phenomena, evolving over a large range of time scales and length scales, control the underlying systems and processes in their spatiotemporal evolution. Indeed, available data, be they physical, biological, or financial, and technologically complex systems and stochastic systems, such as mechanical or electronic devices, can be managed from the same conceptual approach, both analytically and through computer simulation, using effective nonlinear dynamics methods. The aim of this Special Issue is to highlight papers that show the dynamics, control, optimization and applications of nonlinear systems. This has recently become an increasingly popular subject, with impressive growth concerning applications in engineering, economics, biology, and medicine, and can be considered a veritable contribution to the literature. Original papers relating to the objective presented above are especially welcome subjects. Potential topics include, but are not limited to: Stability analysis of discrete and continuous dynamical systems; Nonlinear dynamics in biological complex systems; Stability and stabilization of stochastic systems; Mathematical models in statistics and probability; Synchronization of oscillators and chaotic systems; Optimization methods of complex systems; Reliability modeling and system optimization; Computation and control over networked systems

Communication-protocol-based analysis and synthesis of networked systems: progress, prospects and challenges

In recent years, the communication-protocol-based synthesis and analysis issues have gained substantial research interest owing mainly to their significance in networked systems. In this work, we survey the control and filtering problems of networked systems under the effects induced by communication protocols. First, we introduce the engineering background of networked systems as well as the theoretical frameworks established to deal with the communication-protocol-based analysis and synthesis problems. Then, recent advances (especially the latest results) are reviewed on the stability analysis issue subject to protocol scheduling. Subsequently, the particular effort is devoted to presenting the latest progress on various communication-protocol-based control and filtering problems according to the characteristics of networked systems (e.g. time-varying nature, random behaviours, types of parameter uncertainties, and kinds of distributed structure). After that, we provide a systematic review of the communication-protocol-based fault diagnosis problems. Finally, some research challenges of communication-protocol-based control and filtering problems are outlined for future research

Mini-Workshop: Dynamics of Stochastic Systems and their Approximation

The aim of this workshop was to bring together specialists in the area of stochastic dynamical systems and stochastic numerical analysis to exchange their ideas about the state of the art of approximations of stochastic dynamics. Here approximations are considered in the analytical sense in terms of deriving reduced dynamical systems, which are less complex, as well as in the numerical sense via appropriate simulation methods. The main theme is concerned with the efficient treatment of stochastic dynamical systems via both approaches assuming that ideas and methods from one ansatz may prove beneficial for the other. A particular goal was to systematically identify open problems and challenges in this area

On Stability and Stabilization of Hybrid Systems

The thesis addresses the stability, input-to-state stability (ISS), and stabilization problems for deterministic and stochastic hybrid systems with and without time delay. The stabilization problem is achieved by reliable, state feedback controllers, i.e., controllers experience possible faulty in actuators and/or sensors. The contribution of this thesis is presented in three main parts. Firstly, a class of switched systems with time-varying norm-bounded parametric uncertainties in the system states and an external time-varying, bounded input is addressed. The problems of ISS and stabilization by a robust reliable $H_{\infty}$ control are established by using multiple Lyapunov function technique along with the average dwell-time approach. Then, these results are further extended to include time delay in the system states, and delay systems subject to impulsive effects. In the latter two results, Razumikhin technique in which Lyapunov function, but not functional, is used to investigate the qualitative properties. Secondly, the problem of designing a decentralized, robust reliable control for deterministic impulsive large-scale systems with admissible uncertainties in the system states to guarantee exponential stability is investigated. Then, reliable observers are also considered to estimate the states of the same system. Furthermore, a time-delayed large-scale impulsive system undergoing stochastic noise is addressed and the problems of stability and stabilization are investigated. The stabilization is achieved by two approaches, namely a set of decentralized reliable controllers, and impulses. Thirdly, a class of switched singularly perturbed systems (or systems with different time scales) is also considered. Due to the dominant behaviour of the slow subsystem, the stabilization of the full system is achieved through the slow subsystem. This approach results in reducing some unnecessary sufficient conditions on the fast subsystem. In fact, the singular system is viewed as a large-scale system that is decomposed into isolated, low order subsystems, slow and fast, and the rest is treated as interconnection. Multiple Lyapunov functions and average dwell-time switching signal approach are used to establish the stability and stabilization. Moreover, switched singularly perturbed systems with time-delay in the slow system are considered

Response theory and critical phenomena for noisy interacting systems

In this thesis we investigate critical phenomena for ensembles of identical interacting agents, namely weakly interacting diffusions. These interacting systems undergo two qualitatively different scenarios of criticality, critical transitions and phase transitions. The former situation conforms to the classical tipping point phenomenology that is observed in finite dimensional systems and originates from a setting where negative feedbacks that stabilise the system progressively loose their efficiency, resulting in amplified fluctuations and correlation properties of the system. On the other hand, \textit{phase transitions} stem from the complex interplay between the agents' own dynamics, the coupling among them and the noise, leading to macroscopic emergent behaviour of the system, and are only observed in the thermodynamic limit. Classically, \textit{phase transitions} are investigated with the use of suitable macroscopic variables, called order parameters, acting as effective reaction coordinates that capture the relevant features of the macroscopic dynamics. However, identifying an order parameter is not always possible. In this thesis we adopt a complementary point of view, based on Linear Response theory, to investigate such critical phenomena. We are able to identify the conditions leading either to a critical transition or a phase transition in terms of spectral properties of suitable response operators. We associate critical phenomena to settings where the response of the system breaks down. In particular, we are able to characterise these critical scenarios as settings where the complex valued susceptibility of the system develops a non analytical behaviour for real values of frequencies, resulting in a macroscopic resonance of the system. We provide multiple paradigmatic examples of equilibrium and nonequilibrium phase transitions where we are able to prove mathematically and numerically the clear signature of a singular behaviour of the susceptibility at the phase transition as the thermodynamic limit is reached. Being associated to spectral properties of suitable operators describing either correlation or response properties, these resonant phenomena do not depend on the specific details of the applied forcing nor on the observable under investigation, allowing one to bypass the problem of the identification of the order parameter for the system.Open Acces