Event-triggered near optimal adaptive control of interconnected systems

Increased interest in complex interconnected systems like smart-grid, cyber manufacturing have attracted researchers to develop optimal adaptive control schemes to elicit a desired performance when the complex system dynamics are uncertain. In this dissertation, motivated by the fact that aperiodic event sampling saves network resources while ensuring system stability, a suite of novel event-sampled distributed near-optimal adaptive control schemes are introduced for uncertain linear and affine nonlinear interconnected systems in a forward-in-time and online manner. First, a novel stochastic hybrid Q-learning scheme is proposed to generate optimal adaptive control law and to accelerate the learning process in the presence of random delays and packet losses resulting from the communication network for an uncertain linear interconnected system. Subsequently, a novel online reinforcement learning (RL) approach is proposed to solve the Hamilton-Jacobi-Bellman (HJB) equation by using neural networks (NNs) for generating distributed optimal control of nonlinear interconnected systems using state and output feedback. To relax the state vector measurements, distributed observers are introduced. Next, using RL, an improved NN learning rule is derived to solve the HJB equation for uncertain nonlinear interconnected systems with event-triggered feedback. Distributed NN identifiers are introduced both for approximating the uncertain nonlinear dynamics and to serve as a model for online exploration. Next, the control policy and the event-sampling errors are considered as non-cooperative players and a min-max optimization problem is formulated for linear and affine nonlinear systems by using zero-sum game approach for simultaneous optimization of both the control policy and the event based sampling instants. The net result is the development of optimal adaptive event-triggered control of uncertain dynamic systems --Abstract, page iv

Towards the Holy Grail: combining system dynamics and discrete-event simulation in healthcare

The idea of combining discrete-event simulation and system dynamics has been a topic of debate in theoperations research community for over a decade. Many authors have considered the potential benefits ofsuch an approach from a methodological or practical standpoint. However, despite numerous examples ofmodels with both discrete and continuous parameters in the computer science and engineering literature,nobody in the OR field has yet succeeded in developing a genuinely hybrid approach which truly integratesthe philosophical approach and technical merits of both DES and SD in a single model. In this paperwe consider some of the reasons for this and describe two practical healthcare examples of combinedDES/SD models, which nevertheless fall short of the “holy grail” which has been so widely discussed inthe literature over the past decade

Development of a Novel MultiBody Mechatronic Model for Five-Axis CNC Machine Tool

The paper presents the development of a mechatronic hybrid model for Geiss five-axis CNC machine tool using MultiBody-System (MBS) approach. The motion control systems comprising electrical and mechanical elements are analyzed and modeled. The 3D assembly of the machine tool is built in SolidWorks and exported into SimMechanics which interfaces seamlessly with SimPowerSystems, SimDriveline, and Simulink packages. CNC machine tools are mechatronic systems incorporating non-linearities so the proposed multibody mechatronic model (which considers the coupling of elastic mechanical structures with the control systems) represents accurately the dynamic behaviour of the actual machine by using only one simulation environment