Chaotic exploration and learning of locomotion behaviours

We present a general and fully dynamic neural system, which exploits intrinsic chaotic dynamics, for the real-time goal-directed exploration and learning of the possible locomotion patterns of an articulated robot of an arbitrary morphology in an unknown environment. The controller is modeled as a network of neural oscillators that are initially coupled only through physical embodiment, and goal-directed exploration of coordinated motor patterns is achieved by chaotic search using adaptive bifurcation. The phase space of the indirectly coupled neural-body-environment system contains multiple transient or permanent self-organized dynamics, each of which is a candidate for a locomotion behavior. The adaptive bifurcation enables the system orbit to wander through various phase-coordinated states, using its intrinsic chaotic dynamics as a driving force, and stabilizes on to one of the states matching the given goal criteria. In order to improve the sustainability of useful transient patterns, sensory homeostasis has been introduced, which results in an increased diversity of motor outputs, thus achieving multiscale exploration. A rhythmic pattern discovered by this process is memorized and sustained by changing the wiring between initially disconnected oscillators using an adaptive synchronization method. Our results show that the novel neurorobotic system is able to create and learn multiple locomotion behaviors for a wide range of body configurations and physical environments and can readapt in realtime after sustaining damage

Robustness of Prediction Based Delay Compensation for Nonlinear Systems

Control of systems where the information between the controller, actuator, and sensor can be lost or delayed can be challenging with respect to stability and performance. One way to overcome the resulting problems is the use of prediction based compensation schemes. Instead of a single input, a sequence of (predicted) future controls is submitted and implemented at the actuator. If suitable, so-called prediction consistent compensation and control schemes, such as certain predictive control approaches, are used, stability of the closed loop in the presence of delays and packet losses can be guaranteed. In this paper, we show that control schemes employing prediction based delay compensation approaches do posses inherent robustness properties. Specifically, if the nominal closed loop system without delay compensation is ISS with respect to perturbation and measurement errors, then the closed loop system employing prediction based delay compensation techniques is robustly stable. We analyze the influence of the prediction horizon on the robustness gains and illustrate the results in simulation.Comment: 6 pages, 3 figure

Self-Control of Traffic Lights and Vehicle Flows in Urban Road Networks

Based on fluid-dynamic and many-particle (car-following) simulations of traffic flows in (urban) networks, we study the problem of coordinating incompatible traffic flows at intersections. Inspired by the observation of self-organized oscillations of pedestrian flows at bottlenecks [D. Helbing and P. Moln\'ar, Phys. Eev. E 51 (1995) 4282--4286], we propose a self-organization approach to traffic light control. The problem can be treated as multi-agent problem with interactions between vehicles and traffic lights. Specifically, our approach assumes a priority-based control of traffic lights by the vehicle flows themselves, taking into account short-sighted anticipation of vehicle flows and platoons. The considered local interactions lead to emergent coordination patterns such as ``green waves'' and achieve an efficient, decentralized traffic light control. While the proposed self-control adapts flexibly to local flow conditions and often leads to non-cyclical switching patterns with changing service sequences of different traffic flows, an almost periodic service may evolve under certain conditions and suggests the existence of a spontaneous synchronization of traffic lights despite the varying delays due to variable vehicle queues and travel times. The self-organized traffic light control is based on an optimization and a stabilization rule, each of which performs poorly at high utilizations of the road network, while their proper combination reaches a superior performance. The result is a considerable reduction not only in the average travel times, but also of their variation. Similar control approaches could be applied to the coordination of logistic and production processes

Stability Analysis and Design of Digital Compensators for Networked Control Systems

Networked Control Systems (NCSs) are distributed control systems where sensors, actuators, and controllers are interconnected by communication networks, e.g. LAN, WAN, CAN, Internet. Use of digital networks are advantageous due to less cost, ease in installation and/or ready availability. These are widely used in automobiles, manufacturing plants, aircrafts, spacecrafts, robotics and smart grids. Due to the involvement of network in such systems, the closed-loop system performance may degrade due to network delays and packet losses. Since delays are involved in NCS, predictor based compensators are useful to improve control performance of such systems. Moreover, the digital communication network demands implementation of digital compensators. First, the thesis studies stability analysis of NCSs with uncertain time-varying delays. For this configuration, both the controller and actuators are assumed as event-driven (i.e. the delays are fractional type). The NCS with uncertain delays and packet losses are represented as systems in polytopic form as well as with norm-bounded uncertainties. The closed-loop system stability is guaranteed using quadratic Lyapunov function in terms of LMIs. For given controller gain the maximum tolerable delay calculated and the resultant stability regions of the system is explored in the parameter plane of control gain and maximum tolerable delay. The stability region is found to be almost same for both the methods for the case of lower order systems (an integrator plant), whereas for higher order systems (second order example system), the obtained stability region is more for the case of polytopic approach than the norm-bounded one. This motivates to use the polytopic modeling approach in remaining of the thesis. Next, design of digital Smith Predictor (SP) to improve the performance of NCS with bounded uncertain delays and packet losses in both the forward and feedback channels is con-sidered. For implementing a digital SP, it is essential that the controller is implemented with constant sampling interval so that predictor model is certain and therefore the controller is required to be time-driven one (sensor-to-controller channel uncertainties are integer type). On the other hand, the actuator is considered to be event-driven since it introduces lesser delay compared to the time-driven case. Thereby, the controller-to-actuator channel delays are fractional type. The system with uncertain delay parameters (packet losses as uncertain integer delays) are modeled in polytopic form. For this system, Lyapunov stability criterion has been presented in terms of LMIs to explore the closed-loop system stability. Finally, the proposed analysis is verified with numerical studies and using TrueTime simulation en- vironment. It is observed that the digital SP improves the stability performance of the NCS considerably compared to without predictor. However, the choice of predictor delay affects the system performance considerably. Further, an additional filter is used along with conventional digital SP to improve the system response and disturbance rejection property of the controller. For this configurations, both the controller and actuators are assumed to be time-driven. The NCS with random but bounded delays and packet losses introduced by the network is modeled as a switched system and LMI based iterative algorithm is used for designing the controller. A LAN-based experimental setup is developed to validate the above theoretical findings.The plant is an op-amp based emulated integrator plant.The plant is interfaced with a computer using data acquisition card. Another computer is used as the digital controller and the two computers are connected via LAN using UDP communication protocol. The effectiveness of the proposed controller design method is verified with this LAN-based experi- mental setup. Three controller configurations (i.e. without and with digital SP as well as the digital SP with filter) are considered for comparison of their guaranteed cost performance. It is shown that the digital SP with filter improves the performance of NCS than with and without simple digital SP based NCS configurations. Finally, design of digital predictor based robust H1 control for NCSs is made in such a way that the effect of randomness in network delays and packet losses on the closed-loop system dynamics is reduced. For the purpose, the predictor delay is chosen as a fixed one whereas variation of random delays in the system are modeled as disturbances. Then quadratic H1 design criterion in the form of LMIs is invoked so that the network jitter effect is minimized. The efficacy of the proposed configurations are validated with the developed LAN based NCS setup. It is seen that the designed controllers effectively regularize the system dynamics from random variations of the network delays and packet losses

Control of chaos in nonlinear circuits and systems

Nonlinear circuits and systems, such as electronic circuits (Chapter 5), power converters (Chapter 6), human brains (Chapter 7), phase lock loops (Chapter 8), sigma delta modulators (Chapter 9), etc, are found almost everywhere. Understanding nonlinear behaviours as well as control of these circuits and systems are important for real practical engineering applications. Control theories for linear circuits and systems are well developed and almost complete. However, different nonlinear circuits and systems could exhibit very different behaviours. Hence, it is difficult to unify a general control theory for general nonlinear circuits and systems. Up to now, control theories for nonlinear circuits and systems are still very limited. The objective of this book is to review the state of the art chaos control methods for some common nonlinear circuits and systems, such as those listed in the above, and stimulate further research and development in chaos control for nonlinear circuits and systems. This book consists of three parts. The first part of the book consists of reviews on general chaos control methods. In particular, a time-delayed approach written by H. Huang and G. Feng is reviewed in Chapter 1. A master slave synchronization problem for chaotic Lur’e systems is considered. A delay independent and delay dependent synchronization criteria are derived based on the H performance. The design of the time delayed feedback controller can be accomplished by means of the feasibility of linear matrix inequalities. In Chapter 2, a fuzzy model based approach written by H.K. Lam and F.H.F. Leung is reviewed. The synchronization of chaotic systems subject to parameter uncertainties is considered. A chaotic system is first represented by the fuzzy model. A switching controller is then employed to synchronize the systems. The stability conditions in terms of linear matrix inequalities are derived based on the Lyapunov stability theory. The tracking performance and parameter design of the controller are formulated as a generalized eigenvalue minimization problem which is solved numerically via some convex programming techniques. In Chapter 3, a sliding mode control approach written by Y. Feng and X. Yu is reviewed. Three kinds of sliding mode control methods, traditional sliding mode control, terminal sliding mode control and non-singular terminal sliding mode control, are employed for the control of a chaotic system to realize two different control objectives, namely to force the system states to converge to zero or to track desired trajectories. Observer based chaos synchronizations for chaotic systems with single nonlinearity and multi-nonlinearities are also presented. In Chapter 4, an optimal control approach written by C.Z. Wu, C.M. Liu, K.L. Teo and Q.X. Shao is reviewed. Systems with nonparametric regression with jump points are considered. The rough locations of all the possible jump points are identified using existing kernel methods. A smooth spline function is used to approximate each segment of the regression function. A time scaling transformation is derived so as to map the undecided jump points to fixed points. The approximation problem is formulated as an optimization problem and solved via existing optimization tools. The second part of the book consists of reviews on general chaos controls for continuous-time systems. In particular, chaos controls for Chua’s circuits written by L.A.B. Tôrres, L.A. Aguirre, R.M. Palhares and E.M.A.M. Mendes are discussed in Chapter 5. An inductorless Chua’s circuit realization is presented, as well as some practical issues, such as data analysis, mathematical modelling and dynamical characterization, are discussed. The tradeoff among the control objective, the control energy and the model complexity is derived. In Chapter 6, chaos controls for pulse width modulation current mode single phase H-bridge inverters written by B. Robert, M. Feki and H.H.C. Iu are discussed. A time delayed feedback controller is used in conjunction with the proportional controller in its simple form as well as in its extended form to stabilize the desired periodic orbit for larger values of the proportional controller gain. This method is very robust and easy to implement. In Chapter 7, chaos controls for epileptiform bursting in the brain written by M.W. Slutzky, P. Cvitanovic and D.J. Mogul are discussed. Chaos analysis and chaos control algorithms for manipulating the seizure like behaviour in a brain slice model are discussed. The techniques provide a nonlinear control pathway for terminating or potentially preventing epileptic seizures in the whole brain. The third part of the book consists of reviews on general chaos controls for discrete-time systems. In particular, chaos controls for phase lock loops written by A.M. Harb and B.A. Harb are discussed in Chapter 8. A nonlinear controller based on the theory of backstepping is designed so that the phase lock loops will not be out of lock. Also, the phase lock loops will not exhibit Hopf bifurcation and chaotic behaviours. In Chapter 9, chaos controls for sigma delta modulators written by B.W.K. Ling, C.Y.F. Ho and J.D. Reiss are discussed. A fuzzy impulsive control approach is employed for the control of the sigma delta modulators. The local stability criterion and the condition for the occurrence of limit cycle behaviours are derived. Based on the derived conditions, a fuzzy impulsive control law is formulated so that the occurrence of the limit cycle behaviours, the effect of the audio clicks and the distance between the state vectors and an invariant set are minimized supposing that the invariant set is nonempty. The state vectors can be bounded within any arbitrary nonempty region no matter what the input step size, the initial condition and the filter parameters are. The editors are much indebted to the editor of the World Scientific Series on Nonlinear Science, Prof. Leon Chua, and to Senior Editor Miss Lakshmi Narayan for their help and congenial processing of the edition

Data-driven Control of Dynamic Event-triggered Systems with Delays

This paper studies data-driven control of unknown sampled-data systems with communication delays under an event-triggering transmission mechanism. Data-based representations for time-invariant linear systems with known or unknown system input matrices are first developed, along with a novel class of dynamic triggering schemes for sampled-data systems with time delays. A model-based stability condition for the resulting event-triggered time-delay system is established using a looped-functional approach. Combining this model-based condition with the data-driven representations, data-based stability conditions are derived. Building on the data-based conditions, methods for co-designing the controller gain and the event-triggering matrix are subsequently provided for both cases with or without using the input matrix. Finally, numerical examples are presented to corroborate the usefulness of additional prior knowledge of the input matrix in reducing the conservatism of stability conditions, as well as the merits of the proposed data-driven event-triggered control schemes relative to existing results.Comment: 15 pages,5 figure

Orbiting Rainbows: Optical Manipulation of Aerosols and the Beginnings of Future Space Construction

Our objective is to investigate the conditions to manipulate and maintain the shape of an orbiting cloud of dust-like matter so that it can function as an ultra-lightweight surface with useful and adaptable electromagnetic characteristics, for instance, in the optical, RF, or microwave bands. Inspired by the light scattering and focusing properties of distributed optical assemblies in Nature, such as rainbows and aerosols, and by recent laboratory successes in optical trapping and manipulation, we propose a unique combination of space optics and autonomous robotic system technology, to enable a new vision of space system architecture with applications to ultra-lightweight space optics and, ultimately, in-situ space system fabrication. Typically, the cost of an optical system is driven by the size and mass of the primary aperture. The ideal system is a cloud of spatially disordered dust-like objects that can be optically manipulated: it is highly reconfigurable, fault-tolerant, and allows very large aperture sizes at low cost. See Figure 1 for a scenario of application of this concept. The solution that we propose is to construct an optical system in space in which the nonlinear optical properties of a cloud of micron-sized particles are shaped into a specific surface by light pressure, allowing it to form a very large and lightweight aperture of an optical system, hence reducing overall mass and cost. Other potential advantages offered by the cloud properties as optical system involve possible combination of properties (combined transmit/receive), variable focal length, combined refractive and reflective lens designs, and hyper-spectral imaging. A cloud of highly reflective particles of micron-size acting coherently in a specific electromagnetic band, just like an aerosol in suspension in the atmosphere, would reflect the Sun's light much like a rainbow. The only difference with an atmospheric or industrial aerosol is the absence of the supporting fluid medium. This new concept is based on recent understandings in the physics of optical manipulation of small particles in the laboratory and the engineering of distributed ensembles of spacecraft clouds to shape an orbiting cloud of micron-sized objects. In the same way that optical tweezers have revolutionized micro- and nano-manipulation of objects, our breakthrough concept will enable new large scale NASA mission applications and develop new technology in the areas of Astrophysical Imaging Systems and Remote Sensing because the cloud can operate as an adaptive optical imaging sensor. While achieving the feasibility of constructing one single aperture out of the cloud is the main topic of this work, it is clear that multiple orbiting aerosol lenses could also combine their power to synthesize a much larger aperture in space to enable challenging goals such as exoplanet detection. Furthermore, this effort could establish feasibility of key issues related to material properties, remote manipulation, and autonomy characteristics of cloud in orbit. There are several types of endeavors (science missions) that could be enabled by this type of approach, i.e. it can enable new astrophysical imaging systems, exoplanet search, large apertures allow for unprecedented high resolution to discern continents and important features of other planets, hyperspectral imaging, adaptive systems, spectroscopy imaging through limb, and stable optical systems from Lagrange-points. Future micro-miniaturization might hold promise of a further extension of our dust aperture concept to other more exciting smart dust concepts with other associated capabilities