Depth of anesthesia control using internal model control techniques

The major difficulty in the design of closed-loop control during anaesthesia is the inherent patient variability due to differences in demographic and drug tolerance. These discrepancies are translated into the pharmacokinetics (PK), and pharmacodynamics (PD). These uncertainties may affect the stability of the closed loop control system. This paper aims at developing predictive controllers using Internal Model Control technique. This study develops patient dose-response models and to provide an adequate drug administration regimen for the anaesthesia to avoid under or over dosing of the patients. The controllers are designed to compensate for patients inherent drug response variability, to achieve the best output disturbance rejection, and to maintain optimal set point response. The results are evaluated compared with traditional PID controller and the performance is confirmed in our simulation

A model-free control strategy for an experimental greenhouse with an application to fault accommodation

Writing down mathematical models of agricultural greenhouses and regulating them via advanced controllers are challenging tasks since strong perturbations, like meteorological variations, have to be taken into account. This is why we are developing here a new model-free control approach and the corresponding intelligent controllers, where the need of a good model disappears. This setting, which has been introduced quite recently and is easy to implement, is already successful in many engineering domains. Tests on a concrete greenhouse and comparisons with Boolean controllers are reported. They not only demonstrate an excellent climate control, where the reference may be modified in a straightforward way, but also an efficient fault accommodation with respect to the actuators

Batch Policy Learning under Constraints

When learning policies for real-world domains, two important questions arise: (i) how to efficiently use pre-collected off-policy, non-optimal behavior data; and (ii) how to mediate among different competing objectives and constraints. We thus study the problem of batch policy learning under multiple constraints, and offer a systematic solution. We first propose a flexible meta-algorithm that admits any batch reinforcement learning and online learning procedure as subroutines. We then present a specific algorithmic instantiation and provide performance guarantees for the main objective and all constraints. To certify constraint satisfaction, we propose a new and simple method for off-policy policy evaluation (OPE) and derive PAC-style bounds. Our algorithm achieves strong empirical results in different domains, including in a challenging problem of simulated car driving subject to multiple constraints such as lane keeping and smooth driving. We also show experimentally that our OPE method outperforms other popular OPE techniques on a standalone basis, especially in a high-dimensional setting

Performance-based control system design automation via evolutionary computing

This paper develops an evolutionary algorithm (EA) based methodology for computer-aided control system design (CACSD) automation in both the time and frequency domains under performance satisfactions. The approach is automated by efficient evolution from plant step response data, bypassing the system identification or linearization stage as required by conventional designs. Intelligently guided by the evolutionary optimization, control engineers are able to obtain a near-optimal ‘‘off-thecomputer’’ controller by feeding the developed CACSD system with plant I/O data and customer specifications without the need of a differentiable performance index. A speedup of near-linear pipelineability is also observed for the EA parallelism implemented on a network of transputers of Parsytec SuperCluster. Validation results against linear and nonlinear physical plants are convincing, with good closed-loop performance and robustness in the presence of practical constraints and perturbations