Optimal input design and parameter estimation for continuous-time dynamical systems

Diese Arbeit behandelt die Themengebiete Design of Experiments (DoE) und Parameterschätzung für zeitkontinuierliche Systeme, welche in der modernen Regelungstheorie eine wichtige Rolle spielen. Im gewählten Kontext untersucht DoE die Auswirkungen von verschiedenen Rahmenbedingungen von Simulations- bzw. Messexperimenten auf die Qualität der Parameterschätzung, wobei der Fokus auf der Anwendung der Theorie auf praxisrelevante Problemstellungen liegt. Dafür wird die weithin bekannte Fisher-Matrix eingeführt und die resultierende nicht lineare Optimierungsaufgabe angeschrieben. An einem PT1-System wird der Informationsgehalt von Signalen und dessen Auswirkungen auf die Parameterschätzung gezeigt. Danach konzentriert sich die Arbeit auf ein Teilgebiet von DoE, nämlich Optimal Input Design (OID), und wird am Beispiel eines 1D-Positioniersystems im Detail untersucht. Ein Vergleich mit häufig verwendeten Anregungssignalen zeigt, dass generierte Anregungssignale (OID) oft einen höheren Informationsgehalt aufweisen und mit genaueren Schätzwerten einhergeht. Zusätzlicher Benefit ist, dass Beschränkungen an Eingangs-, Ausgangs- und Zustandsgrößen einfach in die Optimierungsaufgabe integriert werden können. Der zweite Teil der Arbeit behandelt Methoden zur Parameterschätzung von zeitkontinuierlichen Modellen mit dem Fokus auf der Verwendung von Modulationsfunktionen (MF) bzw. Poisson-Moment Functionals (PMF) zur Vermeidung der zeitlichen Ableitungen und Least-Squares zur Lösung des resultierenden überbestimmten Gleichungssystems. Bei verrauschten Messsignalen ergibt sich daraus sofort die Problematik von nicht erwartungstreuen Schätzergebnissen (Bias). Aus diesem Grund werden Methoden zur Schätzung und Kompensation von Bias Termen diskutiert. Beitrag dieser Arbeit ist vor allem die detaillierte Aufarbeitung eines Ansatzes zur Biaskompensation bei Verwendung von PMF und Least-Squares für lineare Systeme und dessen Erweiterung auf (leicht) nicht lineare Systeme. Der vorgestellte Ansatz zur Biaskompensation (BC-OLS) wird am nicht linearen 1D-Servo in der Simulation und mit Messdaten validiert und in der Simulation mit anderen Methoden, z.B., Total-Least-Squares verglichen. Zusätzlich wird der Ansatz von PMF auf die weiter gefasste Systemklasse der Modulationsfunktionen (MF) erweitert. Des Weiteren wird ein praxisrelevantes Problem der Parameteridentifikation diskutiert, welches auftritt, wenn das Systemverhalten nicht gänzlich von der Identifikationsgleichung beschrieben wird. Am 1D-Servo wird gezeigt, dass ein Deaktivieren und Reaktivieren der PMF Filter mit geeigneter Initialisierung diese Problematik einfach löst.This thesis addresses two topics that play a significant role in modern control theory: design of experiments (DoE) and parameter estimation methods for continuous-time (CT) models. In this context, DoE focuses on the impact of experimental design regarding the accuracy of a subsequent estimation of unknown model parameters and applying the theory to real-world applications and its detailed analysis. We introduce the Fisher-information matrix (FIM), consisting of the parameter sensitivities and the resulting highly nonlinear optimization task. By a first-order system, we demonstrate the computation of the information content, its visualization, and an illustration of the effects of higher Fisher information on parameter estimation quality. After that, the topic optimal input design (OID), a subarea of DoE, will be thoroughly explored on the practice-relevant linear and nonlinear model of a 1D-position servo system. Comparison with standard excitation signals shows that the OID signals generally provide higher information content and lead to more accurate parameter estimates using least-squares methods. Besides, this approach allows taking into account constraints on input, output, and state variables. In the second major topic of this thesis, we treat parameter estimation methods for CT systems, which provide several advantages to identify discrete-time (DT) systems, e.g., allows physical insight into model parameters. We focus on modulating function method (MFM) or Poisson moment functionals (PMF) and least-squares to estimate unknown model parameters. In the case of noisy measurement data, the problem of biased parameter estimation arises immediately. That is why we discuss the computation and compensation of the so-called estimation bias in detail. Besides the detailed elaboration of a bias compensating estimation method, this work’s main contribution is, based on PMF and least squares for linear systems, the extension to at least slightly nonlinear systems. The derived bias-compensated ordinary least-squares (BCOLS) approach for obtaining asymptotically unbiased parameter estimates is tested on a nonlinear 1D-servo model in the simulation and measurement. A comparison with other methods for bias compensation or avoidance, e.g., total least-squares (TLS), is performed. Additionally, the BC-OLS method is applied to the more general MFM. Furthermore, a practical issue of parameter estimation is discussed, which occurs when the system behavior leaves and re-enters the space covered by the identification equation. Using the 1D-servo system, one can show that disabling and re-enabling the PMF filters with appropriate initialization can solve this problem

Fourth NASA Workshop on Computational Control of Flexible Aerospace Systems, part 1

The proceedings of the workshop are presented. Some areas of discussion are as follows: modeling, systems identification, and control of flexible aircraft, spacecraft, and robotic systems

Prognostics and health management of power electronics

Prognostics and health management (PHM) is a major tool enabling systems to evaluate their reliability in real-time operation. Despite ground-breaking advances in most engineering and scientific disciplines during the past decades, reliability engineering has not seen significant breakthroughs or noticeable advances. Therefore, self-awareness of the embedded system is also often required in the sense that the system should be able to assess its own health state and failure records, and those of its main components, and take action appropriately. This thesis presents a radically new prognostics approach to reliable system design that will revolutionise complex power electronic systems with robust prognostics capability enhanced Insulated Gate Bipolar Transistors (IGBT) in applications where reliability is significantly challenging and critical. The IGBT is considered as one of the components that is mainly damaged in converters and experiences a number of failure mechanisms, such as bond wire lift off, die attached solder crack, loose gate control voltage, etc. The resulting effects mentioned are complex. For instance, solder crack growth results in increasing the IGBT’s thermal junction which becomes a source of heat turns to wire bond lift off. As a result, the indication of this failure can be seen often in increasing on-state resistance relating to the voltage drop between on-state collector-emitter. On the other hand, hot carrier injection is increased due to electrical stress. Additionally, IGBTs are components that mainly work under high stress, temperature and power consumptions due to the higher range of load that these devices need to switch. This accelerates the degradation mechanism in the power switches in discrete fashion till reaches failure state which fail after several hundred cycles. To this end, exploiting failure mechanism knowledge of IGBTs and identifying failure parameter indication are background information of developing failure model and prognostics algorithm to calculate remaining useful life (RUL) along with ±10% confidence bounds. A number of various prognostics models have been developed for forecasting time to failure of IGBTs and the performance of the presented estimation models has been evaluated based on two different evaluation metrics. The results show significant improvement in health monitoring capability for power switches.Furthermore, the reliability of the power switch was calculated and conducted to fully describe health state of the converter and reconfigure the control parameter using adaptive algorithm under degradation and load mission limitation. As a result, the life expectancy of devices has been increased. These all allow condition-monitoring facilities to minimise stress levels and predict future failure which greatly reduces the likelihood of power switch failures in the first place

Review : Deep learning in electron microscopy

Deep learning is transforming most areas of science and technology, including electron microscopy. This review paper offers a practical perspective aimed at developers with limited familiarity. For context, we review popular applications of deep learning in electron microscopy. Following, we discuss hardware and software needed to get started with deep learning and interface with electron microscopes. We then review neural network components, popular architectures, and their optimization. Finally, we discuss future directions of deep learning in electron microscopy

Color image quality measures and retrieval

The focus of this dissertation is mainly on color image, especially on the images with lossy compression. Issues related to color quantization, color correction, color image retrieval and color image quality evaluation are addressed. A no-reference color image quality index is proposed. A novel color correction method applied to low bit-rate JPEG image is developed. A novel method for content-based image retrieval based upon combined feature vectors of shape, texture, and color similarities has been suggested. In addition, an image specific color reduction method has been introduced, which allows a 24-bit JPEG image to be shown in the 8-bit color monitor with 256-color display. The reduction in download and decode time mainly comes from the smart encoder incorporating with the proposed color reduction method after color space conversion stage. To summarize, the methods that have been developed can be divided into two categories: one is visual representation, and the other is image quality measure. Three algorithms are designed for visual representation: (1) An image-based visual representation for color correction on low bit-rate JPEG images. Previous studies on color correction are mainly on color image calibration among devices. Little attention was paid to the compressed image whose color distortion is evident in low bit-rate JPEG images. In this dissertation, a lookup table algorithm is designed based on the loss of PSNR in different compression ratio. (2) A feature-based representation for content-based image retrieval. It is a concatenated vector of color, shape, and texture features from region of interest (ROI). (3) An image-specific 256 colors (8 bits) reproduction for color reduction from 16 millions colors (24 bits). By inserting the proposed color reduction method into a JPEG encoder, the image size could be further reduced and the transmission time is also reduced. This smart encoder enables its decoder using less time in decoding. Three algorithms are designed for image quality measure (IQM): (1) A referenced IQM based upon image representation in very low-dimension. Previous studies on IQMs are based on high-dimensional domain including spatial and frequency domains. In this dissertation, a low-dimensional domain IQM based on random projection is designed, with preservation of the IQM accuracy in high-dimensional domain. (2) A no-reference image blurring metric. Based on the edge gradient, the degree of image blur can be measured. (3) A no-reference color IQM based upon colorfulness, contrast and sharpness