Learning and identification of fuzzy systems

This thesis concentrates on learning and identification of fuzzy systems, and this thesis is composed about learning fuzzy systems from data for regression and function approximation by constructing complete, compact, and consistent fuzzy systems. Fuzzy systems are prevalent to solve pattern recognition problems and function approximation problems as a result of the good knowledge representation. With the development of fuzzy systems, a lot of sophisticated methods based on them try to completely solve pattern recognition problems and function approximation problems by constructing a great diversity of mathematical models. However, there exists a conflict between the degree of the interpretability and the accuracy of the approximation in general fuzzy systems. Thus, how to properly make the best compromise between the accuracy of the approximation and the degree of the interpretability in the entire system is a significant study of the subject.The first work of this research is concerned with the clustering technique on constructing fuzzy models in fuzzy system identification, and this method is a part of clustering based learning of fuzzy systems. As the determination of the proper number of clusters and the appropriate location of clusters is one of primary considerations on constructing an effectively fuzzy model, the task of the clustering technique aims at recognizing the proper number of clusters and the appropriate location as far as possible, which gives a good preparation for the construction of fuzzy models. In order to acquire the mutually exclusive performance by constructing effectively fuzzy models, a modular method to fuzzy system identification based on a hybrid clustering-based technique has been considered. Due to the above reasons, a hybrid clustering algorithm concerning input, output, generalization and specialization has hence been introduced in this work. Thus, the primary advantage of this work is the proposed clustering technique integrates a variety of clustering properties to positively identify the proper number of clusters and the appropriate location of clusters by carrying out a good performance of recognizing the precise position of each dataset, and this advantage brings fuzzy systems more complete.The second work of this research is an extended work of the first work, and two ways to improve the original work have been considered in the extended work, including the pruning strategy for simplifying the structure of fuzzy systems and the optimization scheme for parameters optimization. So far as the pruning strategy is concerned, the purpose of which aims at refining rule base by the similarity analysis of fuzzy sets, fuzzy numbers, fuzzy membership functions or fuzzy rules. By other means, through the similarity analysis of which, the complete rules can be kept and the redundant rules can be reduced probably in the rule base of fuzzy systems. Also, the optimization scheme can be regarded as a two-layer parameters optimization in the extended work, because the parameters of the initial fuzzy model have been fine tuning by two phases gradation on layer. Hence, the extended work primarily puts focus on enhancing the performance of the initial fuzzy models toward the positive reliability of the final fuzzy models. Thus, the primary advantage of this work consists of the simplification of fuzzy rule base by the similarity-based pruning strategy, as well as more accuracy of the optimization by the two-layer optimization scheme, and these advantages bring fuzzy systems more compact and precise.So far as a perfect modular method for fuzzy system identification is concerned, in addition to positively solve pattern recognition problems and function approximation problems, it should primarily comprise the following features, including the well-understanding interpretability, low-degree dimensionality, highly reliability, stable robustness, highly accuracy of the approximation, less computational cost, and maximum performance. However, it is extremely difficult to meet all of these conditions above. Inasmuch as attaining the highly achievement from the features above as far as possible, the research works of this thesis try to present a modular method concerning a variety of requirements to fuzzy systems identification.EThOS - Electronic Theses Online ServiceGBUnited Kingdo

Development of new methodologies for the weight estimation of aircraft structures

The problem of weight estimation in the aerospace industry has been acquiring considerably greater importance in recent years, due to the numerous challenges frequently encountered in the preliminary phases of the design of a new aircraft. This is the stage where it is possible to make design changes without incurring into excessive cost penalties. On the other hand, the knowledge of the design, of the relationships existing between the different variables and their subsequent impact on the final weight of the structure is very limited. As a result, the designer is unable to understand the true effect that individual design decisions will produce on the weight of the structure. In addition to this, new aircraft concepts end up being too conservative, due to the high dependency of current weight estimation methods to historical data and off-the-shelf design solutions. This thesis aims at providing an alternative framework for the weight estimation of aircraft structures at preliminary design stages. By conducting a thorough assessment of current state-of-the-art approaches and tools used in the field, fuzzy logic is presented as an appropriate foundation on which to build an innovative approach to the problem. Different adaptive fuzzy approaches have been used in the development of a methodology which is able to combine an analytical base to the structural design of selected trailing edge components, with substantial knowledge acquisition capabilities for the computation of robust and reliable weight estimates. The final framework allows considerable flexibility in the level of detail of the estimate consistent with the granularity of the input data used. This, combined with an extensive uncertainty analysis through the use of Interval Type-2 fuzzy logic, will provide the designer with the capabilities to understand the impact of error propagation within the model and increase the confidence in the final estimat

Artificial cognitive architecture with self-learning and self-optimization capabilities. Case studies in micromachining processes

Tesis doctoral inédita leída en la Universidad Autónoma de Madrid, Escuela Politécnica Superior, Departamento de Ingeniería Informática. Fecha de lectura : 22-09-201

Advanced Mathematics and Computational Applications in Control Systems Engineering

Control system engineering is a multidisciplinary discipline that applies automatic control theory to design systems with desired behaviors in control environments. Automatic control theory has played a vital role in the advancement of engineering and science. It has become an essential and integral part of modern industrial and manufacturing processes. Today, the requirements for control precision have increased, and real systems have become more complex. In control engineering and all other engineering disciplines, the impact of advanced mathematical and computational methods is rapidly increasing. Advanced mathematical methods are needed because real-world control systems need to comply with several conditions related to product quality and safety constraints that have to be taken into account in the problem formulation. Conversely, the increment in mathematical complexity has an impact on the computational aspects related to numerical simulation and practical implementation of the algorithms, where a balance must also be maintained between implementation costs and the performance of the control system. This book is a comprehensive set of articles reflecting recent advances in developing and applying advanced mathematics and computational applications in control system engineering

BIM-based software for construction waste analytics using artificial intelligence hybrid models

The Construction industry generates about 30% of the total waste in the UK. Current high landfill cost and severe environmental impact of waste reveals the need to reduce waste generated from construction activities. Although literature reveals that the best approach to Construction Waste (CW) management is minimization at the design stage, current tools are not robust enough to support architects and design engineers. Review of extant literature reveals that the key limitations of existing CW management tools are that they are not integrated with the design process and that they lack Building Information Modelling (BIM) compliance. This is because the tools are external to design BIM tools used by architects and design engineers. This study therefore investigates BIM-based strategies for CW management and develops Artificial Intelligent (AI) hybrid models to predict CW at the design stage. The model was then integrated into Autodesk Revit as an add-in (BIMWaste) to provide CW analytics. Based on a critical realism paradigm, the study adopts exploratory sequential mixed methods, which combines both qualitative and quantitative methods into a single study. The study starts with the review of extant literature and (FGIs) with industry practitioners. The transcripts of the FGIs were subjected to thematic analysis to identify prevalent themes from the quotations. The factors from literature review and FGIs were then combined and put together in a questionnaire survey and distributed to industry practitioners. The questionnaire responses were subjected to rigorous statistical process to identify key strategies for BIM-based approach to waste efficient design coordination. Results of factor analysis revealed five groups of BIM strategies for CW management, which are: (i)improved collaboration for waste management, (ii)waste-driven design process and solutions, (iii)lifecycle waste analytics, (iv) Innovative technologies for waste intelligence and analytics, and (v)improved documentation for waste management. The results improve the understanding of BIM functionalities and how they could improve the effectiveness of existing CW management tools. Thereafter, the key strategies were developed into a holistic BIM framework for CW management. This was done to incorporate industrial and technological requirements for BIM enabled waste management into an integrated system.The framework guided the development of AI hybrid models and BIM based tool for CW management. Adaptive Neuro-Fuzzy Inference System (ANFIS) model was developed for CW prediction and mathematical models were developed for CW minimisation. Based on historical Construction Waste Record (CWR) from 117 building projects, the model development reveals that two key predictors of CW are “GFA” and “Construction Type”. The final models were then incorporated into Autodesk Revit to enable the prediction of CW from building designs. The performance of the final tool was tested using a test plan and two test cases. The results show that the tool performs well and that it predicts CW according to waste types, element types, and building levels. The study generated several implications that would be of interest to several stakeholders in the construction industry. Particularly, the study provides a clear direction on how CW management strategies could be integrated into BIM platform to streamline the CW analytics

Classification of Explainable Artificial Intelligence Methods through Their Output Formats

Machine and deep learning have proven their utility to generate data-driven models with high accuracy and precision. However, their non-linear, complex structures are often difficult to interpret. Consequently, many scholars have developed a plethora of methods to explain their functioning and the logic of their inferences. This systematic review aimed to organise these methods into a hierarchical classification system that builds upon and extends existing taxonomies by adding a significant dimension—the output formats. The reviewed scientific papers were retrieved by conducting an initial search on Google Scholar with the keywords “explainable artificial intelligence”; “explainable machine learning”; and “interpretable machine learning”. A subsequent iterative search was carried out by checking the bibliography of these articles. The addition of the dimension of the explanation format makes the proposed classification system a practical tool for scholars, supporting them to select the most suitable type of explanation format for the problem at hand. Given the wide variety of challenges faced by researchers, the existing XAI methods provide several solutions to meet the requirements that differ considerably between the users, problems and application fields of artificial intelligence (AI). The task of identifying the most appropriate explanation can be daunting, thus the need for a classification system that helps with the selection of methods. This work concludes by critically identifying the limitations of the formats of explanations and by providing recommendations and possible future research directions on how to build a more generally applicable XAI method. Future work should be flexible enough to meet the many requirements posed by the widespread use of AI in several fields, and the new regulation

Modularity in artificial neural networks

Artificial neural networks are deep machine learning models that excel at complex artificial intelligence tasks by abstracting concepts through multiple layers of feature extraction. Modular neural networks are artificial neural networks that are composed of multiple subnetworks called modules. The study of modularity has a long history in the field of artificial neural networks and many of the actively studied models in the domain of artificial neural networks have modular aspects. In this work, we aim to formalize the study of modularity in artificial neural networks and outline how modularity can be used to enhance some neural network performance measures. We do an extensive review of the current practices of modularity in the literature. Based on that, we build a framework that captures the essential properties characterizing the modularization process. Using this modularization framework as an anchor, we investigate the use of modularity to solve three different problems in artificial neural networks: balancing latency and accuracy, reducing model complexity and increasing robustness to noise and adversarial attacks. Artificial neural networks are high-capacity models with high data and computational demands. This represents a serious problem for using these models in environments with limited computational resources. Using a differential architectural search technique, we guide the modularization of a fully-connected network into a modular multi-path network. By evaluating sampled architectures, we can establish a relation between latency and accuracy that can be used to meet a required soft balance between these conflicting measures. A related problem is reducing the complexity of neural network models while minimizing accuracy loss. CapsNet is a neural network architecture that builds on the ideas of convolutional neural networks. However, the original architecture is shallow and has wide layers that contribute significantly to its complexity. By replacing the early wide layers by parallel deep independent paths, we can significantly reduce the complexity of the model. Combining this modular architecture with max-pooling, DropCircuit regularization and a modified variant of the routing algorithm, we can achieve lower model latency with the same or better accuracy compared to the baseline. The last problem we address is the sensitivity of neural network models to random noise and to adversarial attacks, a highly disruptive form of engineered noise. Convolutional layers are the basis of state-of-the-art computer vision models and, much like other neural network layers, they suffer from sensitivity to noise and adversarial attacks. We introduce the weight map layer, a modular layer based on the convolutional layer, that can increase model robustness to noise and adversarial attacks. We conclude our work by a general discussion about the investigated relation between modularity and the addressed problems and potential future research directions

Measurements, Models, Systems and Design

531 s.