Maximum Likelihood-based Online Adaptation of Hyper-parameters in CMA-ES

The Covariance Matrix Adaptation Evolution Strategy (CMA-ES) is widely accepted as a robust derivative-free continuous optimization algorithm for non-linear and non-convex optimization problems. CMA-ES is well known to be almost parameterless, meaning that only one hyper-parameter, the population size, is proposed to be tuned by the user. In this paper, we propose a principled approach called self-CMA-ES to achieve the online adaptation of CMA-ES hyper-parameters in order to improve its overall performance. Experimental results show that for larger-than-default population size, the default settings of hyper-parameters of CMA-ES are far from being optimal, and that self-CMA-ES allows for dynamically approaching optimal settings.Comment: 13th International Conference on Parallel Problem Solving from Nature (PPSN 2014) (2014

Metaheuristic design of feedforward neural networks: a review of two decades of research

Over the past two decades, the feedforward neural network (FNN) optimization has been a key interest among the researchers and practitioners of multiple disciplines. The FNN optimization is often viewed from the various perspectives: the optimization of weights, network architecture, activation nodes, learning parameters, learning environment, etc. Researchers adopted such different viewpoints mainly to improve the FNN's generalization ability. The gradient-descent algorithm such as backpropagation has been widely applied to optimize the FNNs. Its success is evident from the FNN's application to numerous real-world problems. However, due to the limitations of the gradient-based optimization methods, the metaheuristic algorithms including the evolutionary algorithms, swarm intelligence, etc., are still being widely explored by the researchers aiming to obtain generalized FNN for a given problem. This article attempts to summarize a broad spectrum of FNN optimization methodologies including conventional and metaheuristic approaches. This article also tries to connect various research directions emerged out of the FNN optimization practices, such as evolving neural network (NN), cooperative coevolution NN, complex-valued NN, deep learning, extreme learning machine, quantum NN, etc. Additionally, it provides interesting research challenges for future research to cope-up with the present information processing era

Neurofly 2008 abstracts : the 12th European Drosophila neurobiology conference 6-10 September 2008 Wuerzburg, Germany

This volume consists of a collection of conference abstracts

Evolution of Grasping Behaviour in Anthropomorphic Robotic Arms with Embodied Neural Controllers

The works reported in this thesis focus upon synthesising neural controllers for anthropomorphic robots that are able to manipulate objects through an automatic design process based on artificial evolution. The use of Evolutionary Robotics makes it possible to reduce the characteristics and parameters specified by the designer to a minimum, and the robot’s skills evolve as it interacts with the environment. The primary objective of these experiments is to investigate whether neural controllers that are regulating the state of the motors on the basis of the current and previously experienced sensors (i.e. without relying on an inverse model) can enable the robots to solve such complex tasks. Another objective of these experiments is to investigate whether the Evolutionary Robotics approach can be successfully applied to scenarios that are significantly more complex than those to which it is typically applied (in terms of the complexity of the robot’s morphology, the size of the neural controller, and the complexity of the task). The obtained results indicate that skills such as reaching, grasping, and discriminating among objects can be accomplished without the need to learn precise inverse internal models of the arm/hand structure. This would also support the hypothesis that the human central nervous system (cns) does necessarily have internal models of the limbs (not excluding the fact that it might possess such models for other purposes), but can act by shifting the equilibrium points/cycles of the underlying musculoskeletal system. Consequently, the resulting controllers of such fundamental skills would be less complex. Thus, the learning of more complex behaviours will be easier to design because the underlying controller of the arm/hand structure is less complex. Moreover, the obtained results also show how evolved robots exploit sensory-motor coordination in order to accomplish their tasks

Computational Design Optimization of Arc Welding Process for Reduced Distortion in Welded Structures

An effective approach to determine optimum welding process parameters is implementation of advanced computer aided engineering (CAE) tool that integrates efficient optimization techniques and numerical welding simulation. In this thesis, an automated computational methodology to determine optimum arc welding process parameters is proposed. It is a coupled Genetic Algorithms (GA) and Finite Element (FE) based optimization method where GA directly utilizes output responses of FE based welding simulations for iterative optimization. Effectiveness of the method has been demonstrated by predicting optimum parameters of a lap joint specimen of two thin steel plates and automotive structure of nonlinear welding path for minimum distortion. Three dimensional FE models have been developed to simulate the arc welding process and subsequently, the models have been used by GA as the evaluation model for optimization. The optimization results show that such a CAE based methodology can contribute to facilitate the product design and development

Multi-Objective structural optimization of repairs of blisk blades

Modern manufacturing technologies offer multiple options to extend the service life of expensive jet engine components through repairs. In this context, the repair processes of blade-integrated disks (blisks) are of particular interest, as the complex design makes replacement of this part very costly. However, currently, repairs of blisks are mainly done manually and repair design decisions still rely on the expertise of maintenance technicians. From a scientific perspective, these subjective, experience-based decisions are a major drawback, as today’s computational methods allow for systematic analysis and evaluation of design alternatives. The present doctoral thesis contributes to the decision-making process related to the repair of blisk blades by blending and patching by providing an engineering optimization framework and simulation routines for structural assessment of different repair designs. First, an object-oriented optimization framework is developed that is ideally suited to address engineering optimization problems such as blisk repair optimization. The design of the software architecture is chosen to achieve a high degree of flexibility and modularity. In particular, the framework provides a unified interface for global and local derivative-free optimization algorithms and custom engineering optimization problems. Thereby, optimization of single- as well as multi-objective problems is supported. The broad applicability of the framework in engineering optimization is demonstrated using examples from wind energy research. Furthermore, the optimization framework forms a suitable environment for structural multi-objective optimization of blend and patch repairs. The second part of this thesis is devoted to the application of the optimization framework to blend repairs of a compressor blisk. The geometry of the removed blade part and the resulting blend is parameterized by three geometric design variables. The two objectives of the optimization correspond to two modal criteria, because especially the vibration behavior of blades is affected by this kind of geometric modification. To check if frequency requirements are harmed by the repair the first objective reflects the deviation of the natural frequencies of the repaired blade to the natural frequencies of the nominal blade. The second objective considers resonance conditions by evaluating the proximity of natural frequencies to excitation frequencies. Pareto optimal repair designs are found by solving the derived optimization problem using appropriate structural mechanics models of a blade sector and employing the developed optimization framework. By analyzing the optimal blend shapes for two different damage patterns, it is shown that the characteristics of Pareto frontiers, like the occurrence of discontinuities, are damage-specific. Therefore, it is concluded that design decisions on blend repairs have to be made on a case-by-case basis. The third part of this thesis is concerned with the multi-objective optimization of patch repairs. While blend repairs change the blade geometry, patch repairs restore the original blade contour. In terms of structural integrity, the most significant modification due to patching is hence associated with the welding process to join patch and blade. The remaining residual stresses, affect the strength of the repaired blade, are therefore the most critical aspect of patch repairs. Utilizing the engineering optimization framework and the parametric simulation model, a multi-objective optimization problem is solved considering the length of the weld and the fatigue strength of the repaired blade. In addition to fatigue strength properties, the weld length is selected as an optimization goal, since the manufacturing effort of the high-tech repair is of practical importance. Pareto optimal repair designs are presented for a damage pattern at the leading edge. The optimization results are further complemented by subsequent thermal and mechanical simulations of the welding and heat treatment process. Different patch geometries are classified from the Pareto optimal solutions. Depending on the preferences in terms of weld length and the High-Cycle Fatigue strength of different load cases, short or long patches are to be used. In addition, the results show that some potential patch designs are not optimal in any case, and therefore can be completely excluded. Finally, the benefits of the unified interface of the engineering optimization framework are emphasized. Different optimization settings of a patch repair optimization are presented and compared utilizing the hypervolume metric. Concluding remarks on the potential of computational methods for improved repair design and an outlook on future maintenance of blisks complete this work.DFG/SFB 871/119 193 472./E

Diffusion-Weighted Imaging: Recent Advances and Applications

Quantitative diffusion imaging techniques enable the characterization of tissue microstructural properties of the human brain “in vivo”, and are widely used in neuroscientific and clinical contexts. In this review, we present the basic physical principles behind diffusion imaging and provide an overview of the current diffusion techniques, including standard and advanced techniques as well as their main clinical applications. Standard diffusion tensor imaging (DTI) offers sensitivity to changes in microstructure due to diseases and enables the characterization of single fiber distributions within a voxel as well as diffusion anisotropy. Nonetheless, its inability to represent complex intravoxel fiber topologies and the limited biological specificity of its metrics motivated the development of several advanced diffusion MRI techniques. For example, high-angular resolution diffusion imaging (HARDI) techniques enabled the characterization of fiber crossing areas and other complex fiber topologies in a single voxel and supported the development of higher-order signal representations aiming to decompose the diffusion MRI signal into distinct microstructure compartments. Biophysical models, often known by their acronym (e.g., CHARMED, WMTI, NODDI, DBSI, DIAMOND) contributed to capture the diffusion properties from each of such tissue compartments, enabling the computation of voxel-wise maps of axonal density and/or morphology that hold promise as clinically viable biomarkers in several neurological and neuroscientific applications; for example, to quantify tissue alterations due to disease or healthy processes. Current challenges and limitations of state-of-the-art models are discussed, including validation efforts. Finally, novel diffusion encoding approaches (e.g., b-tensor or double diffusion encoding) may increase the biological specificity of diffusion metrics towards intra-voxel diffusion heterogeneity in clinical settings, holding promise in neurological applications

AN APPROACH TO INVERSE MODELING THROUGH THE INTEGRATION OF ARTIFICIAL NEURAL NETWORKS AND GENETIC ALGORITHMS

A hybrid model integrating predictive capabilities of Artificial Neural Network (ANN) and optimization feature of Genetic Algorithm (GA) is developed for the purpose of inverse modeling. The proposed approach is applied to Superplastic forming of materials to predict the material properties which characterize the performance of a material. The study is carried out on two problems. For the first problem, ANN is trained to predict the strain rate sensitivity index m given the temperature and the strain rate. The performance of different gradient search methods used in training the ANN model is demonstrated. Similar approach is used for the second problem. The objective of which is to predict the input parameters, i.e. strain rate and temperature corresponding to a given flow stress value. An attempt to address one of the major drawbacks of ANN, which is the black box behavior of the model, is made by collecting information about the weights and biases used in training and formulating a mathematical expression. The results from the two problems are compared to the experimental data and validated. The results indicated proximity to the experimental data

Novel cardiovascular magnetic resonance phenotyping of the myocardium

INTRODUCTION Left ventricular (LV) microstructure is unique, composed of a winding helical pattern of myocytes and rotating aggregations of myocytes called sheetlets. Hypertrophic cardiomyopathy (HCM) is a cardiovascular disease characterised by left ventricular hypertrophy (LVH), however the link between LVH and underlying microstructural aberration is poorly understood. In vivo cardiovascular diffusion tensor imaging (cDTI) is a novel cardiovascular MRI (CMR) technique, capable of characterising LV microstructural dynamics non-invasively. In vivo cDTI may therefore improve our understanding microstructural-functional relationships in health and disease. METHODS AND RESULTS The monopolar diffusion weighted stimulated echo acquisition mode (DW-STEAM) sequence was evaluated for in vivo cDTI acquisitions at 3Tesla, in healthy volunteers (HV), patients with hypertensive LVH, and HCM patients. Results were contextualised in relation to extensively explored technical limitations. cDTI parameters demonstrated good intra-centre reproducibility in HCM, and good inter-centre reproducibility in HV. In all subjects, cDTI was able to depict the winding helical pattern of myocyte orientation known from histology, and the transmural rate of change in myocyte orientation was dependent on LV size and thickness. In HV, comparison of cDTI parameters between systole and diastole revealed an increase in transmural gradient, combined with a significant re-orientation of sheetlet angle. In contrast, in HCM, myocyte gradient increased between phases, however sheetlet angulation retained a systolic-like orientation in both phases. Combined analysis with hypertensive patients revealed a proportional decrease in sheetlet mobility with increasing LVH. CONCLUSION In vivo DW-STEAM cDTI can characterise LV microstructural dynamics non-invasively. The transmural rate of change in myocyte angulation is dependent on LV size and wall thickness, however inter phase changes in myocyte orientation are unaffected by LVH. In contrast, sheetlet dynamics demonstrate increasing dysfunction, in proportion to the degree of LVH. Resolving technical limitations is key to advancing this technique, and improving the understanding of the role of microstructural abnormalities in cardiovascular disease expression.Open Acces