Experienced grey wolf optimizer through reinforcement learning and neural networks

In this paper, a variant of Grey Wolf Optimizer (GWO) that uses reinforcement learning principles combined with neural networks to enhance the performance is proposed. The aim is to overcome, by reinforced learning, the common challenges of setting the right parameters for the algorithm. In GWO, a single parameter is used to control the exploration/exploitation rate which influences the performance of the algorithm. Rather than using a global way to change this parameter for all the agents, we use reinforcement learning to set it on an individual basis. The adaptation of the exploration rate for each agent depends on the agent’s own experience and the current terrain of the search space. In order to achieve this, an experience repository is built based on the neural network to map a set of agents’ states to a set of corresponding actions that specifically influence the exploration rate. The experience repository is updated by all the search agents to reflect experience and to enhance the future actions continuously. The resulted algorithm is called Experienced Grey Wolf Optimizer (EGWO) and its performance is assessed on solving feature selection problems and on finding optimal weights for neural networks algorithm. We use a set of performance indicators to evaluate the efficiency of the method. Results over various datasets demonstrate an advance of the EGWO over the original GWO and other meta-heuristics such as genetic algorithms and particle swarm optimizationIPROCOM Marie Curie initial training network; 10.13039/501100004963-People Programme (Marie Curie Actions) of the European Union’s Seventh Framework Programme FP7/2007-2013/; Romanian National Authority for Scientific Research, CNDI-UEFISCDI

Computational intelligence modelling of pharmaceutical tabletting processes using bio-inspired optimization algorithms

The Society of Powder Technology Japan In pharmaceutical development, it is very useful to exploit the knowledge of the causal relationship between product quality and critical material attributes (CMA) in developing new formulations and products, and optimizing manufacturing processes. With the big data captured in the pharmaceutical industry, computational intelligence (CI) models could potentially be used to identify critical quality attributes (CQA), CMA and critical process parameters (CPP). The objective of this study was to develop computational intelligence models for pharmaceutical tabletting processes, for which bio-inspired feature selection algorithms were developed and implemented for optimisation while artificial neural network (ANN) was employed to predict the tablet characteristics such as porosity and tensile strength. Various pharmaceutical excipients (MCC PH 101, MCC PH 102, MCC DG, Mannitol Pearlitol 200SD, Lactose, and binary mixtures) were considered. Granules were also produced with dry granulation using roll compaction. The feed powders and granules were then compressed at various compression pressures to produce tablets with different porosities, and the corresponding tensile strengths were measured. For the CI modelling, the efficiency of seven bio-inspired optimization algorithms were explored: grey wolf optimization (GWO), bat optimization (BAT), cuckoo search (CS), flower pollination algorithm (FPA), genetic algorithm (GA), particle swarm optimization (PSO), and social spider optimization (SSO). Two-thirds of the experimental dataset was randomly chosen as the training set, and the remaining was used to validate the model prediction. The model efficiency was evaluated in terms of the average reduction (representing the fraction of selected input variables) and the mean square error (MSE). It was found that the CI models can well predict the tablet characteristics (i.e. porosity and tensile strength). It was also shown that the GWO algorithm was the most accurate in predicting porosity. While the most accurate prediction for the tensile strength was achieved using the SSO algorithm. In terms of the average reduction, the GA algorithm resulted in the highest reduction of inputs (i.e. 60%) for predicting both the porosity and the tensile strength.This work was supported by the IPROCOM Marie Curie initial training network, funded through the People Programme (Marie Curie Actions) of the European Union’s Seventh Framework Programme FP7/2007-2013/under REA grant agreement No. 316555

Computational intelligence modeling of the macromolecules release from PLGA microspheres-focus on feature selection

Poly-lactide-co-glycolide (PLGA) is a copolymer of lactic and glycolic acid. Drug release from PLGA microspheres depends not only on polymer properties but also on drug type, particle size, morphology of microspheres, release conditions, etc. Selecting a subset of relevant properties for PLGA is a challenging machine learning task as there are over three hundred features to consider. In this work, we formulate the selection of critical attributes for PLGA as a multiobjective optimization problem with the aim of minimizing the error of predicting the dissolution profile while reducing the number of attributes selected. Four bioinspired optimization algorithms: antlion optimization, binary version of antlion optimization, grey wolf optimization, and social spider optimization are used to select the optimal feature set for predicting the dissolution profile of PLGA. Besides these, LASSO algorithm is also used for comparisons. Selection of crucial variables is performed under the assumption that both predictability and model simplicity are of equal importance to the final result. During the feature selection process, a set of input variables is employed to find minimum generalization error across different predictive models and their settings/architectures. The methodology is evaluated using predictive modeling for which various tools are chosen, such as Cubist, random forests, artificial neural networks (monotonic MLP, deep learning MLP), multivariate adaptive regression splines, classification and regression tree, and hybrid systems of fuzzy logic and evolutionary computations (fugeR). The experimental results are compared with the results reported by Szl?k. We obtain a normalized root mean square error (NRMSE) of 15.97% versus 15.4%, and the number of selected input features is smaller, nine versus eleven.This work was supported by the IPROCOM Marie Curie initial training network, funded through the People Programme (Marie Curie Actions) of the European Union’s Seventh Framework Programme FP7/2007-2013/ under REA grants agreement No. 316555, and by the Romanian National Authority for Scientific Research, CNDI-UEFISCDI, project number PN-II-PT-PCCA-2011-3.2-0917