Optimized Particle Swarm Optimization (OPSO) and its application to artificial neural network training

BACKGROUND: Particle Swarm Optimization (PSO) is an established method for parameter optimization. It represents a population-based adaptive optimization technique that is influenced by several "strategy parameters". Choosing reasonable parameter values for the PSO is crucial for its convergence behavior, and depends on the optimization task. We present a method for parameter meta-optimization based on PSO and its application to neural network training. The concept of the Optimized Particle Swarm Optimization (OPSO) is to optimize the free parameters of the PSO by having swarms within a swarm. We assessed the performance of the OPSO method on a set of five artificial fitness functions and compared it to the performance of two popular PSO implementations. RESULTS: Our results indicate that PSO performance can be improved if meta-optimized parameter sets are applied. In addition, we could improve optimization speed and quality on the other PSO methods in the majority of our experiments. We applied the OPSO method to neural network training with the aim to build a quantitative model for predicting blood-brain barrier permeation of small organic molecules. On average, training time decreased by a factor of four and two in comparison to the other PSO methods, respectively. By applying the OPSO method, a prediction model showing good correlation with training-, test- and validation data was obtained. CONCLUSION: Optimizing the free parameters of the PSO method can result in performance gain. The OPSO approach yields parameter combinations improving overall optimization performance. Its conceptual simplicity makes implementing the method a straightforward task

Prediction of Skin Sensitization with a Particle Swarm Optimized Support Vector Machine

Skin sensitization is the most commonly reported occupational illness, causing much suffering to a wide range of people. Identification and labeling of environmental allergens is urgently required to protect people from skin sensitization. The guinea pig maximization test (GPMT) and murine local lymph node assay (LLNA) are the two most important in vivo models for identification of skin sensitizers. In order to reduce the number of animal tests, quantitative structure-activity relationships (QSARs) are strongly encouraged in the assessment of skin sensitization of chemicals. This paper has investigated the skin sensitization potential of 162 compounds with LLNA results and 92 compounds with GPMT results using a support vector machine. A particle swarm optimization algorithm was implemented for feature selection from a large number of molecular descriptors calculated by Dragon. For the LLNA data set, the classification accuracies are 95.37% and 88.89% for the training and the test sets, respectively. For the GPMT data set, the classification accuracies are 91.80% and 90.32% for the training and the test sets, respectively. The classification performances were greatly improved compared to those reported in the literature, indicating that the support vector machine optimized by particle swarm in this paper is competent for the identification of skin sensitizers

Adaptive optimization of focused compound libraries

Das Ziel des adaptiven Entwurfs von Substanzbibliotheken ist es, die vollständige biologische Testung einer molekularen Screeningbibliothek zu vermeiden. Stattdessen erfolgt, geleitet durch Optimierungsalgorithmen, eine "intelligente" Navigation durch den chemischen Raum, um so bevorzugt Substanzen mit gewünschten Eigenschaften auszuwählen. In einer retrospektiven Studie wurden die Optimierungsalgorithmen "Zufallssuche", "Simulated Annealing", "Evolutionsstrategie" und "Partikelschwarmoptimierung" im Hinblick auf den Entwurf von Bibliotheken von Serinproteaseinhibitoren systematischen verglichen. Die Gesamtzahl verfügbarer Substanztestungen wurde auf 300 beschränkt, um Laborbedingungen zu simulieren. Als Ergebnis zeigten sich besonders die Evolutionsstrategien für einen Einsatz in einer Niedrigdurchsatzscreening-Kampagne geeignet, da diese effizient mit großen Populationen und wenigen Iterationen arbeiteten. Der zweite Teil dieser Arbeit beschreibt den erfolgreichen Entwurf einer fokussierten Bibliothek von RNA-Liganden. In einer hybriden, prospektiven Optimierungsstudie wurden nach dem Vorbild einer iterativen Niedrigdurchsatzscreening-Kampagne vom Computer vorgeschlagene Moleküle im Labor getestet. Die Substanzen wurden auf Inhibition einer spezifischen molekularen Wechselwirkung im Replikationszyklus von HIV getestet (Tat-TAR-Interaktion). In vier Generationen wurden 9 von 170 untersuchten Verbindungen positiv auf Inhibition der Tat-TAR-Interaktion getestet (Trefferquote: 5,3%), wobei lediglich 0,089% der Verbindungen der Screeningbibliothek untersucht wurden. Die zwei potentesten Kandidaten wiesen einen IC50 von 51 uM bzw. 116 uM auf.The goal of adaptive library design is to avoid biological testing of a complete screening compound library. Instead, the idea is to navigate chemical space in an "intelligent" way, guided by optimization algorithms and "cherry-picking" primarily molecules with desired properties. In a retrospective study the optimization algorithms "random search", "simulated annealing", "evolution strategy", and "particle swarm optimization" were systematically compared with respect to the design of libraries of serine protease inhibitors. To simulate laboratory conditions the total number of compound tests was restricted to 300. As a result evolution strategies showed to be particularly suited for an employment in a low-throughput screening campaign as they operated efficiently with large populations and a small number of iterations. Next, the successful design of a focused library of RNA ligands is described. In a hybrid, prospective optimization study compounds were suggested by a computer program and tested in the lab in an iterative manner, following the spirit of a low-throughput screening campaign. The compounds were tested for inhibition of a specific molecular interaction in the replication cycle of HIV (Tat-TAR interaction). Within four generations 9 out of 170 screened compounds were found to inhibit the Tat-TAR interaction (hit rate: 5.3%) while only 0.089% of the screening library compounds were examined. The two most potent candidates exhibited an IC50 of 51 uM and 116 uM, respectively