Interactive Decomposition Multi-Objective Optimization via Progressively Learned Value Functions

Decomposition has become an increasingly popular technique for evolutionary multi-objective optimization (EMO). A decomposition-based EMO algorithm is usually designed to approximate a whole Pareto-optimal front (PF). However, in practice, the decision maker (DM) might only be interested in her/his region of interest (ROI), i.e., a part of the PF. Solutions outside that might be useless or even noisy to the decision-making procedure. Furthermore, there is no guarantee to find the preferred solutions when tackling many-objective problems. This paper develops an interactive framework for the decomposition-based EMO algorithm to lead a DM to the preferred solutions of her/his choice. It consists of three modules, i.e., consultation, preference elicitation and optimization. Specifically, after every several generations, the DM is asked to score a few candidate solutions in a consultation session. Thereafter, an approximated value function, which models the DM's preference information, is progressively learned from the DM's behavior. In the preference elicitation session, the preference information learned in the consultation module is translated into the form that can be used in a decomposition-based EMO algorithm, i.e., a set of reference points that are biased toward to the ROI. The optimization module, which can be any decomposition-based EMO algorithm in principle, utilizes the biased reference points to direct its search process. Extensive experiments on benchmark problems with three to ten objectives fully demonstrate the effectiveness of our proposed method for finding the DM's preferred solutions.Comment: 25 pages, 18 figures, 3 table

Dynamic Multi-Objectives Optimization with a Changing Number of Objectives

This is the author accepted manuscript. The final version is available from IEEE via the DOI in this record.Existing studies on dynamic multiobjective optimization (DMO) focus on problems with time-dependent objective functions, while the ones with a changing number of objectives have rarely been considered in the literature. Instead of changing the shape or position of the Pareto-optimal front/set (PF/PS) when having time-dependent objective functions, increasing or decreasing the number of objectives usually leads to the expansion or contraction of the dimension of the PF/PS manifold. Unfortunately, most existing dynamic handling techniques can hardly be adapted to this type of dynamics. In this paper, we report our attempt toward tackling the DMO problems with a changing number of objectives. We implement a dynamic two-archive evolutionary algorithm which maintains two co-evolving populations simultaneously. In particular, these two populations are complementary to each other: one concerns more about the convergence while the other concerns more about the diversity. The compositions of these two populations are adaptively reconstructed once the environment changes. In addition, these two populations interact with each other via a mating selection mechanism. Comprehensive experiments are conducted on various benchmark problems with a time-dependent number of objectives. Empirical results fully demonstrate the effectiveness of our proposed algorithm.Engineering and Physical Sciences Research Council (EPSRC)NSF

Equal Force Recovery in Dysferlin-Deficient and Wild-Type Muscles Following Saponin Exposure

Dysferlin plays an important role in repairing membrane damage elicited by laser irradiation, and dysferlin deficiency causes muscular dystrophy and associated cardiomyopathy. Proteins such as perforin, complement component C9, and bacteria-derived cytolysins, as well as the natural detergent saponin, can form large pores on the cell membrane via complexation with cholesterol. However, it is not clear whether dysferlin plays a role in repairing membrane damage induced by pore-forming reagents. In this study, we observed that dysferlin-deficient muscles recovered the tetanic force production to the same extent as their WT counterparts following a 5-min saponin exposure (50 μg/mL). Interestingly, the slow soleus muscles recovered significantly better than the fast extensor digitorum longus (EDL) muscles. Our data suggest that dysferlin is unlikely involved in repairing saponin-induced membrane damage and that the slow muscle is more efficient than the fast muscle in repairing such damage

Integration of Preferences in Decomposition Multiobjective Optimization

This is the author accepted manuscript. The final version is available from IEEE via the DOI in this record.© 2018 IEEE. Rather than a whole Pareto-optimal front, which demands too many points (especially in a high-dimensional space), the decision maker (DM) may only be interested in a partial region, called the region of interest (ROI). In this case, solutions outside this region can be noisy to the decision-making procedure. Even worse, there is no guarantee that we can find the preferred solutions when tackling problems with complicated properties or many objectives. In this paper, we develop a systematic way to incorporate the DM's preference information into the decomposition-based evolutionary multiobjective optimization methods. Generally speaking, our basic idea is a nonuniform mapping scheme by which the originally evenly distributed reference points on a canonical simplex can be mapped to new positions close to the aspiration-level vector supplied by the DM. By this means, we are able to steer the search process toward the ROI either directly or interactively and also handle many objectives. Meanwhile, solutions lying on the boundary can be approximated as well given the DM's requirements. Furthermore, the extent of the ROI is intuitively understandable and controllable in a closed form. Extensive experiments on a variety of benchmark problems with 2 to 10 objectives, fully demonstrate the effectiveness of our proposed method for approximating the preferred solutions in the ROI.Royal Society (Government)Ministry of Science and Technology of ChinaScience and Technology Innovation Committee Foundation of ShenzhenShenzhen Peacock PlanEngineering and Physical Sciences Research Council (EPSRC)Engineering and Physical Sciences Research Council (EPSRC

Nearest Neighbor Classifiers over Incomplete Information: From Certain Answers to Certain Predictions

Machine learning (ML) applications have been thriving recently, largely attributed to the increasing availability of data. However, inconsistency and incomplete information are ubiquitous in real-world datasets, and their impact on ML applications remains elusive. In this paper, we present a formal study of this impact by extending the notion of Certain Answers for Codd tables, which has been explored by the database research community for decades, into the field of machine learning. Specifically, we focus on classification problems and propose the notion of "Certain Predictions" (CP) -- a test data example can be certainly predicted (CP'ed) if all possible classifiers trained on top of all possible worlds induced by the incompleteness of data would yield the same prediction. We study two fundamental CP queries: (Q1) checking query that determines whether a data example can be CP'ed; and (Q2) counting query that computes the number of classifiers that support a particular prediction (i.e., label). Given that general solutions to CP queries are, not surprisingly, hard without assumption over the type of classifier, we further present a case study in the context of nearest neighbor (NN) classifiers, where efficient solutions to CP queries can be developed -- we show that it is possible to answer both queries in linear or polynomial time over exponentially many possible worlds. We demonstrate one example use case of CP in the important application of "data cleaning for machine learning (DC for ML)." We show that our proposed CPClean approach built based on CP can often significantly outperform existing techniques in terms of classification accuracy with mild manual cleaning effort

Linkage between surface energy balance non‐closure and horizontal asymmetric turbulent transport

A number of studies have reported that the traditional eddy covariance (EC) method generally underestimated vertical turbulent fluxes, leading to an outstanding non-closure problem of the surface energy balance (SEB). Although it is recognized that the enlarged surface energy imbalance frequently coincides with the increasing wind shear, the role of large eddies in affecting the SEB remains unclear. On analyzing data collected by an EC array, considerable horizontal inhomogeneity of kinematic heat flux is observed. The results show that the combined EC method that incorporates the spatial flux contribution increases the kinematic heat flux by 21% relative to the traditional EC method, improving the SEB closure. Additionally, spectral analysis indicates that large eddies with scales ranging from 0.0005 to 0.01 (in the normalized frequency) mainly account for the horizontal inhomogeneity of kinematic heat flux. Under unstable conditions, this process is operating upon large eddies characterized by enlarged asymmetric turbulent flux transport. With enhanced wind shear, the increment of flux contribution associated with sweeps and ejections becomes disproportionate, contributing to the horizontal inhomogeneity of kinematic heat flux, and thus may explain the increased SEB non-closure