A Multi-objective Exploratory Procedure for Regression Model Selection

Variable selection is recognized as one of the most critical steps in statistical modeling. The problems encountered in engineering and social sciences are commonly characterized by over-abundance of explanatory variables, non-linearities and unknown interdependencies between the regressors. An added difficulty is that the analysts may have little or no prior knowledge on the relative importance of the variables. To provide a robust method for model selection, this paper introduces the Multi-objective Genetic Algorithm for Variable Selection (MOGA-VS) that provides the user with an optimal set of regression models for a given data-set. The algorithm considers the regression problem as a two objective task, and explores the Pareto-optimal (best subset) models by preferring those models over the other which have less number of regression coefficients and better goodness of fit. The model exploration can be performed based on in-sample or generalization error minimization. The model selection is proposed to be performed in two steps. First, we generate the frontier of Pareto-optimal regression models by eliminating the dominated models without any user intervention. Second, a decision making process is executed which allows the user to choose the most preferred model using visualisations and simple metrics. The method has been evaluated on a recently published real dataset on Communities and Crime within United States.Comment: in Journal of Computational and Graphical Statistics, Vol. 24, Iss. 1, 201

Understanding knee points in bicriteria problems and their implications as preferred solution principles

A knee point is almost always a preferred trade-off solution, if it exists in a bicriteria optimization problem. In this article, an attempt is made to improve understanding of a knee point and investigate the properties of a bicriteria problem that may exhibit a knee on its Pareto-optimal front. Past studies are reviewed and a couple of new definitions are suggested. Additionally, a knee region is defined for problems in which, instead of one, a set of knee-like solutions exists. Edge-knee solutions, which behave like knee solutions but lie near one of the extremes on the Pareto-optimal front, are also introduced. It is interesting that in many problem-solving tasks, despite the existence of a number of solution methodologies, only one or a few of them are commonly used. Here, it is argued that often such common solution principles are knee solutions to a bicriteria problem formed with two conflicting goals of the underlying problem-solving task. The argument is illustrated on a number of tasks, such as regression, sorting, clustering and a number of engineering designs

A Utility-Theoretic Approach to Privacy in Online Services

Online offerings such as web search, news portals, and e-commerce applications face the challenge of providing high-quality service to a large, heterogeneous user base. Recent efforts have highlighted the potential to improve performance by introducing methods to personalize services based on special knowledge about users and their context. For example, a user's demographics, location, and past search and browsing may be useful in enhancing the results offered in response to web search queries. However, reasonable concerns about privacy by both users, providers, and government agencies acting on behalf of citizens, may limit access by services to such information. We introduce and explore an economics of privacy in personalization, where people can opt to share personal information, in a standing or on-demand manner, in return for expected enhancements in the quality of an online service. We focus on the example of web search and formulate realistic objective functions for search efficacy and privacy. We demonstrate how we can find a provably near-optimal optimization of the utility-privacy tradeoff in an efficient manner. We evaluate our methodology on data drawn from a log of the search activity of volunteer participants. We separately assess users’ preferences about privacy and utility via a large-scale survey, aimed at eliciting preferences about peoples’ willingness to trade the sharing of personal data in returns for gains in search efficiency. We show that a significant level of personalization can be achieved using a relatively small amount of information about users

Development of deployable structures for large space platform systems, part 1

Eight deployable platform design objectives were established: autodeploy/retract; fully integrated utilities; configuration variability; versatile payload and subsystem interfaces; structural and packing efficiency; 1986 technology readiness; minimum EVA/RMS; and Shuttle operational compatibility

Quantum limits on post-selected, probabilistic quantum metrology

Probabilistic metrology attempts to improve parameter estimation by occasionally reporting an excellent estimate and the rest of the time either guessing or doing nothing at all. Here we show that probabilistic metrology can never improve quantum limits on estimation of a single parameter, both on average and asymptotically in number of trials, if performance is judged relative to mean-square estimation error. We extend the result by showing that for a finite number of trials, the probability of obtaining better estimates using probabilistic metrology, as measured by mean-square error, decreases exponentially with the number of trials. To be tight, the performance bounds we derive require that likelihood functions be approximately normal, which in turn depends on how rapidly specific distributions converge to a normal distribution with number of trials.Comment: V1:8 pages, 1 figure. V2: 9 pages, 1 figure, revised text. V3: 11 pages, 1 figure, revised text; V4 published version, revised title ;-

Open urethroplasty versus endoscopic urethrotomy - clarifying the management of men with recurrent urethral stricture (the OPEN trial) : study protocol for a randomised controlled trial

Peer reviewedPublisher PD

Momentum Control with Hierarchical Inverse Dynamics on a Torque-Controlled Humanoid

Hierarchical inverse dynamics based on cascades of quadratic programs have been proposed for the control of legged robots. They have important benefits but to the best of our knowledge have never been implemented on a torque controlled humanoid where model inaccuracies, sensor noise and real-time computation requirements can be problematic. Using a reformulation of existing algorithms, we propose a simplification of the problem that allows to achieve real-time control. Momentum-based control is integrated in the task hierarchy and a LQR design approach is used to compute the desired associated closed-loop behavior and improve performance. Extensive experiments on various balancing and tracking tasks show very robust performance in the face of unknown disturbances, even when the humanoid is standing on one foot. Our results demonstrate that hierarchical inverse dynamics together with momentum control can be efficiently used for feedback control under real robot conditions.Comment: 21 pages, 11 figures, 4 tables in Autonomous Robots (2015

Understanding cost-utility analysis studies in the trauma and orthopaedic surgery literature.

Cost-utility analysis (CUA) studies are becoming increasingly important due to the need to reduce healthcare spending, especially in the field of trauma and orthopaedics.There is an increasing need for trauma and orthopaedic surgeons to understand these economic evaluations to ensure informed cost-effective decisions can be made to benefit the patient and funding body.This review discusses the fundamental principles required to understand CUA studies in the literature, including a discussion of the different methods employed to assess the health outcomes associated with different management options and the various approaches used to calculate the costs involved.Different types of model design may be used to conduct a CUA which can be broadly categorized into real-life clinical studies and computer-simulated modelling. We discuss the main types of study designs used within each category. We also cover the different types of sensitivity analysis used to quantify uncertainty in these studies and the commonly employed instruments used to assess the quality of CUAs. Finally, we discuss some of the important limitations of CUAs that need to be considered.This review outlines the main concepts required to understand the CUA literature and provides a basic framework for their future conduct. Cite this article: EFORT Open Rev 2021;6:305-315. DOI: 10.1302/2058-5241.6.200115