Multimodal person recognition for human-vehicle interaction

Next-generation vehicles will undoubtedly feature biometric person recognition as part of an effort to improve the driving experience. Today's technology prevents such systems from operating satisfactorily under adverse conditions. A proposed framework for achieving person recognition successfully combines different biometric modalities, borne out in two case studies

A review of convex approaches for control, observation and safety of linear parameter varying and Takagi-Sugeno systems

This paper provides a review about the concept of convex systems based on Takagi-Sugeno, linear parameter varying (LPV) and quasi-LPV modeling. These paradigms are capable of hiding the nonlinearities by means of an equivalent description which uses a set of linear models interpolated by appropriately defined weighing functions. Convex systems have become very popular since they allow applying extended linear techniques based on linear matrix inequalities (LMIs) to complex nonlinear systems. This survey aims at providing the reader with a significant overview of the existing LMI-based techniques for convex systems in the fields of control, observation and safety. Firstly, a detailed review of stability, feedback, tracking and model predictive control (MPC) convex controllers is considered. Secondly, the problem of state estimation is addressed through the design of proportional, proportional-integral, unknown input and descriptor observers. Finally, safety of convex systems is discussed by describing popular techniques for fault diagnosis and fault tolerant control (FTC).Peer ReviewedPostprint (published version

Fair comparison of skin detection approaches on publicly available datasets

Skin detection is the process of discriminating skin and non-skin regions in a digital image and it is widely used in several applications ranging from hand gesture analysis to track body parts and face detection. Skin detection is a challenging problem which has drawn extensive attention from the research community, nevertheless a fair comparison among approaches is very difficult due to the lack of a common benchmark and a unified testing protocol. In this work, we investigate the most recent researches in this field and we propose a fair comparison among approaches using several different datasets. The major contributions of this work are an exhaustive literature review of skin color detection approaches, a framework to evaluate and combine different skin detector approaches, whose source code is made freely available for future research, and an extensive experimental comparison among several recent methods which have also been used to define an ensemble that works well in many different problems. Experiments are carried out in 10 different datasets including more than 10000 labelled images: experimental results confirm that the best method here proposed obtains a very good performance with respect to other stand-alone approaches, without requiring ad hoc parameter tuning. A MATLAB version of the framework for testing and of the methods proposed in this paper will be freely available from https://github.com/LorisNann

Human Motion Trajectory Prediction: A Survey

With growing numbers of intelligent autonomous systems in human environments, the ability of such systems to perceive, understand and anticipate human behavior becomes increasingly important. Specifically, predicting future positions of dynamic agents and planning considering such predictions are key tasks for self-driving vehicles, service robots and advanced surveillance systems. This paper provides a survey of human motion trajectory prediction. We review, analyze and structure a large selection of work from different communities and propose a taxonomy that categorizes existing methods based on the motion modeling approach and level of contextual information used. We provide an overview of the existing datasets and performance metrics. We discuss limitations of the state of the art and outline directions for further research.Comment: Submitted to the International Journal of Robotics Research (IJRR), 37 page

Topics in Automotive Rollover Prevention: Robust and Adaptive Switching Strategies for Estimation and Control

The main focus in this thesis is the analysis of alternative approaches for estimation and control of automotive vehicles based on sound theoretical principles. Of particular importance is the problem rollover prevention, which is an important problem plaguing vehicles with a high center of gravity (CG). Vehicle rollover is, statistically, the most dangerous accident type, and it is difficult to prevent it due to the time varying nature of the problem. Therefore, a major objective of the thesis is to develop the necessary theoretical and practical tools for the estimation and control of rollover based on robust and adaptive techniques that are stable with respect to parameter variations. Given this background, we first consider an implementation of the multiple model switching and tuning (MMST) algorithm for estimating the unknown parameters of automotive vehicles relevant to the roll and the lateral dynamics including the position of CG. This results in high performance estimation of the CG as well as other time varying parameters, which can be used in tuning of the active safety controllers in real time. We then look into automotive rollover prevention control based on a robust stable control design methodology. As part of this we introduce a dynamic version of the load transfer ratio (LTR) as a rollover detection criterion and then design robust controllers that take into account uncertainty in the CG position. As the next step we refine the controllers by integrating them with the multiple model switched CG position estimation algorithm. This results in adaptive controllers with higher performance than the robust counterparts. In the second half of the thesis we analyze extensions of certain theoretical results with important implications for switched systems. First we obtain a non-Lyapunov stability result for a certain class of linear discrete time switched systems. Based on this result, we suggest switched controller synthesis procedures for two roll dynamics enhancement control applications. One control design approach is related to modifying the dynamical response characteristics of the automotive vehicle while guaranteeing the switching stability under parametric variations. The other control synthesis method aims to obtain transient free reference tracking of vehicle roll dynamics subject to parametric switching. In a later discussion, we consider a particular decentralized control design procedure based on vector Lyapunov functions for simultaneous, and structurally robust model reference tracking of both the lateral and the roll dynamics of automotive vehicles. We show that this controller design approach guarantees the closed loop stability subject to certain types of structural uncertainty. Finally, assuming a purely theoretical pitch, and motivated by the problems considered during the course of the thesis, we give new stability results on common Lyapunov solution (CLS) existence for two classes of switching linear systems; one is concerned with switching pair of systems in companion form and with interval uncertainty, and the other is concerned with switching pair of companion matrices with general inertia. For both problems we give easily verifiable spectral conditions that are sufficient for the CLS existence. For proving the second result we also obtain a certain generalization of the classical Kalman-Yacubovic-Popov lemma for matrices with general inertia