Dynamic approach for real-time skin detection

Human face and hand detection, recognition and tracking are important research areas for many computer interaction applications. Face and hand are considered as human skin blobs, which fall in a compact region of colour spaces. Limitations arise from the fact that human skin has common properties and can be defined in various colour spaces after applying colour normalization. The model therefore, has to accept a wide range of colours, making it more susceptible to noise. We have addressed this problem and propose that the skin colour could be defined separately for every person. This is expected to reduce the errors. To detect human skin colour pixels and to decrease the number of false alarms, a prior face or hand detection model has been developed using Haar-like and AdaBoost technique. To decrease the cost of computational time, a fast search algorithm for skin detection is proposed. The level of performance reached in terms of detection accuracy and processing time allows this approach to be an adequate choice for real-time skin blob tracking

Dynamic approach for real-time skin detection

Human face and hand detection, recognition and tracking are important research areas for many computer interaction applications. Face and hand are considered as human skin blobs, which fall in a compact region of colour spaces. Limitations arise from the fact that human skin has common properties and can be defined in various colour spaces after applying colour normalization. The model therefore, has to accept a wide range of colours, making it more susceptible to noise. We have addressed this problem and propose that the skin colour could be defined separately for every person. This is expected to reduce the errors. To detect human skin colour pixels and to decrease the number of false alarms, a prior face or hand detection model has been developed using Haar-like and AdaBoost technique. To decrease the cost of computational time, a fast search algorithm for skin detection is proposed. The level of performance reached in terms of detection accuracy and processing time allows this approach to be an adequate choice for real-time skin blob tracking

Fair comparison of skin detection approaches on publicly available datasets

Skin detection is the process of discriminating skin and non-skin regions in a digital image and it is widely used in several applications ranging from hand gesture analysis to track body parts and face detection. Skin detection is a challenging problem which has drawn extensive attention from the research community, nevertheless a fair comparison among approaches is very difficult due to the lack of a common benchmark and a unified testing protocol. In this work, we investigate the most recent researches in this field and we propose a fair comparison among approaches using several different datasets. The major contributions of this work are an exhaustive literature review of skin color detection approaches, a framework to evaluate and combine different skin detector approaches, whose source code is made freely available for future research, and an extensive experimental comparison among several recent methods which have also been used to define an ensemble that works well in many different problems. Experiments are carried out in 10 different datasets including more than 10000 labelled images: experimental results confirm that the best method here proposed obtains a very good performance with respect to other stand-alone approaches, without requiring ad hoc parameter tuning. A MATLAB version of the framework for testing and of the methods proposed in this paper will be freely available from https://github.com/LorisNann

Real time hand gesture recognition including hand segmentation and tracking

In this paper we present a system that performs automatic gesture recognition. The system consists of two main components: (i) A unified technique for segmentation and tracking of face and hands using a skin detection algorithm along with handling occlusion between skin objects to keep track of the status of the occluded parts. This is realized by combining 3 useful features, namely, color, motion and position. (ii) A static and dynamic gesture recognition system. Static gesture recognition is achieved using a robust hand shape classification, based on PCA subspaces, that is invariant to scale along with small translation and rotation transformations. Combining hand shape classification with position information and using DHMMs allows us to accomplish dynamic gesture recognition

The implications of embodiment for behavior and cognition: animal and robotic case studies

In this paper, we will argue that if we want to understand the function of the brain (or the control in the case of robots), we must understand how the brain is embedded into the physical system, and how the organism interacts with the real world. While embodiment has often been used in its trivial meaning, i.e. 'intelligence requires a body', the concept has deeper and more important implications, concerned with the relation between physical and information (neural, control) processes. A number of case studies are presented to illustrate the concept. These involve animals and robots and are concentrated around locomotion, grasping, and visual perception. A theoretical scheme that can be used to embed the diverse case studies will be presented. Finally, we will establish a link between the low-level sensory-motor processes and cognition. We will present an embodied view on categorization, and propose the concepts of 'body schema' and 'forward models' as a natural extension of the embodied approach toward first representations.Comment: Book chapter in W. Tschacher & C. Bergomi, ed., 'The Implications of Embodiment: Cognition and Communication', Exeter: Imprint Academic, pp. 31-5

Simultaneous Localization and Recognition of Dynamic Hand Gestures

A framework for the simultaneous localization and recognition of dynamic hand gestures is proposed. At the core of this framework is a dynamic space-time warping (DSTW) algorithm, that aligns a pair of query and model gestures in both space and time. For every frame of the query sequence, feature detectors generate multiple hand region candidates. Dynamic programming is then used to compute both a global matching cost, which is used to recognize the query gesture, and a warping path, which aligns the query and model sequences in time, and also finds the best hand candidate region in every query frame. The proposed framework includes translation invariant recognition of gestures, a desirable property for many HCI systems. The performance of the approach is evaluated on a dataset of hand signed digits gestured by people wearing short sleeve shirts, in front of a background containing other non-hand skin-colored objects. The algorithm simultaneously localizes the gesturing hand and recognizes the hand-signed digit. Although DSTW is illustrated in a gesture recognition setting, the proposed algorithm is a general method for matching time series, that allows for multiple candidate feature vectors to be extracted at each time step.National Science Foundation (CNS-0202067, IIS-0308213, IIS-0329009); Office of Naval Research (N00014-03-1-0108

Tactile on-chip pre-processing with techniques from artificial retinas

The interest in tactile sensors is increasing as their use in complex unstructured environments is demanded, like in tele-presence, minimal invasive surgery, robotics etc. The matrix of pressure data these devices provide can be managed with many image processing algorithms to extract the required information. However, as in the case of vision chips or artificial retinas, problems arise when the array size and the computation complexity increase. Having a look to the skin, the information collected by every mechanoreceptor is not carried to the brain for its processing, but some complex pre-processing is performed to fit the limited throughput of the nervous system. This is specially important for high bandwidth demanding tasks. Experimental works report that neural response of skin mechanoreceptors encodes the change in local shape from an offset level rather than the absolute force or pressure distributions. This is also the behavior of the retina, which implements a spatio-temporal averaging. We propose the same strategy in tactile preprocessing, and we show preliminary results when it faces the detection of the slip, which involves fast real-time processing.Ministerio de Ciencia y Tecnología TIC2003 - 09817-C0

Linear and non-linear dynamic analyses of sandwich panels with face sheet-tocore debonding

А survey of recent developments in the dynamic analysis of sandwich panels with face sheet-to-core debonding is presented. The finite element method within the ABAQUSTM code is utilized. The emphasis is directed to the procedures used to elaborate linear and non-linear models and to predict dynamic response of the sandwich panels. Recently developed models are presented, which can be applied for structural health monitoring algorithms of real-scale sandwich panels. First, various popular theories of intact sandwich panels are briefly mentioned and a model is proposed to effectively analyse the modal dynamics of debonded and damaged (due to impact) sandwich panels. The influence of debonding size, form and location, and number of such damage on the modal characteristics of sandwich panels are shown. For nonlinear analysis, models based on implicit and explicit time integration schemes are presented and dynamic response gained with those models are discussed. Finally, questions related to debonding progression at the face sheet-core interface when dynamic loading continues with time are briefly highlighted

Eco-efficient process based on conventional machining as an alternative technology to chemical milling of aeronautical metal skin panels

El fresado químico es un proceso diseñado para la reducción de peso de pieles metálicas que, a pesar de los problemas medioambientales asociados, se utiliza en la industria aeronáutica desde los años 50. Entre sus ventajas figuran el cumplimiento de las estrictas tolerancias de diseño de piezas aeroespaciales y que pese a ser un proceso de mecanizado, no induce tensiones residuales. Sin embargo, el fresado químico es una tecnología contaminante y costosa que tiende a ser sustituida. Gracias a los avances realizados en el mecanizado, la tecnología de fresado convencional permite alcanzar las tolerancias requeridas siempre y cuando se consigan evitar las vibraciones y la flexión de la pieza, ambas relacionadas con los parámetros del proceso y con los sistemas de utillaje empleados. Esta tesis analiza las causas de la inestabilidad del corte y la deformación de las piezas a través de una revisión bibliográfica que cubre los modelos analíticos, las técnicas computacionales y las soluciones industriales en estudio actualmente. En ella, se aprecia cómo los modelos analíticos y las soluciones computacionales y de simulación se centran principalmente en la predicción off-line de vibraciones y de posibles flexiones de la pieza. Sin embargo, un enfoque más industrial ha llevado al diseño de sistemas de fijación, utillajes, amortiguadores basados en actuadores, sistemas de rigidez y controles adaptativos apoyados en simulaciones o en la selección estadística de parámetros. Además se han desarrollado distintas soluciones CAM basadas en la aplicación de gemelos virtuales. En la revisión bibliográfica se han encontrado pocos documentos relativos a pieles y suelos delgados por lo que se ha estudiado experimentalmente el efecto de los parámetros de corte en su mecanizado. Este conjunto de experimentos ha demostrado que, pese a usar un sistema que aseguraba la rigidez de la pieza, las pieles se comportaban de forma diferente a un sólido rígido en términos de fuerzas de mecanizado cuando se utilizaban velocidades de corte cercanas a la alta velocidad. También se ha verificado que todas las muestras mecanizadas entraban dentro de tolerancia en cuanto a la rugosidad de la pieza. Paralelamente, se ha comprobado que la correcta selección de parámetros de mecanizado puede reducir las fuerzas de corte y las tolerancias del proceso hasta un 20% y un 40%, respectivamente. Estos datos pueden tener aplicación industrial en la simplificación de los sistemas de amarre o en el incremento de la eficiencia del proceso. Este proceso también puede mejorarse incrementando la vida de la herramienta al utilizar fluidos de corte. Una correcta lubricación puede reducir la temperatura del proceso y las tensiones residuales inducidas a la pieza. Con este objetivo, se han desarrollado diferentes lubricantes, basados en el uso de líquidos iónicos (IL) y se han comparado con el comportamiento tribológico del par de contacto en seco y con una taladrina comercial. Los resultados obtenidos utilizando 1 wt% de los líquidos iónicos en un tribómetro tipo pin-on-disk demuestran que el IL no halogenado reduce significativamente el desgaste y la fricción entre el aluminio, material a mecanizar, y el carburo de tungsteno, material de la herramienta, eliminando casi toda la adhesión del aluminio sobre el pin, lo que puede incrementar considerablemente la vida de la herramienta.Chemical milling is a process designed to reduce the weight of metals skin panels. This process has been used since 1950s in the aerospace industry despite its environmental concern. Among its advantages, chemical milling does not induce residual stress and parts meet the required tolerances. However, this process is a pollutant and costly technology. Thanks to the last advances in conventional milling, machining processes can achieve similar quality results meanwhile vibration and part deflection are avoided. Both problems are usually related to the cutting parameters and the workholding. This thesis analyses the causes of the cutting instability and part deformation through a literature review that covers analytical models, computational techniques and industrial solutions. Analytics and computational solutions are mainly focused on chatter and deflection prediction and industrial approaches are focused on the design of workholdings, fixtures, damping actuators, stiffening devices, adaptive control systems based on simulations and the statistical parameters selection, and CAM solutions combined with the use of virtual twins applications. In this literature review, few research works about thin-plates and thin-floors is found so the effect of the cutting parameters is also studied experimentally. These experiments confirm that even using rigid workholdings, the behavior of the part is different to a rigid body at high speed machining. On the one hand, roughness values meet the required tolerances under every set of the tested parameters. On the other hand, a proper parameter selection reduces the cutting forces and process tolerances by up to 20% and 40%, respectively. This fact can be industrially used to simplify workholding and increase the machine efficiency. Another way to improve the process efficiency is to increase tool life by using cutting fluids. Their use can also decrease the temperature of the process and the induced stresses. For this purpose, different water-based lubricants containing three types of Ionic Liquids (IL) are compared to dry and commercial cutting fluid conditions by studying their tribological behavior. Pin on disk tests prove that just 1wt% of one of the halogen-free ILs significantly reduces wear and friction between both materials, aluminum and tungsten carbide. In fact, no wear scar is noticed on the ball when one of the ILs is used, which, therefore, could considerably increase tool life