Sistema de miografia óptica para reconhecimento de gestos e posturas de mão

Orientador: Éric FujiwaraDissertação (mestrado) - Universidade Estadual de Campinas, Faculdade de Engenharia MecânicaResumo: Nesse projeto, demonstrou-se um sistema de miografia óptica como uma alternativa promissora para monitorar as posturas da mão e os gestos do usuário. Essa técnica se fundamenta em acompanhar as atividades musculares responsáveis pelos movimentos da mão com uma câmera externa, relacionando a distorção visual verificada no antebraço com a contração e o relaxamento necessários para dada postura. Três configurações de sensores foram propostas, estudadas e avaliadas. A primeira propôs monitorar a atividade muscular analisando a variação da frequência espacial de uma textura de listras uniformes impressa sobre a pele, enquanto que a segunda se caracteriza pela contagem de pixels de pele visível dentro da região de interesse. Ambas as configurações se mostraram inviáveis pela baixa robustez e alta demanda por condições experimentais controladas. Por fim, a terceira recupera o estado da mão acompanhando o deslocamento de uma série de marcadores coloridos distribuídos ao longo do antebraço. Com um webcam de 24 fps e 640 × 480 pixels, essa última configuração foi validada para oito posturas distintas, explorando principalmente a flexão e extensão dos dedos e do polegar, além da adução e abdução do último. Os dados experimentais, adquiridos off-line, são submetidos a uma rotina de processamento de imagens para extrair a informação espacial e de cor dos marcadores em cada quadro, dados esses utilizados para rastrear os mesmos marcadores ao longo de todos os quadros. Para reduzir a influência das vibrações naturais e inerentes ao corpo humano, um sistema de referencial local é ainda adotado dentro da própria região de interesse. Finalmente, os dados quadro a quadro com o ground truth são alimentados a uma rede neural artificial sequencial, responsável pela calibração supervisionada do sensor e posterior classificação das posturas. O desempenho do sistema para a classificação das oito posturas foi avaliado com base na validação cruzada com 10-folds, com a câmera monitorando o antebraço pela superfície interna ou externa. O sensor apresentou uma precisão de ?92.4% e exatidão de ?97.9% para o primeiro caso, e uma precisão de ?75.1% e exatidão de ?92.5% para o segundo, sendo comparável a outras técnicas de miografia, demonstrando a viabilidade do projeto e abrindo perspectivas para aplicações em interfaces humano-robôAbstract: In this work, an optical myography system is demonstrated as a promising alternative to monitor hand posture and gestures of the user. This technique is based on accompanying muscular activities responsible for hand motion with an external camera, and relating the visual deformation observed on the forearm to the muscular contractions/relaxations for a given posture. Three sensor designs were proposed, studied and evaluated. The first one intended to monitor muscular activity by analyzing the spatial frequency variation of a uniformly distributed stripe pattern stamped on the skin, whereas the second one is characterized by reckoning visible skin pixels inside the region of interest. Both designs are impracticable due to their low robustness and high demand for controlled experimental conditions. At last, the third design retrieves hand configuration by tracking visually the displacements of a series of color markers distributed over the forearm. With a webcam of 24 fps and 640 × 480 pixels, this design was validated for eight different postures, exploring fingers and thumb flexion/extension, plus thumb adduction/abduction. The experimental data are acquired offline and, then, submitted to an image processing routine to extract color and spatial information of the markers in each frame; the extracted data is subsequently used to track the same markers along all frames. To reduce the influence of human body natural and inherent vibrations, a local reference frame is yet adopted in the region of interest. Finally, the frame by frame data, along with the ground truth posture, are fed into a sequential artificial neural network, responsible for sensor supervised calibration and subsequent posture classification. The system performance was evaluated in terms of eight postures classification via 10-fold cross-validation, with the camera monitoring either the underside or the back of the forearm. The sensor presented a ?92.4% precision and ?97.9% accuracy for the former, and a ?75.1% precision and ?92.5% accuracy for the latter, being thus comparable to other myographic techniques; it also demonstrated that the project is feasible and offers prospects for human-robot interaction applicationsMestradoEngenharia MecanicaMestre em Engenharia Mecânica33003017CAPE

Textile Forms’ Computer Simulation Techniques

Computer simulation techniques of textile forms already represent an important tool for textile and garment designers, since they offer numerous advantages, such as quick and simple introduction of changes while developing a model in comparison with conventional techniques. Therefore, the modeling and simulation of textile forms will always be an important issue and challenge for the researchers, since close‐to‐reality models are essential for understanding the performance and behavior of textile materials. This chapter deals with computer simulation of different textile forms. In the introductory part, it reviews the development of complex modeling and simulation techniques related to different textile forms. The main part of the chapter focuses on study of the fabric and fused panel drape by using the finite element method and on development of some representative textile forms, above all, on functional and protective clothing for persons who are sitting during performing different activities. Computer simulation techniques and scanned 3D body models in a sitting posture are used for this purpose. Engineering approaches to textile forms’ design for particular purposes, presented in this chapter, show benefits and limitations of specific 3D body scanning and computer simulation techniques and outline the future research challenges

Monitoring of the central blood pressure waveform via a conformal ultrasonic device.

Continuous monitoring of the central-blood-pressure waveform from deeply embedded vessels, such as the carotid artery and jugular vein, has clinical value for the prediction of all-cause cardiovascular mortality. However, existing non-invasive approaches, including photoplethysmography and tonometry, only enable access to the superficial peripheral vasculature. Although current ultrasonic technologies allow non-invasive deep-tissue observation, unstable coupling with the tissue surface resulting from the bulkiness and rigidity of conventional ultrasound probes introduces usability constraints. Here, we describe the design and operation of an ultrasonic device that is conformal to the skin and capable of capturing blood-pressure waveforms at deeply embedded arterial and venous sites. The wearable device is ultrathin (240 μm) and stretchable (with strains up to 60%), and enables the non-invasive, continuous and accurate monitoring of cardiovascular events from multiple body locations, which should facilitate its use in a variety of clinical environments

Virtual skeleton methodology for athlete posture modification in CFD simulations

This study focuses on the aerodynamic influence of athlete posture in sports aerodynamics. To analyze a specific posture, wind tunnel measurements and computer simulations are commonly employed. For computer simulations, the growing trend is to use 3D scanning to create accurate representations of an athlete’s geometry. However, this process becomes cumbersome and time-consuming when multiple positions need to be scanned. This work presents a methodology to use a virtual skeleton to perform modifications of an athlete’s posture. This is an efficient approach that can be applied directly to a scanned geometry model, and that allows easy modification and use in optimization procedures. The methodology is applied to two different cases; small adjustment of arm position for a time-trial cyclist, and large alteration of a standing alpine skier into a tucked position. Computational fluid dynamics simulations show that similar results are obtained for aerodynamic drag using the proposed methodology as with geometry models obtained from 3D scanning. Less than 1% difference in drag area was found for the cyclist, and less than 2% difference for the skier. These findings show the method’s potential for efficient use in sports aerodynamics studies.publishedVersio

AFFECT-PRESERVING VISUAL PRIVACY PROTECTION

The prevalence of wireless networks and the convenience of mobile cameras enable many new video applications other than security and entertainment. From behavioral diagnosis to wellness monitoring, cameras are increasing used for observations in various educational and medical settings. Videos collected for such applications are considered protected health information under privacy laws in many countries. Visual privacy protection techniques, such as blurring or object removal, can be used to mitigate privacy concern, but they also obliterate important visual cues of affect and social behaviors that are crucial for the target applications. In this dissertation, we propose to balance the privacy protection and the utility of the data by preserving the privacy-insensitive information, such as pose and expression, which is useful in many applications involving visual understanding. The Intellectual Merits of the dissertation include a novel framework for visual privacy protection by manipulating facial image and body shape of individuals, which: (1) is able to conceal the identity of individuals; (2) provide a way to preserve the utility of the data, such as expression and pose information; (3) balance the utility of the data and capacity of the privacy protection. The Broader Impacts of the dissertation focus on the significance of privacy protection on visual data, and the inadequacy of current privacy enhancing technologies in preserving affect and behavioral attributes of the visual content, which are highly useful for behavior observation in educational and medical settings. This work in this dissertation represents one of the first attempts in achieving both goals simultaneously

A framework for natural animation of digitized models

We present a novel versatile, fast and simple framework to generate highquality animations of scanned human characters from input motion data. Our method is purely mesh-based and, in contrast to skeleton-based animation, requires only a minimum of manual interaction. The only manual step that is required to create moving virtual people is the placement of a sparse set of correspondences between triangles of an input mesh and triangles of the mesh to be animated. The proposed algorithm implicitly generates realistic body deformations, and can easily transfer motions between human erent shape and proportions. erent types of input data, e.g. other animated meshes and motion capture les, in just the same way. Finally, and most importantly, it creates animations at interactive frame rates. We feature two working prototype systems that demonstrate that our method can generate lifelike character animations from both marker-based and marker-less optical motion capture data

Book of Abstracts 15th International Symposium on Computer Methods in Biomechanics and Biomedical Engineering and 3rd Conference on Imaging and Visualization

In this edition, the two events will run together as a single conference, highlighting the strong connection with the Taylor & Francis journals: Computer Methods in Biomechanics and Biomedical Engineering (John Middleton and Christopher Jacobs, Eds.) and Computer Methods in Biomechanics and Biomedical Engineering: Imaging and Visualization (JoãoManuel R.S. Tavares, Ed.). The conference has become a major international meeting on computational biomechanics, imaging andvisualization. In this edition, the main program includes 212 presentations. In addition, sixteen renowned researchers will give plenary keynotes, addressing current challenges in computational biomechanics and biomedical imaging. In Lisbon, for the first time, a session dedicated to award the winner of the Best Paper in CMBBE Journal will take place. We believe that CMBBE2018 will have a strong impact on the development of computational biomechanics and biomedical imaging and visualization, identifying emerging areas of research and promoting the collaboration and networking between participants. This impact is evidenced through the well-known research groups, commercial companies and scientific organizations, who continue to support and sponsor the CMBBE meeting series. In fact, the conference is enriched with five workshops on specific scientific topics and commercial software.info:eu-repo/semantics/draf

Distortion Correction for 3D Scan of Trunk Swaying Human Body Segments

We propose a method for acquiring a 3D shape of human body segments accurately. Using a light stripe triangulation range finder, we can acquire accurate 3D shape of a motionless object in dozens of seconds. If the object moves during the scanning, the acquired shape would be distorted. Naturally, humans move slightly for making balance while standing even if the subject makes an effort to stay still for avoiding the distortion in acquired shape. Our method corrects the distortion based on measured subject's motion during the scanning. Experimental results show the accuracy of the proposed method. Trunk swaying degrades the accuracy of the light stripe triangulation from 1mm to 10mm. We can keep the accuracy of as good as 2mm by applying our method

Efforts in Preparation for Jack Validation

This document presents a detailed record of the methodologies, assumptions, limitations, and references used in creating the human figure model in Jack, a program that displays and manipulates articulated geometric figures. This report reflects current efforts to develop and refine Jack software to enable its validation and verification as a tool for performing human engineering analysis. These efforts include human figure model improvements, statistical anthropometric data processing methods, enhanced human figure model construction and measuring methods, and automated accomodation analysis. This report discusses basic details of building human models, model anthropometry, scaling, Jack anthropometry-based human models, statistical data processing, figure generation tools, anthropometric errors, inverse dynamics, smooth skin implementation, guidelines used in estimating landmark locations on the model, and recommendations for validating and verifying the Jack human figure model

Extending the Design Space of E-textile Assistive Smart Environment Applications

The thriving field of Smart Environments has allowed computing devices to gain new capabilities and develop new interfaces, thus becoming more and more part of our lives. In many of these areas it is unthinkable to renounce to the assisting functionality such as e.g. comfort and safety functions during driving, safety functionality while working in an industrial plant, or self-optimization of daily activities with a Smartwatch. Adults spend a lot of time on flexible surfaces such as in the office chair, in bed or in the car seat. These are crucial parts of our environments. Even though environments have become smarter with integrated computing gaining new capabilities and new interfaces, mostly rigid surfaces and objects have become smarter. In this thesis, I build on the advantages flexible and bendable surfaces have to offer and look into the creation process of assistive Smart Environment applications leveraging these surfaces. I have done this with three main contributions. First, since most Smart Environment applications are built-in into rigid surfaces, I extend the body of knowledge by designing new assistive applications integrated in flexible surfaces such as comfortable chairs, beds, or any type of soft, flexible objects. These developed applications offer assistance e.g. through preventive functionality such as decubitus ulcer prevention while lying in bed, back pain prevention while sitting on a chair or emotion detection while detecting movements on a couch. Second, I propose a new framework for the design process of flexible surface prototypes and its challenges of creating hardware prototypes in multiple iterations, using resources such as work time and material costs. I address this research challenge by creating a simulation framework which can be used to design applications with changing surface shape. In a first step I validate the simulation framework by building a real prototype and a simulated prototype and compare the results in terms of sensor amount and sensor placement. Furthermore, I use this developed simulation framework to analyse the influence it has on an application design if the developer is experienced or not. Finally, since sensor capabilities play a major role during the design process, and humans come often in contact with surfaces made of fabric, I combine the integration advantages of fabric and those of capacitive proximity sensing electrodes. By conducting a multitude of capacitive proximity sensing measurements, I determine the performance of electrodes made by varying properties such as material, shape, size, pattern density, stitching type, or supporting fabric. I discuss the results from this performance evaluation and condense them into e-textile capacitive sensing electrode guidelines, applied exemplary on the use case of creating a bed sheet for breathing rate detection