51,148 research outputs found
Gravity optimised particle filter for hand tracking
This paper presents a gravity optimised particle filter (GOPF) where the magnitude of the gravitational force for every particle is proportional to its weight. GOPF attracts nearby particles and replicates new particles as if moving the particles towards the peak of the likelihood distribution, improving the sampling efficiency. GOPF is incorporated into a technique for hand features tracking. A fast approach to hand features detection and labelling using convexity defects is also presented. Experimental results show that GOPF outperforms the standard particle filter and its variants, as well as state-of-the-art CamShift guided particle filter using a significantly reduced number of particles
A fast and robust hand-driven 3D mouse
The development of new interaction paradigms requires a natural interaction. This means that people should be able to interact with technology with the same models used to interact with everyday real life, that is through gestures, expressions, voice. Following this idea, in this paper we propose a non intrusive vision based tracking system able to capture hand motion and simple hand gestures. The proposed device allows to use the hand as a "natural" 3D mouse, where the forefinger tip or the palm centre are used to identify a 3D marker and the hand gesture can be used to simulate the mouse buttons. The approach is based on a monoscopic tracking algorithm which is computationally fast and robust against noise and cluttered backgrounds. Two image streams are processed in parallel exploiting multi-core architectures, and their results are combined to obtain a constrained stereoscopic problem. The system has been implemented and thoroughly tested in an experimental environment where the 3D hand mouse has been used to interact with objects in a virtual reality application. We also provide results about the performances of the tracker, which demonstrate precision and robustness of the proposed syste
Vision-based hand gesture interaction using particle filter, principle component analysis and transition network
Vision-based human-computer interaction is becoming important nowadays. It offers natural interaction with computers and frees users from mechanical interaction devices, which is favourable especially for wearable computers. This paper presents a human-computer interaction system based on a conventional webcam and hand gesture recognition. This interaction system works in real time and enables users to control a computer cursor with hand motions and gestures instead of a mouse. Five hand gestures are designed on behalf of five mouse operations: moving, left click, left-double click, right click and no-action. An algorithm based on Particle Filter is used for tracking the hand position. PCA-based feature selection is used for recognizing the hand gestures. A transition network is also employed for improving the accuracy and reliability of the interaction system. This interaction system shows good performance in the recognition and interaction test
LiveCap: Real-time Human Performance Capture from Monocular Video
We present the first real-time human performance capture approach that
reconstructs dense, space-time coherent deforming geometry of entire humans in
general everyday clothing from just a single RGB video. We propose a novel
two-stage analysis-by-synthesis optimization whose formulation and
implementation are designed for high performance. In the first stage, a skinned
template model is jointly fitted to background subtracted input video, 2D and
3D skeleton joint positions found using a deep neural network, and a set of
sparse facial landmark detections. In the second stage, dense non-rigid 3D
deformations of skin and even loose apparel are captured based on a novel
real-time capable algorithm for non-rigid tracking using dense photometric and
silhouette constraints. Our novel energy formulation leverages automatically
identified material regions on the template to model the differing non-rigid
deformation behavior of skin and apparel. The two resulting non-linear
optimization problems per-frame are solved with specially-tailored
data-parallel Gauss-Newton solvers. In order to achieve real-time performance
of over 25Hz, we design a pipelined parallel architecture using the CPU and two
commodity GPUs. Our method is the first real-time monocular approach for
full-body performance capture. Our method yields comparable accuracy with
off-line performance capture techniques, while being orders of magnitude
faster
Deep Learning How to Fit an Intravoxel Incoherent Motion Model to Diffusion-Weighted MRI
Purpose: This prospective clinical study assesses the feasibility of training
a deep neural network (DNN) for intravoxel incoherent motion (IVIM) model
fitting to diffusion-weighted magnetic resonance imaging (DW-MRI) data and
evaluates its performance. Methods: In May 2011, ten male volunteers (age
range: 29 to 53 years, mean: 37 years) underwent DW-MRI of the upper abdomen on
1.5T and 3.0T magnetic resonance scanners. Regions of interest in the left and
right liver lobe, pancreas, spleen, renal cortex, and renal medulla were
delineated independently by two readers. DNNs were trained for IVIM model
fitting using these data; results were compared to least-squares and Bayesian
approaches to IVIM fitting. Intraclass Correlation Coefficients (ICC) were used
to assess consistency of measurements between readers. Intersubject variability
was evaluated using Coefficients of Variation (CV). The fitting error was
calculated based on simulated data and the average fitting time of each method
was recorded. Results: DNNs were trained successfully for IVIM parameter
estimation. This approach was associated with high consistency between the two
readers (ICCs between 50 and 97%), low intersubject variability of estimated
parameter values (CVs between 9.2 and 28.4), and the lowest error when compared
with least-squares and Bayesian approaches. Fitting by DNNs was several orders
of magnitude quicker than the other methods but the networks may need to be
re-trained for different acquisition protocols or imaged anatomical regions.
Conclusion: DNNs are recommended for accurate and robust IVIM model fitting to
DW-MRI data. Suitable software is available at (1)
Recommended from our members
Optical coherence tomography measurements of biological fluid flows with picolitre spatial localization
This paper was presented at the 4th Micro and Nano Flows Conference (MNF2014), which was held at University College, London, UK. The conference was organised by Brunel University and supported by the Italian Union of Thermofluiddynamics, IPEM, the Process Intensification Network, the Institution of Mechanical Engineers, the Heat Transfer Society, HEXAG - the Heat Exchange Action Group, and the Energy Institute, ASME Press, LCN London Centre for Nanotechnology, UCL University College London, UCL Engineering, the International NanoScience Community, www.nanopaprika.eu.Interest in studying the human and animal microcirculation has burgeoned in recent years. In part
this has been driven by recent advances in volumetric microscopy modalities, which allow the study of the
3-D morphology of the microcirculation without the limitations of 2-D intra-vital microscopy. In this paper
we highlight the power of optical coherence tomography (OCT) to image the normal and pathological
microcirculation with picolitre voxel sizes. Both Doppler and speckle-variance methods are employed to
characterize complex rheological flows both in-vitro and in-vivo. GPU accelerated image registration
methods are demonstrated in order to mitigate problems of bulk tissue motion in methods based on speckle
decorrelation. In-vivo images of the human nailfold microcirculation are shown
- …