Fine-grained hand gesture recognition based on active acoustic signal for VR systems

Hand gestures are the nature and dominant interaction interfaces for VR systems. The state of the art interaction mechanism for VR system either requires expensive sensing devices or suffers from accuracy issues thus hard to perform versatile interactions. In this paper, we leverage Ultragloves, a low cost interaction system using microphone-implanted gloves to extract the hand gestures. With specifically designed signals, we manage to get both the distance and the directions in a relatively accurate manner. We then design a CNN-LSTM like learning algorithm to extract the gestures. Furthermore, to improve the accuracy of recognition, we also design a filter algorithm to filter out noisy data. The implementation shows that our method can recognize four micro-gestures in the accuracy of 82% by combining phase and frequency features.</div

Abnormal Functional Connectivity of Amygdala in Late-Onset Depression Was Associated with Cognitive Deficits

<div><p>Background</p><p>Major depressive disorder (MDD) is associated with decreased function of cortico-limbic circuits, which play important roles in the pathogenesis of MDD. Abnormal functional connectivity (FC) with the amygdala, which is involved in cortico-limbic circuits, has also been observed in MDD. However, little is known about connectivity alterations in late-onset depression (LOD) or whether disrupted connectivity is correlated with cognitive impairment in LOD.</p><p>Methods and Results</p><p>A total of twenty-two LOD patients and twenty-two matched healthy controls (HC) underwent neuropsychological tests and resting state functional magnetic resonance imaging (rs-fMRI). Regional homogeneity (ReHo) and FC with bilateral amygdala seeds were used to analyze blood oxygen level-dependent fMRI data between two groups. Compared with HC, LOD patients showed decreased ReHo in the right middle frontal gyrus and left superior frontal gyrus. In the LOD group, the left amygdala had decreased FC with the right middle frontal gyrus and the left superior frontal gyrus in the amygdala positive network, and it had increased FC with the right post-central gyrus in the amygdala negative network. However, significantly reduced FC with the right amygdala was observed in the right middle occipital gyrus in the amygdala negative network. Further correlative analyses revealed that decreased FC between the amygdala and the right middle occipital gyrus was negatively correlated with the verbal fluency test (VFT, <i>r</i> = −0.485, <i>P</i> = 0.022) and the digit span test (DST, <i>r</i> = −0.561, <i>P</i> = 0.007).</p><p>Conclusions</p><p>Our findings of reduced activity of the prefrontal gyrus and abnormal FC with the bilateral amygdala may be key markers of cognitive dysfunction in LOD patients.</p></div

Maps of functional connectivity of Amygdala.

<p>(a) Decreased functional connectivity of left amygdala positive network in LOD compared with HC with a corrected threshold of <i>P</i><0.05, determined by Monte Carlo simulation. Cluster size is more than 119 voxels. (b) Increased functional connectivity of left amygdala negative network in LOD compared with HC with a corrected threshold of <i>P</i><0.05, determined by Monte Carlo simulation. Cluster size is more than 77 voxels. (c) Decreased functional connectivity of right amygdala negative network in LOD compared with HC with a corrected threshold of <i>P</i><0.05, determined by Monte Carlo simulation. Cluster size is more than 86 voxels. (d) − (e) Significant negative correlation between FC with right amygdala and VFT/DST. VFT: Verbal fluency test; DST: digit span test; <i>r</i> = spearman’s correlation coefficient.</p

Reduced ReHo in late onset depression compared with healthy controls with voxels with <i>P</i><0.05 and cluster size is more than 148 voxels, determined by Monte Carlo simulation,age, gender and education level as covariates.

<p>Reduced ReHo in late onset depression compared with healthy controls with voxels with <i>P</i><0.05 and cluster size is more than 148 voxels, determined by Monte Carlo simulation,age, gender and education level as covariates.</p

Reduced ReHo in LOD group compared with HC group.

<p><b>Note:</b> A corrected threshold of p<0.05 determined by Monte Carlo simulation was taken as meaning there was a significantly difference between groups. R  =  right; L  =  left; cluster size is in mm³.</p

Abnormal functional connectivity of bilateral amygdala in LOD group compared with HC group.

<p><b>Note:</b> A corrected threshold of p<0.05 determined by Monte Carlo simulation was taken as meaning there was a significantly difference between groups. R  =  right; L  =  left; cluster size is in mm³.</p

Maps of functional connectivity with Amygdala in the results of one sample t-test.

<p>Resting state left amygdala FC pattern for (a) LOD group, (b) HC group. Resting state right amygdala FC pattern for (c) LOD group, (d) HC group. Corrected with Monte Carlo simulation, P<0.05, Cluster size is more than 119 voxels.</p

Demographic and neuropsychological data between LOD group and HC group.

<p>LOD: late-onset depression; HC: healthy controls; MMSE: Mini mental state exam; HAMA: Hamilton Anxiety Scale; HAMD: Hamilton Depression Scale; AVLT-delayed recall: Auditory Verbal Learning Test-delayed recall; SDMT: Symbol digit modalities test; DST: Digit span test-forward and backward; VFT: Verbal fluency test-animal and verb; TMT-A: Trail making test-A; TMT- B: Trail making test- B.</p>a<p>Independent-samples t-test.</p>b<p>Chi square test.</p>c<p>Analysis of covariance.</p

The result of one sample t-test in amygdala functional connectivity for LOD group and HC group.

<p><b>Note:</b> A corrected threshold of p<0.05 determined by Monte Carlo simulation was taken as meaning there was a significantly difference. Cluster size is more than 389 voxels. R  =  right; L  =  left; cluster size is in mm³.</p

Significant Correlations between Neuropsychological Measurements and ReHo/FC with Amygdala in HC group.

<p>Note: this table only showed the significant correlations by Spearman's correlation. *: <i>P<</i>0.05.</p