The Natural Statistics of Audiovisual Speech

Humans, like other animals, are exposed to a continuous stream of signals, which are dynamic, multimodal, extended, and time varying in nature. This complex input space must be transduced and sampled by our sensory systems and transmitted to the brain where it can guide the selection of appropriate actions. To simplify this process, it's been suggested that the brain exploits statistical regularities in the stimulus space. Tests of this idea have largely been confined to unimodal signals and natural scenes. One important class of multisensory signals for which a quantitative input space characterization is unavailable is human speech. We do not understand what signals our brain has to actively piece together from an audiovisual speech stream to arrive at a percept versus what is already embedded in the signal structure of the stream itself. In essence, we do not have a clear understanding of the natural statistics of audiovisual speech. In the present study, we identified the following major statistical features of audiovisual speech. First, we observed robust correlations and close temporal correspondence between the area of the mouth opening and the acoustic envelope. Second, we found the strongest correlation between the area of the mouth opening and vocal tract resonances. Third, we observed that both area of the mouth opening and the voice envelope are temporally modulated in the 2–7 Hz frequency range. Finally, we show that the timing of mouth movements relative to the onset of the voice is consistently between 100 and 300 ms. We interpret these data in the context of recent neural theories of speech which suggest that speech communication is a reciprocally coupled, multisensory event, whereby the outputs of the signaler are matched to the neural processes of the receiver

Image and Video for Hearing Impaired People

<p/> <p>We present a global overview of image- and video-processing-based methods to help the communication of hearing impaired people. Two directions of communication have to be considered: from a hearing person to a hearing impaired person and vice versa. In this paper, firstly, we describe sign language (SL) and the cued speech (CS) language which are two different languages used by the deaf community. Secondly, we present existing tools which employ SL and CS video processing and recognition for the automatic communication between deaf people and hearing people. Thirdly, we present the existing tools for reverse communication, from hearing people to deaf people that involve SL and CS video synthesis.</p

Epidemiology, clinical features and diagnostic work-up of cystic neoplasms of the pancreas: Interim analysis of the prospective PANCY survey

Introduction: A prospective survey to evaluate the diagnostic workup of cystic pancreatic neoplasms (CPNs) according to the Italian guidelines. Methods: An online data sheet was built. Results: Fifteen of the 1385 patients (1.1%) had non cystic neoplastic lesions. Forty percent (518/1295) had at least one 1st degree relative affected by a solid tumor of the digestive and extra-digestive organs. Symptoms/signs associated with the cystic lesion were present in 24.5% of the patients. The cysts were localized in the head of the pancreas in 38.5% of patients. Of the 2370 examinations (1.7 examinations per patient) which were carried out for the diagnosis, magnetic resonance imaging was performed as a single test in 48.4% of patients and in combination with endoscopic ultrasound in 27% of the cases. Of the 1370 patients having CPNs, 89.9% had an intraductal papillary mucinous neoplasm (IPMN) (70.1% a branch duct IPMN, 6.2% a mixed type IPMN and 4.6% a main duct IPMN), 12.7% had a serous cystadenoma, 2.8% a mucinous cystadenoma, 1.5% a non-functioning cystic neuroendocrine neoplasm, 0.7% a solid-pseudopapillary cystic neoplasm, 0.3% a cystic adenocarcinoma, and 1.2% an undetermined cystic neoplasm. Seventy-eight (5.7%) patients were operated upon after the initial work-up. Conclusions: This prospective study offers a reliable real-life picture of the diagnostic work-up CPN

Incidence of traumatic spinal cord injury in Italy during 2013-2014: A population-based study

Study design: Observational prospective population-based incidence study. Objectives: The main objective of this study was to assess the incidence of traumatic spinal cord injuries (TSCIs) and incidence rates, in order to provide estimates by age, gender, characteristics and cause. Setting: This study was conducted at acute-care spinal cord injury (SCI) hospitals and SCI centers from 11 Italian regions, between 1 October 2013 and 30 September 2014. Methods: Data of all consecutive patients with acute TSCI who met the inclusion criteria were obtained through case reporting by clinicians. The data were collected into a web database. Incidence rates and incidence rate ratios were calculated and stratified by age, gender, cause, level and completeness. Results: From 50% of the entire population of Italy, 445 new cases of TSCI were included. The crude incidence rate of TSCI was 14.7 cases per million per year (95% CI: 13.4-16.4); the overall male to female ratio was 4:1 and the mean age was 54. Complete information was available in 85% of the sample and revealed tetraplegia in 58% and incomplete lesion in 67% of cases. The leading cause of TSCI was falls (40.9%) followed by road traffic accidents (33.5%). The leading cause was falls for patients over 55 and road traffic accidents for patients under 55. Conclusion: The changing trend of TSCI epidemiology concerns the increase in the average age of TSCI people and the increase of both cervical and incomplete lesions. The etiology shows the primacy of falls over road traffic accidents and suggests the need for a change in prevention policies