A survey on mouth modeling and analysis for Sign Language recognition

© 2015 IEEE.Around 70 million Deaf worldwide use Sign Languages (SLs) as their native languages. At the same time, they have limited reading/writing skills in the spoken language. This puts them at a severe disadvantage in many contexts, including education, work, usage of computers and the Internet. Automatic Sign Language Recognition (ASLR) can support the Deaf in many ways, e.g. by enabling the development of systems for Human-Computer Interaction in SL and translation between sign and spoken language. Research in ASLR usually revolves around automatic understanding of manual signs. Recently, ASLR research community has started to appreciate the importance of non-manuals, since they are related to the lexical meaning of a sign, the syntax and the prosody. Nonmanuals include body and head pose, movement of the eyebrows and the eyes, as well as blinks and squints. Arguably, the mouth is one of the most involved parts of the face in non-manuals. Mouth actions related to ASLR can be either mouthings, i.e. visual syllables with the mouth while signing, or non-verbal mouth gestures. Both are very important in ASLR. In this paper, we present the first survey on mouth non-manuals in ASLR. We start by showing why mouth motion is important in SL and the relevant techniques that exist within ASLR. Since limited research has been conducted regarding automatic analysis of mouth motion in the context of ALSR, we proceed by surveying relevant techniques from the areas of automatic mouth expression and visual speech recognition which can be applied to the task. Finally, we conclude by presenting the challenges and potentials of automatic analysis of mouth motion in the context of ASLR

Hydrologic balance estimation using GIS in Korinthia prefecture, Greece

The main objective of this work is to determine the parameters of hydrological balance for several basins in the prefecture of Korinthia (SE Greece), using hydrometeorological data and geographic information systems (GIS) technology. Multiple linear regression and GIS were used to estimate the spatial distribution of rainfall. The largest precipitation amounts occur in the SW part of the region and decrease towards the eastern and northern coastal parts. The long term mean annual rainfall is 1.39×10<sup>9</sup> m<sup>3</sup>. Based on the Thornthwaite method, infiltration and streamflow were estimated to be 0.29×10<sup>9</sup> m<sup>3</sup>/yr and 0.38×10<sup>9</sup> m<sup>3</sup>/yr, respectively. The unequal distribution of rainfall results in water surplus in the western part of Korinthia prefecture and water deficit in the eastern. We conclude that he estimation of hydrologic balance is a useful tool in order to establish sustainable water resources management in each hydrological basin

WATER RESOURCES IN THE WIDER AREA OF THE APOSELEMIS BASIN, CRETE ISLAND, GREECE

Η γνώση του υδρολογικού ισοζυγίου μιας λεκάνης αποτελεί απαραίτητη προϋπόθεση για να εκτιμηθεί η ασφαλής απόδοση των υδροφόρων συστημάτων ώστε να εξασφαλι­ σθεί η ορθολογική και βιώσιμη διαχείριση τους. Προκειμένου να αντιμετωπιστεί η διαταραχή της ισορροπίας του υδατικού ισοζυγίου στην υδρογεωλογική λεκάνη του Αποσελέμη αλλά και στον ευρύτερο χώρο του όρους Δίκτη είναι απαραίτητη η εκτίμη­ ση του υδατικού ισοζυγίου των επιμέρους λεκανών απορροής δηλαδή της λεκάνης του Αποσελέμη, των οροπεδίων Λασιθίου και Καθαρού καθώς και της υπόλοιπης επιφάνειας απορροής του όρους Δίκτη. Προς τούτο χρησιμοποιήθηκαν οι καταγραφές της απορροής του Αποσελέμη στη θέση Ποταμιές και οι μετρήσεις βροχής σε επτά βροχομετρικούς σταθμούς εντός ή πλησίον της λεκάνης απορροής του Αποσελέμη κατά την περίοδο 1967-2003. Τα όρια των περιοχών και οι μορφολογικές παράμετροι καθορί­ στηκαν με τη χρήση GIS, με βάση το ψηφιακό μοντέλο ανάγλυφου (DEM). Η πραγμα­ τική εξατμισοδιαπνοή σε όλη τη περιοχή υπολογίστηκε με τη μέθοδο ThornthwaiteMather. Διαπιστώθηκε υψηλός βαθμός συσχέτισης της απορροής του Αποσελέμη με τη βροχόπτωση στην ευρύτερη περιοχή πέρα από τα συμβατικά όρια της λεκάνης απορ­ ροής του. Σημαντικό ποσοστό της ετήσιας βροχόπτωσης και απορροής στην περιοχή τροφοδοτεί τόσο τα καρστικά υδροφόρα συστήματα κατάντη όσο και την απορροή του Αποσελέμη. Οι καρστικοί υδροφορίες εκφορτίζονται μερικώς από μεγάλες παράκτιες και υποθαλάσσιες υφάλμυρες πηγές, καθώς και από μικρότερες πηγές γλυκού νερού στην ενδοχώρα. Επιβεβαιώθηκε τέλος με ιχνηθετήσεις που εκτέλεσε το ΙΓΜΕ η υ­ δραυλική επικοινωνία του οροπεδίου Λασιθίου και των κατάντη υδροφορέων.The estimation of hydrologie balance is useful in order to assess the safe yield of the aquifer systems and therefore to establish their rational exploitation and sustainable management. Over-abstractions of groundwater in Aposelemis basin resulted in a severe disequilibrium of its water balance. In order to overcome this disequilibrium we studied the hydrological balance in the wider area ofDikti mountain which comprises the drainage basins of Aposelemis river, ofLasithi and Katharo plateaus and of the rest of the drainage area of Dikti. The data used are the monthly values of Aposelemis runoff in the gauge station at Potamies and rainfall data for the period 1967-2003 from seven stations located within or in the close vicinity of the drainage basin of Aposelemis. Using ArcView GIS, the hydrological basin of Aposelemis river and the drainage area ofDikti were delineated, based on the digital elevation model (DEM). The actual évapotranspiration was estimated by the Thornthwaite method. A high inter-relationship exists between the flow of the Aposelemis river and rainfall outside the conventional boundaries of the Aposelemis basin. A significant portion of the annual rainfall, in that wider area is not only recharging the karst systems downstream but also contributing to the flow of Aposelemis river. Karst aquifer systems are partially drained by large coastal and submarine brackish springs and by inland freshwater springs. Finally, tracer studies carried out by IGME confirmed the hydraulic connection between Lasithiplateau and downstream aquifer systems

Crystal Structure Studies of Human Dental Apatite as a Function of Age

Studies of the average crystal structure properties of human dental apatite as a function of the tooth-age in the range of 5-87 years are reported. The crystallinity of the dental hydroxyapatite decreases with the tooth-age. The a-lattice constant that is associated with the carbonate content in carbonate apatite decreases with the tooth-age in a systematic way, whereas the c-lattice constant does not change significantly. Thermogravimetric measurements demonstrate an increase of the carbonate content with the tooth-age. FTIR spectroscopy reveals both, B and A-type carbonate substitutions with the B-type greater than the A-type substitution by a factor up to ~5. An increase of the carbonate content as a function of the tooth-age can be deduced from the ratio of the v2 CO3 to the v1 PO4 IR modes.Comment: 17 page

Estimating correspondences of deformable objects "in-the-wild"

This is the author accepted manuscript. The final version is available from IEEE via the DOI in this recordDuring the past few years we have witnessed the development of many methodologies for building and fitting Statistical Deformable Models (SDMs). The construction of accurate SDMs requires careful annotation of images with regards to a consistent set of landmarks. However, the manual annotation of a large amount of images is a tedious, laborious and expensive procedure. Furthermore, for several deformable objects, e.g. human body, it is difficult to define a consistent set of landmarks, and, thus, it becomes impossible to train humans in order to accurately annotate a collection of images. Nevertheless, for the majority of objects, it is possible to extract the shape by object segmentation or even by shape drawing. In this paper, we show for the first time, to the best of our knowledge, that it is possible to construct SDMs by putting object shapes in dense correspondence. Such SDMs can be built with much less effort for a large battery of objects. Additionally, we show that, by sampling the dense model, a part-based SDM can be learned with its parts being in correspondence. We employ our framework to develop SDMs of human arms and legs, which can be used for the segmentation of the outline of the human body, as well as to provide better and more consistent annotations for body joints.Engineering and Physical Sciences Research Council (EPSRC)TekesEuropean Community Horizon 202

3D Reconstruction of 'In-the-Wild' Faces in Images and Videos

This is the author accepted manuscript. The final version is available from IEEE via the DOI in this record 3D Morphable Models (3DMMs) are powerful statistical models of 3D facial shape and texture, and are among the state-of-the-art methods for reconstructing facial shape from single images. With the advent of new 3D sensors, many 3D facial datasets have been collected containing both neutral as well as expressive faces. However, all datasets are captured under controlled conditions. Thus, even though powerful 3D facial shape models can be learnt from such data, it is difficult to build statistical texture models that are sufficient to reconstruct faces captured in unconstrained conditions ('in-the-wild'). In this paper, we propose the first 'in-the-wild' 3DMM by combining a statistical model of facial identity and expression shape with an 'in-the-wild' texture model. We show that such an approach allows for the development of a greatly simplified fitting procedure for images and videos, as there is no need to optimise with regards to the illumination parameters. We have collected three new benchmarks that combine 'in-the-wild' images and video with ground truth 3D facial geometry, the first of their kind, and report extensive quantitative evaluations using them that demonstrate our method is state-of-the-art.Engineering and Physical Sciences Research Council (EPSRC

Explicit Evidence Systems with Common Knowledge

Justification logics are epistemic logics that explicitly include justifications for the agents' knowledge. We develop a multi-agent justification logic with evidence terms for individual agents as well as for common knowledge. We define a Kripke-style semantics that is similar to Fitting's semantics for the Logic of Proofs LP. We show the soundness, completeness, and finite model property of our multi-agent justification logic with respect to this Kripke-style semantics. We demonstrate that our logic is a conservative extension of Yavorskaya's minimal bimodal explicit evidence logic, which is a two-agent version of LP. We discuss the relationship of our logic to the multi-agent modal logic S4 with common knowledge. Finally, we give a brief analysis of the coordinated attack problem in the newly developed language of our logic