Annotating sign language using a dedicated glyph system (the project Typannot)

International audienc

Annotating Sign Language using a dedicated glyph System

International audienc

Toward a typeface for the transcription of facial actions in sign languages

International audienceNon-manual actions, and more specifically facial actions (FA) can be found in all Sign Languages (SL). Those actions involve all the different facial parts and can have various and intricate linguistic relations with manual signs. Unlike in vocal languages, FA in SL provide more meaning than simple expressions of feelings and emotions. Yet non-manual parameters are among the most unknown formal features in SL studies. During the past 30 years, some studies have started questioning the meanings and linguistic values and the relations between manual and non-manual signs (Crashborn et al. 2008; Crashborn & Bank 2014); more recently, SL corpora have been analysed, segmented, and transcribed to help study FA (Vogst-Svenden 2008; Bergman et al. 2008; Sutton-Spence & Day 2008).Moreover, to fill the lack of an annotation system for FA, a few manual annotation systems have integrated facial glyphs, such as HamNoSys (Prillwitz et al. 1989) and SignWriting (Sutton 1995). On one hand, HamNoSys has been developed to describe all existing SLs at a phonetic level; it allows a formal, linear, highly detailed and searchable description of manual parameters. As for non-manual parameters, HamNoSys offers the replacement of hands by another articulators. Non-manual parameters can be written as “eyes” or “mouth” and described by the same symbols developed for hands (Hanke 2004). Unfortunately only a limited number of manual symbols can be translated into FA and the annotation system remains incomplete. On the other hand, SignWriting describes SL with iconic symbols placed in a 2D space representing the signer’s body. Facial expressions are divided into mouth, eyes, nose, eyebrows, etc., and are drawn in a circular “head” much like emoticons. SignWriting offers a detailed description of posture and actions of non-manual parameters, but does not ensure compatibility with the most common annotation software used by SL linguists (e.g., ELAN).Typannot, a interdisciplinary project led by linguists, designers, and developers, which aims to set up a complete transcription system for SL that includes every SL parameter (handshape, localisation, movement, FA), has developed a different methodologie. As mentioned earlier, FA have various linguistic values (mouthings, adverbial mouth gestures, semantically empty, enacting, whole face) and also include prosody and emotional meanings. In this regard, they can be more variable and signer-related than manual parameters. To offer the best annotation tool, Typannot’s approach has been to define facial parameters and all their possible tangible configurations. The goal is to set up the most efficient, simple, yet complete and universal formula to describe all possible FA.This formula is based on a 3 dimensional grid. Indeed all the different configurations of FA can be described by its X, Y, Z axis position. As a result, all FA can be described and encoded using a restricted list of 39 qualifiers. Based on this model and to help reduce the annotation process, a set of generic glyphs has been developed. Each qualifier has its own symbolic “generic” glyph. This methodical decomposition of all facial components enables a precise and accurate transcription of a complex FA using only a few glyphs.This formula and its generic glyphs have gone through a series of tests and revisions. Recently, an 18m20s long FA corpus of two deaf signers has been recorded using two different cameras. The first one, RGB HQ, is used to capture a high quality image and the second, infrared Kinect, is used to captured the depth. The latter was linked with Brekel Proface 2 (Leong et al. 2015), a 3D animation software that enables an automatic recognition of FA. This corpus has been fully annotated using Typannot’s generic glyphs. These annotations have enabled the validation of the general structure of Typannot FAformula and to identify some minor corrections to be made. For instance, it has been shown that the description of the air used to puff out or suck in cheeks is too restrictive and the description of the opening and closure of the eyelids is too unnecessarily precise.When those changes are implemented, our next task will be to develop a morphological glyphic system that will combine the different generic glyphs used for each facial parameter into one unique morphological glyph. This means that for any given FA, all the information contained in Typannot descriptive formula will be contained within one legible glyph. Some early research and work has already begun on this topic, but needs further development before providing a statement on its typographic structure. When this system is completed, it will be released with its own virtual keyboard (Typannot Keyboard, currently in development for handshapes) to help transcription and improve annotation processes.Bibliography :-Chételat-Pelé, E. (2010). Les Gestes Non Manuels en Langue des Signes Française ; Annotation, analyse et formalisation : application aux mouvements des sourcils et aux clignements des yeux. Université de Provence - Aix-Marseille I.-Crasborn, O., Van Der Kooij, E., Waters, D., Woll, B., & Mesch, J. (2008). Frequency distribution and spreading behavior of different types of mouth actions in three sign languages. Sign Language & Linguistics, 11(1), 45–67.-Crasborn, O. A., & Bank, R. (2014). An annotation scheme for the linguistic study of mouth actions in sign languages. http://repository.ubn.ru.nl/handle/2066/132960-Fontana, S. (2008). Mouth actions as gesture in sign language. Gesture, 8(1), 104‑123.-Hanke, T. (2004). HamNoSys—Representing sign language data in language resources and language processing contexts. In Workshop on the Representation and Processing of Sign Languages on the occasion of the Fourth International Conference on Language Resources and Evaluation (p. 1‑6).-Leong, C. W., Chen, L., Feng, G., Lee, C. M., & Mulholland, M. (2015). Utilizing depth sensors for analyzing multimodal presentations: Hardware, software and toolkits (p. 547‑556).Presented at Proceedings of the 2015 ACM on International Conference on Multimodal Interaction, ACM.-Prillwitz, S., Leven, R., Zienert, H., Hanke, T., & Henning, J. (1989). Hamburg notation system for sign languages: An introductory guide. Signum Press, Hamburg.-Sandler, W. (2009). Symbiotic symbolization by hand and mouth in sign language. Semiotica, 2009(174), 241‑275. http://doi.org/10.1515/semi.2009.035-Sutton, V. (1995). Lessons in Sign Writing: Textbook. DAC, La Jolla (CA).-Sutton-Spence, R., & Boyes-Braem, P. (2001). The hands are the head of the mouth: The mouth as articulator in sign languages. Signum Press, Hamburg

Systèmes graphématiques et écritures des langues signées

International audienceOver the last few decades, various writing systems for sign languages (SLs) have been developed in a context where vocal languages (VLs) obviously prevail. In fact, VLs are characterized by a switch of modality between writing and speaking, while SLs present a brand new situation with the possibility of sharing modalities. Indeed, in the act of speaking and writing, SLs use similar modalities (upper body limbs movement) and reception (vision). This unprecedented situation of shared visuo-gestural modalities allows writing and speaking to meet in a form of cohabitation, sharing semiotic features. Scripturality may emerge from the formal (highly graphical in many situations) and gestural dimensions that are inherent to oral expression in SLs. The goal of this article is to establish an approach that links visuo-gestual modalities. On one hand, this approach is founded in ‘orality,’ i.e., in gesture; on the other hand, this approach is rooted in the act of drawing (tracing) as a link between language and writing. Similarly to the way SLs are able to assign meaning to movements, the meaning represented in the marks intended to be read can be back-traced to the body in action. To consider the scriptural experience in this way resonates with the cognitive theory of enaction (Varela et al., 1991) and, more broadly, with the hypotheses of embodied cognition.First we will present the three main notation systems that are used—almost exclusively—among researchers in linguistics studies of SLs. We will discuss their specific characteristics: the visual principles on which they are built in regard to their legibility, and also their ability to be written and used (focusing on the principle of linearity found in other writing systems). In the second part, we will explore in detail some issues of writing SLs such as: how can we articulate the modalities of the act of writing with the semiotic modalities of language itself? What are the analogies available to build a glyphic system? Can the act of tracing and the trace itself boost new semiotic relations in the writing of SLs? In the third part, we will look at some theoretical aspects of existing writing systems and put them into the perspective of the writing of SLs. Finally, this matter will be dealt with through the presentation of Typannot, a notation system on which we are currently working. We will focus on describing the graphematic and typographic principles of this new system. Several conceptual levels are envisioned in order to justify the coupling between technical aspects and writing/tracing activity, with the goal of obtaining a system aimed at: readability, modularity, writability and searchability. These criteria are an attempt to translate concepts of writing systems in VLs for specific issues related to the visual and gestural modalities of SLs.Depuis quelques décennies, les langues des signes (LS) connaissent l’apparition de systèmes de notations qui s’inscrivent dans une pratique dominée par les écritures de langues vocales (LV). Alors que ces dernières sont caractérisées par une rupture de modalité entre l’écrit et l’oral, les LS introduisent la situation inédite d’un possible partage des modalités en convoquant dans leur production les mêmes articulateurs (le membre supérieur) et dans leur réception la même modalité visuelle. Ces circonstances de partage des mêmes modalités gestuo-visuelle placent l’écriture et l’oralité des LS dans un rapport de coexistence, voire de sémiotiques partagées. L’acte d’écrire peut alors se manifester comme une inscription des dimensions formelles (parfois hautement graphiques) et gestuelles intrinsèques de l’oralité et de l’expression des LS. Nous chercherons dans cet article à développer les fondements d’une approche analogique visuo-gestuelle ancrée d’une part dans l’oralité, c’est à dire le geste, et d’autre part dans le tracé comme vecteur de sens communs à la langue et son écriture. Considérer ainsi l’expérience scripturale trouve un écho dans la théorie cognitive de l’énaction (Varela et al., 1991) ou plus généralement dans les hypothèses portant sur la cognition incarnée.Nous présenterons trois des principaux systèmes de notation actuellement en usage, dont l’usage est le plus souvent limité aux chercheurs en linguistique de ces langues. Les principales caractéristiques de ces systèmes de notation seront abordées ; il s’agit de leur lisibilité en lien avec le formalisme sur lequel ils s’appuient, et aussi de leur capacité à être écrits et maniés (en particulier au regard du principe de linéarité des écritures existantes). Dans une deuxième partie, les problématiques que l’écriture des LS posent seront exposées en détails : l’articulation des modalités de production et des modalités sémiotique orale/écrite, les domaines analogiques exploitables dans la construction des principes glyphiques et les rapports sémiotiques nouveaux entre traces et tracés qu’apporte l’écriture des LS. Dans la troisième partie, quelques éléments des théories sur l’écriture seront examinés au regard de ce qu’une écriture des LS apporte. Ils seront illustrés par le système de notation pour les LS appelé « Typannot » (sur lequel les auteurs du présent article travaillent) et plus spécifiquement par ses choix graphématiques et typographiques. Nous développons pour cela une réflexion à plusieurs niveaux rendant compte de ce couplage entre la technique et notre activité scripturale, portant sur la lisibilité, la modularité, la scripturalité et l’automatisation (requêtabilité). Ces critères constituent le cadre d’une réflexion prenant racine dans les systèmes d’écriture des LV pour évoluer vers des problématiques proprement liées aux modalités gestuelles et formelles des LS

Systèmes graphématiques et écritures des langues signées

Depuis quelques décennies, les langues des signes (LS) connaissent l’apparition de systèmes de notations qui s’inscrivent dans une pratique dominée par les écritures de langues vocales (LV). Alors que ces dernières sont caractérisées par une rupture de modalité entre l’écrit et l’oral, les LS introduisent la situation inédite d’un possible partage des modalités en convoquant dans leur production les mêmes articulateurs (le membre supérieur) et dans leur réception la même modalité visuelle. Ces circonstances de partage des mêmes modalités gestuo-visuelle placent l’écriture et l’oralité des LS dans un rapport de coexistence, voire de sémiotiques partagées. L’acte d’écrire peut alors se manifester comme une inscription des dimensions formelles (parfois hautement graphiques) et gestuelles intrinsèques de l’oralité et de l’expression des LS. Nous chercherons dans cet article à développer les fondements d’une approche analogique visuo-gestuelle ancrée d’une part dans l’oralité, c’est à dire le geste, et d’autre part dans le tracé comme vecteur de sens communs à la langue et son écriture. Considérer ainsi l’expérience scripturale trouve un écho dans la théorie cognitive de l’énaction (Varela et al., 1991) ou plus généralement dans les hypothèses portant sur la cognition incarnée.Nous présenterons trois des principaux systèmes de notation actuellement en usage, dont l’usage est le plus souvent limité aux chercheurs en linguistique de ces langues. Les principales caractéristiques de ces systèmes de notation seront abordées ; il s’agit de leur lisibilité en lien avec le formalisme sur lequel ils s’appuient, et aussi de leur capacité à être écrits et maniés (en particulier au regard du principe de linéarité des écritures existantes). Dans une deuxième partie, les problématiques que l’écriture des LS posent seront exposées en détails : l’articulation des modalités de production et des modalités sémiotique orale/écrite, les domaines analogiques exploitables dans la construction des principes glyphiques et les rapports sémiotiques nouveaux entre traces et tracés qu’apporte l’écriture des LS. Dans la troisième partie, quelques éléments des théories sur l’écriture seront examinés au regard de ce qu’une écriture des LS apporte. Ils seront illustrés par le système de notation pour les LS appelé « Typannot » (sur lequel les auteurs du présent article travaillent) et plus spécifiquement par ses choix graphématiques et typographiques. Nous développons pour cela une réflexion à plusieurs niveaux rendant compte de ce couplage entre la technique et notre activité scripturale, portant sur la lisibilité, la modularité, la scripturalité et l’automatisation (requêtabilité). Ces critères constituent le cadre d’une réflexion prenant racine dans les systèmes d’écriture des LV pour évoluer vers des problématiques proprement liées aux modalités gestuelles et formelles des LS.Over the last few decades, various writing systems for sign languages (SLs) have been developed in a context where vocal languages (VLs) obviously prevail. In fact, VLs are characterized by a switch of modality between writing and speaking, while SLs present a brand new situation with the possibility of sharing modalities. Indeed, in the act of speaking and writing, SLs use similar modalities (upper body limbs movement) and reception (vision). This unprecedented situation of shared visuo-gestural modalities allows writing and speaking to meet in a form of cohabitation, sharing semiotic features. Scripturality may emerge from the formal (highly graphical in many situations) and gestural dimensions that are inherent to oral expression in SLs. The goal of this article is to establish an approach that links visuo-gestual modalities. On one hand, this approach is founded in ‘orality,’ i.e., in gesture; on the other hand, this approach is rooted in the act of drawing (tracing) as a link between language and writing. Similarly to the way SLs are able to assign meaning to movements, the meaning represented in the marks intended to be read can be back-traced to the body in action. To consider the scriptural experience in this way resonates with the cognitive theory of enaction (Varela et al., 1991) and, more broadly, with the hypotheses of embodied cognition.First we will present the three main notation systems that are used—almost exclusively—among researchers in linguistics studies of SLs. We will discuss their specific characteristics: the visual principles on which they are built in regard to their legibility, and also their ability to be written and used (focusing on the principle of linearity found in other writing systems). In the second part, we will explore in detail some issues of writing SLs such as: how can we articulate the modalities of the act of writing with the semiotic modalities of language itself? What are the analogies available to build a glyphic system? Can the act of tracing and the trace itself boost new semiotic relations in the writing of SLs? In the third part, we will look at some theoretical aspects of existing writing systems and put them into the perspective of the writing of SLs. Finally, this matter will be dealt with through the presentation of Typannot, a notation system on which we are currently working. We will focus on describing the graphematic and typographic principles of this new system. Several conceptual levels are envisioned in order to justify the coupling between technical aspects and writing/tracing activity, with the goal of obtaining a system aimed at: readability, modularity, writability and searchability. These criteria are an attempt to translate concepts of writing systems in VLs for specific issues related to the visual and gestural modalities of SLs

Hsp60 Is Actively Secreted by Human Tumor Cells

Background: Hsp60, a Group I mitochondrial chaperonin, is classically considered an intracellular chaperone with residence in the mitochondria; nonetheless, in the last few years it has been found extracellularly as well as in the cell membrane. Important questions remain pertaining to extracellular Hsp60 such as how generalized is its occurrence outside cells, what are its extracellular functions and the translocation mechanisms that transport the chaperone outside of the cell. These questions are particularly relevant for cancer biology since it is believed that extracellular chaperones, like Hsp70, may play an active role in tumor growth and dissemination. Methodology/Principal Findings: Since cancer cells may undergo necrosis and apoptosis, it could be possible that extracellular Hsps are chiefly the result of cell destruction but not the product of an active, physiological process. In this work, we studied three tumor cells lines and found that they all release Hsp60 into the culture media by an active mechanism independently of cell death. Biochemical analyses of one of the cell lines revealed that Hsp60 secretion was significantly reduced, by inhibitors of exosomes and lipid rafts. Conclusions/Significance: Our data suggest that Hsp60 release is the result of an active secretion mechanism and, since extracellular release of the chaperone was demonstrated in all tumor cell lines investigated, our observations most likel

Defining Kawasaki disease and pediatric inflammatory multisystem syndrome-temporally associated to SARS-CoV-2 infection during SARS-CoV-2 epidemic in Italy: results from a national, multicenter survey

Background: There is mounting evidence on the existence of a Pediatric Inflammatory Multisystem Syndrome-temporally associated to SARS-CoV-2 infection (PIMS-TS), sharing similarities with Kawasaki Disease (KD). The main outcome of the study were to better characterize the clinical features and the treatment response of PIMS-TS and to explore its relationship with KD determining whether KD and PIMS are two distinct entities. Methods: The Rheumatology Study Group of the Italian Pediatric Society launched a survey to enroll patients diagnosed with KD (Kawasaki Disease Group - KDG) or KD-like (Kawacovid Group - KCG) disease between February 1st 2020, and May 31st 2020. Demographic, clinical, laboratory data, treatment information, and patients' outcome were collected in an online anonymized database (RedCAP®). Relationship between clinical presentation and SARS-CoV-2 infection was also taken into account. Moreover, clinical characteristics of KDG during SARS-CoV-2 epidemic (KDG-CoV2) were compared to Kawasaki Disease patients (KDG-Historical) seen in three different Italian tertiary pediatric hospitals (Institute for Maternal and Child Health, IRCCS "Burlo Garofolo", Trieste; AOU Meyer, Florence; IRCCS Istituto Giannina Gaslini, Genoa) from January 1st 2000 to December 31st 2019. Chi square test or exact Fisher test and non-parametric Wilcoxon Mann-Whitney test were used to study differences between two groups. Results: One-hundred-forty-nine cases were enrolled, (96 KDG and 53 KCG). KCG children were significantly older and presented more frequently from gastrointestinal and respiratory involvement. Cardiac involvement was more common in KCG, with 60,4% of patients with myocarditis. 37,8% of patients among KCG presented hypotension/non-cardiogenic shock. Coronary artery abnormalities (CAA) were more common in the KDG. The risk of ICU admission were higher in KCG. Lymphopenia, higher CRP levels, elevated ferritin and troponin-T characterized KCG. KDG received more frequently immunoglobulins (IVIG) and acetylsalicylic acid (ASA) (81,3% vs 66%; p = 0.04 and 71,9% vs 43,4%; p = 0.001 respectively) as KCG more often received glucocorticoids (56,6% vs 14,6%; p < 0.0001). SARS-CoV-2 assay more often resulted positive in KCG than in KDG (75,5% vs 20%; p < 0.0001). Short-term follow data showed minor complications. Comparing KDG with a KD-Historical Italian cohort (598 patients), no statistical difference was found in terms of clinical manifestations and laboratory data. Conclusion: Our study suggests that SARS-CoV-2 infection might determine two distinct inflammatory diseases in children: KD and PIMS-TS. Older age at onset and clinical peculiarities like the occurrence of myocarditis characterize this multi-inflammatory syndrome. Our patients had an optimal response to treatments and a good outcome, with few complications and no deaths

Search for stop and higgsino production using diphoton Higgs boson decays

Results are presented of a search for a "natural" supersymmetry scenario with gauge mediated symmetry breaking. It is assumed that only the supersymmetric partners of the top-quark (stop) and the Higgs boson (higgsino) are accessible. Events are examined in which there are two photons forming a Higgs boson candidate, and at least two b-quark jets. In 19.7 inverse femtobarns of proton-proton collision data at sqrt(s) = 8 TeV, recorded in the CMS experiment, no evidence of a signal is found and lower limits at the 95% confidence level are set, excluding the stop mass below 360 to 410 GeV, depending on the higgsino mass