Advanced Augmentative and Alternative Communication System Based in Physiological Control

Dyskinetic Cerebral Palsy (DCP) is mainly characterized by alterations in muscle tone and involuntary movements. Therefore, these people present with difficulties in coordination and movement control, which makes walking difficult and affects their posture when seated. Additionally, their cognitive performance varies between being completely normal and severe mental retardation. People with DCP were selected as the objective of this thesis due to their multiple and complex limitations (speech problems and motor control) and because their capabilities have a great margin for improvement thanks to physiological control systems. Given their communication difficulties, some people with DCP have good motor con-trol and can communicate with written language. However, most have difficulty using Augmentative and Alternative Communication (AAC) systems. People with DCP gen-erally use concept boards to indicate the idea they want to communicate. However, most communication solutions available today are based on proprietary software that makes it difficult to customize the concept board and this type of control system. This is the motivation behind this thesis, with the aim of creating an interface with characteristics, able to be adapted to the user needs and limitations. Thus, this thesis proposes an Augmentative and Alternative Communication System for people with DCP based on physiological control. In addition, an innovative system for direct con-trol of concept boards with EMG is proposed. This control system is based on a physi-cal model that reproduces the muscular mechanical response (stiffness, inertia and viscosity). It allows for a selection of elements thanks to small pulses of EMG signal with sensors on a muscle with motor control. Its main advantage is the possibility of correcting errors during selection associated with uncontrolled muscle impulses, avoid-ing sustained muscle effort and thus reduced fatigue.La Parálisis Cerebral de tipo Discinésica (DCP) se caracteriza principalmente por las alteraciones del tono muscular y los movimientos involuntarios. Por ello, estos pacientes presentan dificultades en la coordinación y en el control de movimientos, lo cual les dificulta el caminar y afecta su postura cuando están sentados. Cabe resaltar que la capacidad cognitiva de las personas con DCP puede variar desde completamente normal, hasta un retraso mental severo. Las personas con DCP han sido seleccionadas como objetivo de esta tesis ya el margen de mejora de sus capacidades es amplio gracias a sistemas de control fisiológico, debido a sus múltiples y complejas limitaciones (problemas de habla y control motor). Debido a sus dificultades de comunicación, algunas personas con DCP se pueden comunicar con lenguaje escrito, siempre y cuando tenga un buen control motor. Sin embargo, la mayoría tienen dificultades para usar sistemas de Comunicación Aumentativos y Alternativos (AAC). De hecho, las personas con DCP utilizan generalmente tableros de conceptos para indicar la idea que quieren transmitir. Sin embargo, la mayoría las soluciones de comunicación disponibles en la actualidad están basadas en software propietario que hacen difícil la personalización del tablero de conceptos y el tipo de sistema de control. Es aquí donde surge esta tesis, con el objetivo de crear una interfaz con esas características, capaz de adaptarse a las necesidades y limitaciones del usuario. De esta forma, esta tesis propone un sistema de comunicación aumentativo y alternativo para personas con DCP basado en control fisiológico. Además, se propone un Sistema innovador de control directo sobre tableros de conceptos basado en EMG. Este Sistema de control se basa en un modelo físico que reproduce la respuesta mecánica muscular (basado en parámetros como Rigidez, Inercia y Viscosidad), permitiendo la selección de elementos gracias a pequeños pulsos de señal EMG con sensores sobre un músculo con control motor. Sus principales ventajas son la posibilidad de corregir errores durante la selección asociado a los impulsos musculares no controlados, evitar el esfuerzo muscular mantenido para alcanzar un nivel y reducir la fatiga.La Paràlisi Cerebral de tipus Discinèsica (DCP) es caracteritza principalment per les alteracions del to muscular i els moviments involuntaris. Per açò, aquests pacients presenten dificultats en la coordinació i en el control de moviments, la qual cosa els dificulta el caminar i afecta la seua postura quan estan asseguts. Cal ressaltar que la capacitat cognitiva de les persones amb DCP pot variar des de completament normal, fins a un retard mental sever. Les persones amb DCP han sigut seleccionades com a objectiu d'aquesta tesi ja el marge de millora de les seues capacitats és ampli gràcies a sistemes de control fisiològic, a causa dels seus múltiples i complexes limitacions (problemes de parla i control motor). A causa de les seues dificultats de comunicació, algunes persones amb DCP es poden comunicar amb llenguatge escrit, sempre que tinga un bon control motor. No obstant açò, la majoria tenen dificultats per a usar sistemes de Comunicació Augmentatius i Alternatius (AAC). De fet, les persones amb DCP utilitzen generalment taulers de conceptes per a indicar la idea que volen transmetre. No obstant açò, la majoria les solucions de comunicació disponibles en l'actualitat estan basades en programari propietari que fan difícil la personalització del tauler de conceptes i el tipus de sistema de control. És ací on sorgeix aquesta tesi, amb l'objectiu de crear una interfície amb aqueixes característiques, capaç d'adaptar-se a les necessitats i limitacions de l'usuari. D'aquesta forma, aquesta tesi proposa un sistema de comunicació augmentatiu i alternatiu per a persones amb DCP basat en control fisiològic. A més, es proposa un sistema innovador de control directe sobre taulers de conceptes basat en EMG. Aquest sistema de control es basa en un model físic que reprodueix la resposta mecànica muscular (basat en paràmetres com a Rigidesa, Inèrcia i Viscositat), permetent la selecció d'elements gràcies a xicotets polsos de senyal EMG amb sensors sobre un múscul amb control motor. Els seus principals avantatges són la possibilitat de corregir errors durant la selecció associat als impulsos musculars no controlats, evitar l'esforç muscular mantingut per a aconseguir un nivell i reduir la fatiga.Díaz Pineda, JA. (2017). Advanced Augmentative and Alternative Communication System Based in Physiological Control [Tesis doctoral no publicada]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/90418TESI

Tracking Visible Features of Speech for Computer-Based Speech Therapy for Childhood Apraxia of Speech

At present, there are few, if any, effective computer-based speech therapy systems (CBSTs) that support the at-home component for clinical interventions for Childhood Apraxia of Speech (CAS). PROMPT, an established speech therapy intervention for CAS, has the potential to be supported via a CBST, which could increase engagement and provide valuable feedback to the child. However, the necessary computational techniques have not yet been developed and evaluated. In this thesis, I will describe the development of some of the key underlying computational components that are required for the development of such a system. These components concern camera-based tracking of visible features of speech which concern jaw kinematics. These components would also be necessary for the serious game that we have envisioned

A Grammar of Italian Sign Language (LIS)

A Grammar of Italian Sign Language (LIS) is a comprehensive presentation of the grammatical properties of LIS. It has been conceived as a tool for students, teachers, interpreters, the Deaf community, researchers, linguists and whoever is interested in the study of LIS. It is one output of the Horizon 2020 SIGN-HUB project. It is composed of six Parts: Part 1 devoted to the social and historical background in which the language has developed, and five Parts covering the main properties of Phonology, Lexicon, Morphology, Syntax and Pragmatics. Thanks to the electronic format of the grammar, text and videos are highly interconnected and are designed to fit the description of a visual language

Special issue: Lugha ya mitaani in Tanzania - the poetics and sociology of a young urban style of speaking: with a dictionary comprising 1100 words and phrases

Swahili has been moulded in a long process by many factors over many centuries (Chiraghdin & Mnyampala 1977, Khalid 1977, Nurse & Spear 1985, Shariff 1973, Whiteley 1969). One of the latest chapters in its history is the standardisation and implementation as national and official language in Tanzania after independence.The National Swahili Council was given the task of further developing as well as guarding the standard form in textbooks for schools, in literature, in music texts, and in radio and television broadcasting. However, while Standard Swahili was taught in schools and writtenin books and newspapers, people in town quarters where Swahili was spoken developed and used a colloquial style of speech by enriching the standard form with “slang” expressions and lexemes.Recently, many people in Tanzania speak of “lugha za mitaani” (‘languages of the town quarters’, or ‘street languages’), using the plural to point to the fact that there exists a whole range of varieties of non-standard language, depending on local and social factors. The more recent development of lugha za mitaani reflects very much the social, economic, and political liberalisation in Tanzania, which started in the late 1980s. Little research has been done on the complex of these locally coloured colloquial Swahili variants, and we hope that our work will prepare the ground for further, more detailed studies. Since we acknowledge the existence of variants, we will use Lugha ya Mitaani (henceforth abbreviated LyM) to denote the phenomenon as such, whereas we will apply the term Lugha za Mitaani (henceforth abbreviated LzM) when we speak of the complex of variants.The primary characteristic of lugha za mitaani in general is that they deviate from Standard Kiswahili by their special lexicon which is in a constant process of rapid renovation. This is done by way of deliberate manipulation of existing lexical items, as an expression of an attitude of jocular and provocative violation of linguistic norms.Looking into the linguistic makeup, it is quite clear that Lugha ya Mitaani is not an independent language, but a sociolect or register of Kiswahili. The geographical centre of the ongoing creation and recreation of linguistic elements is Dar es Salaam. From there the linguistic items spread very quickly into the interior and reach even remote places such as Nachingwea (Lindi region) and Kurio (Dodoma region), where we conducted our research. The remarkably high mobility of the youth in Tanzania plays a crucial role in this process, but also the media, especially music, radio, video, and the yellow press contribute a lot to the rapid diffusion of Lugha ya Mitaani-terms. This article is based on research conducted in Tanzania between 2000 and 2006 and approaches the phenomenon of Lugha ya Mitaani from different angles. A substantial part of the field research was lexicographic in nature, complemented by ethnographic methods (see chapter two). The analysis focuses on form, function, mediation and general comparative sociolinguistic issues of Lugha ya Mitaani.:1. Introduction: Lugha ya Mitaani 1 1.1 History of colloquial non-standard Swahili speech forms 1 1.2 Special forms of Lugha ya Mitaani 4 1.2.1 Campus Swahili 5 1.2.2 Secret codes derived from Swahili 5 1.2.3 Lugha ya vijana wa vijiweni 6 1.2.4 The language of daladalas 8 1.3 Overview of the article 9 2. Methodology 10 2.1 Field research 10 2. 2 Acknowledgements 12 2. 3 The making of the dictionary 12 3. Sociolinguistics of Lugha ya Mitaani 13 3.1 Lugha ya Mitaani as youth language 13 3.2 Knowledge, use and attitudes 14 3.3 Diachronic aspects of Lugha ya Mitaani 17 4. Lexical elaboration 18 4.1 Humans and social relations 20 4.1.1 Humans 20 4.1.2 Women 21 4.1.3 Men 23 4.1.4 Homosexuals 23 UTA REUSTER-JAHN & ROLAND KIEßLING 4.1.5 Social relationship 24 4.1.6 Social status 24 4.2 Communication 24 4.3 Body & Appearance 25 4.4 Economy, Money & Occupation 26 4.5 Sex 27 4.6 Drugs & Alcohol 28 4.7 Movement & Vehicles 28 4.8 Evaluative terms 29 4.9 Experience 30 4.10 Trouble & Violence 30 4.11 Crime & Police 30 4.12 Food 31 4.13 Disease 31 4.14 Geography & Place 32 4.15 Education 32 4.16 Sports 33 4.17 Weapons 33 4.18 Cultural innovation 33 4.19 Time 33 5. The poetic making of Lugha ya Mitaani 34 5.1 Hyperbole and dysphemism 35 5.2 Humoristic effects 37 5.3 Metaphors 39 LUGHA YA MITAANI IN TANZANIA 5.4 Cognitive motivation 41 5.5 Onomastic synecdoche 43 5.6 Multiple semantic extensions 44 5.7 Folk etymologies 45 5.8 Phraseologisms 46 5.9 Manipulations of form 50 5.10 Donor languages 52 6. The construction of youth identities in discourse practice 53 7. Lugha ya Mitaani and the media 60 8. Lugha ya Mitaani in a historical perspective 66 8.1 Lugha ya Mitaani in contrast to other phenomena of language birth 67 8.1.1 Pidginisation and creolisation 67 8.1.2 Codeswitching 67 8.1.3 Lugha ya Mitaani and Sheng 70 8.2 Semantic change 75 8.3 Sociosymbolic change 76 9. Conclusion 78 Abbreviations 79 Bibliography 80 Appendix 1: Lugha ya Mitaani texts written by John Degera 88 Appendix 2: Diachronic change in the campus lexicon at Teacher Training College Nachingwea 90 Appendix 3: Dictionary of Lugha ya Mitaani 9

The Effect of Developmental Factors on the Use of an Electronic Communication Device.

This study addressed a poorly understood variable of voice output communication aid (VOCA) use, namely mnemonic development. Forty children without disabilities, aged from 49 to 60 months, were required to use an IntroTalker (Prentke Romich Company) to participate in a one-on-one storybook reading task with the investigator. They were provided with sixteen messages to use during a scripted reading of The Three Bears. Children could use a trained verbal elaboration strategy or generate their own methods to retrieve messages. Immediate and delayed responses of children under two training methods were compared, and the contribution of developmental factors, including metamemory, were evaluated. In the control method, Direct Instruction (DI), children learned to retrieve messages via an error-free method including simple repetition of a verbal elaboration mnemonic. In the experimental method, Active Problem Solving (APS), children were first led through a series of steps alerting them to the limitations of non-symbolic retrieval strategies and allowing them to make retrieval errors, thus discovered the relative value of various retrieval strategies. Next, they were taught to retrieve the remaining messages in the same way as the DI children. Children with low metamemory skill were less accurate in their retrieval of messages, and produced more Self-corrected Responses when trained under the APS condition. Children receiving APS training showed an initial retrieval advantage on the first story-retelling immediately following training; however, on the second day retrieval by DI subjects matched APS. It was concluded that DI children experienced a de facto active problem-solving condition on the first day, when they produced many errors, thereby enhancing the value of the verbal elaborations they had been trained to use. Effects of perceptual, semantic and syntactic development, and of conflicts between the canonical and experimental Three Bears script were evident. Although the use of a normally developing population is controversial in the area of augmentative communication, the strategy was found to produce valuable insights into the errors made by children. Overall, the task was easy for most of the children, thereby supporting the use of VOCAs with young children

Exploring the multimodal communication and agency of children in an autism classroom.

This study explores the communication and agency of five children between 6-8 years old attending a special school in England. The children have all received a diagnosis of Autism Spectrum Disorder and demonstrate limited or no verbal speech. The study analyses how the children communicate with staff and peers in the classroom, how the diverse communicative contexts arising from the school day shape their communicative behaviours, and the nature of the relationship between their communication opportunities and the agency they exercise in the classroom. The study draws on a wide range of data including classroom video recordings, fieldnotes, the author’s reflexive research journal, interviews with classroom staff and with the children’s parents and the collection of photographs and documents. It adopts a hybridized methodological framework drawing upon ethnography of communication, Conversation Analysis and Multimodal Interaction Analysis. This framework is used to enable fine-grained analysis of communication and to subsequently locate such microanalysis within a broader ethnographic context. The children in this study communicate using a range of strategies including the use of Picture Exchange Communication System (PECS®) and Makaton® signing, embodied communication and Intensive Interaction. Some individual variation between children is noted in terms of their preferred modes, speech topics, functions and interactional partners. Communication mediated by Makaton and PECS is often associated with requesting objects or help from adults as well as social convention such as please and thank-you, and appears to be outstripped in range and complexity by the children’s embodied multimodal communication. Some forms of communication are found to be highly associated with certain classroom communicative contexts. Whilst all the children show at least some orientation towards peer interaction, the nature of a specialist setting with high staff to student ratios, small classes, an absence of non-disabled peers and AAC provision which orients towards object requesting together tend to mitigate against interactions with other children. Implications arising from the study include the need to think critically about facilitating peer interaction in specialist settings, to reflect on how and why some vocabulary and speech functions are provided with PECS and Makaton to the exclusion of others, and to consider the very complex relationships between classroom activities, vocabulary, mode, speech function and interactional partners. It is suggested that the concept of childhood ‘agency’ might support practitioners and policy makers in reflecting on how communication support for disabled children might enhance their lives both present and future

Diminutive suffixes in the German language: an investigation of the -chen and -lein morphemes in the Baby Talk

The German language is one of those languages that allow the formation of the diminutive form, which is created - according to the grammar books – by adding either the suffix -chen or -lein to the noun. Even if the grammar allows it, the frequency of use is not so high as in other languages. Hence, German native speakers tend to use other constructions to conceive a similar meaning., e.g., the use of the adjective "klein" before the noun to emphasize the differences in terms of size. The starting point of the present work finds its roots in the accurate study by W. U. Dressler – L. Merlini Barbaresi (1994), that present the evaluative morphology of the German language in a cross-linguistical point of view. However, the present paper will offer an outline of the German evaluative morphology in its own language system, especially, observing and analyzing the German spoken language. The analysis on which the paper is based has been carried out through a questionnaire that has been submitted to native German speakers – for a matter of reliability – and in particular to those German people that are mainly parents of very young children or that in some way have kids in their everyday life. By this questionnaire it has been possible to detect many features about the frequency of use of the diminutives and their differences of use according to a given context. Therefore, two contexts of communication have been considered: the first one should reassemble a normal everyday context in which adults have conversations with their peers, while in the second one adults find themselves in a conversation with children. The reason of the choice of this target linked to the main hypothesis from which this work is born: German diminutive forms are mainly used in the baby talk.The German language is one of those languages that allow the formation of the diminutive form, which is created - according to the grammar books – by adding either the suffix -chen or -lein to the noun. Even if the grammar allows it, the frequency of use is not so high as in other languages. Hence, German native speakers tend to use other constructions to conceive a similar meaning., e.g., the use of the adjective "klein" before the noun to emphasize the differences in terms of size. The starting point of the present work finds its roots in the accurate study by W. U. Dressler – L. Merlini Barbaresi (1994), that present the evaluative morphology of the German language in a cross-linguistical point of view. However, the present paper will offer an outline of the German evaluative morphology in its own language system, especially, observing and analyzing the German spoken language. The analysis on which the paper is based has been carried out through a questionnaire that has been submitted to native German speakers – for a matter of reliability – and in particular to those German people that are mainly parents of very young children or that in some way have kids in their everyday life. By this questionnaire it has been possible to detect many features about the frequency of use of the diminutives and their differences of use according to a given context. Therefore, two contexts of communication have been considered: the first one should reassemble a normal everyday context in which adults have conversations with their peers, while in the second one adults find themselves in a conversation with children. The reason of the choice of this target linked to the main hypothesis from which this work is born: German diminutive forms are mainly used in the baby talk