A neurocognitive poetics investigation of eye movements during the reading of Baudelaire’s ‘Les Chats’

Following Jakobson and Levi-Strauss famous analysis of Baudelaire’s poem ‘Les Chats’ (‘The Cats’), in the present study we investigated the reading of French poetry from a Neurocognitive Poetics perspective. Our study is exploratory and a first attempt in French, most previous work having been done in either German or English (e.g., Jacobs, 2015a, 2018a, b; Müller et al., 2017; Xue et al., 2019). We varied the presentation mode of the poem Les Chats (verse vs. prose form) and measured the eye movements of our readers to test the hypothesis of an interaction between presentation mode and reading behavior. We specifically focussed on rhyme scheme effects on standard eye movement parameters. Our results replicate those from previous English poetry studies in that there is a specific pattern in poetry reading with longer gaze durations and more rereading in the verse than in the prose format. Moreover, presentation mode also matters for making salient the rhyme scheme. This first study generates interesting hypotheses for further research applying quantitative narrative analysis to French poetry and developing the Neurocognitive Poetics Model of literary reading (NCPM; Jacobs, 2015a) into a cross-linguistic model of poetry reading

Accessible collaborative learning environments for mobile devices

Mención Internacional en el título de doctorNew technologies and devices are being used in learning environments by teachers and students. Some of these tools are computer supported collaborative learning tools that help them collaborate with each other and share knowledge. Chat applications are one of these tools. These tools allow sharing materials and knowledge or solve doubts in real time without the necessity of being in the same room at the same time. Especially, these tools are being used in mobile devices which make collaboration more ubiquitous because people can use them everywhere. However, existing chat applications are not fully accessible and present accessibility barriers that users need to face every day. People with disabilities encounter these barriers every day despite of they have the same rights as people without disabilities according to multiple regulations in many countries around the World. These barriers might not be faced by people with disabilities only, people with disabilities who use mobile devices in different environments e.g. on the move or in bright environments can suffer similar problems as people with disabilities. This thesis aims to identify the accessibility barriers that m-learning chat applications have. Besides, considering these problems, this research aims, as far as possible, to improve the accessibility of chat applications. As a result, people with and without disabilities could collaborate with each other without facing accessibility barriers that will mermaid their learning. The main objectives of this thesis are: firstly, identify accessibility barriers that people with and without disabilities face when they use chat applications; secondly, specify the requirements that accessible m-learning chat applications should include for being accessible; and finally, provide an accessible interaction improvement for these applications. All these objectives have been achieved following a user centred design approach. As a result, more than 200 people with and without disabilities have participated in this thesis.Las tecnologías de la información se utilizan en entornos educativos para ayudar a los estudiantes y profesores a compartir y mejorar el aprendizaje. Algunas de estas herramientas permiten a los estudiantes compartir conocimiento y aprender colaborando entre sí, y se suelen denominar herramientas de aprendizaje colaborativas. Un ejemplo de herramienta colaborativa es la aplicación Chat. A través de estas aplicaciones, los profesores y estudiantes pueden compartir recursos y conocimiento o resolver dudas en tiempo real, sin la necesidad de encontrarse en la misma aula al mismo tiempo. Estas herramientas se utilizan hoy en día en dispositivos móviles que permiten realizar colaboraciones de forma ubicua, ya que se pueden utilizar desde cualquier lugar. Sin embargo, hoy en día las aplicaciones chats que existen en el mercado no son completamente accesibles, presentando barreras de accesibilidad que los usuarios tienen que sortear cada día. Las personas con discapacidad sufren estas barreras, a pesar de que están amparados por leyes de todo el mundo que especifican que tienen los mismos derechos que las personas sin discapacidad. Estas barreras de accesibilidad no son barreras que sólo personas con discapacidad pueden percibir, personas sin discapacidad pueden sufrir los mismos problemas cuando utilizan estas herramientas en dispositivos móviles, cuando se están desplazando o cuando utilizan los dispositivos en espacios abiertos con mucha luz. En esta tesis doctoral se pretende estudiar las barreras de accesibilidad que presentan las aplicaciones chat en entornos educativos con dispositivos móviles. De esta forma, se trata, en la medida de lo posible, de mejorar la accesibilidad de este tipo de aplicaciones. Como resultado, personas con discapacidad y sin discapacidad podrán colaborar entre sí, sin encontrar problemas de accesibilidad. Los tres objetivos principales de esta tesis son: primero, identificar los problemas que las personas con y sin discapacidad tienen cuando utilizan los chats; segundo, especificar los requisitos de accesibilidad que los chats deben incluir en entornos de aprendizaje utilizando dispositivos móviles; y finalmente, realizar una propuesta de mejora de accesibilidad de este tipo de aplicaciones. Todos estos objetivos se han alcanzado siguiendo para ello un diseño centrado en el usuario en el que se ha contado con la participación de más de 200 personas con y sin discapacidad para obtener cada una de las aportaciones resultado de los objetivos propuestos.Programa Oficial de Doctorado en Ciencia y Tecnología InformáticaPresidente: Covadonga Rodrigo San Juan.- Secretario: María Belén Ruiz Mezcua.- Vocal: Leonel Caseiro Morgad

Acoustics and Resonance in Poetry: The Psychological Reality of Rhyme in Baudelaire’s “Les Chats”

This article uses the term “psychological reality” in this sense: the extent to which the constructs of linguistic theory can be taken to have a basis in the human mind, i.e., to somehow be reflected in human cognitive structures. This article explores the human cognitive structures in which the constructs of phonetic theory may be reflected. The last section is a critique of the psychological reality of sound patterns in Baudelaire’s “Les Chats”, as discussed in three earlier articles. In physical terms, it defines “resonant” as “tending to reinforce or prolong sounds, especially by synchronous vibration”. In phonetic terms it defines “resonant” as “where intense precategorical auditory information lingers in short-term memory”. The effect of rhyme in poetry is carried by similar overtones vibrating in the rhyme fellows, resonating like similar overtones on the piano. In either case, we do not compare overtones item by item, just hear their synchronous vibration. I contrast this conception to three approaches: one that points out similar sounds of “internal rhymes”, irrespective of whether they may be contained within the span of short-term memory (i.e., whether they may have psychological relit); one that claims that syntactic complexity may cancel the psychological reality of “internal rhymes” (whereas I claim that it merely backgrounds rhyme); and one that found through an eye-tracking experiment that readers fixate longer on verse-final rhymes than on other words, assuming regressive eye-movement (I claim that rhyme is an acoustic not visual phenomenon; and that there is a tendency to indicate discontinuation by prolonging the last sounds in ordinary speech and blank verse too, as well as in music — where no rhyme is involved)

Data Musicalization

Data musicalization is the process of automatically composing music based on given data, as an approach to perceptualizing information artistically. The aim of data musicalization is to evoke subjective experiences in relation to the information, rather than merely to convey unemotional information objectively. This paper is written as a tutorial for readers interested in data musicalization. We start by providing a systematic characterization of musicalization approaches, based on their inputs, methods and outputs. We then illustrate data musicalization techniques with examples from several applications: one that perceptualizes physical sleep data as music, several that artistically compose music inspired by the sleep data, one that musicalizes on-line chat conversations to provide a perceptualization of liveliness of a discussion, and one that uses musicalization in a game-like mobile application that allows its users to produce music. We additionally provide a number of electronic samples of music produced by the different musicalization applications.Peer reviewe

Ranking to Learn and Learning to Rank: On the Role of Ranking in Pattern Recognition Applications

The last decade has seen a revolution in the theory and application of machine learning and pattern recognition. Through these advancements, variable ranking has emerged as an active and growing research area and it is now beginning to be applied to many new problems. The rationale behind this fact is that many pattern recognition problems are by nature ranking problems. The main objective of a ranking algorithm is to sort objects according to some criteria, so that, the most relevant items will appear early in the produced result list. Ranking methods can be analyzed from two different methodological perspectives: ranking to learn and learning to rank. The former aims at studying methods and techniques to sort objects for improving the accuracy of a machine learning model. Enhancing a model performance can be challenging at times. For example, in pattern classification tasks, different data representations can complicate and hide the different explanatory factors of variation behind the data. In particular, hand-crafted features contain many cues that are either redundant or irrelevant, which turn out to reduce the overall accuracy of the classifier. In such a case feature selection is used, that, by producing ranked lists of features, helps to filter out the unwanted information. Moreover, in real-time systems (e.g., visual trackers) ranking approaches are used as optimization procedures which improve the robustness of the system that deals with the high variability of the image streams that change over time. The other way around, learning to rank is necessary in the construction of ranking models for information retrieval, biometric authentication, re-identification, and recommender systems. In this context, the ranking model's purpose is to sort objects according to their degrees of relevance, importance, or preference as defined in the specific application.Comment: European PhD Thesis. arXiv admin note: text overlap with arXiv:1601.06615, arXiv:1505.06821, arXiv:1704.02665 by other author

Ranking to Learn and Learning to Rank: On the Role of Ranking in Pattern Recognition Applications

The last decade has seen a revolution in the theory and application of machine learning and pattern recognition. Through these advancements, variable ranking has emerged as an active and growing research area and it is now beginning to be applied to many new problems. The rationale behind this fact is that many pattern recognition problems are by nature ranking problems. The main objective of a ranking algorithm is to sort objects according to some criteria, so that, the most relevant items will appear early in the produced result list. Ranking methods can be analyzed from two different methodological perspectives: ranking to learn and learning to rank. The former aims at studying methods and techniques to sort objects for improving the accuracy of a machine learning model. Enhancing a model performance can be challenging at times. For example, in pattern classification tasks, different data representations can complicate and hide the different explanatory factors of variation behind the data. In particular, hand-crafted features contain many cues that are either redundant or irrelevant, which turn out to reduce the overall accuracy of the classifier. In such a case feature selection is used, that, by producing ranked lists of features, helps to filter out the unwanted information. Moreover, in real-time systems (e.g., visual trackers) ranking approaches are used as optimization procedures which improve the robustness of the system that deals with the high variability of the image streams that change over time. The other way around, learning to rank is necessary in the construction of ranking models for information retrieval, biometric authentication, re-identification, and recommender systems. In this context, the ranking model's purpose is to sort objects according to their degrees of relevance, importance, or preference as defined in the specific application.Comment: European PhD Thesis. arXiv admin note: text overlap with arXiv:1601.06615, arXiv:1505.06821, arXiv:1704.02665 by other author