The triple task technique for studying writing processes : on which task is attention focused ?

The triple task technique measures the time and cognitive effort devoted to specific writing processes by combining directed retrospection with secondary task reaction time (RT). Writing a text is the primary task and rapidly detecting auditory probes to index cognitive effort is the secondary task. The third task is retrospecting and categorizing the contents of working memory at the time of each probe. The present paper reviews studies on the reactivity and validity of the technique. Further, one recent criticism of the method's validity is tested here: namely, that the primary task for the experimenter is not the primary task for the writer, thus distorting the time and effort measurements. We found that time and effort allocated to planning, translating, executing, evaluating, and revising was the same when the writer was encouraged by instructions to focus either on the speed of responding or the accuracy of retrospection instead of the text itself. Because writing requires sustained thought and attention to produce a cumulative product, it is apparently difficult to make text production anything but the primary task. The triple task technique offers a useful alternative to pause analysis and verbal protocols for investigating the functional features of writing

Audio-visual Rhetoric: Visualizing the Pattern Language of Film

Audio-visual Rhetoric is a knowledge domain for designers in theory and practice that is valid for all communicative actions through media that aim for persuasion. Within this domain, we introduce a framework for media analysis. We developed an Audio-Visual Pattern (AVP) language for film that is visualized within a notation system. This system shows auditory and visual parameters in order to reveal film’s rhetorical structure. We discuss related theories from pattern language and rhetoric and apply the AVP method to analyze 10 commercials. Keywords: Pattern Language, Film Analysis, Rhetoric, Emotion, Persuasion, Design Research</p

First impressions: A survey on vision-based apparent personality trait analysis

© 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes,creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.Personality analysis has been widely studied in psychology, neuropsychology, and signal processing fields, among others. From the past few years, it also became an attractive research area in visual computing. From the computational point of view, by far speech and text have been the most considered cues of information for analyzing personality. However, recently there has been an increasing interest from the computer vision community in analyzing personality from visual data. Recent computer vision approaches are able to accurately analyze human faces, body postures and behaviors, and use these information to infer apparent personality traits. Because of the overwhelming research interest in this topic, and of the potential impact that this sort of methods could have in society, we present in this paper an up-to-date review of existing vision-based approaches for apparent personality trait recognition. We describe seminal and cutting edge works on the subject, discussing and comparing their distinctive features and limitations. Future venues of research in the field are identified and discussed. Furthermore, aspects on the subjectivity in data labeling/evaluation, as well as current datasets and challenges organized to push the research on the field are reviewed.Peer ReviewedPostprint (author's final draft

Estudios acerca del establecimiento de conexiones entre enunciados hablados: ¿qué pueden contribuir a la promoción de la construcción de una representación coherente del discurso por parte de los estudiantes?

The aim of this article is to provide an overview of how the establishment of discourse connections among spoken statements has been studied by approaches to discourse analysis and psycholinguistic studies, in order to highlight what variables appear to be important for understanding how comprehension of spoken discourse can be facilitated. The consideration of discourse analysis approaches allows us to think about the role of the establishment of discourse connections among speech acts in the classroom, the uses of contextualization cues by bilingual students, the identification of social and cultural notions in teachers’ discourse, and the interactional effects of teachers’ interventions. Preliminary psycholinguistic studies contribute to our understanding of the role of establishing causal connections and integrating adjacent statements through the presence of discourse markers in the comprehension of spoken discourse by college students. The results of these approaches and studies provide insight into students’ comprehension of classroom discourse, and hold the potential for implications for instruction.El propósito de este artículo es realizar un recorrido a través de enfoques de análisis del discurso y estudios de psicolingüística que han investigado el establecimiento de conexiones entre enunciados hablados, a fin de destacar las variables que parecen ser centrales para facilitar la comprensión. La consideración de los enfoques del análisis del discurso nos permitirán pensar acerca del rol del establecimiento de conexiones entre actos del lenguaje en el aula, las funciones de las claves de contextualización, la identificación de las nociones sociales y culturales en el discurso de los profesores, los efectos de las intervenciones de los profesores en la interacción con los estudiantes. Los estudios preliminares de psicolingüística contribuirán a nuestra comprensión del rol del establecimiento de conexiones causales e integración de enunciados adyacentes a través de marcadores del discurso por parte de estudiantes universitarios. La consideración de estos enfoques y estudios nos ayudarán a pensar acerca de las contribuciones que sus propuestas y métodos pueden hacer al enriquecimiento de nuestro entendimiento de cómo los estudiantes comprenden el discurso producido durante las clases.Fil: Yomha Cevasco, Jazmin. Universidad de Buenos Aires; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; ArgentinaFil: Broek, Paul van den. Leiden University; Países Bajo

SHAPA: An interactive software tool for protocol analysis applied to aircrew communications and workload

As modern transport environments become increasingly complex, issues such as crew communication, interaction with automation, and workload management have become crucial. Much research is being focused on holistic aspects of social and cognitive behavior, such as the strategies used to handle workload, the flow of information, the scheduling of tasks, the verbal and non-verbal interactions between crew members. Traditional laboratory performance measures no longer sufficiently meet the needs of researchers addressing these issues. However observational techniques are better equipped to capture the type of data needed and to build models of the requisite level of sophistication. Presented here is SHAPA, an interactive software tool for performing both verbal and non-verbal protocol analysis. It has been developed with the idea of affording the researchers the closest possible degree of engagement with protocol data. The researcher can configure SHAPA to encode protocols using any theoretical framework or encoding vocabulary that is desired. SHAPA allows protocol analysis to be performed at any level of analysis, and it supplies a wide variety of tools for data aggregation, manipulation. The output generated by SHAPA can be used alone or in combination with other performance variables to get a rich picture of the influences on sequences of verbal or nonverbal behavior

Design activities: how to analyze cognitive effort associated to cognitive treatments?

Working memory issues are important in many real activities. Thus, measuring cognitive effort (or mental load) has been a main research topic for years in cognitive ergonomics, though no consensual method to study such aspect has been proposed. In addition, we argue that cognitive effort has to be related to an analysis of the evolution of cognitive processes, which has been called "time processing". Towards this end, we present and discuss paradigms that have been used for years to study writing activities and, in experiments reported in this paper, for studying design activities, such as computer-graphic tasks or web site desig

Screening tests, information, and the health-education gradient

The association between health outcomes and education - the health-education gradient - is widely documented but little is known about its source. Using microeconomic data on a sample of individuals aged 50+ in eight European countries, we find that education and cognitive skills (such as verbal fluency) are associated with a greater propensity for standard screening tests (mammography and colonoscopy). In order to study the role of information on the decision to screen, we test whether the health-education gradient varies with the quality of the information provided by the health care system, as proxied by the quality of the General Practitioner. Using an Instrumental Variable approach to control for the potential endogeneity of the GP quality score, we find evidence of a strong and significant complementarity between education and quality of primary care. We interpret this result as evidence that health-education gradient can be explained, at least in part, by the fact that better educated individuals are more able to process and internalize health related information as provided by GPs

Reflective visualization and verbalization of unconscious preference

A new method is presented, that can help a person become aware of his or her unconscious preferences, and convey them to others in the form of verbal explanation. The method combines the concepts of reflection, visualization, and verbalization. The method was tested in an experiment where the unconscious preferences of the subjects for various artworks were investigated. In the experiment, two lessons were learned. The first is that it helps the subjects become aware of their unconscious preferences to verbalize weak preferences as compared with strong preferences through discussion over preference diagrams. The second is that it is effective to introduce an adjustable factor into visualization to adapt to the differences in the subjects and to foster their mutual understanding.Comment: This will be submitted to KES Journa

Toward a Taxonomy of Modeling Difficulties: A Multi-Modal Study on Individual Modeling Processes

Conceptual modeling is an essential activity during information systems development and, accordingly, a learning task faced by students of Information Systems. Presently, surprisingly little is known about how learning processes of conceptual modeling proceed, and about modeling difficulties learners experience. In this study, we integrate complementary modes of observation of learners\u27 modeling processes to identify modeling difficulties these learners face while performing a data modeling task using a modeling tool. We use the concept of cognitive breakdowns to analyze verbal protocols, recordings of learner-tool interactions and video recordings of learners\u27 modeling processes and survey learners about modeling difficulties. Our study identifies five types of modeling difficulties relating to different aspects of constructing conceptual data models, i.e., entity types, relationship types, attributes, and cardinalities. The identified types of modeling difficulties motivate a taxonomic theory of modeling difficulties intended to inform design science research on tool support for learners of conceptual modeling