Design: the rhetorical work of shaping the semiotic world

The chapter offers a distinctive perspective on the world of meaning: namely that of ‘design as semiotic work,’ which underlies all and every action of making meaning. It assumes that the work of design is ceaseless, changing the world in the course of that work. We start with a world which on the one hand is already fully designed, and which, on the other hand, is constantly re-designed in and by our semiotic actions, in relation to constantly changing social requirements. The designed world of semiotic resources furnishes us with both the material and the immaterial semiotic resources needed to deal with the semiotic demands of the social world day to day. In our actions, in redesign and in the production of designs, we constantly transform both kinds of resources: the material resources – the modes – and the non-material resources, which emerge in the materiality of modes

Development of methodologies for researching online: the case of food blogs

The expanding reach of the Internet has opened new sites for conducting social science research. The prominence of blogs in combination with their varied areas of focus makes them a rich source of qualitative ‘user-generated data’. However, there are significant practical challenges in empirical research on digital material online. Central among these are ethical, archival and methodological issues. We highlight these in the development of our cross-disciplinary approach. We combine multimodal social semiotic, ethnographic and narrative methods to examine blogs, in our case here, food blogs, created on Wordpress platforms. ‘Food blogs’ are a prospective source of information about parenting, feeding and caring for children, given blogs’ wide use among parents, particularly mothers, in the UK. This relatively new digital environment of the blog, in which often quite intimate portraits of family life are materialized through public ‘multimodal narratives’ of mothers, provides the context for our online research. In this paper, we explicate on our combined multimodal social semiotic, ethnographic and narrative methods to provide a more encompassing approach: one that is able to attend to the unique, online material, which might not be wholly illuminated by any one of the three methodologies used independently. This involves coming to terms with the different epistemological perspectives that guide and shape the cross-disciplinary collaboration. We explain the framework we developed and the research processes, including data sampling, collection, archival and analysis; provide an overview of key findings from the substantive focus of this project; discuss the overall possibilities and constraints of working with combined perspectives; as well as offer suggestions for future online research in blogging platforms

The mechanisms of “incidental news consumption”: An eye tracking study of news interaction on Facebook

This exploratory study examines how participants incidentally consumed news on social media through an eye tracking analysis of their visual interaction with posts on Facebook. By interaction, we refer to the attention participants gave to news (measured through the time devoted to looking at the content); how they read these news items (measured through ocular movements on the screen); and the way they engaged with this content (measured through forms of participation such as liking, commenting, or sharing news). The data were triangulated through interviews with Facebook users and an analysis of the metrics of posts from Costa Rican news organizations on Facebook from 2017 to 2020. We draw on scholarship in communication studies and multimodal discourse analysis. We argue for a more nuanced approach to what study participants did when they incidentally encountered news on social media that focuses on mechanisms, that is, the specific procedures and operations that shape user interaction with news on Facebook (such as visual fixations on parts of news posts; the visual entry points through which they begin to interact with the news; the sequences that characterize how they navigate content; and the time they spend assessing various multimodal elements).Universidad de Costa Rica/[]/UCR/Costa RicaUCR::Vicerrectoría de Investigación::Unidades de Investigación::Ciencias Sociales::Centro de Investigación en Comunicación (CICOM)UCR::Vicerrectoría de Docencia::Artes y Letras::Facultad de Letras::Escuela de Filología, Lingüística y Literatur

Dyslexia in SNS: an Exploratory Study to Investigate Expressions of Identity and Multimodal Literacies

The paradigm of neurodiversity provides a theoretical scaffold to challenge the idea of dyslexia as a deficit, by considering how difficulties related to literacy may reflect possible cognitive strengths and opportunities for learning. In this paper we adopt this perspective which associates dyslexia with strengths in visual, oral and three-dimensional thinking. Our goal is to understand if and how the multimodal affordances of SNS mediate participation and new literacies for dyslexic youth, and how these affordances interact with identity work. Seven young people struggling with literacy were interviewed about their use of SNS. Our results show that the visual affordances of SNS enable new forms of participation and expression, furthering our understanding of visual literacies. Nonetheless, despite the pervasive use of visual affordances to perform identity work, we also find that young people's learning differences are not always obviated but re-constructed, or even confronted in SNS

Design Opportunities for AAC and Children with Severe Speech and Physical Impairments

Augmentative and alternative communication (AAC) technologies can support children with severe speech and physical impairments (SSPI) to express themselves. Yet, these seemingly 'enabling' technologies are often abandoned by this target group, suggesting a need to understand how they are used in communication. Little research has considered the interaction between people, interaction design and the material dimension of AAC. To address this, we report on a qualitative video study that examines the situated communication of five children using AAC in a special school. Our findings offer a new perspective on reconceptualising AAC design and use revealing four areas for future design: (1) incorporating an embodied view of communication, (2) designing to emphasise children's competence and agency, (3) regulating the presence, prominence and value of AAC, and (4) supporting a wider range of communicative functions that help address children's needs