Multimodality in the Digital Environments of Deaf Education (DE2)

This paper contextualizes multimodality theory in digital-epistemological paradigms and analyzes their combined effects upon operations of power in deaf pedagogical practices. Deafness is unbound by geography. Deaf people constitute a heterogeneous, globalized ethnic minority who are singularly linked. Often thought to be rendered powerless by disability, deaf people generate forms of power that disrupt conventional ontology and epistemology by way of divergent adaptations of visuospatial language modalities. As creators and users, deaf people have positioned themselves at the cutting-edge of innovation by developing and repurposing digital technologies to secure insurgent power in the face of sociopolitical oppression. This paper establishes digital environments of deaf education (DE2) as an object of study. Research reviewed in this study (Bauman & Murray, 2014; Thoutenhoofd, 2010; Young and Temple, 2014), demonstrates that multimodality is a critically important but undertheorized concept related to power in deaf education. The paper reviews multimodality theory, entrained as a lens to examine DE2. Findings are subdivided into three categories: (1) the purposes for which DE2 are used, (2) the practices constitutive of DE2, and (3) the characteristics of learners and educators within DE2. The paper closes by examining DE2 exemplars via multimodality. This paper contextualizes multimodality theory in digital-epistemological paradigms and analyzes their combined effects upon operations of power in deaf pedagogical practices, including how knowledge is created and shared by deaf people using digital technologies and pedagogical practices derived thereof. This investigation examines how technosocial tools are embedded in a nexus of historical, social, political, and educational changes—at key times, deaf people effectuate change with celerity. This paper argues that theoretical deaf research is clarified by multimodality; likewise, multimodality benefits by considering deaf ontologies/epistemologies. Converging domains illuminate the dynamism and synergy of technosocial changes in history, and contributes to literatures on the history of technology by documenting complex, interdependent relationships between digital knowledge modalities and the deaf users who drive their development

Ebookness

Since the mid-2000s, the ebook has stabilized into an ontologically distinct form, separate from PDFs and other representations of the book on the screen. The current article delineates the ebook from other emerging digital genres with recourse to the methodologies of platform studies and book history. The ebook is modelled as three concentric circles representing its technological, textual and service infrastructure innovations. This analysis reveals two distinct properties of the ebook: a simulation of the services of the book trade and an emphasis on user textual manipulation. The proposed model is tested with reference to comparative studies of several ebooks published since 2007 and defended against common claims of ebookness about other digital textual genres

Enfrentando os desafios do design de textos multimodais para promover a pedagogia das multiliteracias

This article aims to add to the understanding of the challenges involved in designing digital texts to promote multiliteracies pedagogy. A multiliteracies approach calls for multimodal meaning-making and cultural diversity to be integrated into new school curriculum content, and accordingly, we analyse an interactive children’s story app, named Mobeybou in Brazil. The re-search question addressed was: what can we learn about the design of multimodal texts aimed at promoting intercultural learning from the design of this story app? The app incorporates tangible and digital storytelling materials to promote intercultural skills among young children, focusing specifically on Brazil. Mobeybou in Brazil was studied to characterize the design of its multimodal representations of meaning, using categories from the grammar of storytelling and multimodal meaning-making, particularly those concerned with representing the experiential diversity and personal positioning of the app users. The findings provide evidence of the complexity involved in designing multimodal texts to meet the challenges of promoting multiliteracies pedagogy, highlighting the urgent need to narrow the interface between research undertaken in education, semiotics, and digital media design. The article concludes by identifying the study’s limitations and some future developments.Este artigo pretende contribuir para a compreensão dos desafios colocados pelo design de textos digitais especificamente destinados a promover a pedagogia das multiliteracias. Esta abordagem pedagógica defende que a compreensão e produção de significados multimodais e a diversidade cultural são conteúdos incontornáveis no novo currículo escolar. Apresentamos o estudo de uma story app multimodal interativa, intitulada Mobeybou no Brasil, desenvolvida para dar resposta à seguinte questão de investigação: o que se pode aprender sobre o design de textos multimodais destinados a promover a aprendizagem intercultural a partir do design desta story app? Na nossa análise, utilizamos categorias da gramática da narrativa e da representação multi-modal incidentes na representação da diversidade experiencial e do posicionamento pessoal dos utilizadores. Os resultados sugerem a complexidade envolvida no design de textos multimodais que respondem aos desafios da pedagogia das multiliteracias, salientando a necessidade urgen-te do estreitamento da colaboração entre a investigação realizada nas áreas da educação, da se-miótica e do design de média digitais. Por fim, identificamos as limitações do estudo, apontando alguns desenvolvimentos futuros.This research is funded by the FCT within the scope of the project PTDC/CEDEDG/ 0736/2021, by CIEd – Research Centre on Education, Institute of Education, University of Minho, projects UIDB/01661/2020 and UIDP/01661/2020, through national funds of FCT/MCTES-PT, and by the LARSyS - FCT Plurianual funding 2020-202

Learning and Teaching Languages in Technology-Mediated Environments: Why Modes and Meaning Making Matter

The developing argument presented in this thesis is based on seven articles, eight book chapters and one set of conference proceedings, some single-authored and some co-authored, on language learning and teaching in technology-mediated environments, published between 2004 and 2018. The publications chart my evolution as a researcher and practitioner at the Open University UK. There are several threads which weave themselves through my scholarly journey and which are reflected in the selected work: Thread 1: multimodal competence and language learning and teaching with technology Thread 2: task-based approaches to language learning and teaching with technology Thread 3: teacher (and learner) preparation for language learning and teaching with technology Thread 4: learner (and teacher) autonomy in language learning and teaching with technology. The narrative cloth in the presentation of the publications draws these threads together and illustrates how they interconnect across my work. They are linked by my concern for online language learners’ awareness of the opportunities and demands of the learning environment and the impact that such awareness, or lack thereof, has on the learning process. The empirical studies presented and discussed in my work use mostly qualitative research instruments. They take forward the knowledge in the field by offering original insights into the interrelationship between language learner awareness and control over the learning context understood as awareness of online modes and their potential for meaning-making, communication, interaction and collaboration. This interrelationship is not only relevant for language learning in virtual environments per se, it also has repercussions on online learners’ development of intercultural communicative competence, their digital participatory competence and social presence online, and on their autonomy. Underpinning my work is a view shared by a growing number of researchers and practitioners in online learning and teaching of languages and cultures that a radical pedagogical shift is required: it is not sufficient to see the new technology-infused learning spaces as replicates of conventional face-to-face settings. Such a shift has to be informed by new learning theories which capture the dynamic nature of the enterprise in the wake of unabating technological advancements (e.g. Guichon, 2009; Hampel & Stickler, 2005; Hubbard & Levy, 2006; Hubbard, 2009; Kern, 2015; Sun, 2011). Moreover, I argue, it will need to include the systematic raising of learner awareness of learning context. The presentation of the selected articles, book chapters and conference proceedings in Chapter 4 is divided into five parts in line with the thematic foci of the publications: (1) contextual knowledge, (2) multimodal competence (3) multiliteracies (4) digital literacies (5) participatory literacy and social presence. The publications in Chapter 4, section 4.1 – Hauck (2004), Hampel and Hauck (2004), Hauck (2005), and Hauck and Hurd (2005) – focus on the concept of contextual knowledge and are informed by two studies: one carried out with students when the former Department of Languages (DoL) at the Open University offered learners a choice between face-to-face and online tutorials via an audiographic conferencing application (Lyceum); the other one carried out with OU tutors, most of whom were at the time unfamiliar with using Internet-based conferencing for language learning and teaching purposes. The work presented in section 4.2 – Hampel and Hauck (2006), Hauck (2007), Hauck and Youngs (2008) and Hauck and Hampel (2008) – concentrates on multimodal competence as well as the interface between multimodal communicative competence and intercultural communicative competence online. While Hampel and Hauck (2006) is a theoretical contribution, the other three publications are based on a telecollaborative exchange linking participants from three different parts of the world (the Tridem project). The former helped frame the empirical study at the center of the two articles and the chapter that followed. The publications in section 4.3 – Hauck (2010a) and Hauck (2010b), and Fuchs, Hauck and Müller-Hartmann (2012) – explore multiliteracies with multimodal competence understood as a core element of multiliteracies. They draw on data from a four-way telecollaborative exchange between teacher trainees and language learners in order to illustrate why telecollaboration provides the ideal set-up for fostering such competence development and therefore also online learner and teacher autonomy. This leads to an examination of digital literacies in Kurek and Hauck (2014) and Hauck and Kurek (2017) in section 4.4. Both chapters are, again, theoretical contributions to the field of technology-mediated language learning and teaching. We conceptualise digital proficiency as mastery of modes and meaning-making – in other words multimodal competence – and as a precondition for autonomy. In Kurek and Hauck (2014) we present a task framework for instructed learner reflection to this effect, ideally in telecollaborative settings. Finally, in section 4.5 – Hauck and Warnecke (2012), Hauck, Galley and Warnecke (2016), also a theoretical contribution, and Hauck and Satar (2018) – my co-authors and I explore a subset of digital literacies, namely participatory literacy as reflected in multimodal competence, and its relevance for social presence in online language learning and teaching contexts. An example of how these themes interlink with the aforementioned threads is the task-based approach to multimodal competence development (Threads 1 and 2) in telecollaborative settings which is advocated in all three publications in section 4.3. Together, the publications make a substantial contribution to the field of language learning and teaching in technology-mediated environments, through the centrality they grant to the learning context, and increasingly also to multimodality (Kress & van Leeuwen, 2001; Kress, 2009) as an overarching approach to conceptualising context-related challenges for both students and teachers