Shattering the Crystal Goblet: Seeking a Pedagogy of Visuality in Post - Typographic Expository Texts

This article synthesizes diverse theoretical perspectives toward developing a pedagogy that addresses the visuality of digital texts. To frame those perspectives and their implications, I use a well - known analogy that Beatrice Warde introduced to typographers in the 1930s: drinking wine from a golden cup or a crystal goblet. I briefly review the theory and research related to visual aspects of texts, generating pedagogical perspectives from several prominent theories and perspectives. I then discuss, illustrated with a few examples, how these pedagogical perspectives might be instantiated in curriculum and instruction and the issues and challenges of doing so. I argue that researchers have done little to directly address those challenges and issues in ways that inform practitioners

The Effect of Written Text on Comprehension of Spoken English as a Foreign Language: A Replication Study

The use of written text has been acclaimed to enhance L2 listening comprehension, yet some argue that using written text does not effectively prepare learners to listen in real situations. Thus, the study was conducted to explore the effect of written text on learners' perceived difficulty, listening comprehension and learning to listen through replicating the research by Diao, Chandler & Sweller (2007. The effect of written text on comprehension of spoken English as a foreign language. The American Journal of Psychology 237- 261). Participants were 101 low-proficient English learners who were divided into three groups: listening with subtitles, listening with a full script and listening only. Each group first listened to a passage in their respective mode, then all three groups listened to another passage in the listening-only mode. Participants rated their perceived difficulty and completed a free recall task after each listening. Results suggest that the difficulty of written text should be tuned with learners' proficiency level so that they can benefit from the presence of written text in listening

Telling interactive stories: A practice-based investigation into new media interactive storytelling

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University.Telling Interactive Stories is a practice-based thesis, which theoretically and practically probes the field of digital fictional interactive storytelling. The submission takes the form of the interactive cinema installation Crossed Lines together with a written element of the thesis which interrogates historical, contextual, theoretical, technical and critical aspects of the field of interactive narrative using new media. Crossed Lines is an original fictional interactive AV piece, amalgamating multiform plots, a multi-screen viewing environment, an interactive interface and an interactive story navigation form. The installation tells the stories of nine characters in a way that the viewer can constantly explore and switch between all nine forms, using a telephone keypad and handset as an interface, and can simultaneously observe all characters’ presence between the nine remote locations. Several research methodologies are utilised to analyse and evaluate the installation. Quantitative methodologies include the use of user tracking systems where the computational output of the installation provides measurements and timings of user choices and behaviours. Qualitative methodologies include theoretical and visual analysis, and in depth analysis of user responses using interviews, questionnaires, video recordings and cuttingedge eye-tracking technologies

Beyond Media Borders, Volume 1

This open access book promotes the idea that all media types are multimodal and that comparing media types, through an intermedial lens, necessarily involves analysing these multimodal traits. The collection includes a series of interconnected articles that illustrate and clarify how the concepts developed in Elleström’s influential article The Modalities of Media: A Model for Understanding Intermedial Relations (Palgrave Macmillan, 2010) can be used for methodical investigation and interpretation of media traits and media interrelations. The authors work with a wide range of old and new media types that are traditionally investigated through limited, media-specific concepts. The publication is a significant contribution to interdisciplinary research, advancing the frontiers of conceptual as well as practical understanding of media interrelations. This is the first of two volumes. It contains Elleström’s revised article and six other contributions focusing especially on media integration: how media products and media types are combined and merged in various ways

Beyond Media Borders, Volume 1

This open access book promotes the idea that all media types are multimodal and that comparing media types, through an intermedial lens, necessarily involves analysing these multimodal traits. The collection includes a series of interconnected articles that illustrate and clarify how the concepts developed in Elleström’s influential article The Modalities of Media: A Model for Understanding Intermedial Relations (Palgrave Macmillan, 2010) can be used for methodical investigation and interpretation of media traits and media interrelations. The authors work with a wide range of old and new media types that are traditionally investigated through limited, media-specific concepts. The publication is a significant contribution to interdisciplinary research, advancing the frontiers of conceptual as well as practical understanding of media interrelations. This is the first of two volumes. It contains Elleström’s revised article and six other contributions focusing especially on media integration: how media products and media types are combined and merged in various ways

A framework for the design of usable electronic text

This thesis examines the human issues underlying the design and usability of electronic text systems. In so doing it develops a framework for the conceptualisation of these issues that aims to guide designers of electronic texts in their attempts to produce usable systems. The thesis commences with a review of the traditional human factors literature on electronic text according to three basic themes: its concern with perceptual, manipulatory and structural issues. From this examination it is concluded that shortcomings in translating this work into design result from the adoption of overly narrow uni-disciplinary views of reading taken from cognitive psychology and information science which are inappropriate to serve the needs of electronic text designers. In an attempt to provide a more relevant description of the reading process a series of studies examining readers and their views as well as uses of texts is reported. In the first, a repertory grid based investigation revealed that all texts can be described in reader-relvant terms according to three criteria: why a text is read, what a text contains and how it is read. These criteria then form the basis of two investigations of reader-text interaction using academic journals and user manuals. The results of these studies highlighted the need to consider readers' models of a document's structure in discussing text usability. Subsequent experimental work on readers' models of academic articles demonstrated not only that such models are important aspects of reader-text interaction but that data of this form could usefully be employed in the design of an electronic text system. The proposed framework provides a broad, qualitative model of the important issues for designers to consider when developing a product It consists of four interactive elements that focus attention on aspects of reading that have been identified as central to usability. Simple tests of the utility and validity of the framework are reported and it is shown that the framework both supports reasoned analysis and subsequent prediction of reader behaviour as well as providing a parsimonious account of their verbal utterances while reading. The thesis concludes with an analysis of the likely uses of such a framework and the potential for electronic text systems in an increasingly information-hungry world

Educational use cases from a shared exploration of e-books and iPads

E-books and e-book readers are becoming increasingly widely available, particularly for the general reader, and there have been many studies on their adoption. However, less is known about their use for educational and academic purposes. We report here on work carried out on e-books and e-book applications using iPads by academic and teaching staff. After considering pedagogical issues and reporting survey results, we identify a spiral of six key use case areas for e-books. This spiral of use cases moves from basic e-book use, through situational reading, e-books and learning, using multiple learning resources, collaborative/group learning, to e-book production. We discuss each of these use case areas and provide guidelines that will be of interest to practitioners and researchers alike

Multiliteracies for academic purposes : a metafunctional exploration of intersemiosis and multimodality in university textbook and computer-based learning resources in science

This thesis is situated in the research field of systemic functional linguistics (SFL) in education and within a professional context of multiliteracies for academic purposes. The overall aim of the research is to provide a metafunctional account of multimodal and multisemiotic meaning-making in print and electronic learning materials in first year science at university. The educational motivation for the study is to provide insights for teachers and educational designers to assist them in the development of students’ multiliteracies, particularly in the context of online learning environments. The corpus comprises online and CD-ROM learning resources in biology, physics and chemistry and textbooks in physics and biology, which are typical of those used in undergraduate science courses in Australia. Two underlying themes of the research are to compare the different affordances of textbook and screen formats and the disciplinary variation found in these formats. The two stage research design consisted of a multimodal content analysis, followed by a SF-based multimodal discourse analysis of a selection of the texts. In the page and screen formats of these pedagogical texts, the analyses show that through the mechanisms of intersemiosis, ideationally, language and image are reconstrued as disciplinary knowledge. This knowledge is characterised by a high level of technicality in image and verbiage, by taxonomic relations across semiotic resources and by interdependence among elements in the image, caption, label and main text. Interpersonally, pedagogical roles of reader/learner/viewer/ and writer/teacher/designer are enacted differently to some extent across formats through the different types of activities on the page and screen but the source of authority and truth remains with the teacher/designer, regardless of format. Roles are thus minimally negotiable, despite the claims of interactivity in the screen texts. Textually, the organisation of meaning across text and image in both formats is reflected in the layout, which is determined by the underlying design grid and in the use of graphic design resources of colour, font, salience and juxtaposition. Finally, through the resources of grammatical metaphor and the reconstrual of images as abstract, both forms of semiosis work together to shift meanings from congruence to abstraction, into the specialised realm of science

Comparison of the impacts of different multimodalities on incidental L2 vocabulary learning

Multimodality of input in incidental L2 vocabulary learning has recently been a topic of interest among language acquisition researchers, yet the results have been somewhat contradictory. This study seeks to compare the impacts of two different multimodalities on incidental L2 vocabulary learning, namely, reading-plus-watching (experimental group I) vs. reading-plus-listening (experimental group II), as compared to the reading only condition, which is included as a control measure. Experimental group I watched and read the transcriptions of four news texts with electronic glosses for the target words, while experimental group II read and listened to the same news texts again with electronic glosses for the same 20 target words. Next, the two experimental groups swapped roles with a new set of four news texts glossed for another group of 20 target words. The control group only read the same eight news texts without glosses. The results suggest that reading-plus-listening can be a more conducive multimodal presentation for incidental vocabulary learning as compared to reading-plus-watching. The results also challenge the validity of some principles of the Cognitive Theory of Multimedia Learning in incidental L2 vocabulary learning, while providing supporting evidence for some other principles