Learning Through Multimedia Interaction: The Construal of Primary Social Science Knowledge in Web-based Digital Learning Materials

This thesis is concerned with the construal and the recontextualisation of primary social science knowledge in hypermedia texts. More specifically, it provides an account for the relations between verbiage and image in web-based multimodal interactive leaning materials, known as Multimodal Interactives (MIs). Based on the linguistic description, the thesis offers insights into the ways in which knowledge is construed and recontextaulised in the emerging electronic multimodal discourses. The general theoretical orientation of this thesis is that of systemic functional multimodal discourse analysis (SF-MDA). Within the framework of SF-MDA, the thesis proposes a complementary perspective on intersemiosis, which treats relations between verbiage and image as patterns formed during the unfolding of a text. To capture this type of intersemiotic relations, the thesis develops a logogenetic model for SF-MDA. The defining feature the model is the temporal axis (time), which serves as the main reference point for determining semiotic units (logogenetic units) and describing semiotic patterns (logogenetic patterns). The logogenetic model is applied in studying five MIs. The basic logogenetic unit used in analysis is Critical Path, the shortest traversal through a MI. Two types of logogenetic patterns along the Critical Paths in the five MIs are examined in detail, including intersemiotic ideational coupling and clustering. There are five basic types of verbiage-imaged coupling emerged from the analysis, including Naming & Identifying, Representing, Classifying & Co-classifying, and Circumstantiating. The analysis of ideational clustering shows the different ways in which participants and activities form clusters in each MI. By analysing intersemiotic coupling and clustering, the thesis shows that language and image construe the keys notions of primary social science such as people, place and community through three fundamental principles—abstraction, generalisation and specification. The study also demonstrates the possibility of achieving different degrees of pedagogic framing in hypermedia environments

Legitimizing video-sharing practices on local and global platforms:A multimodal analysis of menu design, folk genres and taxonomy

There have been extensive public and academic debates on the role platform algorithms play in shaping social media (sub)cultures. Little attention, however, has been paid to how platform (sub)cultures are discursively constructed by the design of the platform interface. This study examines Bilibili, a leading Chinese video platform, and investigates how it discursively frames video-sharing culture through platform menu design. We developed a three-level analytical framework that includes: 1) a multimodal social semiotic analysis of Bilibili’s menu design; 2) a contrastive analysis of YouTube’s video menu, and 3) a focused analysis of guichu or kichiku videos (as a linguistic phenomenon, a transcultural practice, and a multimodal semiotic artifact). Our findings reveal that Bilibili discursively frames and legitimizes video-sharing practices by establishing a folk taxonomy of video genres and integrating subculture into its menu design. Furthermore, Bilibili controls access to cultural knowledge through explicit (gatekeeping) and implicit (semiotic) measures, in contrast to YouTube’s visual and superficial taxonomy. This study unveils different discursive strategies platforms use to shape unique online video cultures

Young chinese immigrant children’s language and literacy practices on social media: a translanguaging perspective

In this paper, we present a research approach that makes visible how young children in Chinese immigrant families muster their multilingual, multimodal and multisemiotic repertoires as they interact with distant family and friends on social media. The approach brings multimodal social semiotics into conversation with translanguaging to problematize the notion of languages as bounded systems, and to illustrate how emergent multilingual learners deploy their knowledge of the features of different language scripts and modalities to maximise their communicative capacity. We focus on the emergent translanguaging practices of Chinese immigrant children when using WeChat—a popular Chinese social media that is widely used by young families in their everyday language and literacy practices. Reporting on a study of nine immigrant families in southeast London, we home in on one boy aged eight years and his younger brother aged six years, with mixed Chinese (mother) and Portuguese (father) immigrant heritage. Through fine-grained multimodal analysis of online exchanges between the older brother and contacts in their mother’s WeChat network, we illustrate the multimodal, translinguistic and polyadic nature of his language use in practice and reflect briefly on the disjuncture between his home uses of multiple languages and his schooling. We also consider how the younger brother is socialised into translanguaging practices by observing and occasionally participating in his older sibling’s online chat. The findings address a gap in research knowledge by illustrating how social media can enrich opportunities for young children’s emergent translanguaging practices and heritage language learning

Clinical value of preferred endoscopic ultrasound-guided antegrade surgery in the treatment of extrahepatic bile duct malignant obstruction

Objectives: To explore the clinical value of preferred ultrasound endoscopic guided biliary drainage in patients with extrahepatic biliary obstruction with intrahepatic biliary ectasis. Methods: A total of 58 patients with malignant obstruction and intrahepatic bile duct expansion, including 32 males, 26 females and median age 65 (58‒81) were selected. A prospective randomized controlled study was randomized into EUS-AG and ERCP-BD, with 28 patients in EUS-AG and 30 in ERCP-BD. The efficacy of the two treatments, operation success rate, operation time, the incidence of complications, hospitalization days, cost, unimpeded stent duration, and survival time were compared. Results: 1) The surgical success rate in group EUS-AG was 100%, and in group, ERCP-BD was 96.67%. There was no statistical difference in surgical success rate in the two groups (p>0.05). 2) Average operating time in EUS-AG was (23.69±11.57) min, and in ERCP-BD was (36.75±17.69) min. The difference between the two groups has statistical significance (p<0.05). 3) The clinical symptoms of successful patients were significantly relieved. Compared with the preoperative procedure, the differences in group levels had statistical significance (p<0.05); TBIL, ALP, WBC and CRP levels, no statistical significance difference in groups (p>0.05). Conclusion: EUS-AG operation has short time, low incidence of complications, safe, effective, and can be used as the preferred treatment plan for patients with extrahepatic biliary duct malignant obstruction associated with intrahepatic biliary duct expansion; EUS-AG operation has more unique clinical advantages for patients with altered gastrointestinal anatomy or upper gastrointestinal obstruction

Framing identities using shelfies:Bridging private and professional spaces

This visual essay investigated how material objects frame and represent our self and identity, specifically focusing on curating different parts of identity through objects on bookshelves in online spaces. For the purpose of this study, a mixed method methodology was adopted where data was collected through semi-structured interviews and visual analysis (audio/video). There were six participants in this study who are academics from different higher education institutions with a wide range of research interests. The interviews were administered by the participants in pairs via an online platform and the video calls were recorded for data analysis purposes. The data analysis showed that shelfies reveal a specific place of our working environment in very concrete materiality, yet they also contain references to the invisible non-representational side of the social spaces that we interact with. It was clear from the findings that both parts of our identities (personal and professional) were portrayed in shelfies through the use of different materials and objects which were arranged in different styles