A series of case studies to enhance the social utility of RSS

RSS (really simple syndication, rich site summary or RDF site summary) is a dialect of XML that provides a method of syndicating on-line content, where postings consist of frequently updated news items, blog entries and multimedia. RSS feeds, produced by organisations or individuals, are often aggregated, and delivered to users for consumption via readers. The semi-structured format of RSS also allows the delivery/exchange of machine-readable content between different platforms and systems. Articles on web pages frequently include icons that represent social media services which facilitate social data. Amongst these, RSS feeds deliver data which is typically presented in the journalistic style of headline, story and snapshot(s). Consequently, applications and academic research have employed RSS on this basis. Therefore, within the context of social media, the question arises: can the social function, i.e. utility, of RSS be enhanced by producing from it data which is actionable and effective? This thesis is based upon the hypothesis that the fluctuations in the keyword frequencies present in RSS can be mined to produce actionable and effective data, to enhance the technology's social utility. To this end, we present a series of laboratory-based case studies which demonstrate two novel and logically consistent RSS-mining paradigms. Our first paradigm allows users to define mining rules to mine data from feeds. The second paradigm employs a semi-automated classification of feeds and correlates this with sentiment. We visualise the outputs produced by the case studies for these paradigms, where they can benefit users in real-world scenarios, varying from statistics and trend analysis to mining financial and sporting data. The contributions of this thesis to web engineering and text mining are the demonstration of the proof of concept of our paradigms, through the integration of an array of open-source, third-party products into a coherent and innovative, alpha-version prototype software implemented in a Java JSP/servlet-based web application architecture

REPRESENTING SCIENCE: A MULTIMODAL STUDY OF SCIENCE POPULARIZATION ON INSTITUTIONAL AND MASS MEDIA WEBSITES

Ph.DDOCTOR OF PHILOSOPH

Multimodal discourse on online newspaper home pages: A social-semiotic perspective

In a short space of time, online newspapers have emerged to play an important role in the institutional construction of ‘news’ and the mass mediation of information. The home pages of online newspapers feature short verbal texts, and communicate using language, image, layout, colour, and other semiotic resources: they communicate multimodally. This thesis examines the multimodal discourse of three English-language online newspapers: the Bangkok Post (Thailand), the English-language edition (translated from Chinese) of the People’s Daily (China), and the Sydney Morning Herald (Australia). Between February, 2002 and April, 2006, three data collections were made (February-April, 2002; September-November, 2005; January-April, 2006) using a five-day ‘constructed week’ method. The main corpus was 15 home pages from each newspaper (five per collection per newspaper), but the total corpus (including other pages from each newspaper) was 603 web pages. Two senior editors (one each from the Bangkok Post and the Sydney Morning Herald) were interviewed. The multimodal discourse of the home pages was analysed using tools from Systemic Functional Multimodal Discourse Analysis (SF-MDA), and a ‘visual grammar’ of home pages building on the work of Kress & van Leeuwen (1996) was developed. In addition, a rank scale for online newspapers was proposed, and limitations of applying the tool of rank scale to this corpus were identified. An emerging genre - the headline-plus-lead-plus-hyperlink newsbite - was identified, and the design of newsbites on the home page of the Sydney Morning Herald and the evolution of their design over time was analysed. The use of images on the home pages in the corpus was analysed, and the increasing use of thumbnail images in the Sydney Morning Herald - particularly close-up thumbnails of faces - was investigated in further depth. The visual design of online newspaper home pages and the news texts appearing on them are an evolution of print news genres and their design practices. Newsbites and headline-only newsbits are verbally short, so the authors of newspaper home pages are forced to rely increasingly on visual communication in order to position stories and readers, and to communicate the values of the news institution on the home page as mediated by the screen. Thumbnail images are evolving as a new form of punctuation on some home pages, and this may be a short-lived, or an emerging historical trend in the development of punctuation, at least in online environments. Overall, online newspaper home pages are tending towards shorter texts, which communicate in novel ways. These short texts cannot communicate the values and ideology of news institutions in the way that extended verbal texts have done for centuries, yet this function of news texts remains important to the construction and maintenance of a readership, and therefore crucial to the home page of a newspaper. As a result, news institutions express values visually in their design of newspaper home pages. As readers become familiar with the meanings of online news design, they become adept at reading and understanding short stories within these multimodally-construed frames of reference. Ideology is increasingly fragmented on shorter timescales, but expressed over longer timescales in a hypermedia environment that affords and extends many of the pre-existing multimodal features of print newspaper discourse

Multimodal discourse on online newspaper home pages: A social-semiotic perspective

In a short space of time, online newspapers have emerged to play an important role in the institutional construction of ‘news’ and the mass mediation of information. The home pages of online newspapers feature short verbal texts, and communicate using language, image, layout, colour, and other semiotic resources: they communicate multimodally. This thesis examines the multimodal discourse of three English-language online newspapers: the Bangkok Post (Thailand), the English-language edition (translated from Chinese) of the People’s Daily (China), and the Sydney Morning Herald (Australia). Between February, 2002 and April, 2006, three data collections were made (February-April, 2002; September-November, 2005; January-April, 2006) using a five-day ‘constructed week’ method. The main corpus was 15 home pages from each newspaper (five per collection per newspaper), but the total corpus (including other pages from each newspaper) was 603 web pages. Two senior editors (one each from the Bangkok Post and the Sydney Morning Herald) were interviewed. The multimodal discourse of the home pages was analysed using tools from Systemic Functional Multimodal Discourse Analysis (SF-MDA), and a ‘visual grammar’ of home pages building on the work of Kress & van Leeuwen (1996) was developed. In addition, a rank scale for online newspapers was proposed, and limitations of applying the tool of rank scale to this corpus were identified. An emerging genre - the headline-plus-lead-plus-hyperlink newsbite - was identified, and the design of newsbites on the home page of the Sydney Morning Herald and the evolution of their design over time was analysed. The use of images on the home pages in the corpus was analysed, and the increasing use of thumbnail images in the Sydney Morning Herald - particularly close-up thumbnails of faces - was investigated in further depth. The visual design of online newspaper home pages and the news texts appearing on them are an evolution of print news genres and their design practices. Newsbites and headline-only newsbits are verbally short, so the authors of newspaper home pages are forced to rely increasingly on visual communication in order to position stories and readers, and to communicate the values of the news institution on the home page as mediated by the screen. Thumbnail images are evolving as a new form of punctuation on some home pages, and this may be a short-lived, or an emerging historical trend in the development of punctuation, at least in online environments. Overall, online newspaper home pages are tending towards shorter texts, which communicate in novel ways. These short texts cannot communicate the values and ideology of news institutions in the way that extended verbal texts have done for centuries, yet this function of news texts remains important to the construction and maintenance of a readership, and therefore crucial to the home page of a newspaper. As a result, news institutions express values visually in their design of newspaper home pages. As readers become familiar with the meanings of online news design, they become adept at reading and understanding short stories within these multimodally-construed frames of reference. Ideology is increasingly fragmented on shorter timescales, but expressed over longer timescales in a hypermedia environment that affords and extends many of the pre-existing multimodal features of print newspaper discourse

Critical Discourse Analysis of Media Texts

El volumen presenta una panorámica del Análisis Crítico del Discurso de los textos mediáticos. El Análisis Crítico del Discurso es un modelo que parte de la Lingüística Crítica, basada a su vez en la Gramática Funcional de M. A. K. Halliday. En el volumen se resumen los principales enfoques de esta teoría. El volumen está compuesto de diversos artículos en los que se analizan diferentes casos concretos de los discursos de los medios de comunicación de masas (discurso informativo, discurso publicitario, discurso televisivo y discurso fílmico)The volume presents an overview of Critical Discourse Analysis of media texts. Critical Discourse Analysis is a framework departing from Critical Linguistics, which is based, in turn, on Functional Grammar as developed by M. A. K. Halliday. In this volume several approaches to Critical Discourse Analysis are summed up. In addition, the volume is composed by several papers where diverse concrete cases of media discourses are analysed (news discourse, advertisement discourse, television discourse and filmic discourse

A series of case studies to enhance the social utility of RSS

RSS (really simple syndication, rich site summary or RDF site summary) is a dialect of XML that provides a method of syndicating on-line content, where postings consist of frequently updated news items, blog entries and multimedia. RSS feeds, produced by organisations or individuals, are often aggregated, and delivered to users for consumption via readers. The semi-structured format of RSS also allows the delivery/exchange of machine-readable content between different platforms and systems. Articles on web pages frequently include icons that represent social media services which facilitate social data. Amongst these, RSS feeds deliver data which is typically presented in the journalistic style of headline, story and snapshot(s). Consequently, applications and academic research have employed RSS on this basis. Therefore, within the context of social media, the question arises: can the social function, i.e. utility, of RSS be enhanced by producing from it data which is actionable and effective? This thesis is based upon the hypothesis that the fluctuations in the keyword frequencies present in RSS can be mined to produce actionable and effective data, to enhance the technology's social utility. To this end, we present a series of laboratory-based case studies which demonstrate two novel and logically consistent RSS-mining paradigms. Our first paradigm allows users to define mining rules to mine data from feeds. The second paradigm employs a semi-automated classification of feeds and correlates this with sentiment. We visualise the outputs produced by the case studies for these paradigms, where they can benefit users in real-world scenarios, varying from statistics and trend analysis to mining financial and sporting data. The contributions of this thesis to web engineering and text mining are the demonstration of the proof of concept of our paradigms, through the integration of an array of open-source, third-party products into a coherent and innovative, alpha-version prototype software implemented in a Java JSP/servlet-based web application architecture

Specialised Languages and Multimedia. Linguistic and Cross-cultural Issues

none2noThis book collects academic works focusing on scientific and technical discourse and on the ways in which this type of discourse appears in or is shaped by multimedia products. The originality of this book is to be seen in the variety of approaches used and of the specialised languages investigated in relation to multimodal and multimedia genres. Contributions will particularly focus on new multimodal or multimedia forms of specialised discourse (in institutional, academic, technical, scientific, social or popular settings), linguistic features of specialised discourse in multimodal or multimedia genres, the popularisation of specialised knowledge in multimodal or multimedia genres, the impact of multimodality and multimediality on the construction of scientific and technical discourse, the impact of multimodality/multimediality in the practice and teaching of language, the impact of multimodality/multimediality in the practice and teaching of translation, new multimedia modes of knowledge dissemination, the translation/adaptation of scientific discourse in multimedia products. This volume contributes to the theory and practice of multimodal studies and translation, with a specific focus on specialized discourse.Rivista di Classe A - Volume specialeopenManca E., Bianchi F.Manca, E.; Bianchi, F

Multi-modal surrogates for retrieving and making sense of videos: is synchronization between the multiple modalities optimal?

Video surrogates can help people quickly make sense of the content of a video before downloading or seeking more detailed information. Visual and audio features of a video are primary information carriers and might become important components of video retrieval and video sense-making. In the past decades, most research and development efforts on video surrogates have focused on visual features of the video, and comparatively little work has been done on audio surrogates and examining their pros and cons in aiding users' retrieval and sense-making of digital videos. Even less work has been done on multi-modal surrogates, where more than one modality are employed for consuming the surrogates, for example, the audio and visual modalities. This research examined the effectiveness of a number of multi-modal surrogates, and investigated whether synchronization between the audio and visual channels is optimal. A user study was conducted to evaluate six different surrogates on a set of six recognition and inference tasks to answer two main research questions: (1) How do automatically-generated multi-modal surrogates compare to manually-generated ones in video retrieval and video sense-making? and (2) Does synchronization between multiple surrogate channels enhance or inhibit video retrieval and video sense-making? Forty-eight participants participated in the study, in which the surrogates were measured on the the time participants spent on experiencing the surrogates, the time participants spent on doing the tasks, participants' performance accuracy on the tasks, participants' confidence in their task responses, and participants' subjective ratings on the surrogates. On average, the uncoordinated surrogates were more helpful than the coordinated ones, but the manually-generated surrogates were only more helpful than the automatically-generated ones in terms of task completion time. Participants' subjective ratings were more favorable for the coordinated surrogate C2 (Magic A + V) and the uncoordinated surrogate U1 (Magic A + Storyboard V) with respect to usefulness, usability, enjoyment, and engagement. The post-session questionnaire comments demonstrated participants' preference for the coordinated surrogates, but the comments also revealed the value of having uncoordinated sensory channels