CHORUS Deliverable 2.2: Second report - identification of multi-disciplinary key issues for gap analysis toward EU multimedia search engines roadmap

After addressing the state-of-the-art during the first year of Chorus and establishing the existing landscape in multimedia search engines, we have identified and analyzed gaps within European research effort during our second year. In this period we focused on three directions, notably technological issues, user-centred issues and use-cases and socio- economic and legal aspects. These were assessed by two central studies: firstly, a concerted vision of functional breakdown of generic multimedia search engine, and secondly, a representative use-cases descriptions with the related discussion on requirement for technological challenges. Both studies have been carried out in cooperation and consultation with the community at large through EC concertation meetings (multimedia search engines cluster), several meetings with our Think-Tank, presentations in international conferences, and surveys addressed to EU projects coordinators as well as National initiatives coordinators. Based on the obtained feedback we identified two types of gaps, namely core technological gaps that involve research challenges, and “enablers”, which are not necessarily technical research challenges, but have impact on innovation progress. New socio-economic trends are presented as well as emerging legal challenges

Media Analytics for Personalization in Advertisement

In the realm of advertising, strategic placement and presentation of advertisements are crucial for attracting potential clients. Media companies employ various tactics, such as visually appealing features and vibrant colors, to capture the attention of consumers. However, achieving this objective is not always straightforward, as some advertising strategies may be perceived as irrelevant or disturbing by recipients. This Master's thesis aims to explore the relationship between audience interaction and the perception of advertisements on media platforms, with the overarching goal of enhancing advertising effectiveness and addressing ethical concerns associated with targeted advertising. To delve into this topic comprehensively, this study utilizes real-time data provided by Amedia, one of the largest media companies in Norway. Through an extensive analysis of this real-world data, the research aims to explore the correlation between audience interaction and the perception of advertisements on media platforms. This investigation involves the extraction of relevant features from advertisement images, leading to the creation of a new dataset. Concurrently, predictive machine learning models are developed to gain insights into effective advertising strategies for media companies, with a focus on personalization. Furthermore, a comprehensive user study is conducted to gain insights into user behavior within media platform advertisements. By uncovering the interplay between visual features, user behavior, and advertising effectiveness, this research contributes to improving personalized advertising strategies in the context of media companies.Masteroppgåve i informasjonsvitskapINFO390MASV-INF

Revealing Possible Truths Behind “Coolest Monkey in the Jungle”: Ideational Making Analysis Approach

Multimodal Critical Discourse Analysis (CDA)-commonly defined as a discourse analysis approach that focuses on both linguistic and non-linguistic resources- has been witnessing increasing popularity in the research area. It has been argued, on the one hand, that the greater level of practicality the approach has to offer compared to its predecessor (Critical Discourse Analysis) becomes the main reason of why researchers gradually turn their reference on analysing discourses to this method (Han, 2015). An increasing trend of multimodal communications - that no longer use speech or writing exclusively in their occurrences - has become the logical ground on the other (Kress, 2011). This paper, using H&M ‘monkey' hoodie advertisement (refer to appendix) as a form of multimodal communication, employs MCDA to explore the possible advantages one can learn through the process. To start with, a brief account of the key factors in the development of MCDA will be presented. This part is then followed by the discussion of the analysis approach employed in the paper and also the rational basis for choosing the approach over others. The analysis of the advertisement is done by drawing on related language and social theories to scrutinize the ideologies the company implanted on their advertisement. A thoughtful discussion on what is understood through the analysis process and what and how one can relate the practicality of multimodality analysis to another social area such as pedagogy will mark the end of this paper's discussion

Revealing Possible Truths Behind “Coolest Monkey in The Jungle”: Ideational Making Analysis Approach

Multimodal Critical Discourse Analysis (CDA)-commonly defined as a discourse analysis approach that focuses on both linguistic and non-linguistic resources- has been witnessing increasing popularity in the research area. It has been argued, on the one hand, that the greater level of practicality the approach has to offer compared to its predecessor (Critical Discourse Analysis) becomes the main reason of why researchers gradually turn their reference on analysing discourses to this method (Han, 2015). An increasing trend of multimodal communications - that no longer use speech or writing exclusively in their occurrences - has become the logical ground on the other (Kress, 2011). This paper, using H&M ‘monkey’ hoodie advertisement (refer to appendix) as a form of multimodal communication, employs MCDA to explore the possible advantages one can learn through the process. To start with, a brief account of the key factors in the development of MCDA will be presented. This part is then followed by the discussion of the analysis approach employed in the paper and also the rational basis for choosing the approach over others. The analysis of the advertisement is done by drawing on related language and social theories to scrutinize the ideologies the company implanted on their advertisement. A thoughtful discussion on what is understood through the analysis process and what and how one can relate the practicality of multimodality analysis to another social area such as pedagogy will mark the end of this paper’s discussion

The Generic Structure of Print Advertisement of Elizabeth Arden’s INTERVENE: A Multimodal Discourse Analysis

The Elizabeth Arden campaign with Catherine Zeta-Jones as the brand ambassador has deployed the semiotic resources of language and visual images. The analysis of this paper is based on the systemic functional linguistics (SFL) proposed by Halliday (1985, 1994) and Halliday and Matthiessen (2004), which says that a text is understood to simultaneously function three metafunctions: Ideational, Interpersonal and Textual. O’Toole’s (1994) framework of analysing visual images, which follows the main concept of SFL, is also used in the analysis. A multimodal discourse analysis is then applied to analyse one of the series, Intervene, using Cheong’s framework (2004), which combined both frameworks to find the generic structure of this advertisement. Further, this paper also analyses the intersemiosis of the linguistic and the visual resources using Wee’s (2009) intersemiotic mechanisms. It concludes that the interplay of the language and the visual image has proved to be very effective in the meaning-making process of this print advertisement

Developing an ad-reporting typology: a network analysis approach to newspaper and fact-checker coverage of the 2008 presidential election

In a media environment where political ads influence U.S. news coverage, does the press hold politicians accountable for their ad claims? Using semantic network analysis, four types of reporting styles distinguished the ad coverage of 18 sampled newspapers and online fact-checkers from the 2008 presidential election. Horserace reporting characterized the largest group, whereas other models included partisan, he-said/she-said, and fact-checking. If educating the public about the accuracy of political ad claims is a goal of journalism, this study suggests that high-quality political adwatching following the fact-checking journalistic model did not predominate in the 2008 political ad coverage of newspapers

Discovery and Push Notification Mechanisms for Mobile Cloud Services

Viimase viie aasta jooksul on mobiilsed seadmed nagu sülearvutid, pihuarvutid, nutitelefonid jmt. tunginud peaaegu kõigisse inimeste igapäevaelu tegevustesse. Samuti on põhjalik teadus- ja arendustegevus mobiilsete tehnoloogiate vallas viinud märkimisväärsete täiustusteni riistvara, tarkvara ja andmeedastuse alal. Tänapäeval on mobiilsed seadmed varustatud sisseehitatud sensorite, kaamera, puutetundliku ekraani, suurema hulga mäluga, kuid ka tõhusamate energiatarbemehhanismidega. Lisaks on iOS ja Android operatsioonisüsteemide väljalaske tõttu suurenenud nii mobiilirakenduste arv kui keerukus, pakkudes arvukamalt kõrgetasemelisi rakendusi. Sarnaselt on toimunud olulised arengud ja standardiseerimisele suunatud jõupingutused veebiteenusete valdkonnas ja elementaarsetele veebiteenuste ligipääsu kasutatakse laialdaselt nutitelefonidest. See on viinud loogilise järgmise sammuna veebiteenuste pakkumiseni nutitelefonidest. Telefonidest veebiteenuste pakkumise kontseptsioon ei ole uus ning seda on põhjalikult uurinud Srirama, kes pakkus välja Mobile Host (Mobiilne Veebiteenuse Pakkuja) kontseptsiooni. Algne realisatsioon kasutas aga aegunud tehnoloogiaid nagu JMEE, PersonalJava, SOAP arhitektuur jne. See töö uuendab Mobile Host'i kasutades uusimaid tehnoloogiad, nagu Android OS ja REST arhitektuur, ning pakub välja teenusemootori, mis põhineb Apache Felix'il - OSGi platvormi realisatsioonil piiratud ressurssidega seadmetele. Hämmastava kiirusega toimunud arengud mobiilsete arvutuste vallas võimaldavad uue põlvkonna veebirakenduste loomist valdkondades nagu keskkonnateadlikkus, sotsiaalvõrgustikud, koostöövahendid, asukohapõhised teenused jne. Sellised rakendused saavad ära kasutada Mobile Host'i võimalusi. Selle tulemusena on klientidel ligipääs väga suurele hulgale teenustele, mistõttu tekib vajadus efektiivse teenuste avastamise mehhanismi järele. See töö pakub välja kataloogipõhise avastusmehhanismi võrgu ülekatte toega suurtele, kõrge liikuvusega võrgustikele. See mehhanism toetub OWL-S'le, mis on ontoloogia veebiteenuseid pakkuvate ressursside avastamiseks, väljakutseks, koostamiseks ja jälgimiseks. Töö kirjeldab ka Srirama välja pakutud algupärast teenuste avastamise mehhanismi, mis toetub peer-to-peer võrkudele ja Apache Lucene võtmesõna otsingumootorile. Uurimuse käigus uuendatakse teenuseotsing kasutama Apache Solr'i, Apache Lucene'i viimast versiooni. Teenuste avastust testiti põhjalikult ja tulemused on töös kokkuvõtvalt välja toodud. Mobiilsete tehnoloogiate vallas uuritakse ka võimalust kasutada pilvetehnolologiat laiendamaks mobiilseadmete salvestusmahtu ja töökoormust edastades pilve andme- ja arvutusmahukad ülesanded. See soodustab keerulisemate ja võimalusrohkemate mobiilirakenduste arendust. Pilve delegeeritavate toimingute aeganõudva iseloomu tõttu aga on vajalik asünkroonne mehhanism teavitamaks kasutajat, millal töömahukad tegevused on lõpetatud. Mobiilsete pilveteenuste pakkujad ja vahevara lahendused võivad kasu saada Mobile Host'ist ja selle asünkroonsete teavituste võimekusest. Uurimus esitleb nelja teavitusmehhanismi: AC2DM, APNS, IBM MQTT ja Mobile Host'i põhine teavitus. Töö võtab kokku kvantitatiivse analüüsi tulemused ja toob välja nelja teavitamise lähenemise tugevused ja nõrkused. Lisaks kirjeldatakse CroudSTag rakenduse realisatsiooni - CroudSTag on mobiilirakendus, mille eesmärgiks on sotsiaalsete gruppide moodustamine kasutades näotuvastustehnoloogiat. CroudSTag-i realisatsioon kasutab mobiilseid pilveteenuseid ja Mobile Host'i, et pakkuda oma funktsionaalsust kasutajale.In the last lustrum the mobile devices such as laptops, PDAs, smart phones, tablets, etc. have pervaded almost all the environments where people perform their day-to-day activities. Further, the extensive Research and Development in mobile technologies has led to significant improvements in hardware, software and transmission. Similarly, there are significant developments and standardization efforts in web services domain and basic web services have been widely accessed from smart phones. This has lead to the logical next step of providing web services from the smart phones. The concept of the web service provisioning from smart phones is not new and has been extensively explored by Srirama who proposed the concept of Mobile Host. However, the original implementation considered aged technologies such as JMEE, PersonalJava, SOAP architecture among others. This work updates the Mobile Host to the latest technologies like Android OS and REST architecture and proposes a service engine based on Apache Felix, and OSGI implementation for resource constraint devices. Moreover, the astonishing speed in developments in mobile computing enable the new generation of applications from domains such as context-awareness, social network, collaborative tools, location based services, etc., which benefit from the Mobile Host service provisioning capabilities. As a result the clients have access to a huge number of services available; therefore, an efficient and effective service discovery mechanism is required. The thesis proposes a directory-based with network overlay support discovery mechanism for large networks with high mobility. The proposed discovery mechanism relies in OWL-S, an ontology for service discovery, invocation, composition, and monitoring of web resources. The work also considers the original service discovery mechanism proposed by Srirama relying in peer-to-peer networks and Apache Lucene, a keyword search engine. The study updates the service search to Apache Solr, the latest development for Apache Lucene. The service discovery was extensively tested and the results are summarized in this work. Mobile technologies are looking into the clouds for extending their capabilities in storage and processing by offloading data and process intensive tasks. This fosters the development of more complex and rich mobile applications. However, due to the time-consuming nature of the tasks delegated to the clouds, an asynchronous mechanism is necessary for notifying the user when the intensive tasks are completed. Mobile cloud service providers and Middleware solutions might benefit from Mobile Host and its asynchronous notification capabilities. The study presents four push notification mechanisms being AC2DM, APNS, IBM MQTT and Mobile Host based push notification. The work summarizes the results of a quantitative analysis and highlights the strengths and weakness of the four notifications approaches. In addition, it explains CroudSTag realization, a mobile application that aims the social group formation by means of facial recognition that relies in mobile cloud services and Mobile Host to provide its functionality to the user

Revealing Possible Truths Behind “Coolest Monkey in The Jungle”: Ideational Making Analysis Approach

Multimodal Critical Discourse Analysis (CDA)-commonly defined as a discourse analysis approach that focuses on both linguistic and non-linguistic resources- has been witnessing increasing popularity in the research area. It has been argued, on the one hand, that the greater level of practicality the approach has to offer compared to its predecessor (Critical Discourse Analysis) becomes the main reason of why researchers gradually turn their reference on analysing discourses to this method (Han, 2015). An increasing trend of multimodal communications - that no longer use speech or writing exclusively in their occurrences - has become the logical ground on the other (Kress, 2011). This paper, using H&M ‘monkey’ hoodie advertisement (refer to appendix) as a form of multimodal communication, employs MCDA to explore the possible advantages one can learn through the process. To start with, a brief account of the key factors in the development of MCDA will be presented. This part is then followed by the discussion of the analysis approach employed in the paper and also the rational basis for choosing the approach over others. The analysis of the advertisement is done by drawing on related language and social theories to scrutinize the ideologies the company implanted on their advertisement. A thoughtful discussion on what is understood through the analysis process and what and how one can relate the practicality of multimodality analysis to another social area such as pedagogy will mark the end of this paper’s discussion