Multimodal Content Analysis for Effective Advertisements on YouTube

The rapid advances in e-commerce and Web 2.0 technologies have greatly increased the impact of commercial advertisements on the general public. As a key enabling technology, a multitude of recommender systems exists which analyzes user features and browsing patterns to recommend appealing advertisements to users. In this work, we seek to study the characteristics or attributes that characterize an effective advertisement and recommend a useful set of features to aid the designing and production processes of commercial advertisements. We analyze the temporal patterns from multimedia content of advertisement videos including auditory, visual and textual components, and study their individual roles and synergies in the success of an advertisement. The objective of this work is then to measure the effectiveness of an advertisement, and to recommend a useful set of features to advertisement designers to make it more successful and approachable to users. Our proposed framework employs the signal processing technique of cross modality feature learning where data streams from different components are employed to train separate neural network models and are then fused together to learn a shared representation. Subsequently, a neural network model trained on this joint feature embedding representation is utilized as a classifier to predict advertisement effectiveness. We validate our approach using subjective ratings from a dedicated user study, the sentiment strength of online viewer comments, and a viewer opinion metric of the ratio of the Likes and Views received by each advertisement from an online platform.Comment: 11 pages, 5 figures, ICDM 201

Picturing Argentina: Myths, Movies, and the Peronist Vision

No individual has had greater impact on Argentine history than Juan Domingo Perón. The years 1943–1945, when he was an influential member in his nation’s governing junta, and 1946–1955, when he was its president, were tumultuous ones that transformed Argentina. Perón was a highly controversial figure, and his memory continues to provoke intense and often acrimonious debate. Moreover, the nature of his legacy resists neat classification. Many of his achievements were positive. He oversaw the passage of progressive social legislation, including women’s suffrage and prison reform, and he implemented programs that aided the nation’s poor and working classes. On the other hand, he tolerated no opposition and, as president, incarcerated even former supporters who questioned his actions, and he ordered the closure of newspapers that he judged inappropriately critical. His regime’s impact on the nation’s cinema is similarly difficult to classify. When Perón came to prominence, Argentina had developed one of the two major film industries in Latin America. His government intervened in this sphere to an unprecedented degree and in contradictory ways. It encouraged production by providing financial credits for filmmakers, and in 1948 Perón and his wife, Evita, a former actress, presided over the inauguration of the nation’s international film festival in Mar del Plata. Conversely, his administration blacklisted a remarkable number of directors and performers, censored and prohibited movies, and required all films made in Argentina to portray his regime’s accomplishments in a favorable manner. Although Perón’s central role in Argentine history and the need for an unbiased assessment of his impact on his nation’s cinema are beyond dispute, the existing scholarship on the subject is limited. In recent decades Argentina has witnessed a revival of serious film study, some of which has focused on the nation’s classical movies and, in one case, on Peronism. None of this work has been translated into English, however. The only recent book in English to study this topic divides its attention between Argentine cinema and radio and dedicates only one chapter to film during the Perón years. Picturing Argentina: Myths, Movies, and the Peronist Vision is the first English-language book that offers an extensive assessment of Argentine cinema during first Peronism. It is also the first study in any language that concentrates systematically on the evolution of social attitudes reflected in Argentine movies throughout those years and that assesses the period’s impact on subsequent filmmaking activity. By analyzing popular Argentine movies from this time through the prism of myth—second-order communication systems that present historically developed customs and attitudes as natural—the book traces the filmic construction of gender, criminality, race, the family, sports, and the military. It identifies in movies the development and evolution of mindsets and attitudes that may be construed as “Peronist.” By framing its consideration of films from the Perón years in the context of earlier and later ones, it demonstrates that this period accelerates—and sometimes registers backward-looking responses to—earlier progressive mythic shifts, and it traces the development in the 1950s of a critical mindset that comes to fruition in the “new cinema” of the 1960s. [From the Publisher]https://cupola.gettysburg.edu/books/1053/thumbnail.jp

Application of Common Sense Computing for the Development of a Novel Knowledge-Based Opinion Mining Engine

The ways people express their opinions and sentiments have radically changed in the past few years thanks to the advent of social networks, web communities, blogs, wikis and other online collaborative media. The distillation of knowledge from this huge amount of unstructured information can be a key factor for marketers who want to create an image or identity in the minds of their customers for their product, brand, or organisation. These online social data, however, remain hardly accessible to computers, as they are specifically meant for human consumption. The automatic analysis of online opinions, in fact, involves a deep understanding of natural language text by machines, from which we are still very far. Hitherto, online information retrieval has been mainly based on algorithms relying on the textual representation of web-pages. Such algorithms are very good at retrieving texts, splitting them into parts, checking the spelling and counting their words. But when it comes to interpreting sentences and extracting meaningful information, their capabilities are known to be very limited. Existing approaches to opinion mining and sentiment analysis, in particular, can be grouped into three main categories: keyword spotting, in which text is classified into categories based on the presence of fairly unambiguous affect words; lexical affinity, which assigns arbitrary words a probabilistic affinity for a particular emotion; statistical methods, which calculate the valence of affective keywords and word co-occurrence frequencies on the base of a large training corpus. Early works aimed to classify entire documents as containing overall positive or negative polarity, or rating scores of reviews. Such systems were mainly based on supervised approaches relying on manually labelled samples, such as movie or product reviews where the opinionist’s overall positive or negative attitude was explicitly indicated. However, opinions and sentiments do not occur only at document level, nor they are limited to a single valence or target. Contrary or complementary attitudes toward the same topic or multiple topics can be present across the span of a document. In more recent works, text analysis granularity has been taken down to segment and sentence level, e.g., by using presence of opinion-bearing lexical items (single words or n-grams) to detect subjective sentences, or by exploiting association rule mining for a feature-based analysis of product reviews. These approaches, however, are still far from being able to infer the cognitive and affective information associated with natural language as they mainly rely on knowledge bases that are still too limited to efficiently process text at sentence level. In this thesis, common sense computing techniques are further developed and applied to bridge the semantic gap between word-level natural language data and the concept-level opinions conveyed by these. In particular, the ensemble application of graph mining and multi-dimensionality reduction techniques on two common sense knowledge bases was exploited to develop a novel intelligent engine for open-domain opinion mining and sentiment analysis. The proposed approach, termed sentic computing, performs a clause-level semantic analysis of text, which allows the inference of both the conceptual and emotional information associated with natural language opinions and, hence, a more efficient passage from (unstructured) textual information to (structured) machine-processable data. The engine was tested on three different resources, namely a Twitter hashtag repository, a LiveJournal database and a PatientOpinion dataset, and its performance compared both with results obtained using standard sentiment analysis techniques and using different state-of-the-art knowledge bases such as Princeton’s WordNet, MIT’s ConceptNet and Microsoft’s Probase. Differently from most currently available opinion mining services, the developed engine does not base its analysis on a limited set of affect words and their co-occurrence frequencies, but rather on common sense concepts and the cognitive and affective valence conveyed by these. This allows the engine to be domain-independent and, hence, to be embedded in any opinion mining system for the development of intelligent applications in multiple fields such as Social Web, HCI and e-health. Looking ahead, the combined novel use of different knowledge bases and of common sense reasoning techniques for opinion mining proposed in this work, will, eventually, pave the way for development of more bio-inspired approaches to the design of natural language processing systems capable of handling knowledge, retrieving it when necessary, making analogies and learning from experience

Generating Effective Recommendations Using Viewing-Time Weighted Preferences for Attributes

Recommender systems are an increasingly important technology and researchers have recently argued for incorporating different kinds of data to improve recommendation quality. This paper presents a novel approach to generating recommendations and evaluates its effectiveness. First, we review evidence that item viewing time can reveal user preferences for items. Second, we model item preference as a weighted function of preferences for item attributes. We then propose a method for generating recommendations based on these two propositions. The results of a laboratory evaluation show that the proposed approach generated estimated item ratings consistent with explicit item ratings and assigned high ratings to products that reflect revealed preferences of users. We conclude by discussing implications and identifying areas for future research

Application of Common Sense Computing for the Development of a Novel Knowledge-Based Opinion Mining Engine

The ways people express their opinions and sentiments have radically changed in the past few years thanks to the advent of social networks, web communities, blogs, wikis and other online collaborative media. The distillation of knowledge from this huge amount of unstructured information can be a key factor for marketers who want to create an image or identity in the minds of their customers for their product, brand, or organisation. These online social data, however, remain hardly accessible to computers, as they are specifically meant for human consumption. The automatic analysis of online opinions, in fact, involves a deep understanding of natural language text by machines, from which we are still very far. Hitherto, online information retrieval has been mainly based on algorithms relying on the textual representation of web-pages. Such algorithms are very good at retrieving texts, splitting them into parts, checking the spelling and counting their words. But when it comes to interpreting sentences and extracting meaningful information, their capabilities are known to be very limited. Existing approaches to opinion mining and sentiment analysis, in particular, can be grouped into three main categories: keyword spotting, in which text is classified into categories based on the presence of fairly unambiguous affect words; lexical affinity, which assigns arbitrary words a probabilistic affinity for a particular emotion; statistical methods, which calculate the valence of affective keywords and word co-occurrence frequencies on the base of a large training corpus. Early works aimed to classify entire documents as containing overall positive or negative polarity, or rating scores of reviews. Such systems were mainly based on supervised approaches relying on manually labelled samples, such as movie or product reviews where the opinionist’s overall positive or negative attitude was explicitly indicated. However, opinions and sentiments do not occur only at document level, nor they are limited to a single valence or target. Contrary or complementary attitudes toward the same topic or multiple topics can be present across the span of a document. In more recent works, text analysis granularity has been taken down to segment and sentence level, e.g., by using presence of opinion-bearing lexical items (single words or n-grams) to detect subjective sentences, or by exploiting association rule mining for a feature-based analysis of product reviews. These approaches, however, are still far from being able to infer the cognitive and affective information associated with natural language as they mainly rely on knowledge bases that are still too limited to efficiently process text at sentence level. In this thesis, common sense computing techniques are further developed and applied to bridge the semantic gap between word-level natural language data and the concept-level opinions conveyed by these. In particular, the ensemble application of graph mining and multi-dimensionality reduction techniques on two common sense knowledge bases was exploited to develop a novel intelligent engine for open-domain opinion mining and sentiment analysis. The proposed approach, termed sentic computing, performs a clause-level semantic analysis of text, which allows the inference of both the conceptual and emotional information associated with natural language opinions and, hence, a more efficient passage from (unstructured) textual information to (structured) machine-processable data. The engine was tested on three different resources, namely a Twitter hashtag repository, a LiveJournal database and a PatientOpinion dataset, and its performance compared both with results obtained using standard sentiment analysis techniques and using different state-of-the-art knowledge bases such as Princeton’s WordNet, MIT’s ConceptNet and Microsoft’s Probase. Differently from most currently available opinion mining services, the developed engine does not base its analysis on a limited set of affect words and their co-occurrence frequencies, but rather on common sense concepts and the cognitive and affective valence conveyed by these. This allows the engine to be domain-independent and, hence, to be embedded in any opinion mining system for the development of intelligent applications in multiple fields such as Social Web, HCI and e-health. Looking ahead, the combined novel use of different knowledge bases and of common sense reasoning techniques for opinion mining proposed in this work, will, eventually, pave the way for development of more bio-inspired approaches to the design of natural language processing systems capable of handling knowledge, retrieving it when necessary, making analogies and learning from experience

Designing Human-Centered Collective Intelligence

Human-Centered Collective Intelligence (HCCI) is an emergent research area that seeks to bring together major research areas like machine learning, statistical modeling, information retrieval, market research, and software engineering to address challenges pertaining to deriving intelligent insights and solutions through the collaboration of several intelligent sensors, devices and data sources. An archetypal contextual CI scenario might be concerned with deriving affect-driven intelligence through multimodal emotion detection sources in a bid to determine the likability of one movie trailer over another. On the other hand, the key tenets to designing robust and evolutionary software and infrastructure architecture models to address cross-cutting quality concerns is of keen interest in the “Cloud” age of today. Some of the key quality concerns of interest in CI scenarios span the gamut of security and privacy, scalability, performance, fault-tolerance, and reliability. I present recent advances in CI system design with a focus on highlighting optimal solutions for the aforementioned cross-cutting concerns. I also describe a number of design challenges and a framework that I have determined to be critical to designing CI systems. With inspiration from machine learning, computational advertising, ubiquitous computing, and sociable robotics, this literature incorporates theories and concepts from various viewpoints to empower the collective intelligence engine, ZOEI, to discover affective state and emotional intent across multiple mediums. The discerned affective state is used in recommender systems among others to support content personalization. I dive into the design of optimal architectures that allow humans and intelligent systems to work collectively to solve complex problems. I present an evaluation of various studies that leverage the ZOEI framework to design collective intelligence

Trusted Knowledge Infusion Model-based Recommender System for IoT based B2B applications

The exponential growth and usage of Internet, social sites, and e-commerce results extensive amount of information everywhere. It becomes very difficult for the people to search something, so they go for the offered suggestions which are pertinent for them rather than searching from a potentially overwhelming number of options. Recommender Systems are the solutions for such difficulties. There are many powerful Recommender Systems available for e-commerce, websites, books, tourism, and documents, but recommendations for IoT-based applications need of new discoveries. Traditional recommendations methods are not sufficient for big data based scalable and heterogeneous IoT environment. In this paper, we propose a knowledge infusion model-based hybrid recommendation model for IoT-based B2B applications. The proposed model is analyzed with a real dataset, and the evaluation represents that model performs well in terms execution time, RMSE, precision and F1-score as compared with the existing models