Motion and emotion : Semantic knowledge for hollywood film indexing

Ph.DDOCTOR OF PHILOSOPH

PlayRightNow - Designing a media player experience for PlayNow arena

This paper discusses the process of designing a media player tailored for PlayNowTM arena with the purpose of enhancing the user experience of this media portal. The design process is divided into two main stages, the first consisting on gathering information to inform the design of a media player and the second stage involving a low-fidelity prototype of a media player. In the first stage, three main activities are carried out to inform the design of the interface: a literary review of relevant research and studies related to the way people use digital media and its effect on society; an evaluation of the interfaces and features offered by some of the existing popular media players in the market today from an interaction design point of view; and user observations and interviews on people’s relation to digital media. Based on the information and data collected from the first stage, an iterative process of design of interfaces was adapted, whereby potential users and design experts were consulted with their opinions and suggestions that influenced the sketching of various possible interfaces. Finally, a design of a media player for PlayNowTM arena is proposed, which is believed to have the potential of providing its users with a better experience in relation to digital content, as well as attracting new customers and increasing the revenue of this media portal

VISUAL ANALYTICS FOR OPEN-ENDED TASKS IN TEXT MINING

Overview of documents using topic modeling and multidimensional scaling is helpful in understanding topic distribution. While we can spot clusters visually, it is challenging to characterize them. My research investigates an interactive method to identify clusters by assigning attributes and examining the resulting distributions. ParallelSpaces examines the understanding of topic modeling applied to Yelp business reviews, where businesses and their reviews each constitute a separate visual space. Exploring these spaces enables the characterization of each space using the other. However, the scatterplot-based approach in ParallelSpaces does not generalize to categorical variables due to overplotting. My research proposes an improved layout algorithm for those cases in our follow-up work, Gatherplots, which eliminate overplotting in scatterplots while maintaining individual objects. Another limitation in clustering methods is the fixed number of clusters as a hyperparameter. TopicLens is a Magic Lens-type interaction technique, where the documents under the lens are clustered according to topics in real time. While ParallelSpaces help characterize the clusters, the attributes are sometimes limited. To extend the analysis by creating a custom mixture of attributes, CommentIQ is a comment moderation tool where moderators can adjust model parameters according to the context or goals. To help users analyze documents semantically, we develop a technique for user-driven text mining by building a dictionary for topics or concepts in a follow-up study, ConceptVector, which uses word embedding to generate dictionaries interactively and uses those dictionaries to analyze the documents. My dissertation contributes interactive methods to overview documents to integrate the user in text mining loops that currently are non-interactive. The case studies we present in this dissertation provide concrete and operational techniques for directly improving several state-of-the-art text mining algorithms. We summarize those generalizable lessons and discuss the limitations of the visual analytics approach

Understanding Collaborative Sensemaking for System Design — An Investigation of Musicians\u27 Practice

There is surprisingly little written in information science and technology literature about the design of tools used to support the collaboration of creators. Understanding collaborative sensemaking through the use of language has been traditionally applied to non-work domains, but this method is also well-suited for informing hypotheses about the design collaborative systems. The presence of ubiquitous, mobile technology, and development of multi-user virtual spaces invites investigation of design which is based on naturalistic, real world, creative group behaviors, including the collaborative work of musicians. This thesis is considering the co-construction of new (musical) knowledge by small groups. Co-construction of new knowledge is critical to the definition of an information system because it emphasizes coordination and resource sharing among group members (versus individual members independently doing their own tasks and only coming together to collate their contributions as a final product). This work situates the locus of creativity on the process itself, rather than on the output (the musical result) or the individuals (members of the band). This thesis describes a way to apply quantitative observations to inform qualitative assessment of the characteristics of collaborative sensemaking in groups. Conversational data were obtained from nine face-to-face collaborative composing sessions, involving three separate bands producing 18 hours of recorded interactions. Topical characteristics of the discussion, namely objects, plans, properties and performance; as well as emergent patterns of generative, evaluative, revision, and management conversational acts within the group were seen as indicative of knowledge construction. The findings report the use of collaborative pathways: iterative cycles of generation, evaluation and revision of temporary solutions used to move the collaboration forward. In addition, bracketing of temporary solutions served to help collaborators reuse content and offload attentional resources. Ambiguity in language, evaluation criteria, goal formation, and group awareness meant that existing knowledge representations were insufficient in making sense of incoming data and necessitated reformulating those representations. Further, strategic use of affective language was found to be instrumental in bridging knowledge gaps. Based on these findings, features of a collaborative system are proposed to help in facilitating sensemaking routines at various stages of a creative task. This research contributes to the theoretical understanding of collaborative sensemaking during non-work, creative activities in order to inform the design of systems for supporting these activities. By studying an environment which forms a potential microcosm of virtual interaction between groups, it provides a framework for understanding and automating collaborative discussion content in terms of the features of dialogue

Proceedings of the 7th Sound and Music Computing Conference

Proceedings of the SMC2010 - 7th Sound and Music Computing Conference, July 21st - July 24th 2010

Teen playlist: music discovery, production, and sharing among a group of high school students

The purpose of this investigation was to determine if a select group of adolescents exhibited behaviors and practices regarding digital music discovery, production, and sharing that influenced their classroom music instruction. The qualitative study focused on ways in which a group of adolescents informally engaged with digital music in relationship to learning music in their classroom. A constructivist–interpretivist viewpoint framed the theoretical perspective that a person’s knowledge constructions take place within the context of social interaction. In the early 21st century, young people interacting via digital social networking can experience and share music in ways previous generations could not imagine. Peer learning and exchange occur when adolescents share musical ideas and digital artifacts. In addition, autonomous learning takes place while interacting with a digital device. I used Mayer’s (2002) cognitive theory of multimedia learning to support an understanding of the learning effects associated with content-rich digital experiences. Linking social-constructivist and multimedia educational theories provided the conceptual framework needed to extrapolate meaning from adolescents’ preferences, influences, and feelings regarding digital musicking. In an instrumental case study, I followed four high school participants and their music teacher over the course of 6 months. The data consisted of participants’ detailed reflections and perspectives regarding digital music media discovery, production, and sharing. Detailed accounts collected from interviews and observations illustrated the behaviors of the participants, building a thick description. Although the research focused on adolescents, viewpoints of others emerged throughout the study, including those of peers, colleagues, and family members. Consequently, the investigation also considered what music teachers understood about their students’ out of school digital music discovery, production, and sharing. Findings show the convergence and divergence of digital music engagement in a high school music setting. Themes of experiencing music for personal identity, creativity, and popular culture intermix in classroom and informal learning environments. I present outcomes indicating direct implications for music curriculum development and suggest paths to connect in school and out of school music learning via digital music experiences. This study might help contemporary music teachers take advantage of students’ out of school digital music media practices to strengthen in school music programs

Exploiting Latent Features of Text and Graphs

As the size and scope of online data continues to grow, new machine learning techniques become necessary to best capitalize on the wealth of available information. However, the models that help convert data into knowledge require nontrivial processes to make sense of large collections of text and massive online graphs. In both scenarios, modern machine learning pipelines produce embeddings --- semantically rich vectors of latent features --- to convert human constructs for machine understanding. In this dissertation we focus on information available within biomedical science, including human-written abstracts of scientific papers, as well as machine-generated graphs of biomedical entity relationships. We present the Moliere system, and our method for identifying new discoveries through the use of natural language processing and graph mining algorithms. We propose heuristically-based ranking criteria to augment Moliere, and leverage this ranking to identify a new gene-treatment target for HIV-associated Neurodegenerative Disorders. We additionally focus on the latent features of graphs, and propose a new bipartite graph embedding technique. Using our graph embedding, we advance the state-of-the-art in hypergraph partitioning quality. Having newfound intuition of graph embeddings, we present Agatha, a deep-learning approach to hypothesis generation. This system learns a data-driven ranking criteria derived from the embeddings of our large proposed biomedical semantic graph. To produce human-readable results, we additionally propose CBAG, a technique for conditional biomedical abstract generation

Occasionality: A Theory of Literary Exchange between US and China in the Nineteenth Century.

This dissertation uses nineteenth-century Sino-American literary exchanges, both conventional and unconventional, to forward a theory of transnational uses of literature. I argue that in occasion-driven transnationalism, the literature or literary practices of the other are cited to enable a thought experiment or a political enunciation and are then set aside. I track this phenomenon in Sino-American exchanges of the long nineteenth century (1800-1910) and offer readings of the ad hoc transnational writings of Washington Irving, Ralph Waldo Emerson, Dong Xun, Henry Wadsworth Longfellow, Qiu Jin and Sui Sin Far (Edith Maude Eaton). The positivist logic of the literary exchange (which authorizes them as the “proof” of transnational happenings) breaks down when we look at what literary exchange meant to historical actors whose outlooks toward transnationalism and even nationalism were not yet synchronized. Moving between analyses of literary global networks and the narratology and form of individual pieces of writing, this dissertation makes explicit that the relation between this kind of transnationalism and the logics of the uses of literature. Using other people’s literature to create conditions of thinking that nothing else can ffect produces unscripted engagements that tend, in the end, to walk away from permanent influence. In each of five chapters, I read a Chinese-US literary exchange as a case study in the theory of recessive engagement. Intransitivity happens even when (or, rather, especially when) exchanges are happening in the foreground of Sino-US relations, being touted as emblems of cross-influencing. Uncovering unlikely affinities between Chinese and American poetics, historiography, utopianism, philosophies of social activism, and transformations of the public sphere, I further argue that the history of Sino-US literary exchange in the nineteenth century is a romance of the sociality of literature. This is the belief, fueled by transnational formation, that literary contact effectively mediates political action and contemplation, as well as cross-cultural difference. Such a romance encourages the deferral to other people’s literature in the praxis of utopianism; at the same time, through its own tricks, this romance reveals and revels in the likelihood that reading other people’s works might make no difference at all. PhDEnglish Language & LiteratureUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/109072/1/nda_1.pd