Video Abstracting at a Semantical Level

One the most common form of a video abstract is the movie trailer. Contemporary movie trailers share a common structure across genres which allows for an automatic generation and also reflects the corresponding moviea s composition. In this thesis a system for the automatic generation of trailers is presented. In addition to action trailers, the system is able to deal with further genres such as Horror and comedy trailers, which were first manually analyzed in order to identify their basic structures. To simplify the modeling of trailers and the abstract generation itself a new video abstracting application was developed. This application is capable of performing all steps of the abstract generation automatically and allows for previews and manual optimizations. Based on this system, new abstracting models for horror and comedy trailers were created and the corresponding trailers have been automatically generated using the new abstracting models. In an evaluation the automatic trailers were compared to the original Trailers and showed a similar structure. However, the automatically generated trailers still do not exhibit the full perfection of the Hollywood originals as they lack intentional storylines across shots

Multiple change-point detection for non-stationary time series using wild binary segmentation

We propose a new technique for consistent estimation of the number and locations of the change-points in the second-order structure of a time series. The core of the segmentation procedure is the Wild Binary Segmentation method(WBS), a technique which involves a certain randomised mechanism. The advantage of WBS over the standard Binary Segmentation lies in its localisation feature, thanks to which it works in cases where the spacings between change-points are short. In addition, we do not restrict the total number of change-points a time series can have. We also ameliorate the performance of our method by combining the CUSUM statistics obtained at different scales of the wavelet periodogram, our main change-point detection statistic, which allows a rigorous estimation of the local autocovariance of a piecewise-stationary process. We provide a simulation study to examine the performance of our method for different types of scenarios. A proof of consistency is also provided. Our methodology is implemented in the R package wbsts, available from CRAN

Online multimedia advertising

Master'sMASTER OF SCIENC

Multidimensional projections for the visual exploration of multimedia data

Multidimensional data analysis is considerably important when dealing with such large and complex datasets. Among the possibilities when analyzing such kind of data, applying visualization techniques can help the user find and understand patters, trends and establish new goals. This thesis aims to present several visualization methods to interactively explore multidimensional datasets aimed from specialized to casual users, by making use of both static and dynamic representations created by multidimensional projections

Studies of Content-Mediated Interaction: Insights into Activities, Motivations and User Experience Design

The amount of user-generated digital content in social media has exploded during recent years. Currently, it is easy to capture and produce versatile personal content, for example, activity data that is recorded with devices, such as heart rate monitors or the preference data of the music you listen to. A plethora of services exists for content sharing. Sharing digital content, such as images, audio, and video allows people to express themselves, create new contacts, strengthen ties with existing contacts, and to collaborate with other people. Social activities through content can create a sense of belonging and being part of a community. Digital content mediates social interaction through online services. For example, a shared video tells someone the story of an event that they could not be physically present at, and then shared exercise data might inform others of an interesting cycle route for a specific type of exercise. The sharing of traditional, personal digital content such as photos and videos has been widely studied, but recently it has become increasingly common to produce different types of content collaboratively and various services enable social interaction around such content – not just the sharing of it. The guidance for designers on how to build services to enable users to engage in these interactions naturally is still limited. To design better services, we need a better understanding of user activities together with the shared content and the collaborative practices that they form. Thus, this work focuses on novel types of user-generated digital content as well as the related activities, motivations, and user experiences.This compound thesis contributes to the research field of human-computer interaction; more specifically, the user experience. The thesis contains findings from six user case studies, involving a total of 328 participants. Through the case studies, we identified the elements that contribute to the user experience of content-mediated interaction with various content types. The theoretical contribution of this work is the introduction of the concept of contentmediated interaction. This work identifies the different elements that affect content-mediated interaction, and builds a content-mediated interaction model. The work extends the knowledge of user activities and the related user experience with novel types of shared content and of the user’s motivation to participate in content-mediated interaction. As a practical outcome, the thesis presents design implications. The thesis first proposes that understanding content-mediated interaction helps to design better applications and services that support online social interaction. Second, this helps to evaluate and refine the existing services as well as understand the emerging new content types in the future. Understanding the underlying activities and motivations supports the creation of new interaction features, service concepts, and finally, identifying business prospects

Advances in Robotics, Automation and Control

The book presents an excellent overview of the recent developments in the different areas of Robotics, Automation and Control. Through its 24 chapters, this book presents topics related to control and robot design; it also introduces new mathematical tools and techniques devoted to improve the system modeling and control. An important point is the use of rational agents and heuristic techniques to cope with the computational complexity required for controlling complex systems. Through this book, we also find navigation and vision algorithms, automatic handwritten comprehension and speech recognition systems that will be included in the next generation of productive systems developed by man

MediaSync: Handbook on Multimedia Synchronization

This book provides an approachable overview of the most recent advances in the fascinating field of media synchronization (mediasync), gathering contributions from the most representative and influential experts. Understanding the challenges of this field in the current multi-sensory, multi-device, and multi-protocol world is not an easy task. The book revisits the foundations of mediasync, including theoretical frameworks and models, highlights ongoing research efforts, like hybrid broadband broadcast (HBB) delivery and users' perception modeling (i.e., Quality of Experience or QoE), and paves the way for the future (e.g., towards the deployment of multi-sensory and ultra-realistic experiences). Although many advances around mediasync have been devised and deployed, this area of research is getting renewed attention to overcome remaining challenges in the next-generation (heterogeneous and ubiquitous) media ecosystem. Given the significant advances in this research area, its current relevance and the multiple disciplines it involves, the availability of a reference book on mediasync becomes necessary. This book fills the gap in this context. In particular, it addresses key aspects and reviews the most relevant contributions within the mediasync research space, from different perspectives. Mediasync: Handbook on Multimedia Synchronization is the perfect companion for scholars and practitioners that want to acquire strong knowledge about this research area, and also approach the challenges behind ensuring the best mediated experiences, by providing the adequate synchronization between the media elements that constitute these experiences

Deliverable D2.7 Final Linked Media Layer and Evaluation

This deliverable presents the evaluation of content annotation and content enrichment systems that are part of the final tool set developed within the LinkedTV consortium. The evaluations were performed on both the Linked News and Linked Culture trial content, as well as on other content annotated for this purpose. The evaluation spans three languages: German (Linked News), Dutch (Linked Culture) and English. Selected algorithms and tools were also subject to benchmarking in two international contests: MediaEval 2014 and TAC’14. Additionally, the Microposts 2015 NEEL Challenge is being organized with the support of LinkedTV