Deliverable D2.6 LinkedTV Framework for Generating Video Enrichments with Annotations

This deliverable describes the final LinkedTV framework that provides a set of possible enrichment resources for seed video content using techniques such as text and web mining, information extraction and information retrieval technologies. The enrichment content is obtained from four type of sources: a) by crawling and indexing web sites described in a white list specified by the content partners, b) by querying the API or SPARQL endpoint of the Europeana digital library network which is publicly exposed, c) by querying multiple social networking APIs, d) by hyperlinking to other parts of TV programs within the same collection using a Solr index. This deliverable also describes an additional content annotation functionality, namely labelling enrichment (as well as seed) content with thematic topics, as well as the process of exposing content annotations to this module and to the filtering services of LinkedTV’s personalization workflow. We illustrate the enrichment workflow for the two main scenarios of LinkedTV which have lead to the development of the LinkedCulture and LinkedNews applications, which respectively use the TVEnricher and TVNewsEnricher enrichment services. The original title of this deliverable from the DoW was Advanced concept labelling by complementary Web mining

Exploiting Spatio-Temporal Coherence for Video Object Detection in Robotics

This paper proposes a method to enhance video object detection for indoor environments in robotics. Concretely, it exploits knowledge about the camera motion between frames to propagate previously detected objects to successive frames. The proposal is rooted in the concepts of planar homography to propose regions of interest where to find objects, and recursive Bayesian filtering to integrate observations over time. The proposal is evaluated on six virtual, indoor environments, accounting for the detection of nine object classes over a total of ∼ 7k frames. Results show that our proposal improves the recall and the F1-score by a factor of 1.41 and 1.27, respectively, as well as it achieves a significant reduction of the object categorization entropy (58.8%) when compared to a two-stage video object detection method used as baseline, at the cost of small time overheads (120 ms) and precision loss (0.92).</p

Audiovisual Translation: Subtitling Netflix documentary â Black Hole Apocalypseâ

ope

A critical investigation of deaf comprehension of signed tv news interpretation

This study investigates factors hampering comprehension of sign language interpretations rendered on South African TV news bulletins in terms of Deaf viewers’ expectancy norms and corpus analysis of authentic interpretations. The research fills a gap in the emerging discipline of Sign Language Interpreting Studies, specifically with reference to corpus studies. The study presents a new model for translation/interpretation evaluation based on the introduction of Grounded Theory (GT) into a reception-oriented model. The research question is addressed holistically in terms of target audience competencies and expectations, aspects of the physical setting, interpreters’ use of language and interpreting choices. The South African Deaf community are incorporated as experts into the assessment process, thereby empirically grounding the research within the socio-dynamic context of the target audience. Triangulation in data collection and analysis was provided by applying multiple mixed data collection methods, namely questionnaires, interviews, eye-tracking and corpus tools. The primary variables identified by the study are the small picture size and use of dialect. Secondary variables identified include inconsistent or inadequate use of non-manual features, incoherent or non-simultaneous mouthing, careless or incorrect sign execution, too fast signing, loss of visibility against skin or clothing, omission of vital elements of sentence structure, adherence to source language structures, meaningless additions, incorrect referencing, oversimplification and violations of Deaf norms of restructuring, information transfer, gatekeeping and third person interpreting. The identification of these factors allows the construction of a series of testable hypotheses, thereby providing a broad platform for further research. Apart from pioneering corpus-driven sign language interpreting research, the study makes significant contributions to present knowledge of evaluative models, interpreting strategies and norms and systems of transcription and annotation.Linguistics and Modern LanguagesThesis (D. Litt.et Phil.) (Linguistics

Data visualization in the first person

Thesis (Ph. D.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, February 2013.Cataloged from PDF version of thesis. "February 2013."Includes bibliographical references (p. 103-107).This dissertation will examine what a first person viewpoint means in the context of data visualization and how it can be used for navigating and presenting large datasets. Recent years have seen rapid growth in Big Data methodologies throughout scientific research, business analytics, and online services. The datasets used in these areas are not only growing exponentially larger, but also more complex, incorporating heterogeneous data from many sources that might include digital sensors, websites, mass media, and others. The scale and complexity of these datasets pose significant challenges in the design of effective tools for navigation and analysis. This work will explore methods of representing large datasets as physical, navigable environments. Much of the related research on first person interfaces and 3D visualization has focused on producing tools for expert users and scientific analysis. Due to the complexities of navigation and perception introduced by 3D interfaces, work in this area has had mixed results. In particular, considerable efforts to develop 3D systems for more abstract data, like file systems and social networks, have had difficulty surpassing the efficiency of 2D approaches. However, 3D may offer advantages that have been less explored in this context. In particular, data visualization can be a valuable tool for disseminating scientific results, sharing insights, and explaining methodology. In these applications, clear communication of concepts and narratives are often more essential than efficient navigation. This dissertation will present novel visualization systems designed for large datasets that include audio-video recordings, social media, and others. Discussion will focus on designing visuals that use the first person perspective to give a physical and intuitive form to abstract data, to combine multiple sources of data within a shared space, to construct narratives, and to engage the viewer at a more visceral and emotional level.by Philip DeCamp.Ph.D

Designing personalized video-based crossmedia informal learning environments beyond iTV

Tese de doutoramento, Informática (Engenharia Informática), Universidade de Lisboa, Faculdade de Ciências, 2014Video is a very rich medium, in cognitive and affective terms, to convey information and support learning and entertainment like no other medium, and TV is a privileged way to watch it. However, by being traditionally watched in a more experiential and passive cognitive mode, TV and video are limited in their capacity to fully support learning so important in the lifelong learning era where learning is taking place in a wide variety of contexts and locations that calls for flexible environments. TV and video are limited in their capacity to fully support learning but may induce viewers to engage in more reflective modes, that can be supported to some extent by their adequate design, in interactive contexts and augmented by other media and devices, in diverse situations. The inclusion of iTV that has been gaining increasing attention from researchers, and practitioners, in the last few years, as part of rich and flexible crossmedia environments brings new opportunities in this respect. This situation justifies our research main goal to efficiently and flexibly support users learning informal opportunities created in video-based crossmedia environments, taking into account the different cognitive modes, contexts of use and taking advantage of the diverse devices being used in order to have each device contributing with what it does best. In order to illustrate, explore and validate our research, the eiTV application was conceptualized, prototyped and evaluated. It is capable to create videobased crossmedia informal learning environments, created as additional information to the video being watched, initially via iTV. These environments are accessed from iTV, PC and mobile devices (the most commonly used in crossmedia scenarios), depending on the preferred or most adequate device in each context of use.Fundação para a Ciência e a Tecnologia (FCT, SFRH/PROTEC/67727/2010, projeto UTA-Est/MAI/0010/2009

Rethinking Change

UIDB/00417/2020 UIDP/00417/2020No seguimento da Conferência Internacional sobre Arte, Museus e Culturas Digitais (Abril 2021), este e-book pretende aprofundar a discussão sobre o conceito de mudança, geralmente associado à relação entre cultura e tecnologia. Através dos contributos de 32 autores, de 12 países, questiona-se não só a forma como o digital tem motivado novas práticas artísticas e curatoriais, mas também o inverso, observando como propostas críticas e criativas no campo da arte e dos museus têm aberto vias alternativas para o desenvolvimento tecnológico. Assumindo a diversidade de perspectivas sobre o tema, de leituras retrospectivas à análise de questões e projectos recentes, o livro estrutura-se em torno de sete capítulos e um ensaio visual, evidenciando os territórios de colaboração e cruzamento entre diferentes áreas de conhecimento científico. Disponível em acesso aberto, esta publicação resulta de um projecto colaborativo promovido pelo Instituto de História da Arte, Faculdade de Ciências Sociais e Humanas, Universidade NOVA de Lisboa e pelo maat – Museu de Arte, Arquitectura e Tecnologia. Instituição parceira: Instituto Superior Técnico. Mecenas: Fundação Millennium bcp. Media partner: revista Umbigo. Following the International Conference on Art, Museums and Digital Cultures (April 2021), this e-book seeks to extend the discussion on the concept of change that is usually associated with the relationship between culture and technology. Through the contributions of 32 authors from 12 countries, the book not only questions how digital media have inspired new artistic and curatorial practices, but also how, conversely, critical and creative proposals in the fields of art and museums have opened up alternative paths to technological development. Acknowledging the different approaches to the topic, ranging from retrospective readings to the analysis of recent issues and projects, the book is divided into seven sections and a visual essay, highlighting collaborative territories and the crossovers between different areas of scientific knowledge. Available in open access, this publication is the result of a collaborative project promoted by the Institute of Art History of the School of Social Sciences and Humanities, NOVA University of Lisbon and maat – Museum of Art, Architecture and Technology. Partner institution: Instituto Superior Técnico. Sponsor: Millennium bcp Foundation. Media partner: Umbigo magazine.publishersversionpublishe

The Palgrave Handbook of Digital Russia Studies

This open access handbook presents a multidisciplinary and multifaceted perspective on how the ‘digital’ is simultaneously changing Russia and the research methods scholars use to study Russia. It provides a critical update on how Russian society, politics, economy, and culture are reconfigured in the context of ubiquitous connectivity and accounts for the political and societal responses to digitalization. In addition, it answers practical and methodological questions in handling Russian data and a wide array of digital methods. The volume makes a timely intervention in our understanding of the changing field of Russian Studies and is an essential guide for scholars, advanced undergraduate and graduate students studying Russia today