Crowdsourcing in Computer Vision

Computer vision systems require large amounts of manually annotated data to properly learn challenging visual concepts. Crowdsourcing platforms offer an inexpensive method to capture human knowledge and understanding, for a vast number of visual perception tasks. In this survey, we describe the types of annotations computer vision researchers have collected using crowdsourcing, and how they have ensured that this data is of high quality while annotation effort is minimized. We begin by discussing data collection on both classic (e.g., object recognition) and recent (e.g., visual story-telling) vision tasks. We then summarize key design decisions for creating effective data collection interfaces and workflows, and present strategies for intelligently selecting the most important data instances to annotate. Finally, we conclude with some thoughts on the future of crowdsourcing in computer vision.Comment: A 69-page meta review of the field, Foundations and Trends in Computer Graphics and Vision, 201

A Revision Control System for Image Editing in Collaborative Multimedia Design

Revision control is a vital component in the collaborative development of artifacts such as software code and multimedia. While revision control has been widely deployed for text files, very few attempts to control the versioning of binary files can be found in the literature. This can be inconvenient for graphics applications that use a significant amount of binary data, such as images, videos, meshes, and animations. Existing strategies such as storing whole files for individual revisions or simple binary deltas, respectively consume significant storage and obscure semantic information. To overcome these limitations, in this paper we present a revision control system for digital images that stores revisions in form of graphs. Besides, being integrated with Git, our revision control system also facilitates artistic creation processes in common image editing and digital painting workflows. A preliminary user study demonstrates the usability of the proposed system.Comment: pp. 512-517 (6 pages

Using the Semantic Grid to Build Bridges between Museums and Indigenous Communities

In this paper we describe a Semantic Grid application designed to enable museums and indigenous communities in distributed locations, to collaboratively discuss, describe, annotate and define the rights associated with objects in museums that originally belonged to or are of cultural or historical significance to indigenous groups. By extending and refining an existing application, Vannotea, we enable users on access grid nodes to collaboratively attach descriptive, rights and tribal care metadata and annotations to digital images, video or 3D representations. The aim is to deploy the software within museums to enable the traditional owners to describe and contextualize museum content in their own words and from their own perspectives. This sharing and exchange of knowledge will hopefully revitalize cultures eroded through colonization and globalization and repair and strengthen relationships between museums and indigenous communities

Vannotea: A collaborative video indexing, annotation and discussion system for broadband networks

A number of research groups and software companies have developed digital annotation tools for textual documents, web pages, images, audio and video resources. By annotations we mean subjective comments, notes, explanations or external remarks that can be attached to a document or a selected part of a document without actually modifying the document. When a user retrieves a document, they can also download the annotations attached to it from an annotation server to view their peer’s opinions and perspectives on the particular document or to add, edit or update their own annotations. The ability to do this collaboratively and in real time during group discussions is of great interest to the educational, medical, scientific, cultural, defense and media communities. But it is extremely challenging technically and demands significant bandwidth, particularly for video documents. In this paper we describe a unique prototype application developed over the Australian GrangeNet broadband research network, which combines videoconferencing over access grid nodes with collaborative, real-time sharing of an application which enables the indexing, browsing, annotation and discussion of video content between multiple groups at remote locations

Social video: A collaborative video annotation environment to support E-learning

Our social video system allows users to enrich video by additional information like external websites, hypertext, images, other videos, or communication channels. Users are able to annotate whole videos, scenes, and objects in the video. We do not focus on a single user accessing the system but on multiple users watching the video and accessing the annotations others have created. Our web-based prototype differs from classical hypervideo systems because it allows annotation (authoring) and navigation in videos by focusing on collaboration and communication between the users. The prototype is integrated into the online social network Facebook and was evaluated with more than 300 users. The evaluation analyzes the usage of the system with a learning scenario in mind and indicates a learning success of users

JuxtaLearn D3.2 Performance Framework

This deliverable, D3.2, for Work Package 3 incorporating the pedagogy from WP2 and orchestration factors mapped in D3.1 reviews aspects of performance in the context of participative video making. It reviews literature on curiosity and engagement characteristics of interaction mechanisms for public displays and anticipates requirements for social network analysis of relevant public videos from WP6 task 6.3. Thus, to support JuxtaLearn performance it proposes a reflective performance framework that encompasses the material environment and objects required, the participants, and the knowledge needed

Mobile and web tools for participative learning

Dissertação apresentada na Faculdade de Ciências e Tecnologia da Universidade Nova de Lisboa, para a obtenção do grau de Mestre em Engenharia InformáticaThe combination of different media formats has been a crucial aspect on teaching and learning processes. The recent developments of multimedia technologies over the Internet and using mobile devices can improve the communication between professors and students, and allow students to study anywhere and anytime, allowing each student progress at its own pace. The usage of these new platforms and the increase of multimedia sharing applied to educational environments allow a more participative learning, and make the study of interfaces a relevant aspect of existing multimedia learning systems. The work done in this dissertation explores interfaces and tools for participative learning,using multimedia educational systems over Internet broadband and mobile devices. In this work, aWeb-based learning system was developed, which enables to store, transmit, search and share the contents of courses captured in video and its extension to support Tablet PCs. The Web system, developed as part of the VideoStore project, explores video interfaces and video annotations, which encourage the participative work. The usage of Tablet PCs, through the mEmLearn project, has the aim to encourage the participative work, allowing the students to augment the course materials and to share them with other students or instructors