Crowdsourcing in Computer Vision

Computer vision systems require large amounts of manually annotated data to properly learn challenging visual concepts. Crowdsourcing platforms offer an inexpensive method to capture human knowledge and understanding, for a vast number of visual perception tasks. In this survey, we describe the types of annotations computer vision researchers have collected using crowdsourcing, and how they have ensured that this data is of high quality while annotation effort is minimized. We begin by discussing data collection on both classic (e.g., object recognition) and recent (e.g., visual story-telling) vision tasks. We then summarize key design decisions for creating effective data collection interfaces and workflows, and present strategies for intelligently selecting the most important data instances to annotate. Finally, we conclude with some thoughts on the future of crowdsourcing in computer vision.Comment: A 69-page meta review of the field, Foundations and Trends in Computer Graphics and Vision, 201

Evaluating advanced search interfaces using established information-seeking model

When users have poorly defined or complex goals search interfaces offering only keyword searching facilities provide inadequate support to help them reach their information-seeking objectives. The emergence of interfaces with more advanced capabilities such as faceted browsing and result clustering can go some way to some way toward addressing such problems. The evaluation of these interfaces, however, is challenging since they generally offer diverse and versatile search environments that introduce overwhelming amounts of independent variables to user studies; choosing the interface object as the only independent variable in a study would reveal very little about why one design out-performs another. Nonetheless if we could effectively compare these interfaces we would have a way to determine which was best for a given scenario and begin to learn why. In this article we present a formative framework for the evaluation of advanced search interfaces through the quantification of the strengths and weaknesses of the interfaces in supporting user tactics and varying user conditions. This framework combines established models of users, user needs, and user behaviours to achieve this. The framework is applied to evaluate three search interfaces and demonstrates the potential value of this approach to interactive IR evaluation

A Nine Month Report on Progress Towards a Framework for Evaluating Advanced Search Interfaces considering Information Retrieval and Human Computer Interaction

This is a nine month progress report detailing my research into supporting users in their search for information, where the questions, results or even thei

Volumetric shape making and pattern cutting

This paper, in light of pedagogical observations, seeks to explore and examine an alternative approach to pattern cutting through volumetric shape making and a practical, process led investigation using Alien body shapes as a teaching resource. The holistic fashion designer explores and engages with both silhouette and pattern cutting, by developing the skills of volumetric shape making. The process of pattern cutting and volumetric shape making is an iterative translation between two dimensions and three dimensions which requires a practical, experimental approach. A sequential series of interactive workshops have been developed using irregular shaped mannequins to facilitate and develop this process, promoting creative outcomes and a deeper understanding of pattern cutting. This hands on improvisational approach without a known outcome allows for design to progress organically. The above process of thinking, “drawing” and pattern cutting in three dimensions can be extremely challenging and alien to fashion students who often have a pattern cutting foundation based on technical drawings and drafting principles mostly in a two dimensional format. The aim is to explore whether a synaptic link created between hand, eye and mind through an algorithm, can assist the holistic fashion designer and enhance creativity. The vehicle of delivery for this investigation is a series of experimental workshops undertaken by all three levels of BA (Hons) Fashion Design students at Sheffield Hallam University. This dynamic working method challenges conventional teaching methods of demonstration, books and handouts and promotes enjoyment of the journey, thus reducing preconceived ideals, allowing more scope for spontaneous outcomes. Student workshops also explore morphology as a challenge to the traditional western convention of body contouring through flat pattern cutting. Morphology is explored through a series of irregular shaped, non-humanoid forms: Alien Bodies. Full-scale Alien Body mannequins are provided as a resource in the workshop on which to apply the method of direct working in three dimensions to generate an initial pattern. Reflection, analysis and discussion of the pattern shape when transformed back to the flat plane, aims to promote comprehension and underpin the holistic designing/pattern cutting approach. “Alien Body - Pushing Pattern Parameters” workshops culminated in an exhibition at the Sheffield Institute of Arts Gallery where a selection of 18 garments and their flat patterns, all created by students during the previous six month period, were displayed. This paper evaluates data captured and draws on anecdotal evidence gathered from students attending these workshops as well as looks at the methodologies used including process led investigation and peer review within the university environment. It forms a cornerstone for further questioning of whether the fashion designer and pattern cutter is the same person