A tone driven offline information kiosk

In this paper we introduce the concept of a low-cost, offline information kiosk that is controlled through a sound-based interface. More specifically, we will describe how we use a mobile phone to control a kiosk by communicating DTMF phone tones. Our main use-case is deployment within developing countries where we intend to examine issues related to cross-cultural interface design

Small population face recognition for a kiosk interface

Thesis (M.Eng.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 1999.Includes bibliographical references (leaves 54-56).by Shantanu Kumar Sinha.M.Eng

Object Tracking and Mensuration in Surveillance Videos

This thesis focuses on tracking and mensuration in surveillance videos. The first part of the thesis discusses several object tracking approaches based on the different properties of tracking targets. For airborne videos, where the targets are usually small and with low resolutions, an approach of building motion models for foreground/background proposed in which the foreground target is simplified as a rigid object. For relatively high resolution targets, the non-rigid models are applied. An active contour-based algorithm has been introduced. The algorithm is based on decomposing the tracking into three parts: estimate the affine transform parameters between successive frames using particle filters; detect the contour deformation using a probabilistic deformation map, and regulate the deformation by projecting the updated model onto a trained shape subspace. The active appearance Markov chain (AAMC). It integrates a statistical model of shape, appearance and motion. In the AAMC model, a Markov chain represents the switching of motion phases (poses), and several pairwise active appearance model (P-AAM) components characterize the shape, appearance and motion information for different motion phases. The second part of the thesis covers video mensuration, in which we have proposed a heightmeasuring algorithm with less human supervision, more flexibility and improved robustness. From videos acquired by an uncalibrated stationary camera, we first recover the vanishing line and the vertical point of the scene. We then apply a single view mensuration algorithm to each of the frames to obtain height measurements. Finally, using the LMedS as the cost function and the Robbins-Monro stochastic approximation (RMSA) technique to obtain the optimal estimate

Bayesian Model Based Tracking with Application to Cell Segmentation and Tracking

The goal of this research is to develop a model-based tracking framework with biomedical imaging applications. This is an interdisciplinary area of research with interests in machine vision, image processing, and biology. This thesis presents methods of image modeling, tracking, and data association applied to problems in multi-cellular image analysis, especially hematopoietic stem cell (HSC) images at the current stage. The focus of this research is on the development of a robust image analysis interface capable of detecting, locating, and tracking individual hematopoietic stem cells (HSCs), which proliferate and differentiate to different blood cell types continuously during their lifetime, and are of substantial interest in gene therapy, cancer, and stem-cell research. Such a system can be potentially employed in the future to track different groups of HSCs extracted from bone marrow and recognize the best candidates based on some biomedical-biological criteria. Selected candidates can further be used for bone marrow transplantation (BMT) which is a medical procedure for the treatment of various incurable diseases such as leukemia, lymphomas, aplastic anemia, immune deficiency disorders, multiple myeloma and some solid tumors. Tracking HSCs over time is a localization-based tracking problem which is one of the most challenging tracking problems to be solved. The proposed cell tracking system consists of three inter-related stages: i) Cell detection/localization, ii) The association of detected cells, iii) Background estimation/subtraction. that will be discussed in detail

An interaction abstraction toolkit for public display applications

Tese de doutoramento em Tecnologias e Sistemas de InformaçãoPublic digital displays have become increasingly ubiquitous in our technological landscape. Considering their flexibility and communication potential, public displays can become an important communication channel and even reach the attention, usage, and relevance that smartphones have today. Interaction with public displays is recognised as a key element in making them more engaging and valuable, but most public display systems still do not support any interactive feature. A key reason behind this apparent paradox is the lack of efficient and clear abstractions for incorporating interactivity into public display applications. While interaction can be achieved for a specific display system with a particular interaction modality, the lack of proper interaction abstractions means that there is too much specific work that needs to be done outside the core application functionality to support even basic forms of interaction. In this work, we investigate and develop interaction abstractions for public displays. We start by analysing public displays from the point of view of the information that results from the various interactions and that can be used to drive several types of content adaptation behaviour on public displays. We call this information digital footprints, and the result is a framework that maps digital footprints to adaptation strategies and to interaction mechanisms. This framework can be used by display designers to help them choose the interaction mechanisms that a display should support in order to be able to collect a given set of footprints, creating more relevant displays that are able to automatically adapt to their environment. We then identify and characterise interaction tasks and controls that are appropriate for public display interaction. This analysis results in a design space that can form the foundation of interaction toolkits, giving system developers with a reference for the types of high-level tasks and controls that can be incorporated into a toolkit. Finally, we design, implement, and evaluate a software toolkit of interaction abstractions for public display applications – the PuReWidgets toolkit. Programmers can use this toolkit to easily incorporate interactive features into their web-based public display applications. PuReWidgets provides high-level abstractions that shield programmers from the low-level details of the interaction mechanisms. We evaluate this toolkit along various dimensions. First, we evaluate the system’s performance. We then evaluate the API’s flexibility and capabilities using our own experience in developing interactive applications with it. We also evaluate the API’s usability from the perspective of independent programmers. Finally, we provide an evaluation of the resulting system’s usability from the perspective of an end-user interacting with a real-world deployment of a public display. The evaluation results indicate that PuReWidgets is an efficient, usable, and flexible toolkit for web-based interactive public display applications. By making this toolkit publicly available, we hope to promote the development of more and newer kinds of interactive public display applications inside and, more importantly, outside the research community.Os ecrãs públicos digitais estão cada vez mais presentes na nossa paisagem tecnológica. Considerando a sua flexibilidade e capacidade de ligação em rede, os ecrãs públicos têm o potencial para se tornarem num importante canal de comunicação e talvez até atingir a atenção, utilização e relevância que os smartphones têm hoje em dia. A interactividade dos ecrãs públicos ´e reconhecida como um elemento chave para os tornar mais atractivos e valiosos, mas a maioria dos sistemas de ecrãs públicos actuais ainda não suporta nenhuma forma de interação. Uma razão por detrás deste aparente paradoxo é a falta de abstrações claras e eficientes para incorporar interactividade nas aplicações para ecrãs públicos. Apesar de a interação poder ser conseguida para sistemas específicos, com uma modalidade de interação específica, a falta de abstrações de interação apropriadas significa que ´e necessário demasiado trabalho específico fora das funcionalidades nucleares da aplicação para suportar ate as formas mais básicas de interação. Neste trabalho, investigamos e desenvolvemos abstrações de interação para ecrãs públicos. Começamos por analisar os ecrãs públicos do ponto de vista da informação que resulta das interações e de que forma pode ser utilizada em procedimentos de adaptação de conteúdo para ecrãs públicos. Chamamos a esta informação digital footprints, e o resultado é uma estrutura conceptual que mapeia as digital footprints em estratégias de adaptação e em mecanismos de interação. Esta estrutura pode ser utilizada por designers de ecrãs públicos para ajudar a escolher os mecanismos de interação que um determinado ecrã deve suportar de forma a poder recolher um determinado conjunto de digital footprints, criando assim ecrãs com conteúdos mais relevantes e que são capazes de se adaptar ao seu ambiente social. De seguida, identificamos e caracterizamos tarefas de interação e controlos apropriados para interação com ecrãs públicos. Esta análise resulta num espaço de desenho que pode servir de base para toolkits de interação, dando uma referência aos designers do sistema para os tipos de controlos que podem ser incorporados no toolkit. Finalmente, projectamos, implementamos e avaliamos um toolkit de abstrações de interação para aplicações para ecrãs públicos – o toolkit PuReWidgets. Os programadores podem utilizar este toolkit para incorporar facilmente funcionalidades interactivas nas suas aplicações, baseadas na web, para ecrãs públicos. O PuReWidgets fornece abstrações de alto nível que protegem os programadores dos detalhes de baixo nível associados aos mecanismos de interação. O toolkit é avaliado segundo várias dimensões. Primeiro, avaliamos o desempenho do sistema. De seguida, avaliamos a flexibilidade e capacidades da API, usando a nossa própria experiencia no desenvolvimento de aplicações interactivas. Avaliamos também a usabilidade da API da perspectiva de programadores independentes. Finalmente, avaliamos o toolkit da perspectiva dos utilizadores que interagem com um ecrã público num ambiente real. Os resultados da avaliação indicam que o PuReWidgets é um toolkit eficiente, flexível e usável para aplicações interactivas para ecrãs públicos. Ao tornar este toolkit disponível publicamente, esperamos promover o desenvolvimento de mais aplicações interactivas para ecrãs públicos dentro e, mais importante, fora da comunidade de investigação.This research was supported by the Funda¸c˜ao para a Ciˆencia e Tecnologia (FCT) PhD training grant SFRH/BD/47354/2008. This research has also received funding from the European Union Seventh Framework Programme (FP7/2007-2013) under grant agreement no. 244011 (PD-Net)

Sustainable kiosk development utilising culturally adaptive user interfaces and a novel interaction method

Information kiosks are an important tool for delivering the benefits of information technol- ogy across cultures, particularly in the developing world. Despite kiosk initiatives being launched to help the poor in developing countries, in reality the poorest members of these communities are rarely able to gain access to kiosks as owner operators are entrepre- neurs that face a trade-off between the business viability of providing access to information kiosks and serving the poor. Compounding this issue of restricted kiosk access is the fact that websites are often localised unsuccessfully thereby excluding users from mixed cul- tural backgrounds, or worse still, not localised at all due to prohibitive schedules and mon- etary constraints. This thesis describes a culturally adaptive sustainable information kiosk that has been designed to be adaptable to local cultures and environments in order to de- mocratise the dissemination of information by making it universally consumable. This adaptability presents itself not only in the form of an automatically reconfigurable on- screen user interface but also in the form of physical multi modal interactions (‘gestures’). This study placed importance on investigating non-traditional forms of input methods due to the fact that the familiarity, in the western world, with traditional input methods such as a keyboard and mouse, and even the Windows Icons Menus Pointers (WIMP) paradigm as a whole, is not a trait necessarily shared with other cultures around the world

Vision for a Smart Kiosk

We describe a novel computer vision application: visionbased human sensing for a Smart Kiosk interface. A Smart Kiosk is a free-standing information dispensing computer appliance capable of engaging in public interactions with multiple people. Vision sensing is a critical component of the kiosk interface, where it is used to determine the context for the interaction. We present a taxonomy of vision problems for a kiosk interface and describe a prototype kiosk which uses color stereo tracking and graphical output to interact with several users. 1