Identifying Inexpensive Off-the-Shelf Laser Pointers for Multi-User Interaction on Large Scale Displays

We present a method for identifying inexpensive, off-the-shelf laser pointers in a multiuser interaction environment on large-scale displays. We identify a laser pointer\u27s personality, a measure of its output in a particular context. Our method requires a set of inexpensive and unmodified green lasers, a large screen, a projector, and a camera with an infrared (IR) filter. The camera detects the IR spillover from the green laser beam, while ignoring color information projected onto the screen. During a calibration phase, a radial histogram of each laser\u27s IR spillover are used to represent the laser\u27s personality. Our system is able to identify the spots of a specific laser, allowing multiple users to simultaneously interact in the environment. In addition, we present a series of applications that take advantage of tracked and identified laser pointers to demonstrate large-scale, multiuser interactions

WEBCAM-BASED LASER DOT DETECTION TECHNIQUE IN COMPUTER REMOTE CONTROL

ABSTRACTIn this paper, the authors propose a method to detect the laser dot in an interactive system using laser pointers. The method is designed for presenters who need to interact with the computer during the presentation by using the laserpointer. The detection technique is developed by using a camera to capture the presentation screen and processing every frames transferred to the ara computer. This paper focuses on the detection and tracking of laser dots, based on their characteristics to distinguish a laser dotfrom other areas on the captured frames. Experimental results showed that the proposed method could reduce the rate of misdetection by light noises of a factor of 10 and achieve an average accuracy of 82% of detection in normal presentation environments. The results point out that the better way to describe the laser dots’ features based on visual concept is to use the HSI color space instead of the normal RGB space.Keywords.  laser pointer; laser dot/spot; laser pointer interaction; control; mouse; computer screen/display

3D pointing toolkit

Der Mensch verbringt einen großen Teil seines Lebens in seinem zu Hause und die sogenannten "Smart Homes" von heute werden immer intelligenter. Deshalb besteht Bedarf nach neuen Interaktions- und Feedbackmöglichkeiten für elektronische Geräte, die in unsere modernen Haushalte integriert sind. Mit jedem neuen Feature, das dem Anwender geboten wird, muss nämlich erforscht werden, wie der Mensch auf gewisse Feedbacks reagiert und wie gut er mit neuen Interaktionstechniken umgehen kann. Um Daten über einen Anwender, seine Bewegungen und Aktionen sammeln zu können, werden häufig Trackingsysteme eingesetzt. Diese wiederum benötigen Softwarelösungen, die die gesammelten Daten auswerten und in sinnvoller Form an andere Anwendungen weitergeben. Eine solche Softwarelösung ist das in dieser Bachelorarbeit vorgestellte Toolkit, das präzise Positions- und Orientierungsdaten eines optischen Trackingsystems verarbeiten und an andere Anwendungen weitergeben soll. Mit den verarbeiteten Daten ist es dann möglich eine große Bandbreite von Studien durchzuführen. Das Toolkit kann mit Hilfe der vom Trackingsystem gelieferten Daten Zeigegesten des Anwenders im dreidimensionalen Raum erkennen und damit Schnittberechnungen mit virtuellen Objekten durchführen. Die genannten Objekte wurden zuvor im virtuellen 3D-Raum des Toolkits modelliert. Das Toolkit ist durch seinen integrierten Editor sehr flexibel, da die virtuelle Umgebung an alle realen Gegebenheiten angepasst werden kann.An average person spends most of his time at his beloved home and our so-called "smart homes" are constantly getting more intelligent. That's the reason why new interaction possibilities and feedbacks are needed for electronic devices that are integrated in our "smart homes". Each feature that is added to our homes, demands for research that can tell how the user reacts to certain feedbacks and whether he can deal with new interaction techniques or not. Tracking systems are often used for research purposes, to collect data about the movements and actions of a user. These systems themselves need software solutions, that analyze the collected data and visualize them in a manner that allows other applications to process them. One of these software solutions is presented in this bachelor's thesis. It's a toolkit that can collect and analyze precise data from an optical tracking system about the position and orientation of an object. The processed data are provided to other applications, so that many different studies can the performed. The toolkit is able to detect pointing gestures of the user and to calculate intersections between the pointing direction and virtual objects, that were modeled in the virtual 3D space of the toolkit. It also offers an editor that makes it possible to modify the virtual objects so that they are similar to the objects of the real environment

Sparks: interação humano-computador com base num apontador laser

Este projeto de mestrado contextualiza e descreve a criação de uma framework de interação humano-computador que utiliza um apontador laser como dispositivo de entrada. Perante o desafio identificado, e considerando as restrições impostas com o surgimento da pandemia COVID-19, a proposta assenta na utilização de um apontador laser para possibilitar uma interação contactless. Embora as preocupações com o contágio e propagação tenham estado presentes na elaboração desta abordagem, em verdade, a sua validade e utilidade não se esgota com o fim da pandemia. Pelo contrário, esta abordagem à interatividade humano-computador pode ser um elemento distintivo. Assim, existe a necessidade de estudar um método que possibilite a interação com uma tela projetada, criando uma alternativa inovadora e lúdica que promova maior interatividade com as aplicações web. Perante o desafio identificado, iremos começar por realizar uma introdução à temática, metodologia e contextualização com o caso de estudo. De seguida, serão apresentados os principais conceitos de processamento de imagens, juntamente com os avanços tecnológicos que existem na área de visão computacional. Posteriormente, será realizado uma análise e levantamento de requisitos para a seleção das melhores estratégias, seguido da proposta de uma solução integrada. O principal objetivo consiste em fornecer uma base para futuros estudos no campo da visão computacional, apresentando um protótipo que permita validar e demonstrar o potencial de um sistema particular ao qual designamos: Sparks.This project contextualizes and describes a human-computer interaction framework that uses a laser pointer as an input device. Given the identified challenge, and considering the restrictions imposed with the emergence of the COVID-19 pandemic, the proposal is based on a laser pointer to enable a contactless interaction. Although concerns about contagion and spread were present in the elaboration of this approach, in fact, its validity and usefulness do not end with the pandemic. On the contrary, this approach to human computer interactivity can be a distinctive element. Thus, it is necessary to study a method that enables interaction with a projected screen, creating an innovative and playful alternative that promotes greater interactivity with web applications. Looking at the identified challenge, we will start by performing an introduction, methodology and contextualization with the case study. The main concepts of image processing will be presented, along with the technological advances in the field of computer vision. Subsequently, an analysis and a survey of requirements will be carried out to select the best strategies, followed by the proposal of an integrated solution. The main objective is to provide a basis for future studies, presenting a prototype that allows us to validate and demonstrate the potential of a particular system that we designate: Sparks

Exploring The Impact Of Configuration And Mode Of Input On Group Dynamics In Computing

Objectives: Large displays and new technologies for interacting with computers offer a rich area for the development of new tools to facilitate collaborative concept mapping activities. In this thesis, WiiConcept is described as a tool designed to allow the use of multiple WiiRemotes for the collaborative creation of concept maps, with and without gestures. Subsequent investigation of participants' use of the system considers the effect of single and multiple input streams when using the software with and without gestures and the impact upon group concept mapping process outcomes and interactions when using a large display. Methods: Data is presented from an exploratory study of twenty two students who have used the tool. Half of the pairs used two WiiRemotes, while the remainder used one WiiRemote. All pairs created one map without gestures and one map with gestures. Data about their maps, interactions and responses to the tool were collected. Results: Analysis of coded transcripts indicates that one-controller afforded higher levels of interaction, with the use of gestures also increasing the number of interactions seen. Additionally, the result indicated that there were significantly more interactions of the 'shows solidarity', 'gives orientation', and 'gives opinion' categories (defined by the Bales' interaction processes assessment), when using one-controller as opposed to two. Furthermore, there were more interactions for the 'shows solidarity', 'tension release', 'gives orientation' and 'shows tension' categories when using gestures as opposed to the non-use of gestures. Additionally, there were no significant differences in the perceived dominance of individuals, as measured on the social dominance scales, for the amount of interaction displayed, however, there was a significant main effect of group conversational control score on the 'gives orientation' construct, with a higher number of interactions for low, mixed and high scores of this type when dyads had one-controller as opposed to two-controllers. There was also a significant interaction effect of group conversational control score on the 'shows solidarity' construct with a higher number of interactions for all scores of this type when dyads had one-controller as opposed to two-controllers. The results also indicate that for the WiiConcept there was no difference between number of controllers in the detail in the maps, and that all users found the tool to be useful for the collaborative creation of concept maps. At the same time, engaging in disagreement was related to the amount of nodes created with disagreement leading to more nodes being created. Conclusions: Use of one-controller afforded higher levels of interaction, with gestures also increasing the number of interactions seen. If a particular type of interaction is associated with more nodes, there might also be some argument for only using one-controller with gestures enabled to promote cognitive conflict within groups. All participants responded that the tool was relatively easy to use and engaging, which suggests that this tool could be integrated into collaborative concept mapping activities, allowing for greater collaborative knowledge building and sharing of knowledge, due to the increased levels of interaction for one-controller. As research has shown concept mapping can be useful for promoting the understanding of complex ideas, therefore the adoption of the WiiConcept tool as part of a small group learning activity may lead to deeper levels of understanding. Additionally, the use of gestures suggests that this mode of input does not affect the amount of words, nodes, and edges created in a concept map. Further research, over a longer period of time, may see improvement with this form of interaction, with increased mastery of gestural movement leading to greater detail of conceptual mapping