Tangible user interfaces : past, present and future directions

In the last two decades, Tangible User Interfaces (TUIs) have emerged as a new interface type that interlinks the digital and physical worlds. Drawing upon users' knowledge and skills of interaction with the real non-digital world, TUIs show a potential to enhance the way in which people interact with and leverage digital information. However, TUI research is still in its infancy and extensive research is required in or- der to fully understand the implications of tangible user interfaces, to develop technologies that further bridge the digital and the physical, and to guide TUI design with empirical knowledge. This paper examines the existing body of work on Tangible User In- terfaces. We start by sketching the history of tangible user interfaces, examining the intellectual origins of this field. We then present TUIs in a broader context, survey application domains, and review frame- works and taxonomies. We also discuss conceptual foundations of TUIs including perspectives from cognitive sciences, phycology, and philoso- phy. Methods and technologies for designing, building, and evaluating TUIs are also addressed. Finally, we discuss the strengths and limita- tions of TUIs and chart directions for future research

Indutivo: Contact-Based, Object-Driven Interactions with Inductive Sensing

We present Indutivo, a contact-based inductive sensing technique for contextual interactions. Our technique recognizes conductive objects (metallic primarily) that are commonly found in households and daily environments, as well as their individual movements when placed against the sensor. These movements include sliding, hinging, and rotation. We describe our sensing principle and how we designed the size, shape, and layout of our sensor coils to optimize sensitivity, sensing range, recognition and tracking accuracy. Through several studies, we also demonstrated the performance of our proposed sensing technique in environments with varying levels of noise and interference conditions. We conclude by presenting demo applications on a smartwatch, as well as insights and lessons we learned from our experience

Capacitive Sensing and Communication for Ubiquitous Interaction and Environmental Perception

During the last decade, the functionalities of electronic devices within a living environment constantly increased. Besides the personal computer, now tablet PCs, smart household appliances, and smartwatches enriched the technology landscape. The trend towards an ever-growing number of computing systems has resulted in many highly heterogeneous human-machine interfaces. Users are forced to adapt to technology instead of having the technology adapt to them. Gathering context information about the user is a key factor for improving the interaction experience. Emerging wearable devices show the benefits of sophisticated sensors which make interaction more efficient, natural, and enjoyable. However, many technologies still lack of these desirable properties, motivating me to work towards new ways of sensing a user's actions and thus enriching the context. In my dissertation I follow a human-centric approach which ranges from sensing hand movements to recognizing whole-body interactions with objects. This goal can be approached with a vast variety of novel and existing sensing approaches. I focused on perceiving the environment with quasi-electrostatic fields by making use of capacitive coupling between devices and objects. Following this approach, it is possible to implement interfaces that are able to recognize gestures, body movements and manipulations of the environment at typical distances up to 50cm. These sensors usually have a limited resolution and can be sensitive to other conductive objects or electrical devices that affect electric fields. The technique allows for designing very energy-efficient and high-speed sensors that can be deployed unobtrusively underneath any kind of non-conductive surface. Compared to other sensing techniques, exploiting capacitive coupling also has a low impact on a user's perceived privacy. In this work, I also aim at enhancing the interaction experience with new perceptional capabilities based on capacitive coupling. I follow a bottom-up methodology and begin by presenting two low-level approaches for environmental perception. In order to perceive a user in detail, I present a rapid prototyping toolkit for capacitive proximity sensing. The prototyping toolkit shows significant advancements in terms of temporal and spatial resolution. Due to some limitations, namely the inability to determine the identity and fine-grained manipulations of objects, I contribute a generic method for communications based on capacitive coupling. The method allows for designing highly interactive systems that can exchange information through air and the human body. I furthermore show how human body parts can be recognized from capacitive proximity sensors. The method is able to extract multiple object parameters and track body parts in real-time. I conclude my thesis with contributions in the domain of context-aware devices and explicit gesture-recognition systems

On the Effectiveness of Ambient Sensing for Detecting NFC Relay Attacks

Smartphones with Near-Field Communication (NFC) may emulate contactless smart cards, which has resulted in the deployment of various access control, transportation and payment services, such as Google Pay and Apple Pay. Like contactless cards, however, NFC-based smartphone transactions are susceptible to relay attacks, and ambient sensing has been suggested as a potential countermeasure. In this study, we empirically evaluate the suitability of ambient sensors as a proximity detection mechanism for smartphone-based transactions under EMV constraints. We underpin our study using sensing data collected from 17 sensors from an emulated relay attack test-bed to assess whether they can thwart such attacks effectively. Each sensor, where feasible, was used to record 350-400 legitimate and relay (illegitimate) contactless transactions at two different physical locations. Our analysis provides an empirical foundation upon which to determine the efficacy of ambient sensing for providing a strong anti-relay mechanism in security-sensitive applications. We demonstrate that no single, evaluated mobile ambient sensor is suitable for such critical applications under realistic deployment constraints

Performance assessment for mountain bike based on WSN and Cloud Technologies

The mountain bike is one of the most used equipment’s in outdoor sports activities. The thesis describes the design and all development and implementation of Performance Assessment for Mountain Bike based on Wireless Sensor Network (WSN) and Cloud Technologies. The work presents a distributed sensing system for cycling assessment-providing data for objective evaluation of the athlete performance during training. Thus a wireless sensor network attached to the sport equipment provides to the athlete and the coach with performance values during practice. The sensors placed in biker equipment’s behave as nodes of a WSN. This is possible with the developing of IoT-based systems in sports, the tracking and monitoring of athletes in their activities has an important role on his formation as bikers and helps to increase performance, through the analyze of each session. The implemented system performs acquisition, processing and transmission, of data using a ZigBee wireless networks that provide also machine-to-machine communication and data storage in a server located in the cloud. As in many cycling applications use the phone as a module to get the values, this work will be a little different making use of phone/tablet to consult information. The information stored on the cloud server is accessed through a mobile application that analyses and correlates all metrics calculated using the training data obtained during practice. Additional information regarding the health status may be also considered. Therefore, the system permits that athletes perform an unlimited number of trainings that can be accessed at any time through the mobile application by the bikers and coach. Based on capability of the system to save a history of the evolution of each athlete during training the system permits to perform appropriate comparisons between different training sessions and different athlete’s performances.A bicicleta de montanha é um dos equipamentos para desportos no exterior mais usada. A tese descreve todo o desenho, desenvolvimento e implementação de Performance Assessment for Mountain Bike based on WSN and Cloud Technologies. Este apresenta um sistema de deteção distribuída para o aumento do desempenho, melhorar a metodologia da prática do ciclismo e para formação de atletas. Para tal foi desenvolvida e anexada uma rede de sensores que está embutida no equipamento do ciclista, através desta rede de sensores sem fios são obtidos os valores respetivos à interação do utilizador e a sua bicicleta, sendo estes apresentados ao treinador e ao próprio ciclista. Os sensores colocados comportam-se como nós de uma rede de sensores sem fios. Isso é possível com o desenvolvimento de sistemas baseados na Internet das coisas no desporto, a observação da movimentação e monitoramento de atletas nas suas atividades tem um papel importante na sua formação como ciclistas e ajuda a aumentar o desempenho. O sistema é baseado numa rede ZigBee sem fios, que permite a comunicação máquina-para-máquina e o armazenamento de dados num servidor localizado na nuvem. Toda a informação na nuvem pode ser acedida através de uma aplicação mobile que analisa e correlaciona todos os valores calculados usando os dados recolhidos durante o treino efetuado por cada ciclista. Como em muitas aplicações de ciclismo estas usam o telefone como um módulo para obter os valores, neste trabalho o caso é diferente fazendo o uso do telefone/tablet para apenas consultar as informações. Alguma informação sobre o ciclista é fornecida para poder efetuar alguns cálculos, relativos à saúde do ciclista, neste caso toda a energia gasta na prática de um determinado treino. Toda esta informação pode ser acedida através de uma aplicação Android e por consequência num dispositivo Android. Com a aplicação desenvolvida é possível observar e processar toda a informação recolhida através dos sensores implementados, a observação dos dados recolhidos pode ser efetuada pelo treinador responsável, como pelo próprio atleta. Portanto, o sistema permite a realização de um ilimitado número de sessões de treino, estes podem ser consultados a qualquer momento através da aplicação móvel. Fazendo com que seja possível manter um histórico da evolução de cada atleta, podendo assim observar e comparar cada sessão de treino, realizada por cada atleta

Ubiquitous computing and natural interfaces for environmental information

Dissertação apresentada na Faculdade de Ciências e Tecnologia da Universidade Nova de Lisboa para obtenção do Grau de Mestre em Engenharia do Ambiente, perfil Gestão e Sistemas AmbientaisThe next computing revolution‘s objective is to embed every street, building, room and object with computational power. Ubiquitous computing (ubicomp) will allow every object to receive and transmit information, sense its surroundings and act accordingly, be located from anywhere in the world, connect every person. Everyone will have the possibility to access information, despite their age, computer knowledge, literacy or physical impairment. It will impact the world in a profound way, empowering mankind, improving the environment, but will also create new challenges that our society, economy, health and global environment will have to overcome. Negative impacts have to be identified and dealt with in advance. Despite these concerns, environmental studies have been mostly absent from discussions on the new paradigm. This thesis seeks to examine ubiquitous computing, its technological emergence, raise awareness towards future impacts and explore the design of new interfaces and rich interaction modes. Environmental information is approached as an area which may greatly benefit from ubicomp as a way to gather, treat and disseminate it, simultaneously complying with the Aarhus convention. In an educational context, new media are poised to revolutionize the way we perceive, learn and interact with environmental information. cUbiq is presented as a natural interface to access that information