Presence in blended spaces

Mixed reality technologies have been around for over ten years but it is only with the proliferation of smart phones and tablet (computers) that mixed and augmented reality interaction is reaching the mass market. There are now enough examples of mixed reality interactions that we can begin to abstract principles of design and principles of user experience (UX) for these new spaces of interaction. In this paper I develop the notion of mixed reality as a blendedspace. Mixed reality is a blend of a physical space and a digital space. The term ‘blend’ here is borrowed from blending theory which is a theory of cognition that highlights the importance of cross domain mappings and conceptual integration to our thought process that are grounded in physically-based spatial schemas. The concept of a blendedspace is developed by recognizing that physical space and digital space can both be described in terms of the objects and agents who inhabit the space, the structure of the objects’ relationships (the topology of the space) and the changes that take place in the space (the volatility, or dynamics of the space). The blendedspace will be more effective if the physical and digital spaces have some recognizable and understandable correspondences. The issue of presence in this blendedspace is then discussed and it is suggested that traditional definitions of presence are inadequate to describe the experiences that blendedspaces offer. Presence is considered as interaction between the self and the content of the medium within which the self exists, and place is this medium. Blendedspaces mean that people have an extended presence; from their physical location into digital worlds

Can Touch Interaction Predict Product-Related Emotion? A Study on Mobile Augmented Reality

The advancement in immersive technologies provides online retailers the opportunity to integrate augmented reality (AR) experience for their customers. Using AR, the online product presentation is transformed from the pictorial representation to virtual interaction with the products. The virtual product interaction facilitates online retailers to detect product-related emotion through affective computing. For mobile AR, customers use touch gestures for virtual interaction. Using the theories related to immersive media and affective computing, we hypothesize that the touch movements and touch pressure in AR-based mobile applications are related to positive emotion during product interaction. Moreover, we describe a methodology to establish our hypotheses and to show that these variables can predict the product-related emotion. We expect our research findings to have both theoretical and practical implications. It will explain why touch behavior can predict product-related emotion, and it will also demonstrate online retailers how to implement emotion analytics in AR shopping applications

An Analytical Framework for Designing Future Hybrid Creative Learning Spaces: A Pattern Approach

Existing frameworks which serve as reference for the design of creative space in educational institutions and organizations, have shown some limitations. On one hand, current spatial design theories concerned with hybrid spaces and digital technologies are limited; on the other hand, the analysis of digital technologies’ influence on spaces conducted in Information System and Computer Science research fields rarely uses a spatial theory as a foundation [1]. The aim of this ongoing research is to develop an analytical framework that integrates creative space types and a blended space model in support of the design of future hybrid creative environments (FHCS framework). The current findings have shown that many different social-spatial design solutions exist in both physical and digital spaces, and which are systematically organized as a pattern language. Identified pattern candidates are from specific application domains (e.g., spatial design, HCI Design, E-learning, and game design), and they capture and represent design knowledge of experts. Therefore, the pattern language from Christopher Alexander et al. [2] seems an appropriate approach to bring together design guidance and tools from different disciplines, in a vocabulary that can be shared across disciplines. Through a pattern mining process, various pattern frameworks and many pattern candidates that are related to the design of hybrid creative learning spaces have emerged from the analysis. As a result, 323 patterns are derived from four disciplines, and 13 generic pattern clusters have evolved in relation to the hybrid design themes

Accessibility and tangible interaction in distributed workspaces based on multi-touch surfaces

[EN] Traditional interaction mechanisms in distributed digital spaces often fail to consider the intrinsic properties of action, perception, and communication among workgroups, which may affect access to the common resources used to mutually organize information. By developing suitable spatial geometries and natural interaction mechanisms, distributed spaces can become blended where the physical and virtual boundaries of local and remote spaces merge together to provide the illusion of a single unified space. In this paper, we discuss the importance of blended interaction in distributed spaces and the particular challenges faced when designing accessible technology. We illustrate this discussion through a new tangible interaction mechanism for collaborative spaces based on tabletop system technology implemented with optical frames. Our tangible elements facilitate the exchange of digital information in distributed collaborative settings by providing a physical manifestation of common digital operations. The tangibles are designed as passive elements that do not require the use of any additional hardware or external power while maintaining a high degree of accuracy.This work was supported by the Spanish Ministry of Economy and Competitiveness and the European Regional Development Fund, through the ANNOTA Project (Ref. TIN2013-46036-C3-1-R).Salvador-Herranz, G.; Camba, J.; Contero, M.; Naya Sanchis, F. (2018). Accessibility and tangible interaction in distributed workspaces based on multi-touch surfaces. Universal Access in the Information Society. 17(2):247-256. https://doi.org/10.1007/s10209-017-0563-7S247256172Arkin, E.M., Chew, L.P., Huttenlocher, D.P., Kedem, K., Mitchell, J.S.B.: An efficiently computable metric for comparing polygonal shapes. IEEE Trans. Acoust. Speech Signal Process. 13(3), 209–216 (1991)Benyon, D.: Presence in blended spaces. Interact. Comput. 24(4), 219–226 (2012)Bhalla, M.R., Bhalla, A.V.: Comparative study of various touchscreen technologies. Int. J. Comput. Appl. 6(8), 12–18 (2010)Bradski, G., Kaehler, A.: Learning OpenCV: Computer Vision with the OpenCV Library. O’Reilly Media Inc., Newton (2008)Candela, E.S., Pérez, M.O., Romero, C.M., López, D.C.P., Herranz, G.S., Contero, M., Raya, M.A.: Humantop: a multi-object tracking tabletop. Multimed. Tools Appl. 70(3), 1837–1868 (2014)Cohen, J., Withgott, M., Piernot, P.: Logjam: a tangible multi-person interface for video logging. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 128–135. ACM (1999)Couture, N., Rivière, G., Reuter, P.: Geotui: a tangible user interface for geoscience. In: Proceedings of the 2nd International Conference on Tangible and Embedded Interaction, pp. 89–96. ACM (2008)de la Guía, E., Lozano, M.D., Penichet, V.R.: Cognitive rehabilitation based on collaborative and tangible computer games. In: 2013 7th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth), pp. 389–392. IEEE (2013)Dietz, P., Leigh, D.: Diamondtouch: a multi-user touch technology. In: Proceedings of the 14th Annual ACM Symposium on User Interface Software and Technology, pp. 219–226. ACM (2001)Falcão, T.P., Price, S.: What have you done! the role of ‘interference’ in tangible environments for supporting collaborative learning. In: Proceedings of the 9th International Conference on Computer Supported Collaborative Learning-Volume 1, pp. 325–334. International Society of the Learning Sciences (2009)Fallman, D.: Wear, point and tilt. In: Proceedings of the Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques, pp. 293–302. ACM Press (2002)Fishkin, K.P., Gujar, A., Harrison, B.L., Moran, T.P., Want, R.: Embodied user interfaces for really direct manipulation. Commun. ACM 43(9), 74–80 (2000)Fitzmaurice, G.W., Buxton, W.: An empirical evaluation of graspable user interfaces: towards specialized, space-multiplexed input. In: Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems, pp. 43–50. ACM (1997)Fitzmaurice, G.W., Ishii, H., Buxton, W.A.: Bricks: laying the foundations for graspable user interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 442–449. ACM Press (1995)Graham, R.L., Yao, F.F.: Finding the convex hull of a simple polygon. J. Algorithms 4(4), 324–331 (1983)Hartigan, J.A., Wong, M.A.: Algorithm as 136: a k-means clustering algorithm. J. R. Stat. Soc.: Ser. C (Appl. Stat.) 28(1), 100–108 (1979)Higgins, S.E., Mercier, E., Burd, E., Hatch, A.: Multi-touch tables and the relationship with collaborative classroom pedagogies: a synthetic review. Int. J. Comput. Support. Collab. Learn. 6(4), 515–538 (2011)Hinckley, K., Pausch, R., Goble, J.C., Kassell, N.F.: Passive real-world interface props for neurosurgical visualization. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 452–458. ACM (1994)Hinske, S.: Determining the position and orientation of multi-tagged objects using RFID technology. In: 5th Annual IEEE International Conference on Pervasive Computing and Communications Workshops, 2007. PerCom Workshops’07, pp. 377–381. IEEE (2007)Hornecker, E.: A design theme for tangible interaction: embodied facilitation. In: ECSCW 2005, pp. 23–43. Springer (2005)Hoshi, K., Öhberg, F., Nyberg, A.: Designing blended reality space: conceptual foundations and applications. In: Proceedings of the 25th BCS Conference on Human–Computer Interaction, pp. 217–226. British Computer Society (2011)Ishii, H.: Tangible User Interfaces. CRC Press, Boca Raton (2007)Ishii, H., Ullmer, B.: Tangible bits: towards seamless interfaces between people, bits and atoms. In: Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems, pp. 234–241. ACM (1997)Jacob, R.J., Girouard, A., Hirshfield, L.M., Horn, M.S., Shaer, O., Solovey, E.T., Zigelbaum, J.: Reality-based interaction: a framework for post-wimp interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 201–210. ACM (2008)Jetter, H.C., Dachselt, R., Reiterer, H., Quigley, A., Benyon, D., Haller, M.: Blended Interaction: Envisioning Future Collaborative Interactive Spaces. ACM, New York (2013)Jin, X., Han, J.: Quality threshold clustering. In: Sammut, C., Webb, G.I. (eds.) Encyclopedia of Machine Learning, pp. 820–820. Springer, Boston, MA (2011)Jordà, S., Geiger, G., Alonso, M., Kaltenbrunner, M.: The reactable: exploring the synergy between live music performance and tabletop tangible interfaces. In: Proceedings of the 1st International Conference on Tangible and Embedded Interaction, pp. 139–146. ACM (2007)Kaltenbrunner, M., Bovermann, T., Bencina, R., Costanza, E.: Tuio: a protocol for table-top tangible user interfaces. In: Proceedings of the 6th International Workshop on Gesture in Human–Computer Interaction and Simulation, pp. 1–5 (2005)Kirk, D., Sellen, A., Taylor, S., Villar, N., Izadi, S.: Putting the physical into the digital: issues in designing hybrid interactive surfaces. In: Proceedings of the 23rd British HCI Group Annual Conference on People and Computers: Celebrating People and Technology, pp. 35–44. British Computer Society (2009)Marques, T., Nunes, F., Silva, P., Rodrigues, R.: Tangible interaction on tabletops for elderly people. In: International Conference on Entertainment Computing, pp. 440–443. Springer (2011)Müller, D.: Mixed reality systems. iJOE 5(S2), 10–11 (2009)Newton-Dunn, H., Nakano, H., Gibson, J.: Block jam: a tangible interface for interactive music. In: Proceedings of the 2003 Conference on New Interfaces for Musical Expression, pp. 170–177. National University of Singapore (2003)Patten, J., Recht, B., Ishii, H.: Audiopad: a tag-based interface for musical performance. In: Proceedings of the 2002 Conference on New Interfaces for Musical Expression, pp. 1–6. National University of Singapore (2002)Patten, J., Recht, B., Ishii, H.: Interaction techniques for musical performance with tabletop tangible interfaces. In: Proceedings of the 2006 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology, p. 27. ACM (2006)PQLabs: Inc. http://multitouch.com/ . Retrieved on 16 October 2016Ryokai, K., Marti, S., Ishii, H.: I/o brush: drawing with everyday objects as ink. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI’04, pp. 303–310. ACM, New York (2004). doi: 10.1145/985692.985731Salvador, G., Bañó, M., Contero, M., Camba, J.: Evaluation of a distributed collaborative workspace as a creativity tool in the context of design education. In: 2014 IEEE Frontiers in Education Conference (FIE) Proceedings, pp. 1–7. IEEE (2014)Salvador-Herranz, G., Contero, M., Camba, J.: Use of tangible marks with optical frame interactive surfaces in collaborative design scenarios based on blended spaces. In: International Conference on Cooperative Design, Visualization and Engineering, pp. 253–260. Springer (2014)Salvador-Herranz, G., Camba, J.D., Naya, F., Contero, M.: On the integration of tangible elements with multi-touch surfaces for the collaborative creation of concept maps. In: International Conference on Learning and Collaboration Technologies, pp. 177–186. Springer (2016)Schöning, J., Hook, J., Bartindale, T., Schmidt, D., Oliver, P., Echtler, F., Motamedi, N., Brandl, P., von Zadow, U.: Building interactive multi-touch surfaces. In: Müller-Tomfelde, C. (ed.) Tabletops-Horizontal Interactive Displays, pp. 27–49. Springer, London, UK (2010)Shaer, O., Hornecker, E.: Tangible user interfaces: past, present, and future directions. Found. Trends Hum. Comput. Interact. 3(1–2), 1–137 (2010)Shen, C., Everitt, K., Ryall, K.: Ubitable: Impromptu face-to-face collaboration on horizontal interactive surfaces. In: International Conference on Ubiquitous Computing, pp. 281–288. Springer (2003)Suzuki, H., Kato, H.: Algoblock: a tangible programming language, a tool for collaborative learning. In: Proceedings of 4th European Logo Conference, pp. 297–303 (1993)Suzuki, H., Kato, H.: Interaction-level support for collaborative learning: Algoblockan open programming language. In: The 1st International Conference on Computer Support for Collaborative Learning, pp. 349–355. L. Erlbaum Associates Inc. (1995)Terrenghi, L., Kirk, D., Richter, H., Krämer, S., Hilliges, O., Butz, A.: Physical handles at the interactive surface: exploring tangibility and its benefits. In: Proceedings of the Working Conference on Advanced Visual Interfaces, pp. 138–145. ACM (2008)Veltkamp, R.C.: Shape matching: similarity measures and algorithms. In: SMI 2001 International Conference on Shape Modeling and Applications, pp. 188–197. IEEE (2001)Weinberg, G., Gan, S.L.: The squeezables: Toward an expressive and interdependent multi-player musical instrument. Comput. Music J. 25(2), 37–45 (2001)Weiser, M.: Some computer science issues in ubiquitous computing. Commun. ACM 36(7), 75–84 (1993)Wilson, F.: The hand: how its use shapes the brain, language, and human culture. Vintage Series. Vintage Books (1998). https://books.google.es/books?id=l_Boy_-NkwUCZuckerman, O., Arida, S., Resnick, M.: Extending tangible interfaces for education: digital montessori-inspired manipulatives. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 859–868. ACM (2005

Designing for Experiences in Blended Reality Environments for People with Dementia

Blended Reality environments have the potential to provide scalable solutions that are affordable, adaptable and easily deployable to support people with dementia. Use of these technologies is associated with experience of presence which is an experience with technologically mediated perceptions that generates a feeling of being there and the illusion of non-mediation. Our study examines what constitutes an experience of presence for people with dementia when they interact with MRTs. An observational study with ten participants (MoCA = 18 to 23, Age = 63 to 88 years) played a game of Tangram on Osmo. Six of these participants also played Young Conker on HoloLens. The experiences of the participants in the digital space, the physical space, and their attention crossover between the two spaces were coded in Noldus Observer XT 14.1. The study found four main themes that have an impact on the experience of presence in PwD – correspondences, effortless access to physical and digital content, awareness of reality and emergence. Correspondences between physical and digital spaces require PwD to have constant information about the state and nature of physical and digital content. The transitions between physical and digital should be seamless. PwD demonstrated positive experiences with Osmo, an augmented Virtuality technology while their experience with HoloLens, augmented reality technology was negative. The factors impacting experience of presence were prominent in Osmo while they were mostly absent in HoloLens throughout the game play. The outcomes of this study have resulted in a set of recommendations and guidelines for designers to design correspondences for experience of presence. We are currently working on developing prototypes using these guidelines for evaluations with PwD.AGE-WEL

Mixing and Re-Purposing Realities

This paper discusses a mixed reality that intertwines two parallel spaces, a real and a virtual contemporary sculpture park. With the goal to create a game that motivated children to explore the park and engage with the artworks, we engaged with children as informants. We developed a cast of characters based on the children’s input that lived in the sculpture park. Using the characters as inspiration we created a three-act narrative, with the canonical trajectory provided as a sequential clues treasure hunt. The clues are integrated into character dialogue, with traversal and transitions reinforced through the narrative. Although the narrative and game were designed for a collaborative, multi-user, multi-device experience, the characters, narrative and experience were rapidly re-purposed for an individual game on a mobile phone. This re-purposing focused on the transitions, using dramatic narrative to reinforce and mask reality change. Our results are positive, children enjoyed the mixed reality experiences and are keen to engage in different realities. Re-purposing assets, such as characters and narratives as well as virtual spaces is effective, enabling rapid development of similar, yet very different mixed reality experiences

A survey of the trajectories conceptual framework: investigating theory use in HCI

We present a case study of how Human-Computer Interaction (HCI) theory is reused within the field. We analyze the HCI literature in order to reveal the impact of one particular theory, the trajectories framework that has been cited as an example of both contemporary HCI theory and a strong concept that sits between theory and design practice. Our analysis of 60 papers that seriously engaged with trajectories reveals the purposes that the framework served and which parts of it they used. We compare our findings to the originally stated goals of trajectories and to subsequent claims of its status as both theory and strong concept. The results shed new light on what we mean by theory in HCI, including its relationship to practice and to other disciplines

Revolutionary and evolutionary technology design processes in location-based interactions

Development and deployment of location based systems is a key consideration in the design of new mobile technologies. Critical to the design process is to understand and manage the expectations of stakeholders (including funders, research partners and end users) for these systems. In particular, the way in which expectations impact upon technology development choices between small-scale, 'high tech' innovations or larger scalable solutions. This paper describes the differences in a revolutionary design process (for 'high tech' prototypes or catwalk technologies) versus an evolutionary design process (for scalable or prêt-à-porter systems), as exemplified in two location-based mobile interaction case studies. One case study exemplifies a revolutionary design process and resultant system, and the other an evolutionary design process and system. The use of these case studies is a clear natural progression from the paper that first described the concept of 'catwalk technologies' (Adams et al, 2013), which itself drew upon research that used mobile devices for outdoor 'in the wild' locations. This paper presents a set list of fifteen heuristic guidelines based upon an analysis of these case studies. These heuristics present characteristics and key differences between the two types of design process. This paper provides a key reference point for researchers, developers and the academic community as a whole, when defining a project rationale for designing and developing technical systems. In addition, we refer to the role of the researcher/research team in terms of guiding and managing stakeholder and research team expectations and how this relates to the planning and deployment of catwalk or prêt-à-porter technologies. Lastly, we state how this research has vital implications for planning and enacting interventions and sequences of interactions with stakeholders and, crucially, in the planning of future research projects

Propiedades psicométricas de la escala de presencia en tecnologías ubicuas

Este estudo teve como objetivo o desenvolvimento de uma escala de presença nas tecnologias ubíquas. O processo de desenvolvimento do instrumento teve como etapas a escolha dos atributos comportamentais referentes ao objeto de estudo e à operacionalização do construto, a apresentação a três juízes, dois grupos focais e a uma aplicação piloto em uma amostra reduzida (n = 30) e por fim, uma aplicação com a 458 participantes. Foram realizadas análises de consistência interna, análise fatorial confirmatória e análise fatorial confirmatória multigrupo. A versão final da Escala de Presença em Tecnologias Ubíquas conta com 14 itens, agrupados em três fatores independentes (Autopresença, Presença Espacial e Presença Social), e apresenta um bom índice de consistência interna (alfa = 0,905) e um índice de ajuste aceitável (c2 = 116,83; gl = 74; p < 0,01; CFI = 0,99; RMSEA = 0,035; SRMR = 0,053), com parâmetros psicométricos equivalentes por gênero.This study aimed to develop a scale of presence in ubiquitous tech-nologies. The development process of the instrument had 4 stages: 1) the choice of behavioral attributes related to the object of study and the operation of the construct, 2) the presentation to three judges, two focus groups and a 3) pilot application in a reduced sample (n = 30) and 4) an application with 458 participants. In order to obtain validity and reliability evidences we performed internal consis-tency analyzes, confirmatory factor analysis and multigroup confirmatory factorial analysis. The final version of the Presence Scale in Ubiquitous Technologies has 14 items, grouped into three independent factors (Self-Presence, Spatial Presence and Social Presence), and has a good internal consistency index (alpha = 0.905) and an acceptable adjustment index (χ2 = 116.83, gl = 74, p <0.01, CFI = 0.99, RM-SEA = 0.035, SRMR = 0.053), with equivalent psychometric parameters by gender.Este estudio tuvo como objetivo el desarrollo de una escala de pre-sencia en las tecnologías ubicuas. El proceso de desarrollo del instrumento tuvo como etapas 1) la elección de los atributos comportamentales referentes al objeto de estudio y la operacionalización del constructo, 2) la presentación a tres jueces, dos grupos focales, 3) una aplicación piloto en una muestra reducida (n = 30), y por último, 4) una aplicación con 458 participantes. Se realizaron análisis de consistencia interna, análisis factorial confirmatorio y análisis factorial confirmatorio multigrupo. La versión final de la Escala de Presencia en Tecnologías Ubíquicas cuenta con 14 ítems, agrupados en tres factores independientes (Autopresencia, Presencia Espacial y Presencia Social), y presenta un buen índice de consistencia interna (alfa = 0,905) y un índice de ajuste aceptable (χ2 = 116,83; gl = 74; p < 0,01; CFI = 0,99; RMSEA = 0,035; SRMR = 0,053) con parámetros psicométricos equivalentes por género