Interaction techniques for mobile collocation

Research on mobile collocated interactions has been exploring situations where collocated users engage in collaborative activities using their personal mobile devices (e.g., smartphones and tablets), thus going from personal/individual toward shared/multiuser experiences and interactions. The proliferation of ever- smaller computers that can be worn on our wrists (e.g., Apple Watch) and other parts of the body (e.g., Google Glass), have expanded the possibilities and increased the complexity of interaction in what we term “mobile collocated” situations. The focus of this workshop is to bring together a community of researchers, designers and practitioners to explore novel interaction techniques for mobile collocated interactions

Collaborative use of mobile devices to curate sources of inspiration

We demonstrate a prototype mobile application designed to support individually collecting personal sources of inspiration on mobile phones, and then the sharing and curating of these collected materials in a face-to-face situation

Legal and Ethical Implications of Mobile Live-Streaming Video Apps

The introduction of mobile apps such as Meerkat, Periscope, and Facebook Live has sparked enthusiasm for live-streaming video. This study explores the legal and ethical implications of mobile live-streaming video apps through a review of public-policy considerations and the computing literature as well as analyses of a mix of quantitative and qualitative user data. We identify lines of research inquiry for five policy challenges and two areas of the literature in which the impact of these apps is so far unaddressed. The detailed data gathered from these inquiries will significantly contribute to the design and development of tools, signals or affordances to address the concerns that our study identifies. We hope our work will help shape the fields of ubiquitous computing and collaborative and social computing, jurisprudence, public policy and applied ethics in the future

Audio in place: media, mobility & HCI: creating meaning in space

Audio-based content, location and mobile technologies can offer a multitude of interactional possibilities when combined in innovative and creative ways. It is important not to underestimate impact of the interplay between location, place and sound. Even if intangible and ephemeral, sounds impact upon the way in which we experience the built as well as the natural world. As technology offer us the opportunity to augment and access the world, mobile technologies offer us the opportunity to interact while moving though the world. They are technologies that can mediate, provide and locate experience in the world. Vision, and to some extent the tactile senses have been dominant modalities discussed in experiential terms within HCI. This workshop suggests that there is a need to better understand how sound can be used for shaping and augmenting the experiential qualities of places through mobile computing

RepliCueAuth: Validating the Use of a lab-based Virtual Reality Setup for Evaluating Authentication System

Evaluating novel authentication systems is often costly and time-consuming. In this work, we assess the suitability of using Virtual Reality (VR) to evaluate the usability and security of real-world authentication systems. To this end, we conducted a replication study and built a virtual replica of CueAuth [52], a recently introduced authentication scheme, and report on results from: (1) a lab-based in-VR usability study (N=20) evaluating user performance; (2) an online security study (N=22) evaluating system’s observation resistance through virtual avatars; and (3) a comparison between our results and those previously reported in the real-world evaluation. Our analysis indicates that VR can serve as a suitable test-bed for human-centred evaluations of real-world authentication schemes, but the used VR technology can have an impact on the evaluation. Our work is a first step towards augmenting the design and evaluation spectrum of authentication systems and offers ground work for more research to follow

Using emotions in intelligent virtual environments: the EJaCalIVE framework

Nowadays, there is a need to provide new applications which allow the definition and implementation of safe environments that attends to the user needs and increases their wellbeing. In this sense, this paper introduces the EJaCalIVE framework which allows the creation of emotional virtual environments that incorporate agents, eHealth related devices, human actors, and emotions projecting them virtually and managing the interaction between all the elements. In this way, the proposed framework allows the design and programming of intelligent virtual environments, as well as the simulation and detection of human emotions which can be used for the improvement of the decision-making processes of the developed entities. The paper also shows a case study that enforces the need of this framework in common environments like nursing homes or assisted living facilities. Concretely, the case study proposes the simulation of a residence for the elderly. The main goal is to have an emotion-based simulation to train an assistance robot avoiding the complexity involved in working with the real elders. The main advantage of the proposed framework is to provide a safe environment, that is, an environment where users are able to interact safely with the system.This work is partially supported by the MINECO/FEDER TIN2015-65515-C4-1-R and the FPI Grant AP2013-01276 awarded to Jaime-Andres Rincon. This work is also supported by COMPETE: POCI-01-0145-FEDER-007043 and Fundacao para a Ciencia e Tecnologia (FCT) within the projects UID/CEC/00319/2013 and Post-Doc scholarship SFRH/BPD/102696/2014 (A. Costa).info:eu-repo/semantics/publishedVersio

Digital technologies applied to the accessible management of museums. The first experiments carried out at the Museum of Oriental Art of Turin

[EN] The proposed research focuses on the museum context of the city of Turin (Italy), within an ongoing framework agreement between the Politecnico di Torino and the Museum of Oriental Art (MAO). It aims at the construction of a model for the management of the workflow that includes the digital survey, the 3D virtual modelling and the digital fabrication of the tactile models of the artworks and the exhibition spaces. The paper starts with an overview on the methods of conservation and dissemination of cultural and architectural heritage, on the accessibility of museums and on tactile perception and graphics. It presents the first outcomes of the designed workflow with a special focus on the digital fabrication experiments on the vaulted system of the atrium of Palazzo Mazzonis (MAO home). The founding idea is that tactile exploration of artifacts helps the visitor engagement, making the museum experience more educationally incisive and more inclusive, in a “Design for All” perspective.[ES] La investigación propuesta se centra en el contexto museístico de la ciudad de Turín (Italia), dentro de un acuerdo marco en curso entre el Politecnico di Torino y el Museo de Arte Oriental (MAO). Su objetivo es la construcción de un modelo para la gestión del flujo de trabajo que parte de la digitalización de las obras de arte y de los espacios y termina con la realización de modelos táctiles. El artículo comienza con una visión general sobre los métodos de conservación y difusión del patrimonio cultural y arquitectónico sobre la percepción y los gráficos táctiles. Presenta los primeros resultados del flujo de trabajo diseñado, centrándose especialmente en los experimentos de fabricación digital en el sistema abovedado del atrio del Palazzo Mazzonis (casa del MAO). La idea básica es que la exploración táctil de los artefactos ayuda a la participación del visitante, haciendo que la experiencia del museo sea más incisiva desde el punto de vista educativo y más inclusiva, en una perspectiva de “Diseño para todos”.This research is carried out within the framework of an agreement between the Museo d’Arte Orientale and the Politecnico di Torino. I would like to thank Dr Marco Guglielminotti Trivel, Director of the Museum, Dr Claudia Ramasso, museum curator and Mrs Patrizia Bosio, from the Technical and Security Office for having favored the current research. In addition, I would like to thank Dr Franco Lepore Disability Manager of the Municipality of Turin, and Arch. Rocco Rolli, founder of Tactile Vision Onlus, for their willingness to help me in the management of the model testing phase that will take place soon.Ronco, F. (2021). Digital technologies applied to the accessible management of museums. The first experiments carried out at the Museum of Oriental Art of Turin. EGE Revista de Expresión Gráfica en la Edificación. 0(14):49-61. https://doi.org/10.4995/ege.2021.15661OJS4961014Amoruso, G. 2019. "UID PhD Summer School. Rilievo del patrimonio culturale e rappresentazione inclusiva". Diségno, n. 4, p. 261-264. ISSN 2533-2899Anagnostakis, G., Antoniou, M., Kardamitsi, E., Sachinidis, T., Koutsabasis, P., Stavrakis, S., Vosinakis, M., Zissis, D. 2016. "Accessible museum collections for the visually impaired: combining tactile exploration, audio descriptions and mobile gestures". In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI '16). New York: Association for Computing Machinery, p. 1021-1025. https://doi.org/10.1145/2957265.2963118Balletti, C., Ballarin, M. 2019. "An Application of Integrated 3D Technologies for Replicas in Cultural Heritage". ISPRS Int. J. Geo-Inf., n. 8, p. 285-313. https://doi.org/10.3390/ijgi8060285Barberà Giné, A. 2018. "Fotogrametría para la conservación-restauración de bienes culturales". Unicum, n. 17, p. 153-162. ISSN: 1579-3613.Bo, P., Pottmann, H., Kilian, M., Wang, W., Wallner, J. 2011. "Circular arc structures". ACM Trans. Graph., vol. 30, n. 4, p. 101:1-101:11. ISSN 0730-0301. https://doi.org/10.1145/2010324.1964996Brie, M., Morice, J. C. 1996. "Il disegno in rilievo: oggetto di conoscenza". XY, Dimensioni del Disegno, n. 26, p. 38-51.Bruno, A., Ricca, F. 2010. Il Museo d'Arte Orientale MAO. Torino: Allemandi, p. 3-24. ISBN 978-88-422-1699-5.Bruno, Ivana. 2019. "Comunicazione e accessibilità culturale. L'esperienza di Museo Facile". Il capitale culturale, n. 20, p. 297-325. http://dx.doi.org/10.13138/2039-2362/2068.Candling, F. 2010. Art, Museums and Touch. Manchester: Manchester University Press. ISBN 978-0719079337Clini, P., Frapiccini, N., Quattrini, R., Nespeca, R. 2018. "Toccare l'arte e guardare con altri occhi. Una via digitale per la rinascita dei musei archeologici nell'epoca della riproducibilità dell'opera d'arte". In Luigini, Alessandro and Panciroli, Chiara eds. Ambienti digitali per l'educazione all'arte e al patrimonio. Milano: FrancoAngeli s.r.l., p. 97-113. ISBN 9788891773333. http://library.oapen.org/handle/20.500.12657/25364 [accessed on 2020/05/04].D'Agnano, F., Balletti, C., Guerra, F., Vernier, P.. 2015. "Tooteko: A case study of augmented reality for an accessible cultural heritage. Digitization, 3D printing and sensors for an audio-tactile experience". International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. 5W4, p. 207-213. https://doi.org/10.5194/isprsarchives-XL-5-W4-207-2015De Rubertis, R. (ed.) 1996. "Il disegno oscuro". XY Dimensioni del Disegno, n. 26Díaz Gómez, F., Jiménez,Peiró J., Barreda Benavent, A., Asensi Recuenco, B., Hervás Juan, J. 2015. " Modelado 3D para la generación de patrimonio virtual. 3D modeling for the generation of virtual heritage". Virtual Archaeology Review, vol. 6, no 12, p. 29-37. ISSN 1989-9947. https://doi.org/10.4995/var.2015.4150Empler, T. 1996. Il "disegno in rilievo negli Istituti di Ricerca italiani e francesi". XY, Dimensioni del Disegno, n. 26, p. 5-7.Empler, T. 2013. "Universal Design: ruolo del Disegno e Rilievo". Disegnare. Idee Immagini, n. 46, p. 52-63. ISBN 978-88-492-1835-0.Empler, T., Fusinetti, A. 2019. "Rappresentazione visuo-tattile: comunicazione tattile per i disabili visivi". In Belardi, Paolo ed. UID per il disegno:2019. Riflessioni: l'arte del disegno/ il disegno dell'arte. Roma : Gangemi, p 1563-1572. ISBN 978-88-492-3762-7. https://www.torrossa.com/it/resources/an/4557553 [accessed on 2020/05/04].García Lucerga, M. A. 1993. El acceso de las personas deficientes visuales al mundo de los museos. Madrid: Organización Nacional de Ciegos Españoles, Sección de Cultura D.L. ISBN 84-87277-25-X. https://portal.once.es/bibliotecas/fondo-bibliografico-discapacidad-visual [accessed on 2020/05/04].Levi, F., Rolli, R. 1994. Disegnare per le mani. Manuale di disegno in rilievo. Torino: Silvio Zamorani Editore. ISBN: 9788871580388.Montella, M., Petraroia, P., Manacorda, Daniele, Di Macco, Michela. 2016. In Feliciati, Pierluigi, ed. La valorizzazione dell'eredità culturale in Italia, Atti del Convegno (Macerata 5-6 novembre 2015), Supplemento, n. 5. Macerata: eum edizioni, p. 13-36. ISBN 978-88-6056-485-6.Nasini, L., Isawi, H. 2006. Una geometria per comprendere lo spazio senza percepirlo visivamente. Roma: Officina Edizioni. ISBN: 9788860490070.Pérez de Andrés, C., Ramos Fuentes, A. 1994. Museos abiertos a todos los sentidos : acoger mejor a las personas minusválidas. Salamanca: Ministerio de Cultura, Organización Nacional de Ciegos Españoles, Sección de Cultura 1994. ISBN 84-87277-40-3. https://portal.once.es/bibliotecas/fondo-bibliografico-discapacidad-visual [accessed on 2020/05/04].Petrelli, D., Ciolfi, L., Van DiJk, D., Horneker, E., Not, E., Schmidt A. 2013. "Integrating material and digital: A new way for cultural heritage". Interactions: new visions of human-computer, n. 20, p. 58-63. https://doi.org/10.1145/2486227.2486239Photoworks: 3D Photo Printing Products. URL: https://www.3dphotoworks.com/product [accessed on 2020/05/04].Reichinger, A., Neumüller, M., Rist, F., Maierhofer, S., Purgathofer, W. 2012. "Computer-Aided Design of Tactile Models. Taxonomy and Case Studies". In Miesenberger, Klaus et al. eds. ICCHP 2012, Part II, LNCS 7383, p. 497-504. ISBN 978-3-642-31533-6. https://doi.org/10.1007/978-3-642-31534-3_73Reichinger, A., Fuhrmann, A., Maierhofer, S., Purgathofer, W. 2016. "Gesture-Based Interactive Audio Guide on Tactile Reliefs". In Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '16). New York: Association for Computing Machinery, p. 91-100. https://doi.org/10.1145/2982142.2982176Samaroudi, M., Echavarria, K.R., Rodriguez, Song, R., Evans, R. 2017. "The Fabricated Diorama: Tactile Relief and Context-aware Technology for Visually Impaired Audiences". In Proceedings of the Eurographics Workshop on Graphics and Cultural Heritage (GCH '17). Goslar: Eurographics Association, p 201-206. https://doi.org/10.2312/gch.20171315.Sdegno, A. 2018. "Rappresentare l'opera d'arte con tecnologie digitali: dalla realtà aumentata alle esperienze tattili". In Luigini, Alessandro and Panciroli, Chiara eds. Ambienti digitali per l'educazione all'arte e al patrimonio. Milano: FrancoAngeli s.r.l., p. 257-272. ISBN 9788891773333Secchi, L. 2018. "Toccare con gli occhi e vedere con le mani. Funzioni cognitive e conoscitive dell'educazione estetica". Ocula, vol.19, n.19, p. 15-31. https://doi.org/10.12977/ocula2018-9Shi, L., Zelzer, I., Feng, C., Azenkot, S. 2016. "Tickers and Talker: An Accessible Labeling Toolkit for 3D Printed Models". In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). New York: Association for Computing Machinery, p. 4896-4907. https://doi.org/10.1145/2858036.2858507Spallone, R., Vitali, M. 2017. Star-shaped and Planterian Vaults in the Baroque Atria of Turin. Ariccia: Aracne. ISBN 978-88-255-0472-9Wilson, P. F., Stott, J., Warnett, J. M., Attridge, A., Smith, M. P., Williams, M. A. 2017. "Evaluation of touchable 3D-printed replicas in museums". Curator. The Museum Journal, vol. 60, n. 4, p. 445-465. https://doi.org/10.1111/cura.1224

1D-Touch: NLP-Assisted Coarse Text Selection via a Semi-Direct Gesture

Existing text selection techniques on touchscreen focus on improving the control for moving the carets. Coarse-grained text selection on word and phrase levels has not received much support beyond word-snapping and entity recognition. We introduce 1D-Touch, a novel text selection method that complements the carets-based sub-word selection by facilitating the selection of semantic units of words and above. This method employs a simple vertical slide gesture to expand and contract a selection area from a word. The expansion can be by words or by semantic chunks ranging from sub-phrases to sentences. This technique shifts the concept of text selection, from defining a range by locating the first and last words, towards a dynamic process of expanding and contracting a textual semantic entity. To understand the effects of our approach, we prototyped and tested two variants: WordTouch, which offers a straightforward word-by-word expansion, and ChunkTouch, which leverages NLP to chunk text into syntactic units, allowing the selection to grow by semantically meaningful units in response to the sliding gesture. Our evaluation, focused on the coarse-grained selection tasks handled by 1D-Touch, shows a 20% improvement over the default word-snapping selection method on Android

Collaborative behavior, performance and engagement with visual analytics tasks using mobile devices

Interactive visualizations are external tools that can support users’ exploratory activities. Collaboration can bring benefits to the exploration of visual representations or visu‐ alizations. This research investigates the use of co‐located collaborative visualizations in mobile devices, how users working with two different modes of interaction and view (Shared or Non‐Shared) and how being placed at various position arrangements (Corner‐to‐Corner, Face‐to‐Face, and Side‐by‐Side) affect their knowledge acquisition, engagement level, and learning efficiency. A user study is conducted with 60 partici‐ pants divided into 6 groups (2 modes×3 positions) using a tool that we developed to support the exploration of 3D visual structures in a collaborative manner. Our results show that the shared control and view version in the Side‐by‐Side position is the most favorable and can improve task efficiency. In this paper, we present the results and a set of recommendations that are derived from them