Evaluating Simultaneous Visual Instructions with Kindergarten Children on Touchscreen Devices

[EN] A myriad of educational applications using tablets and multi-touch technology for kindergarten children have been developed in the last decade. However, despite the possible benefits of using visual prompts to communicate information to kindergarteners, these visual techniques have not been fully studied yet. This article therefore investigates kindergarten children¿s abilities to understand and follow several visual prompts about how to proceed and interact in a virtual 2D world. The results show that kindergarteners are able to effectively understand several visual prompts with different communication purposes despite being used simultaneously. The results also show that the use of the evaluated visual prompts to communicate data when playing reduces the number of interferences about technical nature fostering dialogues related to the learning activity guided by the instructors or caregivers. Hence, this work is a starting point for designing dialogic learning scenarios tailored to kindergarten children.This work is supported by the Spanish Ministry of Economy and Competitiveness and funded by the European Development Regional Fund (EDRF-FEDER) with Project TIN2014-60077-R; by VALi+d program from Conselleria d¿Educació, Cultura i Esport (Generalitat Valenciana) under the fellowship ACIF/2014/214, and by the FPU program from Spanish Ministry of Education, Culture, and Sport under the fellowship FPU14/00136Nácher, V.; García-Sanjuan, F.; Jaén Martínez, FJ. (2020). Evaluating Simultaneous Visual Instructions with Kindergarten Children on Touchscreen Devices. International Journal of Human-Computer Interaction. 36(1):41-54. https://doi.org/10.1080/10447318.2019.1597576S4154361Allen, R., & Scofield, J. (2010). Word learning from videos: more evidence from 2-year-olds. Infant and Child Development, 19(6), 649-661. doi:10.1002/icd.712Cristia, A., & Seidl, A. (2015). Parental Reports on Touch Screen Use in Early Childhood. PLOS ONE, 10(6), e0128338. doi:10.1371/journal.pone.0128338Derboven, J., De Roeck, D., & Verstraete, M. (2012). Semiotic analysis of multi-touch interface design: The MuTable case study. International Journal of Human-Computer Studies, 70(10), 714-728. doi:10.1016/j.ijhcs.2012.05.005Egloff, T. H. (2004). Edutainment. Computers in Entertainment, 2(1), 13-13. doi:10.1145/973801.973822Fernández-López, Á., Rodríguez-Fórtiz, M. J., Rodríguez-Almendros, M. L., & Martínez-Segura, M. J. (2013). Mobile learning technology based on iOS devices to support students with special education needs. Computers & Education, 61, 77-90. doi:10.1016/j.compedu.2012.09.014Furió, D., González-Gancedo, S., Juan, M.-C., Seguí, I., & Rando, N. (2013). Evaluation of learning outcomes using an educational iPhone game vs. traditional game. Computers & Education, 64, 1-23. doi:10.1016/j.compedu.2012.12.001Hanna, L., Risden, K., & Alexander, K. (1997). Guidelines for usability testing with children. Interactions, 4(5), 9-14. doi:10.1145/264044.264045Honomichl, R. D., & Chen, Z. (2012). The role of guidance in children’s discovery learning. WIREs Cognitive Science, 3(6), 615-622. doi:10.1002/wcs.1199Hourcade, J. P. (2007). Interaction Design and Children. Foundations and Trends® in Human-Computer Interaction, 1(4), 277-392. doi:10.1561/1100000006Ioannou, A., Zaphiris, P., Loizides, F., & Vasiliou, C. (2013). Let’S Talk About Technology for Peace: A Systematic Assessment of Problem-Based Group Collaboration Around an Interactive Tabletop. Interacting with Computers, 27(2), 120-132. doi:10.1093/iwc/iwt061Keenan, T., Ruffman, T., & Olson, D. R. (1994). When do children begin to understand logical inference as a source of knowledge? Cognitive Development, 9(3), 331-353. doi:10.1016/0885-2014(94)90010-8Levine, S. C., Huttenlocher, J., Taylor, A., & Langrock, A. (1999). Early sex differences in spatial skill. Developmental Psychology, 35(4), 940-949. doi:10.1037/0012-1649.35.4.940Nacher, V., Garcia-Sanjuan, F., & Jaen, J. (2016). Interactive technologies for preschool game-based instruction: Experiences and future challenges. Entertainment Computing, 17, 19-29. doi:10.1016/j.entcom.2016.07.001Nacher, V., Jaen, J., & Catala, A. (2016). Evaluating Multitouch Semiotics to Empower Prekindergarten Instruction with Interactive Surfaces. Interacting with Computers, 29(2), 97-116. doi:10.1093/iwc/iww007Nacher, V., Jaen, J., Navarro, E., Catala, A., & González, P. (2015). Multi-touch gestures for pre-kindergarten children. International Journal of Human-Computer Studies, 73, 37-51. doi:10.1016/j.ijhcs.2014.08.004Nacher, V., Jurdi, S., Jaen, J., & Garcia-Sanjuan, F. (2019). Exploring visual prompts for communicating directional awareness to kindergarten children. International Journal of Human-Computer Studies, 126, 14-25. doi:10.1016/j.ijhcs.2019.01.003Neumann, M. M. (2017). Parent scaffolding of young children’s use of touch screen tablets. Early Child Development and Care, 188(12), 1654-1664. doi:10.1080/03004430.2016.1278215Pecora, N., Murray, J. P., & Wartella, E. A. (Eds.). (2009). Children and Television. doi:10.4324/9781410618047Plowman, L., Stevenson, O., Stephen, C., & McPake, J. (2012). Preschool children’s learning with technology at home. Computers & Education, 59(1), 30-37. doi:10.1016/j.compedu.2011.11.014Smith, S. P., Burd, E., & Rick, J. (2012). Developing, evaluating and deploying multi-touch systems. International Journal of Human-Computer Studies, 70(10), 653-656. doi:10.1016/j.ijhcs.2012.07.002Van der Meij, H., & van der Meij, J. (2014). A comparison of paper-based and video tutorials for software learning. Computers & Education, 78, 150-159. doi:10.1016/j.compedu.2014.06.003Vatavu, R.-D., Cramariuc, G., & Schipor, D. M. (2015). Touch interaction for children aged 3 to 6 years: Experimental findings and relationship to motor skills. International Journal of Human-Computer Studies, 74, 54-76. doi:10.1016/j.ijhcs.2014.10.00

Kindertivity: Usability and Communicability Strategies for Interactive Surfaces and Pre-Kindergarten Children

Tesis por compendio[ES] La tecnología multi-táctil se ha convertido en una de las más emergentes tras experimentar un enorme crecimiento desde sus pasos iniciales en los años ochenta hasta su amplia aceptación y uso en la actualidad. Por una parte, la tecnología multi-táctil se basa en el estilo de interacción de manipulación directa el cual proporciona a los usuarios la ventaja de ver los objetos y las acciones de interés, sustituir comandos escritos por acciones de señalado y, además, permite la realización de acciones rápidas, reversibles e incrementales evitando el uso de instrucciones complejas. Por otra parte, diversos trabajos han evaluado las virtudes derivadas de utilizar conjuntamente la manipulación directa con el toque directo mostrando que es posible evitar los problemas inherentes a otras técnicas de interacción como el ratón y el teclado. Por lo tanto, aprovechando la interacción natural e intuitiva proporcionada por la tecnología multi-táctil, ésta parece una forma ideal para dar soporte a la creación de escenarios educativos dirigidos a niños en edad preescolar. Sin embargo, a pesar de la existencia de diversos estudios que evalúan la idoneidad de utilizar el estilo de interacción de manipulación directa, existe una falta de trabajos abordando el uso dispositivos basados en superficies táctiles con niños de una temprana edad. Asimismo, en la actualidad existe una creciente tendencia a diseñar aplicaciones educativas y lúdicas dirigidas a niños en edad preescolar utilizando dispositivos multi-táctiles como los teléfonos inteligentes o las tabletas. Además, diversos informes señalan que los niños son usuarios frecuentes de este tipo de dispositivos y los utilizan incluso antes de ser capaces de hablar. Sin embargo, a pesar de este crecimiento en el uso de la tecnología multi-táctil y su aparente idoneidad para ser utilizado en el desarrollo de aplicaciones educativas para niños en edad preescolar, no existen unas interacciones universales y estandarizadas para preescolares a la hora de utilizar dispositivos táctiles ya que habitualmente sólo se utilizan dos gestos básicos (básicamente, el toque con un dedo para seleccionar y el arrastre con un dedo para el movimiento). Por lo tanto, existe una clara necesidad de llevar a cabo estudios empíricos para contribuir y avanzar en el diseño de aplicaciones que den un soporte adecuado y encaje con las habilidades de los niños en su temprano desarrollo. Por tanto, esta tesis propone, diseña y evalúa diversas estrategias de usabilidad y comunicabilidad adaptadas a los niños en edad preescolar para establecer la base para el diseño y desarrollo de futuras aplicaciones basadas en dispositivos táctiles dirigidas a preescolares. Estas estrategias llevarán a la adecuada definición de guías de diseño que permitirán a los niños aprovechar al máximo la tecnología multi-táctil, harán posible el desarrollo de nuevas y atractivas aplicaciones y, eventualmente, también podrán ayudar al desarrollo cognitivo y motor de los niños.[CA] La tecnologia multi-tàctil s'ha convertit en una de les més emergents després d'experimentar un enorme creixement des dels seus passos inicials als anys vuitanta fins l'actualitat on es àmpliament acceptada i utilitzada. D'una banda, la tecnologia multi-tàctil es basa en l'estil d'interacció de manipulació directa, el qual proporciona als usuaris l'avantatge de veure els objectes i les accions d'interès, substituir comandos escrits per accions d'assenyalament i, a més, permet la realització d'accions, ràpides, reversibles i incrementals evitant l'ús d'instruccions complexes. D'altra banda, diversos treballs han avaluat les virtuts derivades d'utilitzar conjuntament la manipulació directa amb el toc directe mostrant que és possible evitar els problemes inherents a altres tècniques d'interacció com el ratolí i el teclat. Per tant, aprofitant la interacció natural i intuïtiva proporcionada per la tecnologia multi-tàctil, aquesta sembla una forma ideal per donar suport a la creació d'escenaris educatius per a xiquets en edat preescolar. No obstant això, malgrat l'existència de diversos estudis que avaluen la idoneïtat d'utilitzar l'estil d'interacció de manipulació directa, existeix una manca de treballs abordant l'ús de dispositius basats en superfícies tàctils amb xiquets d'edat primerenca. Així mateix, en l'actualitat existeix una creixent tendència a dissenyar aplicacions educatives i lúdiques dirigides a xiquets en edat preescolar utilitzant dispositius tàctils com els telèfons intel¿ligents o les tauletes. A més, diversos informes assenyalen que els xiquets són usuaris freqüents d'aquests tipus de dispositius i els utilitzen fins i tot abans de ser capaços de parlar. Malgrat aquest creixement en l'ús de la tecnologia multi-tàctil i la seua aparent idoneïtat per a ser utilitzada en el desenvolupament d'aplicacions educatives per a xiquets en edat preescolar, no existeixen unes interaccions universals i estandarditzades per a preescolars a l'hora d'utilitzar dispositius tàctils ja que habitualment només s'utilitzen dos gestos bàsics (bàsicament, el toc amb un dit per a seleccionar i l'arrossegament amb un dit per al moviment). Per tant, hi ha una clara necessitat de dur a terme estudis empírics per a contribuir i avançar en el disseny d'aplicacions que donen un suport adequat i s'ajusten amb les habilitats dels xiquets en el seu primerenc desenvolupament. Per tant, la tesi proposa, dissenya i avalua diverses estratègies de usabilitat i comunicabilitat adaptades als xiquets en edat preescolar per tal d'establir la base per al disseny i desenvolupament de futures aplicacions basades en dispositius tàctils dirigides a preescolars. Aquestes estratègies portaran a l'adequada definició de guies de disseny que permetran als xiquets aprofitar al màxim la tecnologia multi-tàctil, faran possible el desenvolupament de noves i atractives aplicacions i, eventualment, podran també ajudar al desenvolupament cognitiu i motor dels xiquets.[EN] Multi-touch technology has become one of the most emergent technologies and has had an enormous growth since its initial steps in the eighties to be widespread accepted and used in the present. On the one hand, multi-touch technology relies on the direct manipulation interaction style which gives users the advantage to view the objects and actions of interest, replace typed commands by pointing actions and to perform rapid, reversible and incremental actions avoiding using complex instructions. On the other hand, several works have evaluated the virtues when joining direct manipulation with direct-touching showing that it solves the problems inherent in other interaction devices, such as those involving mouse or keyboard. Hence, taking advantage of the intuitive and natural interaction provided by multi-touch technology it seems an ideal way to support educational scenarios targeted to kindergarten children. Although several works have assessed the suitability of using the direct manipulation style with children, there is a lack of works addressing the use of touchscreen devices by this specific type of users. Moreover, there is a growing trend of designing educational and playful applications targeted to kindergarten children based on touchscreen devices such as smartphones and tablets. In addition, several reports point out that children use touchscreen devices even before they are able to speak and they are frequent users of devices such as smartphones and tablets. However, despite this growth in the use of multi-touch technology by children and its apparent suitability to be used to develop applications targeted to young children, there is a lack of standardized and universally accepted interactions for young children when using touchscreen devices since only two basic gestures are commonly used (basically, consisting of only one-finger touch for selection and one-finger drag for movement). Hence, there is a need of carrying out empirical studies to help and advance in the design of applications that adequately support and fit with children's development and skills. Therefore, this thesis proposes, designs and evaluates several usability and communicability strategies tailored to children in their early development stage to establish the design and development of future applications targeted to kindergarten children. These strategies will lead to define appropriate design strategies that enable infants to take full advantage of multi-touch technology, would make it possible to develop attractive new applications and, eventually, could also aid children's cognitive and motor development.Nácher Soler, VE. (2019). Kindertivity: Usability and Communicability Strategies for Interactive Surfaces and Pre-Kindergarten Children [Tesis doctoral no publicada]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/116833TESISCompendi

Exploring visual prompts for communicating directional awareness to kindergarten children

[EN] Although a myriad of educational applications using tablets and multi-touch technology for kindergarten children have been developed in the last decade, most of these applications do not fully exploit multi-touch technology since the game world used is limited to the screen only. Considering a larger digital space in tablet-based educational scenarios would be beneficial since it would enable the design of engaging activities driven by curiosity, exploration, discovery and decisions on where the next action is situated in the digital virtual space by directional awareness. This paper therefore investigates kindergarten children's abilities to use a virtual world beyond the screen and evaluates three different types of visual prompts for communicating directional awareness. The results obtained show, firstly, that these specific users are able to use the space beyond the screen boundaries and that the evaluated prompts can effectively communicate information to kindergarten children. The paper also makes a set of recommendations to help designers choose the appropriate type of prompt for their application requirements.This work received financial support from Spanish Ministry of Economy and Competitiveness and was funded by the European Development Regional Fund (EDRF-FEDER) in the project TIN2014-60077-R (SUPEREMOS). This work is also supported by a pre-doctoral fellowship within the FPU program from the Spanish Ministry of Education, Culture and Sports to V. Nacher (FPU14/00136) and from GVA (ACIF/2014/214) to F. Garcia-Sanjuan.Nácher-Soler, VE.; Jurdi, S.; Jaén Martínez, FJ.; García Sanjuan, F. (2019). Exploring visual prompts for communicating directional awareness to kindergarten children. International Journal of Human-Computer Studies. 126:14-25. https://doi.org/10.1016/j.ijhcs.2019.01.003S142512

Examining the Usability of Touch Screen Gestures for Children With Down Syndrome

[EN] The use of multi-touch devices for all types of users (from children to the elderly) has grown considerably in the recent years. However, despite the huge interest in this technology there is a lack of research addressing usability studies on children with Down's Syndrome. This article evaluates the abilities of these children (aged from 5 to 10 years) when performing a basic set of multi-touch gestures (tap, double tap, long press, drag, scale up and down, rotation) in tablet devices. The results show that regardless of their more limited motor skills, DS children are able to perform most of the evaluated multi-touch gestures with success rates close to 100% and that this technology could be fully exploited for developing applications targeted specifically at this type of user.Spanish Ministry of Economy and Competitiveness and funded by the European Development Regional Fund (EDRF-FEDER) with the project TIN2014-60077-R (SUPEREMOS). This work was also supported by a pre-doctoral fellowship within the Formacion de Profesorado Universitario (FPU) program from the Spanish Ministry of Education, Culture and Sports to V. Nacher (FPU14/00136) and by a pre-doctoral scholarship given by the SENESCYT (Secretaria Nacional de Educacion Superior, Ciencia y Tecnologia e Innovacion) of the government of Ecuador (No. 381-2012) to Doris Caliz.Nácher-Soler, VE.; Cáliz, D.; Jaén Martínez, FJ.; Martínez, L. (2018). Examining the Usability of Touch Screen Gestures for Children With Down Syndrome. Interacting with Computers. 30(3):258-272. https://doi.org/10.1093/iwc/iwy011S25827230