Multisensory Perception and Learning: Linking Pedagogy, Psychophysics, and Human–Computer Interaction

In this review, we discuss how specific sensory channels can mediate the learning of properties of the environment. In recent years, schools have increasingly been using multisensory technology for teaching. However, it still needs to be sufficiently grounded in neuroscientific and pedagogical evidence. Researchers have recently renewed understanding around the role of communication between sensory modalities during development. In the current review, we outline four principles that will aid technological development based on theoretical models of multisensory development and embodiment to foster in-depth, perceptual, and conceptual learning of mathematics. We also discuss how a multidisciplinary approach offers a unique contribution to development of new practical solutions for learning in school. Scientists, engineers, and pedagogical experts offer their interdisciplinary points of view on this topic. At the end of the review, we present our results, showing that one can use multiple sensory inputs and sensorimotor associations in multisensory technology to improve the discrimination of angles, but also possibly for educational purposes. Finally, we present an application, the ‘RobotAngle’ developed for primary (i.e., elementary) school children, which uses sounds and body movements to learn about angles

Using Augmented Reality Toward Improving Social Skills:Scoping Review

BackgroundAugmented reality (AR) has emerged as a promising technology in educational settings owing to its engaging nature. However, apart from applications aimed at the autism spectrum disorder population, the potential of AR in social-emotional learning has received less attention. ObjectiveThis scoping review aims to map the range of AR applications that improve social skills and map the characteristics of such applications. MethodsIn total, 2 independent researchers screened 2748 records derived from 3 databases in December 2021—PubMed, IEEE Xplore, and ACM Guide to Computing Literature. In addition, the reference lists of all the included records and existing reviews were screened. Records that had developed a prototype with the main outcome of improving social skills were included in the scoping review. Included records were narratively described for their content regarding AR and social skills, their target populations, and their outcomes. Evaluation studies were assessed for methodological quality. ResultsA total of 17 records met the inclusion criteria for this study. Overall, 10 records describe applications for children with autism, primarily teaching about reading emotions in facial expressions; 7 records describe applications for a general population, targeting both children and adults, with a diverse range of outcome goals. The methodological quality of evaluation studies was found to be weak. ConclusionsMost applications are designed to be used alone, although AR is well suited to facilitating real-world interactions during a digital experience, including interactions with other people. Therefore, future AR applications could endorse social skills in a general population in more complex group settings

Co-design of augmented reality textbook for children’s collaborative learning experience in primary schools

Augmented Reality (AR) is a recent technology that allows a seamless composition between virtual objects and the real world. This practice-based research uses the affordances of AR to design an AR textbook for collaborative learning experience. It identifies the key concepts of children s AR textbooks for the designing and evaluation of collaborative learning experiences. These concepts were used to develop a conceptual framework for the AR textbook that considers collaborative experience, learning and usability. Informed by these concepts, the research also has identified the design features which are unique to AR affordances which can be integrated in the school textbooks to develop a collaborative AR textbook for primary school children. The research follows a participatory design approach to involve the users of the AR textbook in the design process. The researcher has conducted three co-design studies involving primary school children and adults using cooperative inquiry techniques. The first study uses low-tech prototyping to find the overall direction of designing the AR textbook. After the development of the first AR textbook prototype, two formative evaluations have been conducted using cooperative inquiry critiquing, and layered elaboration techniques. Throughout these studies, a conceptual framework has been developed namely, Experience, Learn and Use (ELU) for the designing and evaluation of children s AR textbooks for collaborative learning experience. This framework is based on the adaption of Janet Read s Play, Learn, Use (PLU) model that defines children s relationships with the interactive technologies. The research proposes the ELU framework as a useful classification framework in the evaluation process, which informs the design features of the AR textbook which are related to the concepts of collaborative experience, learning and usability. The practical component of the thesis proposes a sample of an AR textbook that is integrated in the regular school curriculum. It demonstrates the design features which can be implemented in other textbooks to support collaborative learning experiences for primary school children. The documentation of the co-design process provides a practical framework for co-designing an AR textbook with children, as well as an evidence of using the ELU framework in practice. 4 This research also contributes in bridging the gap between AR and Child-Computer Interaction (CCI) communities, through the use of common CCI methods in the AR development. This research has resulted in key design principles which contribute original knowledge to the literature of the AR for children s education considering the CCI perspective. These important principles are informed by the collaborative experiences, learning and usability aspects that establish a framework for the design and evaluation of collaborative AR textbook for children. The eight identified principles by this research are, Joint Textbooks, Personalised AR Experience, Interactive AR Book, Communication-Based Learning, Rewarding AR feedback, Audio AR Textbook, Intuitive AR Markers, and Mutual AR Display. The research introduces the definition for each of the concepts and a demonstration of the related design features in the outcome of the AR textbook prototype

Educational mobile game design for children learning mathematics

Children can learn while playing computer educational games. Therefore, it is important that educational games for children are well designed and usable. This study proposes an educational mobile game design for children to learn mathematics. Based on the design, a low fidelity and high fidelity prototypes called PreMath Operations were designed and developed. A usability evaluation was conducted on the prototypes by observing children playing with the games. The result of the evaluation suggested that PreMath Operations prototypes is usable and can help children to learn math while playing. This study provides a design strategy of mathematic educational game for children to learn in a fun and interestin

Motion Based Learning for Preschools Mathematics via Kinect (Counting Number)

Kids start learning numbers since they in preschools. Every kids have difficulties to start learn about mathematics. They do not recognize and might be difficult for them to remember the numbers at first. Teacher will help them to teach and assist them to solve this problem and it usually happens after some stages and time. The only problem is education system use currently is not helping much in increasing the speed of children's learning. With current education system that sometime bored and only use whiteboard as medium of teaching, kids cannot give their full commitment in class. In Malaysia, traditional and conventional teaching still widely being practiced. However, with the advancement of technology nowadays, it can help to overcome this problem. By using current technology, it can help to complement current education system. Education system can utilize the advancement of technology to overcome problem such as boring and not interactive learning. Example of technology that can be use is Kinect. Kinect is a device that can track human body to interact with an application. It can help make learning become active, interactive and at it also involving all body parts. The objective of introducing kinect in education is to develop a motion based learning application for preschools' mathematics. To achieve this objective, the author has decided to test the application for preschools kid age from 3 to 6 years old. It will focus on teaching simple numbers. Kinect in mathematic will cover on basic numbers among preschool kids. Since the time given to develop this project is very limited, the methodology chosen for this development is throwaway prototype methodology. By using throwaway prototyping methodology this project have improved and increase user involvement. Results showing that kids enjoy the kinect technology in mathematics and teachers have found one of interactive ways of teaching. From data collected and analyzed, results showed that kids enjoy this kinect technology in mathematics and at same time teachers have found one of interactive ways of teaching

Digital Platform-Based Learning Innovation in Elementary Schools in The Industry 4.0 Era: Systematic Literature Review

Information and communication technology advances have been utilized in many sectors of human life, including educational practices. This study aims to reveal the innovation practices of app-based digital application platforms. This research was conducted using a systematic literature review (SLR) approach. Data sources come from research journal articles and books by the theme of the discussion. The data analysis technique uses content analysis. The finding or result of this research is that learning can utilize digital platform features as part of learning innovation. Digital platforms that can be utilized are such as Microsoft Teams and Edmodo applications. Both applications have many services, such as video conferencing, presentations, assignments, and online assessments. The utilization of digital platforms in schools in the Industrial Age 4.0 aligns with the development and challenges of the rapidly changing times. Digital platforms are part of the innovations that can be used as alternative media and real solutions for technology-integrated learning. Learning with digital platform media can increase student participation and collaboration and provide new, in-depth learning experiences

Boosting children's creativity through creative interactions with social robots

Creativity is an ability with psychological and developmental benefits. Creative levels are dynamic and oscillate throughout life, with a first major decline occurring at the age of 7 years old. However, creativity is an ability that can be nurtured if trained, with evidence suggesting an increase in this ability with the use of validated creativity training. Yet, creativity training for young children (aged between 6-9 years old) appears as scarce. Additionally, existing training interventions resemble test-like formats and lack of playful dynamics that could engage children in creative practices over time. This PhD project aimed at contributing to creativity stimulation in children by proposing to use social robots as intervention tools, thus adding playful and interactive dynamics to the training. Towards this goal, we conducted three studies in schools, summer camps, and museums for children, that contributed to the design, fabrication, and experimental testing of a robot whose purpose was to re-balance creative levels. Study 1 (n = 140) aimed at testing the effect of existing activities with robots in creativity and provided initial evidence of the positive potential of robots for creativity training. Study 2 (n = 134) aimed at including children as co-designers of the robot, ensuring the robot’s design meets children’s needs and requirements. Study 3 (n = 130) investigated the effectiveness of this robot as a tool for creativity training, showing the potential of robots as creativity intervention tools. In sum, this PhD showed that robots can have a positive effect on boosting the creativity of children. This places social robots as promising tools for psychological interventions.Criatividade é uma habilidade com benefícios no desenvolvimento saudável. Os níveis de criatividade são dinâmicos e oscilam durante a vida, sendo que o primeiro maior declínio acontece aos 7 anos de idade. No entanto, a criatividade é uma habilidade que pode ser nutrida se treinada e evidências sugerem um aumento desta habilidade com o uso de programas validados de criatividade. Ainda assim, os programas de criatividade para crianças pequenas (entre os 6-9 anos de idade) são escassos. Adicionalmente, estes programas adquirem o formato parecido ao de testes, faltando-lhes dinâmicas de brincadeira e interatividade que poderão motivar as crianças a envolverem-se em práticas criativas ao longo do tempo. O presente projeto de doutoramento procurou contribuir para a estimulação da criatividade em crianças propondo usar robôs sociais como ferramenta de intervenção, adicionando dinâmicas de brincadeira e interação ao treino. Assim, conduzimos três estudos em escolas, campos de férias, e museus para crianças que contribuíram para o desenho, fabricação, e teste experimental de um robô cujo objetivo é ser uma ferramenta que contribui para aumentar os níveis de criatividade. O Estudo 1 (n = 140) procurou testar o efeito de atividade já existentes com robôs na criatividade e mostrou o potencial positivo do uso de robôs para o treino criativo. O Estudo 2 (n = 134) incluiu crianças como co-designers do robô, assegurando que o desenho do robô correspondeu às necessidades das crianças. O Estudo 2 (n = 130) investigou a eficácia deste robô como ferramenta para a criatividade, demonstrando o seu potencial para o treino da criatividade. Em suma, o presente doutoramento mostrou que os robôs poderão ter um potencial criativo em atividades com crianças. Desta forma, os robôs sociais poderão ser ferramentas promissoras em intervenções na psicologia