User-defined multimodal interaction to enhance children's number learning

Children today are already exposed to the new technology and have experienced excellent number learning applications at an early age. Despite that, most of the children's application softwares either fail to establish the interaction design or are not child-friendly. Involving children in the design phase of any children application is therefore essential as adults or developers do not know the children’s needs and requirements. In other words, designing children's computer applications adapted to the capabilities of children is an important part of today's software development methodology. The goal of this research is to propose a new interaction technique and usability that evaluates children learning performance of numbers. The new interaction technique is designed by participatory design in which children are involved in the design process. A VisionMath interface was implemented with the user-defined multimodal interaction dialogues which was proposed to evaluate the children’s learning ability and subjective satisfaction. An evaluation with 20 participants was conducted using usability testing methods. The result shows that there is a significant difference in the number learning performance between tactile interaction and multimodal interaction. This study reveals the proposed user-defined multimodal interaction dialogue was successful in providing a new interaction technique for children’s number learning by offering alternative input modality and potentially providing a rich field of research in the future

"Paper in Screen" Prototyping a Rapid Technique to Anticipate the Mobile User Experience

Prototyping is generally acknowledged as an effective method for generating cost-effective, preliminary designs of various products including web and mobile user interfaces. Out of the existing types of prototyping, paper prototyping is known for being the most cost-effective of them all, as well as the most constrained for the realistic user experience elements it can render. High-Fidelity prototypes on the other hand offer a richer experience to the user, at the high cost of developing sophisticated software/hardware-based demonstrations. Although both of these types of prototypes continue to be widely and successfully used in product and interface design, there is no evidence of a cost-effective technique that would elicit user’s feedback which as rich as high-fidelity prototypes but without implementation effort. This study proposes an innovative prototyping technique called “Paper in Screen” (Bolchini, Pulido, Faiola, 2009) which enables designers to cheaply and rapidly prototype a mobile application in its key components (interface design and mobile device integration) without the need for implementing a high-fidelity prototype. A study was performed with 10 user experience professionals to evaluate their perception of the technique’s effectiveness, from which a number of benefits and drawbacks of the “Paper in Screen” were learned. The obtained results point to areas of future research in mobile prototyping