Chinese Text Entry with Mobile Devices

Tietokoneiden ja nykyaikaisten matkapuhelimien käytön kannalta on olennaista, että niihin voidaan syöttää tekstiä tehokkaasti. Kiinan kielen eri murteita puhuu äidinkielenään noin viidesosa maailman väestöstä eli yli miljardi ihmistä. Kiinan kielen merkki- ja tavuperustaisuus tekee siitä tekstinsyötön kannalta ainutlaatuisen haastavan. Monet kiinalaisista merkeistä ovat rakenteeltaan monimutkaisia ja homofonisia (ääntyvät samalla tavoin) joidenkin muiden merkkien kanssa. Syötettäessä tekstiä näppäimistöltä tavallinen tapa on käyttää ns. pinyin-koodeja, joiden avulla kukin kiinan merkki voidaan esittää useasta latinalaisen aakkoston merkistä koostuvana koodina. Homofoniasta johtuen tarkoitettu kiinan kielen merkki joudutaan tämän jälkeen vielä valitsemaan usean vaihtoehdon joukosta, mikä tekee tekstinsyöttöprosessista vaikeampaa kuin romaanisten kielten tapauksessa. Lisäksi on otettava huomioon Kiinan eri osissa puhutut useat murteet. Kaikki nämä tekijät yhdessä tekevät kiinankielisen tekstin syötöstä tietokoneille haastavaa. Tämän väitöskirjan tavoitteena on parantaa kiinankielisen tekstin syöttötapojen käyttäjäkokemusta käytettäessä matkapuhelimia ja muita mobiililaitteita. Väitöskirjassa tutkitaan empiiristen kokeiden ja mallinnuksen avulla uusia tekstinsyöttötapoja ja niiden käyttöä. Tutkimuksen kohteena on neljä erilaista tekstinsyöttötapaa: kiinankielen käsinkirjoituksen tunnistus, pyörivän kiekon avulla tapahtuva tekstinsyöttö, mandariinikiinaan perustuva sanelu, ja numeronäppäinten avulla tapahtuva pinyin-koodien syöttö. Työssä ehdotetaan uusia tekniikoita sekä käsinkirjoituksen tunnistukseen että kiekkoa käyttävään pinyin-koodien syöttöön. Empiirisissä kokeissa osoittautui että käyttäjät pitivät uusista tekniikoista. Mandariinikiinalle on suunniteltu lyhytviestien sanelusovellus, josta on tehty kaksi käyttäjäkoetta. Myös numeronäppäinten avulla tapahtuvaa pinyin-koodien syöttöä on tutkittu kahdessa kokeessa. Ensimmäisessä kokeessa vertailtiin viittä eri menetelmää. Se tuotti suunnitteluohjeita etenkin koskien fraasien (useamman merkin kokonaisuuksien) syöttöä, tekniikkaa joka voi nopeuttaa tekstinsyöttöä. Toisen osatutkimuksen tuloksena on tekstinsyöttöä kuvaava malli, jonka avulla voidaan ennustaa menetelmän nopeutta kun syötettäessä ei tehdä virheitä. Tutkimus johti myös useisiin jatkotutkimuskysymyksiin. On tarpeen kehittää tehokkaampia menetelmiä tilanteeseen, jossa merkki joudutaan valitsemaan useista vaihtoehdoista. Kehityspotentiaalia on myös merkkien perustana olevien viivojen tunnistustavoissa sekä kosketusnäytöllä esitettyjen näppäimistöjen paremmassa hyödyntämisessä.For using computers and modern mobile phones it is essential that there are efficient methods for providing textual input. About one fifth of the world´s population, or over one billion people, speaks some variety of Chinese as their native language. Chinese has unique characteristics as a logosyllabic language. For example, many Chinese characters are complex in structure and normally homophonic with some others. With keyboards and other key-based input devices the normal approach is to use so-called pinyin input, where the Chinese characters are entered using their pinyin mark that consists of several characters in the Roman alphabet. Because of homophony this technique requires choosing the correct Chinese character from a list of posssible choices, making the input process more complicated than in Roman languages. Moreover, the many varieties of the language in different parts of China have to be taken into account as well. All above factors bring new challenges to the design and evaluation of Chinese text entry methods in computing systems. The overall objective of this dissertation is to improve user experience of Chinese text entry on mobile devices. To achieve the goal, the author explores new interaction solutions and patterns of user behavior in the Chinese text entry process with various approaches including empirical studies and performance modeling. The work covers four means of Chinese text entry on mobile devices: Chinese handwriting recognition, Chinese indirect text entry with a rotator, Mandarin dictation, and Chinese pinyin input methods with a 12-key keypad. New design solutions for Chinese handwriting recognition and pinyin methods utilizing a rotator are proposed and proved being well accepted by users with empirical studies. A Mandarin short message dictation application for mobile phones is also presented , with two associated studies on human factors. Two studies were also carried out on Chinese pinyin input methods that are based on the 12-key keypad. The comparative study of five phrasal pinyin input methods led to design guidelines for the advanced feature of phrasal input. The second study of pinyin input methods produced a predictive model addressing users´ error-free speeds. Based on the conclusions from studies in this thesis, several additional research questions were identified for the future. For example, improvements are necessary to promote user performance on target selection process in Chinese text entry on mobile devices. Moreover, design and studies on stroke methods and Chinese specific soft keyboards are also required

Designing Text Entry Methods for Non-Verbal Vocal Input

Katedra počítačové grafiky a interakc

Designing Haptic Clues for Touchscreen Kiosks

Most interactive touchscreen kiosks are a challenge to accessibility: if graphics and sound fail in communication, the interaction process halts. In such a case, turning to the only remaining environmentally suited sense - the touch - is an intuitive option. To reinforce the interaction with interactive touchscreen kiosks it is possible to add haptic (touchable) feedback into the features of the device. The range of touchscreen-suited haptic technologies already enables some touch feedback from touchscreen surfaces and significant leaps still forward are being made at a constant rate. Due to this development it is relevant to review the human-centred factors affecting the design of haptic touchscreen in public kiosks. This thesis offers an overview for designing haptic clues for touchscreen kiosks. It emphasizes context sensitivity and the meaningfulness and communicability of different haptic design variants. As the main contribution, this thesis collects together the important considerations for the conscious design of haptic features in interactive kiosks and offers points of multimodal design considerations for designers intending to enrich their touchscreen interaction with haptic features

Investigating the effects of corpus and configuration on assistive input methods

Assistive technologies aim to provide assistance to those who are unable to perform various tasks in their day-to-day lives without tremendous difficulty. This includes — amongst other things — communicating with others. Augmentative and adaptive communication (AAC) is a branch of assistive technologies which aims to make communicating easier for people with disabilities which would otherwise prevent them from communicating efficiently (or, in some cases, at all). The input rate of these communication aids, however, is often constrained by the limited number of inputs found on the devices and the speed at which the user can toggle these inputs. A similar restriction is also often found on smaller devices such as mobile phones: these devices also often require the user to input text with a smaller input set, which often results in slower typing speeds. Several technologies exist with the purpose of improving the text input rates of these devices. These technologies include ambiguous keyboards, which allow users to input text using a single keypress for each character and trying to predict the desired word; word prediction systems, which attempt to predict the word the user is attempting to input before he or she has completed it; and word auto-completion systems, which complete the entry of predicted words before all the corresponding inputs have been pressed. This thesis discusses the design and implementation of a system incorporating the three aforementioned assistive input methods, and presents several questions regarding the nature of these technologies. The designed system is found to outperform a standard computer keyboard in many situations, which is a vast improvement over many other AAC technologies. A set of experiments was designed and performed to answer the proposed questions, and the results of the experiments determine that the corpus used to train the system — along with other tuning parameters — have a great impact on the performance of the system. Finally, the thesis also discusses the impact that corpus size has on the memory usage and response time of the system

Evolution and usability of mobile phone interaction styles

Over one billion people own or use cellular mobile telephones. Therefore, industry practitioners are faced with a question: how big steps can they take when designing the user interfaces for their new products, or how closely should they stick with the already existing user interface conventions that may already be familiar to the consumers. The objective of this research work is to create and communicate new knowledge for design and usability practitioners about how to design and evolve interaction style conventions in mainstream, voice-centric mobile telephones. In the context of this study, interaction style denotes the framework consisting of the physical interaction objects, the abstract interaction elements, and the associated behavior or interaction conventions that are applied throughout the core functionality of the mobile phone, but excludes the stylistic appearance elements of the user interface. The main research problem — how do mobile phone interaction style changes affect the initial usability of a mobile phone for users with earlier experience with mobile phones — is approached via several methods. A literature study compares the interaction styles applied in mainstream computing domains against the aspects relevant in the mobile phones domain. A heuristic analysis of contemporary mobile phones is used to formulate an understanding of the available interaction styles and analyze whether there is convergence towards specific types of interaction styles in the industry. An empirical usability testing experiment with 38 test users is conducted with a novel mobile phone interaction style to investigate differences between users who are already familiar with different mobile phone interaction styles. The study reveals that interaction styles applied in contemporary mobile telephones are designed around menu navigation, and they implement the three primary operations — Select, Back and Menu access — with dedicated hardkeys, context-sensitive softkeys, or using special control devices like joysticks or jog dials. The control keys in the contemporary interaction styles are converging around various two- and three-softkey conventions. The aspects related to indirect manipulation and small displays pose specific usability and UI design challenges on mobile phone user interfaces. The study shows that the mobile handset manufacturers are applying their usually proprietary interaction styles in a rather consistent manner in their products, with the notable exception of mobile Internet browsers that often break the underlying interaction style consistency. Based on the results from the empirical usability testing, we claim that despite differences between interaction styles in contemporary mobile phones, users do not face significant difficulties when transferring to a novel mobile phone model.reviewe

SHOP-Net: Moving from Paper to Mobile

Stock-ordering is one of the challenges that microenterprises face, because shop owners often need to leave their shops to travel to suppliers of goods. Triple Trust Organization (TTO) is a non-profit organization (NGO) that works with microenterprises around Cape Town and addresses this problem. They act as a supplier and fetch stock orders from shops they work with. Their ordering system relied on paper order forms and had a number of inefficiencies. To address these inefficiencies, a mobile-based stock-ordering system was designed with TTO. This system allows orders to be recorded and sent to a server at the TTO office using a mobile phone application where the orders are then processed. This system successfully increased TTO’s efficiency in three ways, namely, improved data processing ability, increased order accuracy and increased access to information. The evaluation was done according to their success criteria and the system has been in use for seven months. We argue that evaluations with NGOs should go further than just the management but include all of those affected by the system

User interface design guidelines for digital television virtual remote controls

The remote control is a pivotal component in households worldwide. It helps users enjoy leisurely television (TV) viewing. The remote control has various user interfaces that people interact with. For example, the physical user interface includes the shape of the remote and the physical buttons; the logical user interface refers to how the information is laid out; and the graphical user interface refers to the colours and aesthetic features of the remote control. All of the user interfaces together with the context of use, cultural factors, social factors, and prior experiences of the user influences the ways people interact with their remote control and ultimately has an effect on their user experiences. Advances in the broadcasting sector and transformations of the TV physical remote control have compounded the simple remote control into a multifaceted, indispensable device, overcrowded with buttons. The usability and ultimately the user experience of physical remote controls (PRCs) have been affected by the overloaded functionality and small button sizes. The usability issues with current PRCs, the evolution of mobile phones into touchscreen smartphones, and the trend of global companies moving towards virtual remote controls (VRCs) have prompted this research to discover what user interface design features will contribute towards an enhanced user experience for digital TV VRCs. This research used the design science research process model (DSRP), which comprised six steps, to investigate this topic area further. A review of the domain literature pertaining to mobile user experiences (MUX) and all the encompassing factors, mobile human computer interaction (MHCI) and the physical, logical, graphical and natural user interfaces was completed, as well as a review of the literature regarding the usability issues of PRCs and VRCs. A contextual task analysis (CTA) of a single South African digital TV PRC was used to identify how users utilise PRCs to perform tasks, and the usability issues they encountered during the tasks. Brainstorming focus groups were used to understand how to represent certain user interface elements and attempted to source ideas from users about what potential functionality digital TV VRCs should contain. Together with all the other results gathered from the previous chapters amalgamated into a set of user interface design guidelines for digital TV VRCs. The proposed user interface guidelines were used to instantiate a digital TV VRC prototype that underwent usability testing in order to validate the proposed user interface design guidelines. The results of the usability testing revealed that the user interface design guidelines for digital TV VRCs were successful, with the addition of one guideline that was discovered during the usability testing

Cartographic user interface design models for mobile Location-Based Services applications

Mobile Location-Based Services (mLBS) offer a unique combination of digital content, portability, interactivity, location-awareness and real-time information delivery, providing increased convenience and support for everyday geospatial decision-making tasks, compared to more traditional printed maps and digital cartographic products. In spite of their benefits, however, limitations inherent within mLBS technology (e.g. small screens), along with the dynamic and changeable contexts in which they are used, impact on their effectiveness for communicating geospatial information to end users and, in turn, their overall acceptance. Identifying usefulness (i.e. utility and usability) as a key factor influencing the acceptance of mLBS products, this thesis details the investigation of techniques and a methodology for designing mLBS applications that communicate geospatial information in a useful manner to non-expert, general public users. The research presented here focuses on the usefulness of the entire cartographic user interface (UI) for mLBS applications – i.e. those components that are specifically concerned with the access and representation of, and interaction with, geospatial information – differentiating it from related mLBS research and application design. Particular emphasis was placed on the usefulness of the interplay between various geospatial components of the cartographic UI, in support of a broad range of everyday geospatial tasks for non-expert users. Contributing to this, a wide array of alternative techniques for representing, presenting and interacting with geospatial information were explored. To achieve its aims, the study adopted a qualitative User-Centred Design (UCD) methodology, involving an early focus on users and their tasks, empirical measurement of usage, and iterative design and evaluation, which together ensured that all design efforts were firmly grounded in the needs and characteristics of the end users. Necessarily focused on a specific application area (tourism) and an associated user group (travellers), the UCD process employed by the research was more comprehensive than had previously been undertaken within the cartographic discipline. The primary results of the research comprise a set of cartographic UI design models for communicating geospatial information in a useful manner to the non-expert users of a tourism-related mLBS application. These incorporate a range of alternative cartographic representation, presentation and interaction techniques considered useful by representative users, with egocentric maps arguably holding the greatest importance. The wider benefits of the design models are expected to be twofold: firstly, they offer a structural foundation to researchers and developers seeking to produce useful cartographic UIs for tourism-related mLBS applications; and secondly, they provide guidance regarding specific cartographic representation, presentation and interaction techniques that offer utility and usability in particular contexts. In addition, a number of secondary research outputs offer other benefits to the scientific and commercial mLBS communities. These include the UCD research methodology – which presents a proven guide for ensuring usefulness during the design of mLBS applications in general – and a set of general recommendations for designing useful mLBS applications – which offer assistance for specific design activities while contributing empirical results to the future development of mLBS application design guidelines