Integrating passive ubiquitous surfaces into human-computer interaction

Mobile technologies enable people to interact with computers ubiquitously. This dissertation investigates how ordinary, ubiquitous surfaces can be integrated into human-computer interaction to extend the interaction space beyond the edge of the display. It turns out that acoustic and tactile features generated during an interaction can be combined to identify input events, the user, and the surface. In addition, it is shown that a heterogeneous distribution of different surfaces is particularly suitable for realizing versatile interaction modalities. However, privacy concerns must be considered when selecting sensors, and context can be crucial in determining whether and what interaction to perform.Mobile Technologien ermöglichen den Menschen eine allgegenwärtige Interaktion mit Computern. Diese Dissertation untersucht, wie gewöhnliche, allgegenwärtige Oberflächen in die Mensch-Computer-Interaktion integriert werden können, um den Interaktionsraum über den Rand des Displays hinaus zu erweitern. Es stellt sich heraus, dass akustische und taktile Merkmale, die während einer Interaktion erzeugt werden, kombiniert werden können, um Eingabeereignisse, den Benutzer und die Oberfläche zu identifizieren. Darüber hinaus wird gezeigt, dass eine heterogene Verteilung verschiedener Oberflächen besonders geeignet ist, um vielfältige Interaktionsmodalitäten zu realisieren. Bei der Auswahl der Sensoren müssen jedoch Datenschutzaspekte berücksichtigt werden, und der Kontext kann entscheidend dafür sein, ob und welche Interaktion durchgeführt werden soll

The architectural nature of the illustrated books of Iliazd : (Ilia Zdanevich, 1894-1975)

Cette thèse propose l’application de la conception de la promenade architecturale à une sélection de quatre livres qui ont été conçus et produits par Iliazd (Ilia Zdanevitch, 1894-1975, né à Tiflis, en la Géorgie). Les quatre livres sont Pismo (1948), Poésie de mots inconnus (1949), Chevaux de minuit (1956), et Le Courtisan grotesque (1974). Toutes les éditions d’Iliazd avaient des structures soigneusement conçues et aussi des intégrations de textes imprimés et d’éléments gravés, au contraire des designs génériques de ses contemporains, mais chacun de ces quatre livres présentent aussi des variations successives de pliages atypiques. Les structures expérimentales de ces livres demandent considération comme des constructions architecturales, qui a été reconnue par les spécialistes. Les architectoniques complexes des livres exigent un vocabulaire critique du genre suggéré par la promenade architecturale de Le Corbusier, qui a été proposée comme la base pour les structures de ses bâtiments. En effet, la promenade architecturale affirme une chaîne d’événements qui dirige l’explorateur de ses édifices aux pointes de perspective successives, lesquelles présentent des vues internes et externes pendant l’ascension de l’entrée jusqu’au toit. Flora Samuel a écrit une monographie (The Elements of Le Corbusier’s Architectural Promenade, 2010), dans laquelle elle propose cinq étapes pour la promenade. Des modifications de ses étapes sont utilisées par cette étude, altérées pour la transition d’un bâtiment à un livre. Ces étapes, dont certaines sont descriptives et certaines analytiques, tant qu’elles soient présentées comme l’expérience probable d’un spectateur général, sont basées sur ma connaissance personnelle de tous les détails des structures de ces livres. Ces structures complexes, même fascinantes, ne sont pas le but, mais plutôt le soutien habilitant d’une expérience esthétique individuelle. Cette étude affirme que la promenade architecturale illumine l’expérience de la conception unique d’Iliazd du livre illustré, permettant une appréciation sans précédent de leur complexité.This dissertation proposes the application of Le Corbusier’s conception of the architectural promenade to a selection of four distinctive illustrated books conceived and produced by Iliazd (Ilia Zdanevich, 1894-1975, born Tiflis, Georgia). The four books examined in this study are Pismo (1948), Poésie de mots inconnus (1949), Chevaux de minuit (1956), and Le Courtisan grotesque (1974). While all of Iliazd’s editions featured carefully conceived structures and integrations of typeset texts and engraved elements, as opposed to the largely generic designs of his contemporaries, each of these four books in particular presents successive variations of atypical page foldings. The experimental structures of these books allow for their justifiable designation as architectural constructions, as scholars have previously recognized. The complex architectonics of the books demands a critical vocabulary of the kind Le Corbusier’s architectural promenade, which has been broadly proposed as the basis for the structures of his buildings, provides. The architectural promenade in effect asserts a chain of elements which guide the explorer of Le Corbusier’s buildings to successive perspective points, which present views of internal and external spaces during an ascent from entry level to rooftop. Flora Samuel wrote a monograph (The Elements of Le Corbusier’s Architectural Promenade, 2010) in which she proposed five stages for the promenade. Modifications of her stages are used for the present study, altered for the transition from building to book. These stages, some of which are descriptive and some analytical, while presented as the likely experience of a general viewer, are based on my individual understanding of all the details of the structures of these books. The complex structures, while fascinating, are not an end in themselves, but rather the enabling support of an individual aesthetic experience. This study asserts that the architectural promenade illuminates the experience of Iliazd’s unique conception of the illustrated book, enabling a hitherto unparalleled appreciation of their complexity

Pattern Recognition

A wealth of advanced pattern recognition algorithms are emerging from the interdiscipline between technologies of effective visual features and the human-brain cognition process. Effective visual features are made possible through the rapid developments in appropriate sensor equipments, novel filter designs, and viable information processing architectures. While the understanding of human-brain cognition process broadens the way in which the computer can perform pattern recognition tasks. The present book is intended to collect representative researches around the globe focusing on low-level vision, filter design, features and image descriptors, data mining and analysis, and biologically inspired algorithms. The 27 chapters coved in this book disclose recent advances and new ideas in promoting the techniques, technology and applications of pattern recognition

Change blindness: eradication of gestalt strategies

Arrays of eight, texture-defined rectangles were used as stimuli in a one-shot change blindness (CB) task where there was a 50% chance that one rectangle would change orientation between two successive presentations separated by an interval. CB was eliminated by cueing the target rectangle in the first stimulus, reduced by cueing in the interval and unaffected by cueing in the second presentation. This supports the idea that a representation was formed that persisted through the interval before being 'overwritten' by the second presentation (Landman et al, 2003 Vision Research 43149–164]. Another possibility is that participants used some kind of grouping or Gestalt strategy. To test this we changed the spatial position of the rectangles in the second presentation by shifting them along imaginary spokes (by ±1 degree) emanating from the central fixation point. There was no significant difference seen in performance between this and the standard task [F(1,4)=2.565, p=0.185]. This may suggest two things: (i) Gestalt grouping is not used as a strategy in these tasks, and (ii) it gives further weight to the argument that objects may be stored and retrieved from a pre-attentional store during this task

Non-Visual Representation of Complex Documents for Use in Digital Talking Books

Essential written information such as text books, bills, and catalogues needs to be accessible by everyone. However, access is not always available to vision-impaired people. As they require electronic documents to be available in specific formats. In order to address the accessibility issues of electronic documents, this research aims to design an affordable, portable, standalone and simple to use complete reading system that will convert and describe complex components in electronic documents to print disabled users

Behavioural biometric identification based on human computer interaction

As we become increasingly dependent on information systems, personal identification and profiling systems have received an increasing interest, either for reasons of personali- sation or security. Biometric profiling is one means of identification which can be achieved by analysing something the user is or does (e.g., a fingerprint, signature, face, voice). This Ph.D. research focuses on behavioural biometrics, a subset of biometrics that is concerned with the patterns of conscious or unconscious behaviour of a person, involving their style, preference, skills, knowledge, motor-skills in any domain. In this work I explore the cre- ation of user profiles to be applied in dynamic user identification based on the biometric pat- terns observed during normal Human-Computer Interaction (HCI) by continuously logging and tracking the corresponding computer events. Unlike most of the biometrics systems that need special hardware devices (e.g. finger print reader), HCI-based identification sys- tems can be implemented using regular input devices (mouse or keyboard) and they do not require the user to perform specific tasks to train the system. Specifically, three components are studied in-depth: mouse dynamics, keystrokes dynamics and GUI based user behaviour. In this work I will describe my research on HCI-based behavioural biometrics, discuss the features and models I proposed for each component along with the result of experiments. In addition, I will describe the methodology and datasets I gathered using my LoggerMan application that has been developed specifically to passively gather behavioural biometric data for evaluation. Results show that normal Human-Computer Interaction reveals behavioural information with discriminative power sufficient to be used for user modelling for identification purposes

'A New Type of Part Writing': Notation and Performance in Beethoven's Late String Quartets

Beethoven’s late string quartets are among his most extraordinary and elusive works. A source of fascination to performers, audiences and scholars alike for nearly two centuries, they are defined by an aesthetic of ‘difficulty’. This thesis argues that one crucial source of difficulty lies in Beethoven’s eccentric uses of notation in the quartets – a difficulty that has had profound implications for the future study and performance of the works. Mirroring the stylistic pluralities of the late quartets themselves, issues of notation and performance are explored through a variety of methodologies, drawn from the digital humanities, Peircean semiotics, anthropology and critical theory. Although the late quartets are the central impetus, this thesis is ultimately about the relational nature of creativity. It conceives of notation not as a textual codification of the composer’s intentions, a private act of composition in the mind, but rather as a mediating material that describes, enacts, engenders, and is dependent upon, social activity. Using Wagner’s notion of Beethoven’s ‘Hearing Eyes’, Chapter 1 considers the influences of Beethoven’s material, writerly approach to composition in his later years and the peculiarly textual emphasis of the quartets’ early reception. Through an analogy with maps and scores, it highlights the importance of considering notation from the perspective of individual performers’ parts. Chapter 2 situates the notational complexity of the late quartets within Beethoven’s entire output through the use of computational methods and statistical analysis. In contrast, Chapter 3 maps a networked understanding of Beethoven’s notation and explores its inextricable entanglement in the social, political and technological currents of 1820s Vienna. Using Alfred Gell’s theory of art and agency, Chapter 4 extends this network to include non-human actors and examines the different ‘material lives’ of the string quartets, both past and present. Ethnographic methods and the insights of twenty-first-century performers are employed to situate this material agency in practice in Chapter 5. The final chapter engages Theodor Adorno’s seminal work on Beethoven’s late style to mediate a very personal source of insight into the unique difficulties of the late quartets: my own, as performer, scholar and listener

PAPIERCRAFT: A PAPER-BASED INTERFACE TO SUPPORT INTERACTION WITH DIGITAL DOCUMENTS

Many researchers extensively interact with documents using both computers and paper printouts, which provide an opposite set of supports. Paper is comfortable to read from and write on, and it is flexible to be arranged in space; computers provide an efficient way to archive, transfer, search, and edit information. However, due to the gap between the two media, it is difficult to seamlessly integrate them together to optimize the user's experience of document interaction. Existing solutions either sacrifice inherent paper flexibility or support very limited digital functionality on paper. In response, we have proposed PapierCraft, a novel paper-based interface that supports rich digital facilities on paper without sacrificing paper's flexibility. By employing the emerging digital pen technique and multimodal pen-top feedback, PapierCraft allows people to use a digital pen to draw gesture marks on a printout, which are captured, interpreted, and applied to the corresponding digital copy. Conceptually, the pen and the paper form a paper-based computer, able to interact with other paper sheets and computing devices for operations like copy/paste, hyperlinking, and web searches. Furthermore, it retains the full range of paper advantages through the light-weighted, pen-paper-only interface. By combining the advantages of paper and digital media and by supporting the smooth transition between them, PapierCraft bridges the paper-computer gap. The contributions of this dissertation focus on four respects. First, to accommodate the static nature of paper, we proposed a pen-gesture command system that does not rely on screen-rendered feedback, but rather on the self-explanatory pen ink left on the paper. Second, for more interactive tasks, such as searching for keywords on paper, we explored pen-top multimodal (e.g. auditory, visual, and tactile) feedback that enhances the command system without sacrificing the inherent paper flexibility. Third, we designed and implemented a multi-tier distributed infrastructure to map pen-paper interactions to digital operations and to unify document interaction on paper and on computers. Finally, we systematically evaluated PapierCraft through three lab experiments and two application deployments in the areas of field biology and e-learning. Our research has demonstrated the feasibility, usability, and potential applications of the paper-based interface, shedding light on the design of the future interface for digital document interaction. More generally, our research also contributes to ubiquitous computing, mobile interfaces, and pen-computing

Collected Papers (Neutrosophics and other topics), Volume XIV

This fourteenth volume of Collected Papers is an eclectic tome of 87 papers in Neutrosophics and other fields, such as mathematics, fuzzy sets, intuitionistic fuzzy sets, picture fuzzy sets, information fusion, robotics, statistics, or extenics, comprising 936 pages, published between 2008-2022 in different scientific journals or currently in press, by the author alone or in collaboration with the following 99 co-authors (alphabetically ordered) from 26 countries: Ahmed B. Al-Nafee, Adesina Abdul Akeem Agboola, Akbar Rezaei, Shariful Alam, Marina Alonso, Fran Andujar, Toshinori Asai, Assia Bakali, Azmat Hussain, Daniela Baran, Bijan Davvaz, Bilal Hadjadji, Carlos Díaz Bohorquez, Robert N. Boyd, M. Caldas, Cenap Özel, Pankaj Chauhan, Victor Christianto, Salvador Coll, Shyamal Dalapati, Irfan Deli, Balasubramanian Elavarasan, Fahad Alsharari, Yonfei Feng, Daniela Gîfu, Rafael Rojas Gualdrón, Haipeng Wang, Hemant Kumar Gianey, Noel Batista Hernández, Abdel-Nasser Hussein, Ibrahim M. Hezam, Ilanthenral Kandasamy, W.B. Vasantha Kandasamy, Muthusamy Karthika, Nour Eldeen M. Khalifa, Madad Khan, Kifayat Ullah, Valeri Kroumov, Tapan Kumar Roy, Deepesh Kunwar, Le Thi Nhung, Pedro López, Mai Mohamed, Manh Van Vu, Miguel A. Quiroz-Martínez, Marcel Migdalovici, Kritika Mishra, Mohamed Abdel-Basset, Mohamed Talea, Mohammad Hamidi, Mohammed Alshumrani, Mohamed Loey, Muhammad Akram, Muhammad Shabir, Mumtaz Ali, Nassim Abbas, Munazza Naz, Ngan Thi Roan, Nguyen Xuan Thao, Rishwanth Mani Parimala, Ion Pătrașcu, Surapati Pramanik, Quek Shio Gai, Qiang Guo, Rajab Ali Borzooei, Nimitha Rajesh, Jesús Estupiñan Ricardo, Juan Miguel Martínez Rubio, Saeed Mirvakili, Arsham Borumand Saeid, Saeid Jafari, Said Broumi, Ahmed A. Salama, Nirmala Sawan, Gheorghe Săvoiu, Ganeshsree Selvachandran, Seok-Zun Song, Shahzaib Ashraf, Jayant Singh, Rajesh Singh, Son Hoang Le, Tahir Mahmood, Kenta Takaya, Mirela Teodorescu, Ramalingam Udhayakumar, Maikel Y. Leyva Vázquez, V. Venkateswara Rao, Luige Vlădăreanu, Victor Vlădăreanu, Gabriela Vlădeanu, Michael Voskoglou, Yaser Saber, Yong Deng, You He, Youcef Chibani, Young Bae Jun, Wadei F. Al-Omeri, Hongbo Wang, Zayen Azzouz Omar