A new user interface for musical timbre design

This thesis characterises and addresses problems and issues associated with the design of intuitive user interfaces for timbral control. The usability of a range of synthesis methods and representative implementations of these methods is assessed, and three interface architectures - fixed architecture, architecture specification and direct specification - are identified. The characteristics of each of these architectures, as well as problems of usability inherent to each of them are discussed; it is argued that none of them provide intuitive tools for the manipulation and control of timbre. The study examines the nature of timbre and the notion of timbre space; different kinds of timbre space are considered and criteria are proposed for the selection of suitable timbre spaces as vehicles for synthesis. A number of listening tests, designed to demonstrate the feasibility of subsequent work, were devised and carried out; the results of these tests provide evidence that, where Euclidean distances between sounds located in a given timbre space are reflected in perceptual distances, the ability of subjects to detect relative distances in different parts of the space varies with the perceptual granularity of the space. Three contrasting timbre spaces conforming to the proposed criteria for use in synthesis are constructed; the purpose of these spaces is to provide an environment for a novel user interaction approach for timbral design which incorporates a search strategy based on weighted centroid localization. Two prototypes which exemplify the proposed approach in alternative ways are designed, implemented and tested with potential users in order to validate the approach; a third contrasting prototype which represents a simple contrasting alternative is tested for purposes of comparison. The results of these tests are evaluated and discussed, and areas of further work identified

Emerging Technologies for Hydrologic and Water Quality Modeling Research

During the past two decades there has been a dramatic increase in the development and application of hydrologic and water quality models to evaluate complex environmental processes and to assess nonpoint source pollution of soil and water resources. Recognizing that advancements in modeling continue to be driven by developments in computer technology, it is worthwhile to examine some of the current and emerging computer technologies that hold great promise for advancing the use of hydrologic and water quality models. An attempt is made to forecast and briefly discuss the impact that technologies such as geographic information systems, global positioning systems, and scientific visualization will have on the future of hydrologic and water quality modeling. Forecasting is a very risky business, not because of our chronic inability to predict what will happen in the future but also because such speculation raises questions about what we modelers and model users desire and value. The thesis of this article is that some current and most of the emerging technologies will facilitate development and widespread use of hydrologic and water quality models for water resources management and decision making in the future

Visualization in spatial modeling

This chapter deals with issues arising from a central theme in contemporary computer modeling - visualization. We first tie visualization to varieties of modeling along the continuum from iconic to symbolic and then focus on the notion that our models are so intrinsically complex that there are many different types of visualization that might be developed in their understanding and implementation. This focuses the debate on the very way of 'doing science' in that patterns and processes of any complexity can be better understood through visualizing the data, the simulations, and the outcomes that such models generate. As we have grown more sensitive to the problem of complexity in all systems, we are more aware that the twin goals of parsimony and verifiability which have dominated scientific theory since the 'Enlightenment' are up for grabs: good theories and models must 'look right' despite what our statistics and causal logics tell us. Visualization is the cutting edge of this new way of thinking about science but its styles vary enormously with context. Here we define three varieties: visualization of complicated systems to make things simple or at least explicable, which is the role of pedagogy; visualization to explore unanticipated outcomes and to refine processes that interact in unanticipated ways; and visualization to enable end users with no prior understanding of the science but a deep understanding of the problem to engage in using models for prediction, prescription, and control. We illustrate these themes with a model of an agricultural market which is the basis of modern urban economics - the von Thünen model of land rent and density; a model of urban development based on interacting spatial and temporal processes of land development - the DUEM model; and a pedestrian model of human movement at the fine scale where control of such movements to meet standards of public safety is intrinsically part of the model about which the controllers know intimately. © Springer-Verlag Berlin Heidelberg 2006

Automating Software Development for Mobile Computing Platforms

Mobile devices such as smartphones and tablets have become ubiquitous in today\u27s computing landscape. These devices have ushered in entirely new populations of users, and mobile operating systems are now outpacing more traditional desktop systems in terms of market share. The applications that run on these mobile devices (often referred to as apps ) have become a primary means of computing for millions of users and, as such, have garnered immense developer interest. These apps allow for unique, personal software experiences through touch-based UIs and a complex assortment of sensors. However, designing and implementing high quality mobile apps can be a difficult process. This is primarily due to challenges unique to mobile development including change-prone APIs and platform fragmentation, just to name a few. in this dissertation we develop techniques that aid developers in overcoming these challenges by automating and improving current software design and testing practices for mobile apps. More specifically, we first introduce a technique, called Gvt, that improves the quality of graphical user interfaces (GUIs) for mobile apps by automatically detecting instances where a GUI was not implemented to its intended specifications. Gvt does this by constructing hierarchal models of mobile GUIs from metadata associated with both graphical mock-ups (i.e., created by designers using photo-editing software) and running instances of the GUI from the corresponding implementation. Second, we develop an approach that completely automates prototyping of GUIs for mobile apps. This approach, called ReDraw, is able to transform an image of a mobile app GUI into runnable code by detecting discrete GUI-components using computer vision techniques, classifying these components into proper functional categories (e.g., button, dropdown menu) using a Convolutional Neural Network (CNN), and assembling these components into realistic code. Finally, we design a novel approach for automated testing of mobile apps, called CrashScope, that explores a given android app using systematic input generation with the intrinsic goal of triggering crashes. The GUI-based input generation engine is driven by a combination of static and dynamic analyses that create a model of an app\u27s GUI and targets common, empirically derived root causes of crashes in android apps. We illustrate that the techniques presented in this dissertation represent significant advancements in mobile development processes through a series of empirical investigations, user studies, and industrial case studies that demonstrate the effectiveness of these approaches and the benefit they provide developers

The Friendly Health Issue Network to Support Computer-Assisted Education for Clinical Reasoning in Multimorbidity Patients

Clinical reasoning in multimorbidity conditions asks for the ability to anticipate the possible evolutions of the overall health state of a patient and to identify the interactions among the concurrent health issues and their treatments. The HIN (Health Issue Network) approach, as Petri Nets-based formal language, is introduced as capable of providing a novel perspective to facilitate the acquisition of such competencies, graphically representing the network among a set of health issues (HIs) that affect a person throughout their life, and describing how HIs evolve over time. The need to provide a more immediate user-oriented interface has led to the development of f-HIN (friendly HIN), a lighter version based on the same mathematical properties as HIN, from which stems in turn the f-HINe (friendly HIN extracted) model, used to represent networks related to either real patients’ clinical experiences extracted from electronic health records, or from teacher-designed realistic clinical histories. Such models have also been designed to be embedded in a software learning environment that allows drawing a f-HIN diagram, checking for its format correctness, as well as designing clinical exercises for the learners, including their computer-assisted assessment. The present paper aims at introducing and discussing the f-HIN/f-HINe models and their educational use. It also introduces the main features of the software learning environment it was built upon, pointing out its importance to: (i) help medical teachers in designing and representing the context of a learning outcome; and (ii) handle the complex history of a multimorbidity patient, to be conveyed in Case-Based Learning (CBL) exercises

GPU Computing for Cognitive Robotics

This thesis presents the first investigation of the impact of GPU computing on cognitive robotics by providing a series of novel experiments in the area of action and language acquisition in humanoid robots and computer vision. Cognitive robotics is concerned with endowing robots with high-level cognitive capabilities to enable the achievement of complex goals in complex environments. Reaching the ultimate goal of developing cognitive robots will require tremendous amounts of computational power, which was until recently provided mostly by standard CPU processors. CPU cores are optimised for serial code execution at the expense of parallel execution, which renders them relatively inefficient when it comes to high-performance computing applications. The ever-increasing market demand for high-performance, real-time 3D graphics has evolved the GPU into a highly parallel, multithreaded, many-core processor extraordinary computational power and very high memory bandwidth. These vast computational resources of modern GPUs can now be used by the most of the cognitive robotics models as they tend to be inherently parallel. Various interesting and insightful cognitive models were developed and addressed important scientific questions concerning action-language acquisition and computer vision. While they have provided us with important scientific insights, their complexity and application has not improved much over the last years. The experimental tasks as well as the scale of these models are often minimised to avoid excessive training times that grow exponentially with the number of neurons and the training data. This impedes further progress and development of complex neurocontrollers that would be able to take the cognitive robotics research a step closer to reaching the ultimate goal of creating intelligent machines. This thesis presents several cases where the application of the GPU computing on cognitive robotics algorithms resulted in the development of large-scale neurocontrollers of previously unseen complexity enabling the conducting of the novel experiments described herein.European Commission Seventh Framework Programm

Music interaction: understanding music and human-computer interaction

We introduce and review recent research in Music and Human Computer Interaction, also known as Music Interaction. After a general overview of the discipline, we analyse the themes and issues raised by the fifteen chapters of this book, each of which presents recent research in this field. The bulk of this chapter is organised as an FAQ. This enables some FAQs to focus on cross cutting issues that appear in multiple chapters, and some chapters to feature in multiple FAQs. Broad topics include: the scope of research in Music Interaction; the role of HCI in Music Interaction; and conversely, the role of Music Interaction in HCI. High-level themes include embodied cognition, spatial cognition, evolutionary interaction, gesture, formal language, affective interaction, and methodologies from social science. Musical activities of interest include performance, composition, analysis, collaborative music making, and human and machine improvisation. Specific issues include: whether Music Interaction should be easy; what can be learned from the experience of being “in the groove”, and what can be learned from the deep commitment of musical amateurs. Broader issues include: what Music Interaction can offer traditional instruments and traditional musical activities; what relevance it has for non-musical domains; and ways in which Music Interaction can enable entirely new musical activities possible