Visual collaging of music in a digital library

This article explores the role visual browsing can play within a digital music library. The context to the work is provided through a review of related techniques drawn from the fields of digital libraries and human computer interaction. Implemented within the open source digital library toolkit Greenstone, a prototype system is described that combines images located through textual metadata with a visualisation technique known as collaging to provide a leisurely, undirected interaction with a music collection. Emphasis in the article is given to the augmentations of the basic technique to work in the musical domain

Digital libraries for creative communities

Digital library technologies have a great deal to offer to creative, design communities. They can enable large collections of text, images, music, video and other information objects to be organised and accessed in interesting and diverse ways. Ordinary people—people not traditionally viewed as 'creators' or 'designers'—can now conceive, assemble, build, and disseminate new information collections. This paper explores the development rationale behind the Greenstone digital library technology. We also examine three examples of creative new techniques for accessing and presenting information in digital libraries and stress the importance of tailoring information access to support the requirements of the users and application area

Digital libraries on an iPod: Beyond the client-server model

This paper describes an experimental system that enhanced an iPod with digital library capabilities. Using the open source digital library software Greenstone as a base, this paper more specifically maps out the technical steps necessary to achieve this, along with an account of our subsequent experimentation. This included command-line usage of Greenstone's basic runtime system on the device, augmenting the iPod’s main interactive menu-driven application to include searching and hierarchical browsing of digital library collections stored locally, and a selection of "launcher" applications for target documents such as text files, images and audio. Media rich applications for digital stories and collaging were also developed. We also configured the iPod to run as a web server to provide digital library content to others over a network, effectively turning the traditional mobile client-server upsidedown

Exploring the user experience through collage

We explore the use of collage in requirements elicitation, as a tool to support potential end-users in expressing their impressions, understanding, and emotions regarding a system

On Birthing Dancing Stars: The Need for Bounded Chaos in Information Interaction

While computers causing chaos is acommon social trope, nearly the entirety of the history of computing is dedicated to generating order. Typical interactive information retrieval tasks ask computers to support the traversal and exploration of large, complex information spaces. The implicit assumption is that they are to support users in simplifying the complexity (i.e. in creating order from chaos). But for some types of task, particularly those that involve the creative application or synthesis of knowledge or the creation of new knowledge, this assumption may be incorrect. It is increasingly evident that perfect order—and the systems we create with it—support highly-structured information tasks well, but provide poor support for less-structured tasks.We need digital information environments that help create a little more chaos from order to spark creative thinking and knowledge creation. This paper argues for the need for information systems that offerwhat we term ‘bounded chaos’, and offers research directions that may support the creation of such interface

Particle staining: physically based texture generation

Computers are being employed in a variety of ways by a variety of individuals to create imagery. Much work has been done to accurately model natural phenomena in the context of computer graphics as well as model specific artists' tools and techniques. Focusing on the dynamics of water flow across surfaces, it is the goal of this work to develop a physically inspired texturing tool that allows artists to create interesting staining and wearing effects on surfaces. Weathering or the wearing down of materials by natural forces can create complex and beautiful patterns on a variety of surfaces. In this process lies the very essence of the creative act. To distill the essence of the elements of the water staining process, we employ a computer generated particle system in a phenomenological model. The motion of these particles is controlled by physically based constraints, such as wind, gravity, mass, etc. The way in which each particle interacts with or modifies the look of the surface is further controlled by parameters such as surface roughness, surface color and surface hardness. Each particle can remove or deposit material as it flows across the surface, creating complex patterns

CreativeConnect: Supporting Reference Recombination for Graphic Design Ideation with Generative AI

Graphic designers often get inspiration through the recombination of references. Our formative study (N=6) reveals that graphic designers focus on conceptual keywords during this process, and want support for discovering the keywords, expanding them, and exploring diverse recombination options of them, while still having room for designers' creativity. We propose CreativeConnect, a system with generative AI pipelines that helps users discover useful elements from the reference image using keywords, recommends relevant keywords, generates diverse recombination options with user-selected keywords, and shows recombinations as sketches with text descriptions. Our user study (N=16) showed that CreativeConnect helped users discover keywords from the reference and generate multiple ideas based on them, ultimately helping users produce more design ideas with higher self-reported creativity compared to the baseline system without generative pipelines. While CreativeConnect was shown effective in ideation, we discussed how CreativeConnect can be extended to support other types of tasks in creativity support

Semantics of time travel in a generative information space

This thesis focuses on interactive and computational semantics for manipulating the time-based medium of an evolving information space. The interactive semantics enable the user to engage in linear timeline traversal and non-linear history manipulation. Extended tape recorder metaphor controls, including jog-shuttle based navigation, provide the user with flexible means for operating the software's generative functionalities, and linearly traversing session history. The user can see previews of information space states while traversing the history using the jog-shuttle. We also introduce a door-latch metaphor that enables one of several considered forms of nonlinear history manipulation. Users can change history by retroactively latching an information sample in its position across time. For representing the information space history, we have developed MPEG-like computational keyframe semantics. This representation is in the form of XML, which is generated automatically and converted back to Java by a framework named ecologylab.xml, which was developed as a part of this thesis. These computational keyframe semantics serve as the basis for interaction semantics. A user study was conducted in the form of a design competition, to evaluate these new features. The results indicated that the users do find the time travel features useful and they feel more in-control of the information space with access to time travel features compared to the case when time travel features are not present

From Sit-Forward to Lean-Back: Using a Mobile Device to Vary Interactive Pace

Although online, handheld, mobile computers offer new possibilities in searching and retrieving information on the go, the fast-paced, “sit -forward” style of interaction may not be appropriate for all user search needs. In this paper, we explore how a handheld computer can be used to enable interactive search experiences that vary in pace from fast and immediate through to reflective and delayed. We describe a system that asynchronously combines an offline handheld computer and an online desktop Personal Computer, and discuss some results of an initial user evaluation