Interactive Technologies for the Public Sphere Toward a Theory of Critical Creative Technology

Digital media cultural practices continue to address the social, cultural and aesthetic contexts of the global information economy, perhaps better called ecology, by inventing new methods and genres that encourage interactive engagement, collaboration, exploration and learning. The theoretical framework for creative critical technology evolved from the confluence of the arts, human computer interaction, and critical theories of technology. Molding this nascent theoretical framework from these seemingly disparate disciplines was a reflexive process where the influence of each component on each other spiraled into the theory and practice as illustrated through the Constructed Narratives project. Research that evolves from an arts perspective encourages experimental processes of making as a method for defining research principles. The traditional reductionist approach to research requires that all confounding variables are eliminated or silenced using methods of statistics. However, that noise in the data, those confounding variables provide the rich context, media, and processes by which creative practices thrive. As research in the arts gains recognition for its contributions of new knowledge, the traditional reductive practice in search of general principles will be respectfully joined by methodologies for defining living principles that celebrate and build from the confounding variables, the data noise. The movement to develop research methodologies from the noisy edges of human interaction have been explored in the research and practices of ludic design and ambiguity (Gaver, 2003); affective gap (Sengers et al., 2005b; 2006); embodied interaction (Dourish, 2001); the felt life (McCarthy & Wright, 2004); and reflective HCI (Dourish, et al., 2004). The theory of critical creative technology examines the relationships between critical theories of technology, society and aesthetics, information technologies and contemporary practices in interaction design and creative digital media. The theory of critical creative technology is aligned with theories and practices in social navigation (Dourish, 1999) and community-based interactive systems (Stathis, 1999) in the development of smart appliances and network systems that support people in engaging in social activities, promoting communication and enhancing the potential for learning in a community-based environment. The theory of critical creative technology amends these community-based and collaborative design theories by emphasizing methods to facilitate face-to-face dialogical interaction when the exchange of ideas, observations, dreams, concerns, and celebrations may be silenced by societal norms about how to engage others in public spaces. The Constructed Narratives project is an experiment in the design of a critical creative technology that emphasizes the collaborative construction of new knowledge about one's lived world through computer-supported collaborative play (CSCP). To construct is to creatively invent one's world by engaging in creative decision-making, problem solving and acts of negotiation. The metaphor of construction is used to demonstrate how a simple artefact - a building block - can provide an interactive platform to support discourse between collaborating participants. The technical goal for this project was the development of a software and hardware platform for the design of critical creative technology applications that can process a dynamic flow of logistical and profile data from multiple users to be used in applications that facilitate dialogue between people in a real-time playful interactive experience

Supporting Collaborative Learning in Computer-Enhanced Environments

As computers have expanded into almost every aspect of our lives, the ever-present graphical user interface (GUI) has begun facing its limitations. Demanding its own share of attention, GUIs move some of the users\u27 focus away from the task, particularly when the task is 3D in nature or requires collaboration. Researchers are therefore exploring other means of human-computer interaction. Individually, some of these new techniques show promise, but it is the combination of multiple approaches into larger systems that will allow us to more fully replicate our natural behavior within a computing environment. As computers become more capable of understanding our varied natural behavior (speech, gesture, etc.), the less we need to adjust our behavior to conform to computers\u27 requirements. Such capabilities are particularly useful where children are involved, and make using computers in education all the more appealing. Herein are described two approaches and implementations of educational computer systems that work not by user manipulation of virtual objects, but rather, by user manipulation of physical objects within their environment. These systems demonstrate how new technologies can promote collaborative learning among students, thereby enhancing both the students\u27 knowledge and their ability to work together to achieve even greater learning. With these systems, the horizon of computer-facilitated collaborative learning has been expanded. Included among this expansion is identification of issues for general and special education students, and applications in a variety of domains, which have been suggested

Proceedings of the 6th international conference on disability, virtual reality and associated technologies (ICDVRAT 2006)

The proceedings of the conferenc

The Complementarity of Tangible and Paper Interfaces in Tabletop Environments for Collaborative Learning

The current trend in Human-Computer Interaction aims at bridging the gap between the digital and the real world, exploring novel ways to engage users with computational devices. Computers take new forms that are better integrated into our environment and can be embedded in buildings, furniture or clothes. Novel forms of interfaces take advantage of people's intuitive knowledge of everyday objects to offer more direct and natural interactions. Tangible User Interfaces (TUIs) allow users to interact with digital objects through tangible artifacts, building on their rich physical affordances. Paper User Interfaces (PUIs) add digital capabilities to paper documents, synchronizing for instance their content with their digital counterpart. Unique properties of paper are also used to create engaging and intuitive interfaces to computer applications. This dissertation is interested in the complementarity of tangible and paper interfaces in tabletop environments. We introduce the concept of Tangible and Paper Environments (TaPEs) where Interactive Paper Forms (IPFs), a particular type of PUIs based on the paper form metaphor, are used as a complementary interface to a TUI. We evaluate the potential of IPFs to overcome two main shortcomings of TUIs, in terms of scalability and pedagogy. The scalability issue comes from the limited expressiveness of task-specific physical artifacts, which offer rich physical affordances but limit the complexity of applications that can be controlled by a TUI. The pedagogy issue is raised by the lack of consistent evidence regarding the use of physical manipulatives in educational settings, which is one of the main application domain of TUIs. IPFs overcome the scalability issue by offering a set of generic interaction elements that allow TaPEs to cope with applications of any complexity. In a pedagogical setting, IPFs present learners with abstract representation which facilitate understanding by the embodied and concrete representations offered by tangible artifacts. A TaPE, the Tinker Environment, has been developed with two logistics teachers in the context of the Swiss vocational training system. It consists of a warehouse physical small-scale model (TUI) and TinkerSheets, our implementation of IPFs. It aims at helping apprentices understand theoretical concepts presented at schools. We followed a Design-based Research (DBR) approach: ten studies were conducted during the development of the Tinker Environment in authentic classroom settings. Controlled experiments were conducted to address specific questions. v The general research questions concern the respective affordances of paper and tangible components of TaPEs. The analysis is not limited to usability aspects but also considers their impact on group problem-solving activities and their potential in terms of integration of the system in its context of use. A descriptive model is proposed, built around three interaction circles: individual (usability), group (collaboration) and context (integration). Results identify design guidelines that limit the impact of the less direct interaction modality offered by IPFs, allowing TaPEs to overcome the scalability issue while supporting rich interactions. At the group level, observations of groups of apprentices solving problems around the Tinker Environment show that the consistent physical interaction modality offered by TaPEs naturally supports collaborative interactions. Apprentices tend to take implicit roles based on their location around the system. Regarding the context circle, we observed that carefully designed IPFs play the role of bridges between offline and online activities and contribute to a tight integration of the system in a its context (i.e. a classroom). The specific research questions address the potential of the Tinker Environment in this pedagogical context and its appropriation by teachers. The observations conducted with the Tinker Environment show that the warehouse small-scale model reduces the complexity of problems and allows apprentices to engage in meaningful problem-solving activities. Controlled experiments comparing a TUI to a mulitouch interface demonstrate that tangible artifacts lead to a higher learning gain and an increased performance in a problem-solving activity. Collaboration quality and perceived playfulness are also improved. The teacher plays a central role in the use of the environment, guiding apprentices through activities and encouraging reflections during debriefing sessions. The design of IPFs, emphasizing either their interface or document nature, has a strong influence on their ability to support teachers. We finally discuss the two-way adaptation process that took place between teachers and the system during the development of the Tinker Environment

A tangible programming environment model informed by principles of perception and meaning

It is a fundamental Human-Computer Interaction problem to design a tangible programming environment for use by multiple persons that can also be individualised. This problem has its origin in the phenomenon that the meaning an object holds can vary across individuals. The Semiotics Research Domain studies the meaning objects hold. This research investigated a solution based on the user designing aspects of the environment at a time after it has been made operational and when the development team is no longer available to implement the user’s design requirements. Also considered is how objects can be positioned so that the collection of objects is interpreted as a program. I therefore explored how some of the principles of relative positioning of objects, as researched in the domains of Psychology and Art, could be applied to tangible programming environments. This study applied the Gestalt principle of perceptual grouping by proximity to the design of tangible programming environments to determine if a tangible programming environment is possible in which the relative positions of personally meaningful objects define the program. I did this by applying the Design Science Research methodology with five iterations and evaluations involving children. The outcome is a model of a Tangible Programming Environment that includes Gestalt principles and Semiotic theory; Semiotic theory explains that the user can choose a physical representation of the program element that carries personal meaning whereas the Gestalt principle of grouping by proximity predicts that objects can be arranged to appear as if linked to each other.School of ComputingPh. D. (Computer Science

Tactile, spatial interfaces for CAD

Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Architecture, 2003.Includes bibliographical references (p. 157-163).Computer-aided design (CAD) systems have become invaluable in three-dimensional creative design fields such as architecture and landscape architecture. However, these digital tools have not replaced the use of physical tools and materials as envisioned by the early developers of CAD. Instead, most designers have added digital media to their suite of physical media, gaining the benefits of both realms and using each where it is most advantageous. Given current CAD systems and how they are being used, two significant problems are apparent. First, the side-by-side physical/digital work environment has resulted in the need to frequently digitize and print in order to switch between physical and digital representations. This process is often time-consuming, costly, and frustrating. Second and more fundamental, the standard graphical user interface (GUI), although appropriate to some tasks, is restrictive as the only interface to CAD, because it lacks tactile and spatial qualities. Interacting with physical media such as paper, cardboard, and clay is a multisensory, spatial experience. Interacting in a GUI may be visual, but our other senses and spatial abilities remain underutilized. Recent interface design research includes embedding or augmenting physical artifacts with computation as one remedy to the limitations of the GUI. This dissertation investigates whether superimposing physical and digital media to create new interfaces for CAD has merit. Findings are presented from experiments performed with Illuminating Clay, a prototype interface that superimposes modeling clay and(cont.) topographic analysis. The objective was to discover whether these new kinds of interfaces could successfully combine the cognitive, motor, and emotional advantages of physical media with the capabilities of computation. Findings indicate that Illuminating Clay can indeed supplement a designer's eyeball analysis with more-accurate feedback while retaining the tactile and spatial advantages of working with a physical material. Salient issues pertaining to the design of tangible, and augmented-reality user interfaces were raised by these experiments: what the appropriate scale limitations should be, what the appropriate type of feedback is from computation, and whether real-time feedback is necessary.by Dorothy J. Shamonsky.Ph.D

Investigation and development of a tangible technology framework for highly complex and abstract concepts

The ubiquitous integration of computer-supported learning tools within the educational domain has led educators to continuously seek effective technological platforms for teaching and learning. Overcoming the inherent limitations of traditional educational approaches, interactive and tangible computing platforms have consequently garnered increased interest in the pursuit of embedding active learning pedagogies within curricula. However, whilst Tangible User Interface (TUI) systems have been successfully developed to edutain children in various research contexts, TUI architectures have seen limited deployment towards more advanced educational pursuits. Thus, in contrast to current domain research, this study investigates the effectiveness and suitability of adopting TUI systems for enhancing the learning experience of abstract and complex computational science and technology-based concepts within higher educational institutions (HEI)s. Based on the proposal of a contextually apt TUI architecture, the research describes the design and development of eight distinct TUI frameworks embodying innovate interactive paradigms through tabletop peripherals, graphical design factors, and active tangible manipulatives. These computationally coupled design elements are evaluated through summative and formative experimental methodologies for their ability to aid in the effective teaching and learning of diverse threshold concepts experienced in computational science. In addition, through the design and adoption of a technology acceptance model for educational technology (TAM4Edu), the suitability of TUI frameworks in HEI education is empirically evaluated across a myriad of determinants for modelling students’ behavioural intention. In light of the statistically significant results obtained in both academic knowledge gain (μ = 25.8%) and student satisfaction (μ = 12.7%), the study outlines the affordances provided through TUI design for various constituents of active learning theories and modalities. Thus, based on an empirical and pedagogical analyses, a set of design guidelines is defined within this research to direct the effective development of TUI design elements for teaching and learning abstract threshold concepts in HEI adaptations

Adaptive User Interfaces in Complex Supervisory Tasks

School of Electrical and Computer Engineerin

Interfaces for human-centered production and use of computer graphics assets

L'abstract è presente nell'allegato / the abstract is in the attachmen