Video interaction using pen-based technology

Dissertação para obtenção do Grau de Doutor em InformáticaVideo can be considered one of the most complete and complex media and its manipulating is still a difficult and tedious task. This research applies pen-based technology to video manipulation, with the goal to improve this interaction. Even though the human familiarity with pen-based devices, how they can be used on video interaction, in order to improve it, making it more natural and at the same time fostering the user’s creativity is an open question. Two types of interaction with video were considered in this work: video annotation and video editing. Each interaction type allows the study of one of the interaction modes of using pen-based technology: indirectly, through digital ink, or directly, trough pen gestures or pressure. This research contributes with two approaches for pen-based video interaction: pen-based video annotations and video as ink. The first uses pen-based annotations combined with motion tracking algorithms, in order to augment video content with sketches or handwritten notes. It aims to study how pen-based technology can be used to annotate a moving objects and how to maintain the association between a pen-based annotations and the annotated moving object The second concept replaces digital ink by video content, studding how pen gestures and pressure can be used on video editing and what kind of changes are needed in the interface, in order to provide a more familiar and creative interaction in this usage context.This work was partially funded by the UTAustin-Portugal, Digital Media, Program (Ph.D. grant: SFRH/BD/42662/2007 - FCT/MCTES); by the HP Technology for Teaching Grant Initiative 2006; by the project "TKB - A Transmedia Knowledge Base for contemporary dance" (PTDC/EAT/AVP/098220/2008 funded by FCT/MCTES); and by CITI/DI/FCT/UNL (PEst-OE/EEI/UI0527/2011

Support for participation in electronic paper prototyping

In this paper, we examine a range of tools for early prototyping of interactive systems that might be described as enabling 'electronic paper prototyping'. We then introduce Gabbeh, a prototype that we are developing to re-enable participatory design when using such tools. Paper-prototyping is an established approach to the creation of early prototypes in the participatory design of computer systems. Recent years have seen the rapid development of new interaction devices in which a display screen is combined with pen-based input to allow users to create sketches or hand-written notes in an interaction that is similar to writing with a pen on paper. Research with such devices has shown how this capability can be used to rapidly create simple prototypes of interactive systems such as websites. However, previous systems have not considered how end-users and other stakeholders could contribute to design dialogues around such prototypes.</p

HandPainter – 3D sketching in VR with hand-based physical proxy

3D sketching in virtual reality (VR) enables users to create 3D virtual objects intuitively and immersively. However, previous studies showed that mid-air drawing may lead to inaccurate sketches. To address this issue, we propose to use one hand as a canvas proxy and the index finger of the other hand as a 3D pen. To this end, we first perform a formative study to compare two-handed interaction with tablet-pen interaction for VR sketching. Based on the findings of this study, we design HandPainter, a VR sketching system which focuses on the direct use of two hands for 3D sketching without requesting any tablet, pen, or VR controller. Our implementation is based on a pair of VR gloves, which provide hand tracking and gesture capture. We devise a set of intuitive gestures to control various functionalities required during 3D sketching, such as canvas panning and drawing positioning. We show the effectiveness of HandPainter by presenting a number of sketching results and discussing the outcomes of a user study-based comparison with mid-air drawing and tablet-based sketching tools

SketChart: A Pen-Based Tool for Chart Generation and Interaction.

It has been shown that representing data with the right visualization increases the understanding of qualitative and quantitative information encoded in documents. However, current tools for generating such visualizations involve the use of traditional WIMP techniques, which perhaps makes free interaction and direct manipulation of the content harder. In this thesis, we present a pen-based prototype for data visualization using 10 different types of bar based charts. The prototype lets users sketch a chart and interact with the information once the drawing is identified. The prototype\u27s user interface consists of an area to sketch and touch based elements that will be displayed depending on the context and nature of the outline. Brainstorming and live presentations can benefit from the prototype due to the ability to visualize and manipulate data in real time. We also perform a short, informal user study to measure effectiveness of the tool while recognizing sketches and users acceptance while interacting with the system. Results show SketChart strengths and weaknesses and areas for improvement

Wireless computers in classrooms: Enhancing interactive physics instruction with Tablet PCs and DyKnow software.

Networked one-on-one computing in educational setting opens a wide array of possibilities for more interactive and more dynamic instructional methodologies. We explore and analyze options offered toward that end by pen-enabled computers associated with DyKnow software. Pedagogies supported and driven by this technology include collaborative note taking, group problem solving, multiple channels of real-time feedback, classroom-wide interaction/content sharing and options for after-class activities etc.. DyKnow software (www.dyknow.com) is primarily designed for face-to-face instruction and pen enabled computers such as Tablet PCs but can be also used with laptops and desktops- with or without external pen input such as the Bamboo Tablet (www.wacom.com/bamboo). This web-based computer interaction also opens distance learning opportunities. We survey research results associated with implementations of this technology in several introductory physics settings

Magmatic and hydrothermal behavior of uranium in syntectonic leucogranites: The uranium mineralization associated with the Hercynian Guérande granite (Armorican Massif, France)

Most of the hydrothermal uranium (U) deposits from the European Hercynian belt (EHB) are spatially associated with Carboniferous peraluminous leucogranites. In the southern part of the Armorican Massif (French part of the EHB), the Guérande peraluminous leucogranite was emplaced in an extensional deformation zone at ca. 310 Ma and is spatially associated with several U deposits and occurrences. The apical zone of the intrusion is structurally located below the Pen Ar Ran U deposit, a perigranitic vein-type deposit where mineralization occurs at the contact between black shales and Ordovician acid metavolcanics. In the Métairie-Neuve intragranitic deposit, uranium oxide-quartz veins crosscut the granite and a metasedimentary enclave. Airborne radiometric data and published trace element analyses on the Guérande leucogranite suggest significant uranium leaching at the apical zone of the intrusion. The primary U enrichment in the apical zone of the granite likely occurred during both fractional crystallization and the interaction with magmatic fluids. The low Th/U values (18Owhole rock = 9.7–11.6‰ for deformed samples and δ18Owhole rock = 12.2–13.6‰ for other samples) indicate that the deformed facies of the apical zone underwent sub-solidus alteration at depth with oxidizing meteoric fluids. Fluid inclusion analyses on a quartz comb from a uranium oxide-quartz vein of the Pen Ar Ran deposit show evidence of low-salinity fluids (1–6 wt.% NaCl eq.), in good agreement with the contribution of meteoric fluids. Fluid trapping temperatures in the range of 250–350 °C suggest an elevated geothermal gradient, probably related to regional extension and the occurrence of magmatic activity in the environment close to the deposit at the time of its formation. U-Pb dating on uranium oxides from the Pen Ar Ran and Métairie-Neuve deposits reveals three different mineralizing events. The first event at 296.6 ± 2.6 Ma (Pen Ar Ran) is sub-synchronous with hydrothermal circulations and the emplacement of late leucogranitic dykes in the Guérande leucogranite. The two last mineralizing events occur at 286.6 ± 1.0 Ma (Métairie-Neuve) and 274.6 ± 0.9 Ma (Pen Ar Ran), respectively. Backscattered uranium oxide imaging combined with major elements and REE geochemistry suggest similar conditions of mineralization during the two Pen Ar Ran mineralizing events at ca. 300 Ma and ca. 275 Ma, arguing for different hydrothermal circulation phases in the granite and deposits. Apatite fission track dating reveals that the Guérande granite was still at depth and above 120 °C when these mineralizing events occurred, in agreement with the results obtained on fluid inclusions at Pen Ar Ran. Based on this comprehensive data set, we propose that the Guérande leucogranite is the main source for uranium in the Pen Ar Ran and Métairie-Neuve deposits. Sub-solidus alteration via surface-derived low-salinity oxidizing fluids likely promoted uranium leaching from magmatic uranium oxides within the leucogranite. The leached out uranium may then have been precipitated in the reducing environment represented by the surrounding black shales or graphitic quartzites. As similar mineralizing events occurred subsequently until ca. 275 Ma, meteoric oxidizing fluids likely percolated during the time when the Guérande leucogranite was still at depth. The age of the U mineralizing events in the Guérande region (300–275 Ma) is consistent with that obtained on other U deposits in the EHB and could suggest a similar mineralization condition, with long-term upper to middle crustal infiltration of meteoric fluids likely to have mobilized U from fertile peraluminous leucogranites during the Late Carboniferous to Permian crustal extension events

Human interaction with digital ink : legibility measurement and structural analysis

Literature suggests that it is possible to design and implement pen-based computer interfaces that resemble the use of pen and paper. These interfaces appear to allow users freedom in expressing ideas and seem to be familiar and easy to use. Different ideas have been put forward concerning this type of interface, however despite the commonality of aims and problems faced, there does not appear to be a common approach to their design and implementation. This thesis aims to progress the development of pen-based computer interfaces that resemble the use of pen and paper. To do this, a conceptual model is proposed for interfaces that enable interaction with "digital ink". This conceptual model is used to organize and analyse the broad range of literature related to pen-based interfaces, and to identify topics that are not sufficiently addressed by published research. Two issues highlighted by the model: digital ink legibility and digital ink structuring, are then investigated. In the first investigation, methods are devised to objectively and subjectively measure the legibility of handwritten script. These methods are then piloted in experiments that vary the horizontal rendering resolution of handwritten script displayed on a computer screen. Script legibility is shown to decrease with rendering resolution, after it drops below a threshold value. In the second investigation, the clustering of digital ink strokes into words is addressed. A method of rating the accuracy of clustering algorithms is proposed: the percentage of words spoiled. The clustering error rate is found to vary among different writers, for a clustering algorithm using the geometric features of both ink strokes, and the gaps between them. The work contributes a conceptual interface model, methods of measuring digital ink legibility, and techniques for investigating stroke clustering features, to the field of digital ink interaction research

Towards an Intelligent Framework for Pressure-based 3D Curve Drawing

Pen pressure is an input channel typically available in tablet pen device. To date, little attention has been paid to the use of pressure in the domain of graphical interaction, its usage largely limited to drawing and painting program, typically for varying brush characteristic such as stroke width, opacity and color. In this paper, we explore the use of pressure in 3D curve drawing. The act of controlling pressure using pen, pencil and brush in real life appears effortless, but to mimic this natural ability to control pressure using a pressure sensitive pen in the realm of electronic medium is difficult. Previous pressure based interaction work have proposed various signal processing techniques to improve the accuracy in pressure control, but a one-for-all signal processing solution tend not to work for different curve types. We propose instead a framework which applies signal processing techniques tuned to individual curve type. A neural network classifier is used as a curve classifier. Based on the classification, a custom combination of signal processing techniques is then applied. Results obtained point to the feasibility and advantage of the approach.Comment: This paper was rejected from GI 2014. Comment from the chief reviewer:All reviewers noted that the ideas behind this paper were promising, but felt that research was not quite sufficiently developed...Although all agreed that this idea is insightful and has the potential to lead to a valuable contribution,... the idea is not yet sufficiently developed to warrant publicatio