Appearance-design interfaces and tools for computer cinematography: Evaluation and application

We define appearance design as the creation and editing of scene content such as lighting and surface materials in computer graphics. The appearance design process takes a significant amount of time relative to other production tasks and poses difficult artistic challenges. Many user interfaces have been proposed to make appearance design faster, easier, and more expressive, but no formal validation of these interfaces had been published prior to our body of work. With a focus on novice users, we present a series of investigations into the strengths and weaknesses of various appearance design user interfaces. In particular, we develop an experimental methodology for the evaluation of representative user interface paradigms in the areas of lighting and material design. We conduct three user studies having subjects perform design tasks under controlled conditions. In these studies, we discover new insight into the effectiveness of each paradigm for novices measured by objective performance as well as subjective feedback. We also offer observations on common workflow and capabilities of novice users in these domains. We use the results of our lighting study to develop a new representation for artistic control of lighting, where light travels along nonlinear paths

Virtual Reality as a Pedagogical Tool to Design for Social Impact: a Design Case

Three-dimensional (3-D) virtual environments have key affordances that can improve learning, particularly when context, culture, and pedagogical aims are aligned to a given learning situation. One challenge in detailing effective uses of 3-D virtual environments in teaching and learning contexts is that the design judgments involved are not always made explicit. We argue that the transparency of design judgments, as it relates to the use of 3-D virtual environments, are critically important. This article advances scholarship of emerging technologies by detailing the design judgments of a university instructor within a Design for Social Impact cross-disciplinary course. To address learner needs and the cultural aims of an authentic client-based project, the instructor directed students to sketch design ideas within Google Blocks, which allows users to create 3-D models in virtual reality. This design case provides precedent for practitioners interested in how 3-D virtual environments can align to learning contexts, cultures, and pedagogical aim

Mobile Wound Assessment and 3D Modeling from a Single Image

The prevalence of camera-enabled mobile phones have made mobile wound assessment a viable treatment option for millions of previously difficult to reach patients. We have designed a complete mobile wound assessment platform to ameliorate the many challenges related to chronic wound care. Chronic wounds and infections are the most severe, costly and fatal types of wounds, placing them at the center of mobile wound assessment. Wound physicians assess thousands of single-view wound images from all over the world, and it may be difficult to determine the location of the wound on the body, for example, if the wound is taken at close range. In our solution, end-users capture an image of the wound by taking a picture with their mobile camera. The wound image is segmented and classified using modern convolution neural networks, and is stored securely in the cloud for remote tracking. We use an interactive semi-automated approach to allow users to specify the location of the wound on the body. To accomplish this we have created, to the best our knowledge, the first 3D human surface anatomy labeling system, based off the current NYU and Anatomy Mapper labeling systems. To interactively view wounds in 3D, we have presented an efficient projective texture mapping algorithm for texturing wounds onto a 3D human anatomy model. In so doing, we have demonstrated an approach to 3D wound reconstruction that works even for a single wound image

Ideation as an intellectual information acquisition and use context: Investigating game designers’ information-based ideation behavior

Human Information Behavior (HIB) research commonly examines behavior in the context of why information is acquired and how it will be used, but usually at the level of the work or everyday-life tasks the information will support. HIB has not been examined in detail at the broader contextual level of intellectual purpose (i.e. the higher-order conceptual tasks the information was acquired to support). Examination at this level can enhance holistic understanding of HIB as a ‘means to an intellectual end’ and inform the design of digital information environments that support information interaction for specific intellectual purposes. We investigate information-based ideation (IBI) as a specific intellectual information acquisition and use context by conducting Critical Incident-style interviews with ten game designers, focusing on how they interact with information to generate and develop creative design ideas. Our findings give rise to a framework of their ideation-focused HIB, which systems designers can leverage to reason about how best to support certain behaviors to drive design ideation. These findings emphasize the importance of intellectual purpose as a driver for acquisition and desired outcome of use

Design and Fabrication of Ultralight Weight, Adjustable Multi-electrode Probes for Electrophysiological Recordings in Mice

The number of physiological investigations in the mouse, mus musculus, has experienced a recent surge, paralleling the growth in methods of genetic targeting for microcircuit dissection and disease modeling. The introduction of optogenetics, for example, has allowed for bidirectional manipulation of genetically-identified neurons, at an unprecedented temporal resolution. To capitalize on these tools and gain insight into dynamic interactions among brain microcircuits, it is essential that one has the ability to record from ensembles of neurons deep within the brain of this small rodent, in both head-fixed and freely behaving preparations. To record from deep structures and distinct cell layers requires a preparation that allows precise advancement of electrodes towards desired brain regions. To record neural ensembles, it is necessary that each electrode be independently movable, allowing the experimenter to resolve individual cells while leaving neighboring electrodes undisturbed. To do both in a freely behaving mouse requires an electrode drive that is lightweight, resilient, and highly customizable for targeting specific brain structures. A technique for designing and fabricating miniature, ultralight weight, microdrive electrode arrays that are individually customizable and easily assembled from commercially available parts is presented. These devices are easily scalable and can be customized to the structure being targeted; it has been used successfully to record from thalamic and cortical regions in a freely behaving animal during natural behavior.Simons FoundationNational Institute of Neurological Disorders and Stroke (U.S.) (NIH Pathway to Independence Career Award)National Institutes of Health (U.S.