Hybrid Rugosity Mesostructures (HRMs) for fast and accurate rendering of fine haptic detail

The haptic rendering of surface mesostructure (fine relief features) in dense triangle meshes requires special structures, equipment, and high sampling rates for detailed perception of rugged models. Low cost approaches render haptic texture at the expense of fidelity of perception. We propose a faster method for surface haptic rendering using image-based Hybrid Rugosity Mesostructures (HRMs), paired maps with per-face heightfield displacements and normal maps, which are layered on top of a much decimated mesh, effectively adding greater surface detail than actually present in the geometry. The haptic probe’s force response algorithm is modulated using the blended HRM coat to render dense surface features at much lower costs. The proposed method solves typical problems at edge crossings, concave foldings and texture transitions. To prove the wellness of the approach, a usability testbed framework was built to measure and compare experimental results of haptic rendering approaches in a common set of specially devised meshes, HRMs, and performance tests. Trial results of user testing evaluations show the goodness of the proposed HRM technique, rendering accurate 3D surface detail at high sampling rates, deriving useful modeling and perception thresholds for this technique.Peer ReviewedPostprint (published version

Interactive 3D Digital Models for Anatomy and Medical Education

This chapter explores the creation and use of interactive, three-dimensional (3D), digital models for anatomy and medical education. Firstly, it looks back over the history and development of virtual 3D anatomy resources before outlining some of the current means of their creation; including photogrammetry, CT and surface scanning, and digital modelling, outlining advantages and disadvantages for each. Various means of distribution are explored, including; virtual learning environments, websites, interactive PDF’s, virtual and augmented reality, bespoke applications, and 3D printing, with a particular focus on the level of interactivity each method offers. Finally, and perhaps most importantly, the use of such models for education is discussed. Questions addressed include; How can such models best be used to enhance student learning? How can they be used in the classroom? How can they be used for selfdirected study? As well as exploring if they could one day replace human specimens, and how they complement the rise of online and e-learning

Towards embodied perspective: exploring first-person, stereoscopic, 4K, wall-sized rendering of embodied sculpting

Treball realitzat a Kungliga Tekniska HögskolanDevelopment of a technology which allowed an unobtrusive, practical and effective embodied perspective to be experienced by users by the single use of a Kinect sensor and a stereoscopic screen. Applied to virtual sculpting

Digital sculpting for historical representation: Neville tomb case study

Despite digital 3-D polygon modelling applications providing a common and powerful tool-set for archaeological, architectural and historical visualisation over recent years, the relatively recent developments in high-resolution sculpting software allow for the possibility to create digital outcomes with a degree of surface fidelity not previously obtainable from the more widely used poly-modelling software packages. Such digital sculpting applications are more commonly applied within the video games and TV/motion picture industries, the intention of this paper is to show how such tools and methodologies together with existing scanned data and some historical knowledge can remediate and re-imagine lost sculptural form. The intended research will focus on an examination and partial re-construction of the tomb of Sir John Neville, 3rd Baron Raby located at Durham Cathedral, County Durham UK

Touching creativity; a review and early pilot test of haptic tooling to support design practice, within a distance learning curriculum

Machine haptics has been shown to assist and enhance human–computer interactions. Research from previous studies in the field of haptics has focused on developing a user’s sense of realism of touch when using a haptic device. This paper examines the use of haptics for education, specifically for creative online education. The paper is presented in two parts. First, a review of literature was conducted and used to aid the rationale and underpin the design of a pilot test. Second, a pilot test was designed using a single-point kinaesthetic haptic device with a haptic rendered interface, to support the assembly of a virtual design prototype. The pilot test proved to be extremely valuable in creating and developing a rich virtual environment for non-sighted and sighted participants to use. The results from the initial pilot test showed that although users were positive about their experience of using the haptic device, there were improvements to be made to the interface to enhance the user experience in the next phase of testing

Digital sculpture : conceptually motivated sculptural models through the application of three-dimensional computer-aided design and additive fabrication technologies

Thesis (D. Tech.) - Central University of Technology, Free State, 200

A hybrid rugosity mesostructure (HRM) for rendering fine haptic detail

The haptic rendering of surface mesostructure (fine relief features) in dense triangle meshes requires special structures, equipment, and high sampling rates for detailed perception of rugged models. Some approaches simulate haptic texture at a lower processing cost, but at the expense of fidelity of perception. We propose a better method for rendering fine surface detail by using image-based Hybrid Rugosity Mesostructures (HRMs), composed of paired maps of piece-wise heightfield displacements and corresponding normals, which are layered on top of a less complex mesh, adding greater surface detail than the one actually present in the geometry. The core of the algorithm renders surface features by modulating the haptic probe's force response using a blended HRM coat. The proposed method solves typical problems arising at edge crossings, concave foldings and smoothing texture stitching transitions across edges. By establishing a common set of specially devised meshes, HRM mesostructures, and a battery of performance tests, we build a usability testing framework that allows a fair and balanced experimental procedure for comparing haptic rendering approaches. The trial results and user testing evaluations show the goodness of the proposed HRM technique in the accurate rendering of high 3D surface detail at low processing costs, deriving useful modeling and perception thresholds for this technique.Postprint (published version

Modeling and rendering for development of a virtual bone surgery system

A virtual bone surgery system is developed to provide the potential of a realistic, safe, and controllable environment for surgical education. It can be used for training in orthopedic surgery, as well as for planning and rehearsal of bone surgery procedures...Using the developed system, the user can perform virtual bone surgery by simultaneously seeing bone material removal through a graphic display device, feeling the force via a haptic deice, and hearing the sound of tool-bone interaction --Abstract, page iii

Collision Detection and Merging of Deformable B-Spline Surfaces in Virtual Reality Environment

This thesis presents a computational framework for representing, manipulating and merging rigid and deformable freeform objects in virtual reality (VR) environment. The core algorithms for collision detection, merging, and physics-based modeling used within this framework assume that all 3D deformable objects are B-spline surfaces. The interactive design tool can be represented as a B-spline surface, an implicit surface or a point, to allow the user a variety of rigid or deformable tools. The collision detection system utilizes the fact that the blending matrices used to discretize the B-spline surface are independent of the position of the control points and, therefore, can be pre-calculated. Complex B-spline surfaces can be generated by merging various B-spline surface patches using the B-spline surface patches merging algorithm presented in this thesis. Finally, the physics-based modeling system uses the mass-spring representation to determine the deformation and the reaction force values provided to the user. This helps to simulate realistic material behaviour of the model and assist the user in validating the design before performing extensive product detailing or finite element analysis using commercially available CAD software. The novelty of the proposed method stems from the pre-calculated blending matrices used to generate the points for graphical rendering, collision detection, merging of B-spline patches, and nodes for the mass spring system. This approach reduces computational time by avoiding the need to solve complex equations for blending functions of B-splines and perform the inversion of large matrices. This alternative approach to the mechanical concept design will also help to do away with the need to build prototypes for conceptualization and preliminary validation of the idea thereby reducing the time and cost of concept design phase and the wastage of resources