1,780 research outputs found
Contactless Haptic Display Through Magnetic Field Control
Haptic rendering enables people to touch, perceive, and manipulate virtual
objects in a virtual environment. Using six cascaded identical hollow disk
electromagnets and a small permanent magnet attached to an operator's finger,
this paper proposes and develops an untethered haptic interface through
magnetic field control. The concentric hole inside the six cascaded
electromagnets provides the workspace, where the 3D position of the permanent
magnet is tracked with a Microsoft Kinect sensor. The driving currents of six
cascaded electromagnets are calculated in real-time for generating the desired
magnetic force. Offline data from an FEA (finite element analysis) based
simulation, determines the relationship between the magnetic force, the driving
currents, and the position of the permanent magnet. A set of experiments
including the virtual object recognition experiment, the virtual surface
identification experiment, and the user perception evaluation experiment were
conducted to demonstrate the proposed system, where Microsoft HoloLens
holographic glasses are used for visual rendering. The proposed magnetic haptic
display leads to an untethered and non-contact interface for natural haptic
rendering applications, which overcomes the constraints of mechanical linkages
in tool-based traditional haptic devices
Modeling and rendering for development of a virtual bone surgery system
A virtual bone surgery system is developed to provide the potential of a realistic, safe, and controllable environment for surgical education. It can be used for training in orthopedic surgery, as well as for planning and rehearsal of bone surgery procedures...Using the developed system, the user can perform virtual bone surgery by simultaneously seeing bone material removal through a graphic display device, feeling the force via a haptic deice, and hearing the sound of tool-bone interaction --Abstract, page iii
Real-time hybrid cutting with dynamic fluid visualization for virtual surgery
It is widely accepted that a reform in medical teaching must be made to meet today's high volume training requirements. Virtual simulation offers a potential method of providing such trainings and some current medical training simulations integrate haptic and visual feedback to enhance procedure learning. The purpose of this project is to explore the capability of Virtual Reality (VR) technology to develop a training simulator for surgical cutting and bleeding in a general surgery
Haptic Interaction with 3D oriented point clouds on the GPU
Real-time point-based rendering and interaction with virtual objects is gaining popularity
and importance as di�erent haptic devices and technologies increasingly provide the basis
for realistic interaction. Haptic Interaction is being used for a wide range of applications
such as medical training, remote robot operators, tactile displays and video games. Virtual
object visualization and interaction using haptic devices is the main focus; this process
involves several steps such as: Data Acquisition, Graphic Rendering, Haptic Interaction
and Data Modi�cation. This work presents a framework for Haptic Interaction using the
GPU as a hardware accelerator, and includes an approach for enabling the modi�cation
of data during interaction. The results demonstrate the limits and capabilities of these
techniques in the context of volume rendering for haptic applications. Also, the use
of dynamic parallelism as a technique to scale the number of threads needed from the
accelerator according to the interaction requirements is studied allowing the editing of
data sets of up to one million points at interactive haptic frame rates
Sublimate: State-Changing Virtual and Physical Rendering to Augment Interaction with Shape Displays
Recent research in 3D user interfaces pushes towards immersive graphics and actuated shape displays. Our work explores the hybrid of these directions, and we introduce sublimation and deposition, as metaphors for the transitions between physical and virtual states. We discuss how digital models, handles and controls can be interacted with as virtual 3D graphics or dynamic physical shapes, and how user interfaces can rapidly and fluidly switch between those representations. To explore this space, we developed two systems that integrate actuated shape displays and augmented reality (AR) for co-located physical shapes and 3D graphics. Our spatial optical see-through display provides a single user with head-tracked stereoscopic augmentation, whereas our handheld devices enable multi-user interaction through video seethrough AR. We describe interaction techniques and applications that explore 3D interaction for these new modalities. We conclude by discussing the results from a user study that show how freehand interaction with physical shape displays and co-located graphics can outperform wand-based interaction with virtual 3D graphics.National Science Foundation (U.S.) (Graduate Research Fellowship Grant 1122374
Towards a realistic in vitro experience of epidural Tuohy needle insertion.
The amount of pressure exerted on the syringe and the depth of needle insertion are the two key factors for successfully carrying out epidural procedure. The force feedback from the syringe plunger is helpful in judging the loss of pressure, and the depth of the needle insertion is crucial in identifying when the needle is precisely placed in the epidural space. This article presents the development of two novel wireless devices to measure these parameters to precisely guide the needle placement in the epidural space. These techniques can be directly used on patients or implemented in a simulator for improving the safety of procedure. A pilot trial has been conducted to collect depth and pressure data with the devices on a porcine cadaver. These measurements are then combined to accurately configure a haptic device for creating a realistic in vitro experience of epidural needle insertion
Haptics Rendering and Applications
There has been significant progress in haptic technologies but the incorporation of haptics into virtual environments is still in its infancy. A wide range of the new society's human activities including communication, education, art, entertainment, commerce and science would forever change if we learned how to capture, manipulate and reproduce haptic sensory stimuli that are nearly indistinguishable from reality. For the field to move forward, many commercial and technological barriers need to be overcome. By rendering how objects feel through haptic technology, we communicate information that might reflect a desire to speak a physically- based language that has never been explored before. Due to constant improvement in haptics technology and increasing levels of research into and development of haptics-related algorithms, protocols and devices, there is a belief that haptics technology has a promising future
Microscope Embedded Neurosurgical Training and Intraoperative System
In the recent years, neurosurgery has been strongly influenced by new technologies. Computer Aided Surgery (CAS) offers several benefits for patients\u27 safety but fine techniques targeted to obtain minimally invasive and traumatic treatments are required, since intra-operative false movements can be devastating, resulting in patients deaths. The precision of the surgical gesture is related both to accuracy of the available technological instruments and surgeon\u27s experience. In this frame, medical training is particularly important. From a technological point of view, the use of Virtual Reality (VR) for surgeon training and Augmented Reality (AR) for intra-operative treatments offer the best results.
In addition, traditional techniques for training in surgery include the use of animals, phantoms and cadavers. The main limitation of these approaches is that live tissue has different properties from dead tissue and that animal anatomy is significantly different from the human. From the medical point of view, Low-Grade Gliomas (LGGs) are intrinsic brain tumours that typically occur in younger adults. The objective of related treatment is to remove as much of the tumour as possible while minimizing damage to the healthy brain. Pathological tissue may closely resemble normal brain parenchyma when looked at through the neurosurgical microscope. The tactile appreciation of the different consistency of the tumour compared to normal brain requires considerable experience on the part of the neurosurgeon and it is a vital point.
The first part of this PhD thesis presents a system for realistic simulation (visual and haptic) of the spatula palpation of the LGG. This is the first prototype of a training system using VR, haptics and a real microscope for neurosurgery.
This architecture can be also adapted for intra-operative purposes. In this instance, a surgeon needs the basic setup for the Image Guided Therapy (IGT) interventions: microscope, monitors and navigated surgical instruments. The same virtual environment can be AR rendered onto the microscope optics. The objective is to enhance the surgeon\u27s ability for a better intra-operative orientation by giving him a three-dimensional view and other information necessary for a safe navigation inside the patient.
The last considerations have served as motivation for the second part of this work which has been devoted to improving a prototype of an AR stereoscopic microscope for neurosurgical interventions, developed in our institute in a previous work. A completely new software has been developed in order to reuse the microscope hardware, enhancing both rendering performances and usability.
Since both AR and VR share the same platform, the system can be referred to as Mixed Reality System for neurosurgery.
All the components are open source or at least based on a GPL license
- …