Text-guided Eyeglasses Manipulation with Spatial Constraints

Virtual try-on of eyeglasses involves placing eyeglasses of different shapes and styles onto a face image without physically trying them on. While existing methods have shown impressive results, the variety of eyeglasses styles is limited and the interactions are not always intuitive or efficient. To address these limitations, we propose a Text-guided Eyeglasses Manipulation method that allows for control of the eyeglasses shape and style based on a binary mask and text, respectively. Specifically, we introduce a mask encoder to extract mask conditions and a modulation module that enables simultaneous injection of text and mask conditions. This design allows for fine-grained control of the eyeglasses' appearance based on both textual descriptions and spatial constraints. Our approach includes a disentangled mapper and a decoupling strategy that preserves irrelevant areas, resulting in better local editing. We employ a two-stage training scheme to handle the different convergence speeds of the various modality conditions, successfully controlling both the shape and style of eyeglasses. Extensive comparison experiments and ablation analyses demonstrate the effectiveness of our approach in achieving diverse eyeglasses styles while preserving irrelevant areas.Comment: Revised version: add some experiment

An Update of Eyeglasses-Supported Nasal–Facial Prosthetic Rehabilitation of Cancer Patients with Post-Surgical Complications: A Case Report

Featured Application: This case report aims to describe an update of the digital protocol for the fabrication of a facial prosthesis for those patients who cannot be rehabilitated with plastic surgery because of post-surgical complications after maxillofacial surgery. In detail, it describes the application of the digital protocol to a mid-facial defect. The innovation proposed is oriented to simplify the procedures and reduce the time and cost of the process, aiming to recover the quality of life of inoperable patients. This case report aims to describe novel steps in the digital design/manufacturing of facial prostheses for cancer patients with wide inoperable residual defects, with a focus on a case of a mid-facial defect. A facial scanner was used to make an impression of the post-surgical residual defect and to digitalize it. The daughter’s face scan was used for reconstructing the missing anatomy. Using 3D printing technologies, try-in prototypes were produced in silicone material. The substructure was laser melted. The final prosthesis was relined directly onto the patient’s defect. The prosthesis resulted in a very low weight and a high elasticity of the external margins. The laser-melted substructure ensured the necessary rigidity with minimum thickness

Consumers and Augmented Reality in Shopping and Services: Drivers and Consequences

This dissertation investigated the effect of augmented reality on user experience and also the mediation effect of user experience in the relationship between augmented reality and the outcome variables including user satisfaction and user’s willingness to buy/user’s willingness to use augmented reality. Three studies were conducted in three different contexts, including buying consumer products, entertainment services and vehicle service use. The results indicate that augmented reality significantly and positively influence user experience, and user experience fully mediates the impact of augmented reality on user satisfaction and user’s willingness to buy/ user’s willingness to use augmented reality. Further, the results showed that trade-off between price and value, user’s information privacy control, perceived control and responsiveness moderate the effect of augmented reality on user experience. In addition, a new scale was developed to capture and measure the output quality in terms of image recognition generated by augmented reality. Additionally, a new aspect of user experience exclusively driven by augmented reality was developed and added to the current user experience scale

Virtual Glasses Try-on System

Virtual Glasses Try-on System Siyu Quan Recent advances in data-driven modeling have enabled the simulation of wearing the glasses virtually based on 2D images (web-camera). For real-life glasses wearing, it needs not only suitable for appearance, but also comfort. Although the simulations based on 2D images can bring out certain conveniences for customers who want to try on glasses online first, there are still many challenging problems ahead because of the high complexity of simulations for wearing glasses. Obviously, it can hardly tell if the glasses are comfortable or can seat on the customer’s nose correctly. Furthermore, customers may want to take a look from different angle to make sure that the glasses selected are perfect. Such requirements cannot be met by using the simulations based on 2D images so we present an interactive real-time system with simulations for wearing glasses, providing users with a high degree of simulation quality including physics application. With our system the user uses the Kinect sensor or the common web camera as input device to acquire the result of wearing the preferred glasses virtually, which is real-time. Input device captures the user’s face and generate a geometry face-mesh which is expected to be aligned to the face-mesh template we pre-set manually. The 3D data captured from Kinect dramatically improve user’s experience by constructing geometry face mesh