Playing for Data: Ground Truth from Computer Games

Recent progress in computer vision has been driven by high-capacity models trained on large datasets. Unfortunately, creating large datasets with pixel-level labels has been extremely costly due to the amount of human effort required. In this paper, we present an approach to rapidly creating pixel-accurate semantic label maps for images extracted from modern computer games. Although the source code and the internal operation of commercial games are inaccessible, we show that associations between image patches can be reconstructed from the communication between the game and the graphics hardware. This enables rapid propagation of semantic labels within and across images synthesized by the game, with no access to the source code or the content. We validate the presented approach by producing dense pixel-level semantic annotations for 25 thousand images synthesized by a photorealistic open-world computer game. Experiments on semantic segmentation datasets show that using the acquired data to supplement real-world images significantly increases accuracy and that the acquired data enables reducing the amount of hand-labeled real-world data: models trained with game data and just 1/3 of the CamVid training set outperform models trained on the complete CamVid training set.Comment: Accepted to the 14th European Conference on Computer Vision (ECCV 2016

To immerse or not? Experimenting with two virtual retail environments

Purpose: The aim of this paper is to examine the determinants of users’ simulated experience in a virtual store and to show the subsequent impact of that experience on engagement. The outcome of that engagement is examined in relation to enjoyment, satisfaction and purchase intentions. Design/methodology/approach: The method comprised an experiment comparing users’ perceptions of a standard 2D online clothing store with an enhanced, immersive one that aimed to provide shopping value approaching that of a traditional store by using a 3D experience where participants wore special glasses and a data glove. Findings: Results demonstrate the major role of telepresence components in simulated experience and the critical role of that experience, along with hedonic and utilitarian values, in engagement. Purchase intention is influenced by satisfaction, which is in turn influenced by enjoyment and engagement. Engagement in turn is influenced by utilitarian and hedonic value and the experience of product simulation or telepresence, which is composed of control, colour and graphics vividness, and 3D authenticity. In the immersive, 3D environment experience is more associated with engagement and enjoyment, leading to greater purchase intention. The immersive, 3D environment thus has the potential to rival traditional shopping in terms of experience, resulting in higher sales for retailers and satisfaction for consumers. Originality: This work has evaluated a robust model of purchase intention and demonstrated it to hold not only in a 3D environment on a conventional computer platform, but also in an immersive one, where participants wear special glasses and a data glove

AN APPROACH FOR PREDICTING FLOW CHARACTERISTICS AT THE CONTINUOUS MINER FACE

As coal and rock are mined, dust is dispersed into the air. This dust, among other contaminants, poses a serious health and safety risk to mineworkers. Very fine dust known as respirable dust can infiltrate the deepest part of the lungs, and long-term exposure to these particles leads to a disease called coal worker’s pneumoconiosis (CWP). Occurrence of this disease declined steadily over the latter half of the 20th century; however, a recent study indicates that CWP has reemerged with an upward trend beginning at the turn of the century. To combat dust exposure, mine operators use a combination of water sprays and dust scrubbers in conjunction with face ventilation. Additionally, the University of Kentucky has developed a device that passively improves air infiltration to the coal face. Researchers use a variety of modeling techniques, including full-scale, reduced-scale, and computer modeling, to understand active-face flow phenomena. A one-twelfth scale model of an active continuous-miner face was constructed to examine airflow patterns under multiple conditions in a controlled environment. Fluid characteristics and boundary conditions have often been assumed in Computational Fluid Dynamics (CFD) models. Using particle-image-velocimetry (PIV), the flow patterns under various conditions can be measured. The results of these scale model experiments can be used to develop scaling laws which help validate numerical modeling and design of more accurate physical models. This dissertation presents airflow measurements taken within a reduced-scale model at multiple depths of cut by a continuous miner (CM) while utilizing a machine-integrated scrubber (an active device), a passive wing regulator, and a combination of the two. For conditions where the scrubber is on, there are three power settings, 85%, 100%, and 115% of the curtain air quantity. The results of these experiments identify the relationship of the airflow during the cutting phase and help researchers narrow the number of simulations needed as new ventilation controls or schemes are developed. It also provides realistic baseline cases which can be used for further comparisons

Rapid Prototyping to Roll-to-Roll Manufacturing of Microfluidic Devices

Microfluidics constitutes a widely applicable field of enabling technologies with great potential to revolutionize healthcare and biotechnology. The ability to miniaturize and parallelize processes with microfluidics is seen as a solution for many problems with diagnostics technologies and accessibility. Unfortunately, fabricating microfluidics often require extremely expensive, time consuming, and specialized high-precision methods, making both prototyping and commercial-scale mass manufacturing difficult to accomplish. In this work, we evaluate the feasibility of using a unique roll-to-roll (R2R) micropatterning manufacturing process coupled with Additive Manufacturing (3D printing) to rapidly prototype and produce microfluidic devices at high-volume on film or paper backings for applications in biotechnology. The first part of this process involved using Innovation Engineering approaches to navigate the customer discovery process to define the market areas in microfluidics that were of most value. Next, we identified key feasibility metrics for assessing products made with this process by looking at both manufacturability and functionality. Feature dimensions of products fabricated in the R2R process were evaluated at each step of production to determine manufacturability. Functionality was then assessed using microfluidic mixing patterns to compare the mixing efficiency of our film product to those manufactured with a current industry standard method. Ultimately, we found that fabrication of microfluidic patterns was feasible in the R2R production method, and that the devices created had functionality comparable to traditional microfluidic devices. This work will serve as a platform for further investigations into the high-volume manufacturing and prototyping of microfluidic patterns for applications in diagnostics and other areas of biotechnology

Augmented reality for computer assisted orthopaedic surgery

In recent years, computer-assistance and robotics have established their presence in operating theatres and found success in orthopaedic procedures. Benefits of computer assisted orthopaedic surgery (CAOS) have been thoroughly explored in research, finding improvements in clinical outcomes, through increased control and precision over surgical actions. However, human-computer interaction in CAOS remains an evolving field, through emerging display technologies including augmented reality (AR) – a fused view of the real environment with virtual, computer-generated holograms. Interactions between clinicians and patient-specific data generated during CAOS are limited to basic 2D interactions on touchscreen monitors, potentially creating clutter and cognitive challenges in surgery. Work described in this thesis sought to explore the benefits of AR in CAOS through: an integration between commercially available AR and CAOS systems, creating a novel AR-centric surgical workflow to support various tasks of computer-assisted knee arthroplasty, and three pre–clinical studies exploring the impact of the new AR workflow on both existing and newly proposed quantitative and qualitative performance metrics. Early research focused on cloning the (2D) user-interface of an existing CAOS system onto a virtual AR screen and investigating any resulting impacts on usability and performance. An infrared-based registration system is also presented, describing a protocol for calibrating commercial AR headsets with optical trackers, calculating a spatial transformation between surgical and holographic coordinate frames. The main contribution of this thesis is a novel AR workflow designed to support computer-assisted patellofemoral arthroplasty. The reported workflow provided 3D in-situ holographic guidance for CAOS tasks including patient registration, pre-operative planning, and assisted-cutting. Pre-clinical experimental validation on a commercial system (NAVIO®, Smith & Nephew) for these contributions demonstrates encouraging early-stage results showing successful deployment of AR to CAOS systems, and promising indications that AR can enhance the clinician’s interactions in the future. The thesis concludes with a summary of achievements, corresponding limitations and future research opportunities.Open Acces

Annals of Scientific Society for Assembly, Handling and Industrial Robotics

This Open Access proceedings present a good overview of the current research landscape of industrial robots. The objective of MHI Colloquium is a successful networking at academic and management level. Thereby the colloquium is focussing on a high level academic exchange to distribute the obtained research results, determine synergetic effects and trends, connect the actors personally and in conclusion strengthen the research field as well as the MHI community. Additionally there is the possibility to become acquainted with the organizing institute. Primary audience are members of the scientific association for assembly, handling and industrial robots (WG MHI)