Augmented Reality-based Feedback for Technician-in-the-loop C-arm Repositioning

Interventional C-arm imaging is crucial to percutaneous orthopedic procedures as it enables the surgeon to monitor the progress of surgery on the anatomy level. Minimally invasive interventions require repeated acquisition of X-ray images from different anatomical views to verify tool placement. Achieving and reproducing these views often comes at the cost of increased surgical time and radiation dose to both patient and staff. This work proposes a marker-free "technician-in-the-loop" Augmented Reality (AR) solution for C-arm repositioning. The X-ray technician operating the C-arm interventionally is equipped with a head-mounted display capable of recording desired C-arm poses in 3D via an integrated infrared sensor. For C-arm repositioning to a particular target view, the recorded C-arm pose is restored as a virtual object and visualized in an AR environment, serving as a perceptual reference for the technician. We conduct experiments in a setting simulating orthopedic trauma surgery. Our proof-of-principle findings indicate that the proposed system can decrease the 2.76 X-ray images required per desired view down to zero, suggesting substantial reductions of radiation dose during C-arm repositioning. The proposed AR solution is a first step towards facilitating communication between the surgeon and the surgical staff, improving the quality of surgical image acquisition, and enabling context-aware guidance for surgery rooms of the future. The concept of technician-in-the-loop design will become relevant to various interventions considering the expected advancements of sensing and wearable computing in the near future

Prospects for the use of Augmented Reality in Education

Augmented Reality (AR) is an emerging form of experience in which the Real World (RW) is enhanced by computer-generated content tied to specific locations and/or activities. Over the last several years, AR applications have become portable and widely available on mobile de­vices. AR is becoming visible in our audio-visual media (e.g., news, entertainment, sports) and is beginning to enter other aspects of our lives (e.g., e-commerce, travel, marketing) in tangible and exciting ways. The aspects of the use of augmented reality technology in the system of higher education are considered. The findings reveal an increase in the number of AR studies during the last four years. The most reported advantage of AR is that it promotes enhanced learning achievement and also of interest to the younger generation Some noted challenges imposed by AR are usability issues and frequent technical problems. The advantages and limitations of using this technology are given. The prospects for the use of augmented reality technology in the educational environment are considered

A systematic literature review of integrating augmented reality technology in science learning

Abstrak: Penelitian ini bertujuan untuk mengungkap tren penelitian selama sepuluh tahun terakhir pada penggunaan teknologi augmented reality (AR) dalam pembelajaran IPA. Review pada studi ini mengikuti pedoman PRISMA. Ditemukan 154 artikel pada tahap identifikasi, kemudian dilakukan screening berdasarkan kriteria inklusi dan eksklusi sehingga menjadi 50 artikel untuk direview. Hasil review menunjukkan bahwa pembelajaran/prestasi akademik, motivasi, dan sikap merupakan variabel yang paling banyak diteliti dalam artikel, Di mana prestasi akademik sangat dipengaruhi oleh motivasi dan sikap, sehingga sering dipertimbangkan dalam penelitian. Aplikasi mobile dan buku bergambar AR merupakan jenis AR yang sering diimplementasikan karena mudah digunakan dan dapat dikembangkan dengan cepat dan praktis. Kecenderungan metodologi adalah desain kuantitatif. Alat pengumpulan data yang sering digunakan adalah tes kognitif. Metode pengambilan sampel yang paling sering digunakan adalah convenience sampling, dan populasi sampel yang sering diidentifikasi adalah siswa sekolah menengah. Rekomendasi penelitian yang sering diberikan oleh peneliti adalah melakukan identifikasi pengaruh penggunaan AR terhadap kemampuan afektif siswa dan mengidentifikasi persepsi guru. Hasil penelitian ini akan menjadi sebuah referensi bagi para peneliti yang tertarik untuk mengimplementasikan AR dalam pembelajaran.Abstract: TThis study aimed to explore research trends over the past decade regarding the use of augmented reality (AR) technology in science learning. The study followed the PRISMA guidelines. A total of 154 articles were found at the identification stage and then screened based on inclusion and exclusion criteria so that 50 articles were to be reviewed. The review results show that learning achievement, motivation, and attitudes are the variables most researched in the article. Learning achievement is strongly influenced by motivation and attitude, so it is often considered in research. Mobile applications and AR picture books are often implemented because they are easy to use, fast, and have practical development. The methodological trend is a quantitative design. Data collection tools that are often used are cognitive tests. The frequently used sampling method is convenience sampling, and the sample population often identified is high school students. Researchers often give research recommendations to identify the effect of using AR on students' affective abilities and teacher perceptions. The results of this study will be a reference for researchers interested in implementing AR in education

Computer-aided position planning of miniplates to treat facial bone defects

In this contribution, a software system for computer-aided position planning of miniplates to treat facial bone defects is proposed. The intra-operatively used bone plates have to be passively adapted on the underlying bone contours for adequate bone fragment stabilization. However, this procedure can lead to frequent intra-operatively performed material readjustments especially in complex surgical cases. Our approach is able to fit a selection of common implant models on the surgeon's desired position in a 3D computer model. This happens with respect to the surrounding anatomical structures, always including the possibility of adjusting both the direction and the position of the used osteosynthesis material. By using the proposed software, surgeons are able to pre-plan the out coming implant in its form and morphology with the aid of a computer-visualized model within a few minutes. Further, the resulting model can be stored in STL file format, the commonly used format for 3D printing. Using this technology, surgeons are able to print the virtual generated implant, or create an individually designed bending tool. This method leads to adapted osteosynthesis materials according to the surrounding anatomy and requires further a minimum amount of money and time.Comment: 19 pages, 13 Figures, 2 Table

HP Windows Mixed Reality vs Meta 2: Investigating Differences in Workload and Usability for a Ball-sorting Task

Perceived workload and usability are crucial components of human-computer interactions. Currently, there is a gap in research comparing Augmented Reality (AR) and Virtual Reality (VR) systems for workload and usability. This study attempts to bridge that gap through the comparison of the HP Windows Mixed Reality system and the Meta 2 system for a ball-sorting task. Subjective questionnaires on workload and usability were implemented as comparative measures for three game scenarios of increasing difficulty. Forty-one participants were recruited from the University of Central Florida and its surrounding communities. Results showed significantly lower cumulative total workload and greater usability (for the subscale of ease of use) for the HP Windows Mixed Reality system when compared to the Meta 2 system. There were no statistically significant differences reported for the other usability subscales between the two systems. Also, there were no statistically significant differences in total workload within the three scenarios for both systems. The findings could be attributed to differences in control schemes (i.e., native handheld controllers versus hand gestures), user experience with AR and VR systems, and difficulty of task scenarios

3D shape reconstruction of the femur from planar X-ray images using statistical shape and appearance models

Major trauma is a condition that can result in severe bone damage. Customised orthopaedic reconstruction allows for limb salvage surgery and helps to restore joint alignment. For the best possible outcome three dimensional (3D) medical imaging is necessary, but its availability and access, especially in developing countries, can be challenging. In this study, 3D bone shapes of the femur reconstructed from planar radiographs representing bone defects were evaluated for use in orthopaedic surgery. Statistical shape and appearance models generated from 40 cadaveric X-ray computed tomography (CT) images were used to reconstruct 3D bone shapes. The reconstruction simulated bone defects of between 0% and 50% of the whole bone, and the prediction accuracy using anterior–posterior (AP) and anterior–posterior/medial–lateral (AP/ML) X-rays were compared. As error metrics for the comparison, measures evaluating the distance between contour lines of the projections as well as a measure comparing similarities in image intensities were used. The results were evaluated using the root-mean-square distance for surface error as well as differences in commonly used anatomical measures, including bow, femoral neck, diaphyseal–condylar and version angles between reconstructed surfaces from the shape model and the intact shape reconstructed from the CT image. The reconstructions had average surface errors between 1.59 and 3.59 mm with reconstructions using the contour error metric from the AP/ML directions being the most accurate. Predictions of bow and femoral neck angles were well below the clinical threshold accuracy of 3°, diaphyseal–condylar angles were around the threshold of 3° and only version angle predictions of between 5.3° and 9.3° were above the clinical threshold, but below the range reported in clinical practice using computer navigation (i.e., 17° internal to 15° external rotation). This study shows that the reconstructions from partly available planar images using statistical shape and appearance models had an accuracy which would support their potential use in orthopaedic reconstruction

Wearable Technology in Education to Enhance Technical MOOCs

The low completion rate issue in MOOCs has become one of the main highlights by researchers. It is reported that only 10 to 15 percent of the students were able to complete the MOOCs. This low completion rate is due to the students are less engaged with the MOOCs content causing them to become demotivated to complete the whole MOOCs. Engaging students in MOOCs environment, especially for non-technical subjects, suited very well. However, for technical MOOCs, it involves significant challenges because technical MOOCs must be able to offer the students with practice-oriented learning outcome in-order for the MOOCs to be effective and engaging. Due to the above issue, this paper discussed an improvised MOOCs model for teaching technical subjects with the intervention in the use of wearable technology. A discussion on the e-content and e-activity of the technical MOOC learning design was presented. This study implemented the proposed technical MOOC model through the MOOC development. The students’ perception of the technical MOOC was then evaluated, and all the results were explained in the discussion part. Results of the correlation test revealed that all of the technical MOOC variables correlated substantially and held a positive relationship with students’ perception variable with r=.3 to 1.0, p < .0005. In addition, this result also suggests that the learning materials produced by wearable technology do contribute towards the positive effect of students’ perception when learning technical MOOC