Trust, but Verify! - An Empirical Investigation of Students’ Initial Trust in AI-Based Essay Scoring

AI is becoming increasingly important in supporting education. Nowadays, AI-based systems can score essays in high-stakes exams not only by comparing words but also by evaluating content. However, for AI-based essay scoring systems to be used, they must be trusted. Based on a scenario-based experiment with 260 students at a German university, we were able to show that their initial trust in AI-based essay scoring systems is significantly lower than in human examiners. Human control of AI-scoring can partially reduce the negative effect. The perceived system characteristics and the personality traits of the students are important factors which positively influence trustworthiness and trust, respectively. Furthermore, we could show that the more complex the essay scoring is perceived, the less trustworthy the AI-based system is classified. No influence could be seen regarding the relevance of the scoring for the students, their AI-experience and technology affinity

(AI)N’T NOBODY HELPING ME? – DESIGN AND EVALUATION OF A MACHINE-LEARNING-BASED SEMI-AUTOMATIC ESSAY SCORING SYSTEM

Education is increasingly being delivered digitally these days, whether due to the COVID-19 pandemic or the growing popularity of MOOCs. The increasing number of participants poses a challenge for institutions to balance didactical and financial demands, especially for exams. The overall goal of this design science research project is to design and evaluate a semi-automatic machine-learning-based scoring system for essays. We focus on the design of a functional software artifact including the required design principles and an exemplary implementation of an algorithm, the optimization of which is, however, not part of this project and subject for future research. Our results show that such a system is suitable for both scoring essay assignments and documenting these scorings. In addition to the software artifact, we document our results using the work of Gregor et al. (2020). This provides a first step towards a design theory for semi-automatic, machine-learning-based scoring systems for essays

coupling of a redundant manipulator with a virtual reality environment to enhance human robot cooperation

Abstract The current trend in manufacturing is to obtain a flexible work cell in which human and robot can safely interact and collaborate. Virtual Reality (VR) represents an effective tool capable of simulating such complex systems with a high level of immersion. In order to take advantage of VR technologies to study Human-Robot Cooperation (HRC), a digital model of a redundant manipulator (KUKA LBR iiwa) has been developed starting with kinematic modeling and then coupled with the real robot. This approach allows simulating HRC in several scenarios, to reproduce the safe behavior on the real robot, as well as to train operators

Detection of Erythropoietin in Exhaled Breath Condensate of Nonhypoxic Subjects Using a Multiplex Bead Array

As a noninvasive method, exhaled breath condensate (EBC) has gained importance to improve monitoring of lung diseases and to detect biomarkers. The aim of the study was to investigate, whether erythropoietin (EPO) is detectable in EBC. EBC was collected from 22 consecutive patients as well as from healthy individuals. Using a multiplex fluorescent bead immunoassay, we detected EPO in EBC, as well as tumour necrosis factor-α (TNF-α) in 13 out of 22 patients simultaneously (EPO 0.21 ± 0.03 in U/mL and TNF-α 34.6 ± 4.2 in pg/mL, mean ± SEM). No significant differences for EPO levels or correlation between EPO and TNF-α were found but TNF-α was significantly higher in patients with chronic obstructive pulmonary disease (COPD) than in non-COPD (obstructive sleep apnoea, OSA, and lung healthy patients). This is the first report of detection of EPO in EBC. Due to the small study size more data is needed to clarify the role of EPO in EBC

Risk of symptomatic heterotopic ossification following plate osteosynthesis in multiple trauma patients: an analysis in a level-1 trauma centre

<p>Abstract</p> <p>Background</p> <p>Symptomatic heterotopic ossification (HO) in multiple trauma patients may lead to follow up surgery, furthermore the long-term outcome can be restricted. Knowledge of the effect of surgical treatment on formation of symptomatic heterotopic ossification in polytrauma is sparse. Therefore, we test the effects of surgical treatment (plate osteosynthesis or intramedullary nailing) on the formation of heterotopic ossification in the multiple trauma patient.</p> <p>Methods</p> <p>We retrospectively analysed prospectively documented data of blunt multiple trauma patients with long bone fractures which were treated at our level-1 trauma centre between 1997 and 2005. Patients were distributed to 2 groups: Patients treated by intramedullary nails (group IMN) or plate osteosynthesis (group PLATE) were compared. The expression and extension of symptomatic heterotopic ossifications on 3-6 months follow-up x-rays in antero-posterior (ap) and lateral views were classified radiologically and the maximum expansion was measured in millimeter (mm). Additionally, ventilation time, prophylactic medication like indomethacine and incidence and correlation of head injuries were analysed.</p> <p>Results</p> <p>101 patients were included in our study, 79 men and 22 women. The fractures were treated by intramedullary nails (group IMN n = 50) or plate osteosynthesis (group PLATE n = 51). Significantly higher radiologic ossification classes were detected in group PLATE (2.9 ± 1.3) as compared to IMN (2.2 ± 1.1; p = 0.013). HO size in mm ap and lateral showed a tendency towards larger HOs in the PLATE group. Additionally PLATE group showed a higher rate of articular fractures (63% vs. 28% in IMN) while IMN demonstrated a higher rate of diaphyseal fractures (72% vs. 37% in PLATE; p = 0.003). Ventilation time, indomethacine and incidence of head injuries showed no significant difference between groups.</p> <p>Conclusion</p> <p>Fracture care with plate osteosynthesis in polytrauma patients is associated with larger formations of symptomatic heterotopic ossifications (HO) while intramedullary nailing was associated with a higher rate of remote HO. For future fracture care of multiply injured patients these facts may be considered by the responsible surgeon.</p

Cryoprobe biopsy increases the diagnostic yield in endobronchial tumor lesions

ObjectiveForceps biopsy is the standard method to obtain specimens in endoscopically visible lesions. It is common to combine forceps biopsy with cytology methods to increase the diagnostic yield. Although the flexible cryoprobe has been established for bronchoscopic interventions in malignant stenosis, the obtained biopsies, called “cryobiopsies,” have not been investigated in a large cohort of patients. The aim of this feasibility study was to prospectively evaluate the diagnostic yield and safety of cryobiopsy and forceps biopsy.MethodsDuring a 6-year period, 296 patients with visible endoluminal tumor lesions were included in the study at the bronchoscopy unit of a university hospital. In the first consecutively conducted 55 cases, both techniques, forceps biopsy and cryobiopsy, were applied simultaneously. Pathologic and quantitative image analyses were performed to evaluate the size and quality of the obtained specimens. We evaluated the safety and diagnostic yield to describe the feasibility of cryobiopsy.ResultsComparative analysis of the first conducted and randomly assigned 55 cases revealed a significantly higher diagnostic yield for cryobiopsy compared with forceps biopsy (89.1% vs 65.5%, P < .05). In this cohort, quantitative image analysis showed significantly larger biopsies regarding size and artifact-free tissue sections for cryobiopsy compared with forceps biopsy (P < .0001). The overall diagnostic yield of cryobiopsy was 89.5%. Mild bleeding occurred in 11 cases (3.7%), moderate bleeding occurred in 3 cases (1.0%), and severe bleeding occurred in 1 case (0.3%).ConclusionCryobiopsy is safe and increases the diagnostic yield in endobronchial tumor lesions. The method also is feasible under routine conditions