Audio-visual interaction in emotion perception for communication

Information from multiple modalities contributes to recognizing emotions. While it is known interactions occur between modalities, it is unclear what characterizes these. These interactions, and changes in these interactions due to sensory impairments, are the main subject of this PhD project. This extended abstract for the Doctoral Symposium of ETRA 2018 describes the project; its background, what I hope to achieve, and some preliminary results.</p

Saccades Follow Perception When Judging Location

An unresolved question in vision research is whether perceptual decision making and action are based on the same or on different neural representations. Here, we address this question for a straightforward task, the judgment of location. In our experiment, observers decided on the closer of two peripheral objects—situated on the horizontal meridian in opposite hemifields—and made a saccade to indicate their choice. Correct saccades landed close to the actual (physical) location of the target. However, in case of errors, saccades went in the direction of the more distant object, yet landed on a position approximating that of the closer one. Our finding supports the notion that perception and action-related decisions on object location rely on the same neural representation

Microstructural Visual Pathway White Matter Alterations in Primary Open-Angle Glaucoma:A Neurite Orientation Dispersion and Density Imaging Study

BACKGROUND AND PURPOSE: DTI studies of patients with primary open-angle glaucoma have demonstrated that glaucomatous degeneration is not confined to the retina but involves the entire visual pathway. Due to the lack of direct biologic interpretation of DTI parameters, the structural nature of this degeneration is still poorly understood. We used neurite orientation dispersion and density imaging (NODDI) to characterize the microstructural changes in the pregeniculate optic tracts and the postgeniculate optic radiations of patients with primary open-angle glaucoma, to better understand the mechanisms underlying these changes.& nbsp;MATERIALS AND METHODS: T1- and multishell diffusion-weighted scans were obtained from 23 patients with primary open-angle glaucoma and 29 controls. NODDI parametric maps were produced from the diffusion-weighted scans, and probabilistic tractography was used to track the optic tracts and optic radiations. NODDI parameters were computed for the tracked pathways, and the measures were compared between both groups. The retinal nerve fiber layer thickness and visual field loss were assessed for the patients with glaucoma.& nbsp;RESULTS: The optic tracts of the patients with glaucoma showed a higher orientation dispersion index and a lower neurite density index compared with the controls (

Chromatic induction and the layout of colours within a complex scene

AbstractA target’s apparent colour is influenced by the colours in its surrounding. If the surrounding consists of a single coloured surface, the influence is a shift ‘away’ from the surface’s colour. If the surface is more than 1° from the target area the shift is very small. If there are many surfaces, then not only the average luminance and chromaticity of the surfaces matters, but also the chromatic variability. It is not yet clear whether it makes any difference where the chromatic variability is within the scene, so we constructed stimuli in which the chromatic variability was restricted to certain regions. We found that it made very little difference where the chromatic variability was located. The extent to which the average colour of nearby surfaces influences the apparent colour of the target seems to depend on the average chromatic variability of the whole scene

The Birthday Party Test (BPT); A new picture description test to support the assessment of simultanagnosia in patients with acquired brain injury

There is broad consensus on the utility of complex pictures in the assessment of simultanagnosia in patients with acquired brain injury (ABI). To overcome various shortcomings of current instruments, we have developed the Birthday Party Test (BPT); a picture description test that contains a neutral scene, a balanced representation of events, and provides clear instructions and a scoring-aid. We have applied the BPT in a large group of patients with ABI (n = 502) and in an age-matched healthy control group (n = 194). Our results show that performance on the BPT was associated with a range of descriptive, neuropsychological and clinical characteristics and that poor test performance appeared to be more common in patients with etiologies that have an increased risk of bilateral damage. Furthermore, we assume a high correspondence between test performance on the BPT and the assessor’s clinical judgment of likely having simultanagnosia in preliminary analyses. This study shows the potential usefulness of the BPT to support diagnostic decision making in simultanagnosia. The BPT is made freely available to facilitate its broad application in the clinical assessment of patients with visual impairment and to enable a further evaluation of its utility and validity in future studies

Electrically controlled long-distance spin transport through an antiferromagnetic insulator

Spintronics uses spins, the intrinsic angular momentum of electrons, as an alternative for the electron charge. Its long-term goal is in the development of beyond-Moore low dissipation technology devices. Recent progress demonstrated the long-distance transport of spin signals across ferromagnetic insulators. Antiferromagnetically ordered materials are however the most common class of magnetic materials with several crucial advantages over ferromagnetic systems. In contrast to the latter, antiferromagnets exhibit no net magnetic moment, which renders them stable and impervious to external fields. In addition, they can be operated at THz frequencies. While fundamentally their properties bode well for spin transport, previous indirect observations indicate that spin transmission through antiferromagnets is limited to short distances of a few nanometers. Here we demonstrate the long-distance, over tens of micrometers, propagation of spin currents through hematite (\alpha-Fe2O3), the most common antiferromagnetic iron oxide, exploiting the spin Hall effect for spin injection. We control the spin current flow by the interfacial spin-bias and by tuning the antiferromagnetic resonance frequency with an external magnetic field. This simple antiferromagnetic insulator is shown to convey spin information parallel to the compensated moment (N\'eel order) over distances exceeding tens of micrometers. This newly-discovered mechanism transports spin as efficiently as the net magnetic moments in the best-suited complex ferromagnets. Our results pave the way to ultra-fast, low-power antiferromagnet-insulator-based spin-logic devices that operate at room temperature and in the absence of magnetic fields

Machine learning based natural language processing of radiology reports in orthopaedic trauma

OBJECTIVES: To compare different Machine Learning (ML) Natural Language Processing (NLP) methods to classify radiology reports in orthopaedic trauma for the presence of injuries. Assessing NLP performance is a prerequisite for downstream tasks and therefore of importance from a clinical perspective (avoiding missed injuries, quality check, insight in diagnostic yield) as well as from a research perspective (identification of patient cohorts, annotation of radiographs). METHODS: Datasets of Dutch radiology reports of injured extremities (n = 2469, 33% fractures) and chest radiographs (n = 799, 20% pneumothorax) were collected in two different hospitals and labeled by radiologists and trauma surgeons for the presence or absence of injuries. NLP classification was applied and optimized by testing different preprocessing steps and different classifiers (Rule-based, ML, and Bidirectional Encoder Representations from Transformers (BERT)). Performance was assessed by F1-score, AUC, sensitivity, specificity and accuracy. RESULTS: The deep learning based BERT model outperforms all other classification methods which were assessed. The model achieved an F1-score of (95 ± 2)% and accuracy of (96 ± 1)% on a dataset of simple reports (n= 2469), and an F1 of (83 ± 7)% with accuracy (93 ± 2)% on a dataset of complex reports (n= 799). CONCLUSION: BERT NLP outperforms traditional ML and rule-base classifiers when applied to Dutch radiology reports in orthopaedic trauma

The relationship between the presence of antibodies and direct detection of Toxoplasma gondii in slaughtered calves and cattle in four European countries

In cattle, antibodies to Toxoplasma gondii infection are frequently detected, but evidence for the presence of T. gondii tissue cysts in cattle is limited. To study the concordance between the presence of anti-T. gondii IgG and viable tissue cysts of T. gondii in cattle, serum, liver and diaphragm samples of 167 veal calves and 235 adult cattle were collected in Italy, the Netherlands, Romania and the United Kingdom. Serum samples were tested for anti-T. gondii IgG by the modified agglutination test and p30 immunoblot. Samples from liver were analyzed by mouse bioassay and PCR after trypsin digestion. In addition, all diaphragms of cattle that had tested T. gondii-positive (either in bioassay, by PCR on trypsin-digested liver or serologically by MAT) and a selection of diaphragms from cattle that had tested negative were analyzed by magnetic capture quantitative PCR (MC-PCR). Overall, 13 animals were considered positive by a direct detection method: seven out of 151 (4.6%) by MC-PCR and six out of 385 (1.6%) by bioassay, indicating the presence of viable parasites. As cattle that tested positive in the bioassay tested negative by MC-PCR and vice-versa, these results demonstrate a lack of concordance between the presence of viable parasites in liver and the detection of T. gondii DNA in diaphragm. In addition, the probability to detect T. gondii parasites or DNA in seropositive and seronegative cattle was comparable, demonstrating that serological testing by MAT or p30 immunoblot does not provide information about the presence of T. gondii parasites or DNA in cattle and therefore is not a reliable indicator of the risk for consumers