Information technology and visual impairment: New developments

No abstract available

(Micro)saccade-related potentials during face recognition:A study combining EEG, eye-tracking, and deconvolution modeling

Under natural viewing conditions, complex stimuli such as human faces are typically looked at several times in succession, implying that their recognition may unfold across multiple eye fixations. Although electrophysiological (EEG) experiments on face recognition typically prohibit eye movements, participants still execute frequent (micro)saccades on the face, each of which generates its own visuocortical response. This finding raises the question of whether the fixation-related potentials (FRPs) evoked by these tiny gaze shifts also contain psychologically valuable information about face processing. Here we investigated this question by co-recording EEG and eye movements in an experiment with emotional faces (happy, angry, neutral). Deconvolution modeling was used to separate the stimulus-ERPs to face onset from the FRPs generated by subsequent microsaccades-induced refixations on the face. As expected, stimulus-ERPs exhibited typical emotion effects, with a larger early posterior negativity (EPN) for happy/angry compared to neutral faces. Eye-tracking confirmed that participants made small saccades within the face in 98% of the trials. However, while each saccade produced a strong response over visual areas, this response was unaffected by the face’s emotional expression, both for the first and for subsequent (micro)saccades. This finding suggests that the face’s affective content is rapidly evaluated after stimulus onset, leading to only a short-lived sensory enhancement by arousing stimuli that does not repeat itself during immediate refixations. Methodologically, our work demonstrates how eye-tracking and deconvolution modeling can be used to extract several brain responses from each EEG trial, providing insights into neural processing at different latencies after stimulus onset

Constructing sonified haptic line graphs for the blind student: first steps

Line graphs stand as an established information visualisation and analysis technique taught at various levels of difficulty according to standard Mathematics curricula. It has been argued that blind individuals cannot use line graphs as a visualisation and analytic tool because they currently primarily exist in the visual medium. The research described in this paper aims at making line graphs accessible to blind students through auditory and haptic media. We describe (1) our design space for representing line graphs, (2) the technology we use to develop our prototypes and (3) the insights from our preliminary work

A screen reader solution for accessing SPSS 9.0 without sight

No abstract available

Self-recognition generates characteristic responses in pupil dynamics and microsaccade rate

Visual fixation is an active process with pupil dynamics as well as fixational eye movements and microsaccades that support perception. Measures of both pupil contraction and microsaccades are known to be sensitive to ongoing cognition and emotional processing. Here we present experimental results from a visual fixation task demonstrating that pupil size and microsaccade rate respond differently during self-recognition (when seeing one's own face) than when seeing familiar or unfamiliar faces. First, the pupil response is characterized by an immediate pupil-constriction followed by later dilation in response to stimulus onsets. For one's own face, we observe muted constriction and greater dilation compared to other faces. Second, microsaccades, which generally show an inhibitory response to incoming stimuli, are more strongly inhibited in response to one's own face compared to other faces. Our results lend support to the idea that eye-related physiological measures could contribute to biometric identification procedures.Comment: 22 pages, 5 figures, 3 table

Studies of mechano-chemical interactions in the tribological behavior of materials

Mechano-chemical interaction studies can contribute to the understanding of wear and friction of materials. Specific examples of experimental results relative to the subject are discussed. There are two parts: one describes the synergistic effect of corrosion and wear of iron sliding on sapphire in sulfuric acid, and the other describes the effect of surface films on the wear and friction of plasma-deposited diamondlike carbon (amorphous hydrogenated carbon) films in sliding contact with silicon nitride. The concentration of acid (pH) is an important factor in controlling the iron loss caused by wear-corrosion processes in sulfuric acid. The mechanical action can cause chemical reactions to proceed much faster than they would otherwise. The diamondlike carbon (DLC) films are shown to behave tribologically much like bulk diamond. In a dry nitrogen environment, a mechano-chemical reaction produces a substance which greatly decreases the coefficient of friction. In a moist air environment, mechano-chemical interactions drastically reduce the wear life of DLC films and water vapor greatly increases friction

Self-recognition generates characteristic responses in pupil dynamics and microsaccade rate

Visual fixation is an active process with pupil dynamics as well as fixational eye movements and microsaccades that support perception. Measures of both pupil contraction and microsaccades are known to be sensitive to ongoing cognition and emotional processing. Here we present experimental results from a visual fixation task demonstrating that pupil size and microsaccade rate respond differently during self-recognition (when seeing one's own face) than when seeing familiar or unfamiliar faces. First, the pupil response is characterized by an immediate pupil-constriction followed by later dilation in response to stimulus onsets. For one's own face, we observe muted constriction and greater dilation compared to other faces. Second, microsaccades, which generally show an inhibitory response to incoming stimuli, are more strongly inhibited in response to one's own face compared to other faces. Our results lend support to the idea that eye-related physiological measures could contribute to biometric identification procedures

Parafoveal and foveal N400 effects in natural reading:A timeline of semantic processing from fixation-related potentials

The depth at which parafoveal words are processed during reading is an ongoing topic of debate. Recent studies using RSVP-with-flanker paradigms have shown that implausible words within sentences elicit N400 components while they are still in parafoveal vision, suggesting that the semantics of parafoveal words can be accessed to rapidly update the sentence representation. To study this effect in natural reading, we combined the co-registration of eye movements and EEG with the deconvolution modeling of fixation-related potentials (FRPs) to test whether semantic plausibility is processed parafoveally during Chinese sentence reading. For one target word per sentence, both its parafoveal and foveal plausibility were orthogonally manipulated using the boundary paradigm. Consistent with previous eye movement studies, we observed a delayed effect of parafoveal plausibility on fixation durations that only emerged on the foveal word. Crucially, in FRPs aligned to the pre-target fixation, a clear N400 effect emerged already based on parafoveal plausibility, with more negative voltages for implausible previews. Once participants fixated the target, we again observed an N400 effect of foveal plausibility. Interestingly, this foveal N400 was absent whenever the preview had been implausible, indicating that when a word’s (im)plausibility is already processed in parafoveal vision, this information is not revised anymore upon direct fixation. Implausible words also elicited a late positive complex (LPC), but exclusively in foveal vision. Our results provide convergent neural and behavioral evidence for the parafoveal uptake of semantic information, but also indicate different contributions of parafoveal versus foveal information towards higher-level sentence processing

The impact of emotional facial expressions on reflexive attention depends on the aim of dynamic gaze changes: An ERP study

The emotional expression and gaze direction of a face are important cues for human social interactions. However, the interplay of these factors and their neural correlates are only partially understood. In the current study, we investigated ERP correlates of gaze and emotion processing following the initial presentation of faces with different emotional expressions (happy, neutral, angry) and an averted or direct gaze direction as well as following a subsequent change in gaze direction that occurred in half of the trials. We focused on the time course and scalp topography of the N170 and EPN components. The N170 amplitude was larger to averted than direct gaze for the initial face presentation and larger to gaze changes from direct to averted than from averted to direct in response to the gaze change. For the EPN component in response to the initial face presentation, we replicate classic effects of emotion, which did not interact with gaze direction. As a major new finding, changes from direct to averted gaze elicited an EPN-like effect when the face showed a happy expression. No such effect was seen for angry expressions. We conclude that happy faces reflexively attract attention when they look at the observer rather than away from the observer. These results for happy expressions are in line with the shared signal hypothesis that posits a better processing of expressions if their approach or avoidance tendency is consistent with gaze direction. However, the shared signal hypothesis is not supported by the present results for angry faces