Towards predicting post-editing productivity

Machine translation (MT) quality is generally measured via automatic metrics, producing scores that have no meaning for translators who are required to post-edit MT output or for project managers who have to plan and budget for transla- tion projects. This paper investigates correlations between two such automatic metrics (general text matcher and translation edit rate) and post-editing productivity. For the purposes of this paper, productivity is measured via processing speed and cognitive measures of effort using eye tracking as a tool. Processing speed, average fixation time and count are found to correlate well with the scores for groups of segments. Segments with high GTM and TER scores require substantially less time and cognitive effort than medium or low-scoring segments. Future research involving score thresholds and confidence estimation is suggested

Social presence and dishonesty in retail

Self-service checkouts (SCOs) in retail can benefit consumers and retailers, providing control and autonomy to shoppers independent from staff, together with reduced queuing times. Recent research indicates that the absence of staff may provide the opportunity for consumers to behave dishonestly, consistent with a perceived lack of social presence. This study examined whether a social presence in the form of various instantiations of embodied, visual, humanlike SCO interface agents had an effect on opportunistic behaviour. Using a simulated SCO scenario, participants experienced various dilemmas in which they could financially benefit themselves undeservedly. We hypothesised that a humanlike social presence integrated within the checkout screen would receive more attention and result in fewer instances of dishonesty compared to a less humanlike agent. This was partially supported by the results. The findings contribute to the theoretical framework in social presence research. We concluded that companies adopting self-service technology may consider the implementation of social presence in technology applications to support ethical consumer behaviour, but that more research is required to explore the mixed findings in the current study.<br/

Eye tracking as an MT evaluation technique

Eye tracking has been used successfully as a technique for measuring cognitive load in reading, psycholinguistics, writing, language acquisition etc. for some time now. Its application as a technique for measuring the reading ease of MT output has not yet, to our knowledge, been tested. We report here on a preliminary study testing the use and validity of an eye tracking methodology as a means of semi-automatically evaluating machine translation output. 50 French machine translated sentences, 25 rated as excellent and 25 rated as poor in an earlier human evaluation, were selected. Ten native speakers of French were instructed to read the MT sentences for comprehensibility. Their eye gaze data were recorded non-invasively using a Tobii 1750 eye tracker. The average gaze time and fixation count were found to be higher for the “bad” sentences, while average fixation duration and pupil dilations were not found to be substantially different for output rated as good and output rated as bad. Comparisons between HTER scores and eye gaze data were also found to correlate well with gaze time and fixation count, but not with pupil dilation and fixation duration. We conclude that the eye tracking data, in particular gaze time and fixation count, correlate reasonably well with human evaluation of MT output but fixation duration and pupil dilation may be less reliable indicators of reading difficulty for MT output. We also conclude that eye tracking has promise as a semi-automatic MT evaluation technique, which does not require bi-lingual knowledge, and which can potentially tap into the end users’ experience of machine translation output

Defining eye-fixation sequences across individuals and tasks: the Binocular-Individual Threshold (BIT) algorithm

We propose a new fully automated velocity-based algorithm to identify fixations from eye-movement records of both eyes, with individual-specific thresholds. The algorithm is based on robust minimum determinant covariance estimators (MDC) and control chart procedures, and is conceptually simple and computationally attractive. To determine fixations, it uses velocity thresholds based on the natural within-fixation variability of both eyes. It improves over existing approaches by automatically identifying fixation thresholds that are specific to (a) both eyes, (b) x- and y- directions, (c) tasks, and (d) individuals. We applied the proposed Binocular-Individual Threshold (BIT) algorithm to two large datasets collected on eye-trackers with different sampling frequencies, and compute descriptive statistics of fixations for larger samples of individuals across a variety of tasks, including reading, scene viewing, and search on supermarket shelves. Our analysis shows that there are considerable differences in the characteristics of fixations not only between these tasks, but also between individuals

Validation of a maritime usability study with eye tracking data

publishedVersio

Gaze–mouse coordinated movements and dependency with coordination demands in tracing.

Eye movements have been shown to lead hand movements in tracing tasks where subjects have to move their fingers along a predefined trace. The question remained, whether the leading relationship was similar when tracing with a pointing device, such as a mouse; more importantly, whether tasks that required more or less gaze–mouse coordination would introduce variation in this pattern of behaviour, in terms of both spatial and temporal leading of gaze position to mouse movement. A three-level gaze–mouse coordination demand paradigm was developed to address these questions. A substantial dataset of 1350 trials was collected and analysed. The linear correlation of gaze–mouse movements, the statistical distribution of the lead time, as well as the lead distance between gaze and mouse cursor positions were all considered, and we proposed a new method to quantify lead time in gaze–mouse coordination. The results supported and extended previous empirical findings that gaze often led mouse movements. We found that the gaze–mouse coordination demands of the task were positively correlated to the gaze lead, both spatially and temporally. However, the mouse movements were synchronised with or led gaze in the simple straight line condition, which demanded the least gaze–mouse coordination

Usability of the SAFEWAY@SCHOOL system in children with cognitive disabilities

PurposeSAFEWAY2SCHOOL is a programme based on several systems for the enhancement of school transportation safety for children. The aim of the study was to explore whether children with cognitive disabilities will notice, realise, understand, trust and accept the SAFEWAY2SCHOOL system and act in accordance with its instructions. Methods Fourteen children with cognitive disabilities and a control group of 23 children were shown five videos of scenarios involving journeys to and from school. During the first viewing visual scanning patterns were recorded with an eye tracking device. After a second viewing the participant was asked ten questions per scenario. Five questions addressed what the children saw on the video, and the remaining five what they would need to know and/or do within the scenario. Additional ratings of trust, likability, acceptability and usability were also collected. Results Very few differences were found in the visual scanning patterns of children with disabilities compared to children who participated in the control group. Of the 50 questions regarding what children saw or needed to know and/or do, only one significant difference between groups was found. No significant differences were found regarding self-reported ratings of trust, acceptability or usability of the system. Despite some significant differences across five of the 11 likability aspects, ratings were consistently high for both groups. Conclusions Children with cognitive disabilities proved that the SAFEWAY2SCHOOL system is as useful for them as it was for children in the control group. However, a valid estimation of the full utility of SAFEWAY2SCHOOL requires in situ testing of the system with these children

Eye movements and brain oscillations to symbolic safety signs with different comprehensibility

Background: The aim of this study was to investigate eye movements and brain oscillations to symbolic safety signs with different comprehensibility. Methods: Forty-two young adults participated in this study, and ten traffic symbols consisting of easy-to-comprehend and hard-to-comprehend signs were used as stimuli. During the sign comprehension test, real-time eye movements and spontaneous brain activity [electroencephalogram (EEG) data] were simultaneously recorded. Results: The comprehensibility level of symbolic traffic signs significantly affects eye movements and EEG spectral power. The harder to comprehend the sign is, the slower the blink rate, the larger the pupil diameter, and the longer the time to first fixation. Noticeable differences on EEG spectral power between easy-to-comprehend and hard-to-comprehend signs are observed in the prefrontal and visual cortex of the human brain. Conclusions: Sign comprehensibility has significant effects on real-time nonintrusive eye movements and brain oscillations. These findings demonstrate the potential to integrate physiological measures from eye movements and brain oscillations with existing evaluation methods in assessing the comprehensibility of symbolic safety signs.open

Spektra elektronowego rezonansu spinowego (ESR) butylowanego hydroksytoluenu (BHT) jako dowód powstawania wolnych rodników w trakcie wyładowań elektrostatycznych (ESD) w turbinowych olejach smarnych

Electrostatic discharges were generated in typical ISO VG 46 cSt turbine lubricating oil by passing the oil through a glass fibre filter element at a hydraulic load of 0.06 L*min-1*cm-2. The oil exhibited electrical conductivity of 8 pS*m-1 at 25°C. The experiment was performed at room temperature. The maximum amplitude of ESD arcing events recorded was approximately –500 V. The magnitude of these arcing events was sufficient to generate a free radical formation of the BHT antioxidant additive generally employed as an antioxidant in typical turbine lubricating oil formulations. The free radical formation was evidenced by a clearly observable ESR signal corresponding to the BHT radical as recorded on an X-Band MiniScope MS100 spectrometer with a resonant frequency of 9.43 GHz and a maximum field sweep of 400 mT. These results indicate that ESD can well be responsible for initiating the free radical polymerization process postulated to result in varnish formation in turbine lubricating oils.Wyładowania elektrostatyczne zostały wygenerowane w typowym oleju ISO VG 46 cSt stosowanym jako olej smarny w turbinach gazowych w trakcie przepływu oleju przez element filtracyjny na bazie włókien szklanych przy obciążeniu hydraulicznym wynoszącym 0,06 L*min-1*cm-2. Przewodowość oleju wynosiła 8 pS*m-1 przy temperaturze 25°C. Eksperyment został przeprowadzony w temperaturze pokojowej. Maksymalna amplituda wyładowań elektrostatycznych osiągnęła –500 V. Amplituda wyładowań była wystarczająca, by doprowadzić do powstawania wolnych rodników BHT stosowanym jako antyutleniacz w typowych formulacjach turbinowych olejów smarnych. Obecność wolnego rodnika BHT została zarejestrowana za pomocą X-Band MiniScope MS100 spektrometru z częstotliwością rezonasową 9,43 GHz o maksymalnym zasięgu pola magnetycznego 400 mT. Zarejestrowane wyniki wskazują, że ESD może być źródłem powstawania wolnych rodników i prowadzić do wolnorodnikowych procesów polimeryzacyjnych odpowiedzialnych za tworzenie się zanieczyszczeń osadowych w turbinowych olejach smarnych