Eye movements during reading and their relationship to reading assessment outcomes in Swedish elementary school children

The characteristics of children’s eye movements during reading change as they gradually become better readers. However, few eye tracking studies have investigated children’s reading and reading development and little is known about the relationship between reading-related eye movement measures and reading assessment outcomes. We recorded and analyzed three basic eye movement measures in an ecologically valid eye-tracking set-up. The participants were Swedish children (n = 2876) who were recorded in their normal school environment. The relationship between eye movements and reading assessment outcomes was analyzed in using linear mixed effects models. We found similar age-related changes in eye movement characteristics as established in previous studies, and that eye movements seem to correlate with reading outcome measures. Additionally, our results show that eye movements predict the results on several tests from a word reading assess- ment. Hence eye tracking may potentially be a useful tool in assessing reading development

Using eye-tracking measures to predict reading comprehension

This study examined the potential of eye-tracking as a tool for assessing reading comprehension. We administered three widely used reading comprehension tests with varying task demands to 79 typical adult readers while monitoring their eye movements. In the York Assessment of Reading for Comprehension (YARC), participants were given passages of text to read silently, followed by comprehension questions. In the Gray Oral Reading Test (GORT-5), participants were given passages of text to read aloud, followed by comprehension questions. In the sentence comprehension subtest of the Wide Range Achievement Test (WRAT-4), participants were asked to provide a missing word in sentences that they read silently (i.e., a cloze task). Linear models predicting comprehension scores from eye-tracking measures yielded different results for the three tests. Eye-tracking measures explained significantly more variance than reading-speed data for the YARC (four times better), GORT (three times better), and the WRAT (1.3 time better). Importantly, there was no common strong predictor for all three tests. These results support growing recognition that reading comprehension tests do not measure the same cognitive processes, and that participants adapt their reading strategies to the tests' varying task demands. This study also suggests that eye-tracking may provide a useful alternative for measuring reading comprehensio

Combining Virtual Reality and Organizational Neuroscience for Leadership Assessment

[EN] In this article, we introduce three-dimensional Serious Games (3DSGs) under an evidencecentered design (ECD) framework and use an organizational neuroscience-based eye-tracking measure to capture mplicit behavioral signals associated with leadership skills. While ECD is a wellestablished framework used in the design and development of assessments, it has rarely been utilized in organizational research. The study proposes a novel 3DSG combined with organizational neuroscience methods as a promising tool to assess and recognize leadership-related behavioral patterns that manifest during complex and realistic social situations. We offer a research protocol for assessing task- and relationship-oriented leadership skills that uses ECD, eye-tracking measures, and machine learning. Seamlessly embedding biological measures into 3DSGs enables objective assessment methods that are based on machine learning techniques to achieve high cological validity. We conclude by describing a future research agenda for the combined use of 3DSGs and organizational neuroscience methods for leadership and human resources.This research was funded by the Generalitat Valenciana funded project Mixed reality and brain decision (REBRAND) 502 (PROMETEU/2019/105).Parra Vargas, E.; Chicchi Giglioli, IA.; Philip, J.; Carrasco-Ribelles, LA.; Marín-Morales, J.; Alcañiz Raya, ML. (2021). Combining Virtual Reality and Organizational Neuroscience for Leadership Assessment. Applied Sciences. 11(13). https://doi.org/10.3390/app11135956111

The national challenge: raising standards, supporting schools - gifted and talented pilot programme. Element 2: tracking progress of gifted and talented pupils (National Strategies: national challenge)

"A booklet to help schools involved in the National Challenge Gifted and Talented (G&T) pilot to track progress of gifted and talented pupils... This booklet contains Element 2 of a set of three. The other two are: User Guide and Element 1: Leading and Managing Improvement for gifted and talented education, and Element 3: Guidance on pedagogy for gifted and talented education. Further information on the Gifted and Talented Pilot Programme can be found in 'National Challenge: Raising standards, supporting schools - Gifted and Talented Pilot Programme Introduction and overview'" - National Strategies website

Community Development Evaluation Storymap and Legend

Community based organizations, funders, and intermediary organizations working in the community development field have a shared interest in building stronger organizations and stronger communities. Through evaluation these organizations can learn how their programs and activities contribute to the achievement of these goals, and how to improve their effectiveness and the well-being of their communities. Yet, evaluation is rarely seen as part of a non-judgemental organizational learning process. Instead, the term "evaluation" has often generated anxiety and confusion. The Community Development Storymap project is a response to those concerns.Illustrations found in this document were produced by Grove Consultants

Reachable Workspace and Proximal Function Measures for Quantifying Upper Limb Motion.

There are a lack of quantitative measures for clinically assessing upper limb function. Conventional biomechanical performance measures are restricted to specialist labs due to hardware cost and complexity, while the resulting measurements require specialists for analysis. Depth cameras are low cost and portable systems that can track surrogate joint positions. However, these motions may not be biologically consistent, which can result in noisy, inaccurate movements. This paper introduces a rigid body modelling method to enforce biological feasibility of the recovered motions. This method is evaluated on an existing depth camera assessment: the reachable workspace (RW) measure for assessing gross shoulder function. As a rigid body model is used, position estimates of new proximal targets can be added, resulting in a proximal function (PF) measure for assessing a subject's ability to touch specific body landmarks. The accuracy, and repeatability of these measures is assessed on ten asymptomatic subjects, with and without rigid body constraints. This analysis is performed both on a low-cost depth camera system and a gold-standard active motion capture system. The addition of rigid body constraints was found to improve accuracy and concordance of the depth camera system, particularly in lateral reaching movements. Both RW and PF measures were found to be feasible candidates for clinical assessment, with future analysis needed to determine their ability to detect changes within specific patient populations

Assessing Depression Improvement with the Remission Evaluation and Mood Inventory Tool (REMIT)

Objective The Remission Evaluation and Mood Inventory Tool (REMIT) was developed as a brief complementary measure to provide a more robust assessment of depression improvement than tracking DSM-V symptom improvement alone. This study provides further validation of the REMIT tool and examines its utility in predicting depression improvement. Methods The sample comprised 294 primary care patients enrolled in a telecare trial of pain plus depression and/or anxiety. Assessments collected included: REMIT, PHQ-9 and measures assessing anxiety, pain, sleep, fatigue, somatization, health-related quality of life and disability. Data was analyzed to assess the REMIT's validity, its minimally important difference (MID), and its utility in predicting 6-month depression improvement. Results Convergent and construct validity of REMIT was supported by moderate correlations with mental health measures and weaker correlation with physical health measures. MID of approximately 2 points for REMIT was estimated by two metrics: 0.5 standard deviation and 1 standard error of measurement. Both baseline and 3-month change in REMIT scores predicted depression improvement at 6 months. Indeed, REMIT was as good or better predictor than the PHQ-9. Conclusion The REMIT measure is a brief 5-item tool that augments core DSM-V symptom-oriented metrics in assessing and predicting recovery from major depression

A Handbook of Data Collection Tools: Companion to "A Guide to Measuring Advocacy and Policy"

This handbook of data collection tools is intended to serve as a companion to A Guide to Measuring Advocacy and Policy. Organizational Research Services (ORS) developed this guide on behalf of the Annie E. Casey Foundation to support efforts to develop and implement an evaluation of advocacy and policy work. The companion handbook is dedicated to providing examples of practical tools and processes for collecting useful information from policy and advocacy efforts. Included within this handbook are a legislative process tracking log, a meeting observation checklist, a policy brief stakeholder survey, a policy tracking analysis tool, and a policy tracking form.This best practice provides an approach to measure advocacy and policy change efforts, starting with a theory of change, identifying outcome categories, and selecting practical approaches to measurement

Expert Elicitation for Reliable System Design

This paper reviews the role of expert judgement to support reliability assessments within the systems engineering design process. Generic design processes are described to give the context and a discussion is given about the nature of the reliability assessments required in the different systems engineering phases. It is argued that, as far as meeting reliability requirements is concerned, the whole design process is more akin to a statistical control process than to a straightforward statistical problem of assessing an unknown distribution. This leads to features of the expert judgement problem in the design context which are substantially different from those seen, for example, in risk assessment. In particular, the role of experts in problem structuring and in developing failure mitigation options is much more prominent, and there is a need to take into account the reliability potential for future mitigation measures downstream in the system life cycle. An overview is given of the stakeholders typically involved in large scale systems engineering design projects, and this is used to argue the need for methods that expose potential judgemental biases in order to generate analyses that can be said to provide rational consensus about uncertainties. Finally, a number of key points are developed with the aim of moving toward a framework that provides a holistic method for tracking reliability assessment through the design process.Comment: This paper commented in: [arXiv:0708.0285], [arXiv:0708.0287], [arXiv:0708.0288]. Rejoinder in [arXiv:0708.0293]. Published at http://dx.doi.org/10.1214/088342306000000510 in the Statistical Science (http://www.imstat.org/sts/) by the Institute of Mathematical Statistics (http://www.imstat.org