Evaluation of outreach interventions for under 16 year olds. Tools and guidance for higher education providers

During 2017-18, OFFA commissioned research that aimed to understand the nature of outreach activities for under 16 year olds (which were funded through access and participation investment) and how these were evaluated. This document, developed from the research, is intended to act as a resource for pre-16 outreach practitioners and evaluators, drawing both on the data collected by this project and the wider literature around evaluation and outreach. It seeks to recognise the complexity of pre-16 outreach work and eschews a prescriptive approach in favour of establishing important principles and actions that are likely to underpin good practice. Our discussion is broadly positioned within a ‘social realist’ worldview (Archer, 2008; Pawson, 2013) that seeks to understand the fuzzy nature of the cause-and-effect relationships that exist within complex social fields, where individuals construct their own realities in reference to those around them. There is a particular focus on epistemology – the pathways to creating dependable, if contingent, knowledge – as a vehicle for making meaning from data that is usually incomplete, compromised or mediated through young people’s emergent constructions of their worlds. Fundamentally, outreach is predicated on the ability of practitioners to influence young people in a planned way, albeit that the plan will not always work for every young person in every cohort. An important element in this epistemology is that it is not concerned with finding single ‘solutions’ that exist outside time and context. Rather, it is concerned with understanding how young people are influenced by their life experiences – not ‘what works’, but what works in a given context and, importantly, why. It is only through understanding the latter element that practices can become robustly effective in the long-term and potentially transferable to other contexts. This is particularly appropriate to pre-16 outreach work due to the lengthy time lag between activity and application to higher education (HE).Office for Students (OfS

Understanding the evaluation of access and participation outreach interventions for under 16 year olds

The project team was asked to address the following six research questions and these were used to guide the project: 1. What are the intended outcomes for current outreach interventions directed at under 16 year olds from disadvantaged backgrounds where the long-term aim is to widen access to higher education (HE)? 2. What types of outreach intervention activity or activities are institutions using in relation to intended outcomes? 3. What evaluation tools, methods and metrics are being used to measure the intended outcomes? 4. What are the perceived and actual challenges and barriers for different stakeholders to effective evaluation of long-term outreach? 5. What do different stakeholders consider most effective evaluation practice and why? 6. How valid and suitable are the evaluation tools, methods and metrics (identified through the research) that are commonly used? The project was constructed around six interlinked work packages: 1. A quantitative analysis of what higher education providers (HEPs) say about their pre-16 outreach activities (and their evaluation) in their 2017-18 access agreements (as the most recent available). 2. An online survey of HEPs to gather information about the pre-16 outreach activities delivered during the 2016-17 academic year and their evaluation, as well as the structure of their evaluation resources and challenges faced. 3. Case studies of four HEPs identified as demonstrating elements of good practice through their access agreements and the online survey, derived from telephone interviews with key staff and documentary analysis. 4. Telephone interviews with 11 third sector organisations (TSOs) to explore their practices and the evaluation of their activities, providing a counterpoint to the data collected from higher education institutions (HEIs). 5. A synthesis of the four preceding work packages to explore elements of good practice, determine a basis for assessing the quality of evaluations and highlight challenges for the sector and OFFA. 6. An invited participatory workshop for evaluators from HEPs and TSOs identified as demonstrating elements of good practice through the online survey and telephone interviews, to act as a sounding board for the emerging conclusions and recommendations.Office for Students (OfS

Progression for success: Evaluating North Yorkshire’s innovative careers guidance project

This report sets out the findings from an evaluation of North Yorkshires innovative careers guidance project.North Yorkshire County Counci

Gatsby careers benchmark north east implementation pilot: interim evaluation (2015-2017)

This report presents interim evaluation findings on the implementation of the Gatsby Benchmarks (herewith referred to as the Benchmarks) for good career guidance with a sample of 16 pilot schools and colleges (herewith referred to as education providers) in the North East of England. These interim findings report progress made against the Benchmarks during the course of the pilot (autumn 2015 to autumn 2017), the enablers and barriers faced, and the impact of the Benchmarks on learners’ career readiness and attainment. The interim findings suggest the following: Timescale - Schools and colleges involved were able to make significant strides towards fully meeting most, if not all, Benchmarks within two years. To date Benchmark 2 (Learning from career and labour market information) and Benchmark 7 (Encounters with FE and HE) have seen the largest increase in the number of pilot education providers fully achieving them. Benchmark 3 (Addressing the needs of every pupil) and Benchmark 4 (Linking curriculum to careers) have the least number of pilot education providers fully achieving them. Positive impact on learners. Learners show an increase in some aspects of career readiness and tentative increases in some aspects of GCSE attainment. Effective implementation of the Benchmarks. This was enabled by the existence of a regional facilitator to support pilot education providers and strong provider leadership and robust organisational infrastructures. Key barriers were a lack of time and space (in the curriculum), a lack of funding and a lack of commitment at senior leadership level, which impacted on achieving a cultural shift in some education providers. Regional impact. The implementation of the Benchmarks is impacting more widely in the region with non-pilot education providers forming links with pilot providers to seek support on developing good career guidance in their settings. Furthermore, wider stakeholders such as local employers and providers of careers education were also using the Benchmarks to review and develop their services to schools/colleges. Emerging challenges: A noticeable challenge was how the term ‘meaningful’, in relation to encounters with employers and employees, was interpreted and how education providers monitor provision of such encounters.Gatsby Charitable Foundatio

Kate 2014 Spring

Each year, kate seeks to: explore ideas about normative gender, sex, and sexuality work against oppression and hierarchies of power in any and all forms serve as a voice for race and gender equity as well as queer positivity encourage the silent to speak and feel less afraid build a zine and community that we care about and trusthttps://digitalcommons.otterbein.edu/kate/1003/thumbnail.jp

Medical Concerns

Panel Chair, Greg Cox Papers Presented: Ebene: Psychedelic Snuff of the Yanomami by Kelly Partin Mycobacterium Tuberculosis: A Survey by Mary Cronin Kinematic Analysis of Universal Joint using Catia V5 by Jibin Jacob Effects of Preterm Birth by Patricia J. Campos Proposal for ETT Research using Picutre-Induced Neural Signatures by Katy N. Lee Severe Mental Illness in the Homeless by Batoul C. Zalkout Asthma Disease of the Respiratory System by Janelle Clar

Evaluating Cognitive Enrichment for Zoo-Housed Gorillas Using Facial Recognition

The use of computer technology within zoos is becoming increasingly popular to help achieve high animal welfare standards. However, despite its various positive applications to wildlife in recent years, there has been little uptake of machine learning in zoo animal care. In this paper, we describe how a facial recognition system, developed using machine learning, was embedded within a cognitive enrichment device (a vertical, modular finger maze) for a troop of seven Western lowland gorillas (Gorilla gorilla gorilla) at Bristol Zoo Gardens, UK. We explored whether machine learning could automatically identify individual gorillas through facial recognition, and automate the collection of device-use data including the order, frequency and duration of use by the troop. Concurrent traditional video recording and behavioral coding by eye was undertaken for comparison. The facial recognition system was very effective at identifying individual gorillas (97% mean average precision) and could automate specific downstream tasks (for example, duration of engagement). However, its development was a heavy investment, requiring specialized hardware and interdisciplinary expertise. Therefore, we suggest a system like this is only appropriate for long-term projects. Additionally, researcher input was still required to visually identify which maze modules were being used by gorillas and how. This highlights the need for additional technology, such as infrared sensors, to fully automate cognitive enrichment evaluation. To end, we describe a future system that combines machine learning and sensor technology which could automate the collection of data in real-time for use by researchers and animal care staff

High-tech and tactile: Cognitive enrichment for zoo-housed gorillas

The field of environmental enrichment for zoo animals, particularly great apes, has been revived by technological advancements such as touchscreen interfaces and motion sensors. However, direct animal-computer interaction (ACI) is impractical or undesirable for many zoos. We developed a modular cuboid puzzle maze for the troop of six Western lowland gorillas (Gorilla gorilla gorilla) at Bristol Zoo Gardens, United Kingdom. The gorillas could use their fingers or tools to interact with interconnected modules and remove food rewards. Twelve modules could be interchanged within the frame to create novel iterations with every trial. We took a screen-free approach to enrichment: substituting ACI for tactile, physically complex device components, in addition to hidden automatic sensors, and cameras to log device use. The current study evaluated the gorillas’ behavioral responses to the device, and evaluated it as a form of “cognitive enrichment.” Five out of six gorillas used the device, during monthly trials of 1 h duration, over a 6 month period. All users were female including two infants, and there were significant individual differences in duration of device use. The successful extraction of food rewards was only performed by the three tool-using gorillas. Device use did not diminish over time, and gorillas took turns to use the device alone or as one mother-infant dyad. Our results suggest that the device was a form of cognitive enrichment for the study troop because it allowed gorillas to solve novel challenges, and device use was not associated with behavioral indicators of stress or frustration. However, device exposure had no significant effects on gorilla activity budgets. The device has the potential to be a sustainable enrichment method in the long-term, tailored to individual gorilla skill levels and motivations. Our study represents a technological advancement for gorilla enrichment, an area which had been particularly overlooked until now. We wholly encourage the continued development of this physical maze system for other great apes under human care, with or without computer logging technology