Analysing the Masked predictive coding training criterion for pre-training a Speech Representation Model

Recent developments in pre-trained speech representation utilizing self-supervised learning (SSL) have yielded exceptional results on a variety of downstream tasks. One such technique, known as masked predictive coding (MPC), has been employed by some of the most high-performing models. In this study, we investigate the impact of MPC loss on the type of information learnt at various layers in the HuBERT model, using nine probing tasks. Our findings indicate that the amount of content information learned at various layers of the HuBERT model has a positive correlation to the MPC loss. Additionally, it is also observed that any speaker-related information learned at intermediate layers of the model, is an indirect consequence of the learning process, and therefore cannot be controlled using the MPC loss. These findings may serve as inspiration for further research in the speech community, specifically in the development of new pre-training tasks or the exploration of new pre-training criterion's that directly preserves both speaker and content information at various layers of a learnt model

Novel intervention to promote COVID-19 protective behaviours among Black and South Asian communities in the UK: protocol for a mixed-methods pilot evaluation

INTRODUCTION: Culturally appropriate interventions to promote COVID-19 health protective measures among Black and South Asian communities in the UK are needed. We aim to carry out a preliminary evaluation of an intervention to reduce risk of COVID-19 comprising a short film and electronic leaflet. METHODS AND ANALYSIS: This mixed methods study comprises (1) a focus group to understand how people from the relevant communities interpret and understand the intervention's messages, (2) a before-and-after questionnaire study examining the extent to which the intervention changes intentions and confidence to carry out COVID-19 protective behaviours and (3) a further qualitative study exploring the views of Black and South Asian people of the intervention and the experiences of health professionals offering the intervention. Participants will be recruited through general practices. Data collection will be carried out in the community. ETHICS AND DISSEMINATION: The study received Health Research Authority approval in June 2021 (Research Ethics Committee Reference 21/LO/0452). All participants provided informed consent. As well as publishing the findings in peer-reviewed journals, we will disseminate the findings through the UK Health Security Agency, NHS England and the Office for Health Improvement and Disparities and ensure culturally appropriate messaging for participants and other members of the target groups

Novel intervention to promote COVID-19 protective behaviours among Black and South Asian communities in the UK: protocol for a mixed-methods pilot evaluation

Introduction Culturally appropriate interventions to promote COVID-19 health protective measures among Black and South Asian communities in the UK are needed. We aim to carry out a preliminary evaluation of an intervention to reduce risk of COVID-19 comprising a short film and electronic leaflet.Methods and analysis This mixed methods study comprises (1) a focus group to understand how people from the relevant communities interpret and understand the intervention’s messages, (2) a before-and-after questionnaire study examining the extent to which the intervention changes intentions and confidence to carry out COVID-19 protective behaviours and (3) a further qualitative study exploring the views of Black and South Asian people of the intervention and the experiences of health professionals offering the intervention. Participants will be recruited through general practices. Data collection will be carried out in the community.Ethics and dissemination The study received Health Research Authority approval in June 2021 (Research Ethics Committee Reference 21/LO/0452). All participants provided informed consent. As well as publishing the findings in peer-reviewed journals, we will disseminate the findings through the UK Health Security Agency, NHS England and the Office for Health Improvement and Disparities and ensure culturally appropriate messaging for participants and other members of the target groups

Novel intervention to promote COVID-19 protective behaviours among Black and South Asian communities in the UK: protocol for a mixed-method pilot evaluation

Introduction Culturally appropriate interventions to promote COVID-19 health protective measures among Black and South Asian communities in the UK are needed. We aim to carry out a preliminary evaluation of an intervention to reduce risk of COVID-19 comprising a short film and electronic leaflet. Methods and analysis This mixed methods study comprises (1) a focus group to understand how people from the relevant communities interpret and understand the intervention’s messages, (2) a before-and-after questionnaire study examining the extent to which the intervention changes intentions and confidence to carry out COVID-19 protective behaviours and (3) a further qualitative study exploring the views of Black and South Asian people of the intervention and the experiences of health professionals offering the intervention. Participants will be recruited through general practices. Data collection will be carried out in the community. Ethics and dissemination The study received Health Research Authority approval in June 2021 (Research Ethics Committee Reference 21/LO/0452). All participants provided informed consent. As well as publishing the findings in peer-reviewed journals, we will disseminate the findings through the UK Health Security Agency, NHS England and the Office for Health Improvement and Disparities and ensure culturally appropriate messaging for participants and other members of the target groups