Rating scale development: a multistage exploratory sequential design

The project chosen to showcase the application of the exploratory sequential design in second/ foreign (L2) language assessment comes from the context of rating scale development and focuses on the development of a set of scales for a suite of high-stakes L2 speaking tests. The assessment of speaking requires assigning scores to a speech sample in a systematic fashion by focusing on explicitly defined criteria which describe different levels of performance (Ginther 2013). Rating scales are the instruments used in this evaluation process, and they can be either holistic (i.e. providing a global overall assessment) or analytic (i.e. providing an independent evaluations for a number of assessment criteria, e.g. Grammar, Vocabulary, Organisation, etc.). The discussion in this chapter is framed within the context of rating scales in speaking assessment. However, it is worth noting that the principles espoused, stages employed and decisions taken during the development process have wider applicability to performance assessment in general

Reconstruction of Phonated Speech from Whispers Using Formant-Derived Plausible Pitch Modulation

Whispering is a natural, unphonated, secondary aspect of speech communications for most people. However, it is the primary mechanism of communications for some speakers who have impaired voice production mechanisms, such as partial laryngectomees, as well as for those prescribed voice rest, which often follows surgery or damage to the larynx. Unlike most people, who choose when to whisper and when not to, these speakers may have little choice but to rely on whispers for much of their daily vocal interaction. Even though most speakers will whisper at times, and some speakers can only whisper, the majority of today’s computational speech technology systems assume or require phonated speech. This article considers conversion of whispers into natural-sounding phonated speech as a noninvasive prosthetic aid for people with voice impairments who can only whisper. As a by-product, the technique is also useful for unimpaired speakers who choose to whisper. Speech reconstruction systems can be classified into those requiring training and those that do not. Among the latter, a recent parametric reconstruction framework is explored and then enhanced through a refined estimation of plausible pitch from weighted formant differences. The improved reconstruction framework, with proposed formant-derived artificial pitch modulation, is validated through subjective and objective comparison tests alongside state-of-the-art alternatives

An evaluation of in-patient respite care at St. Vincent de Paul Residence

Aim: To identify the multi-dimensional characteristics and need for inter-disciplinary input associated with in-patient respite care. Methods: During the period January-December 2007, 91 in-patient respite users, aged ≥60 years, were assessed on admission for respite care at St. Vincent de Paule Residence. Assessment instruments used included the Barthel Index, the Mini-Mental State Examination, a Caregiver Strain Index, the Functional Oral Intake Scale and the Communicative Effectiveness Index. Findings: Of the study group (n=91), 65% of respite users were found to be suffering from moderate to severe dementia (Mini-Mental State Examination score 0-20). High dependency on the Barthel Index (0-7/20) was found in 52% of cases whilst 45% had low dependency (13-20/20). Carer strain was reported in 60% of care-givers (carers). Interdisciplinary input requirements in the group studied included nursing in 85%, dental (83%), speech language pathology (70%), physiotherapy (39%), occupational therapy (38%), medical (33%) and social worker assistance (24%). Conclusion: Elderly respite users are a mixed group with multiple and diverse needs. In their own homes, these care needs are principally met by informal helpers who are frequently under stress. The expansion of in-patient respite services will reinforce the informal community care network and will help avoid or postpone long-term institutionalisation.peer-reviewedpeer-reviewe

Social Validity Assessment in Social Competence Interventions for Preschool Children: A Review

Social competence intervention studies published from 1970 to 2008 for preschoolers were reviewed for reports of social validity assessment. Analysis of 90 studies indicated that nearly 27% (n=24) of studies reported at least one measure of social validity assessment for: the goals (n=7), procedures (n=8), or effects (n=19). The methods used for these assessments were described including information about the participants, time of assessment and results. Trends in the rate of social validity assessment, methodological concerns and recommendations for further social validity assessments are discussed

Efficacy of Elaborated Semantic Features Analysis in Aphasia: a quasi-randomised controlled trial

Background: Word finding difficulty is one of the most common features of aphasia. Semantic Features Analysis (SFA) directly aims to improve word finding in people with aphasia. Evidence from systematic reviews suggests that SFA leads to positive outcomes, yet the evidence comprises single case studies and case series. There is a need to evaluate the efficacy of SFA in controlled group studies/trials. Aims: To evaluate the efficacy of Elaborated Semantic Feature Analysis (ESFA) for word finding in people with aphasia. We investigated: (a) the efficacy of ESFA versus a delayed therapy/control, (b) the efficacy of two therapy approaches– individual versus a combination of individual and group therapy. Methods and procedures: We ran a multi-centre, quasi-randomised controlled trial, nested in a larger study (Thales-Aphasia). Participants were recruited from community settings. They had to be people with aphasia due to stroke at least four months post-onset. Participants were randomized to individual vs combination vs delayed therapy/control groups. Both therapy groups had three hours of ESFA per week for 12 weeks. Delayed therapy/control group had no intervention for 12 weeks and were then randomized to either individual or combination therapy. The primary outcome was confrontation naming. Secondary outcomes were the Boston Naming Test, Discourse, the Functional Assessment of Communication Skills for adults (ASHA–FACS), the Stroke and Aphasia Quality of Life scale (SAQOL-39g), the General Health Questionnaire-12 item, and the EQ-5D. Outcomes and Results: Of the 72 participants of the Thales-Aphasia project, 58 met eligibility criteria for speech-language therapy and 39 were allocated to ESFA. The critical p-value was adjusted for multiple comparisons (.005). For the therapy versus control comparison, there was a significant main effect of time on the primary outcome (p<.001, η2p=.42) and a significant interaction effect (p=.003, η2p=.21). An interaction effect for the SAQOL-39g (p=.015, η2p=.11) and its psychosocial domain (p=.013, η2p=.12) did not remain significant after Bonferroni adjustment. For the individual versus combination ESFA comparison, there were significant main effects of time on the primary outcome (p<.001, η2p=.49), the BNT (p<.001, η2p=.29) and the ASHA-FACS (p=.001, η2p=.18). Interaction and group effects were not significant. Conclusion: Though underpowered, this study provides evidence on the efficacy of ESFA to improve word finding in aphasia, with gains similar in the two therapy approaches. Trial registration: ISRCTN71455409, https://doi.org/10.1186/ISRCTN7145540

The impact of goal orientation, self-reflection and personal characteristics on the acquisition of oral presentation skills

Although many educators help others to develop oral presentation skills, little research is available to direct the instructional design activities of these educators. In the present article an explorative study on university freshman is described, in which goal-setting, self-reflection, and several characteristics of the subjects during oral presentations were analysed. The research results emphasize the critical impact of motivational constructs, such as self-efficacy and goal orientation, next to the topic of the oral presentation on the acquisition of oral presentation skills

Panel data and open-ended questions: Understanding perceptions of quality of life

This paper describes the burgeoning interest in quality of life studies and suggests that as well as expert definitions, we need to consider people’s own perceptions of what matters. Using openended questions from the 1997 and 2002 waves of the British Household Panel Survey we analyse both quantitatively and qualitatively how perceptions of quality of life differ for men and women across the life course. Qualitative analysis reveals that key domains such as health, family and finances often refer, not to self, but to others. Longitudinal analysis demonstrates that people’s perceptions of quality of life change over time, particularly before and after important life transitions. Thus our findings challenge overly individualistic and static conceptions of quality of life and reveal quality of life as a process, not a fixed state

Towards a tool for the subjective assessment of speech system interfaces (SASSI)

Applications of speech recognition are now widespread, but user-centred evaluation methods are necessary to ensure their success. Objective evaluation techniques are fairly well established, but previous subjective techniques have been unstructured and unproven. This paper reports on the first stage of the development of a questionnaire measure for the Subjective Assessment of Speech System Interfaces (SASSI). The aim of the research programme is to produce a valid, reliable and sensitive measure of users' subjective experiences with speech recognition systems. Such a technique could make an important contribution to theory and practice in the design and evaluation of speech recognition systems according to best human factors practice. A prototype questionnaire was designed, based on established measures for evaluating the usability of other kinds of user interface, and on a review of the research literature into speech system design. This consisted of 50 statements with which respondents rated their level of agreement. The questionnaire was given to users of four different speech applications, and Exploratory Factor Analysis of 214 completed questionnaires was conducted. This suggested the presence of six main factors in users' perceptions of speech systems: System Response Accuracy, Likeability, Cognitive Demand, Annoyance, Habitability and Speed. The six factors have face validity, and a reasonable level of statistical reliability. The findings form a userful theoretical and practical basis for the subjective evaluation of any speech recognition interface. However, further work is recommended, to establish the validity and sensitivity of the approach, before a final tool can be produced which warrants general use

A physiologically inspired model for solving the cocktail party problem.

At a cocktail party, we can broadly monitor the entire acoustic scene to detect important cues (e.g., our names being called, or the fire alarm going off), or selectively listen to a target sound source (e.g., a conversation partner). It has recently been observed that individual neurons in the avian field L (analog to the mammalian auditory cortex) can display broad spatial tuning to single targets and selective tuning to a target embedded in spatially distributed sound mixtures. Here, we describe a model inspired by these experimental observations and apply it to process mixtures of human speech sentences. This processing is realized in the neural spiking domain. It converts binaural acoustic inputs into cortical spike trains using a multi-stage model composed of a cochlear filter-bank, a midbrain spatial-localization network, and a cortical network. The output spike trains of the cortical network are then converted back into an acoustic waveform, using a stimulus reconstruction technique. The intelligibility of the reconstructed output is quantified using an objective measure of speech intelligibility. We apply the algorithm to single and multi-talker speech to demonstrate that the physiologically inspired algorithm is able to achieve intelligible reconstruction of an "attended" target sentence embedded in two other non-attended masker sentences. The algorithm is also robust to masker level and displays performance trends comparable to humans. The ideas from this work may help improve the performance of hearing assistive devices (e.g., hearing aids and cochlear implants), speech-recognition technology, and computational algorithms for processing natural scenes cluttered with spatially distributed acoustic objects.R01 DC000100 - NIDCD NIH HHSPublished versio