Decoding visemes: improving machine lip-reading

To undertake machine lip-reading, we try to recognise speech from a visual signal. Current work often uses viseme classification supported by language models with varying degrees of success. A few recent works suggest phoneme classification, in the right circumstances, can outperform viseme classification. In this work we present a novel two-pass method of training phoneme classifiers which uses previously trained visemes in the first pass. With our new training algorithm, we show classification performance which significantly improves on previous lip-reading results

Alien Registration- Harvey, Helen M. (Pittsfield, Somerset County)

https://digitalmaine.com/alien_docs/6593/thumbnail.jp

Spatial evaluation of volcanic ash forecasts using satellite observations

The decision to close airspace in the event of a volcanic eruption is based on hazard maps of predicted ash extent. These are produced using output from volcanic ash transport and dispersion (VATD)models. In this paper an objectivemetric to evaluate the spatial accuracy of VATD simulations relative to satellite retrievals of volcanic ash is presented. The 5 metric is based on the fractions skill score (FSS). Thismeasure of skill provides more information than traditional point-bypoint metrics, such as success index and Pearson correlation coefficient, as it takes into the account spatial scale overwhich skill is being assessed. The FSS determines the scale overwhich a simulation has skill and can differentiate between a "near miss" and a forecast that is badly misplaced. The 10 idealised scenarios presented show that even simulations with considerable displacement errors have useful skill when evaluated over neighbourhood scales of 200–700km2. This method could be used to compare forecasts produced by different VATDs or using different model parameters, assess the impact of assimilating satellite retrieved ash data and evaluate VATD forecasts over a long time period

Alternative visual units for an optimized phoneme-based lipreading system

Lipreading is understanding speech from observed lip movements. An observed series of lip motions is an ordered sequence of visual lip gestures. These gestures are commonly known, but as yet are not formally defined, as `visemes’. In this article, we describe a structured approach which allows us to create speaker-dependent visemes with a fixed number of visemes within each set. We create sets of visemes for sizes two to 45. Each set of visemes is based upon clustering phonemes, thus each set has a unique phoneme-to-viseme mapping. We first present an experiment using these maps and the Resource Management Audio-Visual (RMAV) dataset which shows the effect of changing the viseme map size in speaker-dependent machine lipreading and demonstrate that word recognition with phoneme classifiers is possible. Furthermore, we show that there are intermediate units between visemes and phonemes which are better still. Second, we present a novel two-pass training scheme for phoneme classifiers. This approach uses our new intermediary visual units from our first experiment in the first pass as classifiers; before using the phoneme-to-viseme maps, we retrain these into phoneme classifiers. This method significantly improves on previous lipreading results with RMAV speakers

The impact of a father's presence during newborn resuscitation:a qualitative interview study with healthcare professionals

Objective: To explore healthcare professionals’ experiences around the time of newborn resuscitation in the delivery room, when the baby’s father was present. Design: A qualitative descriptive, retrospective design using the critical incident approach. Tape-recorded semistructured interviews were undertaken with healthcare professionals involved in newborn resuscitation. Participants recalled resuscitation events when the baby’s father was present. They described what happened and how those present, including the father, responded. They also reflected upon the impact of the resuscitation and the father’s presence on themselves. Participant responses were analysed using thematic analysis. Setting: A large teaching hospital in the UK. Participants: Purposive sampling was utilised. It was anticipated that 35–40 participants would be recruited. Forty-nine potential participants were invited to take part. The final sample consisted of 37 participants including midwives, obstetricians, anaesthetists, neonatal nurse practitioners, neonatal nurses and paediatricians. Results: Four themes were identified: ‘whose role?’ ‘saying and doing’ ‘teamwork’ and ‘impact on me’. While no-one was delegated to support the father during the resuscitation, midwives and anaesthetists most commonly took on this role. Participants felt the midwife was the most appropriate person to support fathers. All healthcare professional groups said they often did not know what to say to fathers during prolonged resuscitation. Teamwork was felt to be of benefit to all concerned, including the father. Some paediatricians described their discomfort when fathers came to the resuscitaire. None of the participants had received education and training specifically on supporting fathers during newborn resuscitation. Conclusions: This is the first known study to specifically explore the experiences of healthcare professionals of the father’s presence during newborn resuscitation. The findings suggest the need for more focused training about supporting fathers. There is also scope for service providers to consider ways in which fathers can be supported more readily during newborn resuscitation

Comparing heterogeneous visual gestures for measuring the diversity of visual speech signals

Visual lip gestures observed whilst lipreading have a few working definitions, the most common two are: ‘the visual equivalent of a phoneme’ and ‘phonemes which are indistinguishable on the lips’. To date there is no formal definition, in part because to date we have not established a two-way relationship or mapping between visemes and phonemes. Some evidence suggests that visual speech is highly dependent upon the speaker. So here, we use a phoneme-clustering method to form new phoneme-to-viseme maps for both individual and multiple speakers. We test these phoneme to viseme maps to examine how similarly speakers talk visually and we use signed rank tests to measure the distance between individuals. We conclude that broadly speaking, speakers have the same repertoire of mouth gestures, where they differ is in the use of the gestures

Local currency adoption and use: insights from a realist evaluation of the Bristol Pound

Local currencies (LCs) are seen as a means of achieving greater local economic and environmentalsustainability by keeping value circulating locally. However, there is weak evidence regarding theirsuccess on this score, not least because their achievement of scale is rare. There is rather moreevidence that their social dynamics and role as “moral money” constitute their main appeal to users.Given the recent promotion of LCs in the UK as a step towards low-carbon economies, this presentsan apparent contradiction since, in order to break out of their niche and reach scale, their promotersneed to go beyond their proposed economic impacts to understand the incentives and reasoninginvolved in adopting and using them. We therefore employ realist evaluation to examine theadoption pathways of Bristol Pound (B£) users, the UK’s largest LC. We find that Bristol’s identity as acentre of alternative culture is a key context for adoption. Within this the values, image and identityof the B£ as alternative, along with the social networks that identify with these values, produces anexus of potential users for the B£. At the same time, these factors also create strong boundaries toits use constraining the currency to a niche of ideologically committed and motivated users. Theanalysis also shows how even for some of these users shopping habits and financial security constrainuse. Critically, these findings highlight the bind that LCs have to address if they are to reach scale andthe economic impact to which they aspire