A silent speech system based on permanent magnet articulography and direct synthesis

In this paper we present a silent speech interface (SSI) system aimed at restoring speech communication for individuals who have lost their voice due to laryngectomy or diseases affecting the vocal folds. In the proposed system, articulatory data captured from the lips and tongue using permanent magnet articulography (PMA) are converted into audible speech using a speaker-dependent transformation learned from simultaneous recordings of PMA and audio signals acquired before laryngectomy. The transformation is represented using a mixture of factor analysers, which is a generative model that allows us to efficiently model non-linear behaviour and perform dimensionality reduction at the same time. The learned transformation is then deployed during normal usage of the SSI to restore the acoustic speech signal associated with the captured PMA data. The proposed system is evaluated using objective quality measures and listening tests on two databases containing PMA and audio recordings for normal speakers. Results show that it is possible to reconstruct speech from articulator movements captured by an unobtrusive technique without an intermediate recognition step. The SSI is capable of producing speech of sufficient intelligibility and naturalness that the speaker is clearly identifiable, but problems remain in scaling up the process to function consistently for phonetically rich vocabularies

Integrating user-centred design in the development of a silent speech interface based on permanent magnetic articulography

Abstract: A new wearable silent speech interface (SSI) based on Permanent Magnetic Articulography (PMA) was developed with the involvement of end users in the design process. Hence, desirable features such as appearance, port-ability, ease of use and light weight were integrated into the prototype. The aim of this paper is to address the challenges faced and the design considerations addressed during the development. Evaluation on both hardware and speech recognition performances are presented here. The new prototype shows a com-parable performance with its predecessor in terms of speech recognition accuracy (i.e. ~95% of word accuracy and ~75% of sequence accuracy), but significantly improved appearance, portability and hardware features in terms of min-iaturization and cost

Fundamental representations and algebraic properties of biquaternions or complexified quaternions

The fundamental properties of biquaternions (complexified quaternions) are presented including several different representations, some of them new, and definitions of fundamental operations such as the scalar and vector parts, conjugates, semi-norms, polar forms, and inner and outer products. The notation is consistent throughout, even between representations, providing a clear account of the many ways in which the component parts of a biquaternion may be manipulated algebraically

Going beyond Visualization. Verbalization as Complementary Medium to Explain Machine Learning Models

In this position paper, we argue that a combination of visualization and verbalization techniques is beneficial for creating broad and versatile insights into the structure and decision-making processes of machine learning models. Explainability of machine learning models is emerging as an important area of research. Hence, insights into the inner workings of a trained model allow users and analysts, alike, to understand the models, develop justifications, and gain trust in the systems they inform. Explanations can be generated through different types of media, such as visualization and verbalization. Both are powerful tools that enable model interpretability. However, while their combination is arguably more powerful than each medium separately, they are currently applied and researched independently. To support our position that the combination of the two techniques is beneficial to explain machine learning models, we describe the design space of such a combination and discuss arising research questions, gaps, and opportunities

Angle-resonant stimulated polariton amplifier

We experimentally demonstrate resonant coupling between photons and excitons in microcavities which can efficiently generate enormous single-pass optical gains approaching 100. This new parametric phenomenon appears as a sharp angular resonance of the incoming pump beam, at which the moving excitonic polaritons undergo very large changes in momentum. Ultrafast stimulated scattering is clearly identified from the exponential dependence on pump intensity. This device utilizes boson amplification induced by stimulated energy relaxation

Absolute Frequency Measurements of the Hg^+ and Ca Optical Clock Transitions with a Femtosecond Laser

The frequency comb created by a femtosecond mode-locked laser and a microstructured fiber is used to phase coherently measure the frequencies of both the Hg^+ and Ca optical standards with respect to the SI second as realized at NIST. We find the transition frequencies to be f_Hg=1 064 721 609 899 143(10) Hz and f_Ca=455 986 240 494 158(26) Hz, respectively. In addition to the unprecedented precision demonstrated here, this work is the precursor to all-optical atomic clocks based on the Hg^+ and Ca standards. Furthermore, when combined with previous measurements, we find no time variations of these atomic frequencies within the uncertainties of |(df_Ca/dt)/f_Ca| < 8 x 10^{-14} yr^{-1}, and |(df_Hg/dt)/f_Hg|< 30 x 10^{-14} yr^{-1}.Comment: 6 pages, including 4 figures. RevTex 4. Submitted to Phys. Rev. Let

Restoring speech following total removal of the larynx by a learned transformation from sensor data to acoustics

Total removal of the larynx may be required to treat laryngeal cancer: speech is lost. This article shows that it may be possible to restore speech by sensing movement of the remaining speech articulators and use machine learning algorithms to derive a transformation to convert this sensor data into an acoustic signal. The resulting “silent speech,” which may be delivered in real time, is intelligible and sounds natural. The identity of the speaker is recognisable. The sensing technique involves attaching small, unobtrusive magnets to the lips and tongue and monitoring changes in the magnetic field induced by their movement

Myocardial perfusion scintigraphy: the evidence: A consensus conference organised by the British Cardiac Society, the British Nuclear Cardiology Society and the British Nuclear Medicine Society, endorsed by the Royal College of Physicians of London and the Royal College of Radiologists

This review summarises the evidence for the role of myocardial perfusion scintigraphy (MPS) in patients with known or suspected coronary artery disease. It is the product of a consensus conference organised by the British Cardiac Society, the British Nuclear Cardiology Society and the British Nuclear Medicine Society and is endorsed by the Royal College of Physicians of London and the Royal College of Radiologists. It was used to inform the UK National Institute of Clinical Excellence in their appraisal of MPS in patients with chest pain and myocardial infarction. MPS is a well-established, non-invasive imaging technique with a large body of evidence to support its effectiveness in the diagnosis and management of angina and myocardial infarction. It is more accurate than the exercise ECG in detecting myocardial ischaemia and it is the single most powerful technique for predicting future coronary events. The high diagnostic accuracy of MPS allows reliable risk stratification and guides the selection of patients for further interventions, such as revascularisation. This in turn allows more appropriate utilisation of resources, with the potential for both improved clinical outcomes and greater cost-effectiveness. Evidence from modelling and observational studies supports the enhanced cost-effectiveness associated with MPS use. In patients presenting with stable or acute chest pain, strategies of investigation involving MPS are more cost-effective than those not using the technique. MPS also has particular advantages over alternative techniques in the management of a number of patient subgroups, including women, the elderly and those with diabetes, and its use will have a favourable impact on cost-effectiveness in these groups. MPS is already an integral part of many clinical guidelines for the investigation and management of angina and myocardial infarction. However, the technique is underutilised in the UK, as judged by the inappropriately long waiting times and by comparison with the numbers of revascularisations and coronary angiograms performed. Furthermore, MPS activity levels in this country fall far short of those in comparable European countries, with about half as many scans being undertaken per year. Currently, the number of MPS studies performed annually in the UK is 1,200/million population/year. We estimate the real need to be 4,000/million/year. The current average waiting time is 20 weeks and we recommend that clinically appropriate upper limits of waiting time are 6 weeks for routine studies and 1 week for urgent studies