Anonymizing Speech: Evaluating and Designing Speaker Anonymization Techniques

The growing use of voice user interfaces has led to a surge in the collection and storage of speech data. While data collection allows for the development of efficient tools powering most speech services, it also poses serious privacy issues for users as centralized storage makes private personal speech data vulnerable to cyber threats. With the increasing use of voice-based digital assistants like Amazon's Alexa, Google's Home, and Apple's Siri, and with the increasing ease with which personal speech data can be collected, the risk of malicious use of voice-cloning and speaker/gender/pathological/etc. recognition has increased. This thesis proposes solutions for anonymizing speech and evaluating the degree of the anonymization. In this work, anonymization refers to making personal speech data unlinkable to an identity while maintaining the usefulness (utility) of the speech signal (e.g., access to linguistic content). We start by identifying several challenges that evaluation protocols need to consider to evaluate the degree of privacy protection properly. We clarify how anonymization systems must be configured for evaluation purposes and highlight that many practical deployment configurations do not permit privacy evaluation. Furthermore, we study and examine the most common voice conversion-based anonymization system and identify its weak points before suggesting new methods to overcome some limitations. We isolate all components of the anonymization system to evaluate the degree of speaker PPI associated with each of them. Then, we propose several transformation methods for each component to reduce as much as possible speaker PPI while maintaining utility. We promote anonymization algorithms based on quantization-based transformation as an alternative to the most-used and well-known noise-based approach. Finally, we endeavor a new attack method to invert anonymization.Comment: PhD Thesis Pierre Champion | Universit\'e de Lorraine - INRIA Nancy | for associated source code, see https://github.com/deep-privacy/SA-toolki

Beyond the bottom line:redefining the value of design in SME formation

For SMEs to operate in the complex and globalised economic landscape of today engaging with innovation can sustain competitive advantage. Within Design Management, design is being increasingly posited as a strategic resource to facilitate the absorption of new design resources and leverage design knowledge in ways that support SMEs through such economic pressures. Evidencing the relationship between design and economic performance is complex, leading to extensive current research and industry efforts to show how design adds economic value. Despite the value of such efforts, it is important to recognise that innovation means different things to different organizations, especially for start-ups and SMEs. Within the rising tide of design-led innovation, there is a gap being explored in how design can effectively capture and evaluate its contribution within the complex and diverse situations of business development it engages. In seeking to address this gap, this paper presents findings from research undertaken within Design in Action (DiA), an AHRC-funded knowledge exchange hub. Presenting DiA as a single case study, the paper offers methodical reflection on five case example start-up businesses funded by DiA in order to explore the value that design-led innovation approaches offered in their formation

A Study of F0 Modification for X-Vector Based Speech Pseudonymization Across Gender

International audienceSpeech pseudonymization aims at altering a speech signal to map the identifiable personal characteristics of a given speaker to another identity. In other words, it aims to hide the source speaker identity while preserving the intelligibility of the spoken content. This study takes place in the VoicePrivacy 2020 challenge framework, where the baseline system performs pseudonymization by modifying x-vector information to match a target speaker while keeping the fundamental frequency (F0) unchanged. We propose to alter other paralin-guistic features, here F0, and analyze the impact of this modification across gender. We found that the proposed F0 modification always improves pseudonymization We observed that both source and target speaker genders affect the performance gain when modifying the F0

Speaker information modification in the VoicePrivacy 2020 toolchain

This paper presents a study of the baseline system of the VoicePrivacy 2020 challenge. This baseline relies on a voice conversion system that aims at separating speaker identity and linguistic contents for a given speech utterance. To generate an anonymized speech waveform, the neural acoustic model and neural waveform model use the related linguistic content together with a selected pseudo-speaker identity. The linguistic content is estimated using bottleneck features extracted from a triphone classifier while the speaker information is extracted then modified to target a pseudo-speaker identity in the x-vector's space. In this work, we first proposed to replace the triphone-based bottleneck features extractor that requires supervised training by an end-to-end Automatic Speech Recognition (ASR) system. In this framework, we explored the use of adver-sarial and semi-adversarial training to learn linguistic features while masking speaker information. Last, we explored several anonymization schemes to introspect which module benefits the most from the generated pseudo-speaker identities

Understanding the Interdependence of Penetration Depth and Deformation on Nanoindentation of Nanoporous Silver

International audienceA silver-based nanoporous material was produced by dealloying (selective chemical etching) of an Ag 38.75 Cu 38.75 Si 22.5 crystalline alloy. Composed of connected ligaments, this material was imaged using a scanning electron microscope (SEM) and focused ion-beam (FIB) scanning electron microscope tomography. Its mechanical behavior was evaluated using nanoindentation and found to be heterogeneous, with density variation over a length scale of a few tens of nanometers, similar to the indent size. This technique proved relevant to the investigation of a material's mechanical strength, as well as to how its behavior related to the material's microstructure. The hardness is recorded as a function of the indent depth and a phenomenological description based on strain gradient and densification kinetic was proposed to describe the resultant depth dependence

Design Innovation for creative growth: Modelling relational exchange to support and evaluate creative enterprise in the Scottish Highlands and Islands

This article examines the development and delivery of a Creative Growth Model as part of a programme of Design Innovation activities with creative micro-enterprises and support organizations in the Highlands and Islands region of Scotland. There is a growing body of critique for how creative enterprise is framed, supported and evaluated in relation to economic notions of value and growth that struggle to incorporate the sociocultural interests and activities of sole traders and micro-enterprises. This article presents a Design Innovation approach for identifying situated conceptions of value, modelled as emergent value constellations, based on the diverse interactions and relational exchanges prevalent within the creative enterprise. This research draws predominantly on the work of Design Innovation for New Growth (DING), a two-year AHRC follow-on funded project between 2017 and 2019, which engaged with existing creative expertise in the Highlands and Northern Isles of Scotland to mobilize local practitioners as central drivers of innovation. The article aims to contribute to co-design literature seeking to develop ‘design practices that understand how value is co-produced, […] understood, generated, and employed’ (Whitham et al. 2019: 2) in conjunction with creative enterprises

Modélisation de la combustion turbulente des mélanges hétérogènes en richesse : Des flammes de prémélange aux flammes de diffusion

International audienc

Nonlinear unsteady streaks engendered by the interaction of free-stream vorticity with a compressible boundary layer

The nonlinear response of a compressible boundary layer to unsteady free-stream vortical fluctuations of the convected-gust type is investigated theoretically and numerically. The free-stream Mach number is assumed to be of O(1) and the effects of compressibility, including aerodynamic heating and heat transfer at the wall, are taken into account. Attention is focused on low-frequency perturbations, which induce strong streamwise-elongated components of the boundary-layer disturbances, known as streaks or Klebanoff modes. The amplitude of the disturbances is intense enough for nonlinear interactions to occur within the boundary layer. The generation and nonlinear evolution of the streaks, which acquire an O(1) magnitude, are described on a self-consistent and first-principle basis using the mathematical framework of the nonlinear unsteady compressible boundary-region equations, which are derived herein for the first time. The free-stream flow is studied by including the boundary-layer displacement effect and the solution is matched asymptotically with the boundary-layer flow. The nonlinear interactions inside the boundary layer drive an unsteady two-dimensional flow of acoustic nature in the outer inviscid region through the displacement effect. A close analogy with the flow over a thin oscillating airfoil is exploited to find analytical solutions. This analogy has been widely employed to investigate steady flows over boundary layers, but is considered herein for the first time for unsteady boundary layers. In the subsonic regime the perturbation is felt from the plate in all directions, while at supersonic speeds the disturbance only propagates within the dihedron defined by the Mach line. Numerical computations are performed for carefully chosen parameters that characterize three practical applications: turbomachinery systems, supersonic flight conditions and wind tunnel experiments. The results show that nonlinearity plays a marked stabilizing role on the velocity and temperature streaks, and this is found to be the case for low-disturbance environments such as flight conditions. Increasing the free-stream Mach number inhibits the kinematic fluctuations but enhances the thermal streaks, relative to the free-stream velocity and temperature respectively, and the overall effect of nonlinearity becomes weaker. An abrupt deviation of the nonlinear solution from the linear one is observed in the case pertaining to a supersonic wind tunnel. Large-amplitude thermal streaks and the strong abrupt stabilizing effect of nonlinearity are two new features of supersonic flows. The present study provides an accurate signature of nonlinear streaks in compressible boundary layers, which is indispensable for the secondary instability analysis of unsteady streaky boundary-layer flows

Evaluation of Speaker Anonymization on Emotional Speech

International audienceSpeech data carries a range of personal information, such as the speaker's identity and emotional state. These attributes can be used for malicious purposes. With the development of virtual assistants, a new generation of privacy threats has emerged. Current studies have addressed the topic of preserving speech privacy. One of them, the VoicePrivacy initiative aims to promote the development of privacy preservation tools for speech technology. The task selected for the VoicePrivacy 2020 Challenge (VPC) is about speaker anonymization. The goal is to hide the source speaker's identity while preserving the linguistic information. The baseline of the VPC makes use of a voice conversion. This paper studies the impact of the speaker anonymization baseline system of the VPC on emotional information present in speech utterances. Evaluation is performed following the VPC rules regarding the attackers' knowledge about the anonymization system. Our results show that the VPC baseline system does not suppress speakers' emotions against informed attackers. When comparing anonymized speech to original speech, the emotion recognition performance is degraded by 15% relative to IEMOCAP data, similar to the degradation observed for automatic speech recognition used to evaluate the preservation of the linguistic information

CYP1A1 Induction in the Colon by Serum: Involvement of the PPARα Pathway and Evidence for a New Specific Human PPREα Site

International audienceBackground: We previously showed that blood serum induced cytochrome P450 1A1 (CYP1A1) monooxygenase expression in vitro.Objective: Our purpose was (i) to identify the molecular mechanism involved and (ii) to characterize the inducer compound(s) in serum involved at least in part.Methods: Serum was fractionated on hydrophobic columns. PPARα involvement was demonstrated by gene reporter assays, DNA mutagenesis and EMSA. Gene expression was evaluated by qRT-PCR. Serum samples were analyzed using HS-SPME-GC-MS.Results: The inductive effect of serum did not depend on the AhR pathway and was enhanced by cotransfection of PPARα cDNA. Mutations in the PPAR response elements of the CYP1A1 gene promoter suppressed this effect. One of the PPRE sites appeared highly specific for human PPARα, an unreported PPRE property. A link was found between CYP1A1 inducibility and serum hydrophobic compounds. Characterization of sera showed that hexanal, a metabolite produced by peroxidation of linoleic acid, was involved in CYP1A1 induction by serum, possibly along with other serum entities.Conclusion: We demonstrate that serum induces CYP1A1 via the PPARα pathway and that hexanal is one of the serum inducers. The two PPRE sites within the CYP1A1 promoter are functional and one of them is specific for PPARα