107 research outputs found

    MIRNet: Learning multiple identities representations in overlapped speech

    Full text link
    Many approaches can derive information about a single speaker's identity from the speech by learning to recognize consistent characteristics of acoustic parameters. However, it is challenging to determine identity information when there are multiple concurrent speakers in a given signal. In this paper, we propose a novel deep speaker representation strategy that can reliably extract multiple speaker identities from an overlapped speech. We design a network that can extract a high-level embedding that contains information about each speaker's identity from a given mixture. Unlike conventional approaches that need reference acoustic features for training, our proposed algorithm only requires the speaker identity labels of the overlapped speech segments. We demonstrate the effectiveness and usefulness of our algorithm in a speaker verification task and a speech separation system conditioned on the target speaker embeddings obtained through the proposed method.Comment: Accepted in Interspeech 202

    HD-DEMUCS: General Speech Restoration with Heterogeneous Decoders

    Full text link
    This paper introduces an end-to-end neural speech restoration model, HD-DEMUCS, demonstrating efficacy across multiple distortion environments. Unlike conventional approaches that employ cascading frameworks to remove undesirable noise first and then restore missing signal components, our model performs these tasks in parallel using two heterogeneous decoder networks. Based on the U-Net style encoder-decoder framework, we attach an additional decoder so that each decoder network performs noise suppression or restoration separately. We carefully design each decoder architecture to operate appropriately depending on its objectives. Additionally, we improve performance by leveraging a learnable weighting factor, aggregating the two decoder output waveforms. Experimental results with objective metrics across various environments clearly demonstrate the effectiveness of our approach over a single decoder or multi-stage systems for general speech restoration task.Comment: Accepted by INTERSPEECH 202

    On Exact Inversion of DPM-Solvers

    Full text link
    Diffusion probabilistic models (DPMs) are a key component in modern generative models. DPM-solvers have achieved reduced latency and enhanced quality significantly, but have posed challenges to find the exact inverse (i.e., finding the initial noise from the given image). Here we investigate the exact inversions for DPM-solvers and propose algorithms to perform them when samples are generated by the first-order as well as higher-order DPM-solvers. For each explicit denoising step in DPM-solvers, we formulated the inversions using implicit methods such as gradient descent or forward step method to ensure the robustness to large classifier-free guidance unlike the prior approach using fixed-point iteration. Experimental results demonstrated that our proposed exact inversion methods significantly reduced the error of both image and noise reconstructions, greatly enhanced the ability to distinguish invisible watermarks and well prevented unintended background changes consistently during image editing. Project page: \url{https://smhongok.github.io/inv-dpm.html}.Comment: 16 page

    The variation of relative magnetic helicity around major flares

    Full text link
    We have investigated the variation of magnetic helicity over a span of several days around the times of 11 X-class flares which occurred in seven active regions (NOAA 9672, 10030, 10314, 10486, 10564, 10696, and 10720) using the magnetograms taken by the Michelson Doppler Imager (MDI) on board the Solar and Heliospheric Observatory (SOHO). As a major result we found that each of these major flares was preceded by a significant helicity accumulation over a long period (0.5 to a few days). Another finding is that the helicity accumulates at a nearly constant rate and then becomes nearly constant before the flares. This led us to distinguish the helicity variation into two phases: a phase of monotonically increasing helicity and the following phase of relatively constant helicity. As expected, the amount of helicity accumulated shows a modest correlation with time-integrated soft X-ray flux during flares. However, the average helicity change rate in the first phase shows even stronger correlation with the time-integrated soft X-ray flux. We discuss the physical implications of this result and the possibility that this characteristic helicity variation pattern can be used as an early warning sign for solar eruptions

    Genome structures and transcriptomes signify niche adaptation for the multiple-ion-tolerant extremophyte Schrenkiella parvula

    Get PDF
    Schrenkiella parvula (formerly Thellungiella parvula), a close relative of Arabidopsis (Arabidopsis thaliana) and Brassica crop species, thrives on the shores of Lake Tuz, Turkey, where soils accumulate high concentrations of multiple-ion salts. Despite the stark differences in adaptations to extreme salt stresses, the genomes of S. parvula and Arabidopsis show extensive synteny. S. parvula completes its life cycle in the presence of Na+, K+, Mg2+, Li+, and borate at soil concentrations lethal to Arabidopsis. Genome structural variations, including tandem duplications and translocations of genes, interrupt the colinearity observed throughout the S. parvula and Arabidopsis genomes. Structural variations distinguish homologous gene pairs characterized by divergent promoter sequences and basal-level expression strengths. Comparative RNA sequencing reveals the enrichment of ion-transport functions among genes with higher expression in S. parvula, while pathogen defense-related genes show higher expression in Arabidopsis. Key stress-related ion transporter genes in S. parvula showed increased copy number, higher transcript dosage, and evidence for subfunctionalization. This extremophyte offers a framework to identify the requisite adjustments of genomic architecture and expression control for a set of genes found in most plants in a way to support distinct niche adaptation and lifestyles. © 2014 American Society of Plant Biologists. All rights reserved

    Depression, antidepressant use, and the risk of type 2 diabetes: a nationally representative cohort study

    Get PDF
    BackgroundPrevious studies have reported that depression can increase the risk of type 2 diabetes. However, they did not sufficiently consider antidepressants or comorbidity.MethodsThe National Health Insurance Sharing Service database was used. Among the sample population, 276,048 subjects who had been diagnosed with depression and prescribed antidepressants (DEP with antidepressants group) and 79,119 subjects who had been diagnosed with depression but not prescribed antidepressants (DEP without antidepressants group) were found to be eligible for this study. Healthy controls (HCs) were 1:1 matched with the DEP with antidepressants group for age and sex. We followed up with them for the occurrence of type 2 diabetes.ResultsIn the group of DEP with antidepressants, although the risk of type 2 diabetes increased compared to HCs in a crude analysis, it decreased when comorbidity was adjusted for. In the group of DEP without antidepressants, the risk of type 2 diabetes decreased both in the crude model and the adjusted models. The risk varied by age group and classes or ingredients of antidepressants, with young adult patients showing an increased risk even in the fully adjusted model.ConclusionOverall, those with depression had a reduced risk of type 2 diabetes. However, the risk varied according to the age at onset, comorbidity, and type of antidepressants

    TsHKT1;2, a HKT1 homolog from the extremophile arabidopsis relative Thellungiella salsuginea, shows K \u3csup\u3e+\u3c/sup\u3e specificity in the presence of NaCl

    Get PDF
    Cellular Na +/K + ratio is a crucial parameter determining plant salinity stress resistance. We tested the function of plasma membrane Na +/K + cotransporters in the High-affinity K + Transporter (HKT) family from the halophytic Arabidopsis (Arabidopsis thaliana) relative Thellungiella salsuginea. T. salsuginea contains at least two HKT genes. TsHKT1;1 is expressed at very low levels, while the abundant TsHKT1;2 is transcriptionally strongly up-regulated by salt stress. TsHKT-based RNA interference in T. salsuginea resulted in Na + sensitivity and K + deficiency. The athkt1 mutant lines overexpressing TsHKT1;2 proved less sensitive to Na + and showed less K + deficiency than lines overexpressing AtHKT1. TsHKT1;2 ectopically expressed in yeast mutants lacking Na + or K + transporters revealed strong K + transporter activity and selectivity for K + over Na +. Altering two amino acid residues in TsHKT1;2 to mimic the AtHKT1 sequence resulted in enhanced sodium uptake and loss of the TsHKT1;2 intrinsic K + transporter activity. We consider the maintenance of K + uptake through TsHKT1;2 under salt stress an important component supporting the halophytic lifestyle of T. salsuginea. © 2012 American Society of Plant Biologists
    corecore