Pushing the limits of self-supervised speaker verification using regularized distillation framework

Training robust speaker verification systems without speaker labels has long been a challenging task. Previous studies observed a large performance gap between self-supervised and fully supervised methods. In this paper, we apply a non-contrastive self-supervised learning framework called DIstillation with NO labels (DINO) and propose two regularization terms applied to embeddings in DINO. One regularization term guarantees the diversity of the embeddings, while the other regularization term decorrelates the variables of each embedding. The effectiveness of various data augmentation techniques are explored, on both time and frequency domain. A range of experiments conducted on the VoxCeleb datasets demonstrate the superiority of the regularized DINO framework in speaker verification. Our method achieves the state-of-the-art speaker verification performance under a single-stage self-supervised setting on VoxCeleb. The codes will be made publicly-available

3D-Speaker: A Large-Scale Multi-Device, Multi-Distance, and Multi-Dialect Corpus for Speech Representation Disentanglement

Disentangling uncorrelated information in speech utterances is a crucial research topic within speech community. Different speech-related tasks focus on extracting distinct speech representations while minimizing the affects of other uncorrelated information. We present a large-scale speech corpus to facilitate the research of speech representation disentanglement. 3D-Speaker contains over 10,000 speakers, each of whom are simultaneously recorded by multiple Devices, locating at different Distances, and some speakers are speaking multiple Dialects. The controlled combinations of multi-dimensional audio data yield a matrix of a diverse blend of speech representation entanglement, thereby motivating intriguing methods to untangle them. The multi-domain nature of 3D-Speaker also makes it a suitable resource to evaluate large universal speech models and experiment methods of out-of-domain learning and self-supervised learning. https://3dspeaker.github.io

Improving Speaker Diarization using Semantic Information: Joint Pairwise Constraints Propagation

Speaker diarization has gained considerable attention within speech processing research community. Mainstream speaker diarization rely primarily on speakers' voice characteristics extracted from acoustic signals and often overlook the potential of semantic information. Considering the fact that speech signals can efficiently convey the content of a speech, it is of our interest to fully exploit these semantic cues utilizing language models. In this work we propose a novel approach to effectively leverage semantic information in clustering-based speaker diarization systems. Firstly, we introduce spoken language understanding modules to extract speaker-related semantic information and utilize these information to construct pairwise constraints. Secondly, we present a novel framework to integrate these constraints into the speaker diarization pipeline, enhancing the performance of the entire system. Extensive experiments conducted on the public dataset demonstrate the consistent superiority of our proposed approach over acoustic-only speaker diarization systems.Comment: Submitted to ICASSP 202

Second cancers and causes of death in patients with testicular cancer in Sweden

While treatment for testicular cancer (TC) has become standardized after the 1980s with an associated significant improvement in patient survival, this has been accompanied by an increased risk of second primary cancers (SPCs). Patients were identified from the Swedish Cancer Registry spanning the years from 1980 to 2015, including 8788 individuals with primary TC and their SPCs. Relative risks (RRs) for SPC were calculated using the generalized Poisson regression model. SPCs were diagnosed in 9.4% of patients with TC and half of them were late onset cancers not common in the population in their 40s. Overall RR of SPCs (excluding second TC) was 1.30 (95%CI: 1.20-1.40), including high risks for seven solid cancers, non-Hodgkin lymphoma and leukemia. Second TC was the most common SPC and the RR of 17.19 (95%CI: 14.89-19.85) was the highest recorded. Cancers known to be fatal as first primary cancers were also fatal as SPC in TC patients. Survival at 30 years of follow-up was approximately 80% for TC patients without SPC but it decreased to 40% for patients with SPC. The unexpected finding that half of the identified SPCs were typical late onset cancers in the middle-aged population raises concerns that therapy may facilitate premature aging. The risks of SPC are clinically important for the long-term management of TC patients and the high-mortality calls for a future management strategy.Peer reviewe

Association of vitamin D with HIV infected individuals, TB infected individuals, and HIV-TB co-infected individuals: a systematic review and meta-analysis

BackgroundVitamin D deficiency (VDD) is a worldwide disease. VDD is also associated with an increased risk of HIV-related comorbidities and mortality, and patients have a tendency to develop active tuberculosis compared to those with latent tuberculosis infection. Vitamin D supplementation may modulate HIV replication, improve TB inflammation and reduce progression of HIV-TB co-infection.MethodsWe meta-analyzed individual participant data from cohort studies, cross-sectional study, and RCTs of vitamin D in HIV group, TB group, and HIV-TB group. The primary outcomes were differences in vitamin D level and VDD prevalence between three groups, the secondary outcomes were CD4 count, HIV viral load, time to sputum smear conversion, time to culture conversion, relapse, morality, and TB score.ResultsFor vitamin D levels, the overall mean difference (MD) between HIV group and TB group was −0.21 (95% CI, −20.80–20.38; p = 0.9, I2 = 84%), HIV group and HIV-TB group was 0.87 (95% CI, −11.45–13.20; p = 0.89, I2 = 87%), and TB group and HIV-TB group was 1.17 (95% CI, −5.21–7.55; p = 0.72, I2 = 85%). For vitamin D deficiency prevalence, the overall odds ratio (OR) for HIV group versus TB group was 1.23 (95% CI, 0.46–3.31; p = 0.68; I2 = 70%), HIV group versus HIV-TB group was 1.53 (95% CI, 1.03–2.29; p = 0.04; I2 = 0%), and TB group versus HIV-TB group was 0.85 (95% CI, 0.61–1.20; p = 0.36; I2 = 22%). In HIV-TB group, the overall OR for vitamin D group versus placebo group was 0.78 (95% CI, 0.34–1.67; p = 0.52; I2 = 60%).ConclusionOur findings indicated that there were no variations in vitamin D levels between three groups. The prevalence of vitamin D deficiency was higher in the HIV-TB group than in the HIV group. Additionally, the administration of vitamin D supplements did not have obvious impact on CD4 count and viral load. Likewise, vitamin D had no effect on time to sputum smear conversion, time to culture conversion, relapse, 12-month morality, and TB score

Unlocking the enigma: unraveling multiple cognitive dysfunction linked to glymphatic impairment in early Alzheimer’s disease

BackgroundAlzheimer’s disease (AD) is one of the world’s well-known neurodegenerative diseases, which is related to the balance mechanism of production and clearance of two proteins (amyloid-β and tau) regulated by the glymphatic system. Latest studies have found that AD patients exhibit impairments to their glymphatic system. However, the alterations in the AD disease continuum, especially in the early stages, remain unclear. Moreover, the relationship between the glymphatic system and cognitive dysfunction is still worth exploring.MethodsA novel diffusion tensor image analysis method was applied to evaluate the activity of the glymphatic system by an index for diffusivity along the perivascular space (ALPS-index). Based on this method, the activity of the glymphatic system was noninvasively evaluated in 300 subjects, including 111 normal controls (NC), 120 subjects with mild cognitive impairment (MCI), and 69 subjects with AD. Partial correlation analysis was applied to explore the association between glymphatic system and cognitive impairment based on three domain-general scales and several domain-specific cognitive scales. Receiver operating characteristic curve analysis was used to evaluate the classification performance of ALPS-index along the AD continuum.ResultsALPS-index was significantly different among NC, MCI and AD groups, and ALPS-index decreased with cognitive decline. In addition, ALPS-index was significantly correlated with the scores of the clinical scales (p<0.05, FDR corrected), especially in left hemisphere. Furthermore, combination of ALPS and fractional anisotropy (FA) values achieved better classification results (NC vs. MCI: AUC = 0.6610, NC vs. AD: AUC = 0.8214).ConclusionHere, we show that the glymphatic system is closely associated with multiple cognitive dysfunctions, and ALPS-index can be used as a biomarker for alterations along the AD continuum. This may provide new targets and strategies for the treatment of AD, and has the potential to assist clinical diagnosis

Comparison of Familial Clustering of Anogenital and Skin Cancers Between In Situ and Invasive Types

Literature on familial risk of carcinomas in situ (CISs) is limited because many cancer registries do not collect information on CIS. In Sweden CISs are collected, and we used these data to analyze familial relative risks (RRs) for concordant (CIS-CIS) types of anogenital (cervical, other female and male genital and anal) and skin squamous cell CIS; additionally RRs were assessed between CIS types and between CIS and invasive forms. RRs were calculated for the offspring generations when family members were diagnosed CIS. Case numbers for CIS ranged from 330 in anal to 177,285 in cervical CIS. Significant concordant CIS-CIS RRs were 2.74 for female genital, 1.77 for cervical and 2.29 for SCC skin CISs. The CIS forms associated also with each other, except for cervical and skin CIS types. RRs for concordant CIS-invasive cancer associations were lower than CIS-CIS associations. Cervical CIS associated with non-Hodgkin CIS which may suggest immune dysfunction as a contributing factors. The results for anogenital CIS types suggest that life style related human papilloma virus infections contributed to the observed familial associations. Lower risks for CIS-invasive cancer than CIS-CIS suggest that CIS and invasive cancers share only partially risk factors that underlie familial clustering.Peer reviewe

Familial Clustering, Second Primary Cancers and Causes of Death in Penile, Vulvar and Vaginal Cancers

Data on familial risks in penile and vulvar/vaginal cancers and in second primary cancers (SPCs) following these cancers are limited. We used the Swedish Family-Cancer Database from years 1958 through 2015 to identify 3641 penile and 8856 vulvar/vaginal cancers and to calculate relative risks (RRs) and 95% confidence intervals (CIs) for these cancers according to site-specific cancer in family members; additionally risk for SPCs was calculated. The familial RR for concordant (same) penile cancer was 3.22 (1.34-7.74), and it was 2.72 (1.69-4.39) for vulvar/vaginal cancer; RRs were increased for vulvar/vaginal cancer in families of anal cancer patients. RR for second penile cancer after penile cancers was 11.68 (7.95-17.18), while that for concordant vulvar/vaginal cancer was 9.03 (7.31-11.15). SPCs were diagnosed in 16.8% of penile cancer patients and in them 45.9% of deaths were caused by SPC (other than penile cancer). In vulvar/vaginal cancer patients with SPC, 36.4% of deaths were due to SPC. The results showed that these genital cancers might run in families and as SPCs are associated with human papilloma virus and smoking related cancers. Risk for these genital and anal SPCs are high and a follow-up plan should be agreed at diagnosis of these cancers.Peer reviewe

Sex Differences in Quality of Life and their Explanatory Variables in Patients with Non-Valvular Atrial Fibrillation

Background: Women with atrial fibrillation (AF) have poorer quality of life (QoL) than men; however, the factors contributing to the poorer QoL in women is unclear. Methods: We analyzed data for 3562 patients with non-valvular AF enrolled in the China Registry of Atrial Fibrillation. The Medical Outcomes Study 36-item Short-Form Health Survey (SF-36) was used to evaluate QoL, which was compared between women and men. A multivariate logistic regression analysis model was used to explore factors potentially explaining the sex difference in QoL. Results: Overall, 43.3% of the cohort comprised women (n=1541) who were older than their male counterparts (72 ± 9.8 vs. 68 ± 11.9 years, P<0.001). Compared with men, women were more likely to have more symptoms, hypertension, diabetes mellitus, and heart failure. Women were less likely than men to receive catheter ablation (4.5% vs. 6.1%, P=0.044). Women also had lower physical component summary (PCS) scores (48 ± 9 vs. 51 ± 9, P<0.001) and mental component summary (MCS) scores (49 ± 10 vs. 51 ± 10, P<0.001) than men. In the multivariable analysis of the poorer PCS scores in women, patient age explained 32.9%, low socioeconomic status explained 20.0%, lifestyle explained 14.3%, cardiovascular comorbidities explained 15.7%, the presence of more symptoms explained 5.7%, and less catheter ablation explained 1.4%. These factors also explained similar proportions of the sex difference in MCS scores. Together, these factors explained 54.3% of the poorer physical function status and 46.8% of the poorer mental function status in women than men. Conclusions: Women with AF had poorer QoL than men. The following factors partly explained the poorer QoL in women: older age, low level of socioeconomic status, more cardiovascular comorbidities, less smoking and drinking, more symptoms, and less catheter ablation