Decentralized Stochastic Bilevel Optimization with Improved per-Iteration Complexity

Bilevel optimization recently has received tremendous attention due to its great success in solving important machine learning problems like meta learning, reinforcement learning, and hyperparameter optimization. Extending single-agent training on bilevel problems to the decentralized setting is a natural generalization, and there has been a flurry of work studying decentralized bilevel optimization algorithms. However, it remains unknown how to design the distributed algorithm with sample complexity and convergence rate comparable to SGD for stochastic optimization, and at the same time without directly computing the exact Hessian or Jacobian matrices. In this paper we propose such an algorithm. More specifically, we propose a novel decentralized stochastic bilevel optimization (DSBO) algorithm that only requires first order stochastic oracle, Hessian-vector product and Jacobian-vector product oracle. The sample complexity of our algorithm matches the currently best known results for DSBO, and the advantage of our algorithm is that it does not require estimating the full Hessian and Jacobian matrices, thereby having improved per-iteration complexity.Comment: ICML 202

Sturge-Weber Syndrome

Sturge-Weber syndrome (SWS) is a neurocutaneous syndrome, characterized by the association of facial port-wine hemangiomas in the trigeminal nerve distribution area, with vascular malformation(s) of the brain (leptomeningeal angioma) with or without glaucoma. Herein, we reported Sturge-Weber syndrome in a 50-year-old man, who presented port-wine hemangiomas and epilepsy. In this case, the patient's epilepsy episodes from his first year of life had been ignored and separated from the entity of SWS by his physicians, which led to delayed treatment. This case illustrates the importance of careful examination of patients of any age with hemangiomas in the trigeminal nerve with concomitant episodes of epilepsy. In such cases, there should be yearly neuroimaging screenings to guaranteed early interdisciplinary interventions from the time of definite diagnosis

The audio auditor: user-level membership inference in Internet of Things voice services

With the rapid development of deep learning techniques, the popularity of voice services implemented on various Internet of Things (IoT) devices is ever increasing. In this paper, we examine user-level membership inference in the problem space of voice services, by designing an audio auditor to verify whether a specific user had unwillingly contributed audio used to train an automatic speech recognition (ASR) model under strict black-box access. With user representation of the input audio data and their corresponding translated text, our trained auditor is effective in user-level audit. We also observe that the auditor trained on specific data can be generalized well regardless of the ASR model architecture. We validate the auditor on ASR models trained with LSTM, RNNs, and GRU algorithms on two state-of-the-art pipelines, the hybrid ASR system and the end-to-end ASR system. Finally, we conduct a real-world trial of our auditor on iPhone Siri, achieving an overall accuracy exceeding 80%. We hope the methodology developed in this paper and findings can inform privacy advocates to overhaul IoT privacy

A Prospective Study of the Surgical Outcome of Simple Uvulopalatopharyngoplasty (UPPP), UPPP Combined With Genioglossus Advancement or Tongue Base Advancement for Obstructive Sleep Apnea Hypopnea Syndrome Patients With Multilevel Obstruction

ObjectivesTo investigate the surgical outcomes of different uvulopalatopharyngoplasty (UPPP).Methods All subjects underwent overnight polysomnography and were evaluated using the Epworth sleepiness scale (ESS), the Quebec sleep questionnaire and the snoring scale at the baseline and 3 and 12 months following operation. The primary endpoint was the overall effective rate representing the sum of the surgical success rate and effective rate.ResultsThe overall effective rate at 12 months post surgery was 55.6% for simple UPPP, 95.8% for UPPP+GA, and 92.3% for UPPP+TBA. The surgical success rate at 3 and 12 months postoperation for UPPP+GA or UPPP+TBA was significantly higher than simple UPPP (P<0.05). Marked improvement was observed in all patients in the snoring scale score and the ESS score 3 and 12 months following surgery compared to the baseline (P<0.05 in all).ConclusionUPPP, UPPP+GA, and UPPP+TBA are all effective in improving the surgical outcome of obstructive sleep apnea hypopnea syndrome (OSAHS) patients with multilevel obstruction. UPPP+TBA appears to be the most effective in treating OSAHS patients

MicroRNA miR-378 Regulates Nephronectin Expression Modulating Osteoblast Differentiation by Targeting GalNT-7

MicroRNAs (miRNAs) are small fragments of single-stranded RNA containing 18-24 nucleotides, and are generated from endogenous transcripts. MicroRNAs function in post-transcriptional gene silencing by targeting the 3′-untranslated region (UTR) of mRNAs, resulting in translational repression. We have developed a system to study the role of miRNAs in cell differentiation. We have found that one of the miRNAs tested in our system (miR-378, also called miR-378*) plays a role in modulating nephronectin-mediated differentiation in the osteoblastic cell line, MC3T3-E1. Nephronectin is an extracellular matrix protein, and we have demonstrated that its over-expression enhanced osteoblast differentiation and bone nodule formation. Furthermore, we found that the nephronectin 3′-untranslated region (3′UTR) contains a binding site for miR-378. Stable transfection of MC3T3-E1 cells with miR-378 inhibited cell differentiation. MC3T3-E1 cells stably transfected with nephronectin exhibited higher rates of differentiation and nodule formation as compared with cells transfected with nephronectin containing the 3′UTR in the early stages of development, suggesting that endogenous miR-378 is present and active. However, in the later stages of MC3T3-E1 development, the differentiation rates were opposite, with higher rates of differentiation and nodule formation in the cells over-expressing the 3′UTR of nephronectin. This appeared to be the consequence of competition between nephronectin and UDP-N-acetyl-alpha-D-galactosamine:polypeptide N-acetylgalactosaminyltransferase 7 (GalNAc-T7 or GalNT7) for miR-378 binding, resulting in increased GalNT7 activity, which in turn lead to increased nephronectin glycosylation and product secretion, thereby resulting in a higher rate of osteoblast differentiation