Practical Differentially Private and Byzantine-resilient Federated Learning

Privacy and Byzantine resilience are two indispensable requirements for a federated learning (FL) system. Although there have been extensive studies on privacy and Byzantine security in their own track, solutions that consider both remain sparse. This is due to difficulties in reconciling privacy-preserving and Byzantine-resilient algorithms. In this work, we propose a solution to such a two-fold issue. We use our version of differentially private stochastic gradient descent (DP-SGD) algorithm to preserve privacy and then apply our Byzantine-resilient algorithms. We note that while existing works follow this general approach, an in-depth analysis on the interplay between DP and Byzantine resilience has been ignored, leading to unsatisfactory performance. Specifically, for the random noise introduced by DP, previous works strive to reduce its impact on the Byzantine aggregation. In contrast, we leverage the random noise to construct an aggregation that effectively rejects many existing Byzantine attacks. We provide both theoretical proof and empirical experiments to show our protocol is effective: retaining high accuracy while preserving the DP guarantee and Byzantine resilience. Compared with the previous work, our protocol 1) achieves significantly higher accuracy even in a high privacy regime; 2) works well even when up to 90% of distributive workers are Byzantine

Augmented 2D-TAN: A Two-stage Approach for Human-centric Spatio-Temporal Video Grounding

We propose an effective two-stage approach to tackle the problem of language-based Human-centric Spatio-Temporal Video Grounding (HC-STVG) task. In the first stage, we propose an Augmented 2D Temporal Adjacent Network (Augmented 2D-TAN) to temporally ground the target moment corresponding to the given description. Primarily, we improve the original 2D-TAN from two aspects: First, a temporal context-aware Bi-LSTM Aggregation Module is developed to aggregate clip-level representations, replacing the original max-pooling. Second, we propose to employ Random Concatenation Augmentation (RCA) mechanism during the training phase. In the second stage, we use pretrained MDETR model to generate per-frame bounding boxes via language query, and design a set of hand-crafted rules to select the best matching bounding box outputted by MDETR for each frame within the grounded moment.Comment: Best Paper Award at the 3rd Person in Context (PIC) Challenge CVPR Workshop 202

The dual role of glioma exosomal microRNAs: glioma eliminates tumor suppressor miR-1298-5p via exosomes to promote immunosuppressive effects of MDSCs

Clear evidence shows that tumors could secrete microRNAs (miRNAs) via exosomes to modulate the tumor microenvironment (TME). However, the mechanisms sorting specific miRNAs into exosomes are still unclear. In order to study the biological function and characterization of exosomal miRNAs, we performed whole-transcriptome sequencing in 59 patients’ whole-course cerebrospinal fluid (CSF) small extracellular vesicles (sEV) and matched glioma tissue samples. The results demonstrate that miRNAs could be divided into exosome-enriched miRNAs (ExomiRNAs) and intracellular-retained miRNAs (CLmiRNAs), and exosome-enriched miRNAs generally play a dual role. Among them, miR-1298-5p was enriched in CSF exosomes and suppressed glioma progression in vitro and vivo experiments. Interestingly, exosomal miR-1298-5p could promote the immunosuppressive effects of myeloid-derived suppressor cells (MDSCs) to facilitate glioma. Therefore, we found miR-1298-5p had different effects on glioma cells and MDSCs. Mechanically, downstream signaling pathway analyses showed that miR-1298-5p plays distinct roles in glioma cells and MDSCs via targeting SETD7 and MSH2, respectively. Moreover, reverse verification was performed on the intracellular-retained miRNA miR-9-5p. Thus, we confirmed that tumor-suppressive miRNAs in glioma cells could be eliminated through exosomes and target tumor-associated immune cells to induce tumor-promoting phenotypes. Glioma could get double benefit from it. These findings uncover the mechanisms that glioma selectively sorts miRNAs into exosomes and modulates tumor immunity.publishedVersio

SPI1-induced downregulation of FTO promotes GBM progression by regulating pri-miR-10a processing in an m6A-dependent manner

As one of the most common post-transcriptional modifications of mRNAs and noncoding RNAs, N6-methyladenosine (m6A) modification regulates almost every aspect of RNA metabolism. Evidence indicates that dysregulation of m6A modification and associated proteins contributes to glioblastoma (GBM) progression. However, the function of fat mass and obesity-associated protein (FTO), an m6A demethylase, has not been systematically and comprehensively explored in GBM. Here, we found that decreased FTO expression in clinical specimens correlated with higher glioma grades and poorer clinical outcomes. Functionally, FTO inhibited growth and invasion in GBM cells in vitro and in vivo. Mechanistically, FTO regulated the m6A modification of primary microRNA-10a (pri-miR-10a), which could be recognized by reader HNRNPA2B1, recruiting the microRNA microprocessor complex protein DGCR8 and mediating pri-miR-10a processing. Furthermore, the transcriptional activity of FTO was inhibited by the transcription factor SPI1, which could be specifically disrupted by the SPI1 inhibitor DB2313. Treatment with this inhibitor restored endogenous FTO expression and decreased GBM tumor burden, suggesting that FTO may serve as a novel prognostic indicator and therapeutic molecular target of GBM.publishedVersio

PyPose v0.6: The Imperative Programming Interface for Robotics

PyPose is an open-source library for robot learning. It combines a learning-based approach with physics-based optimization, which enables seamless end-to-end robot learning. It has been used in many tasks due to its meticulously designed application programming interface (API) and efficient implementation. From its initial launch in early 2022, PyPose has experienced significant enhancements, incorporating a wide variety of new features into its platform. To satisfy the growing demand for understanding and utilizing the library and reduce the learning curve of new users, we present the fundamental design principle of the imperative programming interface, and showcase the flexible usage of diverse functionalities and modules using an extremely simple Dubins car example. We also demonstrate that the PyPose can be easily used to navigate a real quadruped robot with a few lines of code

The United States COVID-19 Forecast Hub dataset

Academic researchers, government agencies, industry groups, and individuals have produced forecasts at an unprecedented scale during the COVID-19 pandemic. To leverage these forecasts, the United States Centers for Disease Control and Prevention (CDC) partnered with an academic research lab at the University of Massachusetts Amherst to create the US COVID-19 Forecast Hub. Launched in April 2020, the Forecast Hub is a dataset with point and probabilistic forecasts of incident cases, incident hospitalizations, incident deaths, and cumulative deaths due to COVID-19 at county, state, and national, levels in the United States. Included forecasts represent a variety of modeling approaches, data sources, and assumptions regarding the spread of COVID-19. The goal of this dataset is to establish a standardized and comparable set of short-term forecasts from modeling teams. These data can be used to develop ensemble models, communicate forecasts to the public, create visualizations, compare models, and inform policies regarding COVID-19 mitigation. These open-source data are available via download from GitHub, through an online API, and through R packages