SparCL: Sparse Continual Learning on the Edge

Existing work in continual learning (CL) focuses on mitigating catastrophic forgetting, i.e., model performance deterioration on past tasks when learning a new task. However, the training efficiency of a CL system is under-investigated, which limits the real-world application of CL systems under resource-limited scenarios. In this work, we propose a novel framework called Sparse Continual Learning(SparCL), which is the first study that leverages sparsity to enable cost-effective continual learning on edge devices. SparCL achieves both training acceleration and accuracy preservation through the synergy of three aspects: weight sparsity, data efficiency, and gradient sparsity. Specifically, we propose task-aware dynamic masking (TDM) to learn a sparse network throughout the entire CL process, dynamic data removal (DDR) to remove less informative training data, and dynamic gradient masking (DGM) to sparsify the gradient updates. Each of them not only improves efficiency, but also further mitigates catastrophic forgetting. SparCL consistently improves the training efficiency of existing state-of-the-art (SOTA) CL methods by at most 23X less training FLOPs, and, surprisingly, further improves the SOTA accuracy by at most 1.7%. SparCL also outperforms competitive baselines obtained from adapting SOTA sparse training methods to the CL setting in both efficiency and accuracy. We also evaluate the effectiveness of SparCL on a real mobile phone, further indicating the practical potential of our method.Comment: Published at NeurIPS 2022 as a conference pape

Human Norovirus NTPase Antagonizes Interferon-β Production by Interacting With IkB Kinase ε.

Human norovirus (HuNoV) is the leading cause of epidemic acute gastroenteritis worldwide. Type I interferons (IFN)-α/β are highly potent cytokines that are initially identified for their essential roles in antiviral defense. It was reported that HuNoV infection did not induce IFN-β expression but was controlled in the presence of IFN-β in human intestinal enteroids and a gnotobiotic pig model, suggesting that HuNoV has likely developed evasion countermeasures. In this study, we found that a cDNA clone of GII.4 HuNoV, the predominantly circulating genotype worldwide, inhibits the production of IFN-β and identified the viral NTPase as a key component responsible for such inhibition. HuNoV NTPase not only inhibits the activity of IFN-β promoter but also the mRNA and protein production of IFN-β. Additional studies indicate that NTPase inhibits the phosphorylation and nuclear translocation of interferon-regulatory factor-3 (IRF-3), leading to the suppression of IFN-β promoter activation. Mechanistically, NTPase interacts with IkB kinase ε (IKKε), an important factor for IRF-3 phosphorylation, and such interaction blocks the association of IKKε with unanchored K48-linked polyubiquitin chains, resulting in the inhibition of IKKε phosphorylation. Further studies demonstrated that the 1-179 aa domain of NTPase which interacts with IKKε is critical for the suppression of IFN-β production. Our findings highlight the role of HuNoV NTPase in the inhibition of IFN-β production, providing insights into a novel mechanism underlying how HuNoV evades the host innate immunity

Effects of three different probiotics of Tibetan sheep origin and their complex probiotics on intestinal damage, immunity, and immune signaling pathways of mice infected with Clostridium perfringens type C

Tibetan sheep have unique intestinal microorganisms in their intestines that are adapted to the highland alpine and anoxic environment. To further clarify the probiotic properties of Tibetan sheep-derived probiotics, we selected three Tibetan sheep-derived probiotic isolates (Enterococcus faecalis EF1-mh, Bacillus subtilis BS1-ql, and Lactobacillus sakei LS-ql) to investigate the protective mechanisms of monocultures and their complex strains against Clostridium perfringens type C infection in mice. We established a model of C. perfringens type C infection and used histology and molecular biology to analyze the effects and mechanisms of different probiotic treatments on mice after C. perfringens type C infection. After supplementation with either probiotics or complex probiotics, mice were improved in terms of weight reduction and reduced the levels of cytokines in serum and increased the levels of intestinal sIgA, and supplementation with complex probiotics was effective. In addition, both probiotic and complex probiotic supplementation effectively improved the damage of intestinal mucosa and spleen tissue. The relative expressions of Muc 2, Claudin-1, and Occludin genes were increased in the ileum. The three probiotics and the compound probiotics treatment significantly reduced the relative mRNA expression of toll-like/MyD88/NF-κB/MAPK. The effect of probiotic treatment was similar to the results of engramycin treatment, but the effect of engramycin treatment on intestinal sIgA was not significant. Our results clarify the immunomodulatory effects of the three probiotic isolates and the complex probiotics on C. perfringens infection, and the repair of the intestinal mucosal barrier

MUX64, an analogue 64-to-1 multiplexer ASIC for the ATLAS High Granularity Timing Detector

We present the design and the performance of MUX64, a 64-to-1 analogue multiplexer ASIC for the ATLAS High Granularity Timing Detector (HGTD). The MUX64 transmits one of its 64 inputs selected by six address lines for the voltages or temperatures being monitored to an lpGBT ADC channel. The prototype ASICs fabricated in TSMC 130 nm CMOS technology were prepared in wire-bonding and QFN88 packaging format. A total of 280 chips was examined for functionality and quality assurance. The accelerated aging test conducted at 85 degrees celsius shows negligible degradation over 16 days

Alpha-Tubulin and Small Subunit rRNA Phylogenies of Peritrichs Are Congruent and Do Not Support the Clustering of Mobilids and Sessilids (Ciliophora, Oligohymenophorea)

Peritrich ciliates have been traditionally subdivided into two orders, Sessilida and Mobilida within the subclass Peritrichia. However, all the existing small subunit (SSU) rRNA phylogenetic trees showed that the sessilids and mobilids did not branch together. To shed some light on this disagreement, we tested whether or not the classic Peritrichia is a monophyletic group by assessing the reliability of the SSU rRNA phylogeny in terms of congruency with alpha-tubulin phylogeny. For this purpose, we obtained 10 partial alpha-tubulin sequences from peritrichs and built phylogenetic trees based on alpha-tubulin nucleotide and amino acid data. A phylogenetic tree from the alpha-tubulin and SSU rRNA genes in combination was also constructed and compared with that from the SSU rRNA gene using a similar species sampling. Our results show that the mobilids and sessilids are consistently separated in all trees, which reinforces the idea that the peritrichs do not constitute a monophyletic group. However, in all alpha-tubulin gene trees, the urceolariids and trichodiniids do not group together, suggested mobilids may not be a monophyletic group

Solution for Pursuit-Evasion Game of Agents by Adaptive Dynamic Programming

The paper studies a novel method for real-time solutions of the two-player pursuit-evasion game. The min-max principle is adopted to confirm the Nash equilibrium of the game. As agents in the game can form an Internet of Things (IoT) system, the real-time control law of each agent is obtained by taking a linear-quadratic cost function in adaptive dynamic programming. By introducing the Lyapunov function, we consider the scenario when capture occurs. Since most actual systems are continuous, the policy iteration algorithm is used to make the real-time policy converge to the analytical solution of the Nash equilibrium. Furthermore, we employ the value function approximation method to calculate the neural network parameters without directly solving the Hamilton–Jacobi–Isaacs equation. Simulation results depict the method’s feasibility in different scenarios of the pursuit-evasion game

Online Adaptive Dynamic Programming-Based Solution of Networked Multiple-Pursuer and Single-Evader Game

This paper presents a new scheme for the online solution of a networked multi-agent pursuit–evasion game based on an online adaptive dynamic programming method. As a multi-agent in the game can form an Internet of Things (IoT) system, by incorporating the relative distance and the control energy as the performance index, the expression of the policies when the agents reach the Nash equilibrium is obtained and proved by the minmax principle. By constructing a Lyapunov function, the capture conditions of the game are obtained and discussed. In order to enable each agent to obtain the policy for reaching the Nash equilibrium in real time, the online adaptive dynamic programming method is used to solve the game problem. Furthermore, the parameters of the neural network are fitted by value function approximation, which avoids the difficulties of solving the Hamilton-Jacobi–Isaacs equation, and the numerical solution of the Nash equilibrium is obtained. Simulation results depict the feasibility of the proposed method for use on multi-agent pursuit–evasion games

Distributed square root fuzzy cubature information filter for object tracking on the possibilistic framework

Abstract In this study, a distributed fuzzy filter is proposed for a non‐linear state estimation problem on the possibilistic framework. Firstly, instead of Gaussian distribution on the probability framework, the process and observation noises are modelled as fuzzy random variables with trapezoidal possibility distributions. Secondly, a novel square root fuzzy cubature information filtering (SRFCIF) algorithm is proposed to deal with non‐linear state estimation with fuzzy noise; a fuzzy variable fusion (FVF) algorithm is used for fuzzy random variables fusion. Consequently, a distributed square root fuzzy cubature information filter (DSRFCIF) is proposed by embedding SRFCF and FVF into the consensus frame. Finally, consistency analysis and simulation demonstration are executed for the proposed filter

Table_4_Effects of three different probiotics of Tibetan sheep origin and their complex probiotics on intestinal damage, immunity, and immune signaling pathways of mice infected with Clostridium perfringens type C.XLSX

Tibetan sheep have unique intestinal microorganisms in their intestines that are adapted to the highland alpine and anoxic environment. To further clarify the probiotic properties of Tibetan sheep-derived probiotics, we selected three Tibetan sheep-derived probiotic isolates (Enterococcus faecalis EF1-mh, Bacillus subtilis BS1-ql, and Lactobacillus sakei LS-ql) to investigate the protective mechanisms of monocultures and their complex strains against Clostridium perfringens type C infection in mice. We established a model of C. perfringens type C infection and used histology and molecular biology to analyze the effects and mechanisms of different probiotic treatments on mice after C. perfringens type C infection. After supplementation with either probiotics or complex probiotics, mice were improved in terms of weight reduction and reduced the levels of cytokines in serum and increased the levels of intestinal sIgA, and supplementation with complex probiotics was effective. In addition, both probiotic and complex probiotic supplementation effectively improved the damage of intestinal mucosa and spleen tissue. The relative expressions of Muc 2, Claudin-1, and Occludin genes were increased in the ileum. The three probiotics and the compound probiotics treatment significantly reduced the relative mRNA expression of toll-like/MyD88/NF-κB/MAPK. The effect of probiotic treatment was similar to the results of engramycin treatment, but the effect of engramycin treatment on intestinal sIgA was not significant. Our results clarify the immunomodulatory effects of the three probiotic isolates and the complex probiotics on C. perfringens infection, and the repair of the intestinal mucosal barrier.</p

Table_2_Effects of three different probiotics of Tibetan sheep origin and their complex probiotics on intestinal damage, immunity, and immune signaling pathways of mice infected with Clostridium perfringens type C.XLSX

Tibetan sheep have unique intestinal microorganisms in their intestines that are adapted to the highland alpine and anoxic environment. To further clarify the probiotic properties of Tibetan sheep-derived probiotics, we selected three Tibetan sheep-derived probiotic isolates (Enterococcus faecalis EF1-mh, Bacillus subtilis BS1-ql, and Lactobacillus sakei LS-ql) to investigate the protective mechanisms of monocultures and their complex strains against Clostridium perfringens type C infection in mice. We established a model of C. perfringens type C infection and used histology and molecular biology to analyze the effects and mechanisms of different probiotic treatments on mice after C. perfringens type C infection. After supplementation with either probiotics or complex probiotics, mice were improved in terms of weight reduction and reduced the levels of cytokines in serum and increased the levels of intestinal sIgA, and supplementation with complex probiotics was effective. In addition, both probiotic and complex probiotic supplementation effectively improved the damage of intestinal mucosa and spleen tissue. The relative expressions of Muc 2, Claudin-1, and Occludin genes were increased in the ileum. The three probiotics and the compound probiotics treatment significantly reduced the relative mRNA expression of toll-like/MyD88/NF-κB/MAPK. The effect of probiotic treatment was similar to the results of engramycin treatment, but the effect of engramycin treatment on intestinal sIgA was not significant. Our results clarify the immunomodulatory effects of the three probiotic isolates and the complex probiotics on C. perfringens infection, and the repair of the intestinal mucosal barrier.</p