Fast-iTPN: Integrally Pre-Trained Transformer Pyramid Network with Token Migration

We propose integrally pre-trained transformer pyramid network (iTPN), towards jointly optimizing the network backbone and the neck, so that transfer gap between representation models and downstream tasks is minimal. iTPN is born with two elaborated designs: 1) The first pre-trained feature pyramid upon vision transformer (ViT). 2) Multi-stage supervision to the feature pyramid using masked feature modeling (MFM). iTPN is updated to Fast-iTPN, reducing computational memory overhead and accelerating inference through two flexible designs. 1) Token migration: dropping redundant tokens of the backbone while replenishing them in the feature pyramid without attention operations. 2) Token gathering: reducing computation cost caused by global attention by introducing few gathering tokens. The base/large-level Fast-iTPN achieve 88.75%/89.5% top-1 accuracy on ImageNet-1K. With 1x training schedule using DINO, the base/large-level Fast-iTPN achieves 58.4%/58.8% box AP on COCO object detection, and a 57.5%/58.7% mIoU on ADE20K semantic segmentation using MaskDINO. Fast-iTPN can accelerate the inference procedure by up to 70%, with negligible performance loss, demonstrating the potential to be a powerful backbone for downstream vision tasks. The code is available at: github.com/sunsmarterjie/iTPN.Comment: The tiny/small/base-level models report new records on ImageNet-1K. Code: github.com/sunsmarterjie/iTP

Insights into the issue in IPv6 adoption: a view from the Chinese IPv6 Application mix

Published onlineThis is the author accepted manuscript. The final version is available from Wiley via the DOI in this record.Although IPv6 has been standardized more than 15 years ago, its deployment is still very limited. China has been strongly pushing IPv6, especially due to its limited IPv4 address space. In this paper, we describe measurements from a large Chinese academic network, serving a significant population of IPv6 hosts. We show that despite its expected strength, China is struggling as much as the western world to increase the share of IPv6 traffic. To understand the reasons behind this, we examine the IPv6 applicative ecosystem. We observe a significant IPv6 traffic growth over the past 3 years, with P2P file transfers responsible for more than 80% of the IPv6 traffic, compared with only 15% for IPv4 traffic. Checking the top websites for IPv6 explains the dominance of P2P, with popular P2P trackers appearing systematically among the top visited sites, followed by Chinese popular services (e.g., Tencent), as well as surprisingly popular third-party analytics including Google. Finally, we compare the throughput of IPv6 and IPv4 flows. We find that a larger share of IPv4 flows get a high-throughput compared with IPv6 flows, despite IPv6 traffic not being rate limited. We explain this through the limited amount of HTTP traffic in IPv6 and the presence of Web caches in IPv4. Our findings highlight the main issue in IPv6 adoption, that is, the lack of commercial content, which biases the geographic pattern and flow throughput of IPv6 traffic. Copyright © 2014 John Wiley & Sons, Ltd

Deterministic Computing Power Networking: Architecture, Technologies and Prospects

With the development of new Internet services such as computation-intensive and delay-sensitive tasks, the traditional "Best Effort" network transmission mode has been greatly challenged. The network system is urgently required to provide end-to-end transmission determinacy and computing determinacy for new applications to ensure the safe and efficient operation of services. Based on the research of the convergence of computing and networking, a new network paradigm named deterministic computing power networking (Det-CPN) is proposed. In this article, we firstly introduce the research advance of computing power networking. And then the motivations and scenarios of Det-CPN are analyzed. Following that, we present the system architecture, technological capabilities, workflow as well as key technologies for Det-CPN. Finally, the challenges and future trends of Det-CPN are analyzed and discussed

ChatterBox: Multi-round Multimodal Referring and Grounding

In this study, we establish a baseline for a new task named multimodal multi-round referring and grounding (MRG), opening up a promising direction for instance-level multimodal dialogues. We present a new benchmark and an efficient vision-language model for this purpose. The new benchmark, named CB-300K, spans challenges including multi-round dialogue, complex spatial relationships among multiple instances, and consistent reasoning, which are beyond those shown in existing benchmarks. The proposed model, named ChatterBox, utilizes a two-branch architecture to collaboratively handle vision and language tasks. By tokenizing instance regions, the language branch acquires the ability to perceive referential information. Meanwhile, ChatterBox feeds a query embedding in the vision branch to a token receiver for visual grounding. A two-stage optimization strategy is devised, making use of both CB-300K and auxiliary external data to improve the model's stability and capacity for instance-level understanding. Experiments show that ChatterBox outperforms existing models in MRG both quantitatively and qualitatively, paving a new path towards multimodal dialogue scenarios with complicated and precise interactions. Code, data, and model are available at: https://github.com/sunsmarterjie/ChatterBox.Comment: 17 pages, 6 tables, 9 figurs. Code, data, and model are available at: https://github.com/sunsmarterjie/ChatterBo

Chinese Angelica Polysaccharide (CAP) Alleviates LPS-Induced Inflammation and Apoptosis by Down-Regulating COX-1 in PC12 Cells

Background/Aims: Chinese angelica polysaccharide (CAP) is the main effective ingredient of angelica sinensis and exerts anti-inflammatory and anti-apoptotic effects on many diseases. This study aimed to explore the pharmacological potential of CAP on spinal cord injury (SCI). Methods: PC12 cells were pretreated by CAP and were subjected to LPS. Transfection was performed to alter the expression of COX-1. Cell viability and apoptotic cell rate were measured by CCK-8 and flow cytometry respectively. qRT-PCR and western blot analysis were performed to assess the expression changes of pro-inflammatory cytokines, apoptosis-related factor and core kinases in PI3K/AKT pathway. Results: LPS stimulation induced significant cell damage in PC12 cells as cell viability was repressed, apoptosis was induced and the expression levels of IL-1β, IL-6, IL-8, and TNF-α were increased. CAP pretreatment protected PC12 cells against LPS-induced cell damage. Meanwhile CAP treatment reduced the expression of COX-1 even in LPS-stimulated PC12 cells. More importantly, COX-1 overexpression abolished the protective effects of CAP on LPS-injured PC12 cells. Finally, Western blot analytical results showed that CAP activated PI3K/AKT pathway also in a COX-1-dependent manner. Conclusion: CAP exerted anti-apoptotic and anti-inflammatory effects on LPS-injured PC12 cells via down-regulation of COX-1

Exploration of an Actin Promoter-Based Transient Expression Vector to Trace the Cellular Localization of Nucleorhabdovirus Proteins in Leafhopper Cultured Cells

Continuously cultured cell lines derived from planthopper and leafhopper have greatly facilitated the investigation of rice viruses transmitted by these insects. However, the lack of a suitable transient expression vector has limited their utility. Here, by cloning and analyzing the promoter sequence of the gene encoding cytoplasmic actin from the leafhopper Nephotettix cincticeps, we successfully developed the first efficient transient expression vector for cultured leafhopper cells, which can also be used to express exogenous proteins in other insect culture cell lines, including those derived from Recilia dorsalis leafhopper and Spodoptera frugiperda (Sf9). Furthermore, insertion of the Hr5 viral enhancer element and knockdown of the endogenous Dicer2 gene notably improved the vector’s expression efficiency in leafhopper cells. Using the optimized vector, we have for the first time traced the cellular localization of the proteins encoded by rice yellow stunt virus (RYSV) in cells of its insect vector and demonstrated that P6 protein is a component of the viroplasm

Automatic Root Cause Analysis via Large Language Models for Cloud Incidents

Ensuring the reliability and availability of cloud services necessitates efficient root cause analysis (RCA) for cloud incidents. Traditional RCA methods, which rely on manual investigations of data sources such as logs and traces, are often laborious, error-prone, and challenging for on-call engineers. In this paper, we introduce RCACopilot, an innovative on-call system empowered by the large language model for automating RCA of cloud incidents. RCACopilot matches incoming incidents to corresponding incident handlers based on their alert types, aggregates the critical runtime diagnostic information, predicts the incident's root cause category, and provides an explanatory narrative. We evaluate RCACopilot using a real-world dataset consisting of a year's worth of incidents from Microsoft. Our evaluation demonstrates that RCACopilot achieves RCA accuracy up to 0.766. Furthermore, the diagnostic information collection component of RCACopilot has been successfully in use at Microsoft for over four years

The oyster genome reveals stress adaptation and complexity of shell formation

The Pacific oyster Crassostrea gigas belongs to one of the most species-rich but genomically poorly explored phyla, the Mollusca. Here we report the sequencing and assembly of the oyster genome using short reads and a fosmid-pooling strategy, along with transcriptomes of development and stress response and the proteome of the shell. The oyster genome is highly polymorphic and rich in repetitive sequences, with some transposable elements still actively shaping variation. Transcriptome studies reveal an extensive set of genes responding to environmental stress. The expansion of genes coding for heat shock protein 70 and inhibitors of apoptosis is probably central to the oyster's adaptation to sessile life in the highly stressful intertidal zone. Our analyses also show that shell formation in molluscs is more complex than currently understood and involves extensive participation of cells and their exosomes. The oyster genome sequence fills a void in our understanding of the Lophotrochozoa. © 2012 Macmillan Publishers Limited. All rights reserved

Rotational Spectroscopy of 2-Furoic Acid and Its Dimer: Conformational Distribution and Double Proton Tunneling

Structural and tunneling properties of the 2-furoic acid (FA) monomer and dimer were investigated using rotational spectroscopy and DFT calculations. CREST, a conformational ensemble space exploration tool, was used to identify all possible low-energy conformations of the FA monomer and dimer, followed by the DFT geometry optimization and harmonic frequency calculations. Broadband rotational spectra in the 2–6 and 8–12 GHz regions were recorded in a supersonic jet expansion. The monomeric FA was found to exist dominantly as three different conformers: I, II, and III in a jet, with I and II taking on the cis-COOH configuration while III having the trans-COOH configuration. For the FA dimer, only the I–II conformer was observed experimentally, whereas the symmetric I–I and II–II conformers were not observed because of their zero dipole moments. The analysis of the splittings in the rotational transitions of I–II allowed one to extract the tunneling splitting to be 1056.0(12) MHz. The barrier height was determined to be ∼442 cm−1 using the scaled potential energy scans at several different levels of theory.This research was funded by the University of Alberta and the Natural Sciences and Engineering Research Council (NSERC) of Canada.Peer reviewe