WHC: Weighted Hybrid Criterion for Filter Pruning on Convolutional Neural Networks

Filter pruning has attracted increasing attention in recent years for its capacity in compressing and accelerating convolutional neural networks. Various data-independent criteria, including norm-based and relationship-based ones, were proposed to prune the most unimportant filters. However, these state-of-the-art criteria fail to fully consider the dissimilarity of filters, and thus might lead to performance degradation. In this paper, we first analyze the limitation of relationship-based criteria with examples, and then introduce a new data-independent criterion, Weighted Hybrid Criterion (WHC), to tackle the problems of both norm-based and relationship-based criteria. By taking the magnitude of each filter and the linear dependence between filters into consideration, WHC can robustly recognize the most redundant filters, which can be safely pruned without introducing severe performance degradation to networks. Extensive pruning experiments in a simple one-shot manner demonstrate the effectiveness of the proposed WHC. In particular, WHC can prune ResNet-50 on ImageNet with more than 42% of floating point operations reduced without any performance loss in top-5 accuracy.Comment: Accepted by ICASSP 202

East Learns from West: Asiatic Honeybees Can Understand Dance Language of European Honeybees

The honeybee waggle dance, through which foragers advertise the existence and location of a food source to their hive mates, is acknowledged as the only known form of symbolic communication in an invertebrate. However, the suggestion, that different species of honeybee might possess distinct ‘dialects’ of the waggle dance, remains controversial. Furthermore, it remains unclear whether different species of honeybee can learn from and communicate with each other. This study reports experiments using a mixed-species colony that is composed of the Asiatic bee Apis cerana cerana (Acc), and the European bee Apis mellifera ligustica (Aml). Using video recordings made at an observation hive, we first confirm that Acc and Aml have significantly different dance dialects, even when made to forage in identical environments. When reared in the same colony, these two species are able to communicate with each other: Acc foragers could decode the dances of Aml to successfully locate an indicated food source. We believe that this is the first report of successful symbolic communication between two honeybee species; our study hints at the possibility of social learning between the two honeybee species, and at the existence of a learning component in the honeybee dance language

Spinal nerve segmentation method and dataset construction in endoscopic surgical scenarios

Endoscopic surgery is currently an important treatment method in the field of spinal surgery and avoiding damage to the spinal nerves through video guidance is a key challenge. This paper presents the first real-time segmentation method for spinal nerves in endoscopic surgery, which provides crucial navigational information for surgeons. A finely annotated segmentation dataset of approximately 10,000 consec-utive frames recorded during surgery is constructed for the first time for this field, addressing the problem of semantic segmentation. Based on this dataset, we propose FUnet (Frame-Unet), which achieves state-of-the-art performance by utilizing inter-frame information and self-attention mechanisms. We also conduct extended exper-iments on a similar polyp endoscopy video dataset and show that the model has good generalization ability with advantageous performance. The dataset and code of this work are presented at: https://github.com/zzzzzzpc/FUnet .Comment: Accepted by MICCAI 202

Differential expression of miRNAs related to caste differentiation in the honey bee, Apis mellifera

International audienceAbstractHoney bees are very important eusocial insects and are involved in the pollination of many plants. Queen bees and worker bees can develop from the same fertilized eggs and are thus genetically identical despite their substantial behavioral and physiological differences. The mechanism governing developmental differences between worker and queen bees has always attracted much interest. While there are several reports on messenger RNA (mRNA) expression related to caste differentiation or microRNA (miRNA) expression in one time point of caste differentiation, no systematic investigation of the dynamic expression of small RNAs along with these two caste development has, thus far, been carried out. In this study, we present the dynamic expression profiles of queen and worker bee small RNAs and show caste-specific miRNA expression patterns between them, indicating that miRNAs may be related to the differential development of worker and queen bee larvae. Results presented here will make a valuable contribution to understanding of the caste switch between worker and queen bees

Viral Infection Affects Sucrose Responsiveness and Homing Ability of Forager Honey Bees, Apis mellifera L

Honey bee health is mainly affected by Varroa destructor, viruses, Nosema spp., pesticide residues and poor nutrition. Interactions between these proposed factors may be responsible for the colony losses reported worldwide in recent years. In the present study, the effects of a honey bee virus, Israeli acute paralysis virus (IAPV), on the foraging behaviors and homing ability of European honey bees (Apis mellifera L.) were investigated based on proboscis extension response (PER) assays and radio frequency identification (RFID) systems. The pollen forager honey bees originated from colonies that had no detectable level of honey bee viruses and were manually inoculated with IAPV to induce the viral infection. The results showed that IAPV-inoculated honey bees were more responsive to low sucrose solutions compared to that of non-infected foragers. After two days of infection, around 10⁷ copies of IAPV were detected in the heads of these honey bees. The homing ability of IAPV-infected foragers was depressed significantly in comparison to the homing ability of uninfected foragers. The data provided evidence that IAPV infection in the heads may enable the virus to disorder foraging roles of honey bees and to interfere with brain functions that are responsible for learning, navigation, and orientation in the honey bees, thus, making honey bees have a lower response threshold to sucrose and lose their way back to the hive.This study was supported by earmarked funds for Modern Agro-industry Technology Research System (No. CARS-45-KXJ3), Nature and Science Foundation Commission of Zhejiang Province (R3080306) to SKS. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript

Molecular Cloning and Characterization of Juvenile Hormone Acid Methyltransferase in the Honey Bee, Apis mellifera, and Its Differential Expression during Caste Differentiation

Juvenile hormone acid methyltransferase (JHAMT) is an enzyme involved in one of the final steps of juvenile hormone biosynthesis in insects. It transfers a methyl group from S-adenosyl-L-methionine (SAM) to the carboxyl group of either farnesoic acid (FA) or JH acid (JHA). Several genes coding for JHAMT have been cloned and characterized from insects from different orders, and they have been shown to play critical roles in metamorphosis and reproduction. However, the significance of JHAMT in Hymenopteran insects is unknown. We used RACE amplification method to clone JHAMT cDNA from the honey bee, Apis mellifera (AmJHAMT). The full length cDNA of AmJHAMT that we cloned is 1253bp long and encodes a 278-aa protein that shares 32-36% identity with known JHAMTs. A SAM-binding motif, conserved in the SAM-dependent methyltransferase (SAM-MT) superfamily, is present in AmJHAMT. Its secondary structure also contains a typical SAM-MT fold. Most of the active sites bound with SAM and substrates (JHA or FA) are conserved in AmJHAMT as in other JHAMT orthologs. Phylogenetic analysis clustered AmJHAMT with the other orthologs from Hymenoptera to form a major clade in the phylogenetic tree. Purified recombinant AmJHAMT protein expressed in E. coli was used to produce polyclonal antibodies and to verify the identity of AmJHAMT by immunoblotting and mass spectrometry. Quantitative RT-PCR and immunoblotting analyses revealed that queen larvae contained significantly higher levels of AmJHAMT mRNA and protein than worker larvae during the periods of caste development. The temporal profiles of both AmJHAMT mRNA and protein in queens and workers showed a similar pattern as the JH biosynthesis. These results suggest that the gene that we cloned codes for a functional JHAMT that catalyzes the final reactions of JH biosynthesis in honey bees. In addition, AmJHAMT may play an important role in honey bee caste differentiation.The research was supported by the earmarked funds for Modern Agro-industry Technology Research System (No.CARS-45-KXJ3) and National Natural Science Foundation of China (No.30571409) to SKS. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript

Recipe for a Busy Bee: MicroRNAs in Honey Bee Caste Determination

Social caste determination in the honey bee is assumed to be determined by the dietary status of the young larvae and translated into physiological and epigenetic changes through nutrient-sensing pathways. We have employed Illumina/Solexa sequencing to examine the small RNA content in the bee larval food, and show that worker jelly is enriched in miRNA complexity and abundance relative to royal jelly. The miRNA levels in worker jelly were 7-215 fold higher than in royal jelly, and both jellies showed dynamic changes in miRNA content during the 4(th) to 6(th) day of larval development. Adding specific miRNAs to royal jelly elicited significant changes in queen larval mRNA expression and morphological characters of the emerging adult queen bee. We propose that miRNAs in the nurse bee secretions constitute an additional element in the regulatory control of caste determination in the honey bee.The research was supported by National Sciences Foundation of China Grant No.30630040; National Key Basic Research & Development Program 973 under Grant Nos. 2009CB825401 and 2007CB946901 to RSC, the earmarked fund for Modern Agro-industry Technology Research System (No. CARS-45-KXJ3), and a grant of the National Natural Science Foundation of China (NSFC 30571409) to SKS, and the Nature and Science Foundation Commission of Zhejiang Province (R3080306) to SKS. Zhang was supported by the Australian Research Council through the ARC Centre of Excellence in Vision Science (CE0561903). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript

Optimal Tracking Performance of MIMO Discrete-Time Systems with Network Parameters

The optimal regulation properties of multi-input and multioutput (MIMO) discrete-time networked control systems (NCSs), over additive white Gaussian noise (AWGN) fading channels, based on state space representation, are investigated. The average performance index is introduced. Moreover, the regulation performance is measured by the control energy and the error energy of the system, and fundamental limitations are obtained. Two kinds of network parameters, fading and the additive white Gaussian noise, are considered. The best attainable regulation performance limitations can be obtained by the limiting steady state solution of the corresponding algebraic Riccati equation (ARE). The simulation results are given to demonstrate the main results of the theoretical development