Conditional DETR for Fast Training Convergence

The recently-developed DETR approach applies the transformer encoder and decoder architecture to object detection and achieves promising performance. In this paper, we handle the critical issue, slow training convergence, and present a conditional cross-attention mechanism for fast DETR training. Our approach is motivated by that the cross-attention in DETR relies highly on the content embeddings for localizing the four extremities and predicting the box, which increases the need for high-quality content embeddings and thus the training difficulty. Our approach, named conditional DETR, learns a conditional spatial query from the decoder embedding for decoder multi-head cross-attention. The benefit is that through the conditional spatial query, each cross-attention head is able to attend to a band containing a distinct region, e.g., one object extremity or a region inside the object box. This narrows down the spatial range for localizing the distinct regions for object classification and box regression, thus relaxing the dependence on the content embeddings and easing the training. Empirical results show that conditional DETR converges 6.7x faster for the backbones R50 and R101 and 10x faster for stronger backbones DC5-R50 and DC5-R101. Code is available at https://github.com/Atten4Vis/ConditionalDETR.Comment: Accepted by ICCV 2021. The first two authors share first authorship, and the order was determined by rolling dic

Fusion of HPV L1 into Shigella surface IcsA : a new approach in developing live attenuated Shigella-HPV vaccine

Despite the success of L1 virus-like particles (VLPs) vaccines in prevention of high-risk human papillomavirus (HPV) infection and cervical cancer, extraordinary high cost for the complete vaccination has impeded widespread use of the vaccine in resource-poor countries, where cervical cancers impose greater challenge. Presentation of HPV L1 protein by attenuated pathogenic bacteria through natural infection provides a promising low-cost and convenient alternative. Here, we describe the construction and characterization of attenuated L1-expressing Shigella vaccine candidate, by fusion of L1 into the autotransporter of Shigella sonnei, IcsA, an essential virulence factor responsible for actin-based motility. The functional α domain of IcsA was replaced by codon-optimized L1 gene with independent open reading frames (ORFs) facilitated by suicide vector pJCB12. The L1 gene was stabilized in the genome of recombinant S. sonnei with protein expression and assembly of VLPs in the bacterial cytoplasm. Through conjunctival route vaccination in guinea pigs, L1-containing S. sonnei was able to elicit specific immune response to HPV16 L1 VLP as well as bacterial antigens. The results demonstrated the feasibility of the novel stratagem to develop prophylactic Shigella-HPV vaccines